Educational Policy 4.0—Assessment Assessment is an integral component of competency-based education. To evaluate the extent to which the competencies have been met, a system of assessment is central to this model of education. Data from assessment continuously inform and promote change in the explicit and implicit curriculum to enhance attainment of program competencies. Accreditation Standard 4.0.1 —Assessment (The Plan) The program presents its plan to assess the attainment of each of its competencies. The plan specifies procedures, multiple measures of each practice behavior, and benchmarks employed to assess the attainment of each of the program’s competencies (M2.0.4). The assessment plan for the CSUSM MSW Program includes multiple measures and tools. Table 9 identifies the measures, the frequencies of their administration, and the applicable benchmarks. Table 9: Assessment Plan Components Measure Method of Administration Comprehensive Field Instructor Skills Assessment evaluation of the student EPAS Course Classroom Rubric Instructor evaluation of the student Alumni Survey Employer Survey Graduates assessment of own competence, and program effectiveness Employer assessment of graduate competence, and program effectiveness Benchmark 90% of students will be found competent on each item 90% of first year students will meet the standard that indicates minimal competence on each practice behavior for foundation practice. 90% of Advanced students will meet a standard that indicates minimal competence on each behavior for advanced practice. Alumni will be judge themselves competent on 85% of practice behaviors Employers will rate former students competent on 85% of practice behaviors 1 Frequency of Admission Each semester Each semester Every 3 years Every 3 years The program will use four methods of assessment. The first is the comprehensive skills evaluation of the field practicum courses. The second is a rubric used by all classroom instructors that assesses the level of proficiency that each student has attained on the competencies and practice behaviors. The third is an alumni survey that asks graduates to assess their proficiency with each of the competencies addressed in the curriculum. The fourth is an employer survey that asks alumni to assess their proficiency with each of the competencies contained in the curriculum. Comprehensive Skills Assessment (CSA) At the end of each semester the field instructor that supervises the work of the student in a practicum will be required to assess students’ achievements of specified competencies expected in field placement. The proficiency level of a student for each of the practice behaviors encompassing a competency that is addressed by the field practicum course is rated by the student’s field instructor in the CSA. We have identified a set of EPAS competencies for foundation content and the advanced curriculum that are addressed in the field. These competencies assume that as part of the learning process students will demonstrate an acceptable level of mastery of specific skills and appropriate professional behaviors. The items will be drawn from the practice behaviors. We have identified 26 practice behaviors addressed in the foundation field courses (MSW 540 & MSW 541). Thirty-one practice behaviors are addressed in the advanced year. See Tables 5 & 6 and syllabi for the competencies assessed in a specific course. Instructors will use the following scale for assessing competence. 5= Highly competent 4= Exceeds the level of proficiency expected of a foundation or advanced practitioner 3= Meets the minimal level of proficiency expected of a foundation or advanced practitioner. No major areas of concern identified. 2= Meets the minimal level of proficiency expected, but some areas of concern that need improvement before advanced practice 1= Fails to show a minimally level of proficiency *Depending upon year the student is assessed for foundation and advanced competency. Foundation students will be expected to be rated by the end of the second semester field as at least “Meets the minimal level of proficiency expected, but needs improvement before advanced practice” (a 2 on the scale) on all competencies, and a minimum average of 2.5 rating on all items. The first and third semester’s evaluations will be used to help students identify competencies that need additional work. The second and fourth semesters will be used to assess 2 whether we are meeting the benchmarks or not. Advanced year students must be rated as a “3” on all behaviors (“Meets the minimal level the minimal level of proficiency expected for an advanced practitioner”). These assessments are completed for each field semester. Students who do not demonstrate an acceptable level of mastery of the expected competencies receive a grade of no credit and are disqualified from the program. The CSA evaluations assist in determining if the relevant EPAS competencies have been achieved. The benchmark is that 90% of students will meet the level for acceptable performance as defined above. EPAS Classroom Course Rubric The second method of assessment used by the program is made by the instructors of classes in the required foundation and advanced curriculum. As described earlier in the curriculum section of this document, practice behaviors and competencies are assessed in each course by exams, papers, presentations, class participation etc.. Taken together, the courses address all of 10 competencies and 41 practice behaviors at the foundation and advanced level. Analysis of student performance on these course based measures will enable faculty to identify whether a student demonstrated competency as well as those areas needing improvement. The instructor will use a common rubric to assess the level at which each student has demonstrated competency. The level of competency will be determined by the instructor based on the combination of papers, exams, presentations, class participation etc. completed by the student. Students will be assessed on 5 levels that are described at the end of figure 2. This figure has an example of the instrument that will be completed by the instructor. 3 The completed instrument will be turned in to the Director. The Director in turn will see that the competencies demonstrated by each student will be collated into a summary for the student. An example of how this would look is shown in Figure 3 for a student that demonstrated that she had exceeded the level of proficiency expected in all courses for all of the practice behaviors covered in the class. Figure 3 only shows the first three competencies. 4 The individual summaries for each student will reported in summary form on a program summary sheet. The scores for each competency are established by adding up the scores for the practice behaviors encompassed by a competency. For example, in Figure 2, we see that for the foundation level of the curriculum, the 1st competency “Identify as a professional social worker and conduct oneself accordingly” is addressed by three of the classroom courses; MSW 510 Generalist Practice; MSW 511 Generalist Practice with Individuals, Families, and Groups; and MSW 525 Law and Ethics. All of the practice behaviors encompassing the competency are addressed by one of more of the courses. For example, practice behavior 1 “advocate for client access to the services of social work” is addressed by MSW 540 alone, while practice behavior 2 “practice personal reflection and self-correction to assure continual professional development” is addressed in MSW 505 and MSW 540. The sum of all scores recorded for the practice behaviors encompassing a competency. In Figure 4 we see that the student received the highest scores for each practice behavior rated in each class that a rating was given. Thus, the student scored 50 at the Foundation level for the 1st competency. If the student had not met the minimum level of proficiency expected for any of the practice behaviors in any of the courses addressing the 1st competency, the scores would be all 1s instead of 5’s. The summary score would be 10 instead of 50. For the purposes of setting a benchmark, it is expected that the sum score for a competency will be the score that would be achieved if a student received a 2 for all of the practice behaviors encompassed by a competency for all of the courses that addressed one or more of the competencies. For the 1st competency, then, the benchmark score for the foundation level is 20. For the Advanced Curriculum, the benchmark score is 4. The numbers in the that are in bold Figure 3 summarize the benchmark scores expected for each of the competencies. We expect 90% of students to achieve these benchmarks. 5 Figure 3: EPAS Summary of Student Performance Foundation Content Name_____________. Competency & Practice Behavior E.P. 2.1.1 Identify as a professional social worker and conduct oneself accordingly. PB 1. Advocate for client access to the services of social work PB 2. Practice personal reflection and self-correction to ensure continual professional development PB 3. Attend to professional roles and boundaries PB 4. Demonstrate professional demeanor in behavior, appearance, and communication PB 5. Engage in career long learning PB 6. Use supervision and consultation Summary EP 2.1.1 Score E.P. 2.1.2 PB 7. Recognize and manage personal values in a way that allows professional values to guide practice PB 8. Make ethical decisions by applying the standards of the NASW Code of Ethics and if applicable the IFSW/ASSW Statement of Principles PB 9. Tolerate ambiguity in resolving conflicts PB 10. Apply strategies of ethical reasoning to arrive at principled decisions Summary E.P. 2.1.2 score Apply social work ethical principles to guide professional practice E.P. 2.1.3 Apply critical thinking to inform and communicate professional judgments PB 11. Distinguish, appraise, and integrate multiple sources of knowledge including research-based knowledge and practice wisdom PB 12. Analyze models of assessment, prevention, and evaluation PB 13. Demonstrate effective oral and written communication in working with individuals, families, groups, organizations, communities, and colleagues Summary E.P. 2.1.3 score 500 HBSE I 501 HBSE II 510 GP 511 GP IF&G 512 GP Macro 520 Social Policy 525 Law & Ethics 5 550 Research Summary Score on EP Comp. 5 5 5 5 5 5 5 5 5 5 5 5 20 25 50 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 20 20 20 20 10 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 10 15 15 15 15 10 6 95 5 10 90 Advanced Content – Concentration Name___________________. Competency & Practice Behavior E.P. 2.1.1 Identify as a professional social worker and conduct oneself accordingly. PB 1. Advocate for client access to the services of social work PB 2. Practice personal reflection and self-correction to ensure continual professional development PB 3. Attend to professional roles and boundaries PB 4. Demonstrate professional demeanor in behavior, appearance, and communication PB 5. Engage in career long learning PB 6. Use supervision and consultation Summary EP 2.1.1 Score E.P. 2.1.2 PB 7. Recognize and manage personal values in a way that allows professional values to guide practice PB 8. Make ethical decisions by applying the standards of the NASW Code of Ethics and if applicable the IFSW/ASSW Statement of Principles PB 9. Tolerate ambiguity in resolving conflicts PB 10. Apply strategies of ethical reasoning to arrive at principled decisions Summary E.P. 2.1.2 score Apply social work ethical principles to guide professional practice E.P. 2.1.3 Apply critical thinking to inform and communicate professional judgments PB 11. Distinguish, appraise, and integrate multiple sources of knowledge including research-based knowledge and practice wisdom PB 12. Analyze models of assessment, prevention, and evaluation PB 13. Demonstrate effective oral and written communication in working with individuals, families, groups, organizations, communities, and colleagues Summary E.P. 2.1.3 score 602 ADV. HBSE 5 630A &B ADV. Practice Ind. 631A & B ADV. Practice Family & Group 635A & B ADV. Policy 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 20 20 20 5 5 5 5 5 5 15 10 650 ADV Research 695 Capstone Summary Score on EP Comp. 10 60 5 5 5 7 10 40 8 Employer Survey The Employer Survey is conducted every three years and provides prospective employers with the opportunity to assess the degree to which students are meeting the practice community’s needs. The survey is directed to all agencies providing field practicum sites. Agency management staff and supervisors of recent field students will provide data on the student performance on the EPAS competencies and practice behaviors. Employers will be asked to rate graduates on their ability to perform the practice behavior on a scale that had 4 levels where 4=highly competent, 3=competent, 2= some competence demonstrated, 1=no competence demonstrated. Employers will be instructed to rate on their least capable student if they had more than one alumni employed. The benchmark for competence will be at least 90% of competencies will be rated in the aggregate as “2” or better with no more than 10% rated as 2. A rating of “3” or 4 is regarded as indicating employers students consider the curriculum to have prepared well to carry out the competency. A rating of “2” is regarded as an indicator that the curriculum needs improvement, and “1” that the curriculum has failed in that area. We strive to have 85% of the employers rate our graduates at a 3.0 or better, or have a mean score of 2.5 on all items (Practice Behaviors). Alumni Survey The alumni survey will be conducted every three years. This survey allowed us to: (1) examine career trajectories of our students; (2) to assess our most recent graduate’s reaction to the curriculum, (3) and identify graduates perceptions of how well the programs objectives were met based upon their perception of their own competency to perform the 41 practice behaviors. Alumni will provide employment and salary information, data on professional attainments, professional activities (such as leadership and engagement in policy development), career patterns, professional memberships, continuing education, their perception on how well they were prepared to perform EPAS competencies and practice behaviors at the CSUSM Social Work Program. Alumni will be asked to rate their ability perform the program’s goals and objectives on a 7 point scale where 1= the curriculum did prepare them at all to perform the competency described, and 7= the program prepared them to a great extent to perform the competency. A rating of 4 is the benchmark for indicating a minimal level of competency. As a benchmark we will take 85% of former students having a rating of “4” as indicator that our program is graduating competent students. 4.0.3 The program describes the procedures it employs to evaluate the outcomes and their implications for program renewal. It discusses specific changes it has made in the program based on specific assessment outcomes. The MSW program will engage in a continual process of program evaluation and redesign primarily through the Committee-of-the-Whole under the leadership of the director. The results of the above evaluations will always be considered by the Committee. The Committee assigns tasks to the relevant subgroup based on the outcome measures. The work of the subgroup is returned, and recommendations growing out of the work of the task group are given to the full faculty. 9 4.0.2 The program provides summary data and outcomes for the assessment of each of its competencies, identifying the percentage of students achieving each benchmark. The program will transform the data summarized in Figure 4 using measures of central tendency and measures of dispersion. The data will be presented for public review in program materials and on the program’s web site for each graduating class. 4.0.3 The program describes the procedures it employs to evaluate the outcomes and their implications for program renewal. It discusses specific changes it has made in the program based on specific assessment outcomes. The MSW program will engage in a continual process of program evaluation and redesign primarily through the Committee-of-the-Whole under the leadership of the director. The program’s curriculum committee will annually review the data presented in from the various measures described in this section. Based on the data we will make decisions about decisions about program strengths and needs. The results of the above evaluations will always be considered by the Committee. The Committee will assign tasks to the relevant subgroup based on the outcome measures. The work of the subgroup will be returned to the Committee-of-the Whole with recommendations growing out of the work of the task group for action. The expectation is that summary data will reveal that the program is delivering a curriculum for which most students are exceeding the minimal expectations of competency. Analysis of the data will provide suggestions about any revisions to the curriculum that are needed. 4.0.4 The program uses Form AS 4 (B) and/or Form AS4 (M) to report its most recent assessment outcomes to constituents and the public on its website and routinely up-dates (minimally every 2 years) these postings. The program’s curriculum committee will annually review the data from the evaluation measures. The expectation is that summary data will reveal that the program is delivering a curriculum that is meeting the benchmarks defined in Table 9. Analysis of the data will provide suggestions about any revisions to the curriculum that are needed. 4.0.5 The program appends copies of all assessment instruments used to assess the program competencies. See attachments. 10