University of Nevada, Reno School of Social Work Master of Social Work (MSW) Foundation Outcome Data 2012-2013 Bachelor of Social Work (BSW)1 MSW Assessment Report 2012-2013: Page Background The Master of Social Work (MSW) program at the University of Nevada, Reno (UNR) engages in ongoing evaluation efforts to assess the program’s attainment of its competencies. In accordance with the Council on Social Work Education’s (CSWE) 2008 Educational Policy and Accreditation Standards (EPAS), the MSW program has adopted a competency-based approach to social work education. This perspective has focused the MSW program’s assessment efforts at the foundation level squarely on the ten (10) core competencies identified by CSWE and their accompanying forty-one (41) social work practice behaviors. At the concentration level, the focus is on the same 10 competencies; along with the thirty-three (33) advanced generalist practice (AGP) behaviors the program developed to operationalize them. The School’s Program Evaluation Committee is responsible for designing and implementing assessment plans for the both the BSW and MSW programs. The committee consists of the SSW Director, the BSW Program Coordinator, the MSW Program Coordinator, the Field Education Program Coordinator, one faculty member, and 1-2 graduate assistants. The MSW program’s assessment plan, including the evaluation questions, benchmarks and measures are presented below. MSW Assessment Report 2012-2013: Page 2 Assessment Plan Designing the Plan In designing our assessment plan, the first question we asked was “What is the purpose of the MSW program?” The answer to this query took us to our MSW program mission and goals— and the competencies and practice behaviors we have chosen to operationalize them. The next question we raised was “How does the program go about preparing its foundation and concentration students to become proficient in carrying out these practice behaviors?” In answering this, we adopted a layered theory of change perspective. In applying this theory (see Figure 1 below) we conceptualized our foundation students’ learning as beginning in the classroom—with the lectures, discussions, assignments and skillbuilding exercises introduced here as constituting the first level of our explicit curriculum. Students then build on this layer of knowledge, values and skills in their field placements (Level 2), where they are given opportunities to apply or “practice” the behaviors that define competent professional social work. The level of proficiency students demonstrate with respect to these 41 practice behaviors, when aggregated, yields an assessment of how well the program is doing in achieving its foundation level competencies. MSW Assessment Report 2012-2013: Page 3 Figure 1 Theory of Change – MSW Foundation Level 1: Course-Based Outcomes (Explicit Foundation Curriculum - Courses Designed to Provide a Grounding in the Generalist SW Practice Perspective) Inputs = class lecture/discussion, assignments, readings, skill labs, simulations Student Outcomes Increase Knowledge Level 2: Practice-Based Outcomes (Explicit Curriculum - Foundation Field Education) Inputs = shadowing, practice, reflection, critique, and use of supervision. Student Outcomes Increase Skills Develop & Clarify Values Demonstrate Generalist Practice Behaviors Program Outcomes (Grounding in Generalist Practice Perspective /Readiness for Entry into Concentration ) Demonstrated integration and application of social work core competencies in practice with individuals, families, groups, organizations and communities. Achievement of Social Work Competencies Figure 2 Theory of Change – MSW Concentration Level 1: Course-Based Outcomes (Explicit Curriculum - Advanced Generalist Practice Courses) Inputs = class lecture/discussion, assignments, readings, skill labs, simulations Student Outcomes Level 2: Practice-Based Outcomes (Explicit Curriculum - Concentration Field Education) Deepen Knowledge Inputs = observing, practice, reflection, critique, and use of supervision. Student Outcomes Increase & Refine Skills More Nuanced Integration of Values Demonstrate Advanced Generalist Practice Behaviors Program Outcomes (Advanced Generalist Practice) Demonstrated integration and application of AGP competencies in practice with individuals, families, groups, organizations and communities. Achievement of AGP Competencies MSW Assessment Report 2012-2013: Page 4 As illustrated in Figure 2 (above), a similar layered learning process occurs at the concentration level; however, the course and field inputs differ substantively from those experienced at the foundation level. In addition, program outcomes are stated in terms of advanced generalist competencies and practice behaviors. Undergirding the layers depicted in Figures 1 and 2 is the environment in which the explicit curriculum is delivered. Often referred to as the “implicit curriculum,” this program component is viewed as also playing an important role in shaping our students’ character and competency. Deciding on the Questions Program evaluations can serve many purposes. The purposes chosen determine which questions are asked and what data are gathered. Drawing from the work of Stepney and Rostila (2011),1 the UNR School of Social Work developed its program assessment plan around three key purposes: 1) Accountability; 2) Program Development; and 3) Advancing our understanding of “best practices” with respect to social work education (i.e., knowledge development). Figure 3 depicts these foci, along with the key assessment question that accompanies each purpose. 1 The three perspectives and evaluation questions were adapted from Stepney & Rostila (2011). Towards an integrated model of practice evaluation balancing accountability, critical knowledge and developmental perspectives. Health Sociology Review, 20(2). MSW Assessment Report 2012-2013: Page 5 Figure 3 MSW Program Assessment Purposes and Questions Accountability Purpose is to assess overall program outcomes. •To what extent do students demonstrate the core competencies and practice behaviors? Developmental Purpose is understand where and how the program can be modified and/or enhanced to improve program outcomes. •To what extent did curriculum changes improve student performance on demonstrated practice behaviors? Knowledge Purpose is to strive for a more cirtical understanding of best practices in social work education. •Under what conditions do students learn new skills (i.e. simulation, skills labs, problem-based learning, distance learning, etc.)? Evaluation Design Given competency-based education’s students’ ability to demonstrate the requisite foundation and concentration practice behaviors, we began building our assessment plan from the accountability perspective. In so doing, the overarching question we posed was: To what extent do our MSW foundation and concentration students demonstrate mastery of the 10 professional competencies and their respective practice behaviors? As noted in Table 1, we are using two outcome measures at each program level to evaluate the extent to which students are able to demonstrate attainment of the practice behaviors associated with each of the 10 professional SW competencies. All of these instruments use the same 9 point rating scale (1=Lacking Performance through 9=Mastered Performance). MSW Assessment Report 2012-2013: Page 6 Table 1 To what extent do students demonstrate the core competencies and associated practice behaviors? Benchmark Measures Timing 85% of MSW foundation 1. Field Instructor Assessment 1. At the completion of students will achieve an of Field Practicum Student SW681 – Foundation overall mean of 8 for each Performance Practicum II competency 2. Student Self-Efficacy Survey 2. End of Spring 90% of MSW 1. Field Instructor Assessment 1. At the completion of concentration students of Field Practicum Student SW781 – Advanced will achieve an overall Performance Practicum II mean of 8 for each competency 2. Student Self-Efficacy Survey 2. End of Spring In establishing our benchmark, we chose to use an overall competency mean score of 8. We then set our program performance expectation at 85% for our MSW foundation students and 90% for our MSW concentration students. Thus, using data derived from our field instructor and student self-efficacy assessments, we expect that at the completion of their foundation practicum, at least 85% of our MSW foundation students will achieve an overall competency mean of eight (8) – for each competency. At the concentration level, we expect that at the completion of their advanced practicum, at least 90% of these students will achieve overall means of 8 for each of the 10 competencies. A mean of eight (8) represents an unanchored value falling mid-way between “superior performance” (7) and “mastered performance” (9). While at this stage we are emphasizing the accountability question, we also see the developmental and knowledge questions posed above as essential ingredients for ongoing MSW Assessment Report 2012-2013: Page 7 program renewal. Therefore, at the end of this segment we discuss how we envision incorporating these elements into our assessment plan. Data Collection Methods Instruments and Procedures Measure One - Field Instructor Assessment of Field Practicum Student Performance Description: Both of the instruments described below are designed to gather data from the student’s field instructor’s perspective. o At the foundation level, this instrument is designed to assess the student’s demonstrated performance of the 41 practice behaviors used to operationalize the 10 core competencies associated with generalist social work practice. o At the concentration level, the instrument assesses the student’s demonstrated performance on the 33 advanced generalist practice behaviors developed to operationalize the 10 professional competencies. Benchmark: As noted above, the benchmark we have set for both our foundation and concentration student groups calls for an overall competency mean of 8 (computed using both our field instructor and student self-efficacy measures). o At the foundation level we expect at least 85% of our students will achieve a competency mean score of 8 (or higher) for each competency. o At the concentration level, we expect at least 90% of our students will achieve an overall mean score of 8 (or higher) for each competency. MSW Assessment Report 2012-2013: Page 8 Protocol: Field Instructors are introduced to, and trained on how to use, the assessment form during the fall Field Instructor Orientation and Training. Student performance is rated on the basis of the criteria set forth in the student’s learning agreement and reflects the field instructor’s evaluation of the student’s ability to demonstrate the practice behaviors associated with their respective program level (i.e. foundation or concentration). o At the foundation level, the field instructor assessment instrument is administered at the completion of SW 681 - Foundation Practicum II. This is the 2nd in a two-course field placement sequence (SW 680 and SW 681). Each of these courses requires students to complete a minimum of 225 hours in a supervised field setting. o At the concentration level, the field instructor assessment instrument is administered at the completion of SW781 – Advanced Practicum II. This is the 2nd in a two-course field placement sequence (SW 780 and SW 781). Each of these courses requires students to complete a minimum of 225 hours in a supervised field setting. Data Analysis: Field Instructors submit their completed Field Practicum Student Performance forms to the School of Social Work during the final week of spring semester. Data from these forms are then entered directly to the Statistical Package for Social Sciences (SPSS) for analysis. Utilizing the descriptive statistics feature of this program, mean scores are computed for a) the 41 generalist practice behaviors for students at the foundation level; or, b) the 33 practice behaviors that constitute MSW Assessment Report 2012-2013: Page 9 advanced generalist practice at the concentration level. Then, overall competency means are calculated by averaging the means of the measures of the practice behaviors that define each competency. Measure Two - Student Self-Efficacy Survey Description: At the foundation level, this instrument is designed to assess the student’s “beliefs, expectations and confidence” in their ability –as that moment–to perform each of the 41 practice behaviors that comprise the 10 core competencies. At the concentration level, the instrument also measures the student’s “beliefs, expectations and confidence” in their ability –as that moment–to practice proficiently. The items included, however, address the 33 advanced generalist practice behaviors used to operationalize the 10 competencies at this level. Benchmark: As indicated earlier, the benchmark we have set encompasses an overall mean of 8 (computed using both the field instructor and student self-efficacy measures) for at least 85% of our foundation students. This is to say, that we expect 85% of MSW foundation students each year to achieve an overall mean score of 8 (or higher) for each of the 10 core competencies. Again, at the concentration level we expect at least 90% of our graduating MSW students to achieve a competency mean score of 8 (or higher) for each competency. Protocol: The student self-efficacy survey is administered during the final weeks of spring semester to students completing SW 681 – Foundation Practicum II and SW 781 – Advanced Practicum II. Data are collected via a web-based interface using MSW Assessment Report 2012-2013: Page 10 “SurveyMonkey.” Students are given time to complete the survey during a field seminar class session, which is scheduled in an on-campus computer lab. Data Analysis: Utilizing tools included in the “SurveyMonkey” program, data are downloaded directly into SPSS. Using the descriptive statistics feature of this program, mean scores are computed for each of the 41 foundation and 33 concentration practice behaviors. Then, overall competency means are calculated for our foundation students using the 41 generalist practice behaviors. Likewise, competency means are calculated using the 33 practice behaviors associated with our advanced curriculum for our concentration level students. Overall Percentage of Students Achieving Benchmark To calculate the percentage of students that meet benchmark for each competency, the mean scores (of the practice behaviors used to operationalize it) are calculated independently for each instrument (i.e., the Field Instructor Assessment of Field Practicum Student Performance and the Student Self-Efficacy survey). These data are then combined and “averaged” to yield overall mean scores. As the data presented in the summary reports appended to this segment of the self-study convey, overall mean scores are generated for each practice behavior, as well as for each core competency. To determine the percentage of students achieving benchmark, the “overall competency mean” is divided by our designated benchmark mean of eight (Holloway, 2012). MSW Assessment Report 2012-2013: Page 11 Feedback Loops An important component of any evaluation plan is the ongoing involvement of the program’s key stakeholders. To ensure strong connections between the MSW program and its’ varied constituencies, the maintenance of ongoing feedback loops with members of the following groups is essential: Administration: SSW Director, BSW, MSW and Field Program Coordinators – as members of the program evaluation committee, the director and program coordinators play an important role in ensuring that assessment data is collected, analyzed, and shared with appropriate constituent groups. Not only do these leaders facilitate discussions with faculty, field, and advisory groups, but they also guide curriculum changes and other program enhancements. Faculty: Findings from the previous spring are presented to the full faculty at the SSW faculty fall retreat. These data are then used throughout the year to inform the work of program level (400, 600,700) and curriculum content (i.e., research, policy, field, practice, HBSE) committees. Students: As data are reviewed and addressed by faculty, they are then shared with student representatives through School Meetings, and special sessions with student constituencies who may be directly impacted by the data (e.g., the Undergraduate Student Social Work Association, part-time students, students new to the program when course requirements change due to assessment findings, and so forth). Employers/Field Supervisors: Findings are shared with field instructors during the fall field instructor orientation. Other stakeholders: Benchmark data are posted each fall to the School’s website. Assessment findings are also presented to the SSW Advisory Council, as they become available. MSW Assessment Report 2012-2013: Page 12 Summary of Results by Competency Summary data (i.e., overall mean and benchmark) gathered for each of the core competencies during spring 2013 in the tables below. Table 2 – Summary of Outcome Data, MSW Foundation Competency Fall 2012 Spring 2013 Benchmark = 85% of MSW Foundation students will achieve an overall mean of 8 for each competency. Overall Mean Benchmark Result Overall Mean Benchmark Result 2.1.1 Identify as a professional social worker and conduct oneself accordingly 6.42 80% 7.51 94% 2.1.2 Apply social work ethical principles to guide professional practice 5.59 68% 7.64 96% 2.1.3 Apply critical thinking to inform and communicate professional judgments 5.43 68% 7.17 90% 2.1.4 Engage in diversity and difference in practice 6.55 82% 7.75 97% 2.1.5 Advance human rights and social and economic justice 4.58 57% 7.32 92% 2.1.6 Engage in research-informed practice and practiceinformed research 4.38 55% 6.49 81% 2.1.7 Apply Knowledge of human behavior and the social environment 5.48 69% 7.28 91% 2.1.8 Engage in policy practice to advance social and economic well-being and to deliver effective social work services 3.83 48% 6.69 84% 2.1.9 Respond to contexts that shape practice 4.26 53% 6.73 84% 2.1.10 Engage, assess, intervene and evaluate individuals, families, groups, organizations and communities 5.28 66% 7.46 93% MSW Assessment Report 2012-2013: Page 13 Table 3 – Summary of Outcome Data, MSW Concentration Competency Fall 2012 Spring 2013 Benchmark = 90% of MSW Foundation students will achieve an overall mean of 8 for each competency. Overall Mean Benchmark Result Overall Mean Benchmark Result 2.1.1 Identify as a professional social worker and conduct oneself accordingly 5.91 74% 7.54 94% 2.1.2 Apply social work ethical principles to guide professional practice 6.19 77% 7.78 97% 2.1.3 Apply critical thinking to inform and communicate professional judgments 5.54 69% 7.71 96% 2.1.4 Engage in diversity and difference in practice 5.27 66% 7.34 96% 2.1.5 Advance human rights and social and economic justice 5.34 67% 7.31 91% 2.1.6 Engage in research-informed practice and practiceinformed research 5.38 67% 7.76 97% 2.1.7 Apply Knowledge of human behavior and the social environment 5.82 73% 7.53 94% 2.1.8 Engage in policy practice to advance social and economic well-being and to deliver effective social work services 5.46 68% 7.55 94% 2.1.9 Respond to contexts that shape practice 5.69 71% 7.58 95% 2.1.10 Engage, assess, intervene and evaluate individuals, families, groups, organizations and communities 5.84 73% 7.60 95% MSW Assessment Report 2012-2013: Page 14 Appendix A Outcome Data Reports MSW Assessment Report 2012-2013: Page 15 The Council on Social Work Education’s (CSWE) 2008 Educational Policy and Accreditation Standards (EPAS) included a provision for assessment of accredited social work programs. At the BSW and MSW foundation levels, each program must evaluate the extent to which students master the 10 CSWE identified core competencies and the 41 associated practice behaviors. Below, please find performance summaries for students completing their MSW foundation Field Practicum experiences in May 2013. MSW Foundation Students - Spring 2013 Competency 2.1.1: Identify as a professional social worker and conduct oneself accordingly. Social workers serve as representatives of the profession, its mission, and its core values. They know the profession’s history. Social workers commit themselves to the profession’s enhancement and to their own professional conduct & growth. Competency Benchmark: Based upon data gathered during previous years, we expect 85% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Field Instructor Self-Efficacy Practice Behavior Assessment Survey Overall Mean Assessment F1 Advocate for client access to the 7.60 6.30 6.95 services of social work F2 Practice personal reflection and selfcorrection to assure continual professional 7.80 7.40 7.60 development F3 Attend to professional roles and 7.80 7.20 7.50 boundaries F4 Demonstrate professional demeanor in behavior, appearance, and 8.00 7.60 7.80 communication F5 Engage in career-long learning 7.50 7.20 7.35 F6 Use supervision and consultation 8.00 7.70 7.85 Mean Score Percent of Students Achieving Competency 7.51 94% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 16 Competency 2.1.2: Apply social work ethical principles to guide professional practice. Social workers have an obligation to conduct themselves ethically and to engage in ethical decision making. Social workers are knowledgeable about the value base of the profession, its ethical standards and relevant law. Competency Benchmark: Based upon data gathered during previous years, we expect 85% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 7.80 7.80 7.80 7.90 7.80 7.85 7.80 6.90 7.35 8.00 7.10 7.55 F7 Recognize and manage personal values in a way that allows professional values to guide practice F8 Make ethical decisions by applying standards of NASW Code of Ethics and, as applicable, principles of the International Federation of Social Workers and the Association of Schools of Social Work Ethics in SW F9 Tolerate ambiguity in resolving ethical conflicts F10 Apply strategies of ethical reasoning to arrive at principled decisions Mean Score Percent of Students Achieving Competency 7.64 96% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 17 Competency 2.1.3: Apply critical thinking to inform and communicate professional judgments Social workers are knowledgeable about the principles of logic, scientific inquiry and reasoned discernment. They use critical thinking augmented by creativity and curiosity. Critical thinking also requires synthesis and communication of relevant information. Competency Benchmark: Based upon data gathered during previous years, we expect 85% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 7.30 7.10 7.20 7.00 6.70 6.85 7.50 7.40 7.45 F11 Distinguish, appraise, and integrate multiple sources of knowledge, including research-based knowledge, and practice wisdom F12 Analyze models of assessment, prevention, intervention, and evaluation F13 Demonstrate effective oral and written communication in working with individuals, families, groups, organizations, communities, and colleagues Mean Score Percent of Students Achieving Competency 7.17 90% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 18 Competency 2.1.4: Engage diversity and difference in practice Social workers understand how diversity characterizes and shapes the human experience and is critical to the formation of identity. The dimensions of diversity are understood as the intersectionality of multiple factors including age, class, color, culture, disability, ethnicity, gender, gender identity and expression, immigration status, political ideology, race, religion, sex, and sexual orientation. Social workers appreciate that, as a consequence of difference, a person’s life experiences may include oppression, poverty, marginalization and alienation, as well as privilege, power & acclaim. Competency Benchmark: Based upon data gathered during previous years, we expect 85% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 7.80 7.40 7.60 7.90 7.50 7.70 7.60 7.60 7.60 8.00 8.20 8.10 F14 Recognize the extent to which a culture’s structures and values may oppress, marginalize, alienate, or create or enhance privilege and power F15 Gain sufficient self-awareness to recognize the influence of personal biases and values in working with diverse groups F16 Recognize, value, and communicate their understanding of the importance of difference in shaping life experiences F17 View themselves as learners and engage those with whom they work as experts of their own circumstances/lives Mean Score Percent of Students Achieving Competency 7.75 97% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 19 Competency 2.1.5: Advance human rights and social and economic justice. Each person, regardless of position in society, has basic human rights, such as freedom, safety, privacy, an adequate standard of living, health care, and education. Social workers recognize the global interconnections of oppression and are knowledgeable about theories of justice and strategies to promote human and civil rights. Social work incorporates social justice practices in organizations, institutions, and society to ensure that these basic human rights are distributed equitably and without prejudice. Competency Benchmark: Based upon data gathered during previous years, we expect 85% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 8.00 7.50 7.75 7.70 6.70 7.20 7.60 6.40 7.00 F18 Understand the forms and mechanisms of oppression and discrimination F19 Advocate for human rights and social and economic justice F20 Engage in practices that advance social and economic justice Mean Score Percent of Students Achieving Competency 7.32 92% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 20 Competency 2.1.6: Engage in research-informed practice and practice-informed research. Social workers use practice experience to inform research, employ evidence-based interventions, evaluate their own practice, and use research findings to improve practice, policy, and social service delivery. Social workers comprehend quantitative and qualitative research and understand scientific and ethical approaches to knowledge building. Competency Benchmark: Based upon data gathered during previous years, we expect 85% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 4.75 6.80 5.78 7.60 6.80 7.20 F21 Use practice experiences to inform scientific inquiry F22 Use research evidence to inform practice Mean Score Percent of Students Achieving Competency 6.49 81% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 21 Competency 2.1.7: Apply knowledge of human behavior and the social environment. Social workers are knowledgeable about human behavior across the life course; the range of social systems in which people live; and the ways social systems promote or deter people in maintaining or achieving health and well-being. Social workers apply theories and knowledge from the liberal arts to understand biological, social, cultural, psychological, and spiritual development. Competency Benchmark: Based upon data gathered during previous years, we expect 85% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 7.60 6.70 7.15 7.80 7.00 7.40 F23 Utilize conceptual frameworks to guide the processes of assessment, intervention, and evaluation F24 Critique and apply knowledge to understand person and environment Mean Score Percent of Students Achieving Competency 7.28 91% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 22 Competency 2.1.8: Engage in policy practice to advance social and economic well-being and to deliver effective social work services. Social work practitioners understand that policy affects service delivery and they engage in policy practice. Social workers know the history and current structures of social policies Competency Benchmark: Based upon data gathered during previous years, we expect 85% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 6.44 6.80 6.62 6.70 6.80 6.75 F25 Analyze, formulate, and advocate for policies that advance social well-being F26 Collaborate with colleagues and clients for effective policy action Mean Score Percent of Students Achieving Competency 6.69 84% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 23 Competency 2.1.9: Respond to contexts that shape practice Social workers are informed, resourceful, and proactive in responding to evolving organizational, community, and societal contexts at all levels of practice. Social workers recognize that the context of practice is dynamic, and use knowledge & skill to respond proactively. Competency Benchmark: Based upon data gathered during previous years, we expect 85% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 7.00 7.10 7.05 6.23 6.56 6.40 F27 Continuously discover, appraise, and attend to changing locales, populations, scientific and technological developments, and emerging societal trends to provide relevant services F28 Provide leadership in promoting sustainable changes in service delivery and practice to improve the quality of social services Mean Score Percent of Students Achieving Competency 6.73 84% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 24 Competency 2.1.10: Engage, assess, intervene, and evaluate with individuals, families, groups, organizations and communities Professional practice involves the dynamic and interactive processes of engagement, assessment, intervention, and evaluation at multiple levels. Social workers have the knowledge and skills to practice with individuals, families, groups, organizations and communities. Practice knowledge includes identifying, analyzing and implementing evidence-based interventions designed to achieve client-goals; using research and technological advances; developing, analyzing, advocating, and providing leadership for policies and services; and promoting social and economic justice. Competency Benchmark: Based upon data gathered during previous years, we expect 85% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Field Instructor Self-Efficacy Practice Behavior Assessment Survey Overall Mean Assessment F29 Substantively and affectively prepare for action with individuals, families, groups, 7.90 7.20 7.55 organizations, and communities F30 Use empathy and other interpersonal 8.10 7.70 7.90 skills F31 Develop a mutually agreed-on focus of 8.20 7.20 7.70 work and desired outcomes F32 Collect, organize and interpret client 6.70 7.20 6.95 data F33 Assess client strengths and limitations 8.00 7.30 7.65 F34 Develop mutually agreed-on intervention 7.70 7.20 7.45 goals and objectives F35 Select appropriate intervention 7.70 6.90 7.30 strategies F36 Initiate actions to achieve 7.90 6.80 7.35 organizational goals F37 Implement prevention interventions that 7.90 6.80 7.35 enhance client capacities F38 Help clients resolve problems 8.00 7.30 7.65 F39 Negotiate, mediate, and advocate for 7.70 7.00 7.35 clients. F40 Facilitate transitions and endings 7.70 6.90 7.30 F41 Critically analyze, monitor, and evaluate 7.80 7.20 7.50 interventions Results for Competency: Mean Score 7.46 Percent of Students Achieving Competency 93% MSW Assessment Report 2012-2013: Page 25 MSW Concentration Students - Spring 2013 Competency 2.1.1: Identify as a professional social worker and conduct oneself accordingly Advanced generalist practitioners identify with the human rights values of the social work profession, the centrality of relationships, and the interconnections between client issues and larger social problems. Advanced practitioners in general practice take leadership in ethically and competently working to improve the wellbeing of clients, families, and communities. Competency Benchmark: Based upon data gathered during previous years, we expect 90% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Field Instructor Self-Efficacy Practice Behavior Assessment Survey Overall Mean Assessment C1 Initiate and facilitate socially responsive & just practices across 8.00 7.00 7.50 systems C2 Provide social work leadership within practice contexts and as a member of the 7.29 7.10 7.20 profession C3 Cultivate and apply leadership qualities of self-awareness and other7.95 7.90 7.93 awareness Mean Score Percent of Students Achieving Competency 7.54 94% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 26 Competency 2.1.2: Apply social work ethical principles to guide professional practice. Advanced generalist practitioners readily recognize the range of complex, multi-dimensional ethical dilemmas that often characterize practice settings. They are adept at utilizing the advanced conceptual frameworks required to explore, navigate and resolve these complex circumstances. Competency Benchmark: Based upon data gathered during previous years, we expect 90% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 7.90 7.60 7.75 8.00 7.60 7.80 C4 Is able to critique ethical issues within complex environments to formulate innovative responses and approaches C5 Employ strategies of ethical reasoning in practice settings where policies or values conflict with delivery of social work services, personal values or professional ethics Mean Score Percent of Students Achieving Competency 7.78 97% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 27 Competency 2.1.3: Apply critical thinking to inform and communicate professional judgments Advanced generalist practitioners synthesize multiple sources of information as they seek to understand “what is” and clarify “what’s possible” in addressing issues that arise across system levels. In turn, they effectively communicate this information to diverse client, multidisciplinary team, and stakeholder groups. Competency Benchmark: Based upon data gathered during previous years, we expect 90% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 8.05 7.50 7.78 7.67 7.30 7.49 8.24 7.50 7.87 C6 Question, evaluate, synthesize, and apply information from multiple sources in framing ill-defined, ever changing, multifaceted practice issues C7 Question, evaluate, select, and implement appropriate assessment, intervention, and evaluation strategies in complex, fluid, multidimensional practice situations C8 Produce product-ready presentations and documents (i.e., case presentations, intervention demonstrations, journal articles, grant applications, legislative briefs) Mean Score Percent of Students Achieving Competency 7.71 96% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 28 Competency 2.1.4: Engage diversity and difference in practice Advanced generalist practitioners recognize that human diversity includes and goes beyond conventional categories of ethnicity or culture and recognizes the intersectionality of human differences. Cultural humility characterizes their professional interactions across system levels. Competency Benchmark: Based upon data gathered during previous years, we expect 90% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 7.40 7.30 7.35 7.35 7.30 7.33 C9 Demonstrate leadership in collaboratively examining underlying assumptions and developing interculturally effective policies, programs & interventions C10 Effectively navigate conflicts between diverse identities within and among individuals, families, groups and organizations Mean Score Percent of Students Achieving Competency 7.34 92% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 29 Competency 2.1.5: Advance human rights and social and economic justice. Advanced generalist practitioners identify, analyze, and address mechanisms of oppression and injustice embedded within social institutions, theoretical assumptions, research endeavors, intervention practices and policies. In doing so, they are able to analyze complex political, economic, and social forces that influence the distribution of power and resources. Competency Benchmark: Based upon data gathered during previous years, we expect 90% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 7.57 7.50 7.54 7.24 6.90 7.07 C11 Approach practice with an understanding of the complex and interrelated factors impacting power and oppression (i.e., interconnected—local, regional, national & global—factors, both historic and temporary C12 Identify, develop, implement and evaluate strategies to address policies, practices, and language that are discriminatory and oppressive Mean Score Percent of Students Achieving Competency 7.31 91% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 30 Competency 2.1.6: Engage in research-informed practice and practice-informed research. Advanced generalist practitioners critically appraise and integrate data from multiple sources to inform practice decisions. Advanced generalist practitioners also collect, analyze, interpret, and communicate data for program development, evaluation and ongoing improvement of services. Competency Benchmark: Based upon data gathered during previous years, we expect 90% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 8.19 7.60 7.90 7.95 7.60 7.78 8.00 7.20 7.60 C13 Question and critically evaluate the strength and application of the evidence in regard to assumptions, context and culture C14 Employ evaluation frameworks in assessing the impact of interventions, programs and policies C15 Collaborate with the research enterprise in identifying and addressing questions emanating from the practice arena Mean Score Percent of Students Achieving Competency 7.76 97% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 31 Competency 2.1.7: Apply knowledge of human behavior and the social environment. Advanced generalist practitioners integrate multiple theories about human behavior and the social environment to complete comprehensive assessments and develop and implement intervention plans across system levels. Advanced generalists give equal importance to understanding individual uniqueness and the broader social issues that support or deter well-being. Competency Benchmark: Based upon data gathered during previous years, we expect 90% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 7.62 7.50 7.56 7.67 7.30 7.49 C16 Integrate understandings from a variety of theoretical perspectives in formulating comprehensive, multidimensional assessments and interventions C17 Identify and question underlying theoretical and ontological assumptions about human behavior guiding agency practices, programs and policies Mean Score Percent of Students Achieving Competency 7.53 94% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 32 Competency 2.1.8: Engage in policy practice to advance social and economic well-being and to deliver effective social work services. Advanced generalist practitioners utilize a range of analytical frameworks to assess the efficacy, costs and consequences of policy choices. In turn, advanced generalists use these data to develop and advocate for socially and economically just policies that promote the human rights and dignity of all. Competency Benchmark: Based upon data gathered during previous years, we expect 90% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 7.71 7.40 7.56 7.67 7.40 7.54 C18 Apply analytical frameworks to critically asses the intended & unintended outcomes of existing and proposed policies, especially with respect to vulnerable populations C19 Formulate and advocate for policies that promote socially and economically just practices and services at all system levels 7.40 Mean Score Percent of Students Achieving Competency 7.55 94% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 33 Competency 2.1.9: Respond to contexts that shape practice Grounded in the profession’s person-in-environment perspective, advanced practitioners recognize and attend to the cultural, organizational, and social elements that continually influence and shape social work practice. Competency Benchmark: Based upon data gathered during previous years, we expect 90% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 7.81 7.40 7.61 7.86 7.50 7.68 7.71 7.20 7.46 C20 Based on evidence, facilitate and formulate innovative responses within ambiguous and challenging contexts C21 Critically analyze and apply relevant deata and emerging interventions and technologies to evolving practice contexts C22 Analyze & effectively navigate contextual structures (e.g., power, resources) encountered in emerging practice contexts Mean Score Percent of Students Achieving Competency 7.58 95% Results for Competency: 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 34 Competency 2.1.10: Engage, assess, intervene, and evaluate with individuals, families, groups, organizations and communities Advanced generalist practitioners are ethical, competent leaders who are able to practice reflectively and autonomously in complex environments across system levels with diverse groups. Advanced practitioners integrate the systems, person-in-environment, and strengths perspectives with an array of theoretical models and intervention approaches to collaboratively frame and address complex issues, questions and problems. Thus, advanced practice involves the continuous, dynamic interplay of engagement, multidimensional assessment, intervention and evaluation processes—across system levels. Competency Benchmark: Based upon data gathered during previous years, we expect 90% of our graduates to achieve an overall mean of 8 for the competency-related practice behaviors. Practice Behavior C23 Attend to the interpersonal dynamics, cultural & contextual factors that support or threaten client-worker relationships C24 Establish a relationally based process that encourages clients to be equal participants in the establishment of intervention goals & expected outcomes C25 Adapt, modify & use multidimensional tools in conducting comprehensive, culturally effective, integrative case assessments C26 Identify client system strengths and coping capacities C27 Assess client system readiness for change C28 Select and modify intervention strategies based on continuous evaluation & assessment C29 Critically evaluate, select and apply best practices and evidence-informed interventions C30 Capable of autonomous practice, in competently applying appropriate intervention techniques for a range of presenting issues, problems or questions C31 Develop and implement collaborative multidisciplinary interventions C32 Use process and outcome evaluation findings to inform and shape the ongoing Field Instructor Assessment Mean Self-Efficacy Survey Assessment Overall 7.95 7.60 7.78 7.90 7.70 7.80 7.47 7.40 7.44 7.90 7.90 7.90 7.57 7.60 7.59 7.24 7.50 7.37 7.71 7.60 7.66 7.67 7.80 7.74 7.14 7.60 7.37 7.10 7.50 7.30 MSW Assessment Report 2012-2013: Page 35 development of social work interventions C33 Work collaboratively with evaluations/researchers in identifying questions emanating from practice, as well as assessing intervention efficacy and effectiveness 7.76 7.50 Mean Score Results for Competency: 7.60 0 No Opportunity 1 Lacking Performance 2 3 Inadequate Performance 4 5 Competent Performance 6 7.63 Percent of Students Achieving Competency 95% 7 Superior Performance 8 9 Mastered Performance MSW Assessment Report 2012-2013: Page 36