Professional Education Unit Assessment Report - Initial Preparation Programs (Abridged) Academic Year 2006-07 Report Version: August 17, 2007 Note: Any questions or comments regarding the contents of this report should be directed to Tony Norman (tony.norman@wku.edu), CEBS Associate Dean, Accountability & Research. Unit-Wide_Assessment_Report_0607_Abridged.doc Page 2 of 21 Professional Education Unit Assessment Report - Initial Preparation Programs (Abridged) Academic Year 2006-07 Overview: This report includes assessment and survey results from the following data collection points and sources: Admission Data (Academic Year 2006-07) o Number, percentage, and average GPA by program of teacher preparation candidates approved by the Professional Education Council for admission o Admission test score averages by program Course Based Assessment Data o Percentage of candidates scoring at each level of proficiency on critical performances (Academic Year 2006-07) o Percentage of candidates scoring at each level of proficiency on critical performances by Kentucky Teacher Standard (spring 2007) Clinical Experiences Data (Spring 2004 through Fall 2006) o Field Experience Summary Form information by type of experiences, context, working with students with special needs, and working with diverse students Culminating Assessment Data (Academic Year 2006-07) o Teacher Work Sample Scores by program, by TWS components, and by Kentucky Teacher Standards Exit and Follow Up Data o Praxis results (2005-06 cohort) o WKU Teacher Survey results (student-teachers, 1st, 2nd, and 3rd year teachers) o Education Professional Standards Board (EPSB) New Teacher Survey results (2002-03 through 2005-06) See the WKU Professional Education Unit Wide Continuous Assessment Matrix – Initial Preparation on the next page for a conceptual map that guides our initial preparation data collection efforts. Note that we are in the process of adding several data sources to the electronic accountability system, and, thus, they are not yet a part of this report. Section 1 describes results by data collection point. Section 2 summarizes these results based on what they tell us about candidate proficiency towards Kentucky Teacher Standards. Unit-Wide_Assessment_Report_0607_Abridged.doc Page 3 of 21 KY REQ's Content Knowledge Designs/Plans Learning Climate Implements/Manages Assessment/Evaluation Reflection Collaboration Professional Development Technology Leadership*** Dispositions FR a-f* Field Experiences & Clinical Practice Diversity Impacts P-12 Student Learning DATA MAINTAINED BY: DATA HOUSED IN: DATA REPORTING CYCLE: DATA REVIEWED BY: Praxis II Graduate Survey Principal Survey DFI 2** 8a-d, Overall 8a-d 8a-d 8a-d CF 1-5, LG 1-4, DFI 1, 3-5 1a-e, Overall 1a-e 1a-e 1a-e 2a-e, Overall 2a-e 2a-e 2a-e IDM 1-3 3a-e, Overall 3a-e 3a-e 3a-e AP 1-5, ASL 1-4 4a-d, Overall 4a-e 4a-e 4a-e RSE 1-3 5a-c, Overall 5a-c 5a-c 5a-c 6a-b, Overall 6a-d 6a-d 6a-d RSE 4-5 7a-c, Overall 7a-d 7a-d 7a-d DFI 6 9a-d, Overall 9a-d 9a-d 9a-d 10a, Overall 10a-d 10a-d 10a-d Ed Tech Ed Tech FX a-l* Summary Form Summary Form Component 5: Exit and Follow Up Data State Approved Certification Exams Faculty Recs Various Data Required by State for Admission into Teacher Preparation Programs Conceptual Framework Standards/Values Aligned to Kentucky Teacher Standards Component 1: Admission Data WKU PROFESSIONAL EDUCATION UNIT WIDE CONTINUOUS ASSESSMENT MATRIX - INITIAL PREPARATION Component 2: Component 4: Component 3: Course Based Clinical Experiences Data Culminating Assessment Data Assessment Data Capstone Early Clinical Final Clinical Final Clinical Exit Critical Performances Assessment Experiences Experience Evaluation* Survey (TWS) Disp a-l OTS Data OTS Data CF 1-5, AP 5, DFI 4, IDM 2 Disp g AP 1-5, ASL 1-4 OTS Faculty CEBS ACCSYS CEBS ACCSYS Semester Yearly Yearly Yearly Yearly Yearly Yearly Yearly Yearly Biannually PEC Faculty/Programs/PEC Program Programs/PEC Programs/PEC Programs/PEC Programs/PEC PEC Programs/PEC Programs/PEC *Data sources in the process of being added to the electronic assessment system **Cells reflect instruments or rubric/survey items keyed to CF Standards/Values. ***Leadership is a new standard under consideration by the EPSB. C&I Staff OTS CEBS ACCSYS C&I Staff/Ed Tech OTS/EdTech Ed Tech CEBS ACCSYS OTS BANNER/CEBS ACCSYS Unit-Wide_Assessment_Report_0607_Abridged.doc Page 4 of 21 Section 1. Continuous Assessment Results A. Admission Data (Academic Year 2006-07) Table 1 provides the number, percentages, and average overall GPAs of candidates by program approved by the Professional Education Council (PEC) for admission into initial teacher preparation programs. Before the Office of Teacher Services submits their names for review and approval by the PEC, candidates must meet minimum requirements established by the state and/or the WKU Professional Education Unit. Table 1 Approved Candidate GPA Averages by Program CIP Code 0-Unknown 131001-Special Education 131012-Communication Disorders 131201-Agriculture 131202-Early Elementary Education P-5 131203-Middle Grades Education 131204-Interdisciplinary Early Childhood Education 131302-Art Education 131303-Business Education 131307-Health Education 131308-Family and Consumer Science 131312-Music Education 131314-Physical Education 131320-Industrial Technology 160901-French 160905-Spanish 190701-Interdisciplinary Early Childhood Education 230101- English and Allied Language Arts 250101-School Media Specialist 260101- Biological Science 270101-Mathematics 400501-Chemistry 400703- Earth and Space Science 400801-Physics 450101-History/Social Studies 450801-History/Social Studies 500901-Music Education Grand Total *Cells with N < 5 not reported N 11 60 21 10 184 38 14 6 10 1 5 8 15 2 1 5 2 24 2 5 11 3 2 1 26 4 4 475 % Average GPA 2.3% 3.60 12.6% 3.29 4.4% 3.74 2.1% 3.23 38.7% 3.21 8.0% 3.36 2.9% 3.05 1.3% 3.25 2.1% 3.32 0.2% * 1.1% 3.16 1.7% 3.63 3.2% 3.17 0.4% * 0.2% * 1.1% 3.57 0.4% * 5.1% 3.35 0.4% * 1.1% 2.97 2.3% 3.18 0.6% * 0.4% * 0.2% * 5.5% 3.27 0.8% * 0.8% * 100.0% 3.28 Unit-Wide_Assessment_Report_0607_Abridged.doc Page 5 of 21 Table 2 provides the average admission test scores of candidates by program approved by the Professional Education Council (PEC) for admission into initial teacher preparation programs. Table 2 Approved Candidate Test Score Averages by Program Major Code 0-Unknown 131001-Special Education 131012-Communications Disorders 131201-Agriculture 131202-Elementary Education 131203-Middle Grades Education 131204-IECE 131302-Art Education 131303-Business Education 131307-Health Education 131308-Family Consumer Science 131312-Music Education 131314-Physical Education 131320-Industrial Technology 160901-French 160905-Spanish 190701-IECE 230101-English Allied Lang Arts 250101-School Media Specialist 260101-Biological Science 270101-Mathematics 400501-Chemistry 400703-Earth Space Science 400801-Physics 450101-History/Social Studies 450801-History/Social Studies 500901-Music Education Grand Total ACT PPSTM** PPSTR** N Mean N Mean N Mean N * 1 24 2 * 1 * 2 9 23 1 * 1 * 1 11 21 7 23 26 176 35 176 35 132 23 6 177 5 176 5 28 22 3 * 3 * 3 9 * 1 * 1 * 2 2 23 8 * 1 * 1 1 21 5 25 8 23 5 178 5 176 5 8 * 2 * 1 * 1 * 1 * 1 2 * 1 * 1 * 1 1 24 2 * 2 * 2 17 2 9 * 24 1 * 19 3 4 289 24 3 * 1 * 23 53 * * 3 1 177 60 * * GRE Composite Mean N Mean N Mean 977 10 * 957 17 * 1670 9 * * 1 2 175 4 * * 2 174 1 * * 1 * * * 1 * PPSTW** SAT 175 * * * 1 * 3 1 * * 1 * 176 62 174 8 1093 2 * 4 2 2 2 3 1 1 * * * * * * * 59 1058 *Cells with N < 5 not reported **PPST refers to the ETS Pre-Professional Skills Tests: Mathematics (M), Reading (R), & Writing (W) respectively. Unit-Wide_Assessment_Report_0607_Abridged.doc Page 6 of 21 B. Course Based Assessment Data Table 3 provides the percentage of candidates scoring at each level of proficiency on critical performances within professional education courses for the 2006-07 academic year. Proficiency levels are based on the following scale: 1 – Standard Not Met, 2 – Standard Partially Met, 3 – At Standard, and 4 – Above Standard. Table 3 CP Proficiency Level Percentages Course EDU-250 ELED-345 ELED-355 ELED-365 ELED-405 ELED-406 ELED-407 ELED-465 EXED-331 EXED-332 EXED-333 EXED-415 EXED-417 EXED-418 EXED-419 CP # 1 2 3 4 5 6 7 8 1 2 3 4 5 1 2 3 4 1 3 4 5 6 1 2 3 4 5 6 7 8 6 7 8 1 2 3 4 5 6 1 2 1 1 1 1 1 2 1 0% 0% 0% 0% 0% 1% 1% 0% 0% 1% 0% 0% 0% 0% 0% 0% 1% 0% 0% 0% 1% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 0% 23% 0% 0% 0% 0% Score % 2 3 0% 53% 0% 57% 0% 17% 0% 39% 0% 40% 3% 64% 4% 51% 6% 61% 1% 99% 0% 99% 1% 99% 2% 98% 3% 95% 0% 68% 10% 77% 4% 70% 13% 77% 0% 100% 2% 78% 3% 85% 0% 99% 2% 94% 0% 80% 0% 72% 0% 67% 0% 74% 1% 71% 0% 89% 2% 86% 8% 86% 0% 70% 6% 77% 14% 82% 3% 88% 2% 98% 0% 95% 0% 89% 3% 87% 2% 89% 0% 0% 0% 100% 5% 43% 0% 15% 0% 0% 0% 7% 0% 0% 0% 0% 4 47% 43% 83% 61% 60% 33% 45% 33% 1% 0% 0% 0% 2% 32% 13% 26% 9% 0% 20% 12% 0% 4% 20% 28% 33% 26% 28% 11% 12% 7% 30% 17% 4% 9% 0% 5% 11% 10% 9% 100% 0% 52% 62% 100% 93% 100% 100% Unit-Wide_Assessment_Report_0607_Abridged.doc Page 7 of 21 Course EXED-422 EXED-431 EXED-434 IECE-420 LME-318 LME-407 LME-448 LTCY-320 LTCY-420 LTCY-421 LTCY-444 MGE-275 MGE-475 MGE-477 MGE-479 MGE-481 MGE-485 PSY-310 SEC-351 SEC-352 SEC-453 SEC-473 SEC-475 SEC-477 SEC-479 SEC-481 Grand Total CP # 1 1 1 1 2 4 5 1 2 1 1 1 2 3 1 4 1 2 2 1 2 3 4 5 6 7 8 1 1 1 1 1 2 3 4 1 2 3 1 2 3 4 5 6 1 2 3 4 1 2 3 1 1 1 1 1 1 0% 0% 0% 0% 5% 0% 8% 0% 0% 0% 0% 0% 0% 0% 4% 0% 0% 8% 12% 0% 0% 0% 0% 0% 0% 2% 0% 0% 0% 6% 0% 0% 0% 0% 0% 1% 1% 0% 8% 8% 2% 0% 0% 0% 11% 3% 0% 0% 3% 0% 0% 0% 0% 17% 0% 0% 1% Score % 2 3 0% 24% 0% 21% 0% 71% 5% 40% 5% 45% 10% 25% 15% 8% 0% 56% 0% 66% 0% 100% 0% 88% 0% 100% 4% 57% 0% 100% 9% 47% 100% 0% 100% 0% 15% 48% 14% 36% 0% 9% 0% 4% 0% 4% 7% 55% 0% 53% 0% 100% 0% 98% 0% 100% 0% 100% 44% 33% 12% 59% 10% 90% 0% 0% 0% 33% 2% 32% 0% 5% 8% 31% 2% 5% 0% 0% 13% 62% 33% 48% 2% 80% 4% 83% 31% 56% 8% 75% 3% 24% 1% 40% 0% 7% 2% 62% 8% 56% 11% 37% 7% 56% 0% 100% 0% 75% 17% 50% 50% 0% 32% 68% 4% 63% 4 76% 79% 29% 55% 45% 65% 69% 44% 34% 0% 13% 0% 38% 0% 41% 0% 0% 29% 38% 91% 96% 96% 38% 47% 0% 0% 0% 0% 22% 24% 0% 100% 67% 67% 95% 59% 92% 100% 17% 13% 16% 13% 13% 17% 63% 55% 93% 36% 33% 52% 37% 0% 25% 17% 50% 0% 32% Unit-Wide_Assessment_Report_0607_Abridged.doc Page 8 of 21 Table 4 provides the number of critical performances for each Kentucky Teacher Standard by courses in the three major program divisions: Elementary Education, Middle Grades Education, and Secondary Education. Note that other courses (e.g., PSY 310) have critical performances (CP) that likely assist programs in meeting all teacher standards. Because of the multiple CPs discontinued after the fall 2006 semester, results are only from the spring 2007 semester. Table 4 Number of CPs for Each Kentucky Teacher Standard Kentucky Teacher Standards Program ELED MGE SECED I 4 6 5 II 2 2 2 III 1 2 1 IV 3 6 3 V 2 2 2 VI 1 1 1 VII 1 2 3 VIII 2 6 6 IX 1 2 3 TOTAL 15 6 4 12 6 3 6 14 6 Table 5 indicates the level of candidate proficiency across critical performances related to the Kentucky Teacher Standards for the spring 2007 semester. The pass rate equals the percentage of candidates scoring a “3” or higher. The program pass rate is the average pass rate percentage for all program courses (e.g., for the KTS 1 table below the ELED pass rate is the average of ELED 345, ELED 365, ELED 406, and ELED 465). Table 5 CP Scores by Kentucky Teacher Standards KTS 1 ELED-345 ELED-365 ELED-406 ELED-465 LME-318 LTCY-320 MGE-275 MGE-475 MGE-477 MGE-479 MGE-481 MGE-485 SEC-351 SEC-453 SEC-475 SEC-479 SEC-481 Grand Total KTS 2 EDU-250 ELED-355 ELED-465 MGE-275 MGE-485 PSY-310 SEC-352 SEC-453 Grand Total 1 0% 1% 0% 0% 0% 1% 0% 0% 0% 8% 0% 0% 0% 0% 0% 0% 0% 0% Score % 2 3 1% 99% 13% 77% 0% 89% 0% 89% 0% 64% 4% 45% 6% 94% 0% 100% 33% 50% 17% 42% 0% 100% 3% 98% 31% 56% 11% 37% 0% 75% 50% 0% 33% 67% 7% 75% 4 0% 9% 11% 11% 36% 51% 0% 0% 17% 33% 0% 0% 13% 52% 25% 50% 0% 17% 1 1% 0% 0% 0% 0% 3% 2% 0% 1% Score % 2 3 3% 64% 3% 96% 0% 95% 0% 100% 0% 100% 11% 36% 2% 59% 11% 37% 4% 73% 4 33% 1% 5% 0% 0% 51% 38% 52% 22% Pass Rate 99% 86% 100% 100% 100% 95% 94% 100% 67% 75% 100% 98% 69% 89% 100% 50% 67% 93% Pass Rate 96% 97% 100% 100% 100% 87% 96% 89% 95% Program Pass Rate Program 96% ELED 89% MGE 76% SECED Program Pass Rate Program 99% ELED 100% MGE 93% SECED Unit-Wide_Assessment_Report_0607_Abridged.doc Page 9 of 21 KTS 3 ELED-406 LTCY-421 LTCY-444 MGE-275 MGE-485 SEC-351 Grand Total KTS 4 ELED-345 ELED-405 ELED-465 LTCY-320 LTCY-420 MGE-275 MGE-475 MGE-477 MGE-479 MGE-481 MGE-485 PSY-310 SEC-475 SEC-479 SEC-481 Grand Total KTS 5 EDU-250 ELED-365 ELED-465 MGE-275 MGE-485 SEC-351 SEC-352 Grand Total KTS 6 ELED-407 EXED-422 LTCY-420 MGE-485 SEC-352 Grand Total KTS 7 EDU-250 ELED-405 MGE-275 MGE-485 SEC-351 SEC-352 SEC-453 Grand Total 1 0% 10% 21% 0% 0% 0% 3% Score % 2 3 2% 86% 20% 27% 21% 21% 0% 100% 0% 100% 31% 56% 11% 72% 4 12% 43% 37% 0% 0% 13% 14% 1 1% 0% 0% 1% 7% 0% 0% 0% 8% 0% 0% 1% 0% 0% 0% 1% Score % 2 3 1% 99% 3% 82% 3% 87% 4% 45% 13% 46% 6% 94% 0% 100% 33% 50% 17% 42% 0% 100% 3% 98% 3% 9% 0% 75% 50% 0% 33% 67% 5% 63% 4 0% 14% 10% 51% 34% 0% 0% 17% 33% 0% 0% 87% 25% 50% 0% 30% 1 0% 0% 0% 0% 0% 0% 1% 0% Score % 2 3 6% 61% 4% 70% 2% 89% 0% 100% 0% 100% 8% 75% 2% 61% 3% 74% 4 33% 26% 9% 0% 0% 17% 37% 22% 1 0% 0% 7% 0% 2% 3% Score % 2 3 0% 72% 0% 24% 13% 46% 0% 100% 2% 59% 5% 60% 4 28% 76% 34% 0% 38% 33% 1 1% 0% 2% 0% 0% 2% 0% 1% Score % 2 3 4% 51% 0% 100% 0% 98% 0% 100% 6% 79% 2% 59% 7% 56% 3% 74% 4 45% 0% 0% 0% 15% 38% 37% 23% Pass Rate 98% 70% 58% 100% 100% 69% 87% Pass Rate 99% 97% 97% 95% 80% 94% 100% 67% 75% 100% 98% 96% 100% 50% 67% 94% Pass Rate 94% 96% 98% 100% 100% 92% 97% 97% Pass Rate 100% 100% 80% 100% 96% 92% Pass Rate 96% 100% 98% 100% 94% 96% 93% 96% Program Pass Rate Program 98% ELED 100% 69% MGE SECED Program Pass Rate Program 97% ELED 89% MGE 72% SECED Program Pass Rate Program 97% ELED 100% MGE 95% SECED Program Pass Rate Program 100% ELED 100% 96% MGE SECED Program Pass Rate Program 100% ELED 99% MGE 94% SECED Unit-Wide_Assessment_Report_0607_Abridged.doc Page 10 of 21 KTS 8 ELED-405 ELED-407 LME-318 LTCY-420 LTCY-421 LTCY-444 MGE-275 MGE-475 MGE-477 MGE-479 MGE-481 MGE-485 SEC-351 SEC-352 SEC-453 SEC-475 SEC-479 SEC-481 Grand Total KTS 9 ELED-406 LME-448 MGE-275 MGE-485 SEC-351 SEC-352 SEC-453 Grand Total 1 0% 0% 0% 7% 10% 21% 0% 0% 0% 8% 0% 0% 0% 2% 0% 0% 0% 0% 2% Score % 2 3 2% 92% 14% 82% 0% 64% 13% 46% 20% 27% 21% 21% 11% 89% 0% 100% 33% 50% 17% 42% 0% 100% 0% 100% 4% 83% 2% 59% 7% 56% 0% 75% 50% 0% 33% 67% 9% 69% 4 5% 4% 36% 34% 43% 37% 0% 0% 17% 33% 0% 0% 13% 38% 37% 25% 50% 0% 20% 1 0% 0% 0% 0% 0% 1% 0% 0% Score % 2 3 8% 86% 0% 89% 11% 89% 0% 100% 4% 83% 2% 61% 7% 56% 5% 77% 4 7% 11% 0% 0% 13% 37% 37% 18% Pass Rate 98% 86% 100% 80% 70% 58% 89% 100% 67% 75% 100% 100% 96% 96% 93% 100% 50% 67% 88% Pass Rate 92% 100% 89% 100% 96% 97% 93% 95% Table 6 Unavailable Program Pass Rate Program 92% ELED 88% MGE 84% SECED Program Pass Rate Program 92% ELED 94% MGE 95% SECED Unit-Wide_Assessment_Report_0607_Abridged.doc Page 11 of 21 C. Clinical Experiences Data (Spring 2004 through Fall 2006) Over this period, 2086 students reported over 6,000 field placements with an average of 18% diversity (as provided by the state). Table 7 reveals the percentages of field experiences with various characteristics. Note that candidates could choose all the characteristics that applied for any given experience. Table 7 Percentages of Field Experience by Category Types Types of Experiences Observed Teacher Support Tutored 93% 70% Taught Lesson 62% Mainstreamed Class Resource Room Context Collaboration 84% 9% 32% 69% Pullout Program Tutorial/Enrichment 15% 19% Working With Students With Special Needs Physical Disability 13% African American 81% Learning Disability 54% Mental Disability EBD Gifted ESL 12% 30% 40% 32% Working with Diverse Students Native American Latino/Hispanic Asian American 6% 54% 32% Other 27% Overall, in 82% of their field experiences candidates reported working with at least one student with special needs and in 89% of their field experiences candidates reported working with at least one student from a diverse ethnic group. D. Culminating Assessment Data (Academic Year 2006-07) TWS Results Table 8 presents the results of two TWS scoring sessions where independent scorers judged the quality of the TWS performances. These scores do not include the faculty scores used to calculate candidates’ course grades. “Passing” represents those candidates who scored a holistic score of 3 “Proficient” or 4 “Exemplary.” Chart 1 is based on faculty scoring data and depicts the percentage of candidates by program who averaged at least 2.5 on the indicators for each TWS Factor: CF – Contextual Factors, LG – Learning Goals, AP – Assessment Plan, DFI – Design for Instruction, IDM – Instructional Decision Making, ASL – Analysis of Student Learning, and RSE – Reflection and Self-Evaluation. Chart 2 depicts the percentage of candidates by program who averaged at least 2.5 on indicators related to each Kentucky Teacher Standard measured by the TWS. Unit-Wide_Assessment_Report_0607_Abridged.doc Page 12 of 21 Table 8 TWS Pass Rates By Program OVERALL N % TWS “PASS” RATES Fall 2006 # of Candidates 151 Holistic Score 3 or 4 107 Spring 2007 # of Candidates 211 Holistic Score 3 or 4 155 *Cells with N < 5 not reported ELED N % MGE N % P-12 N % SECED N % 5-12 N % 81% 28 14 2 81% 95 77 21 14 67% 5 2 40% 73% 107 83 78% 34 21 63% 18 16 89% 50% 62% 20 15 75% 32 20 Chart 1 Percentage by Program of Candidates who “Passed” Each TWS Factor 100% 90% 80% TOTAL ELED MGE SECED 5-12 P-12 70% 60% 50% 40% CF LG AP DFI IDM ASL RSE Chart 2 Percentage by Program of Candidates who “Passed” Each Teacher Standard 100% 90% 80% TOTAL ELED MGE SECED 5-12 P-12 70% 60% 50% 40% KTS1 KTS3 KTS4 KTS5 KTS7 KTS8 KTS9 Unit-Wide_Assessment_Report_0607_Abridged.doc Page 13 of 21 Chart 3 Unavailable E. Exit and Follow Up Data Praxis Results (2005-06 Cohort) Tables 9 and 10 delineate the Educational Testing Services reports of the pass rates of candidates (N=338) who completed our programs in the 2005-06 academic year (the most recent year with complete data). The last two columns allow for comparison of the pass rates of our candidates to those of candidates at other state institutions. Numbers in bold in Table 9 represent totals for each assessment category. Note that the institutional pass rates in Tables 9 and 10 differ slightly because Table 9 includes additional candidates in our database, not reported by ETS because of cell sizes smaller than ten, that we were able to add to the table. Table 9 Praxis Pass Rates by Assessment Type Type of Assessment Professional Knowledge PRINCIPLES LEARNING & TEACHING K-6 PRINCIPLES LEARNING & TEACHING 5-9 PRINCIPLES LEARNING & TEACHING 7-12 Academic Content Areas ELEM ED CURR INSTRUC ASSESSMENT ELEMENTARY ED CONTENT KNOWLEDGE ENG LANG LIT COMP CONTENT KNOWLEDGE ENG LANG LIT COMP ESSAYS MIDDLE SCHOOL ENGLISH LANGUAGE ARTS MATHEMATICS: CONTENT KNOWLEDGE MATH PROOFS MODELS PROBLEMS PART 1 MIDDLE SCHOOL MATHEMATICS SOCIAL STUDIES: CONTENT KNOWLEDGE SOCIAL STUDIES: INTERPRET MATERIALS MIDDLE SCHOOL SOCIAL STUDIES PHYSICAL ED: CONTENT KNOWLEDGE PHYSICAL ED ANALYSIS AND DESIGN BUSINESS EDUCATION MUSIC CONCEPTS AND PROCESSES MUSIC CONTENT KNOWLEDGE ART MAKING ART CONTENT KNOWLEDGE FRENCH CONTENT KNOWLEDGE GERMAN CONTENT KNOWLEDGE SPANISH CONTENT KNOWLEDGE SPANISH PRODUCTIVE LANGUAGE SKILLS BIOLOGY CONTENT KNOWLEDGE PART 1 BIOLOGY CONTENT ESSAYS BIOLOGY CONTENT KNOWLEDGE Code Number 522 523 524 011 014 041 042 049 061 063 069 081 083 089 091 092 100 111 113 131 133 173 181 191 192 231 233 235 Number Taking Assessment 312 202 38 72 391 63 123 12 12 19 0 0 16 26 26 25 6 6 10 7 7 8 8 0 1 3 0 2 2 0 Number Passing Assessment 310 201 37 72 378 63 117 12 12 18 0 0 16 26 26 24 6 6 10 6 6 7 8 0 Institutional Pass Rate 99% 100% 97% 100% 97% 100% 95% 100% 100% 95% NA NA 100% 100% 100% 96% 100% 100% 100% 86% 86% 86% 100% NA 0 NA 0 NA Statewide Pass Rate 98% 99% 94% 98% 96% 97% 97% 96% 95% 94% 100% 98% 98% 98% 95% 95% 99% 99% 98% 98% 98% 92% 95% NA NA 71% NA 94% 100% 100% Unit-Wide_Assessment_Report_0607_Abridged.doc Page 14 of 21 Number Passing Assessment 0 0 0 0 0 9 0 0 13 0 5 Institutional Pass Rate NA NA NA NA NA 100% NA NA 100% NA 100% 7 65 0 13 13 17 9 10 100% 100% NA 100% 100% 100% 100% 100% Number Taking Assessment Number Passing Assessment Institutional Pass Rate Statewide Pass Rate Aggregate - Professional Knowledge 312 310 99% 98% Aggregate - Academic Content Areas (Math, English, Biology, etc.) 330 318 96% 96% Aggregate - Other Content Areas (Career/Tech Ed, Health Ed, etc.) 13 13 100% 96% Aggregate - Teaching Special Populations (Special Ed, ELS, etc.) 39 39 100% 93% 338 326 96% 95% Type of Assessment CHEMISTRY CONTENT KNOWLEDGE CHEMISTRY CONTENT KNOWLEDGE PHYSICS CONTENT KNOWLEDGE PHYSICS CONTENT KNOWLEDGE GENERAL SCI CONTENT KNOWL PART 2 MIDDLE SCHOOL SCIENCE EARTH SCIENCE CONTENT KNOWLEDGE LATIN Other Content Areas TECHNOLOGY EDUCATION FAMILY AND CONSUMER SCIENCES HEALTH EDUCATION AGRICULTURE Teaching Special Populations ED OF DEAF & HARD OF HEARING SE STUDENTS W/MENTAL RETARDATION SPEECH-LANGUAGE PATHOLOGY SE APPLIC OF CORE PRINCIPLES ACROSS EDUC. EXCEPTIONAL STUDENTS: CK SE BEHAVIORAL/EMOTIONAL ED EXCEPT STUDENTS: MILD MODER. DISABIL *Cells with N < 5 not reported Code Number 241 245 261 265 432 439 571 600 050 120 550 700 271 321 330 352 353 371 542 Number Taking Assessment 0 0 0 0 0 9 0 0 13 0 5 1 7 65 0 13 13 17 9 10 3 Statewide Pass Rate NA NA NA NA NA 99% NA NA 93% NA 96% 98% 93% 95% 82% 100% 96% 94% 98% 93% 97% Table 10 Aggregate Praxis Pass Rates by Assessment Type Type of Assessment Summary Totals and Pass Rates Tables 11-13 Unavailable Unit-Wide_Assessment_Report_0607_Abridged.doc Page 15 of 21 WKU Teacher Survey Results Below are the results of the electronic WKU Teacher Survey (see Appendix) sent to student teachers and first, second, and third year teachers during spring 2007. With a 78% (186 of 240 possible) response rate, student-teacher results should be trustworthy; with a 20% (150 of 746 who should have received the e-mail invitation) response rate, the alumni results should be interpreted cautiously. Of these 150 surveys, only 144 were useful for analysis. Of the alumni responding, 49 (34%) were first year teachers, 27 (19%) were in their second year, 33 (23%) were in their third year, and 35 (24%) identified themselves as “Other.” Table 14 further breaks down the number of respondents by year and program. Table 14 WKU Survey Respondents by Year and Program Experience Student Teaching First Year Second Year Third Year Grand Total IECE 14 1 2 17 ELED 74 22 14 10 120 MGE 33 8 2 1 44 SECED 35 11 2 4 52 5-12 11 2 4 1 18 P-12 19 2 5 26 SPED Grand Total 186 4 49 4 27 10 33 18 295 Survey items requested the respondent’s perception of WKU preparation on each of the Kentucky Teacher Standards using a scale of 1 “Poor” 2 “Fair” 3 “Good” and 4 “Excellent.” Additionally, respondents evaluated their overall preparation on a similar scale. Below are average respondent scores by preparation program (1 = IECE, 2 = ELED, 3 = MGE, 4 = SECED, 5 = SPED, 6 = 5-12, 7 = P-12) and teacher experience (0 = student teaching, 1 = 1st year, 2 = 2nd year, 3 = 3rd year) on the “Overall” preparation question (Chart 4) and then on questions related to each Kentucky Teacher Standard (Chart 5). Chart 4 Average of “Overall Preparation” by Program and Teacher Experience 4.00 Average of OVERALL 3.00 PROG IECE ELED MGE SECED 5-12 P-12 SPED 2.00 1.00 St Tchr 1st Yr Tchr 2nd Yr Tchr TchExp 3rd Yr Tchr Unit-Wide_Assessment_Report_0607_Abridged.doc Page 16 of 21 Chart 5 Average Scores on Teacher Standards Questions by Program and Teacher Experience Kentucky Teacher Standard 1 4.00 Kentucky Teacher Standard 2 KTS1 AVG 4.00 3.00 PROG 3.00 IECE ELED MGE SECED 5-12 P-12 SPED 2.00 1.00 St Tchr 1st Yr Tchr 2nd Yr Tchr KTS2 AVG PROG IECE ELED MGE SECED 5-12 P-12 SPED 2.00 1.00 3rd Yr Tchr St Tchr 1st Yr Tchr TchExp KTS3 AVG 4.00 3.00 PROG IECE ELED MGE SECED 5-12 P-12 SPED 2.00 KTS4 AVG 3.00 PROG IECE ELED MGE SECED 5-12 P-12 SPED 2.00 1.00 1.00 St Tchr 1st Yr Tchr 2nd Yr Tchr St Tchr 3rd Yr Tchr 1st Yr Tchr 2nd Yr Tchr 3rd Yr Tchr TchExp TchExp Kentucky Teacher Standard 6 Kentucky Teacher Standard 5 4.00 3rd Yr Tchr Kentucky Teacher Standard 4 Kentucky Teacher Standard 3 4.00 2nd Yr Tchr TchExp KTS5 AVG 4.00 3.00 PROG IECE ELED MGE SECED 5-12 P-12 SPED 2.00 KTS6 AVG 3.00 PROG IECE ELED MGE SECED 5-12 P-12 SPED 2.00 1.00 1.00 St Tchr 1st Yr Tchr 2nd Yr Tchr TchExp 3rd Yr Tchr St Tchr 1st Yr Tchr 2nd Yr Tchr TchExp 3rd Yr Tchr Unit-Wide_Assessment_Report_0607_Abridged.doc Page 17 of 21 Kentucky Teacher Standard 8 Kentucky Teacher Standard 7 4.00 KTS7 AVG 4.00 3.00 PROG IECE ELED MGE SECED 5-12 P-12 SPED 2.00 KTS8 AVG 3.00 PROG IECE ELED MGE SECED 5-12 P-12 SPED 2.00 1.00 1.00 St Tchr 1st Yr Tchr 2nd Yr Tchr St Tchr 3rd Yr Tchr 1st Yr Tchr 3rd Yr Tchr Kentucky Teacher Standard 10 Kentucky Teacher Standard 9 4.00 2nd Yr Tchr TchExp TchExp KTS9 AVG 4.00 3.00 PROG IECE ELED MGE SECED 5-12 P-12 SPED 2.00 KTS10 AVG 3.00 PROG IECE ELED MGE SECED 5-12 P-12 SPED 2.00 1.00 1.00 St Tchr 1st Yr Tchr 2nd Yr Tchr 3rd Yr Tchr St Tchr 1st Yr Tchr 2nd Yr Tchr 3rd Yr Tchr TchExp TchExp Table 15 Unavailable EPSB New Teacher Survey Results (2002-03 through 2005-06) Below are the results of the state EPSB New Teacher Survey. The scale for each item is similar to the WKU Teacher Survey. The state interviews four groups of respondents regarding WKU’s preparation of teachers: student teachers, interns (first year teachers), cooperating teachers who work with student teachers, and resource teachers who work with first year teachers. Table 20 represents results for total respondents by year. Items in red represent averages that fall below 3 “Good.” Table 25 represents results by preparation program of respondents. Again, items in red represent averages that fall below 3 “Good.” Numbers at the bottom in blue represent programs with more than seven questions averaging below 3 “Good.” Tables 16-19 Unavailable Unit-Wide_Assessment_Report_0607_Abridged.doc Page 18 of 21 Table 20 EPSB Survey Total WKU Responses by Year TOTAL N Survey Year Design Units Contextual Information Aligned Assessment Reliable Assessment Formative Assessment Connecting to Real Life Instructing SPED children Technology – Instruction Instructional Variety Methods of Inquiry Interpreting Results PG Plan Reflection Presenting Learning Classroom Management Critical Thinking Collaboration Technology - Instruction Assessing PD Needs Ethics Content Knowledge Soc/Emotional Problems Disabilities SPED Behavior Issues OVERALL Reading Health Education Environmental Ed Economics 844 200203 3.47 3.10 3.26 3.16 3.08 3.27 2.75 3.06 3.11 3.13 3.04 3.15 3.32 3.02 3.11 3.20 3.25 2.92 3.13 3.61 3.44 2.78 2.89 2.81 3.35 2.73 2.56 2.60 2.60 316 200304 3.38 3.03 3.17 3.09 3.10 3.26 2.95 3.01 3.11 3.12 3.07 3.25 3.27 2.98 3.09 3.12 3.25 2.91 3.19 3.59 3.45 3.02 3.17 2.96 3.20 2.60 2.56 2.52 2.59 1169 200405 3.48 3.16 3.28 3.19 3.16 3.31 2.88 3.16 3.19 3.14 3.07 3.23 3.34 3.07 3.09 3.21 3.29 3.11 3.18 3.57 3.44 2.97 3.05 2.91 3.34 2.73 2.65 2.65 2.72 Tables 21-24 Unavailable 1014 200506 3.47 3.17 3.30 3.22 3.21 3.33 2.86 3.29 3.21 3.17 3.14 3.25 3.34 3.14 3.09 3.21 3.35 3.24 3.25 3.62 3.46 2.96 3.04 2.91 3.37 3343 Grand Total 3.47 3.14 3.27 3.18 3.15 3.30 2.85 3.16 3.17 3.14 3.08 3.22 3.33 3.07 3.09 3.20 3.29 3.08 3.19 3.60 3.45 2.93 3.01 2.89 3.34 2.71 2.61 2.61 2.66 Unit-Wide_Assessment_Report_0607_Abridged.doc Page 19 of 21 CIS ELED ENGL COMDIS EX_LBD EX_MSD FCS HLTH MUSIC-I IECE MATH MGE PHED SS 3.5 3.2 3.5 3.1 3.1 3.4 2.8 3.2 3.1 3.2 3.4 3.6 3.5 3.3 2.9 3.1 3.5 3.3 3.5 3.8 3.8 2.9 2.9 2.8 3.2 2.9 2.6 2.9 3.1 8 22 3.4 3.1 3.2 3.0 3.0 3.2 2.6 2.9 2.9 3.1 3.0 3.2 3.3 3.0 2.9 3.3 3.1 2.8 3.2 3.7 3.4 2.9 2.7 2.5 3.2 2.5 2.2 2.1 2.2 12 44 3.5 3.2 3.4 3.3 3.2 3.4 2.8 3.2 3.2 3.2 3.1 3.2 3.4 3.2 3.2 3.3 3.4 3.1 3.2 3.6 3.5 2.9 2.9 2.9 3.4 2.9 2.8 2.8 2.8 8 1571 3.5 3.1 3.2 3.1 3.0 3.1 2.7 3.1 3.1 3.0 2.9 3.3 3.3 2.9 3.0 3.3 3.1 2.9 3.1 3.6 3.6 2.9 2.7 2.7 3.3 2.3 2.0 2.1 2.1 12 98 3.3 3.0 3.1 3.2 3.1 3.2 3.1 3.2 3.1 3.1 3.1 3.4 3.3 3.0 3.3 3.2 3.4 3.1 3.3 3.6 3.3 3.2 3.3 3.1 3.3 2.9 2.6 2.6 2.7 5 18 3.4 3.1 3.2 3.1 3.1 3.3 3.3 3.2 3.2 3.1 3.0 3.1 3.3 3.0 3.2 3.1 3.3 3.1 3.1 3.6 3.4 3.2 3.5 3.2 3.3 2.8 2.6 2.5 2.6 5 280 3.3 3.1 3.2 3.0 2.9 3.2 3.1 3.0 3.1 2.8 2.9 3.0 3.1 2.7 3.2 3.0 3.3 3.0 3.0 3.6 3.1 3.0 3.4 3.0 3.2 2.5 2.7 2.7 2.7 11 26 3.5 3.2 3.4 3.2 3.3 3.5 2.6 3.3 3.1 3.3 3.2 3.2 3.4 3.2 3.0 3.3 3.2 3.2 3.1 3.6 3.5 3.1 2.8 2.8 3.2 2.6 3.1 2.8 3.2 5 37 4.0 3.0 4.0 4.0 3.0 4.0 3.0 4.0 4.0 3.0 3.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 4.0 3.0 4.0 4.0 3.0 0 1 3.4 3.0 3.1 3.0 3.0 3.2 2.8 2.8 3.1 3.2 2.9 3.3 3.4 2.8 3.1 3.2 3.2 2.7 3.3 3.7 3.5 2.9 3.0 2.9 3.4 2.4 2.7 2.5 2.3 13 36 3.1 3.1 2.6 2.7 2.6 3.2 3.0 2.8 3.4 3.2 2.6 3.3 3.4 2.4 3.1 3.1 3.6 2.7 3.4 3.7 3.1 3.0 3.6 3.4 3.1 2.8 3.1 2.9 2.9 10 14 3.4 3.0 3.5 3.4 3.3 3.0 2.8 3.0 3.1 3.0 2.8 3.1 3.2 3.0 3.0 3.1 3.2 3.1 2.9 3.5 3.5 3.1 3.4 2.9 3.4 2.5 2.5 2.5 2.7 10 22 3.5 3.1 3.3 3.2 3.1 3.2 2.8 3.2 3.1 3.1 3.1 3.3 3.3 3.0 2.8 3.2 3.2 3.1 3.3 3.6 3.5 2.9 3.0 2.8 3.3 2.6 2.4 2.5 2.6 9 170 3.4 3.0 3.1 3.1 3.1 3.1 2.8 2.9 3.1 3.1 2.9 3.3 3.3 2.9 3.2 3.1 3.1 2.8 3.2 3.7 3.4 2.8 2.9 2.9 3.3 2.5 3.2 2.6 2.4 12 84 3.3 2.9 3.1 3.0 2.9 3.0 2.8 3.1 3.0 2.9 3.0 3.1 3.1 2.9 2.9 3.0 3.1 3.1 3.0 3.4 3.3 2.8 2.8 2.9 3.1 2.6 2.4 2.6 2.9 18 116 TOTAVG CHEM 3.5 3.1 3.3 3.1 3.2 3.4 2.7 3.5 3.1 3.0 3.1 3.2 3.4 3.0 3.2 3.3 3.2 3.4 3.2 3.6 3.4 2.7 2.8 2.8 3.4 2.4 2.3 2.4 3.2 7 71 MG-SS BUSI 3.2 3.0 2.8 3.0 3.0 3.0 2.5 3.0 2.7 2.7 2.8 2.7 2.8 2.8 2.8 2.7 3.0 3.0 2.8 3.5 3.2 2.7 2.7 2.3 3.0 2.2 2.5 2.7 2.0 18 6 MG-SCI BIOL 3.4 3.3 3.1 3.1 3.1 3.3 2.6 3.1 3.4 3.3 3.3 3.3 3.5 3.1 3.1 3.2 3.2 3.0 3.3 3.7 3.4 2.9 3.1 2.8 3.3 2.3 2.3 2.3 2.5 7 25 MS-MTH ART 3.6 3.3 3.3 3.4 3.2 3.4 3.0 3.4 3.5 3.3 3.3 3.1 3.4 3.3 3.1 3.4 3.4 3.2 2.9 3.8 3.5 2.9 3.1 2.9 3.6 2.7 2.5 2.9 2.7 8 27 MS-ENG AGRI Table 25 Total EPSB Survey Responses by Program 3.8 3.5 3.6 3.5 3.4 3.8 2.8 3.2 3.5 3.5 3.6 3.5 3.5 3.4 2.9 3.5 3.2 3.3 3.4 3.7 3.7 3.1 3.2 2.8 3.7 3.7 3.3 3.6 3.4 3.4 3.4 3.0 3.3 3.3 3.3 3.5 3.5 3.5 3.4 3.1 3.5 3.3 3.2 3.5 3.7 3.6 3.1 3.0 3.0 3.6 3.6 3.4 3.5 3.5 3.6 3.5 2.9 3.4 3.2 3.4 3.4 3.5 3.5 3.4 3.1 3.5 3.6 3.4 3.5 3.7 3.5 3.3 3.3 2.8 3.6 3.6 3.1 3.6 3.5 3.3 3.3 2.7 3.4 3.3 3.2 3.4 3.3 3.5 3.3 3.1 3.3 3.3 3.3 3.2 3.6 3.6 3.0 3.2 3.0 3.4 3 13 0 32 2 11 2 23 3.5 3.2 3.3 3.2 3.2 3.3 2.9 3.2 3.2 3.2 3.1 3.2 3.4 3.1 3.1 3.2 3.3 3.1 3.2 3.6 3.5 2.9 3.0 2.9 3.4 2.8 2.6 2.6 2.7 7 274 ALL YEARS Design Units Contextual Information Aligned Assessment Reliable Assessment Formative Assessment Connecting to Real Life Instructing SPED children Technology - Instruction Instructional Variety Methods of Inquiry Interpreting Results PG Plan Reflection Presenting Learning Classroom Management Critical Thinking Collaboration Technology - Instruction Assessing PD Needs Ethics Content Knowledge Soc/Emotional Problems Disabilities SPED Behavior Issues OVERALL Reading Health Education Environmental Ed Economics N Items <3.00 Program N Unit-Wide_Assessment_Report_0607_Abridged.doc Page 20 of 21 Section 2. Continuous Assessment Results A. Introduction and Context Although WKU’s Professional Education Unit Conceptual Framework describes the unit’s mission, vision, and core beliefs, in the current assessment cycle the unit is focusing on the following key values: Belief 3 – Diversity. Recognizing and responding to student diversity represents both an instructional opportunity and instructional necessity. It is an opportunity to use what each child brings to the learning situation in order to facilitate learning. It is a necessity in that those who would attempt to ignore it risk marginalizing students, as diversity exists in every classroom and in every school. Thus, WKU should offer a variety of field experiences that reflect student diversity and demonstrate success with all students. Belief 5 – Reflection. Highly effective education professionals have a rich understanding of and appreciation for student differences and contextual variables. Such understanding requires reflection as the means to improve professional practice. Thus, WKU should provide multiple opportunities for candidates to reflect on their experiences toward the goals of improving their skills and P-12 student learning. Belief 7 – Knowledge, Skills, and Dispositions. WKU has adopted the Kentucky Teacher Standards as the core professional education competencies (knowledge and skills) targeted by all education preparation programs. WKU has adopted the following dispositional values: learning, personal integrity, diversity, collaboration, and professionalism. Thus, WKU should align curriculum and experiences to ensure that all candidates have the opportunity to develop these essential competencies and dispositions. Belief 8 – Technology. Technology provides teachers, school practitioners, and all educators extensions of their abilities to move toward new and higher performance levels. Thus, the WKU education professional preparation unit should strive to provide instruction in, model, and assess the use of technology tools considered essential for instruction, assessment, management, and research related to schools. Beliefs 9 & 10 – Accountability and Assessment. Highly effective education professionals hold themselves accountable for their students’ learning results and use these results to make decisions about professional development and program improvement. In addition, highly effective education units develop and maintain an assessment system that provides credible performance data on the progress and achievement of each candidate available for feedback and reporting to the candidate, faculty, and program. Thus, WKU should model accountability by monitoring candidate progress through assessments that are aligned to professional standards. B. Kentucky Teacher Standards Assessment Summary Table 26 provides a summary of candidate passing rates within and across assessments and surveys. Note that the overall average is the calculated average pass rate across assessments and surveys with each instrument average receiving equal weight. Unit-Wide_Assessment_Report_0607_Abridged.doc Page 21 of 21 Table 26 Summary of Assessment Results by Kentucky Teacher Standard and Component Component 2: Course Based Assessment Data Component 4: Culminating Assessment Data Kentucky Teacher Standards Component 5: Exit and Follow Up Data OVERALL Critical Performance Pass Rates TWS Pass Rates Student Teacher Survey Pass Rates* Praxis II Pass Rate Teacher Survey AVERAGE 8 - Content Knowledge 88% 94% 90% 97% 83% 90% 1 - Designs/Plans 93% 88% 87% 74% 86% 2 - Learning Climate 95% 90% 87% 91% 3 - Implements/Manages 87% 82% 87% 74% 83% 4 -Assessment/Evaluation 94% 79% 84% 73% 83% 5 - Reflection 97% 80% 85% 86% 87% 6 - Collaboration 92% 80% 68% 80% 7 - Professional Development 96% 73% 91% 87% 87% 9 - Technology 95% 87% 86% 86% 89% 82% 60% 71% 10 - Leadership 99%** *Survey Pass Rates calculated as percentage of respondents with Kentucky Teacher Standard Averages >2.99 on survey questions. **Not included in Rough Average Calculation.