Professional Education Unit Assessment Report - Initial Preparation Programs Academic Year 2009-10

advertisement
Professional Education Unit
Assessment Report - Initial Preparation Programs
Academic Year 2009-10
Report Version: August 10, 2010
Note: Any questions or comments regarding the contents of this report should be directed to Tony Norman
(tony.norman@wku.edu), CEBS Associate Dean, Accountability & Research.
Unit Wide Assessment Report 200910 Final Page 2 of 27
Professional Education Unit Assessment Report - Initial Preparation Programs
Academic Year 2009-10
Overview: This report includes assessment and survey results from the following data collection points
and sources:
 Admission Data (Academic Year 2009-10)
o Number, percentage, and average GPA by program of teacher preparation candidates approved
by the Professional Education Council for admission
o Admission test score averages by program
 Course-Based Assessment Data (Academic Year 2009-10)
o Percentage of candidates scoring at each level of proficiency on critical performances
o Percentage of program candidates scoring proficient on critical performances by Kentucky
Teacher Standards
o Listing of candidates scoring below proficiency on at least two critical performances
 Clinical Experiences Data (Academic Year 2009-10)
o Field Experience Summary demographic information (National Center for Education Statistics
[NCES] and candidate self-report data)
o Student teaching demographic information (NCES data)
 Dispositions Data (Academic Year 2009-10)
o Admission and early clinical dispositions data by program
o Student Teacher Evaluation dispositions results by program
 Culminating Assessment Data (Academic Year 2009-10)
o Teacher Work Sample (TWS) Results: Candidates Meeting Standards (by program, by TWS
components, and by Kentucky Teacher Standards)
o Teacher Work Sample Results: Impact on P-12 Student Learning
o Student Teacher Evaluation results by program and Kentucky Teacher Standards
 Exit and Follow-Up Data
o Praxis results (2008-09 cohort)
o WKU Teacher Survey results (2009-10 student teacher and alumni results)
o Kentucky Teacher Internship Program (KTIP) results (2009-10)
See the WKU Professional Education Unit Wide Continuous Assessment Matrix – Initial Preparation on
the next page for a conceptual map that guides our data collection efforts.
Section 1 describes results by data collection point. Section 2 summarizes these results based on what
they tell us about candidate proficiency toward Kentucky Teacher Standards, as well as other key
Conceptual Framework values. Section 3 discusses current and planned efforts to report and
disseminate these results. Section 4 outlines key decisions made during 2009-10 based on the 2008-09
Annual Report and new decisions to be considered based on the 2009-10 results.
Unit Wide Assessment Report 200910 Final Page 3 of 27
KY
REQ's
Content Knowledge
Designs/Plans
Learning Climate
Implements/Manages
Assessment/Evaluation
Technology
Reflection
Collaboration
Professional Development
Leadership
Dispositions
FR a-f
Field Experiences & Clinical
Practice
Diversity
Impacts P-12 Student Learning
DATA MAINTAINED BY:
DATA HOUSED IN:
DATA REPORTING CYCLE:
DATA REVIEWED BY:
Praxis
II
Graduate
Survey
Principal
Survey*
DFI 2**
1a-d, Overall
1a-d
1a-d
1a-d
CF 1-5, LG 1-4,
DFI 1, 3-5
2a-e, Overall
2a-e
2a-e
2a-e
3a-e, Overall
3a-e
3a-e
3a-e
IDM 1-3
4a-e, Overall
4a-e
4a-e
4a-e
AP 1-5, ASL 1-4
5a-d, Overall
5a-e
5a-e
5a-e
DFI 6
6a-d, Overall
6a-d
6a-d
6a-d
RSE 1-3
7a-c, Overall
7a-c
7a-c
7a-c
8a-b, Overall
8a-d
8a-d
8a-d
9a-c, Overall
9a-d
9a-d
9a-d
10a, Overall
10a-d
10a-d
10a-d
Ed Tech
Ed Tech
RSE 4-5
FX a-l
Summary
Form
Summary
Form
Component 5:
Exit and Follow-Up Data
State Approved Certification Exams
Faculty
Recs
Various Data Required by State for Admission into Teacher Preparation Programs
Conceptual Framework
Standards/Values
Aligned to Kentucky Teacher Standards
Component 1:
Admission
Data
WKU PROFESSIONAL EDUCATION UNIT WIDE CONTINUOUS ASSESSMENT MATRIX - INITIAL PREPARATION
Component 2:
Component 3:
Component 4:
Course-Based
Clinical Experiences Data
Culminating Assessment Data
Assessment Data
Capstone
Early Clinical
Final Clinical
Final Clinical
Exit
Critical Performances
Assessment
Experiences
Experience
Evaluation
Survey
(TWS)
Disp a-l
OTS Data
OTS Data
CF 1-5, AP 5, DFI
4, IDM 2
Disp g
AP 1-5, ASL 1-4
OTS
Faculty
CEBS ACCSYS
CEBS ACCSYS
Semester
Yearly
Yearly
Yearly
Yearly
Yearly
Yearly
Yearly
Yearly
Biannually
PEC
Faculty/Programs/PEC
Program
Programs/PEC
Programs/PEC
Programs/PEC
Programs/PEC
PEC
Programs/PEC
Programs/PEC
*Data sources in the process of being added to the electronic assessment system
**Cells reflect instruments or rubric/survey items keyed to CF Standards/Values
C&I Staff
OTS
CEBS ACCSYS
C&I Staff/Ed Tech
OTS/EdTech
Ed Tech
CEBS ACCSYS
OTS
BANNER/CEBS ACCSYS
Unit Wide Assessment Report 200910 Final Page 4 of 27
Section 1. Continuous Assessment Results
A. Admission Data (Academic Year 2009-10)
Table 1 provides the number, percentages, and average overall GPAs of candidates by programs
approved by the Professional Education Council (PEC) for admission into initial teacher preparation
programs. Before the Office of Teacher Services submits their names for review and approval by the
PEC, candidates must meet minimum requirements established by the state and/or the WKU
Professional Education Unit.
Table 1 Approved Candidate GPA Averages by Program
CIP Code
0-Unknown
131001-Special Education
131012-Communication Disorders
N
Average
GPA
%
6
1%
3.44
29
7%
3.19
14
3%
3.71
175
41%
3.28
131203-Middle Grades Education
54
13%
3.24
131204-Interdisciplinary Early Childhood Education
10
2%
3.29
131301-Agriculture
12
3%
3.16
131302-Art Education
6
1%
3.15
131303-Business Education
7
2%
3.48
131308-Family Consumer Science
9
2%
3.33
131312-Music Education
20
5%
3.56
131314-Physical Education
14
3%
2.89
160905-Spanish
2
0%
3.87
190701-Interdisciplinary Early Childhood Education
2
0%
3.66
23
5%
3.35
250101-School Media Specialist
9
2%
3.47
260101- Biological Science
7
2%
3.10
270101-Mathematics
5
1%
3.06
131202-Early Elementary Education P-5
230101- English and Allied Language Arts
400501-Chemistry
1
0%
2.54
400703-Earth Science
1
0%
3.79
450101-History/Social Studies
18
4%
3.12
450801-History/Social Studies
3
1%
3.33
500901-Music Education
5
1%
3.40
432
100%
3.28
Grand Total
Unit Wide Assessment Report 200910 Final Page 5 of 27
Table 2 provides the average admission test scores of candidates by program approved by the
Professional Education Council (PEC) for admission into initial teacher preparation programs.
Table 2 Approved Candidate Test Score Averages by Program
ACT
CIP Code
N
PPSTM*
Mean
N
Mean
PPSTR*
N
Mean
PPSTW*
N
Mean
0-Unknown
131001-Special Education
SAT
N
1
Mean
1030
GRE
Composite
N
Mean
5
940
12
22
16
998
4
24
10
993
133
23
9
178
10
176
9
174
40
23
2
184
2
184
2
178
2
1115
131204-IECE
7
22
1
177
1
180
1
173
131301-Agriculture
9
23
1
185
1
175
1
172
131302-Art Education
4
24
131303-Business Education
5
24
2
875
131308-Family Consumer Science
4
23
20
25
131314-Physical Education
9
22
160905-Spanish
1
30
1
21
20
26
1
610
8
1093
2
1110
1
1130
47
1006
131012-Communication Disorders
131202-Early Elementary Education
131203-Middle Grades Education
131312-Music Education
190701-IECE
230101- English Allied Lang Arts
1
1
184
179
1
182
1
175
1
178
1
172
1
174
1
173
5
1
1340
1040
250101-School Media Specialist
260101- Biological Science
5
22
270101-Mathematics
4
28
400501-Chemistry
1
29
400703-Earth Science
1
24
450101-History/Social Studies
16
24
450801-History/Social Studies
2
25
500901-Music Education
5
23
1
180
2
181
2
175
Grand Total
303
23 16
179 19
178 18
174
7 1253
*PPST refers to the ETS Pre-Professional Skills Tests: Mathematics (M), Reading (R), & Writing (W) respectively.
B. Course-Based Assessment Data
Table 3 provides the percentage of candidates scoring at each level of proficiency on critical
performances within professional education courses for the 2009-10 academic year. Proficiency levels
are based on the following scale: 1 – Standard Not Met, 2 – Standard Partially Met, 3 – At Standard, and
4 – Above Standard.
Unit Wide Assessment Report 200910 Final Page 6 of 27
Course
ED-201
EDU-250
EDU-489
ELED-345
ELED-355
ELED-365
ELED-405
ELED-406
ELED-407
ELED-465
EXED-330
EXED-331
EXED-333
EXED-334
EXED-415
EXED-417
EXED-418
EXED-422
EXED-430
EXED-431
EXED-432
EXED-434
IECE-321
IECE-322
IECE-324
IECE-421
IECE-422
LME-318
LME-407
LME-410
LTCY-310
LTCY-320
LTCY-420
LTCY-421
LTCY-444
MGE-275
MGE-385
MGE-475
MGE-477
MGE-479
MGE-481
MUS-312
MUS-412
Table 3 CP Proficiency Level Percentages
1
2
3
0%
6%
0%
2%
0%
1%
0%
1%
1%
2%
0%
2%
0%
0%
0%
1%
0%
1%
0%
1%
0%
2%
0%
0%
0%
0%
0%
8%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
8%
0%
0%
0%
0%
0%
0%
1%
1%
0%
0%
0%
0%
10%
10%
0%
4%
1%
3%
2%
10%
2%
8%
1%
4%
1%
3%
0%
0%
0%
4%
0%
0%
0%
0%
0%
0%
0%
8%
4
74%
62%
67%
83%
60%
71%
67%
77%
55%
84%
34%
25%
0%
92%
8%
58%
0%
11%
0%
0%
19%
10%
52%
58%
30%
50%
65%
60%
52%
0%
20%
65%
43%
70%
71%
27%
44%
100%
27%
40%
34%
30%
17%
19%
36%
32%
16%
37%
27%
33%
21%
44%
14%
64%
75%
100%
0%
92%
42%
100%
89%
100%
100%
81%
90%
48%
33%
70%
50%
35%
39%
48%
100%
60%
31%
53%
19%
19%
68%
52%
0%
69%
60%
66%
70%
75%
Unit Wide Assessment Report 200910 Final Page 7 of 27
Course
1
MUS-415
PH-261
PSY-310
SEC-351
SEC-352
SEC-453
SEC-475
SEC-477
SEC-479
SEC-481
EXED-416
EXED-419
IECE-325
PE-320
CFS-381
MUS-416
PH-381
FREN-323
GERM-314
GERM-430
Grand Total
2
0%
0%
2%
1%
0%
1%
0%
0%
0%
0%
0%
0%
0%
0%
0%
20%
0%
0%
0%
0%
0%
3
0%
7%
3%
3%
0%
0%
0%
0%
0%
0%
0%
0%
0%
4%
0%
0%
0%
0%
0%
100%
2%
4
21%
20%
12%
56%
64%
36%
95%
17%
0%
94%
78%
59%
11%
58%
100%
20%
50%
0%
100%
0%
56%
79%
73%
82%
40%
36%
63%
5%
83%
100%
6%
22%
41%
89%
38%
0%
60%
50%
100%
0%
0%
42%
Table 4 indicates the level of candidate proficiency by program across critical performances related to
the Kentucky Teacher Standards. Candidates receiving an overall rating of 3 or 4 on a CP are considered
to have demonstrated proficiency on the standards associated with the CP.
Table 4 Percent† of Program Students Scoring Proficient on CPs by Teacher Standard
Program
Kentucky Teacher Standards*
1
2
3
4
5
6
7
8
9
10
Elementary Ed.
98%
98%
97%
97%
98%
99%
98%
98%
97%
100%
Middle Grades Ed.
96%
96%
95%
94%
96%
97%
96%
96%
97%
96%
Secondary Ed.
98%
98%
98%
97%
99%
99%
99%
100%
98%
100%
P-12 Ed.
98%
97%
97%
97%
97%
96%
97%
95%
97%
100%
5-12 Ed.
95%
98%
98%
95%
98%
98%
98%
100%
97%
100%
Exceptional Ed.
99%
94%
92%
98%
97%
100%
100%
100%
96%
100%
IECE
100%
100%
96%
99%
100%
100%
99%
99%
95%
100%
Unit-Wide
98%
98%
97%
96%
98%
98%
98%
98%
97%
99%
†Percentages based on all CPs completed by candidates based on their coursework--not just program requirements
*KTS Key: 1 – Content Knowledge, 2 – Designs/Plans Instruction, 3 – Maintains Learning Climate, 4 –
Implements/Manages Instruction, 5 – Assessment/Evaluation, 6 – Technology, 7 – Reflection, 8 – Collaboration, 9 –
Professional Development, 10 – Leadership
Unit Wide Assessment Report 200910 Final Page 8 of 27
Table 5 provides counts of 34 students who have scored 2 or below on two or more critical
performances over the 2009-10 academic year. The table highlights the counts of the 11 students who
scored low on three or more critical performances.
Table 5 Count of Students Scoring Below Proficient on CPs
Student ID
Score
1
0438
1
0119
6059
9635
0341
9280
7604
6231
7863
1
5266
1961
2
0523
8958
3271
1
1212
2
4920
1
7550
7117
1
7821
2
0157
1
4363
1
0138
1
7482
8816
5712
1
0602
4662
1
4600
9063
1
6134
9921
8339
4
4303
1
8839
Student N
Students with three or more low scores
Count Per Student
2
1
2
2
2
2
2
2
2
1
2
2
2
1
1
2
1
1
1
1
2
3
2
3
2
3
2
3
4
3
5
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
3
3
3
3
3
3
3
4
4
4
5
34
11
Unit Wide Assessment Report 200910 Final Page 9 of 27
C. Clinical Experiences Data (Academic Year 2009-10)
Over the 2009-10 academic year, 740 students reported demographic information on 893 field
placements, with an average of 15% ethnically diverse students, 46% students on free/reduced lunch,
and 16% student with disabilities (based on data from National Center for Education Statistics and
Kentucky Department of Education). The ethnic diversity percentage continues to be well above the
average 11% diversity of schools in the 30+ counties in our service area. Table 6 reveals percentages of
field experiences with various characteristics. Note that candidates could choose all the characteristics
that applied for any given experience.
Table 6. Percentages of Field Experience by Category Types
Working with Students With Special Needs
% Candidates working with Students with Physical Impairments
% Candidates working with Students with Learning Disabilities
% Candidates working with Students with Moderate/Severe Disabilities
% Candidates working with Students with Emotional/Behavioral Disorders
% Candidates working with Gifted Students
% Candidates working with English Language Learners
% Candidates working with Students with Visual Impairments
% Candidates working with Students with Hearing Impairments
% Candidates working with Students with Speech/Language Delays
% Candidates working with Students with Development Delays
% Candidates working with Students with Autism Spectrum Disorder
% Candidates working with Students with Other Impairments
Working with Diverse Students
% Candidates working with African American Students
% Candidates working with Native American/American Indian Students
% Candidates working with Latino/Hispanic Students
% Candidates working with Asian Students
% Candidates working with Students with Special Needs (Aggregate)
% Candidates working with Diverse Students (Aggregate)
15%
62%
13%
36%
50%
30%
9%
7%
30%
15%
19%
8%
83%
10%
65%
39%
88%
91%
Overall, as can be seen in Table 6, in 88% of their field experiences candidates reported working with at
least one student with special needs, and in 91% of their field experiences candidates reported working
with at least one student from a diverse ethnic group.
In addition, Table 7 reports the diversity percentages of the schools where student teachers were placed
during the 2009-10 academic year. The average overall diversity percentage remains slightly above the
average 11% ethnic diversity of the schools in the 31 counties that represent our service area.
Unit Wide Assessment Report 200910 Final Page 10 of 27
Table 7 Demographic Percentages of Student Teaching Sites
Key: AI/AN = American Indian/Alaskan, BL/AA = Black/African American, HIS/LAT = Hispanic/Latino, FRL = Students receiving
Free or Reduced Lunch, ELL = English Language Learners, ST W/ DIS = Students with Disabilities
Name of School
AI/AN ASIAN
BL/AA HIS/LAT WHITE DIVERSITY*
FRL†
ELL ST W/DIS
ABRAHAM LINCOLN ES
0.0
0.0
1.4
0.8
97.8
2.2
62.5
0.0
24.4
ADAIR COUNTY ES
0.2
0.0
2.2
2.8
94.8
5.2
69.3
0.0
18.6
ADAIR COUNTY MS
0.0
0.3
2.3
0.8
96.7
3.3
57.6
0.0
12.2
ALLEN COUNTY PRIMARY
0.0
0.0
1.2
1.3
97.5
2.5
53.0
0.0
12.2
ALLEN CTY-SCOTTSVILLE HS
0.1
0.1
0.9
0.4
98.5
1.5
38.4
0.0
11.3
ALVATON ES
0.2
0.2
2.0
2.6
95.0
5.0
32.4
0.0
26.1
APOLLO HS
0.0
0.9
4.5
1.3
93.3
6.7
34.6
0.4
9.4
ATHERTON HS
0.0
2.7
25.9
9.3
62.2
37.9
46.9
0.0
19.2
AUBURN ES
0.0
0.0
4.1
0.8
95.1
4.9
48.9
0.0
13.5
AUDUBON ES
0.2
1.3
9.2
3.2
86.2
13.8
63.8
0.0
21.8
AUSTIN TRACY ES
0.0
0.0
0.4
0.4
99.2
0.8
71.4
0.0
20.4
BARDSTOWN ES
0.0
1.5
20.3
1.8
76.5
23.5
63.3
0.0
12.7
BARDSTOWN MS
0.0
0.8
21.2
2.7
75.3
24.7
56.4
0.0
12.7
BARDSTOWN PRIMARY SCH
0.2
0.9
16.1
2.3
80.6
19.4
90.8
0.0
21.0
BARREN COUNTY HS
0.2
0.4
1.4
0.5
97.4
2.6
39.5
0.1
9.4
BARREN COUNTY MS
0.3
0.0
0.4
1.0
98.3
1.7
46.0
0.1
9.5
BEAVER DAM ES
0.0
0.2
2.0
9.8
88.0
12.0
70.4
0.0
17.7
**
**
BEECH ES
0.0
1.4
5.5
2.2
90.9
9.1
11.5
**
**
BEECH SENIOR HS
0.3
1.9
8.8
2.4
86.5
13.5
16.0
**
BLOOMFIELD ES
0.0
0.0
0.0
0.8
99.2
0.8
41.3
0.0
BONNIEVILLE ES
0.0
0.0
1.0
0.7
98.4
1.6
62.3
0.0
16.0
BOWLING GREEN HS
0.1
3.4
22.5
7.7
66.2
33.8
46.2
5.2
9.7
BOWLING GREEN MS
0.1
2.6
23.1
7.0
67.3
32.7
50.1
2.8
11.2
BRECKINRIDGE COUNTY MS
0.0
0.3
2.1
0.7
96.9
3.1
58.1
0.0
12.0
BREMEN ES
0.0
0.0
0.8
0.3
99.0
1.0
59.2
0.0
18.9
BRIARWOOD ES
0.2
4.7
10.1
2.5
82.5
17.5
22.8
0.0
17.9
BRISTOW ES
0.2
1.5
13.5
5.1
79.8
20.2
47.8
0.0
16.8
BURNS ES
0.0
2.3
5.3
4.1
88.3
11.7
38.7
0.0
24.4
CALHOUN ES
0.0
0.0
0.0
0.0
100.0
0.0
53.6
0.0
15.7
CAMDEN STATION ES
0.0
0.6
1.9
1.2
96.3
3.7
15.0
0.4
20.7
CANEYVILLE ES
0.3
0.3
0.3
0.8
98.5
1.5
79.3
0.0
23.1
CARRITHERS MS
0.2
0.5
42.6
4.5
52.3
47.7
55.7
0.0
23.7
CAVERNA ES
0.0
0.3
14.2
2.2
83.4
16.6
92.3
0.0
28.5
CAVERNA MS
0.5
0.5
12.6
0.5
85.9
14.1
74.4
0.0
19.5
CENTERFIELD ES
0.0
0.4
1.5
1.7
96.5
3.5
11.9
0.4
15.7
CENTRAL HARDIN HS
0.2
1.4
3.8
1.0
93.7
6.3
30.8
0.0
8.9
CHENOWETH ES
0.0
1.3
39.7
1.9
57.1
42.9
59.0
0.0
25.1
CLARKSON ES
0.2
0.0
0.5
1.5
97.8
2.2
64.6
0.0
19.9
COLLEGE VIEW MS
0.0
1.2
2.3
0.4
96.1
3.9
30.2
0.2
11.2
**
**
COOPERTOWN ES
0.3
0.3
1.7
2.8
94.8
5.2
27.1
**
**
COOPERTOWN MS
0.0
0.6
4.0
3.1
92.3
7.7
24.0
CUMBERLAND COUNTY ES
0.0
0.2
2.5
1.2
96.1
3.9
75.3
0.0
28.4
CUMBERLAND COUNTY HS
0.3
0.3
1.8
0.0
97.7
2.3
58.6
0.0
10.1
CUMBERLAND TRACE ES
0.2
3.1
9.9
6.6
80.2
19.8
51.7
0.2
23.7
DAVID T. WILSON ES
0.0
0.5
2.4
1.0
96.2
3.9
59.1
0.0
11.4
Unit Wide Assessment Report 200910 Final Page 11 of 27
Name of School
DAVIESS COUNTY HS
DAVIESS COUNTY MS
DAWSON SPRINGS HS
DAWSON SPRINGS MS
DEER PARK ES
DISHMAN MCGINNIS ES
DRAKES CREEK MS
EAST HARDIN MS
EAST OLDHAM MS
EAST VIEW ES
EDMONSON COUNTY HS
EDMONTON ES
EKRON ES
ELIZABETHTOWN HS
ESTES ES
F T BURNS MS
FLAHERTY ES
FORDSVILLE ES
FOSTER HEIGHTS ES
FRANKLIN ES
FRANKLIN-SIMPSON HS
FRANKLIN-SIMPSON MS
G C BURKHEAD ES
GALLATIN SENIOR HS
GAMALIEL ES
GLASGOW HS
GLASGOW MS
GRAYSON COUNTY HS
GRAYSON COUNTY MS
GREEN COUNTY MS
GREENBRIER ES
GREENWOOD HS
H W WILKEY ES
HANCOCK COUNTY MS
HELMWOOD HEIGHTS ES
HENDERSON COUNTY HS
HENDERSONVILLE HS
HENRY F MOSS MS
HISEVILLE ES
HODGENVILLE ES
HOWEVALLEY ES
INDIAN LAKE ES
IROQUOIS HS
JAMESTOWN ES
JOE SHAFER MS
JOHN ADAIR INTERM SCH
KRISLE ES
AI/AN
0.1
0.0
0.0
0.0
0.0
0.0
0.4
0.0
0.0
0.0
0.3
0.2
0.0
0.2
0.3
0.0
0.5
0.0
0.0
0.0
0.0
0.0
0.2
0.1
0.0
0.0
0.0
0.0
0.1
0.0
0.0
0.1
0.0
0.0
0.4
0.1
0.0
0.0
0.0
0.6
0.4
0.2
0.3
0.0
0.3
0.0
0.0
ASIAN
0.9
0.4
0.0
0.5
1.3
2.2
2.5
0.6
0.6
0.0
0.2
0.0
1.0
4.0
0.0
1.1
0.3
0.0
0.0
0.9
0.7
0.4
3.7
0.8
0.0
1.3
0.7
0.3
0.0
0.3
1.1
3.5
0.0
0.0
3.5
0.7
1.7
0.9
0.0
0.4
1.3
0.5
3.6
0.0
0.7
0.5
0.5
BL/AA
0.8
1.5
0.0
0.0
2.5
31.0
4.8
4.7
1.2
0.7
3.3
0.5
1.7
14.3
15.5
4.7
2.0
0.0
2.6
11.3
11.9
13.5
17.7
22.9
1.4
14.8
18.5
0.9
0.3
1.3
2.2
5.0
2.1
1.1
15.0
9.9
4.8
17.3
0.0
5.8
0.9
1.9
53.2
3.6
21.4
3.1
25.3
HIS/LAT
0.6
1.4
0.0
0.0
1.3
13.9
2.2
0.9
1.6
2.4
0.5
1.8
0.5
2.1
3.7
1.6
2.9
1.1
1.4
2.8
0.7
1.5
2.2
4.2
3.6
1.7
2.4
0.9
0.5
0.3
2.6
2.0
0.6
1.7
2.0
1.0
3.4
7.0
1.7
3.2
0.9
1.4
5.3
1.8
4.8
2.1
10.8
WHITE
97.6
96.7
100.0
99.5
94.9
52.9
90.1
93.9
96.7
97.0
95.8
97.5
96.9
79.6
80.5
92.5
94.3
98.9
96.0
85.0
86.8
84.6
76.2
72.1
95.0
82.2
78.5
97.9
99.1
98.2
94.1
89.3
97.3
97.3
79.0
88.4
90.2
74.8
98.3
90.0
96.6
96.1
37.7
94.7
72.8
94.3
63.4
DIVERSITY*
2.4
3.3
0.0
0.5
5.1
47.1
9.9
6.1
3.3
3.0
4.3
2.5
3.2
20.4
19.5
7.5
5.7
1.1
4.0
15.0
13.2
15.4
23.8
27.9
5.1
17.8
21.5
2.1
0.9
1.8
5.9
10.7
2.7
2.8
21.0
11.7
9.9
25.2
1.7
10.0
3.4
3.9
62.4
5.4
27.2
5.7
36.6
FRL†
25.2
37.6
55.9
59.2
45.5
101.5
23.7
34.3
14.6
67.0
48.9
72.0
50.4
34.3
106.8
44.3
59.3
76.7
49.0
98.6
33.7
49.0
52.1
37.9
80.1
40.8
50.0
41.7
48.7
54.7
30.3
15.7
68.9
36.9
62.7
34.5
15.1
93.2
59.1
56.6
65.1
3.2
72.9
72.2
47.3
54.1
52.1
ELL
0.3
0.4
**
**
0.0
2.8
1.0
0.0
1.1
0.4
0.0
0.0
0.0
0.1
0.0
0.7
0.0
0.0
0.0
0.0
0.0
0.0
0.0
**
0.0
0.4
0.0
0.0
0.0
0.0
**
0.3
0.0
0.0
0.0
0.0
**
1.7
0.0
1.2
0.0
**
0.0
0.0
**
0.0
**
ST W/DIS
8.1
10.7
**
**
21.3
17.8
8.8
11.9
13.7
21.0
9.3
23.3
14.8
8.2
26.9
14.7
15.6
23.7
27.7
31.5
8.9
8.2
20.2
**
18.3
9.2
15.2
6.4
11.4
13.9
**
5.7
18.2
10.5
24.0
9.3
**
9.9
20.2
20.4
28.2
**
28.6
24.2
**
15.1
**
Unit Wide Assessment Report 200910 Final Page 12 of 27
Name of School
LAKEWOOD ES
LARUE COUNTY HS
LARUE COUNTY MS
LEBANON JUNCTION ES
LINCOLN ES
LINCOLN TRAIL ES
LIVERMORE ES
LOST RIVER ES
MADISON CREEK ES
MEADE COUNTY HS
METCALFE COUNTY HS
MONROE COUNTY MS
MORGANTOWN ES
MORNINGSIDE ES
MOUNT WASHINGTON ES
MUHLENBERG NORTH MS
MUHLENBERG SOUTH ES
MUNFORDVILLE ES
NANNIE BERRY ES
NEW HIGHLAND ES
NEWTON PARRISH ES
NIAGARA ES
NORTH HANCOCK ES
NORTH HARDIN HS
NORTH TODD ES
NORTH WARREN ES
OAKLAND ES
OHIO COUNTY MS
ORAN P LAWLER ES
OWENSBORO MS
PARK CITY ES
PARKER BENNETT CURRY ES
PORTLAND HS
PORTLAND MS
POTTER GRAY ES
R E STEVENSON ES
RED CROSS ES
RICH POND ES
RICHARDSVILLE ES
RINEYVILLE ES
ROCKFIELD ES
RUCKER STEWART MS
RUSSELL COUNTY MS
RUSSELLVILLE HS
RUSSELLVILLE MS
SALEM ES
SENECA HS MAGNET
AI/AN
0.2
0.0
0.0
0.3
0.5
0.3
0.3
0.2
0.1
0.5
0.2
0.2
0.0
0.2
0.0
0.0
0.0
0.0
0.0
0.2
0.0
0.0
0.0
0.4
0.0
0.3
0.0
0.0
0.0
0.0
0.0
0.0
0.4
0.1
0.3
0.2
0.1
0.1
0.0
0.0
0.0
0.3
0.2
0.3
0.5
0.0
0.1
ASIAN
0.5
0.1
0.0
0.0
0.2
1.5
0.0
1.9
2.7
0.5
0.4
0.0
0.2
1.9
0.5
0.0
0.0
0.4
1.9
3.8
1.0
0.0
0.2
4.6
0.0
0.0
1.6
0.2
0.3
0.0
0.6
3.8
0.4
0.6
2.3
1.0
0.0
1.7
0.0
0.8
0.0
0.5
0.2
1.2
0.5
0.0
1.6
BL/AA
4.5
5.9
3.2
0.3
10.3
3.2
2.0
13.9
11.8
1.8
1.8
4.1
0.8
16.6
0.9
2.6
3.1
6.7
12.8
21.8
3.0
1.0
1.4
30.9
2.5
4.3
11.2
0.8
1.1
18.6
2.1
39.6
3.4
5.0
9.0
22.7
0.6
2.7
0.2
6.2
4.3
25.7
0.7
29.4
30.1
0.0
37.7
HIS/LAT
1.8
1.4
2.7
0.3
1.1
1.3
2.0
10.3
2.6
0.7
0.2
1.1
2.8
3.2
0.7
1.0
0.7
0.2
3.0
4.6
3.9
2.2
1.0
6.1
1.8
1.3
8.0
1.6
0.3
0.6
0.9
31.2
2.1
2.7
2.6
3.6
0.9
2.6
1.2
0.8
1.1
7.7
1.2
2.9
3.0
1.7
4.8
WHITE
93.0
92.6
94.2
99.1
87.9
93.7
95.6
73.8
82.7
96.5
97.4
94.6
96.2
78.1
97.9
96.4
96.2
92.7
82.4
69.6
92.1
96.8
97.5
58.1
95.8
94.2
79.3
97.5
98.4
80.9
96.4
25.5
93.8
91.6
85.9
72.6
98.4
92.9
98.6
92.3
94.6
65.8
97.6
66.2
66.0
98.3
55.8
DIVERSITY*
7.0
7.4
5.8
0.9
12.1
6.3
4.4
26.2
17.3
3.5
2.6
5.4
3.8
21.9
2.1
3.6
3.8
7.3
17.6
30.4
7.9
3.2
2.5
41.9
4.2
5.8
20.7
2.5
1.6
19.1
3.6
74.5
6.2
8.4
14.1
27.4
1.6
7.1
1.4
7.7
5.5
34.2
2.4
33.8
34.0
1.7
44.2
FRL†
58.0
43.5
58.7
49.7
47.4
40.6
67.4
93.2
16.4
40.2
54.7
66.7
45.2
55.9
35.5
50.9
70.0
53.5
23.0
58.5
63.4
41.5
51.3
43.4
51.5
58.7
63.0
49.8
63.5
68.9
67.0
100.0
28.5
41.3
32.1
76.6
50.7
26.1
42.7
46.1
50.2
52.4
62.2
52.9
49.8
57.7
41.3
ELL
0.0
0.0
0.2
0.0
0.2
0.0
0.0
0.3
**
0.0
0.0
0.0
0.0
0.0
0.0
0.0
0.0
0.0
**
0.1
0.0
0.0
0.0
0.1
0.0
0.0
0.2
0.0
0.0
0.2
0.0
3.6
**
**
0.2
0.0
0.0
0.3
0.0
0.0
0.0
**
0.0
1.8
0.0
0.0
0.0
ST W/DIS
27.6
9.2
17.3
18.8
8.5
22.6
26.7
18.6
**
10.3
12.9
15.6
16.6
12.5
14.0
6.4
19.9
20.8
**
24.2
19.2
15.7
20.4
7.2
33.1
26.2
23.9
15.8
17.5
22.8
18.8
20.6
**
**
9.3
21.4
13.0
14.6
24.7
20.4
16.7
**
10.6
10.8
8.1
22.1
19.8
Unit Wide Assessment Report 200910 Final Page 13 of 27
Name of School
AI/AN ASIAN
BL/AA HIS/LAT WHITE DIVERSITY*
FRL†
ELL
SIMPSON ES
0.2
0.4
11.1
1.8
86.6
13.5
55.0
0.0
SORGHO ES
0.0
0.7
3.7
2.2
93.4
6.6
56.7
0.0
SOUTH EDMONSON ES
0.5
0.0
0.5
1.0
98.1
2.0
59.9
0.0
SOUTH GREEN ES
0.0
1.4
12.7
2.6
83.3
16.7
53.2
0.0
SOUTH HANCOCK ES
0.0
0.0
1.1
0.5
98.4
1.6
63.4
0.0
SOUTH HEIGHTS ES
0.0
0.2
17.2
1.8
80.8
19.2
89.4
0.0
SOUTHERN ES
0.9
0.0
0.4
1.3
97.5
2.6
72.3
0.0
SOUTHERN HS MAGNET
0.1
1.4
29.4
3.5
65.6
34.4
48.9
0.0
SOUTHSIDE ES
0.0
0.2
0.9
0.9
98.1
1.9
62.8
0.0
**
STATION CAMP HS
0.2
1.3
11.0
2.3
85.2
14.8
16.2
STUART PEPPER MS
0.4
0.7
2.4
0.8
95.7
4.3
44.1
0.0
T C CHERRY ES
0.0
1.6
16.3
4.3
77.8
22.2
59.1
0.0
TALTON K STONE MS
0.2
2.2
14.2
1.2
82.2
17.9
44.6
0.0
TAYLOR COUNTY ES
0.0
0.3
1.4
1.4
97.0
3.0
50.5
0.2
TEMPLE HILL ES
0.6
0.0
0.3
0.9
98.1
1.9
68.0
0.0
TODD COUNTY CENTRAL HS
0.2
0.3
10.9
2.2
86.4
13.6
44.6
0.2
TOMPKINSVILLE ES
0.0
0.0
5.7
4.0
90.3
9.7
80.1
0.0
W R MCNEILL ES
0.0
4.1
14.1
2.2
79.7
20.3
27.9
0.5
**
WALTON FERRY ES
0.2
0.4
7.3
3.0
89.0
11.0
26.9
WARREN CENTRAL HS
0.0
1.9
19.5
4.6
74.0
26.0
50.7
5.8
WARREN COUNTY ES
0.0
2.5
27.3
17.4
52.9
47.1
80.6
0.1
WARREN EAST HS
0.2
0.8
10.7
2.2
86.1
13.9
45.9
0.2
WARREN EAST MS
0.0
1.2
8.3
2.6
87.9
12.1
56.8
0.1
WEST HARDIN MS
0.5
0.2
5.3
1.1
92.9
7.1
46.6
0.0
WEST LOUISVILLE ES
0.0
0.4
0.4
2.0
97.2
2.8
52.2
0.0
**
WHITE HOUSE HERITAGE
0.4
1.5
1.4
2.1
94.6
5.5
23.9
**
WHITE HOUSE HS
0.1
0.4
2.9
1.3
95.3
4.7
20.3
WHITESVILLE ES
0.0
0.3
1.3
0.3
98.1
1.9
43.4
0.0
WILLIAM NATCHER ES
0.0
8.2
5.5
4.8
81.5
18.5
19.2
0.9
Average Percentages
0.1
0.9
8.3
2.6
88.1
11.9
51.3
0.2
*Diversity equals combined percentage of Native American/Alaskan, Asian, Black/African American, and
Hispanic/Latino students in the school
†Some percentages exceed 100 because state reports MORE students in a category than the TOTAL number of
students in the school
**n/a - Data not available from Tennessee schools
ST W/DIS
11.0
27.2
21.0
16.4
28.2
21.2
21.7
25.2
28.7
**
12.5
18.9
9.8
16.7
19.2
9.8
20.0
8.6
**
8.6
20.1
8.7
13.4
13.9
29.0
**
**
17.2
17.1
17.1
Unit Wide Assessment Report 200910 Final Page 14 of 27
D. Dispositions Data (Academic Year 2009-10)
During the 2007-08 school year, a dispositions rubric was developed and adopted at the initial
preparation level. The faculty recommendation used for teacher program admission now reflects Level
1 dispositions. The full rubric is used as part of the student teaching evaluation process. All initial
programs have developed Program Assessment Plans that outline how each program collects midprogram level dispositions data. These were finalized throughout 2008, as all programs prepared
Program Review Documents (aka folios) to be submitted to the EPSB as a required part of our
accreditation renewal process. Tables 8 and 9 report how initial program candidates are performing on
our dispositions as they enter and progress through their program and during their student teaching
experience. Students are considered “proficient” who average 3 or higher on each dispositions
category.
Table 8 Proficiency Rates on Unit Wide Dispositions Prior to Student Teaching
Program
Elementary Ed.
Values
Learning
99%
WKU Professional Education Dispositions
Values Personal
Values
Values
Integrity
Diversity
Collaboration
100%
100%
100%
Values
Professionalism
99%
Middle Grades Ed.
100%
100%
100%
100%
100%
Secondary Ed.
99%
100%
100%
100%
100%
P-12 Ed.
98%
100%
100%
100%
100%
5-12 Ed.
100%
100%
100%
100%
100%
Exceptional Ed.
97%
100%
100%
100%
100%
IECE
100%
100%
*
*
*
99%
100%
100%
100%
99%
Unit-Wide
*Data not available
Table 9 Proficiency Rates on Unit Wide Dispositions during Student Teaching
Program
Values
Learning
WKU Professional Education Dispositions
Values Personal
Values
Values
Integrity
Diversity
Collaboration
Values
Professionalism
Elementary Ed.
99%
100%
100%
99%
99%
Middle Grades Ed.
100%
97%
100%
100%
98%
Secondary Ed.
100%
100%
100%
100%
99%
P-12 Ed.
85%
93%
93%
90%
88%
5-12 Ed.
100%
100%
100%
100%
100%
Exceptional Ed.
100%
100%
100%
100%
92%
IECE
100%
100%
100%
100%
100%
Unit-Wide
98%
99%
99%
99%
98%
Unit Wide Assessment Report 200910 Final Page 15 of 27
E. Culminating Assessment Data (Academic Year 2009-10)
Teacher Work Sample Results: Candidates Meeting Standards
As Component 4 of our unit wide Continuous Assessment Plan (CAP) strategy, all initial preparation
candidates complete a culminating assessment of professional and pedagogical knowledge and skills,
the Teacher Work Sample (TWS). Although in spring 2008 the Professional Education Council agreed
that candidates who score a holistic score of at least “2 – Developing” are able to exit the program, for
program evaluation purposes our goal is that at least 80% of program candidates will achieve “3 –
Proficient” or higher. Table 10 represents three-year proficiency rates by program area.
Table 10 Initial Preparation TWS Proficiency Rates
Program Type
Elementary Ed.
Middle Grades Ed.
Secondary Ed.
P-12 Ed.
5-12 Ed.
Exceptional Ed.
IECE
Unit-Wide
2009-10
99%
99%
99%
100%
100%
100%
100%
99%
2008-09
92%
95%
90%
93%
100%
100%
100%
93%
2007-08
89%
86%
73%
84%
80%
96%
100%
86%
Because faculty score TWS at the indicator level, we can use their scores to ascertain candidate success
in meeting each component of the TWS. For program evaluation purposes, candidates are considered
successful who average at least 2.5 on a three-point scale (1 – Not Met, 2 – Partially Met, and 3 – Met)
on indicators associated with each component. Table 11 and Chart 1 depict the percentage of
candidates by program who averaged at least 2.5 on the indicators for each TWS Factor: CF –
Contextual Factors, LG – Learning Goals, AP – Assessment Plan, DFI – Design for Instruction, IDM –
Instructional Decision Making, ASL – Analysis of Student Learning, and RSE – Reflection and SelfEvaluation.
Table 11 Percentage by Program of Candidates who “Passed” Each TWS Component
Major
CF
LG
AP
DFI
IDM
ASL
RSE
ELED
98%
98%
85%
98%
95%
89%
97%
MGE
100%
100%
98%
98%
83%
90%
90%
SECED
87%
95%
97%
97%
95%
74%
84%
P-12
97%
100%
97%
100%
100%
92%
92%
5-12
100%
100%
96%
100%
100%
92%
100%
EXED
92%
100%
100%
100%
100%
83%
92%
IECE
100%
100%
89%
100%
95%
95%
100%
Total
96%
98%
91%
98%
94%
87%
93%
Unit Wide Assessment Report 200910 Final Page 16 of 27
Chart 1 Percentage by Program of Candidates who “Passed” Each TWS* Factor
*TWS Key: CF – Contextual Factors, LG – Learning Goals, AP – Assessment Plan, DFI – Design
for Instruction, IDM – Instructional Decision-Making, ASL – Analysis of Student Learning, RSE –
Reflection & Self-Evaluation
Because the TWS indicators have been aligned to Kentucky Teacher Standards, we can use these scores
to ascertain candidate success in meeting each standard related to the TWS (Chart 2 and Table 12).
Chart 2 Percentage by Program of Candidates who “Passed” Each Kentucky Teacher Standard*
*KTS Key: 1 – Content Knowledge, 2 – Designs/Plans Instruction, 4 – Implements/Manages
Instruction, 5 – Assessment/Evaluation, 6 – Technology, 7 – Reflection, 9 – Professional
Development
Unit Wide Assessment Report 200910 Final Page 17 of 27
Table 12 Percentage of Program Candidates “Passing” Each Kentucky Teacher Standard*
Major
1*
2
4
5
6
7
9
ELED
97%
98%
95%
86%
94%
97%
95%
MGE
100%
100%
85%
96%
96%
96%
88%
SECED
92%
95%
95%
87%
95%
89%
81%
P-12
97%
100%
100%
97%
100%
95%
89%
5-12
100%
100%
100%
92%
100%
96%
96%
EXED
100%
100%
100%
100%
100%
92%
92%
IECE
100%
100%
95%
89%
95%
100%
100%
Total
97%
98%
95%
90%
96%
95%
91%
*KTS Key: 1 – Content Knowledge, 2 – Designs/Plans Instruction, 4 – Implements/Manages Instruction,
5 – Assessment/Evaluation, 6 – Technology, 7 – Reflection, 9 – Professional Development
Teacher Work Sample Results: Impact on P-12 Student Learning
Like many NCATE institutions, WKU has relied on the TWS to document candidate impact on P-12
student learning. Although it seems intuitive that candidate success on the TWS should translate into
positive impact on P-12 learning (and NCATE accepts such evidence), the national mood requires “proof
positive” that teacher preparation does so. One line of evidence that many TWS institutions present is
the pre-post assessment data embedded within the TWS. Guided by the earlier work of these
institutions and with WKU faculty input, the Associate Dean for Accountability and Research, the
Manager of the Educational Technology Center, and CEBS Web Developer created an Excel workbook to
capture these data. Additionally, the workbook was enhanced to provide candidates completing TWS
with readymade graphs of P-12 student learning once the data were entered. Volunteer faculty
provided this workbook to their candidates, who in turn entered the performance of individual P-12
students (without names) on each learning goal. Candidates then uploaded their completed workbooks
along with their TWS into the WKU E-PASS Electronic Portfolio System.
During the 2009-10 academic year, 235 candidates in ELED 405 or EDU 489 uploaded completed Excel
workbooks containing 5295 records of P-12 student learning data. These data were compiled to
ascertain P-12 student learning gains on goals established in each TWS. For reporting purposes, all P-12
student scores were converted to percentages of items correct for each learning goal. Chart 3 reveals
the average P-12 student learning gains (35% gain for Learning Goal A; 37% gain for Learning Goal B)
reported in TWS. Additionally, candidates set targets for each learning goal that represented how well
individual P-12 students had to perform in order to be considered as reaching proficiency on a particular
goal. Chart 4 reveals the increasing numbers of students (47% more students on Learning Goal A; 45%
more on Learning Goal B) who reached the target level on the post-assessment items related to the two
learning goals.
Unit Wide Assessment Report 200910 Final Page 18 of 27
Chart 3 Average P-12 Student Gains on TWS Learning Goals
Chart 4 Percentage of P-12 Students Reaching Proficiency on TWS Learning Goals
Student Teacher Evaluation Results
Additionally, all candidates are assessed during their student teaching experience using the Student
Teaching Evaluation form. Although in years past this form had been somewhat standard aligned, a
shortcoming of the form was that indicators for standards were not fully developed, with the result that
nearly all candidates received high marks. Three years ago, the form was redesigned to align more
clearly with the Kentucky Teacher Standards and the descriptive rubrics developed for these standards
as part of the Kentucky Teacher Internship Program. These rubrics were developed by a statewide Task
Force under the direction of the Kentucky Education Professional Standards Board and, as a result,
represent statewide consensus on what “Not Met,” “Partially Met,” and “Met” levels of a standard look
like. Where appropriate, the language from these rubrics was added to our new Student Teacher
Evaluation. Table 13 reports the percentages of 2009-10 student teachers successful on each standard.
Unit Wide Assessment Report 200910 Final Page 19 of 27
For program evaluation purposes, candidates are considered successful who average at least 2.5 on a
three-point scale (1 – Not Met, 2 – Partially Met, and 3 – Met) on indicators aligned to a standard.
Table 13 Student Teaching Evaluation Proficiency Rates by Kentucky Teacher Standards*
Program
Kentucky Teacher Standards
1
2
3
4
5
6
7
8
9
10
Elementary Ed.
97%
93%
97%
93%
89%
97%
91%
96%
98%
94%
Middle Grades Ed.
89%
86%
90%
83%
84%
95%
84%
89%
94%
86%
Secondary Ed.
96%
87%
83%
80%
80%
93%
83%
91%
96%
80%
P-12 Ed.
85%
78%
85%
78%
65%
80%
70%
83%
80%
78%
5-12 Ed.
93%
96%
96%
93%
93%
96%
78%
93%
100%
89%
100%
85%
92%
92%
69%
92%
77%
92%
92%
92%
Exceptional Ed.
IECE
93% 100%
100%
100%
86%
100%
100%
93%
100%
93%
Unit-Wide
94%
89%
93%
88%
84%
94%
86%
92%
95%
88%
*KTS Key: 1 – Content Knowledge, 2 – Designs/Plans Instruction, 3 – Maintains Learning Climate, 4 –
Implements/Manages Instruction, 5 – Assessment/Evaluation, 6 – Technology, 7 – Reflection, 8 – Collaboration, 9 –
Professional Development, 10 – Professional Leadership
F. Exit and Follow-Up Data
Praxis Results (2008-09 Cohort)
Tables 14 and 15 delineate the most recent Educational Testing Service reports of pass rates on content
licensure and Principles of Learning and Teaching and related exams of 2008-09 program completers
(N=405) compared to previous pass rates.
Table 14 Pass Rates on Content Licensure Tests for Initial Teacher Preparation
Program
Name of Licensure Test
Elementary Education
Middle Grades Education
Middle Grades Education
Middle Grades Education
Middle Grades Education
Secondary Education
Secondary Education
Secondary Education
Secondary Education
Secondary Education
Secondary Education
Secondary Education
P-12 Education
P-12 Education
P-12 Education
P-12 Education
P-12 Education
P-12 Education
ELEMENTARY ED CONTENT KNOWLEDGE
MIDDLE SCHOOL ENGLISH LANGUAGE ARTS
MIDDLE SCHOOL MATHEMATICS
MIDDLE SCHOOL SOCIAL STUDIES
MIDDLE SCHOOL SCIENCE
BIOLOGY CONTENT KNOWLEDGE
ENG LANG LIT COMP CONTENT KNOW
ENG LANG LIT COMP ESSAYS
MATHEMATICS: CONTENT KNOWLEDGE
MATH PROOFS MODELS PROBLEMS PART 1
SOCIAL STUDIES: CONTENT KNOWLEDGE
SOCIAL STUDIES: INTERPRET MATERIALS
ART MAKING
ART CONTENT KNOWLEDGE
FRENCH CONTENT KNOWLEDGE
MUSIC CONCEPTS AND PROCESSES
MUSIC CONTENT KNOWLEDGE
PHYSICAL ED: CONTENT KNOWLEDGE
N Taking
Assessment
(2008-09)
189
297
20
25
16
2
19
20
7
7
19
18
4
4
-24
25
11
WKU
Pass Rate
(2008-09)
99%
100%
100%
84%
100%
100%
100%
95%
100%
100%
84%
94%
100%
100%
-92%
100%
100%
WKU
Pass Rate
(2007-08)
94%
97%
100%
94%
100%
100%*
94%
88%
100%*
100%*
100%
95%
33%*
88%*
100%*
100%
100%
100%
WKU
Pass Rate
(2006-07)
100%
96%
94%
92%
100%
100%*
100%
87%
86%*
100%*
100%
91%
100%*
100%*
-100%
90%
100%
Unit Wide Assessment Report 200910 Final Page 20 of 27
Program
N Taking
Assessment
(2008-09)
10
1
5
7
4
7
--41
25
13
540
Name of Licensure Test
P-12 Education
P-12 Education
5-12 Education
5-12 Education
5-12 Education
5-12 Education
5-12 Education
Exceptional Education
Exceptional Education
Exceptional Education
Exceptional Education
Overall Pass Rate
*Pass rate based on N<10
PHYSICAL ED ANALYSIS AND DESIGN
SPANISH CONTENT KNOWLEDGE
AGRICULTURE
BUSINESS EDUCATION
FAMILY AND CONSUMER SCIENCES
FAMILY AND CONSUMER SCIENCES II
TECHNOLOGY EDUCATION
SE STUDENTS W/MENTAL RETARDATION
EDUC. EXCEPTIONAL STUDENTS: CK
ED EXCEPT STUDENTS: MILD/MOD. DISAB.
ED EXCEPT STUDENTS: PROFND. DISAB.
WKU
Pass Rate
(2008-09)
100%
100%
100%
100%
100%
100%
--98%
92%
92%
97%
WKU
Pass Rate
(2007-08)
100%
100%*
100%*
100%*
0%*
-100%*
88%*
100%
94%
100%*
96%
WKU
Pass Rate
(2006-07)
100%
100%*
100%
100%*
100%*
-100%*
100%
100%
100%
-92%
Table 15 Pass Rates on Professional and Pedagogical Knowledge and Skills Praxis Test
Type of Assessment
Aggregate – Professional Knowledge
Aggregate – Teaching Special Populations
Unit-wide
N Taking
Assessment
(2008-09)
341
58
399
Institutional
Pass Rate
(2008-09)
98%
91%
97%
Institutional
Pass Rate
(2007-08)
96%
96%
96%
Institutional
Pass Rate
(2006-07)
96%
98%
96%
WKU Teacher Survey Results (Academic Year 2009-10)
Below are the results of the electronic WKU Teacher Survey sent to student teachers and alumni who
have potentially been teaching one or more years. Out of a possible 419 student teachers, 410 (98%)
completed the survey; out of a possible 1521 alumni, 217 (14%) completed the survey. Survey items
requested the respondent’s perception of WKU preparation on each of the Kentucky Teacher Standards
using a scale of 1 - Poor, 2 - Fair, 3 - Good, and 4 - Excellent. Standards with average scores of 3 or
better across items were considered to demonstrate acceptable program quality. Table 16 reports
student teacher results by program with averages below 3 highlighted; Table 17 reports alumni results.
Table 16 Student Teacher Averages on Teacher Standards Questions by Program
Kentucky
Teacher
Standard*
1
2
3
4
5
6
7
8
9
10
ELED
N=197
3.60
3.67
3.76
3.52
3.51
3.51
3.67
3.37
3.46
3.39
MGE
N=63
3.37
3.19
3.45
3.17
3.15
3.20
3.05
3.04
3.29
2.85
SECED
N=62
3.18
3.13
3.36
3.09
2.97
3.20
2.94
2.85
3.27
3.08
Program
P-12
5-12
N=34
N=25
3.26
3.16
3.46
3.35
3.09
3.07
3.22
2.76
3.15
2.82
3.18
3.09
3.36
3.16
3.10
3.39
3.08
2.93
3.18
2.95
EXED
N=10
3.45
3.38
3.74
3.42
3.32
3.40
3.40
3.58
3.58
3.10
IECE
N=16
3.52
3.48
3.74
3.64
3.40
3.45
3.35
3.55
3.55
3.22
Grand Total
N=407
3.44
3.42
3.60
3.37
3.30
3.36
3.37
3.17
3.37
3.17
Unit Wide Assessment Report 200910 Final Page 21 of 27
Table 17 Alumni Averages on Teacher Standards Questions by Program
Kentucky
Teacher
Standard*
1
2
3
4
5
6
7
8
9
Program
ELED
MGE
SECED
P-12
5-12
EXED
IECE
Grand Total
N=93
N=19
N=28
N=14
N=6
N=19
N=9
N=188
3.23
3.35
3.46
3.24
3.11
3.24
3.29
3.00
3.23
3.03
2.98
2.95
3.42
2.75
2.85
2.95
2.95
2.76
3.15
2.82
2.92
2.88
3.23
2.92
2.72
2.95
2.90
2.62
3.29
2.70
3.16
3.10
3.38
3.19
3.05
2.92
3.13
2.78
3.23
2.95
3.42
3.00
3.53
2.70
3.23
3.79
3.22
3.08
3.42
3.46
3.32
3.06
3.64
3.22
3.12
3.34
3.13
3.33
3.27
3.01
3.17
3.22
3.47
3.31
2.93
3.31
3.07
3.19
3.06
2.86
3.17
3.18
3.44
3.13
3.02
3.18
3.16
2.96
3.23
2.96
10
*KTS Key: 1 – Content Knowledge, 2 – Designs/Plans Instruction, 3 – Maintains Learning Climate, 4 –
Implements/Manages Instruction, 5 – Assessment/Evaluation, 6 – Technology, 7 – Reflection, 8 – Collaboration, 9 –
Professional Development, 10 – Leadership
In years past, we reported results from the Kentucky Education Professional Standards Board New
Teacher Survey. However, these data will not be available until fall 2010. They will be reported
separately.
Kentucky Teacher Internship Program Results (2009-10)
All candidates in our initial teacher preparation programs who enter the profession participate in a
yearlong internship entitled the Kentucky Teacher Internship Program (KTIP). During KTIP, candidates
are mentored and observed by their building principal, a resource teacher, and a teacher educator at a
nearby Kentucky university. In addition, candidates must develop several artifacts tied to the Kentucky
Teacher Standards including lesson plans; a videotaped lesson; plans for professional development,
collaboration, and leadership with documented evidence of carrying them out; and a standards-based
unit very similar to the WKU TWS. Based on these sources of evidence, the mentor team rates
candidates on each Kentucky Teacher Standard on a three-point scale (1 – Not Met, 2 – Partially Met,
and 3 – Met) over several cycles of the internship. Of most interest to us are the first cycle scores
because they are assigned near the beginning of the internship, and, thus, should reflect the strength of
our preparation programs. It should be noted, however, that because the goal of the internship is
showing intern growth, mentor teams tend to score candidates at the “partially met” level. Thus, for
the first cycle, we consider ourselves successful if overall our newly prepared teachers average at least 2
on each standard. However, our goal is that by the last cycle all our candidates are performing at the
proficient level (averaging at least 2.5 or higher on each standard). Below are several years of internship
data. Table 18 reports the percentage of our candidates averaging at least 2 during the first cycle. Table
19 reports the percentage of candidates averaging at last 2.5 by the last cycle.
Unit Wide Assessment Report 200910 Final Page 22 of 27
Table 18 Percentage of Candidates Averaging 2 (First Cycle)
Year
Kentucky Teacher Standards*
4
5
6
7
1
2
3
8
9
10
2005-06
100%
99%
99%
99%
99%
93%
98%
96%
95%
n/a
2006-07
99%
99%
99%
99%
99%
96%
98%
95%
95%
n/a
2007-08
100%
100%
100%
100%
100%
100%
97%
94%
94%
n/a
2008-09
100%
100%
100%
99%
96%
97%
98%
94%
94%
94%
2009-10
100%
99%
99%
97%
94%
97%
97%
91%
92%
90%
8
9
10
Table 19 Percentage of Candidates Averaging at least 2.5 (Last Cycle)
Year
Kentucky Teacher Standards*
4
5
6
7
1
2
3
2005-06
100%
100%
99%
100%
100%
100%
100%
100%
100%
n/a
2006-07
100%
100%
100%
100%
100%
100%
100%
100%
100%
n/a
2007-08
100%
100%
100%
100%
99%
100%
100%
100%
100%
n/a
2008-09
100%
100%
100%
100%
99%
100%
100%
100%
100%
100%
2009-10
100%
100%
100%
100%
99%
100%
100%
100%
100% 100%
*KTS Key: 1 – Content Knowledge, 2 – Designs/Plans Instruction, 3 – Maintains Learning Climate, 4 –
Implements/Manages Instruction, 5 – Assessment/Evaluation, 6 – Technology, 7 – Reflection, 8 – Collaboration,
9 – Professional Development, 10 – Professional Leadership
Unit Wide Assessment Report 200910 Final Page 23 of 27
Section 2. Continuous Assessment Results
A. Introduction and Context
Although WKU’s Professional Education Unit Conceptual Framework describes the unit’s mission, vision,
and core beliefs, in the current assessment cycle the unit is focusing on the following key values:
Belief 3 – Diversity. WKU should offer a variety of field experiences that reflect student diversity and
demonstrate success with all students.
Belief 5 – Reflection. WKU should provide multiple opportunities for candidates to reflect on their
experiences toward the goals of improving their skills and P-12 student learning.
Belief 7 – Knowledge, Skills, and Dispositions. WKU should align curriculum, experiences, and
assessments to ensure that all candidates have the opportunity to develop these essential competencies
and dispositions.
Belief 8 – Technology. WKU’s education professional preparation unit should strive to provide
instruction in, model, and assess the use of technology tools considered essential for instruction,
assessment, management, and research related to schools.
Beliefs 9 & 10 – Accountability and Assessment. WKU should model accountability by monitoring
candidate progress through assessments that are aligned to professional standards.
This report represents WKU’s efforts to live out Beliefs 9 and 10. Competencies identified in the
Kentucky Teacher Standards (Belief 7) are reflection (Belief 5) and technology (Belief 8). We evaluate
diversity (Belief 3) efforts in light of field experiences data. Below is a summary of our assessment
results based on what they tell us about candidate proficiency toward Kentucky Teacher Standards, as
well as other key Conceptual Framework values.
B. Kentucky Teacher Standards Assessment Summary
Table 20 provides a summary of candidate passing rates within and across assessments and surveys.
Note that the overall average is the calculated average pass rate across assessments and surveys, with
each instrument average receiving equal weight.
Unit Wide Assessment Report 200910 Final Page 24 of 27
Table 20 Summary of Assessment Results (Based on Most Recent Year) by Kentucky Teacher Standard and Component
Kentucky Teacher Standards
Component 2:
Course Based
Assessment Data
Component 4:
Culminating Assessment Data
Component 5:
Exit and Follow Up Data
OVERALL
Critical Performance
Pass Rates
TWS Pass Rates
Student Teacher
Evaluation Pass Rate
Student Teacher
Survey Pass Rates*
Praxis II Pass Rate
KTIP Results
(1st Cycle)
AVERAGE
1 - Content Knowledge
98%
97%
94%
88%
97%
100%
95%
2 - Designs/Plans
98%
98%
89%
84%
99%
94%
3 - Learning Climate
97%
93%
91%
99%
95%
4 - Implements/Manages
96%
95%
88%
81%
97%
91%
5 -Assessment/Evaluation
98%
90%
84%
79%
94%
89%
6 - Technology
98%
96%
94%
83%
97%
94%
7 – Reflection
98%
95%
86%
86%
97%
92%
8 - Collaboration
98%
92%
74%
91%
89%
9 - Professional Development
97%
95%
84%
92%
92%
10 - Leadership
99%
88%
74%
90%
88%
91%
97%**
*Survey Pass Rates calculated as percentage of respondents with Kentucky Teacher Standard Averages >2.99 on survey questions
**Not included in Rough Average Calculation
Unit Wide Assessment Report 200910 Final Page 25 of 27
C. Other Conceptual Framework Values Summary
Diversity
As described earlier, overall, in 88% of their field experiences candidates reported working with at least
one student with special needs, and in 91% of their field experiences candidates reported working with
at least one student from a diverse ethnic group. These percentages have remained steady over the last
several years. However, to ensure that all candidates have at least one diverse field experience, all
initial education preparation programs have developed Program Assessment Plans that identify a course
and experience where all candidates within the program will be assigned to schools that meet or exceed
that average level of diversity (11%) of schools in our service area.
Impact on P-12 Student Learning
This year represents our first routine effort to capture impact on P-12 student learning based on data
reported within the TWS, with promising results. As reported earlier, the P-12 students who candidates
work with make large gains on learning goals and large percentages of these students reach proficiency
on these goals. Thus, we have additional substantive evidence that our candidates do know how to
make an impact on the students they teach.
Section 3. Dissemination Efforts
Portions and drafts of this report have been shared with the College of Education and Behavioral
Sciences Dean and Associate Dean for Academic Programs. Planned efforts to disseminate the final
version of this report include the following audiences:






Other WKU College Deans
Professional Education Council
CEBS department heads and associated faculty
Education Professional Standards Board staff
NCATE
The public via the CEBS website (reported in summary form)
These audiences will be invited to discuss; provide insight regarding; and suggest edits, corrections, and
alternative explanations to the findings of this report. More importantly, these audiences have
contributed and will again contribute to Section 4 that outlines key decisions made during 2009-10
based on the previous Annual Reports and new decisions to be considered based on the 2009-10 results.
Unit Wide Assessment Report 200910 Final Page 26 of 27
Section 4. Key Decisions Made and to be Considered
Below is a listing of decisions and changes that took place over the 2009-10 academic year based on the
previous Unit-Wide Assessment Reports, as well as decisions that remain to be made (highlighted) based
on challenges associated with developing the current report.
 Mapping Critical Performances: Earlier Unit-Wide Assessment Reports indicated that some
Kentucky Teacher Standards are clearly assessed more often than others and that there is variability
in coverage by program. Based on that finding, program coordinators worked in 2008-09 with their
faculty to develop a Program Assessment Plan that maps out their performances by standard. In
some cases, new assessments were developed and added to the Electronic Portfolio System to fill
gaps in standard coverage. During 2009-10, Program Assessment Plans and Critical Performances
continued to be refined or created. For example, to reflect the new SKyTeach Math and Science
programs, all plans were revised and new Critical Performances are under development.
 Monitoring and Following Up Candidate Performance on Critical Performances: Table 5 reports
students (names are available from the Associate Dean for Accountability & Research) who have
scored low on critical performances. The PEC adopted a transition plan that monitors candidate
proficiency on critical performance for progress through initial preparation programs at specific
transition points: Admission to Teacher Preparation, Student Teaching, and Program Exit. These
transition points included minimum levels of proficiency candidates must demonstrate in course
work, Kentucky Teacher Standards measured by critical performances, and unit dispositions.
Because Student Teaching is a university course, establishing minimal proficiencies as course
prerequisites required making “Multiple Revisions” to these courses and passing them through the
entire university curriculum process during the 2008-09 academic year. This year a School of Teacher
Education task force was created to develop a policy to work with candidates who apply for student
teaching but do not meet minimal proficiencies. This policy passed in the School of Teacher
Education and is now ready to make its way through the curricular process this upcoming (2010-11)
year.
 Establishing Acceptable TWS Individual Score and Program-Level Pass Rates: The PEC formally
adopted a TWS cutoff score that candidates must meet in order to complete a program, as well as
policies for dealing with candidates who fall below the cutoff. However, the current report continues
to reveal program variability in the proficiency rates of candidates. Based on last year’s
recommendation in this report, program faculty worked together to revise the TWS to align better
with Kentucky Teacher Standards. They also discussed differences in implementing and interpreting
TWS processes with the goal of a stronger TWS instrument, as well as opportunities to refine
programs to prepare candidates for the knowledge and skills associated with the TWS.
 Collecting Impact on P-12 Student Learning Data: A routine process was established this year.
Work will continue to encourage more faculty and students to use the Excel workbook created for
this purpose.
 Reviewing Survey Results: Although Tables 16 and 17 indicate that, in general, student teachers and
alumni feel adequately prepared to meet Kentucky Teacher Standards, variability exists among
programs and across standards. Program faculty should review these results to ascertain potential
program weaknesses, especially in light of other data sources from this and past years.
Unit Wide Assessment Report 200910 Final Page 27 of 27
 Developing a Comprehensive Diversity Plan: Although diversity of clinical experience placement is
important to monitor, it is a small piece in what should be a more comprehensive diversity plan.
Based on recommendations in last year’s Unit-Wide Assessment Report, this year a School of Teacher
Education task force was created to develop a set of diversity proficiencies. These proficiencies were
adopted by the School of Teacher Education and are now ready to make their way to the PEC for
consideration and adoption.
Download