Note: Any questions or comments regarding the contents of this report should be directed to Jacqueline Pope-
Tarrence ( jacqueline.pope@wku.edu
), CEBS Assistant to the Dean for Accountability & Research.
Unit Wide Assessment Report 2010-11 Final
Page 2 of 24
Professional Education Unit Assessment Report - Initial Preparation Programs
Academic Year 2010-11
Overview: This report includes assessment and survey results from the following data collection points and sources:
Admission Data (Academic Year 2010-11) o
Number and average GPA by program of teacher preparation candidates approved by the
Professional Education Council for admission o
Admission test score averages by program
Course-Based Assessment Data (Academic Year 2010-2011) o
Percentage of candidates scoring at each level of proficiency on critical performances o
Percentage of program candidates scoring proficient on critical performances by Kentucky
Teacher Standards o
Listing of candidates scoring below proficiency on at least two critical performances
Clinical Experiences Data (Academic Year 2010-2011) o
Field Experience Summary demographic information (National Center for Education Statistics
[NCES] and candidate self-report data) o
Student teaching demographic information (NCES data)
Dispositions Data (Academic Year 2010-2011) o
Admission and early clinical dispositions data by program o
Student Teacher Evaluation dispositions results by program
Culminating Assessment Data (Academic Year 2010-2011) o
Teacher Work Sample (TWS) Results: Candidates Meeting Standards (by program, by TWS components, and by Kentucky Teacher Standards) o
Teacher Work Sample Results: Impact on P-12 Student Learning o
Student Teacher Evaluation results by program and Kentucky Teacher Standards
Exit and Follow-Up Data o
Praxis results (2009-2010 cohort) o
WKU Teacher Survey results (2010-11 student teacher) o
Kentucky’s Education Professional Standards Board Teacher Survey results (2009-2010)
See the WKU Professional Education Unit Wide Continuous Assessment Matrix – Initial Preparation on the next page for a conceptual map that guides our data collection efforts.
Section 1 describes results by data collection point. Section 2 summarizes these results based on what they tell us about candidate proficiency toward Kentucky Teacher Standards, as well as other key
Conceptual Framework values. Section 3 discusses current and planned efforts to report and disseminate these results. Section 4 outlines key decisions made during 2010-11 based on the 2009-
2010 Annual Report and new decisions to be considered based on the 2010-11 results.
Unit Wide Assessment Report 2010-11 Final
Page 3 of 24
Conceptual Framework
Standards/Values
Content Knowledge
Designs/Plans
Learning Climate
Implements/Manages
Assessment/Evaluation
Technology
Reflection
Collaboration
Component 1:
Admission Data
Faculty
Recs
KY
REQ's
WKU PROFESSIONAL EDUCATION UNIT WIDE CONTINUOUS ASSESSMENT MATRIX - INITIAL PREPARATION
Component 2:
Course-Based
Assessment Data
Component 3:
Clinical Experiences Data
Component 4:
Culminating Assessment Data
Critical
Performances
Early Clinical
Experiences
Final Clinical
Experience
Capstone
Assessment
(TWS)
LG4, DFI2, DFI4,
ASL4
CF1-3, LG1, LG4,
LG7, DFI1-2, DFI4-5,
ROT4-5
Final Clinical
Evaluation
1a-d, Overall
2a-e, Overall
Exit
Survey
1a-d
2a-e
CF1-3, LG2, LG5 3a-e, Overall 3a-e
4a-e, Overall 4a-e
LG6, LG8-10, DFI1,
DFI5, ASL2, ASL4-5
DFI3, ASL1
ASL2-3, ASL5,
ROT2-5
CF4-5, ASL4
5a-d, Overall
6a-d, Overall
7a-c, Overall
8a-b, Overall
5a-e
6a-d
7a-c
8a-d
Professional Development
Leadership
ROT1-3 9a-c, Overall
10a, Overall
9a-d
10a-d
Dispositions
Field Experiences & Clinical
Practice
Diversity
Impacts P-12 Student
Learning
DATA MAINTAINED BY:
FR a-f
OTS Faculty
FX a-l
Summary Form
Summary Form
C&I Staff
OTS Data
OTS Data
OTS
To Be Determined**
To Be Determined**
C&I Staff/Ed Tech
Disp a-l
Disp g
OTS/EdTech Ed Tech
DATA HOUSED IN: CEBS ACCSYS CEBS ACCSYS CEBS ACCSYS CEBS ACCSYS
DATA REPORTING CYCLE: Semester Yearly Yearly Yearly Yearly
DATA REVIEWED BY: PEC
Faculty/Programs/
PEC
Program
Note: Cells reflect instruments or rubric/survey items keyed to CF Standards/Values
*Collection of Principal Survey data will resume Spring 2012
Programs/PEC Programs/PEC
**The TWS was revised Fall 2010 and Spring 2011. New TWS Items have yet to be keyed to Diversity and Impacts on P-12 Student Learning
Yearly
Programs/PEC
Yearly
Programs/PEC
Component 5:
Exit and Follow-Up Data
Praxis
II
Graduate
Survey
1a-d
2a-e
3a-e
4a-e
5a-e
6a-d
7a-c
8a-d
9a-d
10a-d
OTS Ed Tech
BANNER/CEBS ACCSYS
Yearly Yearly
Principal
Survey*
1a-d
2a-e
3a-e
4a-e
5a-e
6a-d
7a-c
8a-d
9a-d
10a-d
Ed Tech
Biannually
PEC Programs/PEC Programs/PEC
Unit Wide Assessment Report 200910 Final
Page 4 of 24
Section 1. Continuous Assessment Results
A. Admission Data (Academic Year 2010-11)
Table 1 provides the number, average test scores, and overall GPAs of candidates by programs approved by the Professional Education Council (PEC) for admission into initial teacher preparation programs.
Before the Office of Teacher Services submits their names for review and approval by the PEC, candidates must meet minimum requirements established by the state and/or the WKU Professional
Education Unit.
Table 1. Approved Candidate Test Score and GPA Averages by Program
Program
ACT
PPST
Math
PPST
Reading
PPST
Writing
SAT
GRE
Composite
Admission
GPA
N Mean N Mean N Mean N Mean N Mean N Mean N Mean
0-Unknown
131001-Special Ed
131012-Comm Dis
16
12
131202-Early ELED P-5 127
23
23
23
1
21
183
177
1
20
180
176
1
20
176
174
1
1
2
970
900
1420
30
36
957
1068
1
44
41
171
2.79
3.20
3.73
3.23
131203-MGE
131204-IECE
131301-Agriculture
131302-Art Ed
40
3
2
4
23
23
22
24
2
2
179
177
2
2
177
179
2
1
2
175 2 1045 1
178
179 1 1790
1
890
1320
50
7
2
7
3.18
3.43
2.66
3.46
131303-Business Ed
131308-Family & CS
131309-Indust Tech
131312-Music Ed
1
6
1
12
22
23
24
25
1 179 1 180 1 1700
1 3.65
9 3.17
2 3.39
13 3.53
131314-Physical Ed
160905-Spanish
190701-IECE
230101- English & ALA
250101-School Media
260101- Biology
270101-Mathematics
400501-Chemistry
2
4
7
1
1
5
6
2
22
24
27
24
24
27
27
26
22
2
1
1
178
174
173
2
1
1
174
175
177
2
1
1
176
175
175
3 1023
7 1083
1 800
1 990
2 1020
7 3.00
9 3.62
7 1073 11 3.17
1 1060 24 3.34
6
5
8
3
3.53
3.43
3.55
3.12
400801-Physics
4210101-School Psy
450101-History/SS
450801-History/SS
14
2
25
24 1
23
178 1 181 1 177
1 1870
6 910
2 3.66
6 3.65
15 3.24
3 2.75
500901-Music Ed
Grand Total
4
294
24
24 31 177 31 177 32
*PPST refers to the ETS Pre-Professional Skills Tests: Mathematics (M), Reading (R), & Writing (W,) respectively.
4 3.63
175 8 1286 97 1028 451 3.31
B. Course-Based Assessment Data
Table 2 provides the percentage of candidates scoring at each level of proficiency on critical performances within professional education courses for the 2010-11 academic year. Proficiency levels are based on the following scale: 1 – Standard Not Met, 2 – Standard Partially Met, 3 – At Standard, and
4 – Above Standard.
EXED-434
IECE-321
IECE-322
IECE-324
IECE-325
IECE-421
IECE-422
LME-318
LME-407
LME-411
LME-448
LTCY-310
LTCY-320
LTCY-420
LTCY-421
LTCY-444
MGE-275
MGE-385
MGE-475
MGE-477
MGE-479
MGE-481
MUS-312
MUS-412
MUS-415
PE-111
CFS-381
ED201
EDU-250
EDU-489
ELED-345
ELED-355
ELED-365
ELED-405
ELED-406
ELED-407
ELED-465
EXED-330
EXED-331
EXED-332
EXED-333
EXED-416
EXED-417
EXED-422
EXED-430
EXED-431
EXED-432
Course
Unit Wide Assessment Report 2010-11 Final
Page 5 of 24
Table 2. CP Proficiency Level Percentages
1 2
0%
12%
0%
4%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
1%
1%
0%
0%
0%
6%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
19%
29%
0%
3%
0%
0%
0%
6%
3%
0%
5%
0%
0%
0%
0%
0%
0%
0%
0%
25%
0%
0%
0%
3%
0%
6%
0%
0%
1%
3%
5%
10%
0%
17%
13%
4%
9%
3%
3%
3%
10%
0%
0%
0%
0%
15%
0%
73%
64%
55%
81%
57%
20%
13%
0%
58%
67%
17%
20%
23%
0%
3
83%
75%
63%
79%
85%
70%
68%
40%
0%
62%
51%
59%
53%
20%
32%
74%
45%
59%
56%
55%
20%
30%
60%
57%
52%
100%
75%
100%
23%
41%
31%
54%
7%
27%
35%
43%
16%
37%
70%
88%
90%
42%
33%
83%
80%
62%
100%
4
0%
6%
33%
12%
12%
28%
28%
60%
100%
32%
46%
22%
6%
80%
61%
26%
55%
36%
44%
45%
80%
70%
40%
43%
48%
0%
0%
0%
77%
59%
67%
46%
88%
Unit Wide Assessment Report 2010-11 Final
Page 6 of 24
PE-121
PE-212
PE-320
PE-413
PE-414
PH-261
PH-381
PSY-310
SEC-351
SEC-352
SEC-453
SEC-473
SEC-475
SEC-478
SEC-481
SMED-102
SMED-210
SMED-320
SMED-360
SMED-470
Grand Total
Course
0%
0%
0%
0%
0%
0%
0%
0%
0%
2%
1%
0%
0%
0%
1
0%
0%
0%
0%
0%
0%
0%
0%
0%
17%
0%
0%
0%
0%
0%
4%
3%
5%
1%
8%
0%
2
6%
0%
0%
4%
7%
0%
0%
16%
71%
86%
38%
0%
70%
100%
83%
63%
0%
100%
74%
30%
61%
3
27%
59%
71%
81%
93%
56%
67%
Table 3 indicates the level of candidate proficiency by program across critical performances related to the Kentucky Teacher Standards. Candidates receiving an overall rating of 3 or 4 on a CP are considered to have demonstrated proficiency on the standards associated with the CP.
Table 3. Percent† of Program Students Scoring Proficient on CPs by Teacher Standard
79%
24%
13%
53%
100%
30%
0%
0%
38%
100%
0%
26%
70%
35%
4
67%
41%
29%
15%
0%
44%
33%
P-12 Ed.
5-12 Ed.
Special Ed.
IECE
Program
Elementary Ed.
Middle Grades Ed.
Secondary Ed.
1 2
98% 97%
93%
93%
95%
91%
94% 93%
94% 95%
3
95%
93%
92%
97%
Kentucky Teacher Standards*
4
92%
94%
96%
97%
5
97% 100% 97%
94%
94%
93%
95%
6
98%
96%
95%
93%
96%
7
96%
96%
97%
93%
97%
8
97%
92%
96%
93%
96%
9
95%
91%
95%
10
97%
96%
99%
92% 100%
95% 100%
95% 96% 97% 95% 96% 100% 96% 100% 91% 100%
100% 96% 100% 100% 97% 100% 100% 98% 95% 100%
Unit-Wide 96% 95% 96% 96% 96% 96% 96% 96% 94% 99%
†Percentages based on all CPs completed by candidates based on their coursework--not just program requirements
*KTS Key: 1 – Content Knowledge, 2 – Designs/Plans Instruction, 3 – Maintains Learning Climate, 4 – Implements/Manages
Instruction, 5 – Assessment/Evaluation, 6 – Technology, 7 – Reflection, 8 – Collaboration, 9 – Professional Development, 10 –
Leadership
Table 4 provides counts of 167 students who have scored 2 or below on two or more critical performances over the 2010-11 academic year. The table highlights the counts of the 31 students who scored low on three or more critical performances.
Unit Wide Assessment Report 2010-11 Final
Page 7 of 24
5091
6601
8482
7113
8385
7558
5663
5113
0022
3188
1126
3351
4676
4325
3959
1298
6753
9063
0301
8952
6150
0535
1208
6590
1413
1819
5831
1919
2068
2439
8434
9344
4198
4812
7823
5434
1218
0001
2756
7829
0299
3041
8867
3386
2192
3651
0523
3811
3433
6958
9343
3787
9409
6030
9949
3151
Table 4. Count of Students Scoring Below Proficient on CPs
Student ID
1
Score
2
2
2
2
2
2
2
2
2
2
2
Count Per Student
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2 2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
Student ID
6362
6379
6568
8098
3588
9262
6073
0032
5266
4303
5630
5138
7108
8376
1202
5188
9140
4671
8545
6910
5958
0827
4983
2416
3107
4701
5291
5490
1292
0314
3825
1413
3831
1171
4067
2543
4156
7438
1146
2743
5224
8075
9284
7500
0060
4593
0213
0157
0154
9955
1275
0426
1768
3723
6949
7051
3882
1
2
2
Score
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
Unit Wide Assessment Report 2010-11 Final
Page 8 of 24
Count Per Student
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
Student ID
3228
0459
1532
7998
9624
7281
6973
7572
9226
2772
7348
5001
6779
3500
8865
9422
4256
9589
8427
6013
2675
8206
3357
0561
6269
0493
8716
2091
9673
8444
6583
2621
1
2
2
2
2
1
Score
0341
1509
3271
4140
8248
7482
3795
3607
2628
5643
5235
9560
7906
8812
0056
5742
2
4
2
2
2
2
4
0451
7094
9909
2913
6854
0154 3
Student N
Students with three or more low scores
2
2
3
3
1
3
1
2
3
3
3
3
3
2
2
3
3
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
4
5
6
6
6
4
4
2
2
4
2
2
4
4
4
4
Unit Wide Assessment Report 2010-11 Final
Page 9 of 24
Count Per Student
4
4
4
4
4
4
4
4
4
4
4
4
3
3
3
3
6
7
167
31
4
5
6
6
3
3
3
3
3
3
3
3
2
2
2
3
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
Unit Wide Assessment Report 2010-11 Final
Page 10 of 24
C. Clinical Experiences Data (Academic Year 2010-11)
Over the 2010-11 academic year, 937 students reported demographic information on 1303 field placements, with an average of 17% ethnically diverse students, 46% students on free/reduced lunch, and 16% students with disabilities (based on data from National Center for Education Statistics and
Kentucky Department of Education). The ethnic diversity percentage continues to be well above the average 11% diversity of schools in the 30+ counties in our service area. Table 5 reveals percentages of field experiences with various characteristics. Note that candidates could choose all the characteristics that applied for any given experience.
Table 5. Percentages of Field Experience by Category Types
Working with Students With Special Needs
% Candidates working with Students with Physical Impairments
% Candidates working with Students with Learning Disabilities
% Candidates working with Students with Moderate/Severe Disabilities
% Candidates working with Students with Emotional/Behavioral Disorders
% Candidates working with Gifted Students
% Candidates working with English Language Learners
% Candidates working with Students with Visual Impairments
% Candidates working with Students with Hearing Impairments
% Candidates working with Students with Speech/Language Delays
% Candidates working with Students with Development Delays
% Candidates working with Students with Autism Spectrum Disorder
% Candidates working with Students with Other Impairments
Working with Diverse Students
% Candidates working with African American Students
% Candidates working with Native American/American Indian Students
% Candidates working with Latino/Hispanic Students
% Candidates working with Asian Students
16%
61%
13%
37%
47%
39%
10%
10%
26%
16%
19%
7%
87%
9%
70%
42%
% Candidates working with Students with Special Needs (Aggregate) 89%
% Candidates working with Diverse Students (Aggregate) 94%
Overall, as can be seen in Table 5, in 89% of their field experiences candidates reported working with at least one student with special needs, In 94% of their field experiences candidates reported working with at least one student from a diverse ethnic group.
In addition, Table 6 reports the diversity percentages of the schools where student teachers were placed during the 2010-11 academic year. The average overall diversity percentage remains slightly above the average 11% ethnic diversity of the schools in the 30+ counties that represent our service area.
Unit Wide Assessment Report 2010-11 Final
Page 11 of 24
Table 6. Demographic Percentages of Student Teaching Sites
Key: AI/AN = American Indian/Alaskan, BL/AA = Black/African American, HIS/LAT = Hispanic/Latino, FRL = Students receiving
Free or Reduced Lunch, ELL = English Language Learners, ST W/ DIS = Students with Disabilities
Name of School AI/AN ASIAN BL/AA HIS/LAT WHITE DIVERSITY* FRL
†
ELL ST W/DIS
96.6
84.3
85.7
98.1
67.6
68.5
96.5
83.2
96.9
76.6
82.8
97.3
96.1
94.9
97.5
97.7
97.3
95
95
92.3
93.5
49
84.5
95.8
93.1
7.6
98.7
94.5
95.9
95.9
96.8
82.2
79.6
97.4
97.8
96.9
83.3
98.3
63.3
94.7
95.5
100
72
95.9
95.2
1.4
13.2
2.2
0.6
7.8
8.8
0.3
2.3
1.2
2
3.6
0.9
1.7
3.3
1.7
1.7
0.6
2.4
1
1.5
0.5
6.7
1.1
1
1.9
1.5
6.2
0.6
1.9
1
3.3
1.5
1
2
1
3.3
8.5
1
1.5
2
1.9
0
10.2
1.8
1.3
1.8
2.1
10.2
0.6
22
19.5
1.9
13.4
1.2
20.3
13.1
1.3
1.7
1.4
0.5
0.5
1.5
1.4
0
5.2
5.7
44.2
14.2
2.4
4.4
83.1
0
3.5
1.9
2.2
0.5
0.4
12.7
0.2
1.8
8.1
9.5
1
35.3
2.4
2.2
0
12.3
0.6
2.6
0.4
0.6
0
0
0
0.4
0
0.2
0
0
0.2
0.2
0.2
0
0.3
0.1
0.2
0.2
0
0
0.3
0
0.2
0.1
0
0.2
0
0.6
0
0.4
0.2
0.2
0
0
0
0.1
0.2
0.2
0
0.6
0
0
0
0
0
ABRAHAM LINCOLN ES
ADAIR COUNTY ES
ALLEN COUNTY INTERMEDIATE
ALLEN COUNTY PRIMARY
ALLEN CNTY-SCOTTSVILLE HS
ALVATON ES
ANCHORAGE PUBLIC ES
APOLLO HS
AUBURN ES
AUDUBON ES
AUSTIN TRACY ES
BARDSTOWN ES
BARDSTOWN PRIMARY
BARREN COUNTY HS
BARREN COUNTY MS
BEAVER DAM ES
BEECH SENIOR HS
BEN JOHNSON ES
BOWLING GREEN HS
BOWLING GREEN MS
BRANDENBURG PRIMARY
BRECKINRIDGE COUNTY MS
BRIARWOOD ES
BRISTOW ES
BULLITT CENTRAL HS
BUTLER COUNTY HS
BUTLER COUNTY MS
CAMPBELLSVILLE ES
CANEYVILLE ES
CARRITHERS MS
CAVERNA MS
FIELD ES
CENTRAL HARDIN HS
CENTRAL HS
CLARKSON ES
COLLEGE VIEW MS
COLONEL WILLIAM CASEY ES
COX'S CREEK ES
CRAVENS ES
CREEKSIDE ES
CROSSROADS ES
CUB RUN ES
CUMBERLAND TRACE ES
CUSTER ES
DAVID T. WILSON ES
0.3
0.4
1.5
0
2.7
2.9
1.3
0.9
0.8
1.1
0.3
0.3
0.2
0.4
0
0
0.3
1
3.9
1.1
0
2.5
0
0.9
0.3
0.2
0.6
0
0
1.2
0.5
0.4
0.7
0
0.3
6.3
2.2
0.4
0
0.9
0.4
0
5.5
1.2
0.9
3.4
15.7
14.3
1.9
32.4
31.5
3.5
16.8
3.1
23.4
17.2
2.7
3.9
5.1
2.5
2.3
2.7
7.7
6.5
5
5
51
15.5
4.2
6.9
92.4
1.3
5.5
4.1
4.1
3.2
17.8
20.4
2.6
2.2
3.1
16.7
1.7
36.7
5.3
4.5
0
28
4.1
4.8
62 0.0
69.6 0.0
69.2 0.0
60.4 0.0
54.4 0.0
36.3 0.0
0.3 0.0
39.2 0.4
50.9 0.0
55.1 0.0
76.4 0.0
68.1 0.0
53 0.0
47.5 0.1
51.4 0.1
61.2 0.0
15.8 n/a
47.8 0.0
44.9 5.2
53 2.8
47.4 0.0
68.8 0.0
30.5 0.0
49.1 0.0
43.5 0.3
55.9 0.0
61.8 0.0
88.3 0.0
85.6 0.0
64 0.0
83.2 0.0
18 0.4
38.6 0.0
81.5 0.0
76 0.0
35.3 0.2
47.8 0.0
22.6 0.0
99.6 0.0
49.7 0.0
59.6 n/a
53.8 0.0
46.4 0.2
50.9 0.0
41.5 0.0
9.5
17.7 n/a
14.5
9.7
11.2
24.8
21.8
20.4
12.7
21
9.4
24.4
18.6
8
12.2
11.3
26.1
17.5
9.4
13.5
23.7
19.5
15.7
8.9
14.1
19.9
11.2
23.4
25.8
12
17.9
16.8
13.1
9.6
7.9
26.4
23.1
16.3
24.6 n/a
21.2
23.7
21.2
11.4
Unit Wide Assessment Report 2010-11 Final
Page 12 of 24
Name of School
DAVIESS COUNTY HS
DAVIESS COUNTY MS
DEER PARK ES
DISHMAN MCGINNIS ES
DRAKES CREEK MS
EAST HARDIN MS
EAST OLDHAM MS
EAST VIEW ES
EDMONSON COUNTY HS
EDMONTON ES
ELIZABETHTOWN HS
F T BURNS MS
FRANKLIN ES
FRANKLIN-SIMPSON HS
FRANKLIN-SIMPSON MS
GAMALIEL ES
GLASGOW MS
GRAYSON COUNTY HS
GREEN COUNTY HS
GREENWOOD HS
H W WILKEY ES
HANCOCK COUNTY MS
HARDINSBURG ES
HART COUNTY HS
HELMWOOD HEIGHTS ES
HENDERSON CNTY SOUTH MS
HENRY F MOSS MS
HIGHLAND ES
HISEVILLE ES
HODGENVILLE ES
HORSE BRANCH ES
HOWE VALLEY ES
INDIAN LAKE ES
IRVINGTON ES
JAMES E BAZZELL MS
JAMES T ALTON MS
JOE HARRISON CARTER ES
JOHN ADAIR INTERMEDIATE
JOHN HARDIN HS
KENWOOD STATION ES
LAKEWOOD ES
LINCOLN ES
LINCOLN TRAIL ES
LOGAN COUNTY HS
LOST RIVER ES
MADISON CREEK ES
MEADOW LANDS ES
AI/AN ASIAN BL/AA HIS/LAT WHITE DIVERSITY* FRL
†
ELL ST W/DIS
0.1 1.1 1.5 1.2 96.2 3.8 29 0.3 8.1
0.4
0.3
0
0.5
0.4
0
0
0
0
0.2
0.2
0.2
0.2
0
0
0
0.1
0
0
0
0.1
0.5
0
0
0
0.3
0.2
0
0
0.2
0
0
0
0
0
0.7
0.2
0.4
0.6
0
0.7
0.1
0.3
0.3
0.5
0
2.4
1.5
0.6
0.5
0.7
0
3
0
0.3
4.3
0.2
2.5
3.3
0.2
0
0.2
0
0.7
0
0
0.9
1.2
1.3
0.6
0
0.2
0
3.2
0.1
2
2.3
3.9
0.9
0.9
2.2
0.8
1
1
3.3
0
0.7
3.6
2.9
0.7
0
3
5.8
2.3
11.9
1.6
6.9
5.5
6.2
3.5
6
21.9
11.8
24.9
9.9
2.6
1.9
3.5
10.1
19.5
15.1
14.5
3.4
13.8
1.6
2
3.2
6.6
54.4
12.8
7.6
3.1
5.7
6.9
2.3
20
26.3
2.2
7.8
29.6
8.2
8.8
14.3
4.6
3.5
28.1
20.6
5.7
94.2
97.7
88.1
98.4
93.1
94.5
93.8
96.5
90.1
97.4
98.1
96.5
94
78.1
88.2
75.1
89.9
80.5
84.9
85.5
96.6
86.2
98.4
98
96.8
93.4
45.6
87.2
92.4
96.9
94.3
93.1
97.7
80
73.7
97.8
92.2
70.4
91.8
91.2
85.7
95.4
96.5
71.9
79.4
94.3
1.6
2.3
4.7
1.9
1.6
0
6.1
0
4.2
15.8
9.3
14.9
4.5
1.9
1.1
2.6
6.3
13.2
13
11.1
1.1
10.3
0.7
1.8
1.8
3.4
31.1
5.1
6
0.5
1.4
6
0.8
14.8
17.9
0.7
3.5
21.8
4.6
4.2
11.9
2.1
2.9
12.8
13.1
2.6
2.4
1.3
0.9
0.7
1.1
2.3
4.7
1.6
1.5
1.6
2.2
7.3
1.9
0.6
0.8
0.7
2.3
2.8
0.8
0.2
2.9
5.1
0.7
2.3
4.3
0.5
1.3
2
1.3
1.2
21
3.5
0.7
1.6
0.4
11.9
4
2.4
1.5
3.2
1.2
1.1
4.5
1.5
2.8
4.2
35.7 0.3
75.1 0.0
41.9 0.0
45.3 0.0
57.5 0.1
61.7 0.0
48.4 0.0
61.3 1.7
20.5 0.2
65.4 0.0
60.7 1.2
71.4 0.0
61.1 0.0
38.3 0.4
44 0.0
97.7 2.8
33.2 1.0
42 0.0
12.7 1.1
60.6 0.4
46 0.0
73.2 0.0
37.6 0.1
48.4 0.7
63.4 0.0
42.6 0.0
53.2 0.0
73.3 0.0
52.9 0.0
47.9 0.0
53.6 0.0
4 n/a
50.5 0.0
55.9 0.0
46.3 0.0
59.5 0.0
71.3 0.0
33.7 0.0
15.8 0.3
52.8 0.0
52.7 0.2
43.8 0.0
41 0.0
67 0.3
19 n/a
49.6 0.0
5.7
18.2
10.5
24.7
9.9
24
13.3
9.9
18.8
20.2
20.4
29
28.2
14.7
31.5
8.9
8.2
18.3
15.2
6.4
15.2
10.7
21.3
17.8
8.8
11.9
13.7
21
9.3
23.3
8.2 n/a
17.6
13.4
27.6
8.5
22.6
12
18.6
11.9
12.9
20.4
15.1
7.1 n/a
26.5
Unit Wide Assessment Report 2010-11 Final
Page 13 of 24
Name of School
MONROE COUNTY HS
MONROE COUNTY MS
MORGANTOWN ES
MORNINGSIDE ES
MORNINGSIDE ES
MUNFORDVILLE ES
NELSON COUNTY HS
NORTH BUTLER ES
NORTH HANCOCK ES
NORTH WARREN ES
OHIO COUNTY MS
OLD KENTUCKY HOME MS
ORAN P LAWLER ES
OWENSBORO HS
OWENSBORO MS
PARKER BENNETT CURRY ES
PAYNEVILLE ES
PLANO ES
POTTER GRAY ES
R E STEVENSON ES
RED CROSS ES
RICH POND ES
RICHARDSVILLE ES
RINEYVILLE ES
ROCKFIELD ES
RUSSELL COUNTY HS
RUSSELL SPRINGS ES
SALEM ES
SENECA HS MGNT CRR ACAD
SIMPSON ES
SORGHO ES
SOUTH EDMONSON ES
SOUTH GREEN ES
SOUTH HANCOCK ES
SOUTH SPENCER HS
SOUTHERN ES
SOUTHERN ES
SOUTHERN OAKS ES
STUART PEPPER MS
T C CHERRY ES
TALTON K STONE MS
TAYLOR COUNTY HS
TAYLOR COUNTY MS
TECUMSEH JR-SR HIGH SCH
TEMPLE HILL ES
TEMPLE HILL ES
TOMPKINSVILLE ES
AI/AN ASIAN BL/AA HIS/LAT WHITE DIVERSITY* FRL
†
ELL ST W/DIS
0 0.5 3.8 1.4 94.2 5.8 59.4 0.2 9
0.4
1.2
0.5
0.4
0.9
1.8
0
2
1.1
0.5
0.5
0
0.8
0.7
1.7
0
0.5
2.8
4
0
0.5
0.2
0.6
1.1
0
0.3
0.57
2.9
0.2
0.4
0.3
0.7
0
0
1.4
3.9
0.1
0.5
0.3
0
0
0.4
0.2
0
0
0
0
39.4
9.6
3.5
0.2
15.8
1.4
0.9
23.4
0.7
2.8
0.4
5.4
4.3
0.5
0.3
1.9
1.6
20.3
19.7
33.7
0
1.5
6.3
3.4
0.7
44.25
17
6.3
2.1
0.3
2.2
4.2
0.3
17.2
13.3
1.7
2
1
0.5
0.3
2
1.4
0.8
0.9
3.9
1.8
5.9
0.5
1.1
1.7
7
3
2.4
2.2
1.4
1.7
3.6
4.8
1.9
2.8
0.7
37.2
0.5
2.8
2.8
1.4
0.2
0.6
1.6
2.7
2.6
8.91
4.3
0.9
0.6
0.6
2
2.2
1.5
4.1
1.2
1.5
1.4
5.1
2.8
7
1.1
0
0.8
2.6
4.1
0.2
0.2
0
0
0.2
0
0
0
0
0.2
0.1
0
0.2
0
0
0
0
0
0
0
0.2
0
0
0
0.3
0
0.2
0
0
0
0
0
0
0
0
0.4
0.1
0.5
0.2
0
0
0.1
0
0
0
0
98.3
51.6
86.4
92.2
97.4
76.8
97.7
97.6
70.9
96.8
92.8
98.9
91.3
93.6
97.3
96.1
96
97.9
78.4
77.5
25.2
99.5
95.2
88
94
96.3
46.26
75.8
92.6
96.9
98.6
95.2
93.4
98.1
93.5
96.7
92.7
96.3
77.4
81.2
96.6
95.6
98.3
98.5
96.5
92
6
3.7
53.74
24.2
2.6
23.2
2.3
2.4
6.5
3.3
7.3
3.7
1.7
48.4
13.6
7.8
8.7
6.4
2.7
3.9
22.6
18.8
3.4
4.4
1.7
1.5
3.5
8
74.8
0.5
4.8
12
29.1
3.2
7.2
1.1
6.6
1.9
4
2.1
21.6
22.5
7.4
3.1
1.4
4.8
69.6 0.0
27.6 0.0
89.94
53.2 n/a
58.3 0.0
56.5 0.0
32.8 0.0
43.2 0.0
46.1 0.0
39.6 0.0
56.6 0.0
52.6 0.0
58.1 0.0
65.4 0.0
74.6 0.2
99 3.6
50.2 0.0
36.4 n/a
27.4 0.2
63.5 0.0
37.4 0.0
22.7 0.3
37.6 0.0
46.3 0.0
43.3 0.0
61.5 0.0
70.7 0.0
66.2 0.0
56 0.0
63.5 0.0
49.2 0.0
58.3 0.0
60.5 0.0
58.7 0.0
29.2 n/a
53.5 0.5
71.5 0.0 n/a
44.4 0.0
60.6 0.0
28.8 0.0
44.1 0.8
47.7 0.6
28.4 n/a
51.5 n/a
67.1 0.0
77.1 0.0
15.6
16.6 n/a
12.5
20.8
8.7
21.6
20.4
26.2
15.8
10.8
17.5
13.9
22.8
20.6
16.7 n/a
9.3
22.1
19.8
11
27.2
21
16.4
28.2
21.4
13
14.6
24.7
20.4
16.7
9.9
18.8 n/a
17.2
21.7 n/a
12.5
18.9
9.8
11.2
14.3 n/a n/a
19.2
20
Unit Wide Assessment Report 2010-11 Final
Page 14 of 24
Name of School
W R MCNEILL ES
WARREN CENTRAL HS
WARREN CENTRAL HS
WARREN COUNTY ES
WARREN EAST HS
WARREN EAST MS
WATT HARDISON ES
WEBSTER COUNTY HS
WEST HARDIN MS
WEST LOUISVILLE ES
WESTERN ES
WHITE HOUSE HERITAGE
WHITE HOUSE HS
WHITE HOUSE MS
WHITESVILLE ES
AI/AN ASIAN BL/AA HIS/LAT WHITE DIVERSITY* FRL
†
ELL ST W/DIS
0 3.8 11.7 2.2 82.2 17.8 26.2 0.5 8.6
59.9 5.8 8.6
0.2
0.7
0
0
0.1
0.3
0
0.2
0
0.3
0.5
0.3
0.2
0
0.2
0.8
0.4
0
1.7
0.9
3.4
1.9
1.1
0.8
1
0.7
0.8
0
18.1
50.5
24.6
9.6
7.4
6.3
4.4
6.7
0.4
0
2.2
2.8
2.5
1.2
5.5
6.2
15.1
3.2
3.1
3.9
2.1
2.1
3.9
0.3
2.2
1.9
2.3
1.2
74.5
42.1
56.9
85
88.4
88.6
93.2
89.7
95.4
99.7
94
94.2
94.2
97.5
25.5
57.9
43.1
15
11.6
11.4
6.8
10.3
4.6
0.3
6
5.8
5.8
2.5
54.9 n/a
60.9 0.1
50.9 0.2
64.6 0.1
46 n/a
41.7 0.0
50.7 0.0
48.2 0.0
70.4 0.0
21
19.8
27.3 n/a n/a n/a
48.5 0.0 n/a
20.1
8.7
13.4 n/a
12.8
13.9
29
26 n/a n/a n/a
17.2
WILLIAM NATCHER ES 0.1 10.4 8.4 5.3 75.8 24.2 36.6 0.9 17.1
Average Percentages 0.1 1.0 7.4 2.9 88.4 11.5 51.3 0.2
*Diversity equals combined percentage of Native American/Alaskan, Asian, Black/African American, and Hispanic/Latino students in the school
†Some percentages exceed 100 because state reports MORE students in a category than the TOTAL number of students in the school
**n/a - Data not available from Tennessee schools
16.6
D. Dispositions Data (Academic Year 2010-11)
During the 2007-08 school year, a dispositions rubric was developed and adopted at the initial preparation level. The faculty recommendation used for teacher program admission now reflects Level
1 dispositions. The full rubric is used as part of the student teaching evaluation process. All initial programs have developed Program Assessment Plans that outline how each program collects midprogram level dispositions data. These were finalized throughout 2008, as all programs prepared
Program Review Documents to be submitted to the EPSB as a required part of our accreditation renewal process. Tables 7 and 8 report how initial program candidates are performing on our dispositions as they enter and progress through their program and during their student teaching experience. Students are considered “proficient” who average 3 or higher on each dispositions category.
Table 7. Proficiency Rates on Unit Wide Dispositions Prior to Student Teaching
Program
Elementary Ed.
Middle Grades Ed.
Secondary Ed.
P-12 Ed.
5-12 Ed.
Special Ed.
IECE
Unit-Wide
Values
Learning
97%
88%
87%
95%
95%
100%
84%
94%
WKU Professional Education Dispositions
Values Personal
Integrity
Values
Diversity
Values
Collaboration
99%
95%
99%
94%
99%
99%
93%
100%
100%
100%
100%
98%
94%
100%
100%
100%
100%
98%
93%
100%
100%
100%
100%
99%
Values
Professionalism
98%
93%
90%
100%
100%
100%
89%
96%
Unit Wide Assessment Report 2010-11 Final
Page 15 of 24
Table 8. Proficiency Rates on Unit Wide Dispositions during Student Teaching
Program Values
Learning
WKU Professional Education Dispositions
Values Personal
Integrity
Values
Diversity
Values
Collaboration
Values
Professionalism
Elementary Ed.
Middle Grades Ed.
100%
98%
100%
100%
100%
100%
100%
100%
99%
100%
Secondary Ed.
P-12 Ed.
100%
100%
100%
100%
100%
100%
100%
100%
100%
100%
5-12 Ed.
Special Ed.
100%
100%
100%
100%
100%
100%
100%
100%
100%
100%
IECE
Unit-Wide
100%
100%
100%
100%
100%
100%
100%
100%
100%
99%
E. Culminating Assessment Data (Academic Year 2010-11)
Teacher Work Sample Results: Candidates Meeting Standards
As Component 4 of our unit wide Continuous Assessment Plan (CAP) strategy, all initial preparation candidates complete a culminating assessment of professional and pedagogical knowledge and skills, the Teacher Work Sample (TWS). Although in spring 2008 the Professional Education Council agreed that candidates who score a holistic score of at least “2 – Developing” are able to exit the program, for program evaluation purposes our goal is that at least 80% of program candidates will achieve “3 –
Proficient” or higher. Table 9 represents three-year proficiency rates by program area.
Table 9. Initial Preparation TWS Proficiency Rates
Program Type
Elementary Ed.
Middle Grades Ed.
Secondary Ed.
P-12 Ed.
5-12 Ed.
Special Ed.
IECE
Unit-Wide
** No data reported
2010-11
97%
91%
84%
93%
94%
**
100%
94%
2009-10
99%
99%
99%
100%
100%
100%
100%
99%
2008-09
92%
95%
90%
93%
100%
100%
100%
93%
Because faculty members score TWS at the indicator level, we can use their scores to ascertain candidate success in meeting each component of the TWS. For program evaluation purposes, candidates are considered successful who average at least 2.5 on a three-point scale (1 – Not Met, 2 –
Partially Met, and 3 – Met) on indicators associated with each component. Table 10 depicts the percentage of candidates by program who averaged at least 2.5 on the indicators for each TWS Factor:
CF – Contextual Factors, LG – Learning Goals, DFI – Design for Instruction, ASL – Analysis of Student
Learning, and ROT – Reflection on Teaching.
Unit Wide Assessment Report 2010-11 Final
Page 16 of 24
Table 10. Percentage by Program of Candidates who “Passed” Each TWS Component
Major
ELED
MGE
SECED
P-12
5-12
IECE
Total
CF
94%
100%
97%
99%
95%
100%
96%
LG
97%
91%
100%
87%
86%
88%
94%
DFI
90%
89%
97%
85%
91%
100%
90%
ASL
94%
87%
90%
80%
95%
100%
91%
ROT
99%
89%
100%
89%
95%
100%
96%
Likewise, because the TWS indicators are aligned to Kentucky Teacher Standards, we can use these scores to ascertain candidate success in meeting each standard related to the TWS (Table 11).
Table 11.
Percentage of Program Candidates “Passing” Each Kentucky Teacher Standard*
Major 1 2 3 5 6 7 8 9
ELED
MGE
SECED
P-12
84%
84%
68%
72%
93%
96%
97%
91%
97%
100%
94%
100%
90%
89%
90%
85%
79%
78%
55%
57%
89%
82%
94%
72%
89%
95%
91%
100%
97%
89%
100%
89%
5-12
IECE
83%
75%
91%
88%
95%
100%
64%
100%
82%
75%
77%
100%
100%
**
95%
100%
Total 80% 93% 97% 87% 73% 85% 92% 95%
*KTS Key: 1 – Content Knowledge, 2 – Designs/Plans Instruction, 3 – Maintains Learning Climate, 4 – Implements/Manages
Instruction, 5 – Assessment/Evaluation, 6 – Technology, 7 – Reflection, 8 – Collaboration, 9 – Professional Development, 10 –
Professional Leadership
** No data reported
Student Teacher Evaluation Results
Additionally, all candidates are assessed during their student teaching experience using the Student
Teaching Evaluation form. This form aligns with the Kentucky Teacher Standards and the descriptive rubrics developed for these standards as part of the Kentucky Teacher Internship Program. A statewide
Task Force under the direction of the Kentucky Education Professional Standards Board developed these rubrics and, as a result, they represent statewide consensus on what “Not Met,” “Partially Met,” and
“Met” levels of a standard look like. Table 12 reports the percentages of 2010-2011 student teachers successful on each standard. For program evaluation purposes, candidates are considered successful who average at least 2.5 on a three-point scale (1 – Not Met, 2 – Partially Met, and 3 – Met) on indicators aligned to a standard.
Unit Wide Assessment Report 2010-11 Final
Page 17 of 24
Table 12. Student Teaching Evaluation Proficiency Rates by Kentucky Teacher Standards*
Program
Kentucky Teacher Standards
1 2 3 4 5 6 7 8 9 10
Elementary Ed. 97% 93% 99% 93% 91% 94% 93% 94% 91% 95%
Middle Grades Ed. 95% 90% 92% 90% 94% 100% 87% 100% 94% 95%
Secondary Ed. 98% 92% 93% 86% 95% 95% 86% 93% 95% 90%
P-12 Ed. 100% 82% 95% 84% 70% 66% 80% 95% 91% 89%
5-12 Ed. 95% 86% 100% 95% 95% 95% 36% 82% 68% 91%
Special Ed. 100% 100% 100% 89% 78% 78% 89% 89% 78% 78%
IECE 100% 80% 90% 90% 80% 50% 90% 80% 80% 90%
P-12 Ed
P-12 Ed
P-12 Ed
P-12 Ed
P-12 Ed
P-12 Ed
P-12 Ed
P-12 Ed
5-12 Ed
Middle Grades Ed
Middle Grades Ed
Secondary Ed
Secondary Ed
Secondary Ed
Secondary Ed
Secondary Ed
Secondary Ed
Secondary Ed
5-12 Ed
5-12 Ed
5-12 Ed
Unit-Wide 97% 91% 96% 91% 89% 91% 86% 94% 90% 93%
*KTS Key: 1 – Content Knowledge, 2 – Designs/Plans Instruction, 3 – Maintains Learning Climate, 4 – Implements/Manages
Instruction, 5 – Assessment/Evaluation, 6 – Technology, 7 – Reflection, 8 – Collaboration, 9 – Professional Development, 10 –
Professional Leadership
F. Exit and Follow-Up Data
Praxis Results (2009-10 Cohort)
Tables 13 and 14 delineate the most recent Educational Testing Service reports of pass rates on content licensure and Principles of Learning and Teaching and related exams of 2009-2010 program completers
(N=433) compared to previous pass rates.
Table 13.
Pass Rates on Content Licensure Tests for Initial Teacher Preparation
Program
Elementary Ed
Middle Grades Ed
Middle Grades Ed
Name of Licensure Test
ELEMENTARY ED CONTENT KNOWLEDGE
MIDDLE SCHOOL ENGLISH LANGUAGE ARTS
MIDDLE SCHOOL MATHEMATICS
N Taking
Assessment
(2009-10)
194
29
26
WKU
Pass Rate
(2009-10)
97%
97%
100%
WKU
Pass Rate
(2008-09)
99%
100%
100%
WKU
Pass Rate
(2007-08)
94%
97%
100%
MIDDLE SCHOOL SOCIAL STUDIES
MIDDLE SCHOOL SCIENCE
BIOLOGY CONTENT KNOWLEDGE
ENG LANG LIT COMP CONTENT KNOW
ENG LANG LIT COMP ESSAYS
MATHEMATICS: CONTENT KNOWLEDGE
MATH PROOFS MODELS PROBLEMS PART 1
SOCIAL STUDIES: CONTENT KNOWLEDGE
SOCIAL STUDIES: INTERPRET MATERIALS
ART MAKING
ART CONTENT KNOWLEDGE
FRENCH CONTENT KNOWLEDGE
MUSIC CONCEPTS AND PROCESSES
MUSIC CONTENT KNOWLEDGE
PHYSICAL ED: CONTENT KNOWLEDGE
PHYSICAL ED ANALYSIS AND DESIGN
SPANISH CONTENT KNOWLEDGE
AGRICULTURE
BUSINESS ED
FAMILY AND CONSUMER SCIENCES
FAMILY AND CONSUMER SCIENCES II
4
4
0**
16
16
15
15
0
10**
43
15
3**
18
18
11
11
24
24
7
0
6
100%
100%
--
100%
100%
100%
93%
--
90%
95%
100%
100%
89%
83%
100%
100%
88%
96%
100%
--
100%
100%
100%
--
92%
100%
100%
100%
100%
100%
84%
100%
100%
100%
95%
100%
100%
84%
94%
100%
100%
100%
33%*
88%*
100%*
100%
100%
100%
100%
100%*
100%*
94%
100%
100%*
94%
88%
100%*
100%*
100%
95%
100%*
0%*
--
Unit Wide Assessment Report 2010-11 Final
Page 18 of 24
Program
5-12 Ed
IECE
Special Ed
Name of Licensure Test
TECHNOLOGY ED
IECE
EDUC. EXCEPTIONAL STUDENTS: CK
N Taking
Assessment
(2009-10)
1**
8**
44
WKU
Pass Rate
(2009-10)
100%
100%
100%
WKU
Pass Rate
(2008-09)
--
98%
Special Ed
Special Ed
ED EXCEPT STUDENTS: MILD/MOD. DISAB.
ED EXCEPT STUDENTS: PROFND. DISAB.
18
13
89%
92%
Overall Pass Rate 433 † 95%
*Pass rate based on N<10 **Reflects discrepancy between ETS and internal count; the report reflects ETS count.
92%
92%
97%
†Total N equals number of students passing all of the tests they took. Total N does not equal the sum of the “N Taking Assessment” column because students may take more than one test for licensure.
WKU
Pass Rate
(2007-08)
100%*
100%
94%
100%*
96%
Table 14.
Pass Rates on Professional and Pedagogical Knowledge and Skills Praxis Test
N Taking
Assessment
(2009-10)
Institutional
Pass Rate
(2009-10)
Institutional
Pass Rate
(2008-09)
Institutional
Pass Rate
(2007-08) Type of Assessment
Aggregate – Professional Knowledge
Aggregate – Teaching Special Populations*
Unit-wide
368
--
--
98%
--
--
98%
91%
97%
96%
96%
96%
*ETS no longer reports this information.
WKU Teacher Survey Results (Academic Year 2010-11)
Below are the results of the electronic WKU Teacher Survey sent to student teachers completing their experience fall 2010 or spring 2011. Out of a possible 392 student teachers, 355 (91%) completed the survey. Survey items requested the respondent’s perception of WKU preparation on each of the
Kentucky Teacher Standards using a scale of 1 - Poor, 2 - Fair, 3 - Good, and 4 - Excellent. Standards with average scores of 3 or better across items were considered to demonstrate acceptable program quality.
Table 15 reports student teacher results by program with averages below 3 highlighted.
Table 15 . Student Teacher Averages on Teacher Standards Questions by Program
Kentucky Teacher
Standard*
ELED MGE SECED P-12 5-12 IECE Grand Total
1
2
3
N=183 N=41
3.62 3.13
3.64
3.68
3.03
3.28
N=40
3.11
3.08
3.31
N=44
3.28
3.22
3.43
N=17
3.25
3.01
3.25
N=10
3.55
3.54
3.48
335
3.43
3.41
3.52
6
7
4
5
3.52
3.46
3.43
3.58
3.01
3.03
3.15
2.85
2.93
2.78
3.06
3.13
3.18
3.02
2.94
3.14
3.18
2.76
3.44
2.92
3.44
3.30
3.30
3.57
3.33
3.23
3.29
3.35
8
9
3.38
3.45
2.77
3.22
2.71
3.36
2.91
3.18
2.78
3.00
3.43
3.53
3.14
3.36
10 3.29 2.77 2.91 2.95 2.87 3.35 3.12
*KTS Key: 1 – Content Knowledge, 2 – Designs/Plans Instruction, 3 – Maintains Learning Climate, 4 – Implements/Manages
Instruction, 5 – Assessment/Evaluation, 6 – Technology, 7 – Reflection, 8 – Collaboration, 9 – Professional Development, 10 –
Leadership
Unit Wide Assessment Report 2010-11 Final
Page 19 of 24
Additionally, Table 16 reflects similar teacher survey results from Kentucky’s Education Professional
Standards Board (EPSB) on each of the Kentucky Teacher Standards for 2009-10. Standards with average scores of 3 or better across items were considered to demonstrate acceptable program quality.
Table 16. Averages on Teacher Standards by Type of Teacher*
Kentucky
Teacher
Standard**
1
2
3
4
5
6
7
8
9
10
Cooperating
Teacher
N=266
3.24
3.24
3.46
3.18
3.11
3.40
3.17
3.14
3.20
3.05
Student
Teacher
N=148
3.35
3.37
3.52
3.27
3.22
3.37
3.31
3.14
3.33
3.15
Resource
Teacher
N=167
3.26
3.24
3.45
3.21
3.10
3.42
3.24
3.29
3.30
3.27
Intern
N=94
3.14
3.27
3.36
3.14
3.17
3.19
3.25
3.16
3.26
3.05
*Rating scale: 4=Excellent, 3=Good, 2=Fair, 1=Poor
**KTS Key: 1 – Content Knowledge, 2 – Designs/Plans Instruction, 3 – Maintains Learning Climate, 4 – Implements/Manages
Instruction, 5 – Assessment/Evaluation, 6 – Technology, 7 – Reflection, 8 – Collaboration, 9 – Professional Development, 10 –
Leadership
Kentucky Teacher Internship Program Results (2010-11)
All candidates in our initial teacher preparation programs who enter the profession participate in a yearlong internship entitled the Kentucky Teacher Internship Program (KTIP). During KTIP, candidates are mentored and observed by their building principal, a resource teacher, and a teacher educator at a nearby Kentucky university. In addition, candidates must develop several artifacts tied to the Kentucky
Teacher Standards including lesson plans; a videotaped lesson; plans for professional development, collaboration, and leadership with documented evidence of carrying them out; and a standards-based unit very similar to the WKU TWS. Based on these sources of evidence, the mentor team rates candidates on each Kentucky Teacher Standard on a three-point scale (1 – Not Met, 2 – Partially Met, and 3 – Met) over several cycles of the internship. Of most interest to us are the first cycle scores because they are assigned near the beginning of the internship, and, thus, should reflect the strength of our preparation programs. It should be noted, however, that because the goal of the internship is showing intern growth, mentor teams tend to score candidates at the “partially met” level. Thus, for the first cycle, we consider ourselves successful if overall our newly prepared teachers average at least 2 on each standard. However, our goal is that by the last cycle all our candidates are performing at the proficient level (averaging at least 2.5 or higher on each standard). Previous years’ data reveal nearly all our graduates meet both our first and last cycle goals. Because the Kentucky EPSB has not yet provided
2010-11 data, these data will be reported to the Professional Education Council at a later meeting.
Unit Wide Assessment Report 2010-11 Final
Page 20 of 24
Section 2. Continuous Assessment Results
A. Introduction and Context
This report represents the first since our spring 2011 NCATE visit. Although a final decision by NCATE’s
Unit Accreditation Board has not been received, all indications from the NCATE Board of Examiners visit and report suggest that the WKU Professional Education Unit likely met all six standards, in particular
Standard 2 – Assessment System and Unit Evaluation. Although, as will be discussed in Section 4, this is a good time to revisit some of the processes that have been followed the last several years, it seems that the routines established served the WKU Professional Education Unit well.
B. Kentucky Teacher Standards Assessment Summary
Table 19 provides a summary of candidate passing rates within and across assessments and surveys.
Note that the overall average is the calculated average pass rate across assessments and surveys, with each instrument average receiving equal weight.
Unit Wide Assessment Report 200910 Final
Page 21 of 24
Table 19 Summary of Assessment Results (Based on Most Recent Year) by Kentucky Teacher Standard and Component
Kentucky Teacher Standards
Component 2:
Course-Based
Assessment Data
Component 4:
Culminating Assessment Data
Component 5:
Exit and Follow-Up Data
Critical Performance
Pass Rates
TWS Pass Rates
Student Teacher
Evaluation Pass Rate
Student Teacher
Survey Pass Rates*
Praxis II Pass Rate
OVERALL
AVERAGE
1 - Content Knowledge 96% 80% 97% 88% 95% 91%
2 - Designs/Plans 95% 93% 91% 84% 91%
3 - Learning Climate
4 - Implements/Manages
5 -Assessment/Evaluation
6 - Technology
7 – Reflection
8 - Collaboration
9 - Professional Development
96%
96%
96%
96%
96%
96%
94%
97%
87%
73%
85%
92%
95%
96%
91%
89%
91%
86%
94%
90%
10 - Leadership 99% 93% 75%
*Survey Pass Rates calculated as percentage of respondents with Kentucky Teacher Standard Averages >2.99 on survey questions
**Not included in Rough Average Calculation
86%
74%
87%
89%
81%
77%
81%
95%**
88%
89%
91%
95%
89%
88%
86%
89%
Unit Wide Assessment Report 200910 Final
Page 22 of 24
C. Other Conceptual Framework Values Summary
Diversity
As described earlier, overall, in 89% of their field experiences candidates reported working with at least one student with special needs. In 94% of their field experiences candidates reported working with at least one student from a diverse ethnic group. These percentages have remained steady over the last several years. However, to ensure that all candidates have at least one diverse field experience, all initial Education preparation programs have developed Program Assessment Plans that identify a course and experience where all candidates within the program will be assigned to schools that meet or exceed that average level of diversity (11%) of schools in our service area.
Impact on P-12 Student Learning
Data for reporting these results are still being gathered. Results will be reported at a later PEC meeting.
Section 3. Dissemination Efforts
Portions and drafts of this report have been shared with the College of Education and Behavioral
Sciences Dean and Associate Dean for Academic Programs. Planned efforts to disseminate the final version of this report include the following audiences:
Other WKU College Deans
Professional Education Council
CEBS department heads and associated faculty
Education Professional Standards Board staff
NCATE
The public via the CEBS website (reported in summary form)
These audiences will be invited to discuss; provide insight regarding; and suggest edits, corrections, and alternative explanations to the findings of this report. More importantly, these audiences have contributed and will again contribute to Section 4 that outlines key decisions made during 2010-11 based on the previous Annual Reports and new decisions to be considered based on the 2010-11 results.
Unit Wide Assessment Report 2010-11 Final
Page 23 of 24
Section 4. Key Decisions Made and to be Considered
During the 2010-11 academic year, the WKU Professional Education Unit prepared for and hosted a visit by the NCATE Board of Examiners. As mentioned earlier, all indications are that the visit was successful.
Yet, the following decisions remain to continue improving the unit assessment process.
Mapping Critical Performances: In 2008-09, program coordinators worked with their faculty to develop a Program Assessment Plan that maps out their performances by standard. In some cases, new assessments were developed and added to the Electronic Portfolio System to fill gaps in standard coverage. As time passes, it will be important for coordinators and faculty to refine their assessments and update their Program Assessment Plans.
Monitoring and Following Up Candidate Performance on Critical Performances: Table 4 reports students (names are available from the Associate Dean for Accountability & Research) who have scored low on critical performances. The PEC adopted a transition plan that monitors candidate proficiency on critical performance for progress through initial preparation programs at specific transition points: Admission to Teacher Preparation, Student Teaching, and Program Exit. These transition points included minimum levels of proficiency candidates must demonstrate in course work, Kentucky Teacher Standards measured by critical performances, and unit dispositions.
Because Student Teaching is a university course, establishing minimal proficiencies as course prerequisites required making “Multiple Revisions” to these courses and passing them through the entire university curriculum process during the 2008-09 academic year. Last year a School of Teacher
Education task force was created to develop a policy to work with candidates who apply for student teaching but do not meet minimal proficiencies. This policy has passed the university curricula process.
Establishing Acceptable TWS Individual Score and Program-Level Pass Rates : The PEC formally adopted a TWS cutoff score that candidates must meet in order to complete a program, as well as policies for dealing with candidates who fall below the cutoff. However, past versions of this report continued to reveal program variability in the proficiency rates of candidates. Based on the recommendation in the 2008-09 version of this report, program faculty worked together to revise the TWS to align better with Kentucky Teacher Standards. They also discussed differences in implementing and interpreting TWS processes with the goal of a stronger TWS instrument, as well as opportunities to refine programs to prepare candidates for the knowledge and skills associated with the TWS. This report includes the first sets of data from the new TWS instrument.
Collecting Impact on P-12 Student Learning Data: A routine process was established last year.
Work will continue to encourage more faculty and students to use the Excel workbook created for this purpose.
Developing a Comprehensive Diversity Plan: Although diversity of clinical experience placement is important to monitor, it is a small piece in what should be a more comprehensive diversity plan.
Based on recommendations in the 2009-2010 Unit-Wide Assessment Report, last year a School of
Teacher Education task force developed a set of diversity proficiencies. This policy has passed the university curricula process.
Unit Wide Assessment Report 2010-11 Final
Page 24 of 24
Deciding on future directions regarding NCATE accreditation: Following our successful NCATE visit, we will focus our efforts on refining our unit assessment process and considering areas of improvement. In the upcoming year as NCATE considers its move to a Continuous Assessment model, we will continue with efforts to improve our unit assessment measures to ensure our candidates continue to perform well at the state and federal levels.