Improving Your CTE Report Card Data
Erica Weaston
Autumn 2013
Overview
• “Easy” ways to improve your data
–Concentrator data
–Technical Skill Attainment
–Dual Enrollment
–Placement
–Industry Credentials
• Other Upcoming Changes
• Questions?
Concentrators drive everything!
• Report during Yearend (N) when student is
in second half of the program
• Report the correct program of concentration
–Must align to approved subject code in
which the student is enrolled
–Assessment must align to program
• See Program Matrix and Assessment
Matrix
Achievement Component
Measure: Technical Skill Attainment
Data:
FY12 Yearend (N) Technical Assessments
FY13 March (D) Industry Assessments
Potential FY14 change: Grading Technical Skill Attainment
Technical Skill Data
• Test all students
– Includes students with disabilities
• Jamie.Nash@education.ohio.gov
• Report test data during Yearend (N) for Webxam tests
• Report test data during Yearend (N) OR March (D) for
Industry Assessments
• Student is included in the calculation when they leave
school
• Highest test score is used for accountability
• Changes expected in FY14N assessment records
• Make sure test is aligned to the program of concentration
Assessment Alignment
To find which assessment aligns with each
CTE program…
Search “technical assessment matrix” on the
ODE website
CTE Assessment Matrix
CTE
Program
Code
A4
D4
F0
P2
T1
CTE Program
Name
Food Science and
Technology
Construction
Design-Build
Biomedical
Science
Criminal Science
Technologies
Auto Collision
Repair
Required Assessments with
EMIS Code - (Benchmark)
Assessment Vendor
Science and Technology of Food 46MC – (52)
ODE/Ohio State University-CETE
N/A
N/A
N/A
Auto Collision Technician – 09EA – (69)
ODE/Ohio State University-CETE
Or
National Automotive Student Skills Standards Assessment, Paint and
Refinishing - 650
National Automotive Technician Education Foundation (NATEF)
Prepared for Success Component
Measure: Dual Enrollment
Data:
FY12 Completion of a Course Qualifying for
Postsecondary Credit
Potential FY14 changes driven by State Board of Education decisions about
this component for the report card for traditional schools and districts.
Dual Enrollment
• This measure captures HIGH SCHOOL
CREDIT earned in a course the QUALIFIES
for college credit.
• Calculation uses:
–October course records
• CTE College Credit Flag, AP, IB, PSEO
–Yearend student course records
• Earned credit (full or partial)
Post-Program Outcomes Component
Measure: Post-Program Placement
Measure: Industry Credentials
Data:
FY13 March (D) Placement Results
FY13 March (D) State or Industry-Recognized Certificate
or License
Post-Program Placement
• Plan for follow-up
–Get contact info from students before they leave
–Communicate with students about follow-up
• Actually follow-up
• Be mindful of software defaults
• If a student is incorrectly reported as a
concentrator, mark with X for status known
• Report carefully and accurately
Post-Program Outcomes Component
Original Grade
Placement
Score
A
93% - 100%
B
89% - 92.9%
C
84% - 88.9%
D
F
79% - 83.9%
< 79%
Promotion/
Demotion
Status
Known
Percent
Grade
Promotion
>=95%
No Change
85%-95%
Grade
Demotion
<85%
Industry Credentials
• Make sure you get info about credentials
before they leave school if possible
• Make sure that, for industry assessments,
you report both the assessment and the
credential
• Assessment in N or D, credential in D only
(for now)
New Program-Level Reports
• Program level reports will:
–Be available late fall
–Include statewide program performance for
comparison
–Include documentation about data points and
‘how to’ guide
–Why is this important?
Program Level Reports
• OGT Reading (1S1), Math (1S2), Science
• Technical Skill & Participation (2S1)
• Graduation (4S1)
• Placement & Status Known (5S1)
• Industry Credentials (1STP3)
• Dual Enrollment (1STP4)
Calculations
To find how each data point is calculated…
Search “Performance Calculation
Documentation” on the ODE website
Examples…
1S1 OGT Reading
CTPD
IRN
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
District
IRN
District B
District B
District A
District A
District A
District A
District A
District B
District A
District A
District A
District B
District A
District B
District B
CTE
Program
Code
A4
B0
D4
E1
F0
JL
M1
M1
N1
N2
P2
R6
S4
S4
T1
1S1 Num 1S1 Den
CTE Program Name
(Passed) (Took)
Food Science and Tech.
22
23
Media Arts
5
5
Construction Design - Build
12
13
Teaching Professions
45
49
Biomedical Science
10
10
Therapeutic Pathway
11
17
Cosmetology
18
20
Cosmetology
32
34
Interactive Media
12
12
Network Systems
22
22
Criminal Science Tech.
9
10
Welding and Cutting
36
44
Marketing Management
10
10
Marketing Management
17
18
Auto Collision Repair
18
18
1S1
Passage
%
95.65%
100.00%
92.31%
91.84%
100.00%
64.71%
90.00%
94.12%
100.00%
100.00%
90.00%
81.82%
100.00%
94.44%
100.00%
5S1 Placement Example
CTPD District
IRN
IRN
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
District B
District B
District A
District A
District A
District A
District A
District B
District A
District A
District A
District B
District A
District B
District B
CTE
Program
Code
CTE Program Name
A4
B0
D4
E1
F0
JL
M1
M1
N1
N2
P2
R6
S4
S4
T1
Food Science and Tech.
Media Arts
Construction Design - Build
Teaching Professions
Biomedical Science
Therapeutic Pathway
Cosmetology
Cosmetology
Interactive Media
Network Systems
Criminal Science Tech.
Welding and Cutting
Marketing Management
Marketing Management
Auto Collision Repair
5S1 5S1
Num Den 5S1 %
22
5
13
12
10
2
19
0
12
21
10
44
9
17
10
23
5
13
49
10
17
20
0
12
22
10
44
10
18
18
95.65%
100.00%
100.00%
24.49%
100.00%
11.76%
95.00%
0.00%
100.00%
95.45%
100.00%
100.00%
90.00%
94.44%
55.56%
Status Status
Known Known Status
Num Den
Known %
23
5
13
49
10
17
20
0
12
22
10
44
10
18
18
23
15
13
50
10
17
20
16
12
23
34
44
12
18
19
100.00%
33.33%
100.00%
98.00%
100.00%
100.00%
100.00%
0.00%
100.00%
95.65%
29.41%
100.00%
83.33%
100.00%
94.74%
2S1 Technical Skill Example
CTPD
IRN
District
IRN
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
xxxxxx
District B
District B
District A
District A
District A
District A
District A
District B
District A
District A
District A
District B
District A
District B
District B
CTE
Program
Code
CTE Program Name
A4
B0
D4
E1
F0
JL
M1
M1
N1
N2
P2
R6
S4
S4
T1
Food Science and Tech.
Media Arts
Construction Design - Build
Teaching Professions
Biomedical Science
Therapeutic Pathway
Cosmetology
Cosmetology
Interactive Media
Network Systems
Criminal Science Tech.
Welding and Cutting
Marketing Management
Marketing Management
Auto Collision Repair
CTE
Assmt
Concentrators 2S1
2S1
2S1 2S1
Available?
Particip. (Per Assmt
Num Den Passage who left
(Passed) (Took) %
Matrix)
school
%
0
10
0
20
0
11
1
15
12
22
0
14
10
3
0
0
0.00%
15 66.67%
0
0.00%
20 100.00%
0
0.00%
15 73.33%
20
5.00%
16 93.75%
12 100.00%
23 95.65%
0
0.00%
19 73.68%
12 83.33%
17 17.65%
0
0.00%
23
15
13
50
10
17
20
16
12
23
34
44
12
18
19
0.00%
100.00%
0.00%
40.00%
0.00%
88.24%
100.00%
100.00%
100.00%
100.00%
0.00%
43.18%
100.00%
94.44%
0.00%
YES
YES
NO
YES
NO
YES
YES
YES
YES
YES
NO
YES
YES
YES
YES
CTE Accountability Manual
Overview of the new CTE Manual structure
Overview
EMIS Reporting
Funding
Accountability
Career-Based Intervention (CBI)
CTE Accountability Manual
EMIS Reporting
 Course, Staff, Student,
Concentrator/Participant Information,
Reporting Periods/Reports
Funding
 FTE Calculations
CTE Accountability Manual
Accountability
 CTE Student Assessments,
Performance Indicators, CTE Report
Card, Program Evaluation and Approval
Career-Based Intervention
CTE Accountability Manual
Feedback
Please provide 3 topics that you would like
to see in the Accountability Manual.
Email to
Briar.Mckeand@Education.ohio.gov
education.ohio.gov
Erica.Weaston@education.ohio.gov
Emily.Passias@education.ohio.gov
Briar.Mckeand@Education.ohio.gov