Scantron Measures, Metrics
and Cut-Points for Alternative
Education Campuses
Colorado Department of Education
July 12, 2012
1
Agenda
•
•
•
•
•
2
Purpose
Selection of Measures Process & Considerations
Metrics and Cut-Points for Scantron Achievement Results
Metrics and Cut-Points for Scantron Growth Results
Timeline
Purpose
• Discuss and propose methodologies to explore for
calculating and reporting Scantron assessment
results for accountability purposes on the AEC SPF
report (metrics and cut-points).
• Provide feedback on how CDE can support
districts/schools in the calculation.
3
Selection of Measures Process
• AECs submitted the Selection of Measures Form July 2.
– http://www.cde.state.co.us/Accountability/Downloads/AECSel
ectionOfAccountabilityMeasures.xlsx
• There are a set of state required AEC measures:
–
–
–
–
Achievement: CSAP/TCAP % proficient/advanced
Growth: CSAP/TCAP Median Growth Percentiles
Postsecondary: Completion rate, Dropout rate, ACT composite
Engagement: Average daily attendance, Truancy rate
• Districts may select additional measures, subject to CDE
approval.
4
Considerations for Measures
• The three most recent years of data will be included.
• AECs will receive indicator ratings similar to the
traditional SPF:
– Does not meet, approaching, meets, or exceeds AEC norms
• Each indicator/sub-indicator:
– Uses adjusted AEC cut-points relative to each other
– Typically uses either normative cuts of 40th/60th/90th percentile
or head counts of 40%/60%/90%
• Where there are common measures across districts,
common metrics and cut-points will be used.
5
Considerations for Overall Results
• Based on the indicator ratings, AECs receive an overall
point total and plan type.
• AECs engage in the same UIP process as all other schools,
and have the same consequences for performance.
– Note: There is a modified UIP template for AECs to reflect the
modified performance indicators.
6
Scantron Achievement Results
• Reading, Language Arts, Math, Science
Metrics
% of students scoring at grade
level
% of students increasing at
least one grade level
7
Cut-Points
•
•
•
•
Exceeds – at/above 90%
Meets – below 90% but at/above 60%
Approaching – below 60% but at/above 40%
Does Not Meet – below 40%
Scantron Growth results
• Reading, Language Arts, Math, Science
Metrics
% of students achieving target
growth
8
Cut-Points
•
•
•
•
Exceeds – at/above 90%
Meets – below 90% but at/above 60%
Approaching – below 60% but at/above 40%
Does Not Meet – below 40%
Calculating Growth Targets for Scantron
Ideally, Scantron growth targets would be:
• Student level
• Take into consideration the student’s starting scale score
• Appropriate for students attending AECs
• Account for the length of time the student was receiving
instruction
• Indicate whether the student is on-track in terms of observed
and expected growth
9
Calculating Growth Targets for Scantron
Questions for AECs
• How are AECs currently assigning growth targets?
• Targets provided by Scantron? Or
• Targets calculated from the AEC’s prior results?
• Are the targets specific to AECs or for traditional schools?
• Are the growth targets student level?
• Do the targets vary by starting grade equivalent?
• How do we know the growth targets are appropriate for this
student population?
10
Calculating Growth Targets for Scantron
• How can AECs giving Scantron come up with
meaningful growth targets?
• What support can CDE provide in this process?
11
Completing Selection of Measures Form
• Fill in your AEC’s aggregated percentage of students meeting
their target growth
• Fill in your AEC’s total number of students with pre- and posttest records (denominator)
12
Assigning a Growth Rating
• CDE will assign a rating to your AEC’s reported Scantron
growth.
• This calculation is done separately for each of the three
subject areas by comparing the percentage of students
meeting their target growth against the following state
cut-points:
Cut-Points
•
•
•
•
13
Exceeds – at/above 90%
Meets – below 90% but at/above 60%
Approaching – below 60% but at/above 40%
Does Not Meet – below 40%
Process/Timeline
May
• CDE provides updated AEC
Application/Renewal form
and Selection of Measures
form.
July 2
• For schools seeking AEC
designation, districts/authorizer
submits (1) Application/Renewal
form and (2) Selection of
Measures form, with
supplemental measures,
metrics, cut-points and data, or
district proposed framework.
July 25:
Scantron Results to CDE
October 5
October 15
Aug. 15/Sept. 4
• SBE approves schools for AEC
designation. (Aug.)
• CDE release preliminary traditional
SPF. (Aug. 15)
• CDE reviews proposed AEC
selected measures or district
proposed framework, and
approves supplemental measures ,
metrics, and cut-points or
framework. (Sept. 4)
Nov. 15 / Dec. 17
• CDE generates AEC
• District submits final
• CDE makes final
framework report with state
and submitted supplemental
data.
• CDE provides initial plan type
assignment based on the AEC
framework.
accreditation category for
AEC based on framework.
• District submits any requests
to reconsider plan type
assignments.
recommendation to the State
Board re: school plan type
assignments. (Nov. 15)
• State Board finalizes school
plan type assignments. (Dec 17)
• CDE publishes SPFs to
SchoolView.org. (Dec. 17)
14
Resources
• Alyssa Pearson, Executive Director
– pearson_a@cde.state.co.us , 303-866-6855
• Marie Huchton
– huchton_m@cde.state.co.us , 303-866-6203
• Donna Morganstern
– morganstern_d@cde.state.co.us , 303-866-6209
• Somoh Supharukchinda
– supharukchinda_s@cde.state.co.us , 303-866-6778
• http://www.cde.state.co.us/Accountability/StateAccountabilityAE
Cs.asp
15