Rhonda Sims, Director
Division of Support and Research
Office Of Assessment And Accountability rhonda.sims@education.ky.gov
502-564-4394
September 24, 2013
Kentucky Department of Education

2
What We’ll be Covering

Timeline for 2013 Reporting

What’s included in the School Report
Card (SRC)?

Year 2 SRC Review

Classifications and Labels
(Rewards/Assistance)

Delivery

Program Reviews

Timeline for 2013 Reporting
3
August
Wed.
Sept. 25
Fri.
Sept. 27
Through
Oct. 7
Schools received data
Quality Review
9 a.m. ET -- Release of embargoed data to districts via the School Report Card
1 p.m. ET -- Release of embargoed data to media
12:01 a.m. ET – Embargo lifted
Public release of School Report Card
Data Review for (10 days)

4
What’s Included in the School Report Card?
School/District/State Data

Profiles



Assessment Results
Accountability Classifications
Federal Accountability/AMO


Learning Environment –non-academic data

 membership attendance rate
 per pupil spending  retention rate
 student demographics  dropout rate
 free/reduced-meal
 graduation rate
 school safety
Delivery Targets

Assessment Data
5





K-PREP (Kentucky Performance Rating for Educational
Progress) -- Grades 3-8
 Scores and performance levels (NAPD) o Reading o Mathematics o Science o o
Social Studies
Writing/mechanics
EXPLORE, PLAN, ACT (Grades 8, 10, 11)
 Scores and benchmarks
End-of-Course o English II o Algebra II o o
Biology
U.S. History
Writing (Grades 5, 6, 8, 10-11)
Editing/mechanics (Grades 4, 6, 10 (Plan))

Accountability Data
6

Next-Generation Learners

Achievement 
Graduation Rate

Gap 
College/career-readiness

Growth

Accountability classifications

Annual Measurable Objective (AMO)

Participation Rate and Graduation Rate

Rewards/Assistance

7
Accountability:
Year 2 SRC Review
Simulated data shown

8
Accountability:
Year 2 SRC Review
Simulated data shown

9
Accountability:
Year 2 SRC Review
Simulated data shown
KDE:OAA:rls: 9/11/2013

10
Accountability:
Year 2 SRC Review
Simulated data shown
KDE:OAA:rls: 9/11/2013

11
Accountability:
Year 2 SRC Review
Simulated data shown
KDE:OAA:rls: 9/11/2013

College/
Career-Readiness Rate
12
College Ready:
Must meet benchmarks on one of the following:
College Ready
ACT
COMPASS
KYOTE
Career Ready: Must meet benchmarks for one requirement in
Career Academic area and must meet one requirement in
Career Technical area
Career Ready
Academic
Armed Services
Vocational Aptitude
Battery (ASVAB)
Career Ready
Technical
Kentucky
Occupational
Skills Standards
Assessment
(KOSSA)
ACT Work Keys
(Applied Math,
Locating information, and Reading for Information)
Industry
Certificates
Bonus: College AND Career Ready must meet at least one from each area
College Ready Academic
ACT or COMPASS or KYOTE
NOTES: (1) By meeting the
College Ready Academic definition, the student does not have to take the additional tests of ASVAB or Work Keys for the bonus area.
(2) For accountability purposes, the bonus shall not allow the readiness percentage to exceed 100 percent.
Career Ready
Technical
KOSSA
Industry
Certificates

13
Accountability:
Year 2 SRC Review
Simulated data shown
KDE:OAA:rls: 9/11/2013

Graduation Rate Reminder
14

Cohort model graduation data is used in the
2012-13 calculation for the Graduation Rate component (20% of high school Next-
Generation Learners).

Averaged Freshman Graduation Rate (AFGR) will be used one last time in 2012-13 for graduation rate goals.

Cohort will be used for graduation rate goals moving forward (i.e., 2013-14).

15
Accountability:
Year 2 SRC Review
Simulated data shown

16
Accountability:
Year 2 SRC Review
Simulated data shown

17
Accountability: Year 2
Classifications and Labels

Needs Improvement (Below 70th Percentile)

Proficient (At or Above 70th Percentile)

Distinguished (Above 90th Percentile)
 Progressing NEW 2013 o Meet Annual Measurable Objective (AMO) goal (1.0 gain in Overall Score below
Proficient or .5 gain Proficient and above); o Graduation rate goal (AFGR); and o Participation rate (95%)

Accountability: Year 2
Rewards Categories
18


High Performing School

Top 90% of schools and meets AMO, graduation rate goal and participation rate goal
School of Distinction
 Top 95% of schools and meets AMO, graduation rate goal, participation rate goal and has graduation rate above 60% for 2 years

High-Progress NEW 2013
 Top 10% of improvement and
 Meet AMO, graduation rate goal (AFGR) and participation rate (95%)
Any other school label can also be labeled High-Progress

19
Accountability: Year 2
Assistance Categories

Priority (No new Priority Schools added in
2012-13)

Focus (No new Focus Schools added in
2012-13, but new Districts may be added) o Lowest 10% in Overall Gap Group or meets third standard deviation model for a single gap group

Accountability: Year 2
20
Locked Proficient & Distinguished Percentiles
Percentiles for Elementary, Middle and High Overall
Score were set and locked in 2011-12. The locked percentile serves as the overall score target for 2013 reporting.
70th 90th 95th
Elementary Overall Score 62.5
Middle Overall Score 58.7
High Overall Score
District Overall Score
58.0
58.4
69.8
64.9
64.4
63.3
72.5
68.2
67.7
65.2

21
School Report Card
Year Two Format Changes
 Add Trend Data for Profiles
 Update Graduation Data to show both Cohort & AFGR
 Add Trend Data for NAPD Tables
 Add Non-Duplicated Gap Group to list of individual group scores
 Add Total Students with Disability (regular and alternate assessments)
 Add Level-Based (elementary, middle and high) data for disaggregated pages
 Clarify language and footnotes

Delivery
22 sets yearly targets based upon a 5-year goal to help schools/districts meet state achievement expectations
Simulated data shown

Program Review (PR) Data Release
23

Tentative Release of School and District Data

Date: October 2013

Provided through Open House on KDE website

Based on Program Review scores that schools and districts entered into ASSIST

Scores generated using the Program Review scoring guides/rubrics

For accountability, new set of combined goals for
2014

Date: November 2013

24
Program Review (PR) Scoring Guide

Program Review Calculations
25
Each of the 3 Program Review areas (Arts & Humanities, Writing, and
Practical Living) is comprised of 4 standards (Curriculum/Instruction,
Formative/Summative Assessment, Professional Development, and
Administrative Support).
Step 1: Average the characteristic scores for a score for each standard.


Scores range from 0-3 for each standard
0–No Implementation, 1–Needs Improvement, 2–Proficient, and 3–Distinguished
Step 2: Add the 4 standard scores to get a single number for each Program
Review area.


Scores range 0-12 for each Program Review area
The cut score 8 is Proficient and 10.8 is Distinguished
Step 3: Add the three Program Review area scores for a total Program
Review score.
 Scores range between 0-36
Step 4: Divide the total number by 24 (proficient (8) x 3 areas = 24).
 This number yields the percent of the 23 points earned (number of points possible in Unbridled Learning accountability model for PR when Learners and
PR are combined).

26
Program
Review
Data
Release
Calculation
Example
ARTS &
HUMANITIES
PRACTICAL
LIVING/CAREER
STUDIES
WRITING
Curriculum/ Instruction
Formative/ Summative
Assessment
Professional Development
Administrative Support
ARTS & HUMANITIES TOTAL
Curriculum/Instruction
Formative/Summative Assessment
AVERAGE
CHARACTER-
ISTIC
SCORES
1.0
1.0
1.0
1.0
2.0
2.0
1.9
2.1
Professional Development
Administrative Support
PRACTICAL LIVING TOTAL
Curriculum/Instruction
Formative/Summative
Assessment
Professional Development
Administrative Support
WRITING TOTAL
1.4
1.4
1.8
1.4
TOTAL POINTS
PERCENTAGE OF POINTS (divide by 24)
ACCOUNTABILITY POINTS (out of 23 points possible)
PROGRAM
REVIEW
TOTAL
CATEGORY
4
8
6
18
75%
17.25
Needs
Improvement
Proficient
Needs
Improvement

27
Program Review Data Release
Combining Next-Generation Learners and Program Review
Accountability Formula for Combining
Next Generation Learners and Program Reviews
Component
Next Gen Learners
Overall Score
Overall
57.9
X
Weighted
Percent
77% =
Weighted
Score
44.6
Program Reviews 75.0
X 23% = 17.3
Combined Overall
Score*
61.9
*
Combined Overall Score used to calculate new 70 th and 90 th percentile cut for summer 2014 targets

Important Resources
28

KDE website: www.education.ky.gov

29
Important Resources

Rhonda Sims, Director
Division of Support and Research
Office Of Assessment And Accountability rhonda.sims@education.ky.gov
502-564-4394
September 24, 2013
Kentucky Department of Education