History of work between ODE and
ECO
• APR data analysis
– Missing data
– Across child and service variables
• Planning for improving data quality
– Review of ECO Child Outcomes
Measurement System Framework
• Focused on the Data Collection Quality Indicator 7
Early Childhood Outcomes Center
1
APR data analysis
Ohio completes a 4 part analysis of their APR data
for Indicator 7 including:
– Computing progress categories and summary
statements for complete data
– Looking at the quality and completeness of the data
included in the APR
– Comparing progress categories and summary
statements across child and service variables
– Comparing quality and completeness across
programs
Early Childhood Outcomes Center
2
20% of districts of service have late entry assessments for
between 95 – 100% of exiters
Districts with less than 50 exiters (n = 356 districts) have a larger
percentage of late entry assessments than districts serving 50 or
more exiters (n = 51 districts)
Characteristics of high quality data
collection identified through the COMS
review
1. All ECOSF team members have been trained in
ECOSF procedures and understand the process.
2. All ECOSFs are completed in a timely manner.
3. All information on the ECOSF is provided for all
ECOSFs.
4. The criteria for the ratings have been correctly applied
and the ratings are accurate for all ECOSFs.
5. All ECOSF data are entered accurately and in a timely
manner
Measuring performance on the 5
characteristics
• Data
– Analysis of Indicator 7 data
– Expertise of state staff
– Information gathered through past TA
• Organized information into what we knew
and what we didn’t know
• Presented this to the regional TA providers
Early Childhood Outcomes Center
6
All ECOSFs are completed in a
timely manner.
What we know
• Almost half of entry ECOSFs are not being
completed in a timely manner
• The problem is not getting better with time
Early Childhood Outcomes Center
7
All ECOSFs are completed in a
timely manner.
What we don’t know
• Why the ECOSFs are not completed in a
timely manner
• Whether timely completion is being
monitored at the local level
Early Childhood Outcomes Center
8
Results of the TA
• Gathering more information about
implementations
– Regional TA providers interviewing directors of
sampled districts
– Focus on Indicator 7 in the general IDEA monitoring
• Planning TA around areas where districts clearly
need support
– Teaming
– Assessment
Early Childhood Outcomes Center
9