What Does Michigan Collect/Report and Why?

advertisement
Office of Special
Education (OSE)
It's Not the Same Data Anymore
August 2012
Fran Loose
Supervisor, Performance Reporting
Michigan Department of Education (MDE), OSE
loosef@michigan.gov
(517) 241-4414
1
Our Agenda
1. Backdrop Resources
2. 2012-2013 MSDS data collection/reporting
changes
3. How to support accurate MSDS data
collection/analysis
4. SPP data available on the Wayne State
University/Center for Urban Studies website
5. Emerging special education elements in the MISchool Data Portal
2
What Does Michigan Collect/Report and Why?
IDEA-Required State Performance Plan Indicators
1– Graduation
2– Dropout
3– Statewide Assessment
4A–Suspension/Expulsion
4B- Susp/Exp by Race/Ethnicity
5– Educational Environments
6– Preschool Ed. Environments
7– Preschool Outcomes
8– Facilitated Parent
Involvement
9– Disproportionate Rep. –
Child with a Disability
3
10- Disproportionate Rep. –
Eligibility Category
11- Child Find
12- Early Childhood Transition
13- Secondary Transition
14- Postsecondary Transition
15- Compliance Findings
16- State Complaints
17- Hearings Adjudicated
18- Resolution Session Agreements
19- Mediation Agreements
20- Timely and Accurate Data
What Does Michigan Collect/Report and Why?
SPP Compliance Indicators
1– Graduation
2– Dropout
3– Statewide Assessment
4A–Suspension/Expulsion
4B- Susp/Exp by Race/Ethnicity
5– Educational Environments
6– Preschool Ed. Environments
7– Preschool Outcomes
8– Facilitated Parent
Involvement
9– Disproportionate Rep. –
Child with a Disability
4
10- Disproportionate Rep. –
Eligibility Category
11- Child Find
12- Early Childhood Transition
13- Secondary Transition
14- Postsecondary Transition
15- Compliance Findings
16- State Complaints
17- Hearings Adjudicated
18- Resolution Session Agreements
19- Mediation Agreements
20- Timely and Accurate Data
What Does Michigan Collect/Report and Why?
SPP Results Indicators
1– Graduation
2– Dropout
3– Statewide Assessment
4A–Suspension/Expulsion
4B- Susp/Exp by race/ethnicity
5– Educational Environments
6– Preschool Ed. Environments
7– Preschool Outcomes
8– Facilitated Parent
Involvement
9– Disproportionate Rep. –
Child with a Disability
5
10- Disproportionate Rep. –
Eligibility Category
11- Child Find
12- Early Childhood Transition
13- Secondary Transition
14- Postsecondary Transition
15- Compliance Findings
16- State Complaints
17- Hearings Adjudicated
18- Resolution Session
Agreements
19- Mediation Agreements
20- Timely and Accurate Data
NEW: OSEP SPP Data Changes
Affect How We Use MSDS Data
• Dropout–If new calculation methodology implemented, 20092010 dropout rate changes from 6.1% to 25.9%.
• State Assessment
– AYP adjustment (2011-2012 data), district = 1 large school,
no more separate elementary, middle, HS analysis
– (3C) Proficiency-- students who have not been enrolled in a
building/LEA for a full academic year (FAY) will now be
counted.
• Disproportionate Representation--Under-representation gone
• State Complaints & Hearings Adjudicated gone. Associated
data will be submitted via EDFacts. District accountability
continues for timely correction of non-compliance. Uncorrected
noncompliance reported in Indicator 15.
6
What Does Michigan Collect/Report and Why?
IDEA-Required EDFacts Tables
1–
2–
34–
5–
6–
7–
8–
7
Child Count
Personnel
Educational Environments
Exit
Suspension/Expulsion
Statewide Assessment
Due Process
Maintenance of Effort & Coordinated Early
Intervening Services
What Does Michigan Collect/Report and Why?
Michigan’s determination from the OSEP—In 2012
Michigan received a “needs assistance”, determination level
2 rating for Part B of IDEA 2004.
Elements in LEA Determinations from the OSE--June
2012
● Performance on each SPP compliance indicator (4B, 9,
10, 11, 12, 13, 15)
● Timely, valid, and reliable data submitted by LEAs
o Timely MSDS, CIMS, and 4096 submissions
o Consistent collection to collection data on students,
or correctly exit students
● Timely IEPs
● Uncorrected noncompliance from other sources
8 ● Audit findings
OSE Data Contacts
Performance
Contact
Reporting Staff
Oren Christmas 517-335-0394
Data Responsibility for
SPP Indicators / EDFacts Tables
All SPP Indicators
christmaso@mi.gov
Jayme Kraus
517-373-0346
Julie Treviño
SPP Indicators:
11, 12, 13
517-335-0454
Indicators: 1, 2, 5,
robertsonj@mi.gov
Tables: Child Count, Ed. Environment,
Discipline, Exit, Personnel,
Valid, Reliable
Data
517-241-0497
517-241-0786
warnerd@mi.gov
Debbie Young
517-241-1448
youngd16@mi.gov
9
Timely IEPs
All SPP Indicators
All SPP
Indicators
Indicators: 3, 15, 16, 17, 18, 19, 20
Tables: Due Process, Maintenance of
Effort/Coordinated Early Intervening
Services
Indicators: 4, 8, 9, 10, 14
SPP Indicator 15
trevinoj1@mi.gov
Darren Warner
All SPP
Indicators
Indicators: 6, 7, 11, 12, 13
krausj1@mi.gov
John
Robertson
Determinations
Timely Data
SPP Indicators:
4B, 9, 10, 14
State Data Partners
• OSE Program Accountability Unit
• OSE Continuous Improvement and Compliance Team – CIMS
workbooks 3/year www.cenmi.org/cims
• OSE Data Advisory Committee
• Bureau of Assessment and Accountability
• Center for Educational Performance and Information (CEPI)
www.michigan.gov/cepi
• Office of Great Start
• Interagency Information Systems (MI-CIS)
• Public Sector Consultants
• Wayne State University, Center for Urban Studies
www.cus.waye.edu/ecd
10
National Data Partners
• National:
o Data Accountability Center, Westat
www.ideadata.org
o Education Information Management Advisory
Consortium (EIMAC)
11
CEPI Resources/Contacts
• Educational Entity Master (EEM)—updated special
education contact, grade levels and center programs
• Registry of Educational Personnel (REP) —personnel
• Michigan Student Data System (MSDS)—reports and
new 2012-2013 aspects
• MI School Data Portal—new special education
demographics and APR Public Reporting
CEPI Customer Support
517-335-0505 / CEPI@michigan.gov
12
Data Accountability Center
www.IDEAdata.org
• Left Tab: State Data
• Center Tab: Data TA
Resources
• Right Tab: Data
Collections Forms
13
Part 2
2012-2013 MSDS data
collection/reporting changes
…
And a few other quick facts
14
Bridge from Early On® (Part C)
The collection of Early On data has moved
from MI-CIS to MSDS for 2012-2013
• The Early On component collects data relative to
children under the age of three (3) who receive
services which may or may not include special
education
• NOTE: Children receiving special education
services must be reported in the Special Education
Component in addition to the Early On Component.
15
Initial IEP Component Updates
• Only report children at least 2½ years of age
• New Characteristic: Part C Transition Timeliness
– For children referred by Part C prior to age 3 and
who have been receiving special education services
• NOTE: Children 2-1/2 to 3 years of age transitioning
from Part C must have their initial IEP both-– within 30 school days of receiving parental consent
or within agreed-upon written extension AND
– by their 3rd birthday
16
New Educational Environments in 2011
Educational Environments for Children
Three Through Five (3-5)
• Time spent with typically developing peers reported by
o 10 hours or more per week
o Less than 10 hours per week
• AND whether the majority of special education service
occurs in regular early childhood setting or a separate
special education classroom or building
• A quick guide, instructions and attached tools are
available at: www.michigan.gov/ecse
17
Educational Environments for Children
Three Through Five (3-5)
MSDS and EDFacts
Code
22
23
Early Childhood Special Education
Program/Class
Home (ages 3-5)
25
Residential Facility
26
Separate School
27
Service Provider Location
46
Regular EC program at least 10
hrs/wk, majority of SE hrs. in EC
program (A1)
Regular EC program at least 10
hrs/wk, majority of SE hrs. in other
location (A2)
Regular EC program less than 10
hrs/wk, majority of SE hrs. in EC
program (B1)
Regular EC program less than 10
hrs/wk, majority of SE hrs. in other
location (B2)
47
48
49
18
Description
Part B State Annual Performance
Report-Indicator 6
Measurement A
# of children aged 3 through 5 with IEPs
attending a regular early childhood
program and receiving the majority of
special education and related services in
the regular early childhood program
(Codes 46 & 48)
Measurement B
# of children aged 3 through 5 with IEPs
attending a separate special education
class, separate school or residential
facility
(Codes 22, 25 & 26)
Educational Environments for Children
Three Through Five (3-5)
Preliminary Indicator 6 Results
Special Education Child Count 2011
6A.
# of children aged 3 through 5 with IEPs attending a regular
early childhood program and receiving the majority of special education
and related services in the regular early childhood program (5,743)
x 100 = 27.2%
Total # of children aged 3 through 5 with IEPs (21,086)
6B.
# of children aged 3 through 5 with IEPs attending a
separate special education class, separate school or residential
facility (9,325)
x 100 = 44.2%
Total # of children aged 3 through 5 with IEPs (21,086)
Calculated using EDFacts Tables submitted to USED/OSEP February 2012
19
Educational Environments for Children
Three Through Five (3-5) EDFacts-Table
3
20
Grade 14: Special Education Transition
Grade 14 may only be reported if all of the
following conditions are met:
1.The student with an IEP is attending a transition
program, or is moving from a standard K-12
environment to a transition program.
2.The student with an IEP is 18 years of age or
older as of September 1 of the current school year.
3.The student completed or will be completing a
high school state assessment in the current school
year.
21
In Lieu of Grade 14
If the student with an IEP is
• in a graded classroom for either special or general
education, report that grade. This includes shared
time students who attend graded classrooms in
other districts.
• only educated in an ungraded setting, report the
most appropriate grade based on the student’s age
as of December 1 of the current school year. The
following is a guideline for districts to follow when
assigning a grade based on the student’s age.
22
Ungraded Classrooms
Assign to a Grade by Age as of December 1
Age
Under 5
5 or 6 years old
7 years old
8
9
10
11
…
18
23
Grade
Early Childhood
K
1
2
3
4
5
…
12
Code
30
00
01
02
03
04
05
…
12
New CEPI Downloadable SE File
ISD DCODE
DNAME
StudwoI StudwI SpEd%
EP
EP
CI
EI
HI
VI
PI
SLI
ECDD
SLD
SXI
ASD
TBI
DB
OHI
AI
AA
AS
11
11010
Benton Harbor Area Schools
2664
442
14.2%
126
38 <5
<5
<5
75
52
128
<5
6
<5
<5
13
<5
406
<5
15
15050
Charlevoix Public Schools
1034
125
10.8%
6
13 <5
<5
<5
29
<5
53
<5
5
<5
<5
17
12
<5
<5
33
33010
East Lansing School District
3349
316
8.6%
33
13 9
<5
<5
109
10
68
<5
31
<5
<5
36
<5
72
16
29
37010
Mt. Pleasant City School District
3409
625
15.5%
63
18 9
<5
<5
209
<5
215
8
34
<5
<5
56
94
28
9
28
45020
Leland Public School District
567
40
6.6%
<5
<5 <5
<5
<5
8
<5
16
<5
5
<5
<5
<5
<5
<5
<5
82
82010
Detroit City School District
58461
11957
17.0%
2341 502 245 56
153 1624 359
4777 310 806
39
<5
745
31
10834
53
82
82702
University Preparatory Academy (PSAD) 1586
142
8.2%
6
<5
70
<5
5
<5
<5
13
<5
138
<5
M
Home
(0-3)
Other
<5 <5
<5
43
<5
HS WH HW MR
LEP
Migrant
FRL Bto3
PreK KG
01
02
03
04
05
06
07
08
09
10
11
12
14*
F
11
22
<5
<5
<5
412
6
10
29
46
39
34
41
31
38
46
23
33
30
22
14
<5
127 315
<5
<5
<5
101 <5
5
<5
<5
87
<5
<5
13
6
5
9
8
11
14
15
10
10
7
9
8
<5
41
<5
<5
27
182 <5
17
11
<5
144
16
15
22
17
27
23
19
23
24
18
20
25
22
17
22
6
105 211
<5
<5
33
444 <5
17
<5
<5
363
<5
<5
52
35
63
42
47
54
34
42
38
48
58
51
22
39
220 405
<5
<5
7
31
<5
<5
<5
<5
20
<5
<5
<5
<5
<5
<5
<5
6
<5
<5
<5
<5
6
<5
<5
<5
16
<5
<5
692 343 <5
<5
683
<5
9900 394
172
319 546 656 750 875 917 985 936 965 1122 1025 905 895 495 3948 8009 246
<5
<5
<5
<5
<5
114
<5
5
<5
<5
24
<5
<5
<5
6
12
14
13
10
19
13
11
10
15
8
6
<5
41
84
24
101
<5
Data and Reports
Downloadable Data File Layout
Michigan Student Data System (MSDS)
Special Education - Oct 5 Count,
Public Data
*2011-2012 School Year
Column Name
ISD
DCODE
Description
ISD
Code
District
Code
http://www.michigan.gov/cepi/0,45
46,7-113-21423_30451_37305--,00.html
DNAME
District Official Name
StudwoIEP
Number of students without an IEP
StudwIEP
Number of students with an IEP
SpEd%
Percentage of students with an IEP in the District
CI
Number of students with Cognitive Impairment
EI
Number of students with Emotional Impairment
…
…
OHI
Number of students with Other Health Impairment
AI
Number of American Indian students
…
…
MR
Number of Multi-Racial students
LEP
Number of students who are limited English proficient
Migrant
Number of students who are migrant
FRL
Number of students who receive free and/or reduced lunch
Bto3
Number of students birth to 3 years old
Pre-K
Number of pre-kindergarten students
KG
Number of students in kindergarten
…
…
14*
Number of students in Grade 14 as submitted by the Districts
F
Number of Female students
M
Number of Male students
25
26
27
Part 3
How to support accurate
MSDS data collection/analysis
…
And a few other quick facts
28
MSDS—So, How Do I Get Access?
• Work with your local MSDS superuser who can assist with
authorizations.
• Consider requesting viewer rights.
• And then, how do I learn to use it?
29
MSDS--So, How Do I Use It?
Step 1:
Go to http://www.michigan.gov/cepi
• Start with CEPI
Applications
• Then Michigan Student
Data System
• Go to MSDS
• Authorized User Login
• Login and click on your
subscription to the
Michigan Student Data
System
30
MSDS--So, How Do I Use It?
Step 2:
Once in the MSDS
• Start with Certified
Data Reports
• Then, Certified
Reports
• Enter your
Submitting Entity,
Collection, Report,
Format, then View
Report
31
New MSDS District Special Education Report
Sample Public School District (11111)
Sample High School (00000)
Grade 09
Local
Primary Primary Primary Placed
Student
Primary Program Service
Ed
By Other Section
ID
IEP Date Disability Code
Code
Setting District 52 FTE
UIC
First
Name
Last
Name
123456789
aaaaaa
bbbbb
9876543
2011-09-12
20
194
12
false
0.46
0.00
No
123456789
aaaaaa
bbbbb
9876543
2011-05-12
13
194
11
false
0.15
0.00
No
123456789
aaaaaa
bbbbb
9876543
2011-04-28
13
194
310
12
false
0.46
0.00
No
123456789
aaaaaa
bbbbb
9876543
2011-04-14
13
194
290
13
false
0.31
0.00
No
123456789
aaaaaa
bbbbb
9876543
2011-10-17
05
110
290
13
false
1.00
0.00
No
123456789
aaaaaa
bbbbb
9876543
2011-03-09
06
194
310
13
false
123456789
aaaaaa
bbbbb
9876543
2009-12-11
05
194
11
false
0.32
0.00
No
123456789
aaaaaa
bbbbb
9876543
2010-10-22
13
194
310
12
false
0.47
0.00
No
123456789
aaaaaa
bbbbb
9876543
2011-11-15
13
194
310
12
false
0.31
0.00
No
123456789
aaaaaa
bbbbb
9876543
2011-10-26
13
194
310
12
false
0.16
0.00
No
123456789
aaaaaa
bbbbb
9876543
2011-01-27
13
194
11
false
0.31
0.00
No
123456789
aaaaaa
bbbbb
9876543
2011-04-19
06
194
310
11
false
123456789
aaaaaa
bbbbb
9876543
2011-04-25
13
194
310
12
false
123456789
aaaaaa
bbbbb
9876543
2011-02-09
13
194
12
false
Summary for Grade : 09
32
Section Is Initial
53 FTE
IEP
No
No
No
0.30
0.00
No
Total Records: 14
MSDS Data Quality Checks
Discipline
● Some districts under-reported or misreported data
o Amended during verification
● Incidents must be reported consecutively
o Counting by student will lead to
inaccuracies in reporting
>250,000 lost days of instruction for
2010-2011 school year
33
34
Note: new version
has separate tab
per bldg.
35
Office of Special Education
36
36
Office of Special Education
37
37
MSDS Discipline Report
Data vary from what you see in CIMS Strand
Report, APR Public Reporting, and
determinations because
• MSDS shows all discipline vs. only out-ofschool suspensions/expulsions >10 days
• MSDS views the data as submitted for any
one given collection
• CIMS, Public Reporting, and determinations
data = a composite of the Fall, Spring, and
EOY collections.
38
MSDS Data Quality Checks
Initial IEPs
● Some districts over-reported
o Some students reported did not have initial
IEPs during 2011-2012
● Some districts under-reported
o Must include “Evaluated and found Not
Eligible”, including preschoolers
● Some districts did not also include the Special
Education component—required if found eligible
39
MSDS Initial IEP Report
40
MSDS Initial IEP Report
MSDS Initial IEP Report data may vary
from what you see in CIMS Strand Report,
APR Public Reporting, and determinations.
This is okay, as they are not intended to
match.
• MSDS Initial IEP report = a tool designed to allow
districts the ability to view the data they submitted
for any one given collection
• CIMS, Public Reporting, and determinations data = a
composite of the Fall, Spring, and EOY collections.
• Additional business rules are then applied to the data
to we meet OSEP reporting requirements
41
Examples of OSE Business Rules
For Part B Child Find (Indicator 11):
Filters are used
• to limit records to the current school year for Date
Of Parental Consent
• to limit records for Age As of Count Date to 2
years, 6 months -21 years of age
• To limit district accountability for Timeliness of
Initial IEP for certain situations (e.g., where
parents did not make child available, student died,
parent withdrew consent, and student moved)
• De-duplication completed when multiple records exist
for any one student
42
MSDS Data Quality Checks
Special Education Component
• Complete this component for every child 2½ or
older who receives special education programs or
services
• Include children who do not generate a special
education FTE--e.g., speech/language service 60
minutes/week
• Do not use Primary Educational Setting code (02)
Special Education School Building when a child
attends a center program in a general education
building.
43
Students With IEPs Ages 14-21 Exiting School
Without a Regular High School Diploma
Other Completer or Dropout??
• If the district offers a certification of completion,
o those receiving certificate of completion count as “other
completers”.
o those who don’t meet the local criteria count as
“dropouts”.
• If the district doesn’t offer certification of
completion,
o they count as “dropouts”.
44
Annual Performance Report Graduation Rate
—Sample Calculation (a cohort calculation)
# of youth with IEPs who entered 9th grade in 2007-2008 and received a
regular diploma in 2011 total # of youth with IEPs in the cohort
District A: (awards certificates)
700 graduates
700 graduates +100 continuing +100 certificate recipients +100dropouts
=70% graduation rate
District B: (does not award certificates)
700 graduates
700 graduates + 100 continuing + 200 dropouts
=70% graduation rate
45
Annual Performance Report Dropout Rate
—Sample Calculation (an event calculation)
# of youth with IEPs who dropped out of high school during 2010-2011
total # of youth with IEPs enrolled in grades 9-12 in the same year
District A: (awards certificates)
100 dropouts
700 graduates +2,500 continuing +100 certificate recipients +100 dropouts
=2.9% dropout rate
District B: (does not award certificates)
200 dropouts
700 graduates + 2,500 continuing + 200 dropouts
=5.9% dropout rate
46
AGE (ALL DISABILITY CATEGORIES)
2010-2011
BASIS OF EXIT
14
(A) TRANSFERRED TO
REGULAR EDUCATION
(B) GRADUATED WITH
REGULAR HIGH SCHOOL
DIPLOMA
(C) RECEIVED A
CERTIFICATE
15
16
17
18
19
20
14-21
TOTAL
21
5
11
12
6
1
2
0
0
38
0
2
14
4,054
3,531
583
85
36
8,305
1
0
0
179
328
108
41
25
682
7
8
10
7
5
2
3
3
45
1,563
1,730
1,860
1,505
842
279
94
69
7,942
184
284
578
895
732
350
93
55
3,171
1,760
2,035
2,475
6,646
5,439
1,324
316
188
20,183
(D) REACHED MAXIMUM
AGE
(E) DIED
(F) MOVED, KNOWN TO
BE CONTINUING
(G) DROPPED OUT
(H) TOTAL
(OF ROWS A-G):
47
A reminder from CEPI:
2010-2011 MSDS Reports
For continued access to your district’s 2010-2011
student-level reports, save them by August 30. e.g.
• Discipline Incident and Consequence report
• District special education report
• Early childhood special education assessment
report
• Initial IEP report
• Primary disability count
• Student count by primary educational setting
48
Timely and Reliable Data
Do you have an Electronic IEP program
that feeds into your Student
Information System?
● If you answered yes, please remember to update
your Electronic IEP program with complete and
current data in time to make sure that the
following transfers result in accurate data being
reflected in the MSDS:
o Electronic IEP
o SIS
49
MSDS
SIS
Part 4
SPP data available on the
Wayne State
University/Center for Urban
Studies website
50
www.cus.wayne.edu/ecd
51
52
53
54
55
56
Part 5
Emerging special education
elements in the MI School
Data Portal
57
Home Page Mock-up
58
Provide data
immediately
when user arrives
to the portal.
As in existing dashboard, links
take user to specific reports where
locations can be set and report
options can be adjusted.
59

Use frame to control
text vertically. Try to
move data graph
higher onto page.
Waiting for input from Paul/Steve
Provide additional
summary
information.
Integrate report
settings into display.
Integrate
navigation/report
type into display.
Update data chart .
Social media
integration.
10
Best
Practices
Dashboard
61
Location Set and Sort Order
11
Data Page Mock-up
63
MI School Data Portal--What’s Coming?
• September 2012: User acceptance
testing of special education
demographic data inquiries (customized
data portraits) using 2011 data
• January 2013: Special education
demographic data inquiries using 2012
data
• June 2013: APR Public Reports
64
65
What’s new with Public Reports?
• Limited narrative, more information available,
one click away
• Graphics like those used throughout the MI
School Data Portal
• New comparisons in the future: to all students,
to previous years
• Core elements from Special Education Facts
incorporated on to webpage, a click away, with
hot links to other resources
66
Short Term Forecast
• Districts now have more tools to access their own
data and generate reports for analysis.
• Shared Educational Entities (SEEs & S2E2s1) affect
reporting of AYP data
• Grade 14 modifications  statewide consistency
• New rules and data reporting impact birth-3 data
• MI-CIS will be decommissioned 9/30/12—Save any
Data Portraits you want prior to then.
1Specialized
67
shared educational entities
Long Term Data Forecast
● USED Grants to Improve Assessments for
Students with Disabilities
o Aligned to the common set of college- and
career-ready standards
o Michigan in Smarter Balanced consortium
o Assess knowledge of mathematics and English
language arts in grades 3-8, and one grade in
high school
o New generation of alternate assessments for
students with the most significant cognitive
disabilities-- Dynamic Learning Maps Alternate
Assessment System Consortium led by the
University of Kansas.
● ESEA then IDEA reauthorization
68
Download