District and
School
Profiles
College and Career Readiness Webinar Series:
Tools to be CCR
Data-Wise
1
Massachusetts Department of Elementary & Secondary
Education
Welcome!
Please type your question or comment in the
chat window at any point during the
presentation
All phones will be muted
PowerPoint slides will be sent to all registered
participants
2
Massachusetts Department of Elementary & Secondary
Education
About the C&CR Webinar Series
Month
Webinar Title
9/09/14
CCR Data Wise: EWIS, Postsecondary Reports/Success after
High School DART
10/14/14
Building a Positive School Culture in the Context of the new
Discipline Bill - Chapter 222
12/09/14
Integration of College and Career Readiness: The
Personal/Social Domain
Graduation and Dropout Rate Data
2/10/15
3/10/15
Career Development Education: Career Awareness,
Exploration and Immersion
4/14/15
Summer Transition Programs
5/12/15
6/09/15
Individual Learning Plans
MA Model for Comprehensive School Counseling Programs
Massachusetts Department of Elementary & Secondary
Education
3
Goals for the Session
Introduction to some of ESE’s high level goals
and strategies
Understanding of the nature of data
Introduction to data tools offered by ESE
“Information is a beacon, a cudgel, an olive
branch, a deterrent--all depending on who
wields it and how.” Steven Levitt
4
Massachusetts Department of Elementary & Secondary
Education
ESE’s goal
To prepare all students
for success after high school
5
Massachusetts Department of Elementary & Secondary
Education
ESE’s core strategies
Prepare all students for success after high school by:
Strengthening curriculum, instruction, and
assessment
Improving educator effectiveness
Turning around the lowest performing districts
and schools
Using data and technology to support
student performance
Massachusetts Department of Elementary & Secondary
Education
6
Success after high school
 All students deserve a world-class education
that prepares them for success after high school.
 Academic proficiency alone is no longer
enough to ensure this.
 Students also need to be proficient in the
knowledge, skills and experiences required to
navigate the workplace and function as
contributing citizens.
Massachusetts Department of Elementary & Secondary
Education
7
Readiness means a student has the requisite knowledge, skills and experiences in the
academic, workplace readiness and personal/social domains to successfully navigate to
completion an economically viable career pathway in a 21st century economy.
Knowledge, Skills, and
Experiences for College
and Career Readiness
8
Massachusetts Department of Elementary & Secondary
Education
Now back to our regularly scheduled
programming...
Qualitative data are everything that refers to the quality
of something. For example, a description of
experiences, observations and interviews are all
qualitative data.
Quantitative data are data that refers to a number. The
numbers of students, test scores, anything that can be
added, multiplied, subtracted or divided.
Simply put, data is information that helps in our
decision making.
Massachusetts Department of Elementary & Secondary
Education
9
What is the Cycle of Inquiry?
10
Massachusetts Department of Elementary & Secondary
Education
Making the Data Dance
 Data is a tool…
 Data can help inform our decisions…
 Behind the data are real human beings…
 Use data to tell the story….
 Data is our friend…
11
Massachusetts Department of Elementary & Secondary
Education
Overviews of College and Career Readiness
related data tools
School Profiles: http://profiles.doe.mass.edu/
Graduation rates, MCAS results, discipline data
Edwin Analytics: https://gateway.edu.state.ma.us/
Early Warning Indicator System (EWIS) reports
Postsecondary Readiness and Success reports
Success After High School DART:
http://www.doe.mass.edu/apa/dart/DARTSAHS.xlsx
Released in November 2013 (and updated in June 12
2014)
Massachusetts Department of Elementary & Secondary
Education
Profiles
13
Massachusetts Department of Elementary & Secondary
Education
First, a quick look at Profiles
http://profiles.doe.mass.edu/
Profiles are a great way to find basic
information about schools and
districts and also acts as an access
point to a great deal of other publicly
available data.
14
Massachusetts Department of Elementary & Secondary
Education
INSERT PROFILES SCREEN SHOT
15
Massachusetts Department of Elementary & Secondary
Education
16
Massachusetts Department of Elementary & Secondary
Education
Edwin Analytics
17
Massachusetts Department of Elementary & Secondary
Education
• Student profiles
• An early warning
indicator system
• Dashboards &
reports
• Tools to assess
student understanding
of multiple standards
• Competency Tracking
System
• Aligned to standards
• Model
curriculum
units
• Curriculum
mapping and
Lesson
planning tools
• Aligned to
Standards
• High-quality
digital
resources to
support
instruction
• Aligned to
standards
18
Massachusetts Department of Elementary & Secondary
Education
What is Edwin Analytics?
What is the SAME: Education Data Warehouse (EDW)
reports are still available
New reports are constantly being added
Today we are focusing on…
Identifying current students in grades 1-12 who
may be at risk of missing key educational targets
(Early Warning Indicator System (EWIS) reports)
Identifying how your former students did after
they graduated from your school/district
(Postsecondary Readiness and Success)
Massachusetts Department of Elementary & Secondary
Education
19
Early Warning Indicator System (EWIS)
20
Massachusetts Department of Elementary & Secondary
Education
What are Early Warning Indicators?
Methodological way of looking at students and
their likelihood of meeting specific academic
goals
Traditionally implemented at the high school
level to help predict which students are most
likely to drop out
Tool for educators to better design and target
student interventions in a timely way
21
Massachusetts Department of Elementary & Secondary
Education
Grade Groupings & Goals
=
Age
Groups
Grade
Levels
Academic Goals
(expected student outcomes for
each age group)
Use when
setting school
and district
goals!
2012-13
Statewide
Results for
Goal
Early
Grades
Elementary 1-3
Reading by the end of third
grade: Reaching proficient or
advanced on 3rd grade ELA MCAS
57%
Late
Grades
Elementary 4-6
Middle school ready: Reaching
proficient or advanced on 6th grade
ELA and math MCAS
54%
Middle
Grades
Grades
7-9
High school ready: Passing grades
on all 9th grade courses
78%
High
School
Grades
10-12
High school graduation: Meeting
all local and state graduation
requirements
85%
Massachusetts Department of Elementary & Secondary
Education
22
Key Concepts
 Provides risk level information for all students based
on prior year data
 The risk levels are not based on a student’s relative
likelihood for reaching an academic goal when
compared with other students
 Individual indicators in the risk model are not
reflective of the level of risk - taken together, the
indicators (data points) collectively form a risk level
 Only includes data from existing statewide collections
(SIMS, SSDR and SCS) and state assessments (MCAS
and ACCESS)
Massachusetts Department of Elementary & Secondary
Education
23
EWIS is / is not…
The Massachusetts EWIS is…
The Massachusetts EWIS is not…
A tool to better target interventions
=
and supports at the individual, small
A “life sentence” or a reason to
label students.
group, and whole school levels.
A systematic way to flag students that
need to be further examined to
determine what additional support
are necessary.
Related to measures that are included
in the state’s school and district
accountability system (PPI), but is
not itself an accountability measure.
Based on data and risk models that
the Department will reexamine each
year to continually improve the
system.
A diagnostic tool that provides
details on the exact reason(s) why
a student is at risk for not meeting
an expected academic goal.
An accountability measure.
A stagnant system that will remain
exactly the same in future years.
Massachusetts Department of Elementary & Secondary
Education
24
Edwin Analytics: EWIS Reports
There are Five EWIS reports in Edwin:
EWIS Student List (EW601)
EWIS District View (EW301)
EWIS Graphical View (EW302) and two new reports,
EWIS Risk Level Indicator Analysis (EW317)
EWIS Subgroup Analysis (EW318)
 All can be filtered numerous way (e.g., selecting specific
schools, grade levels, student subgroups)
Massachusetts Department of Elementary & Secondary
Education
25
EWIS Student List (EW601)
What are the current risk levels of my
students?
What are the prior risk levels of my current
students?
What data points (indicators) went into the
calculation to determine the risk level?
26
Massachusetts Department of Elementary & Secondary
Education
27
27
Massachusetts Department of Elementary & Secondary
Education
28
Massachusetts Department of Elementary & Secondary
Education
TWO NEW EWIS TOOLS!
EWIS Risk Level Indicator Analysis (EW317)
A tool to analyze specific attendance, behaviors, and course
Early Warning Indicator System (EWIS) indicators for students
in each risk level for a selected grade.
EWIS Subgroup Analysis (EW318)
Provides educators with aggregate student risk levels of not
achieving their next educational outcome as determined by
the Early Warning Indicator System (EWIS) by student
subgroups within a District
Massachusetts Department of Elementary & Secondary
Education
29
Insert EW 318 Screen shot
30
Massachusetts Department of Elementary & Secondary
Education
Insert EW317 Screen shot
31
Massachusetts Department of Elementary & Secondary
Education
Postsecondary Outcome Reports
32
Massachusetts Department of Elementary & Secondary
Education
How did our students do after graduating?
Three reports:
Postsecondary Outcomes of Public HS
Graduates:
All Institutions (CR301)
Postsecondary Outcomes of Public HS
Graduates:
MA Public Institutions Only (CR302)
Postsecondary Outcomes of Public HS
Graduates:
Academic Preparation (CR303)
Massachusetts Department of Elementary & Secondary
Education
33
Use when
setting
school and
district
goals!
Comparing the Three Reports
Potential Questions
CR301 CR302 CR3
03
How many graduates go on to postsecondary?
What type of institutions (4-year/2-year, private/public) do
graduates attend?
Which specific institutions did students attended?
How many went to each?
What are the enrollment rates of students who complete
MassCore or AP coursework compared to those who don’t?
What are the persistence and degree obtainment rates of
students who complete MassCore or AP coursework?
What is the postsecondary experience of students from a
specific subgroup? (CVTE, ELL, SWD, high needs, etc)
What percentages of students enroll in and complete
remedial courses?
In what remedial subjects to do students enroll?
What are the MCAS scores of students who take remedial
coursework in math and reading?
How many credits, on average, do public high school
graduates earn in their first year of college?
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
Massachusetts Department of Elementary & Secondary
Education
34
How many public high school
graduates enroll postsecondary?
… at MA public institutions?
35
On top: data from CR301; on bottom: data from CR302
Massachusetts Department of Elementary & Secondary
Education
How many return for a 2nd year?
What does
persistence
look like
across
subgroups?
36
Data from CR301; See CR302 for MA Public Institutions Only
Massachusetts Department of Elementary & Secondary
Education
Where did
students
enroll?
(Anywhere
in the USA)
37
This data from CR301
See CR302 for MA Public Institutions Only
Massachusetts Department of Elementary & Secondary
Education
What are enrollment rates of students
who complete AP or MassCore?
38
Data from CR301; See CR302 for MA Public Institutions Only
Massachusetts Department of Elementary & Secondary
Education
Which type of institutions do they
attend?
39
Data from CR303
Massachusetts Department of Elementary & Secondary
Education
Of those in MA public postsecondary,
what % enroll in remedial courses?
In which
subjects?
40
Data from CR302
Massachusetts Department of Elementary & Secondary
Education
How many of your graduates
obtain a degree?
 How does that vary by subgroup?
 How does that vary by the type of institution where
students enroll? (4-year, 2-year, public, or private)
41
Data from CR301; See CR302 for MA Public Institutions Only
Massachusetts Department of Elementary & Secondary
Education
How many credits do graduates
earn in their first year of college?
What about developmental credits?
42
Data from CR302
Massachusetts Department of Elementary & Secondary
Education
… and this is just the beginning of
what we can do!
We could also explore…
What is the relationship between
MCAS scores and the type of institution where
students enroll? (4-year, 2-year, public, or private)
What is the postsecondary experience of students
from a specific subgroup (CVTE, ELL, students with
disabilities, high needs, etc)?
43
Massachusetts Department of Elementary & Secondary
Education
For more information…
 Watch the Edwin website for updates, including
materials and professional development opportunities:
www.doe.mass.edu/Edwin
 Follow Edwin on Twitter! @ Edwin_DESE
 Questions can be submitted to: Edwin@doe.mass.edu
 If you need access to Edwin Analytics – contact your
district directory administrator (List is available at
http://www.doe.mass.edu/infoservices/data/diradmin/list.aspx)
 EWIS use workshop day: September 23rd:
https://www.surveymonkey.com/s/EWIS9-23-14
 Early warning implementation guide coming soon!
Massachusetts Department of Elementary & Secondary
Education
44
Success After High School DART Detail
45
Massachusetts Department of Elementary & Secondary
Education
What is the DART?
The District Analysis and Review Tools
(DARTs) turn the Department's vast
amount of data into valuable, easily
consumable information.
The DARTs offer snapshots of district
and school performance, allowing users
to easily track select data elements over
time, and make sound, meaningful
comparisons to the state or to
"comparable" organizations.
DARTs are free and available to the
public on the ESE website
Massachusetts Department of Elementary & Secondary
Education
46
What is the Success After High School DART?
 The Success After High School Dart is a DART: Detail tool
 DART: Detail tools provide in-depth data on targeted
topic areas
 The Department already released DART Detail’s:
Staffing and Finance and English Language Learners to
go along with the more comprehensive DART tools
 The intent of the Success After High School DART is to
synthesize and summarize existing information available
concerning secondary and post-secondary education in a
freely, well-organized, accessible format for schools,
districts, non-profit organizations, researchers, families and
the general public.
47
Massachusetts Department of Elementary & Secondary
Education
Use when
setting
school and
district
goals!
Example elements for DART
Detail: Success After High School
High School Indicators: Graduation, dropout,
suspension, and retention rates.
High School Performance: Students scoring
proficient on MCAS, students scoring on SAT and AP
tests, and participation in SAT and AP tests.
Program of Study: Students completing MassCore
and Advanced Placement coursework. Students
passing all ninth grade courses, Students passing 12th
grade mathematics and science
technology/engineering coursework.
Massachusetts Department of Elementary & Secondary
Education
48
Use when
setting
school and
district
goals!
Example elements for DART Detail:
Success After High School (continued)
Post-Secondary Educational Outcomes: Students
enrolling in post-secondary education, students
persisting in post-secondary education, percentage of
students enrolling in developmental (remedial)
coursework in Massachusetts Public Colleges.
Workforce Development: Students participating
in career/technical education by cluster, Students
completing work based learning plans and Connecting
Activities, links to other regional workforce
development data.
49
Massachusetts Department of Elementary & Secondary
Education
DART for Success After High School is a publicly accessible
tool that provides a snapshot of high school,
postsecondary, and career development education data.
This tool allows users such as district and school staff, parents, students,
workforce partners and organizations to:
 Find comparable high schools based on demographic characteristics
 Look at trends over several years
 View school data in charts that are easy to interpret
 Evaluate and reflect on schools and their progress
50
Massachusetts Department of Elementary & Secondary
Education
Find comparable high schools based
on demographic characteristics
Select your school If desired, select a "comparable"
school, no school or any other school.
Malden - Malden High
Select comparable school
School Overview
*Schools most similar to your district in terms of grade span, total enrollment, and special
populations.
Orange-shaded row: Your school Blue-shaded row: Highest performing of the other 10 schools.
Comparable
schools
School
Gra de
s pa n
MA Level
2013
Brockton - Brockton HS*
Everett - Everett High*
Holyoke - Holyoke HS*
Lowell - Lowell HS*
Lynn - Classical High*
Lynn - Lynn English High*
Malden - Malden High*
Quincy - North Quincy High*
Quincy - Quincy High*
Revere - Revere High*
Worcester - Doherty Memorial HS*
09 - 12
09 - 12
09 - 12
09 - 12
09 - 12
09 - 12
09 - 12
09 - 12
09 - 12
09 - 12
09 - 12
Level 3
Level 3
Level 3
Level 3
Level 1
Level 3
Level 3
Level 1
Level 2
Level 1
Level 3
WIB Regi on
Brockton Area
Metro North
Hampden County
Greater Lowell
North Shore
North Shore
Metro North
South Shore
South Shore
Metro North
Central Mass
2012-13 Enrol l ment
Total
#
4,081
1,931
1,354
3,099
1,528
1,653
1,847
1,222
1,568
1,537
1,333
Hi gh
Needs
%
79.2
76.2
77.4
73.5
83.6
82.0
67.4
59.0
61.4
75.5
67.9
Low
Income
%
SWD
%
ELL
%
75.7
69.0
74.9
68.3
79.8
79.6
59.1
51.0
53.8
71.0
59.3
10.6
12.1
14.3
11.3
13.3
12.8
12.7
12.7
14.3
10.7
15.3
17.2
9.7
10.9
18.3
11.2
10.8
12.5
9.9
7.2
7.5
25.8
Massachusetts Department of Elementary & Secondary
Education
51
Trend over several years with easy to
interpret charts
4-year cohort graduation rate
100%
90%
80%
70%
Your School
60%
50%
Comparable
school
40%
30%
State
20%
10%
52
0%
2008
2009
2010
2011
2012
Massachusetts Department of Elementary & Secondary
Education
“The Waterfall”
53
Massachusetts Department of Elementary & Secondary
Education
And recently released!
100%
State Avg
Cambridge
90%
Needham
80%
70%
60%
50%
40%
30%
20%
10%
0%
2006 Cohort
54
5 Year Grad for 2006
Cohort
Enroll in college
(immediate fall)
Persist 1st-to-second
year*
Graduate PS within
6 years**
Massachusetts Department of Elementary & Secondary
Education
The Success After High School DART is available at
http://www.doe.mass.edu/apa/dart/DARTSAHS.xl
sx
It is openly accessible to anyone, however it is a
large file due to all the data in the file, so…
a. it is best to download it to your computer and
b. won’t go through most email systems
Massachusetts Department of Elementary & Secondary
Education
55
Questions or comments?
56
Massachusetts Department of Elementary & Secondary
Education
Hope to See You on Our Future Webinars!
Month
Webinar Title
9/09/14
CCR Data Wise: EWIS, Postsecondary Reports/Success after
High School DART
10/14/14
Building a Positive School Culture in the Context of the new
Discipline Bill - Chapter 222
12/09/14
Integration of College and Career Readiness: The
Personal/Social Domain
Graduation and Dropout Rate Data
2/10/15
3/10/15
Career Development Education: Career Awareness,
Exploration and Immersion
4/14/15
Summer Transition Programs
5/12/15
6/09/15
Individual Learning Plans
MA Model for Comprehensive School Counseling Programs
Massachusetts Department of Elementary & Secondary
Education
57