Student Assessment:
Next Steps
Guidance for school and district leaders
November 23 and 24, 2015
Agenda
Transition plan for student assessment
2016 Test Administration
2016 options for districts
Timeline for decision-making
Survey for registering your decision
Accessibility and accommodations for 2016
Technology considerations
Reporting and accountability
Planning for 2017 and beyond
Resources
Massachusetts Department of Elementary and Secondary Education
2
Transition plan for student
assessment
2016 transition year
Districts default to test administered in 2015 unless
a change is registered:
MCAS districts in 2015 can choose to switch to PARCC in
2016 and select their mode of administration (CBT or PBT)
PARCC districts in 2015 can choose to change their mode
of administration (CBT or PBT)
2017 and beyond
Next-generation MCAS
3
The Commissioner’s recommendation, as approved by the Board of
Elementary and Secondary Education, is available through here.
Massachusetts Department of Elementary and Secondary Education
District Choice for Grades 3-8 in
2015-16
4
Massachusetts Department of Elementary and Secondary Education
Additional 2016 Administration
Details
PARCC
Districts can assign students to either the grade 8
math test or Algebra I test.
Voluntary high school testing in grades 9 and 11
will not be offered.
MCAS (augmented with a small number of
PARCC items)
As part of the PARCC portion of the ELA test,
students will likely write in response to text in all
grades.
Possible elimination of the ELA Composition (grades
4 and 7); to be confirmed in the next few weeks.
Massachusetts Department of Elementary and Secondary Education
5
All districts will continue to
administer:
Grade 5 and 8 MCAS Science and
Technology/Engineering tests
Grade 10 MCAS ELA and Mathematics tests
High school MCAS Science and
Technology/Engineering tests
High school MCAS retests
MCAS-Alt
ACCESS for ELLs 2.0
Massachusetts Department of Elementary and Secondary Education
6
Spring 2016 testing windows
MCAS
Grades 3-8 ELA: March 28-April 12
New - ELA window will be one week later for grades 3-8
Grade 10 dates will remain the same.
Grades 3-8 Math: May 9-24
PARCC
New - Consolidated schedule (PBA and EOY from
2015 combined into one window for 2016)
CBT: April 25-June 6
PBT: April 25-May 27
Massachusetts Department of Elementary and Secondary Education
7
2016 District Decisions
8
Massachusetts Department of Elementary and Secondary Education
Timeline for making decisions
Date
Event
November 23
District superintendents and directors
of outplacements receive instructions
and passwords via email to register
the district’s choice via an online tool
By December 18
Districts register decisions using the
online tool, or request an extension
from ESE via
assessment@doe.mass.edu
Mid-January 2016 Decisions published on ESE website;
Districts that did not make a decision
will default to 2015 decisions
Massachusetts Department of Elementary and Secondary Education
9
How to register your district’s spring
2016 assessment decision
1. Check email for your district’s unique
password.
 Sent by assessment@doe.mass.edu to
superintendents and directors on 11/23
2. Access survey link included in email.
3. You will receive a confirmation after you
submit the survey.
4. Choices can be re-submitted online until the
Dec. 18 deadline.
Massachusetts Department of Elementary and Secondary Education
10
The survey
Enter password sent Nov. 23
from assessment@doe.mass.edu
Your confirmation will
be sent to this address.
11
Massachusetts Department of Elementary and Secondary Education
Districts that did PARCC in 2015
Will be asked first if they want to do
everything the same as they did in 2015
The survey will not show your choices from 2015
Then choose grade 8 math test and/or Algebra I
test for grade 8 students.
Enter the number of grade 8 students taking
Algebra I.
Or some schools will be changing test mode
from paper to CBT or vice-versa
Massachusetts Department of Elementary and Secondary Education
12
PARCC District’s prompt
Choose yes to choose the same mode for all grade 3-8 schools
Choose “No” if you want to change the mode for some of your grade 3-8
schools
Massachusetts Department of Elementary and Secondary Education
13
Districts that did MCAS in 2015
Choose MCAS
OR
Choose PARCC
Choose mode of administration for each school
(CBT or PBT).
Choose grade 8 math test and/or Algebra I test
for grade 8 students.
Enter the number of grade 8 students taking
Algebra I.
Massachusetts Department of Elementary and Secondary Education
14
December 18 Deadline for Decisions
Districts that do not register their decision by
December 18 will default to 2015 assessments
MCAS will be default for MCAS schools
PARCC mode of administration (CBT or PBT)
PARCC Algebra I or grade 8 math test orders
Districts with extenuating circumstances must
contact assessment@doe.mass.edu to request
a short extension and receive confirmation by
the December 18 deadline.
Massachusetts Department of Elementary and Secondary Education
15
Accessibility and
Accommodations for 2016
Accessibility and Accommodations
Overview
MCAS:
 2015-2016 Participation Requirements remain in
effect: www.doe.mass.edu/mcas/participation/?section=all
PARCC:
 Many “accommodations” for MCAS are built into
computer-based PARCC tests as accessibility
features for all students.
 Many test administration considerations are
available to any student, at discretion of principal.
 Accommodations are available only to students
with disabilities and English language learners.
MCAS-Alt:
 For all students designated for alternate assessment.
PARCC Accessibility and
Accommodations Resources
• PARCC Accessibility
Features and
Accommodations
Manual
www.parcconline.org/parccaccessibility-features-andaccommodations-manual
• MA Overview of PARCC
Accommodations and
Accessibility
http://www.doe.mass.edu/ne
ws/news.aspx?id=21217
Comparison of PARCC and MCAS
Accessibility Policies
PARCC
MCAS
CBT schools can use paper-based
testing as an accommodation
Paper-based
Timed tests, with extended time for
students with disabilities and ELLs
Untimed tests for all students.
Individualized graphic
organizers and reference sheets
may not be used
Individualized graphic
organizers and reference sheets
allowed with ESE approval
Expanded accessibility for all
students; more accommodations
available for ELLs
Accommodations only available to
students with disabilities; limited
accommodations available for ELLs
PARCC Emergency
504 Plan developed for student
Accommodation Form for students with temporary or recentlywith temporary or recently-occurring occurring disability.
disability (i.e., fracture).
Technology
Considerations
What did 127,000 MA students say after
taking the PARCC online tests in 2015?
92% said they had enough time to finish, 6%
“rushed” and 2% did not finish in time
38% (ELA) and 47% (Math) said the test was
harder than their normal school work
27% Experienced problems logging into the
test; 25% experienced technical problems
during the test; 23% reported the computer
“worked slowly”
65% said they prefer taking the test online to
paper
Source: Online surveys compiled byMassachusetts Department of Elementary and Secondary Education
HumRRO, Sept. 2015
21
How well-prepared were MA students
who took the 2015 PARCC online tests?
25% reported that they “never practiced” for
the online test; 28% reported that they
practiced once before taking the online test
86% use a computer or tablet at home at least
a few times per week; 62% use a computer or
tablet at least a few times per week at school
48% report that they usually write stories or
essays using a tablet or computer
Source: Online surveys compiled byMassachusetts Department of Elementary and Secondary Education
HumRRO, Sept. 2015
22
What devices did Massachusetts
students use for online testing?
Device
%
Desktops
30%
Laptops
55%
Tablets w/
12%
Keyboards
Tablets no
3%
Keyboard
Source: Online surveys compiled byMassachusetts Department of Elementary and Secondary Education
HumRRo, Sept. 2015
23
Device specifications
Technology Guidelines for PARCC Assessments
Version 5.1 http://www.parcconline.org/technology
Specifications for:
 Windows (desktops, laptops, tablets)
 Linux machines
 MAC (desktops, laptops)
 iPads
 Chromebooks
 Android tablets
Devices meeting minimum specs can be used in 2015-16
Devices meeting recommended specs can be used through 2018-19
24
Massachusetts Department of Elementary and Secondary Education
How many devices are needed to give the test?
Steps
Notes
1. Determine total # of
testing sessions available
during the 20-day window
•
2. Determine total # of
students to be assessed
Example
If a school can provide 3 sessions/day, the
total number of sessions is 60
If a school can provide 2 sessions/day, the
total number of sessions is 40
60 sessions
•
This is the enrollment count across tested
grades
125 students
3. Determine max # of
sessions per tested student
•
At most, each student needs 7 sessions to
take the test across ELA and math
7 sessions
4. Determine total # of
“seats”
•
Multiply total # of students to be assessed
by the total # of sessions per tested
student
875 seats
5. Determine total # of
devices needed
•
Divide total # of seats by total # of
sessions available
• Divide by 60 if the school can provide
3 sessions/day
• Divide by 40 if the school can provide
2 sessions/day
15 devices
•
This school needs 15 devices to give 7 sessions of the test to 125 students within the window
Massachusetts Department of Elementary and Secondary Education
25
Infrastructure recommendations
Technology Guidelines for PARCC Assessments
Version 5.1 http://www.parcconline.org/technology
 Minimum with caching:
5kbps/student
 Minimum without caching:
50kbps/student
 Recommended:
100kbps/student
 SETDA standard:
1mbps/user
Regardless of a school’s infrastructure, proctor caching is strongly
recommended in all situations.
 Ensures uninterrupted testing experience
 Minimizes data loss
26
 Maximizes # of simultaneous test-takers
 Less burden on tech support staff
Massachusetts Department of Elementary and Secondary Education
Operating systems, browsers, and Java versions
no longer supported by TestNav 8.4*
*TestNav 8.5 is scheduled for release in January 2016
 Operating
systems:
Windows Vista
Windows XP
MacOS 10.6
iOS 7
 Browser
versions:
Internet Explorer 9
Internet Explorer 10
Safari 5.x
Google Chrome (all versions)
 Java
versions:
27
1.6
1.7
Massachusetts Department of Elementary and Secondary Education
New in TestNav for Spring 2016
TestNav app for desktops and laptops replaces all
Google Chrome and older Java-based browsers
Headphones required for all ELA/L units
Larger screen size for ELA/L constructed response
Spell check available for ELA/L responses
Flag items for review before exiting session
Massachusetts Department of Elementary and Secondary Education
28
Preparing students for computer-based testing
 Provide plenty of opportunities across the curriculum for students to gain
fluency with computers and digital tools
 Basic computer skills such as the correct use of a computer, using a mouse, starting and
exiting a program, switching between two open programs, working with windows (dialogue
boxes) in a program, scrolling, etc.
 Keyboarding skills such as identifying, locating, and using letter, number, and punctuation
keys to enter characters; using special keys (e.g., enter/return, spacebar, delete, backspace,
tab, number pad, etc.)
 Word processing skills such as using keyboards to type words/sentences/stories; locate
and enter punctuation marks; insert or replace letters/words; using shift key for
capitalization; checking spelling, etc.
 Text-reader or screen reader skills such as highlighting text, reading highlighted text,
using speech options, reading selected text, reading specific words/paragraphs,
start/stop/pause reading, navigate tables, etc.
 Take practice tests to become familiar with the TestNav environment
 PARCC sample sets and tutorials: http://practice.parcc.testnav.com/#
29
Massachusetts Department of Elementary and Secondary Education
Reporting and
Accountability
2016 Reporting on PARCC
As in 2015, ESE plans to:
Link PARCC and MCAS results
Based on 2016 or 2015 representative samples and
resulting concordance tables
Report achievement and growth results (where
available) for students, schools, districts, and state
PARCC and MCAS achievement levels
PARCC and MCAS scaled scores
Composite Performance Index (CPI) scores
Student Growth Percentiles (SGPs)
Massachusetts Department of Elementary and Secondary Education
31
32
Massachusetts Department of Elementary and Secondary Education
33
Massachusetts Department of Elementary and Secondary Education
2016 Accountability
Schools & districts administering PARCC will have
their 2016 accountability and assistance level
“held harmless” (i.e., the level will stay the same
or improve from 2015, but cannot decline)*
Applies to all districts & schools that administer
PARCC—even if they took PARCC in 2015
Schools administering MCAS will be classified into
a level as usual, and will not be “held harmless”
34
* Exception for Level 5 classifications
Massachusetts Department of Elementary and Secondary Education
2016 Accountability Determination for a
School Participating in PARCC
Sample School A
2015
2016
Cumulative
PPI
Cumulative PPI
All
Students
High
Needs
School
Percentile
Level
All
Students
High Needs
School
Percentile
Level –
Effect
without
“Hold
Harmless”
Level –
Effect
with
“Hold
Harmless”
78
76
45
Level 1
76
70
43
Level 2
Level 1
(declines)
(remains
the
same)
35
Massachusetts Department of Elementary and Secondary Education
2016 Accountability Determination for a
School Participating in PARCC
Sample School B
2015
2016
Cumulative
PPI
Cumulative PPI
All
Students
High
Needs
School
Percentile
Level
All
Students
High Needs
School
Percentile
Level –
Effect
without
“Hold
Harmless”
Level –
Effect
with
“Hold
Harmless”
85
68
24
Level 2
74
73
17
Level 3
Level 2
(declines)
(remains
the
same)
36
Massachusetts Department of Elementary and Secondary Education
2016 Accountability Determination for a
School Participating in PARCC
Sample School C
2015
2016
Cumulative
PPI
Cumulative
PPI
All
Students
High
Needs
School
Percentile
Level
All
Students
High
Needs
School
Percentile
Level –
Effect
without
“Hold
Harmless”
Level –
Effect with
“Hold
Harmless”
73
70
19
Level 3
77
71
24
Level 2
Level 2
(improves)
(improves)
37
Massachusetts Department of Elementary and Secondary Education
Looking Ahead
Planning for 2017
In the coming months, the Department will:
 Issue a Request for Proposals and award a contract to
develop a next-generation test for the spring 2017
administration.
 Work with districts to prepare them for computerbased testing by 2019.
 Convene new committees to advise the Department
on technical quality, policy, content, and accessibility.
 Work within PARCC to ensure development of highquality test items, while sharing costs with other
member states.
 Consider development of a new CD requirement
Massachusetts Department of Elementary and Secondary Education
Resources
PARCC
 Released Items from Spring 2015
 https://prc.parcconline.org/assessments/parcc-released-items
 Technology System Check and Requirements
 http://parcc.pearson.com/technology-setup/
 Test Administration Resources
 http://www.doe.mass.edu/parcc/testadmin/
 Practice Tests
 http://parcc.pearson.com/practice-tests/
Contact us:
assessment@doe.mass.edu
(781) 338-3625
Massachusetts Department of Elementary and Secondary Education
40
Questions & Answers
Thank you for participating.