test administrators - Boston Public Schools

advertisement
Spring Test
Administration
Training Session
February 2013
Includes information on
MCAS, MCAS-Alt, and ACCESS for ELLs
Presenters
Dan Wiener
Administrator of Inclusive Assessment
Jodie Zalk
Coordinator of MCAS Test Administration
Bob Lee
MCAS Chief Data Analyst
2
Massachusetts Department of Elementary and Secondary Education
Today’s Agenda
 Review materials in folders
 Updates for 2013
 Test security and test administration protocols
 MCAS and ACCESS for ELLs participation
requirements
 Students with disabilities
 ELL students
 Reporting
 Schedules
 Edwin Analytics
 Historically anchored growth percentiles
 Additional information and orientation for new
principals
Massachusetts Department of Elementary and Secondary Education
3
Updates for 2013
MA Secretary of Education — Matthew Malone
Changes in reporting growth
Updates for high school principals
March retest questions will not be released.
Adams requirement will include STE for grade 9
students.
ACCESS for ELLs implementation
Communication with schools and districts
Student Assessment Updates email
Massachusetts Department of Elementary and Secondary Education
4
Test Security
Why Is MCAS Security Important?
To protect the validity and integrity of test
results
“When MCAS scores are invalidated, parents,
students, educators, and the community are
deprived of important information about
student achievement...”
--Commissioner Mitchell D. Chester, Spring 2012
6
Massachusetts Department of Elementary and Secondary Education
Invalidations of MCAS Results
Year
# of Student Score Invalidations Because of
Student Cheating, Accommodation(s) Given
to Ineligible Students, Teacher Coaching
2009
2010
598
1,350
2011
2012
354
300*
* Of these students, 103 had results invalidated because
they used electronic devices, including cell phones.
Massachusetts Department of Elementary and Secondary Education
7
Top 10 Types of Security
Violations in Spring 2012
1. Cell phone
2. Improper use of
the read-aloud
accommodation
3. Improper calculator
use
4. Passing notes
5. Improper
assistance from
test administrator
6.
7.
8.
9.
Cheat sheet
MP3 player
Tweeting
Working in
wrong session
10.Posting to
Facebook
Massachusetts Department of Elementary and Secondary Education
8
Importance of Leadership
Superintendents must review their
principals’ test security plans.
Superintendent’s Assurance of Proper Test
Administration (optional) — PAM page 116
Principals must maintain the security of the
testing environment and test materials.
PCPA certification — PAM pages 114–115
Train test administrators and others, and ensure
they comply with requirements.
Meet with students.
Massachusetts Department of Elementary and Secondary Education
9
A Secure Testing Environment
Do NOT schedule breaks mid-session
Plan for
appropriate testing spaces
students who may need more time
lunch, recess, restrooms
Cover/remove prohibited classroom displays
PAM page 23
No visitors
10
Massachusetts Department of Elementary and Secondary Education
Security Requirements for
Test Materials
Store all test materials in a central location
each day.
Locked when tests are not being administered
Restricted access
Maintain chain of custody of materials
during test administration.
Do not remove test materials from school.
Do not leave test materials unattended.
Massachusetts Department of Elementary and Secondary Education
11
Confidentiality of Booklets
Do NOT …
review test booklets or answer booklets
before, during, or after testing
exceptions for certain accommodations
provide students access to tests before testing
duplicate test materials
retain, recycle, remove, or destroy test
materials
12
Massachusetts Department of Elementary and Secondary Education
Case Study #1
The test coordinator prepares crates of testing
materials for all the test administrators.
She counts the number of booklets twice and
matches the number to each room roster.
The test administrators pick up their crates and
take them to their classrooms.
Is this sufficient?
13
Massachusetts Department of Elementary and Secondary Education
Is this sufficient?
A. Yes. Materials were counted twice and
quantities were matched to room rosters.
B. No. Test administrators should also have
counted materials (in addition to the test
coordinator). Also, tracking forms should
have been used.


14
Massachusetts Department of Elementary and Secondary Education
Train Test Administrators and
Others
All individuals involved in test administration
must participate in training.
See topics in PAM — pages 26–28
Forms requiring signoff by test administrators
Participated in training
Received their TAMs — see PAM page 121
Signed a nondisclosure agreement if providing
certain accommodations — see PAM page 119
15
Massachusetts Department of Elementary and Secondary Education
Test Administrator Responsibilities
1. Follow directions in TAMs and read scripts
verbatim.
2. Supervise students at all times to prevent cheating.
3. Prevent use of prohibited materials (e.g., cell
phones).
4. Focus full attention on the testing room.
5. Do not coach students or alter responses.
16
Massachusetts Department of Elementary and Secondary Education
Case Study #2
During Session B of the Composition, some
students turn in their completed booklets.
While the remaining students continue working,
the test administrator reads some of the
compositions to see how well the students
used the writing techniques they were taught.
Is this permitted?
Massachusetts Department of Elementary and Secondary Education
17
Is this permitted?
A. No. Test administrators cannot look at
student responses or secure test content.
B. Yes. One of the purposes of MCAS is to
inform instruction. The test administrator
acted appropriately.


18
Massachusetts Department of Elementary and Secondary Education
Provide Clear Expectations to Students
 Students must not
 preview test materials
 copy others’ work
 accept any coaching or let someone else answer for them
 use materials that are prohibited during testing
 TAMs instruct students
 to work until end of session (and only in that session)
 to answer all questions in the session
 Also instruct students to
 try their best
 respond directly to the MCAS ELA Composition prompt
 Sample form in PAM (page 122)
Massachusetts Department of Elementary and Secondary Education
19
Results will be invalidated for students who use
cell phones or other electronic devices at any time
during a session, including after a student turns in
his or her test materials, during a break, or during
the transition to a test completion area.
20
Massachusetts Department of Elementary and Secondary Education
Case Study #3
A test administrator notices a student has finished working
but hasn’t turned in her test materials.
The test administrator notices that the student has her
phone out. The test administrator confiscates the
phone, collects the student’s test materials, and sends
the student to the principal’s office.
Upon questioning, the student admits that she took a
photo of a drawing she had made in her test booklet,
and posted the photo to Facebook.
What should the principal do?
Massachusetts Department of Elementary and Secondary Education
21
What should the principal do?
Print a copy of the photo.
Have the student delete the photo from
Facebook and from the phone.
Determine whether the photo was
disseminated in another way (e.g., email,
texting).
Call the Department immediately.
22
Massachusetts Department of Elementary and Secondary Education
How to Avoid This Situation
Inform students about the cell phone policy.
Inform students of appropriate activities at the
end of a session (read a book).
Have test administrators collect test materials
when students are no longer working.
Schedule sessions for appropriate lengths of
time.
23
Massachusetts Department of Elementary and Secondary Education
Tips to Maintain Security (Recommended)
Use seating charts.
Have an empty seat between students.
Have test administrators proctor other
teachers’ classes.
Have two test administrators in each room.
Massachusetts Department of Elementary and Secondary Education
24
Please contact the Department
at 781-338-3625
IMMEDIATELY
to report testing irregularities.
See PAM page 7 for more information
about reporting testing irregularities.
Massachusetts Department of Elementary and Secondary Education
25
Test Administration
Protocols
Before Materials Arrive
Determine logistics.
Security plan
Testing dates and deadlines
Testing locations and staffing plan (including special
populations)
Prepare record of test administrators and students
Check the Department’s website.
Practice tests
Read the PAM.
27
Student participation guidelines
Massachusetts Department of Elementary and Secondary Education
Review Data for March SIMS
Students’ names
changes
Demographic information
first-year LEP, IEP, and 504 status
Grade levels
Students will be reported as absent
if they are enrolled but not tested.
28
Massachusetts Department of Elementary and Secondary Education
Order June STE Materials:
March 11–15
at www.mcasservicecenter.com
29
Massachusetts Department of Elementary and Secondary Education
Receive Test Materials
 Complete forms.
Internal tracking forms (sample – PAM pages 117–118)
Materials Summary
Principal’s Certification of Proper Test Administration
(PCPA) – www.mcasservicecenter.com
 Order additional materials if necessary.
Deadlines listed on PAM pages iii–v
 Prepare materials for distribution.
Affix Student ID Labels to answer booklets.
Massachusetts Department of Elementary and Secondary Education
30
Be Sure to…
Distribute and track test materials.
Monitor and coordinate test administration.
Securely store materials between sessions and
after each day of testing.
Remind test administrators to read scripts
verbatim.
Keep a log of test administrators and students.
31
Massachusetts Department of Elementary and Secondary Education
Prepare Materials for School Files
Retain your school’s test administration files
for three years.
Records may be requested in the event of an
investigation.
Lists of materials to retain:
PAM pages 50–51, 68–69
32
Massachusetts Department of Elementary and Secondary Education
Test Administration Updates
 Students write the test administrator’s name on
the answer booklet cover – not on the test booklet
 Exception: Test booklet for ELA Composition Session A
 Principals keep reason for change of enrollment
status on file – not reported on the answer
booklet
 Non-grade-10 status reported in SIMS – not on
the answer booklet
 Updates to scripts in TAMs
 Cell phones
 Testing time
33
Massachusetts Department of Elementary and Secondary Education
Prepare the Scorable Shipment
 Assign an answer booklet for
 students who participated in ANY part of testing
 students who were absent with medical documentation
 first-year ELLs
 Transcribe responses if necessary
 Prepare envelopes
 Return, Special Handling, Void
 Packing diagrams and instructions in PAM
 ELA: PAM pages 46–47
 Math and STE: PAM pages 64–65
Massachusetts Department of Elementary and Secondary Education
34
Complete Forms after Testing
Internal tracking forms
Materials Summary
PCPA
Signature must match the name of the principal in
School/District Profiles
(http://profiles.doe.mass.edu).
35
Massachusetts Department of Elementary and Secondary Education
Options for Returning Materials
(March–April and May)
 Complete Early
Shipment
• Early pickup of
all scorable and
nonscorable
materials
 Partial Early
Shipment
• Early pickup of
used answer
booklets for
students who
tested by certain
dates
AND
 Regular
Shipment
• Pickup of all
scorable and
nonscorable
materials as soon
as testing has
been completed
(by deadline)
• Pickup of
remaining
scorable and
nonscorable
materials by
deadline
Massachusetts Department of Elementary and Secondary Education
36
Schedule Your School’s Pickup
 Two methods:
 Schedule online at mcasservicecenter.com.
One day prior, and by 3:00 p.m.
OR
 Give cartons to your regular UPS driver.
Call to inform the MCAS Service Center (800-737-5103).
 Grade 10: Call the Service Center to cancel early
pickup if using regular return.
 Do not take materials to UPS.
 Do not leave materials unattended.
 Use UPS labels specific for each administration.
Massachusetts Department of Elementary and Secondary Education
37
Questions & Answers
Short Break
MCAS and
ACCESS for ELLs
Participation
Requirements for
Students with Disabilities
Eligibility for Test Accommodations
for Students with Disabilities
IEP or 504 plan must specify the
accommodations to be used for testing.
Accommodations may not be provided if
IEP has not yet been signed by the
student’s parent/guardian.
Accommodations may be provided if a
504 plan is being developed for a student.
40
Massachusetts Department of Elementary and Secondary Education
Prohibitions for Test
Accommodations
 Providing student with unapproved
accommodations or those not listed in the PAM
 Allowing student to take a different grade-level
test
 Violating test security
 Providing student with an altered or photocopied test
 Coaching or providing clues or other assistance (e.g.,
defining words, sending student back to write more)
 Allowing prohibited materials
(e.g., dictionary on ELA Reading Comprehension test)
Massachusetts Department of Elementary and Secondary Education
41
Plan Ahead to Provide
Accommodations on Test Day
Review IEPs, 504 plans, and PAM Appendix B
ahead of time.
Prepare accommodations spreadsheet: Who? Which
accommodation(s)? Where?
Ensure sufficient quantities of special test
editions (large-print, Braille, Kurzweil, ASL DVD).
Provide only Department-approved ELA graphic
organizers and individualized mathematics
reference sheets.
Train all test administrators who will provide
42
accommodations, including substitutes.
Massachusetts Department of Elementary and Secondary Education
Invalidating MCAS Test Results for
Inappropriate Accommodation Use
Test results may be invalidated if a student is
provided with an accommodation not listed in
his or her IEP or 504 plan.
Cautions
Accommodation 16 vs. 26 (read aloud)
Accommodation 20 (approved graphic organizer or
mathematics reference sheet)
Accommodation 30 (calculator)
Dictionaries only permitted for the ELA Composition
Refer to last approved IEP or 504 plan.
Massachusetts Department of Elementary and Secondary Education
43
If a Student Refuses an
Accommodation
 Document refusal in student’s file.
Do not ask the student to sign a statement.
 Continue to make accommodation available for
remainder of test administration.
 Amend IEP/504 plan for future testing.
It may be appropriate to list the accommodation in
the IEP/504 plan “as requested by student” or
remove it.
 Do not fill in circles on the student’s answer
booklet (back cover) for accommodations that
were refused.
Massachusetts Department of Elementary and Secondary Education
44
Nonstandard Accommodations (NSAs)
NSAs may be provided only if student
is virtually unable to decode, calculate, write, or
spell; AND
receives ongoing intervention in this area.
NSAs may not be provided if student is
simply performing “below grade level.”
Score may be invalidated if ineligible student was
provided an NSA.
Use of NSAs reported on Parent/Guardian
Reports and school and district rosters
Massachusetts Department of Elementary and Secondary Education
45
Data Collection for Students with
Disabilities
504 information is collected through SIMS,
instead of on the answer booklet.
Answer booklets:
Fill in only those accommodations that were used.
Accommodations that are not applicable for a
specific test are not listed on the answer booklet for
that test.
e.g., accommodation 30 (calculator) is not listed for
ELA tests
Massachusetts Department of Elementary and Secondary Education
46
MCAS-Alt General Information
IEP/504 teams annually designate students
for MCAS-Alt (decision made in each subject).
Encourage teachers to review the Educator’s
Manual and attend Department training.
Consider flexible scheduling and classroom
coverage to allow teachers to work on portfolios.
47
Massachusetts Department of Elementary and Secondary Education
MCAS-Alt Important Dates
February 25
Schools receive MCAS-Alt materials
March 4, 6–8
“Portfolios-in-Progress”
regional review sessions
April 1
Deadline for UPS pickup of portfolios
Mid-June
MCAS-Alt results reported
electronically
June 28
MCAS-Alt Score Appeal
submission deadline
MidSeptember
Portfolios returned to schools
Massachusetts Department of Elementary and Secondary Education
48
Schools’ Retention of Returned Portfolios
Portfolios returned to your school become part
of the student’s temporary record.
Temporary records must be destroyed within
7 years after student transfers or
graduates/exits. (Student Record Regulations)
However, temporary records may be
destroyed when they become outdated or
irrelevant.
Provided that parent/guardian is notified in writing
and given opportunity to receive portfolio prior to
its destruction
Massachusetts Department of Elementary and Secondary Education
49
Suggested Portfolio Retention Schedule
Grades
Subject
Retention Schedule
3−8
ELA and Mathematics
2 years after return of portfolios
to school
5 and 8
STE
• grade 5: 3 years after return of
portfolios to school
• grade 8: 2 years after return of
portfolios to school
High
school
ELA, Mathematics,
STE
2 years after the student exits
public education
50
Massachusetts Department of Elementary and Secondary Education
MCAS and
ACCESS for ELLs
Participation
Requirements for
ELL Students
Accommodations on MCAS Tests
for ELL Students
Bilingual word-to-word dictionaries authorized
for use on MCAS tests
 May be used by any student who is or was ELL
 New languages added annually
 Specialized translations (glossaries) for Math and STE
 Selected publishers/distributors and online resources
included
 Electronic translators prohibited
ELLs with disabilities receive test
accommodations per their IEP/504 plan
Massachusetts Department of Elementary and Secondary Education
52
Features of ACCESS for ELLs Test
Used by 30 states in the WIDA Consortium
Assesses WIDA English Language Development Standards
Reduction in testing time
Fewer test sessions for reading and writing
No fall tests for new ELLs
Longer testing window than MEPA
Earlier testing and release of results
To inform decisions on student placement and services
“Bridge study” and updated guidance
Coming this summer
Massachusetts Department of Elementary and Secondary Education
53
ACCESS for ELLs Information
Administration highlights
A booklet must be returned for every ELL student.
Students who exited ELL status after October 2012
SIMS are not required to participate.
ELL students who do not take ACCESS for ELLs (if
required) will be reported as nonparticipants for
MCAS ELA participation calculations.
For more info
See the ACCESS TAM, MA Supplement, and ELL
Assessment Updates at
www.doe.mass.edu/mcas/access.
Massachusetts Department of Elementary and Secondary Education
54
Test Administration for ELLs
Assigning Testing Spaces for ELLs
 Principals may assign students to spaces other than
regular classrooms, as long as other conditions and
staffing requirements are met.
MCAS Policy on “Stop Testing”
 If an ELL student does not seem to be responding to test
questions, the test administrator may ask the student if
he or she is finished.
55
 If so, collect materials and have the student sit quietly.
Massachusetts Department of Elementary and Secondary Education
Questions & Answers
Short Break
Reporting
Reporting Topics
Schedule for reporting MCAS results
Discrepancy period
Schedule for reporting ACCESS for ELLs results
New and redesigned reports in the EDW
Introducing “Edwin”
Including the EDW and more
Growth model
Historically anchored growth percentiles
58
Massachusetts Department of Elementary and Secondary Education
Spring 2013 MCAS
Reporting Schedule — March–May
(all dates tentative)
Access February Biology data files at
DropBox Central
(rosters available March 20)
Access March Retest data files and
April 19
rosters at DropBox Central
Districts receive February Biology and
May 6
March Retest Parent/Guardian Reports
Early May Schools and districts receive printed
ACCESS for ELLs reports
March 22
Results will be available in EDW/Edwin Analytics three days
after the DropBox release.
Massachusetts Department of Elementary and Secondary Education
59
Spring 2013 MCAS
Reporting Schedule — Mid-June
Districts access preliminary MCAS and
MCAS-Alt student results
ELA (preliminary results), Math (MC), Grades 5
and 8 STE (MC), MCAS-Alt
Districts access MCAS ELA Compositions at
www.mcasservicecenter.com
Massachusetts Department of Elementary and Secondary Education
60
Spring 2013 MCAS
Reporting Schedule — July–August
(all dates tentative)
July 1–Aug. 2
MCAS discrepancy reporting by
phone (800-737-5103)
August 7
Districts access preliminary
Mathematics and STE MCAS results
• Combined with June ELA and
absence codes
MCAS discrepancy reporting online
(mcasservicecenter.com)
August 7–13
61
Massachusetts Department of Elementary and Secondary Education
Spring 2013 MCAS Official Results
Reporting Schedule — Mid-September
 Districts access official MCAS student, school,
and district results on the Department’s
Security Portal
 One day later:
 Districts receive shipment of MCAS and MCAS-Alt
Parent/Guardian Reports
 Public release of official school and district results
by the Department
62
Massachusetts Department of Elementary and Secondary Education
Reporting Notes for High Schools
STE scores used for accountability in grade 10
Grade 9 students’ scores held until grade 10
All high school accountability determinations made for
grade 10 students
New –— Repeating grade 10 students who
participate in grade 10 tests will not be included
in participation and performance results.
Students count once for high school accountability.
Massachusetts Department of Elementary and Secondary Education
63
Recent Reporting Changes
EDW now named Edwin Analytics
All current and historical reports available in
one location (in Edwin Analytics)
Classroom-level reports now available to those
with the “Evaluator” role
CD status reports now available (updated
monthly)
Five MCAS reports updated to reflect the
adoption of the new standards
Massachusetts Department of Elementary and Secondary Education
64
Available for all
districts in
2013
• MCAS reports
• Student profiles
• An early
warning
indicator system
• Dashboards and
reports
• MCAS released
items and other
items available for
online testing
• Competency
Tracking System
• Aligned to
standards
• Model
curriculum
units
• Curriculum
mapping and
lesson
planning
tools
• Aligned to
standards
• High-quality
digital
resources to
support
instruction
• Aligned to
standards
View assessment demo online at http://thinkgate.net/ohma/.
65
Analysis & Reporting Tools
(Edwin Analytics)
MCAS reports
Student profiles
An early warning indicator system
Dashboards and reports
66
Massachusetts Department of Elementary and Secondary Education
Other Reports in Edwin Analytics
Early Warning
Indicator System
(EWIS)
Postsecondary
Readiness and
Success
• Which students in
grades 1–12 may be at
risk of missing key
educational targets?
• Based on MCAS,
Early Childhood and
Care (ECC) data, and
other demographics
• How did my graduates
do in college?
• Did my Needs
Improvement students
require college course
remediation? Did they
graduate from college?
Massachusetts Department of Elementary and Secondary Education
67
Reminder about “Claiming
Students” in Edwin Analytics
Claim students new to your district or school.
Access recent MCAS scores, grades,
coursework, discipline, and program data
reported to the state.
Commonly used by middle schools and high schools
to view information about incoming students over
the summer
Review CD test and retest data.
See your district technology coordinator or
Data Warehouse contact for help.
Massachusetts Department of Elementary and Secondary Education
68
Historically Anchored
Growth Percentiles
Student Growth Percentiles
Background
As a Result…
 Since 2008, the
Department has calculated
growth percentiles for
each new class.
 50% of students grew
at a rate below 50 no
matter how much they
improved.
 Each student’s progress
compared to students in
his or her grade.
 Half of schools were
below average.
 Norms updated each year
Median of 50 each year
 20–25 percent of
teachers’ growth
scores were below 40
each year.
70
However, students are improving at
increasing rates.
 NAEP grade 4 and 8 scores in Massachusetts
have risen 3% of a standard deviation per year
(1992–2011).
 TIMSS grade 8 Math scores rose dramatically
between 1999 and 2011 (43 points).
 MCAS proficiency rates rose 4–5 points between
2008 and 2012 (all grades).
How do we show this information more
clearly?
71
New for 2013 –
Historically Anchoring Growth
New system:
We will calculate growth using historical
academic peers.
2013 student gains will be compared to all the
MCAS scores between 2008 and 2012.
The average student, classroom and district
can now show growth above the 50th
percentile.
Massachusetts Department of Elementary and Secondary Education
72
73
Growth in 2013 will be anchored to
the three 2008–2012 cohorts.
2008
2009
2010
2011
2012
Grade 5
Grade 5
Grade 5
Grade 5
Grade 6
Grade 6
Grade 6
Grade 6
Grade 6
Grade 7
Grade 7
Grade 7
Grade 7
2013
2013
Contemporary
Peers
Grade 7
74
Historical academic peers
This Means for Your School…
As teaching and learning improves, average
growth will rise above 50.
The same teaching and learning will result in
the same growth scores each year.
It will be possible to determine the growth
needed for a student to be Proficient or
Advanced.
75
The Difference Will Likely Be Subtle
Growth will still range from 1–99.
Higher numbers will still represent more
growth and vice versa.
Experimental data from 2012 suggests that
school and district results will vary 1–6 points.
76
For More Information
www.doe.mass.edu/mcas/growth
Student Assessment Updates email
77
Massachusetts Department of Elementary and Secondary Education
Questions & Answers
Short Break
If you are leaving now, please
leave your completed
Evaluation Forms at the
registration desk.
Thank you for coming.
Additional Information
and
Orientation for
New Principals
Additional
Accommodations
Information
Selecting Appropriate
Accommodations for Instruction
Adults who work with the student:
1. Gather information on student’s learning
style and preferences.
2. Look at student’s classroom performance,
not just the type of disability.
3. Try out prospective accommodations
during instruction.
4. Evaluate instructional accommodations and
modify as needed.
Massachusetts Department of Elementary and Secondary Education
82
Designate Accommodations
for Assessment
 Team bases selection of test accommodations on
those that were used successfully during
instruction.
 For each subject, determine whether the
accommodation is appropriate and allowed for
MCAS testing.
 Develop/amend IEP or 504 plan, listing
instructional and assessment accommodations
separately.
 Accommodations must be provided/offered if
listed in IEP (signed by parent/guardian) or in
504 plan.
Massachusetts Department of Elementary and Secondary Education
83
Accommodation 20: Organizers
and Checklists
Use approval cover sheet (all subjects)
 If not using posted materials (ELA)
 Not necessary to resubmit if approved in 2012
Mathematics reference sheets
 Formulas, word banks, memory prompts (e.g., mnemonics)
 No graphics, definitions, examples, specific steps in solving
problems
Deadline Test
to Submit
Feb. 1
ELA tests (all grades)
April 5
Mathematics (all grades) and STE tests (gr. 5 & 8)
May 3
High school STE tests
Massachusetts Department of Elementary and Secondary Education
84
Students with Concussions
Per DPH regulations, students must be placed
on a “graduated reentry plan.”
Terms and conditions for student’s gradual return to
academic and extracurricular activities
Student may be excused from MCAS testing
if participation would impede recovery or
endanger health.
Student will be reported and included in results as
“medically documented absence.”
View details and regulations at
www.doe.mass.edu/mcas/participation/?section=sped.
Massachusetts Department of Elementary and Secondary Education
85
Additional Details on
Test Administration
Additional Information
Forms
Participation guidelines
Return shipping instructions
Brockton High School video
87
Massachusetts Department of Elementary and Secondary Education
PCPA “Materials Received” Section


89
PCPA “After Testing” Sections


90
Internal Tracking Forms
Used to determine chain of custody of materials
See samples in PAM (pages 117 and 118)
91
Massachusetts Department of Elementary and Secondary Education
Highlights of Spring High School
Participation Guidelines
Administration
Who’s eligible?
Dates
March ELA retest
Students who have not earned
240/Proficient on the ELA test
(Students may participate for EPP
purposes.)
February 27–
March 1
March
Mathematics
retest
March 4–5
Students who have not earned
220/Needs Improvement on the
Mathematics test (Students may not
participate for EPP purposes.)
EPP/MCAS
Mathematics test
For students seeking to successfully
complete the mathematics
assessment portion of their EPPs
April 22–May 3
92
Massachusetts Department of Elementary and Secondary Education
June High School STE Participation
Eligibility
Students who …
Grade
Required to have not yet earned CD in STE
participate
Gr. 10
(Class of 2015)
Eligible
are enrolled in STE course who have
not yet earned CD in STE
New – score will be used to determine
Adams Scholarship eligibility
Gr. 9
(Class of 2016)
have not yet earned CD in STE OR
wish to attempt to qualify for Koplik
Award
Gr. 11 (Class of
2014)
have not yet earned CD in STE
Gr. 12 (Class of
2013)
are attempting to earn CD in STE
Adults who exited
HS
Not eligible have earned their CD in STE and are not All
participating for Koplik Award purposes
Massachusetts Department of Elementary and Secondary Education
93
Three Envelopes for Answer Booklets
Return Envelope
 Used/assigned standard answer booklets (ABs)
Special Handling Envelope
 Typed Responses inserted in ABs
 Large-print ABs with transcribed standard AB
Void Envelope
 ABs that were assigned to students that should not be
scored
 Fill in “VOID” circle on back cover
94
Pack Return Shipments
 Use the diagrams in the PAM to pack scorable and
nonscorable shipments.
ELA instructions — pages 46–49
Mathematics and STE instructions — pages 64–67
95
Massachusetts Department of Elementary and Secondary Education
One School’s
Perspective on Test
Administration
Brockton High School
Organizing Test Administration
(Courtesy of Brockton High School)
1. Preparation in advance of materials
arriving at the school
2. Preparation of test administrators
3. Preparation of students
4. Maintaining security within each testing
room
5. Collection and accountability of
materials
97
Additional Reporting
Information
Where do I find my results?
ESE Security Portal mcasservicecenter.com
Edwin Analytics
(formerly the EDW)
 Ordering MCAS tests
DropBox Central
 Viewing compositions
Passwords connected
to educator license
accounts
 Filing discrepancies
Non-principal access
governed by District
Administrator
 Principal passwords
mailed early January
Massachusetts Department of Elementary and Secondary Education
99
What reports will I find in Edwin
Analytics?
District, School and Student level reports with
MCAS achievement, growth and demographics
MCAS results by standard
Item-level reports
Detailed growth reports
Classroom-level reports
ACCESS for ELLs reports (and historical MEPA
reports)
Early Warning Indicator System Reports
Post-Secondary Readiness Reports
Massachusetts Department of Elementary and Secondary Education
100
What reports will I find in
DropBox Central?
MCAS and ACCESS for ELLs rosters
Student-level data files (Excel)
Preliminary accountability reports
Multiple-choice interpretive guide
for analyzing June preliminary data
Data file layouts and legends
Other data files
Students who were in grade 9 in the previous
school year and grade 11 this school year (and are
required to participate in the grade 10 tests)
Massachusetts Department of Elementary and Secondary Education
101
What reports will I find at
mcasservicecenter.com?
ELA student compositions
Discrepancy reporting tool
Historical MEPA reports
Reporting workshop presentations
102
Massachusetts Department of Elementary and Secondary Education
Security Portal — www4.doemass.org
103
 Select
Edwin
Analytics
 Or
DropBox
Central
104
Inside Edwin Analytics
105
Accessing DropBox Central
 Select
“MCAS 20xx
Data”
folder.
 Click
Next.
 Your
organization
(school or
district
name) will
appear.
106
Click the name of the data file and layout to
download.
107
Questions & Answers
Please leave your completed
Evaluation Forms at the
registration desk.
Thank you for coming.
Download