1
2013 Maryland School Assessment
School Test Coordinators Training
Carol Wilson & James Gresham, Ed.D.
Office of Achievement and Accountability
January 29 2013 and January 30, 2013
BALTIMORE CITY
PUBLIC SCHOOLS
AGENDA
2
Welcome and Introductions
Purpose of Training
2013 Test Administration Guidelines
A. Review of 2013 Test Administration Coordination
Manual (TACM)
B. Scan Tracks – Barcode Scanning
Test Security
A. Video Presentation
B. Pre-Test
C. Procedures for Successful Administration
D. Overview of City Schools 2013 Monitoring Plan
Student Survey Administration /Coordination
BALTIMORE CITY
PUBLIC SCHOOLS
3
Review of 2013 TACM
BALTIMORE CITY
PUBLIC SCHOOLS
Goals
4
Topic
Slide
• Key Dates
8
• What is new for 2013
9
• Testing Window and Local Schedules
10-11
• Participation / ELL Policies
14-20
• Test Materials Format
21-22
• Accommodations
24-33
• Prohibited Aids
34-35
• Home Schooled Students
36-37
• Split Books/Transfers
39-41
• Test Materials
42-46
BALTIMORE CITY
PUBLIC SCHOOLS
Goals
5
Topic
Slide
• PreID Labels
47-51
• Use of Pearson Access
52-56
• Testing Irregularities
58-62
• Preparing Materials for Scoring/Pickup
63-74
• Contacts
75-76
• ScanTracks
78-82
• Test Security
83-109
• School Testing Plan
89
• Test Examiners/Proctors
106-107
• Monitoring Plan
108-109
• Post Test
110
BALTIMORE CITY
PUBLIC SCHOOLS
MSA 2013 TACM Appendices
6
A.
B.
C.
D.
E.
F.
G.
H.
I.
J.
K.
L.
M.
Alt-MSA Participation Criteria
N.
Test Administration/Certification of
O.
Training Form and Non-Disclosure
P.
Non-Disclosure Agreement Form
Q.
STOP and GO ON Samples
R.
Shipping Documentation
S.
Testing Materials Inventory
Checklist
T.
School Security Checklist
Transcription Instructions
U.
Redistribution of Materials Record
Demographic Sheet Sample
V.
Preprinted Student ID Labels
W.
Daily Test Materials Tracking
X.
Record
Y.
BALTIMORE CITY
Verbatim Reading Rules (Math)
Damaged Testing Material Report
Header Sheet Sample
Home Schooled Student Info. Sheet
Orange and Green Return Label
Bill of Lading
Verbatim Reading Accommodation
(Online Testing)
Request to Mark Student Online Test
Complete
Kurzweil 3000 Administration &
Security Procedures
Test Archive: Student Tracking Form
Non-Disclosure Form
MSA Frequently Asked Questions
STC Eligibility Waiver
PUBLIC SCHOOLS
MSA 2013 Key Dates
7
Return Special Materials Order to OAA
February 4, 2013
Return School’s MSA Testing Schedule
February 22, 2013
Standard-sized MSA Test Books, Examiner Manuals Delivered
to Schools
February 13-19
Braille, KurzweilTM, and Large Print Delivery to Schools
February 20-27
Send Request for Additional Test Materials to OAA
February 19-March 15
Additional Materials Ready for Pick-up (Start Date)
February 25
Primary Reading MSA Testing (paper)
March 5-6
Make-up Reading MSA Testing (paper)
March 7, 8,11
March 7-8
MSA Scorable Pickup #1
BALTIMORE CITY
PUBLIC SCHOOLS
MSA 2013 Key Dates
8
Primary Mathematics MSA Testing
March 12-13
Make-up Reading/Mathematics MSA Testing
March 14, 15, 18, 19
MSA Scorable Pickup #2
March 14-15
AOP Schools return all materials to OAA
March 19
MSA Scorable and Non-scorable Pickup #3
(FINAL)
March 20-21
Return School Group List to OAA
March 20
Return Non-Participant List to OAA
BALTIMORE CITY
March 20
PUBLIC SCHOOLS
What is New for 2013
9
 No Mod-MSA Assessment
 Two Examiner Manuals for MSA Reading





(Grades 3-5 and Grades 6-8)
MSA Reading to offer online tests for grades 5 & 7
MSA Reading test window extended for online only
Header Sheets separated by content area
Several updated appendices
Scan Tracks- barcode scanning of secure materials
BALTIMORE CITY
PUBLIC SCHOOLS
MSA 2013 Testing Window
10
 Primary Window – March 4-13, 2013
 Make-up Window – March 14 -19, 2013
 MSDE requires LEAs to have grade and content-
specific testing schedules.
 Each content administered in 2 days.
 Approximately 2-1/2 hours on day 1, and
2 hours on day 2 (including prep time and
breaks)
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 2 - 3
MSA 2013 (Paper & Pencil)
City Schools Schedule
MON
4
11
Reading
Make-up
TUES
March
WED
THUR
FRI
5
Reading
Grades 3-8
6
Reading
Grades 3-8
7
Reading Makeup
8
Reading
Make-up
12
Math
Grades 3-8
13
Math
Grades 3-8
14
Reading/Math
Make-up
Grades 3-8
15
Reading/Math
Make-up
Grades 3-8
22
18
Reading/Math
Make-up
19
Reading/Math
Make-up
BALTIMORE CITY
20
Online Reading
Grades 5 and 7
11
21
Online Reading
Grades 5 and 7
PUBLIC SCHOOLS
Online Reading
Grades 5 and 7
Handling Accommodations
12
 Not Having Enough Personnel to Handle
Accommodations - (TACM page 105,
Appendix W, FAQ’s)
 If a school absolutely does not have sufficient
staff to administer the accommodations
required during the primary administration,
the remaining untested students must be
tested during the make-up window.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM page 105
No Mod MSA for 2013 - Grades 3-8
13
 Students in grades 3-8 who have been
identified through the IEP process as eligible
for Modified Assessment will be administered
the MSA with the appropriate accommodations
specified in their IEP.
BALTIMORE CITY
PUBLIC SCHOOLS
MSA 2013 Student Participation
14
 ALL students in grades 3-8 must participate in the
MSA .
 Students with significant cognitive disabilities may
be eligible to participate in the Alt-MSA. Alt-MSA
criteria on page 71 of TACM.
 Excusing students from the test administration
must be done when absolutely necessary, as a last
resort. Procedures for excusing students are
outlined in the MAM. All local school systems must
submit a reason to MSDE for any student that is a
non-participant.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 6
MSA 2013 Participation Policy
15
 Maryland calculates actual rates of students who
take the test.
 Schools are accountable to ensure that not only for
student achievement on MSA testing, but also to
show AMO progress of student participation as
measured at each grade, in each content, and by
each disaggregated subgroup.
 Each school must minimize the number of
students that are absent during testing or are
excused from testing.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 6
Student Participation English Learner (EL)
16
For MSA Reading:
 EL students in their first year of enrollment in a
U.S. school may substitute their score on the
English Language Proficiency Test for the MSA
or Mod-MSA Reading test.
 EL students must participate in the MSA Reading
test starting in their second year of enrollment in
a U.S. school.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 7
MSA 2013 Participation EL Students
17
For MSA Mathematics:
 EL students must participate in MSA
Mathematics testing, regardless of how recently
they entered the U.S. educational system.

Participation is defined as allowing the student to
attempt the test for a least 20 minutes.

If after 20 minutes the test examiner determines that
the student does not possess sufficient English fluency
to be able to continue testing, the test administration
for that student may be concluded.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 7
MSA 2013 Non-Participation
18
 All local school systems are required to submit a
reason to MSDE for any student that is a nonparticipants in MSA and Alt-MSA.
 OAA is providing a form to collect this data.
 STC’s are enter student’s name, pupil number,
grade and the reason the students did not
participate on the form .
BALTIMORE CITY
PUBLIC SCHOOLS
MSA 2013 Non-Participation
19
BALTIMORE CITY
PUBLIC SCHOOLS
MSA 2013 Participation
20
 Students must sit for both days of testing.
 If a student does not sit for both days of testing
because of an absence, then
 Paper testers: The test material must be invalidated
and returned with non-scorable material.
BALTIMORE CITY
PUBLIC SCHOOLS
MSA 2013 Test Materials Format
21
 Combined Test/Answer Books for each content
area in all grades. No separate answer sheets.
Student write in Test Book.
 MSA Reading and Math have 2 forms .



Reading forms are numbered 1 and 2.
Math forms lettered A and B.
Unique cover picture for each grade for
ease of identification
The
 Examiner’s Manuals


Reading: Grades 3-5 and Grades 6-8
Mathematics: All grades 3-8 in one EM.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 3
MSA 2013 Test Book Contents
22
 Reading Items
 Selected response (multiple choice)
 Constructed response (short answer)
 Mathematics Items
 Selected response
 Constructed response
 Student-produced response
(gridded, beginning in grade 7)
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 3 - 4
Writing in the Test Book
23
 Students may write lightly in books
 No highlighters (colored pencils can be used)
 No interference with answer bubbles or track
marks on edges of pages
 Beware of stray markings on or near answer
bubbles
 Multiple marks may cause question to be scored as
incorrect
 Students should mark only the correct answer to a
test question. Do not strikethrough to eliminate
incorrect answers.
BALTIMORE CITY
PUBLIC SCHOOLS
Student Accommodations
24
 There are large-print, Braille, and Kurzweil
TM
testing
materials. Reading Form 1; Mathematics Form A.
 Student responses must be transcribed into a standard-
size Test Book for all students using large-print or TM
Braille Test Books, and all students using Kurzweil
who have a transcription accommodation.
 Complete the “Tested with Accommodations” field on
the demographic sheet
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 8 - 11
Student Accommodations(cont.)
25
 Verbatim Reading
 Live
verbatim readers can be used as long as the
Verbatim Reading Accommodation is prescribed in
student’s IEP, Section 504 Plan, or EL Plan
 Any
form may be used, it must be the same form for
the group of students being tested.

It does not have to be Reading Form 1, or
Mathematics Form A. (page 104, Appendix W,
FAQ)
BALTIMORE CITY
PUBLIC SCHOOLS
Student Accommodations(cont.)
26
•Mathematics Verbatim Reading Rules
–
Specific rules for proper reading of numbers and
symbols on the math tests.

(page90-92, Appendix M)
Numbers over 100 do not include the word
“and”
Example:
115 is read “one hundred fifteen.”
115 is not read “one hundred and fifteen.”
BALTIMORE CITY
PUBLIC SCHOOLS
Student Accommodations(cont.)
27
 Providing Accommodations
 Be
certain test examiners and proctors know the
accommodations that must be provided to
individual students.
 Know how to administer specific accommodations.
 Where will student who requires a “verbatim
reading” accommodation take assessment.
 Where will a student with “extended time”
accommodation continue assessment?)

A list of student accommodations must be maintained by
STC. This list must be in each testing room during the
test administration.
BALTIMORE CITY
PUBLIC SCHOOLS
Student Accommodations(cont.)
28
 Scribe Response Accommodation
 This
must be administered so that other
students are not able to hear the
accommodated student’s response
BALTIMORE CITY
PUBLIC SCHOOLS
Student Accommodations(cont.)
29
 Refusal of Accommodations

If a student refuses an accommodation
listed in his or her IEP, 504, or EL Plan, the
school must document in writing that the
student refused the accommodation. The
accommodation must be offered and remain
available to the student during the test
administration.
BALTIMORE CITY
PUBLIC SCHOOLS
Student Accommodations(cont.)
30
 Unique Accommodation Requests

Must be approved by the local Director of
Special Education or Local English as
Second Language (ESOL) Manager, the LAC,
and MSDE.
BALTIMORE CITY
PUBLIC SCHOOLS
Student Accommodations(cont.)
31
 Emergency Accommodations

If prior to or during testing the school
principal (or principal’s designee)
determines that a student requires an
emergency accommodation, the Emergency
Accommodation Form for State Assessment
must be submitted to the OAA for approval.
BALTIMORE CITY
PUBLIC SCHOOLS
Student Accommodations(cont.)
32
 Emergency Accommodation Form
BALTIMORE CITY
PUBLIC SCHOOLS
Student Accommodations(cont.)
33
 Not Having Enough Personnel to Handle
Accommodations - (page 105, Appendix W,
FAQ’s)
 If a school absolutely does not have
sufficient staff to administer the
accommodations required during the
primary administration, the remaining
untested students must be tested during the
make-up window.
BALTIMORE CITY
PUBLIC SCHOOLS
Prohibited Aids
34
 Prohibited instructional aids must be removed or
covered up in each testing room.
 Define terms in the MSA or State Curriculum.
 Give answers to test questions or
 Direct student responses to test questions.
 Students with ELL, IEP, or 504 plans follow the
guidelines set forth in their plans as defined by the
MAM.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 20-21
Prohibited Aids
35
TACM p. 20
BALTIMORE CITY
PUBLIC SCHOOLS
Procedures for Testing Home Schooled
•
•
36
Home schooled students are entitled to participated in
MSA testing.
Bubble in demographic information except School
Number.
•
Home schooled student’s test books are returned with
your scorable materials.
•
Bundle separately with paper band. Write on band Home
Schooled.
•
Complete the Home-Schooled Student Information
Sheet. Appendix P, page 95.
•
Return the Student Information Sheets to OAA.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 23-24
Home-Schooled Student Information Sheet
37
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 95
Make-up Testing
38
If make-up testing is necessary:
 Use the make-up box on the front cover of the Test
Book to track make-up needs
 Don’t wait until the “official” make-up window to
administer the test if you are able to do so at an earlier
date
 Use the same Test Book that the student used during
the regular administration (unless damaged)
 Completed make-up tests may be returned to Pearson
during the appropriate MSA pickup windows
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 47
Split Test Books
39
Process :
 If a paper test book is sent back to Pearson
prior to being complete, please contact OAA
immediately. OAA who will contact MSDE to
have Pearson retrieve the test book.
 Deadline to contact OAA is March 19
 Upon MSDE approval, Pearson will retrieve
and return a facsimile of the test book to the
school for transcription
 Transcription must be completed and shipped
to Pearson with 48 hours of receipt.
BALTIMORE CITY
PUBLIC SCHOOLS
Student Transfers During Testing
40
Process Change:
 Students Who Transfer Within Baltimore City
STC of receiving school notifies OAA and transferring
school’s STC immediately upon arrival of student
 STC of transferring school must notify receiving school
of the form(s) and subject(s) that need to be completed
 Student must complete test using SAME FORM
 OAA securely transports partially-completed Test Book
to receiving school
 Student can use either original test book or test in
another Test Book (Same form) requiring STC to
transcribe Day 1 responses into new Test Book.

BALTIMORE CITY
PUBLIC SCHOOLS
TACM 32-33
Student Transfers During Testing
41
 Students Who Transfer Outside Baltimore City
 The original Test Book is NOT to be transferred out of
the school STC of receiving school notifies initial school
of transfer and determines which content(s) has been
completed.
 STC of transferring school must invalidate the Test book
if only DAY 1 was completed and return to Pearson with
non-scorables. If student completed a test before
transferring, return test with scorables.
 Transferred student must take an entire test at the new
school, if only partial testing was done at old school.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM 33
MSA 2013 Materials from Pearson
42
 Test Materials will be delivered by UPS
February 13-19, 2013.
TM
 Braille, large-print, and Kurzweil materials will
arrive in schools between February 20 -27.
 All Braille, large-print and KurzweilTM materials will
arrive as shrink-wrapped kits with a standard-sized
Test Book.
The
standard-sized Test Book is to be use to transcribe answers.
BALTIMORE CITY
PUBLIC SCHOOLS
MSA 2013 Testing Materials
43
Provided by Pearson
 Examiner’s Manuals:


Reading: Grades 3-5 and Grades 6-8
Mathematics: Grade 3-8One (1) per
content area for grades 3-8
 TACM
 Two (2) sets of pre-printed ID
labels
 Header Sheets
 Student Test Books
 Special accommodation materials



Provided by School
or Student
No. 2 pencils with erasers
Blank scratch paper
Rulers, protractors,
Compasses, calculators, as
required
 A sign for the door that says:
Testing-Do Not Disturb
 A digital clock or a watch or a
clock with a second hand




Large Print
Braille
Kurzweil CD
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 18
MSA 2013 Testing Materials
44
 To minimize the chance that
students miss a STOP or GO
On sign in the Test Book
 Samples of these symbols
must be shown and explained
to students before testing.
 Samples are also in the
Examiner's Manuals
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 76
MSA 2013 Materials from Pearson
45
 One continuously numbered shipment. (1of 5
etc.)
 Standard-size Reading Test Books and
Examiner’s Manuals
 Standard-size Mathematics Test Books and
Examiner’s Manuals
 Security Checklist
 Test Coordinator Kit (TCK) – located in Box 1
 TCK
Contents – Student Preprinted ID labels,
Header Sheets, Return labels: scorable (orange),
non-scorable (green), Bill of Lading forms, paper
bands
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 38
Request for Additional Materials
46
If additional materials are
needed, complete the
Additional Materials
Request Form and submit
to OAA.
Materials will be ready
for pick-up starting
Monday, February 25
BALTIMORE CITY
PUBLIC SCHOOLS
Test Materials – Apply Student Pre-ID Labels
47
 Schools are provided with two sets of preprinted student
ID labels (shown below) – one for each content area
Apply on back
Spare Label
(demographic)
page of Test Book
If you make a mistake, do NOT apply one label over another! Use the spare label on a
new Test Book
and invalidate old Test Book.
TACM p.42
47
BALTIMORE CITY
PUBLIC SCHOOLS
Copyright ©
2011 Pearson
Test Materials – Apply Student Pre-ID Labels
48
 Labels will be sorted by grade, by test group, then
alphabetically by student’s last name
 Labels are interchangeable between content.
TACM p.42
48
BALTIMORE CITY
PUBLIC SCHOOLS
Copyright ©
2011 Pearson
Sample Demographic Sheet
49
Place the Pre-ID label in
the box. (Place Pre-ID
Label Here)
Bubble in Yes on the
Demographic page, if
the student was tested
with an accommodation.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 42 and 86
Students Without PreID Labels
50
• There are no generic labels
• The Test book 10 digit
Security Barcodes number
(found on front cover of test
book) will be entered into
PearsonAccess.
• Write the Students name
and date of birth at the top of
the Test Book
• No gridding/bubbling of
Demographics
BALTIMORE CITY
PUBLIC SCHOOLS
Students Without PreID Labels
51
Important Note
•
•
•
•
•
When entering the security barcode number, you must
enter a 10-digits
On the security checklist only 9 digits of the test book
appear.
You will have get the last digit from the actual test book.
Students from other Baltimore City schools or other
Maryland county schools have to be moved to your school
by OAA in PearsonAccess.
Send name and pupil number for these students to
Carol Wilson via email ( cwilson@bcps.k12.md.us)
BALTIMORE CITY
PUBLIC SCHOOLS
Students Without PreID Labels
52
Logins for PearsonAccess
• Logins will be created and passwords will be reset
for those who have a login
• You will received an email from Pearson, by
February 3 to create your password
BALTIMORE CITY
PUBLIC SCHOOLS
Students Without PreID Labels
53
• Log into PearsonAccess (www.pearsonaccess.com)
• Select the Test Management tab at the top of the page
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 42
Students Without PreID Labels (cont.)
54
• Select Student Registration
• Use the search functionality to locate the student in
PearsonAccess
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 44
Students Without PreID Labels (cont.)
55
• Select the student by clicking on the student’s name
• Select Assigned Tests
• Select MSA
Reading and/or Math as
appropriate
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 44
Students Without PreID Labels (cont.)
56
• Select Edit in the upper right-hand corner
•
•
•
•
Type the secure barcode number into the Security Barcode
field
Select Save and verify that the secure barcode was entered
correctly
Write the student’s name and DOB on the Test Book cover
You do not need to grid any demographic data for the student
1st
2nd
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 45
Other Important Notes – PreID (cont.)
57
• Do not save any unused PreID labels after the test
administration window has closed
• Return unused PreID labels with non-scorable
material at the end of testing
• When returning non-scorable Test Books that have
PreID labels applied, remember to invalidate the
Test Book by drawing a slash across the
demographic page in permanent marker.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 43
Testing Irregularities
58
Test Books Soiled with Bodily Fluid
 Stop testing
 Record time left in session
 Remove students
 Clean area
 Dispose of soiled materials appropriately – send to ALL-Shred
 Provide new Test Book (use same form)
 Re-start testing
 Ensure PreID label is applied to new Test Book or complete
procedure for students without PreID labels in PearsonAccess
 Complete Damaged Testing Material Report
 Record barcode of Damaged Book
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 21-22
Testing Irregularities (cont.)
59
Damaged Test Book (other than with bodily fluid)
• Collect damaged Test Book
• Replace book with same form of new Test Book
 Continue testing, instruct student to start where he/she left
off
 Transcribe answers from damaged book into new book
 Apply new PreID label to new book or complete barcode entry
procedure in PearsonAccess
 Invalidate damaged book
 Record barcode of Damaged Book
 Return damaged book to Pearson with non-scorables
 Complete Damaged Testing Materials Report
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 22
Damaged Testing Materials Report
60
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 93
Invalidation Procedure
61
 If you have test materials (a Test Book with Pre-
ID label attached) for a student who was absent
and did not test, you must invalidate the Test
Book and return it to Pearson with your nonscorable materials.
 Failure to invalidate the book will result in a
non- participating student receiving the lowest
obtainable scale score (LOSS), rather than simply
being counted as a non-participant.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p49
Invalidation Procedure
62
Invalidate the test
book by drawing a
slash across the student
demographic page with
a permanent marker
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 6, 48
Prepare Materials for Scoring
63
After testing a content area and before
returning materials to the STC, the Test
Examiner (TE) must:
 Ensure all materials are accounted for
 Separate secure from non-secure materials
 Separate Home-schooled student materials (if
applicable)
 Ensure each Test Book has a PreID label applied to the
demographic page
 Ensure secure barcode entry is completed in
PearsonAccess for students without PreID labels
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 48-49
Prepare Materials for Scoring (cont.)
64
Invalidate used but non-scorable Test Books, as necessary
Complete Tested with Accommodations bubble on
the demographic page as appropriate
Check each Test Book page to be sure:







There are no stray marks in the bubble or track mark areas
Completed answer bubbles are sufficiently dark (DO NOT fill in bubbles
for incomplete questions)
Check that answers have been transcribed from special
accommodation Test Books to standard-size Test Books
Complete an MSA Header Sheet for all scorable groups
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 49
Completing the MSA Header Sheet
65
 Complete a Header Sheet for each test group by



•
subject and grade.
Count the number of scorable Test Books in the
group.
Complete boxes 1 - 5 according to the instructions on
the MSA Header Sheet (See TACM, page 94,
Appendix O)
Place MSA Header Sheets on top of scorables group
and secure with a paper band.
Be sure Box 5 indicates the number of scorable Test
Books in the group
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 48
MSA 2013 Header Sheet
66
TACM p. 94
BALTIMORE CITY
PUBLIC SCHOOLS
Complete School/Group List
67
BALTIMORE CITY
•
Complete a School
Group List, include
each teachers name and
number of test in the
group.
•
Send the completed
School Group List to
OAA.
PUBLIC SCHOOLS
Scorables vs. Non-scorables
68
When preparing materials for return to Pearson
after each content testing window, remember:
Scorables
Non-scorables
• Used Test Books
• Standard-size transcribed
Test Books (from LP, Braille,
and/or Kurzweil administrations)
THAT’S ALL!
NOTES: Each group of scorables
must have a completed MSA Header
Sheet on top!
You can mix grades and content
areas in a shipment.
• Unused Test Books
• Invalidated Test Books
• Used and unused Braille Test
Books
• Used and unused large-print
Test Books
TM
• All Kurzweil CDs
• Unused PreID labels
• Unused Bills of Lading
TM
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 49-52
MSA 2013 Packing Scorables
69
Once scorables are ready for
packing and shipping:
• Use original boxes, if possible
Place banded groups of Test
Books in boxes.
• Affix orange label(scorable
(MSA ) to the outside of each box
• Seal each box
• Complete one (1) Bill of Lading
for each pickup wave
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 50
MSA 2013 Packing Non-scorables
70
 When testing is complete and testing materials are not
needed for make-up testing, group and paper-band nonscorables (see “Scorables vs. Non-scorables” slide)
 Be sure invalided and/or unused Test Books are separated
by content and grade.
 Affix green (MSA ) non-scorable labels to outside of each
box
 Seal each box
Discard TACMs and Examiner’s Manuals at the
school; do NOT return them to Pearson.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 51
MSA 2013 Completing Orange/Green Labels
71

After all boxes are packed, sealed, and the
appropriate shipping labels are applied, fill in
any missing information on the orange and
green labels.

Fill in the blanks to indicate the box number
and total number of boxes being returned in
each of shipment. Tally scorables and nonscorables separately.

School information will be pre-printed on
labels provided in the TCK

Please contact OAA if you do not have the
appropriate return labels.

Do not use prior year return labels
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 51, 96
MSA 2013 Final Packing / Shipping Notes
72
Key points when packing and shipping
materials:
1.
Do not mix scorables and non-scorables in the same box.
2. Scorable and non-scorable material may be returned during
the same pick-up as long as they are in their own labeled
boxes.
3. You can mix content areas and grades in a shipment.
Include Home-schooled scorables with your scorable
material, but bundle seperately.
5. Complete an Bill of Lading form for each pick-up.
4.
6. Send home Schooled Information Sheet to OAA.
BALTIMORE CITY
PUBLIC SCHOOLS
K2 Logistics Bill of Lading
73
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 97
MSA 2013 Testing Material Pickup
74
K2 Logistics will make THREE (3) pickups at each
testing location.
•
As a reminder, K2 Logistics will contact each
location at least two (2) days prior to pickup.
Event
Dates
Pickup #1 (MSA )
March 7-8
Pickup #2 (MSA )
March 14-15
Pickup #3 (MSA )
March 20-21
It is critical for timely reporting that scorable materials are returned
as soon as they are available!
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 52
Contacts
75
Organization
Contact Information
Achievement &
Accountability (OAA)
Phone: 410-396-8962, 410-396-8956
Fax: 410-39410-6-8627
Carol Wilson- cwilson@bcps.k12.md.us ;
James Gresham - jgresham@bcps.k12.md.us
Pearson Customer Support
Center
(888) 639-0690 between 7:00 a.m. and 6:00 p.m. EST
Maryland@support.pearson.com
Docushare: LAC/STC Folders
http://docushare.msde.state.md.us/docushare
MSDE – Assessment Branch in
the Division of Accountability
and Assessment
(410) 767–0083
msa@msde.state.md.us
PearsonAccess
www.pearson.access
ALL-Shred (for disposal of
testing materials soiled with
bodily fluids)
4831 Winchester Blvd.
Frederick, MD 21703
(301) 874-1480
K2 Logistics
(materials return)
1-888-886-0780,
pickup@k2assessments.com
BALTIMORE CITY
PUBLIC SCHOOLS
MSDE Docushare Website
76
2013 MSA Administration Clarifications and Updates
http://docushare.msde.state.md.us/docushare
User names:
Password (case
sensitive)
STC Folder
lea30elema1
lea30elema2
lea30elema3
lea30elema4
30MSApass
lea30elema5
lea30elema6
lea30elema7
lea30elema8
MSA
BALTIMORE CITY
PUBLIC SCHOOLS
MSA 2013 Science Key Dates
77
Event
Date
Test Materials Delivered to Schools
March 20-22, 2013
Send Request for Additional Materials
April 10 – May 1
Testing Window (Online)
April 8-26, 2013
Testing Day 1 (Paper and Pencil)
April 10
Testing Day 2 (Paper and Pencil)
April 11
Make-up days
April 12, 15-19,
22-26
Pick-up
April 12-24
BALTIMORE CITY
PUBLIC SCHOOLS
Scan Tracks
78
• In an effort to maintain security and
accountability of secure testing materials OAA
and School Test Coordinators will be using the
scanning system, ScanTracks, supported by
MSDE and the Sidus Group.
•
Office of Information and Technology (ITD) will
load the software File-Maker Pro to STCs
computers.
• ITD will also be at each school to ensure the
software has been loaded properly.
BALTIMORE CITY
PUBLIC SCHOOLS
Scan Tracks
79
Hand Held Bar Code Scanner
BALTIMORE CITY
PUBLIC SCHOOLS
Scan Tracks
80
•
Scanning the Test book
10 digit Security
Barcodes number
(found on front cover of
test book)
BALTIMORE CITY
PUBLIC SCHOOLS
Scan Tracks
81
 ScanTracks Support (support @scan-tracks.com)
STCs will receive an email form ScanTracks Support
entitled First Contact
 STCs will be provided passwords, materials ship date, and
file download availability.

LEA ID: 30
 School ID: XXXX
 Passwor:x xxxxxxx

BALTIMORE CITY
PUBLIC SCHOOLS
Scan Tracks
82
 Web-ex Training for ScanTracks – Conducted
by Sidus Group
February 5, 2013 – at 1:30 PM
February 7, 2013 – at 10:30 AM
February 12, 2013 – at 1:30 PM
• Specific instructions for these will be coming from
Vincent Hardick of Sidus Group.
• The training sessions will be recorded for those
who are not available for these three dates.
BALTIMORE CITY
PUBLIC SCHOOLS
83
2012-13 Maryland School Assessment
Test Integrity Plan
James Gresham, Ed.D.
Coordinator of Assessments and
Security Investigations
jgresham@bcps.k12.md.us
BALTIMORE CITY
PUBLIC SCHOOLS
Maryland School Assessments (MSAs) Context
84
Purpose for Monitoring MSA Administrations
 Compliance with COMAR statutes
 Address the increasing concern on test integrity
 Ensure that schools are adhering to MSDE test administration guidelines
Background on MSA
Administered Spring
 Reading and Math Paper and Pencil, Grades 3-8
 Reading Online, Grades 5 and 7
 Science, Grades 5 and 8
Content Areas Assessed
 Reading, Mathematics, and Science
Number of City Schools Participating
 162
BALTIMORE CITY
PUBLIC SCHOOLS
City Schools 2013 MSA Schedule
(Paper & Pencil)
MON
4
TUES
March
WED
THUR
FRI
5
6
7
8
Reading
Grades 3-8
Reading
Grades 3-8
Reading
Make-up
Reading
Make-up
11
12
13
14
15
Reading
Make-up
Math
Grades 3-8
Math
Grades 3-8
Reading/Math Reading/Math
Make-up
Make-up
Grades 3-8
Grades 3-8
18
19
Reading/Math
Make-up
Reading/Math
Make-up
20
21
Monitors meet
Principals/ STC
BALTIMORE CITY
85
PUBLIC SCHOOLS
22
12 Tips for Principals
86
1.
2.
3.
4.
5.
Principals can NOT serve as STC
Work with your STC to develop a well thought out
testing plan (envision your plan)
Make sure that your STC attends the district MSA
trainings prior to each administration
Participate in your staff MSA trainings (view and
discuss CEO’s video on Test Integrity
Make sure that all person participating in the
administration have been trained.
BALTIMORE CITY
PUBLIC SCHOOLS
12 Tips for Principals
87
6. Make sure your STC keeps a copy of signed
7.
8.
9.
10.
Training Certifications and Student Tracking forms
on file for 6 years
Make sure your STC immediately inventories
testing materials (report discrepancies )
Make sure your STC Tracking Record to account
for, and secure test booklets at all times.
Work collaboratively with monitors
Make sure that your STC is prepared to seal boxes
at end of the day
BALTIMORE CITY
PUBLIC SCHOOLS
12 Tips for Principals
88
11. Make sure that all test books are returned on time
12. When in doubt call OAA (410)396-8962
BALTIMORE CITY
PUBLIC SCHOOLS
School Testing Plan
TIME YOU WANT
THE MONITOR
TO REPORT
Maryland School Assessment (MSA)
School Name and #: Anywhere Ele School #122
Grade
Ex: 3
Subject
Reading
Examiner
(Must Be
Certified
Employee)
J. Gresham
Proctor
C. Wilson
Daily Start Time: 9:00am
Room
203
Phone: 410-555-1212
Thurs.
Testing With
Tues.
Wed
March 7
Accommodations March 5 March 6
Make-up
No
X
Test Coordinator’s Signature:_____________________________________ Date ___________________
Principal’s Signature ____________________________________________Date ___________________
Please return this form to James Gresham: JGresham@bcps.k12.md.us by February 22, 2013
BALTIMORE CITY
PUBLIC SCHOOLS
Inventory Test Materials
90
 Also verify that only your school’s boxes are in
the shipment. Do not accept/sign for boxes
belonging to another address. Have the
courier take the box for re-routing.

BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 38
Inventory Test Materials (cont.)
91
 If possible, inventory boxes while courier is present
 If you are missing a box:

Inventory boxes 1 of X, 2 of X, etc. and note missing box
number(s)

Alert courier, if possible, to the missing box number(s)

Check PearsonAccess website to confirm delivery of the
box(es)

If the box(es) do not arrive within 2 days of the initial
shipment, contact the Pearson Customer Support Center.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 39
Inventory Discrepancies
92
If you encounter a discrepancies during
the inventory process:


Complete the Testing Materials Inventory
Checklist (TACM, page 79, Appendix F)
Contact Pearson immediately; you may be asked
to fax a copy of the Testing Materials Inventory
Checklist
Pearson
1-888-639-0690
7am – 6 pm EST
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 39
Inventory Checklist
93
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 79
Test Security
94
What are secure materials?
 Student Test Books –used and unused, standardsized and special accommodation
TM
 Kurzweil
CDs
 Used scratch paper
 Examiner's Notes for Braille
 School or district staff are prohibited from
studying or discussing test items in any manner.
TACM p. 12
BALTIMORE CITY
PUBLIC SCHOOLS
Test Security
95
What are non-secure materials?
 TACM and – Examiner’s Manuals
 Unused preprinted student ID labels
 Shipping labels – Bills of Lading & colored return
labels
 Unused MSA Header Sheets
 When not in us ALL materials must be kept
under lock and key!
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 12 - 13
Test Security
96
Non-Secure materials may be used at any time by STC
and TE for training
STCs have access to secure and non-secure materials to
prepare materials and training sessions for Test
Examiners. STCs may open packages of student Test
books to inventory and prepare materials for
distribution to TEs.
TEs are not permitted to have access to secure paper
and online testing materials prior to the scheduled
test date.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 12 - 13
Test Security
97
 Non-certified staff: May have access to secure
materials for clerical purposes as approved by the LAC
and only if supervised by the STC. Non-certified staff
may perform activities such as taking inventory of
materials or applying preprinted student ID labels to
Test Books.
Materials may NOT be copied.
Materials are NOT available to proctors or members of the
general public.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 12 - 13
Test Security
98
Secure materials are available to:
 TEs on the day of the scheduled test date
 Staff providing certain accommodation may need
access to secure materials prior to the first day of
testing in order to prepare their accommodations.
 STC must contact OAA to determine if a specific
accommodation warrants the review of a Test Book
prior to the first day.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 13
Test Security
99
 When not in use ALL materials must be kept under
lock and key!
 ALL materials must be returned to the STC each day
 STCs can use the School Security Checklist or the
Daily Test Materials Tracking Record to check
in and check out materials on a daily basis.
 TEs must account for materials BEFORE and AFTER
testing
 Any security breach MUST be reported to the school
principal, OAA, and MSDE
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 17
Testing Documentation – COMAR
Compliance with 13A.03.04
100
 Students should only receive accommodations noted in
their IEP, ELL, or 504 plans.
 Anyone having access to test materials must sign the Test
Administration and Certification of Training Form and
Non-Disclosure Agreement
 Each TE must be provided The Test Archive Student
Tracking Form (Appendix V)
 Record ten-digit security barcode number and test form
number/letter and sign to confirm all student returned
testing materials
 STC and TEs must sign one for each test group
including one-on-one accommodated administrations
and all make-up sessions(for both paper and online)
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 9-11
Testing Documentation – COMAR
Compliance with 13A.03.04
101
 All testing documentation must be retained for
six years after date of test administration.
 Test
Administration and Certification of
Training Form and Non-Disclosure Agreement
 Sign-in
 Test
sheets from training session
Archive Student Tracking Form
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 9-11
Daily Tracking Record
102
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 88
School Security Checklist
103
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 80
Test Archive : Student Tracking Form
104
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 103
Eligible School Test Coordinator(STC)
105
Must be an employee of the local school system and
have a valid MSDE professional school staff certificate:
 Principals are NOT eligible to serve as the STC.

Academic classroom teachers
 Teachers who teach in Special Education, Gifted, and
Talented, and EL programs


Physical education teachers, PE, art, health, technology
ed. etc.
Media specialists, guidance counselors, school
administrators (other than the Principal), etc.
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 15
Eligible Test Examiners
106
Must be an employee of the local school system
and have a valid MSDE professional school staff
certificate:
 Academic classroom teachers
 Teachers who teach in Special Education, Gifted, and
Talented, and EL programs

Physical education teachers, PE, art, health, technology
ed. etc.
Media specialists, guidance counselors, school
administrators, etc.
 Retired teachers who may be working as instructional
assistants, aides, or regular substitutes

BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 16
Eligible MSA Proctors
107
Proctors can be:
 Non-certified instructional assistants and aides (e.g.,
student teachers)
 State-certified teachers who are not employed by the
district
Proctors can assist by:
 Helping to distribute and collect testing materials
 Circulating and observing during testing
 Ensuring students working on correct section
 Ensuring students using allowed materials during testing
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 17
Monitoring Plan
108
 All schools will be monitored for monitoring;
 Work
collaboratively with monitor
Review your schools test plan and training
certification forms
Conduct classroom observations
 Monitor will not assist with test administration
 Be prepared to pack test books immediately after
testing
Observe daily packing and opening of used test
books
BALTIMORE CITY
PUBLIC SCHOOLS
Monitoring Plan
109
Work collaboratively with monitor and supervisor
 Review your school’s test plan and training certification
forms
 Conduct classroom observations
Be prepared to pack test books immediately after
testing
 Observe daily packing and opening of used test books
Monitors will not assist with test administration
BALTIMORE CITY
PUBLIC SCHOOLS
Post Test
110
The School Test Coordinator is responsible for conducting training for Test Examiners.
____ True
_____False
2. The School Test Coordinator should confirm that all boxes listed on the courier’s shipping
invoice have been received before signing for the delivery.
1.
_____ True
_____False
3. The School Test Coordinator can erase a student’s response to a question on the test if
he/she is sure that the student knows the correct answer.
_____ True
_____False
4. All students in grades 3-8 must participate in either the MSA , or Alt MSA.
_____ True
_____False
5. If there’s not enough personnel to handle testing accommodations, we just make do.
_____ True
_____False
BALTIMORE CITY
PUBLIC SCHOOLS
Post Test (cont)
111
6. It is required for a MSA Test Examiner to have a valid MSDE professional school staff
certificate.
_____ True
_____False
7. MSA Test Proctors can be student teachers or state-certified teachers who are not employed
by the district.
_____ True
_____False
8. Students who are disruptive during testing can be removed from the classroom to take the
test somewhere else.
_____ True
_____False
9. Teachers are permitted to cue regular educations students to select correct answers while
testing.
_____ True
_____False
10. Teachers can read the question aloud for the child, if they have difficulty reading the
passage.
_____ True
_____False
BALTIMORE CITY
PUBLIC SCHOOLS
Post Test (cont)
112
11. As the School Test Coordinator , you can return student test books after the MSDE deadline
for returning materials.
_____ True
_____False
12. Teachers can have access to student test books at anytime during the testing window.
_____ True
_____False
13. Principals, Assistant Principals, and school-level Chairpersons are prohibited from viewing
or discussing secure test materials in any manner, either among themselves or with students
before, during, or after testing.
_____ True
_____False
14. All testing materials must be stored in a secure location prior to the test administration.
_____ True
_____False
15. If a student completes a section of the test before the allotted time for that section has
expired, he/she may go back to complete questions missed in previous sections.
_____ True
_____False
BALTIMORE CITY
PUBLIC SCHOOLS
Post Test (cont)
113
16. Test Examiners are NOT required to read directions to the test verbatim.
_____ True
_____False
17. When in doubt about testing administration protocols, the School Test Coordinator should
call Baltimore City School’s Office of Achievement and Accountability at (410)396-8962 for
guidance.
_____ True
_____False
18. School are permitted to start paper and pencil testing on Monday March 4, 2013
_____ True
_____False
19. When the school does not have enough test booklets, the School Test Coordinator is the only
person permitted to make photocopies of test booklet
_____ True
_____False
20. Test Examiners and Proctors are permitted to use their cell phones for texting and emailing
during testing.
_____ True
_____False
BALTIMORE CITY
PUBLIC SCHOOLS
114
Questions or Comments?
BALTIMORE CITY
PUBLIC SCHOOLS
Certification of Training and
Non-Disclosure Agreement
BALTIMORE CITY
PUBLIC SCHOOLS
TACM p. 72
Point of Contact
116
Contacts
Test Security :James Gresham
Coordinator of Assessment and Security Investigations,
at jgresham@bcps.k12.md.us
MSA Administration: Carol Wilson
Director of Assessment
at cwilson@bcps.k12.md.us
OAA-Assessment@bcps.k12.md.us
BALTIMORE CITY
PUBLIC SCHOOLS