2015 California Assessment of
Student Performance and Progress
(CAASPP)
Pre-Test Webcast for Paper-Pencil
Tests
December 17, 2014
1:00 p.m.
Presenters: Michael McDaniel
Copyright © 2012 Educational Testing Service. All rights reserved.
December
December 2014
2015 Pre-Test Workshop | Slide 1
2014
Objectives
Local educational agency (LEA) CAASPP
coordinators will be able to:
• Follow current testing procedures properly.
• Ensure all testing materials are handled securely
and appropriately.
• Train CAASPP test site coordinators to conduct
testing correctly, securely and consistently.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 2
Agenda
•
•
•
•
•
•
•
•
Introductions
Objectives and agenda
New for the 2015 Test Administration
LEA CAASPP Coordinator responsibilities
Accessibility Support Request Form
CAASPP Test Site Coordinator responsibilities
CAASPP Paper-Pencil Tests
California Standards Tests (CSTs) for Science
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 3
Agenda (cont.)
• California Modified Assessment (CMA) for
Science
• California Alternate Performance Assessment
(CAPA) for Science
• Standards-based Tests in Spanish (STS) for
Reading Language Arts (RLA)
• After testing
• Summary
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 4
New for the 2015
Test Administration
Copyright © 2012 Educational Testing Service. All rights reserved.
December
December 2014
2015 Pre-Test Workshop | Slide 5
2014
New for the 2015 Test
Administration
•
Of the CAPA tests, only the CAPA for Science will be
administered. Because this test is administered to
students in grades five, eight, and ten in Levels I and III–
V, there is no test administered in Level II in 2015.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 6
New for the 2015 Test
Administration (cont.)
•
Because orders are placed based on student records in the
California Longitudinal Pupil Achievement Data System
(CALPADS), which means that materials are based on
actual, rather than estimated, enrollments, there is no
longer a need for an excessive order policy, which had
charged LEAs for excessive paper materials ordered if
less than 90 percent of the ordered materials was used.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 7
New for the 2015
Administration(cont.)
•
•
The “Request for Student Data File and Additional
Reports” form, also known as the processing form, is no
longer used because of new online reporting options that
will be available after test administration.
Results and reports are not available on CD because of
new online reporting options that will be available after
test administration.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 8
New for the 2015 Test
Administration (cont.)
•
Because all demographic data originate from CALPADS,
some demographic fields have been removed from
answer documents and test booklets, which has also
caused some answer document fields to be renumbered.
The fields remaining on answer documents are related to
student identification and test conditions.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 9
New for the 2015 Test
Administration (cont.)
• Note: Please review all changes to the answer
documents used for the 2015 CST, CMA, CAPA,
and STS administrations in the Test Administration
Manual, available at http://caaspp.org. (available end
of December)
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 10
LEA and Test Site CAASPP
Coordinator Responsibilities
Copyright © 2012 Educational Testing Service. All rights reserved.
December
December 2014
2015 Pre-Test Workshop | Slide 11
2014
Key LEA CAASPP Coordinator
Responsibilities
• Number One Responsibility—Security
– No unauthorized electronic devices should be used
during testing
 For testing purposes, any electronic device that is not
specifically designated in the student’s Individual
Education Plan (IEP) or Section 504 plan is
unauthorized.
– Security audits will be conducted this year.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 12
Security Audits
•
•
•
At randomly selected LEA offices and schools
Before, during, or after testing
Key Questions:
–
–
Are testing materials secure, accounted for, and
locked up when not in use?
Are correct administrative procedures being followed? For
example:
Instructional materials have been removed or covered.
Students are not being coached through the exams.
Only appropriate Universal Tools, Designated Supports,
and Accommodations are being provided.
No unauthorized electronic devices are being used.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 13
Key LEA CAASPP Coordinator
Responsibilities
• Number Two Responsibility—Train CAASPP
Test Site Coordinators:
– Review archived videos at http://caaspp.org
– Room sign with reminder of no electronic devices
To be posted in clear view of students during testing
Included in coordinator kit
Available on caaspp.org
Can be photocopied
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 14
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 15
Other LEA CAASPP Coordinator
Responsibilities
•
•
•
•
•
Receive, count, store, distribute, track, collect, count and
return test materials.
Coordinate testing schedule.
Coordinate collection of minimal demographic data.
– Pre-ID labels
– Or hand-mark answer documents
Assist CAASPP Test Site Coordinators
Complete Accessibility Support Request Form, as necessary
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 16
Other LEA CAASPP Coordinator
Responsibilities (cont.)
•
•
•
Verify Student Data in CALPADS and Test Assignments in
the Test Operations Management Systems (TOMS).
Use CALPADS to update student demographic data as
necessary.
Assign tests to students through TOMS, which can be
accessed at http://caaspp.org.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 17
Accessibility Support Request
Form
• New for the 2015 Test Administration
• Request new universal tool, designated support, or
accommodation that is not yet listed as approved.
• Approved tools/supports/accommodations will be
added to list.
• Request form is online and available at
http://caaspp.org/administration/forms/.
•
Note: See page 14 of the Paper and pencil Test
Administration manual for more details.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 18
CAASPP Test Site Coordinator
Responsibilities
•
•
•
•
•
•
•
•
Train examiners
Ensure examiners READ and sign affidavits to be retained by
CAASPP test site coordinator
Prevent test administration errors
Secure test materials
Verify test materials are marked correctly to ensure correct
student scores
Guarantee correct enrollment counts
Complete Accessibility Support Request Form, as necessary
Return materials promptly to the LEA CAASPP Coordinator
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 19
CAASPP Test Site Coordinators:
Train Examiners
•
•
•
•
READ and sign security affidavits.
Emphasize NO unauthorized electronic devices.
MAKE SURE CORRECT TESTS ARE ADMINISTERED.
Note:
─
Students who are not testing may not stay in the classroom where a
test is being administered.
─ If students need to be taken to another room to finish testing,
BE SURE THEY ARE ESCORTED BY TEST SITE STAFF.
Do not allow students to walk to another room with test
materials by themselves.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 20
CAASPP Test Site Coordinators:
Train Examiners (cont.)
•
Examiners CANNOT:
– Review test questions before, during, or after testing.
– Check students’ answers including (but not limited to):
1. Advising students of wrong answer or checking
answers; or
2. Withholding answer documents until students
demonstrate they have the right answers.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 21
CAASPP Test Site Coordinators:
Train Examiners (cont.)
• Examiners shall monitor students throughout
testing to make sure students are:
– On the correct part.
– Not going on to other parts or back to a previously
completed part.
– Not skipping a question on their answer document
(so that they are off by one or more).
– Not using unauthorized electronic devices during
the testing session.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 22
CAASPP Test Site Coordinators:
Train Examiners (cont.)
•
Examiners must ensure there is enough time to complete
a part before beginning the part.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 23
CAASPP Paper-Pencil Tests
Copyright © 2012 Educational Testing Service. All rights reserved.
December
December 2014
2015 Pre-Test Workshop | Slide 24
2014
CAASPP Paper-Pencil Tests
•
CSTs for Science
–
•
CMA for Science
–
–
•
Students take grade-level CSTs for Science in grades 5, 8, and
10.
Students take CMA for Science in grades 5, 8, and 10.
Must have an IEP that designates that they will take the CMA
for Science
STS for RLA
–
–
Grades 2–11 RLA
Optional for Spanish-speaking English learners (ELs) and for
English-speaking Spanish learners (purchased separately)
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 25
Before Paper-Pencil Testing
(LEA CAASPP Coordinator)
•
Receive boxes:
–
–
•
All boxes may not come in single delivery.
Before signing receipt, check number of boxes.
Prepare answer documents:
–
–
–
Use only the 2015 scorable answer documents received in the
shipment from the testing contractor.
Provide CAASPP Site Coordinator with information about
which demographics are to be completed.
Ensure correct Non Public School (NPS) code.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 26
Before Paper-Pencil Testing (cont.)
(CAASPP Test Site Coordinators)
•
•
•
Confirm which test(s) each student takes.
Confirm any Universal Tools, Designated Supports, and
Accommodations students will use and where they will be
tested.
Prepare materials:
–
–
–
–
Test booklets
No. 2 pencils
Scratch paper
Signs (Example: No Unauthorized Electronic Devices)
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 27
Before Paper-Pencil Testing (cont.)
(CAASPP Test Site Examiners)
•
Use Directions for Administration
(DFAs) correctly.
– Read ALL “SAY” boxes exactly as
written.
– Be sure to read and complete “First Day of
Testing” section with students.
– ONLY translate boxes with “T” (NO
CST/CMA/STS questions, prompts, or
passages may be translated).
– Grades 9−11 are in single DFA
for each test: CST, CMA, and STS.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 28
Before Paper-Pencil Testing (cont.)
(CAASPP Test Site Examiners)
•
•
Apply Pre-ID labels.
Check names on test booklets and answer documents
before distributing to make sure students receive correct
documents.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 29
At Start of Testing
(CAASPP Test Site Examiners)
Section 1
• Note:
–
–
All students must complete box number 1 of the answer
document, even if Pre-ID was used.
Students should mark the correct test version number.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 30
During Paper-Pencil Testing
(CAASPP Test Site Examiners)
•
•
•
Monitor for use of unauthorized electronic devices.
Make sure students are taking the correct test and marking
answers in the correct section of the answer document.
Ensure students complete all parts of each test.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 31
During Paper-Pencil Testing (cont.)
(CAASPP Test Site Examiners)
•
Breaks:
–
Give breaks only at end of a part as indicated by stop sign.
–
Individual students may use restroom during test:
 Collect materials
 Monitor student
–
–
Some students may be allowed supervised breaks
(IEP, 504, ELs)
See DFA for more information on breaks.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 32
California Standards Tests
(CSTs) for Science
Copyright © 2012 Educational Testing Service. All rights reserved.
December
December 2014
2015 Pre-Test Workshop | Slide 33
2014
CSTs for Science
•
•
•
CST for Science in grades 5 and 8
CST for Life Science in grade 10
All students take the CST unless they have an IEP that
designates CMA or CAPA.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 34
California Modified
Assessment
(CMA) for Science
Copyright © 2012 Educational Testing Service. All rights reserved.
December
December 2014
2015 Pre-Test Workshop | Slide 35
2014
CMA for Science
•
•
CMA for Science in grades 5 and 8
CMA for Life Science in grade 10
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 36
CMA for Science Participation
•
•
Student must have an IEP that designates that he/she takes
the CMA for Science.
Examiners should check the student’s IEP to see whether
the student should take the CMA instead of the CST.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 37
CST/CMA Combined Answer
Document for Grade 5, 8, and 10
Right side of inside of the answer document
CMA section has:
• Different subject
icon from CST
• Alternate row
shading for the
response bubbles
• Three options
• Fewer number of
questions than the
CST for grades 5
and 8
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 38
California Alternate
Performance Assessment
(CAPA) for Science
Copyright © 2012 Educational Testing Service. All rights reserved.
December
December 2014
2015 Pre-Test Workshop | Slide 39
2014
CAPA for Science
•
•
•
•
•
Performance-based, one-on-one test
For students with significant cognitive disabilities unable
to take the CSTs even with Universal Tools, Designated
Supports, and Accommodations
Student must have an IEP.
IEP should specify CAPA for Science and CAPA level.
Students who take CAPA for Science do not take STS.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 40
CAPA for Science
Answer Document
•
•
•
Use only 2015 answer document.
Ensure correct CAPA Level is marked in box 6a.
Only Level I can have “5” as a score. The highest
possible score for Levels III and IV is “4.”
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 41
CAPA for Science
Observers
•
•
•
Districts must double-rate a minimum of ten percent (10%)
of the CAPA students per level, per site (including Non
Public School [NPS]).
Students to be double-rated are randomly selected.
Observers must mark Observer and BOTH examiners and
observers must sign their separate answer documents.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 42
Administering the CAPA for Science
Observer’s Answer Document
Use blank from overage.
Observers must mark sections.
1 – Name, etc.
3 – Date of Birth
4 – Name
5 – Gender
6a – CAPA Level
6b – Grade
8 – Student ID
9 – SSID
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 43
Standards-based Tests in
Spanish (STS)
Copyright © 2012 Educational Testing Service. All rights reserved.
December
December 2014
2015 Pre-Test Workshop | Slide 44
2014
Who Takes the STS for Reading
Language Arts?
•
STS for RLA is optional for Spanish-speaking ELs, grades
2–11, who either:
–
–
Receive instruction in Spanish regardless of the length of
time they have been enrolled in schools in the U.S. or one
of its territories; or
Have been enrolled in a school in the U.S. or one of its
territories less than 12 cumulative months.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 45
Other STS RLA Stipulations
•
•
Students taking the STS must also take CSTs or the CMA
for Science.
Students who take the CAPA for Science in grades 5, 8,
and 10 do NOT take the STS.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 46
STS RLA Materials
•
•
STS for RLA in grades 2–11
DFAs
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 47
After Testing
Copyright © 2012 Educational Testing Service. All rights reserved.
December
December 2014
2015 Pre-Test Workshop | Slide 48
2014
After Testing
(CAASPP Test Site Coordinator)
•
•
Paperwork:
– Complete back of student test answer documents.
– Transcribe voided test answer documents.
– Complete School Grade Identification (SGID) sheet.
Packing: scorables and nonscorables
– Attach correct shipping labels.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 49
After Testing
(CAASPP Test Site Coordinator)
Answer Documents
• Train examiners to:
– Erase NOTHING in answer circles.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 50
After Testing (cont.)
(CAASPP Test Site Coordinator)
Answer Documents
•
Avoid teaching students to mark through answer circles
to eliminate answers. Such marks MAY NOT be erased
by adults.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 51
After Testing (cont.)
(CAASPP Test Site Coordinator)
Back of Answer Documents
•
•
•
A1: DO NOT complete without CDE notification
A2: Special Conditions
A3: Accommodations and Modifications
–
–
Part a: mark “IEP” and/or “Section 504 plan” to indicate which
program/plan student has, WHETHER USED UNIVERSAL
TOOLS, DESIGNATED SUPPORTS, AND
ACCOMMODATIONS OR NOT.
 Note: IEP is required to take the CMA or CAPA.
Part b, mark codes for all Universal Tools, Designated Supports,
and Accommodations student used as specified in IEP and/or 504
plan.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 52
After Testing (cont.)
(CAASPP Test Site Coordinator)
Back of Answer Documents
•
•
A3: Accommodations and Modifications
A4: English Learner Test Variations
–
For each test, mark what was actually used by the student
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 53
After Testing (cont.)
(CAASPP Test Site Coordinator)
•
Transcribe:
– Braille and large print (or not processed)
 In Section A3 on the back of the student answer
document mark “G”- for Braille, and “H” – for large
print
– Damaged answer documents
• Write VOID on the front of damaged answer
document(s) and return with nonscorables.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 54
After Testing (cont.)
(CAASPP Test Site Coordinator)
School and Grade Identification Sheet (SGID)
•
•
•
Complete for each set of answer
documents or test booklets.
Check counts to be accurate;
include documents of students not
tested with reason why in A2.
Place on answer documents for
correct:
–
–
–
Grade
School
Processing stops
if not correct.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 55
After Testing (cont.)
(CAASPP Test Site Coordinator)
School and Grade Identification Sheet (SGID)
•
Make sure the REQUIRED fields are completed to ensure
accurate processing.
–
–
CAASPP Assessments administered
Grade
 Mark only one
 For CST/CMA, STS only
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 56
After Testing (cont.)
(CAASPP Test Site Coordinator)
School and Grade Identification Sheet (SGID)
•
Make sure the REQUIRED fields are completed to ensure
accurate processing.
–
–
–
Number of documents
Test start date = first day of testing within window
Used by CDE accountability office
School code
NOT pre-populated
For home/hospital or independent study, enter 7-digit
district code
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 57
After Testing (cont.)
(CAASPP Test Site Coordinator)
Home/Hospital/Independent Study
• On answer document, A3, mark as accommodation
“M” if home/hospital.
• On SGID, enter correct home hospital/independent
study school code = same as 7-digit county district
code.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 58
After Testing (cont.)
(CAASPP Test Site Coordinator)
NPS Answer Documents
• Put on answer document the NPS unique school
code.
• Put under SGID sheet with 0000001 as the school
code.
• Return with scorable materials for processing.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 59
After Testing:
Answer Documents to Return
•
An answer document must be returned for students
enrolled on the first day of testing and designated to take
one of the following tests (even if not tested):
–
–
–
•
•
CST for Science (grades 5, 8, and 10)
CMA for Science (grades 5, 8, and 10)
CAPA for Science (any level)
Return answer documents for students with special
conditions identified in Section A2.
Must return STS answer document only if test taken
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 60
After Testing:
Other Materials to Return
• Must return all CAPA Examiner’s Manuals with
nonscorables
• Must return all test booklets.
• Note: If only the cover or portion of the test
booklet is returned, this will be considered a
security breach.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 61
Late Material Return
• Contact CalTAC at 1800-955-2954
or e-mail at caaspp@ets.org.
• Indicate school and LEA with
returns
• Depending on stage of processing at
scoring center, there may be a fee to
process.
• Late returns are considered a
security breach.
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 62
Summary
Copyright © 2012 Educational Testing Service. All rights reserved.
December
December 2014
2015 Pre-Test Workshop | Slide 63
2014
Summary
• What’s New in 2015?
• Responsibilities,
including security &
training
• Paper-pencil-tests
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
•
•
•
•
•
CSTs for Science
CMA for Science
CAPA for Science
STS for RLA
After testing
2015 Pre-Test Workshop | Slide 64
More Information
• http://www.cde.ca.gov/ta/tg/sr/
• http://caaspp.org/
• Call CalTAC at 800-955-2954 or e-mail at
caaspp@ets.org
Copyright © 2012 Educational Testing Service. All rights reserved.
December 2014
2015 Pre-Test Workshop | Slide 65