2014 California Assessment of
Student Performance and Progress
(CAASPP)
Pre-Test Workshop for PaperPencil Tests
January 13, 2014
9:00 a.m.
Presenters: Michael McDaniel and Dan Stanley
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 1
Objectives
Local educational agency (LEA) CAASPP
coordinators will:
• Follow current procedures properly.
• Ensure all materials are handled securely and
appropriately.
• Train site coordinators to conduct testing
consistently.
Handout (H) Page 1
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 2
Agenda
•
•
•
•
•
•
•
•
Introductions
Objectives and agenda
New for 2014
LEA CAASPP Coordinator responsibilities
Accessibility Support Request Form
Site Coordinator responsibilities
Multiple-choice tests
California Standards Tests (CSTs) for Science
H1
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 3
Agenda (cont.)
• California Modified Assessment (CMA) for
Science
• Standards-based Tests in Spanish (STS) for RLA
• California Alternate Performance Assessment
(CAPA)
• After testing
• Early Assessment Program (EAP) tests
• Summary
H1
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 4
New for 2014
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 5
New for 2014
• Most paper testing has been eliminated, except:
–
–
–
–
Grade-level science tests (CST, CMA, CAPA)
CAPA English–Language Arts (ELA) and Math
Tests used for EAP (Voluntary)
STS RLA (Optional)
• Changes in terminology and titles
– STAR Coordinator is now LEA CAASPP
Coordinator
H1
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 6
New for 2014 (cont.)
• Revised Security Agreement and Affidavit
(DRAFT)
• Universal Tools, Designated Supports, and
Accommodations (DRAFT)
– Accessibility Support Request Form
(DRAFT)
H1
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 7
LEA and Site CAASPP
Coordinator Responsibilities
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 8
LEA CAASPP Coordinators’
Responsibilities
• #1 Responsibility—Security
– No unauthorized electronic devices used in classroom
during testing
 For testing purposes, any electronic device that is not
specifically designated in the student’s IEP or Section
504 plan is unauthorized.
– Security audits to occur
H2
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 9
Security Audits
•
•
•
•
At randomly selected schools and LEA offices
Before, during, or after testing
Are materials secure, accounted for, and
locked up when not in use?
Are correct administrative procedures being followed?
For example:
– Instructional materials have been removed or covered.
– Students are not being coached through the exams.
– Only appropriate Universal Tools, Designated
Supports, and Accommodations are being provided.
– No unauthorized electronic devices are being used.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 10
LEA CAASPP Coordinators’
Responsibilities
• #2 Responsibility—Train CAASPP Site
Coordinators:
– New and updated videos
– Room sign with reminder of no electronic devices
•
•
•
•
To be posted in clear view of students
Included in coordinator kit
Available on californiatac.org
Can be photocopied
H2
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 11
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 12
Other LEA CAASPP Coordinator
Responsibilities
• Receive, count, store, distribute, track, collect,
count and return materials.
• Coordinate testing schedule.
• Coordinate collection of demographic data.
– Pre-ID (preferred)
– Or hand-mark answer documents
• Assist Site CAASPP Coordinators
• Complete Accessibility Support Request Form, as
necessary
H2
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 13
Accessibility Support Request
Form
• New for 2014, still in draft
• Request new universal tool, designated support, or
accommodation that is not yet listed as approved
• Approved tools/supports/accommodations will be
added to list
• Request form will be online and available on the
CDE Web site
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 14
Site Coordinator Responsibilities
•
•
•
•
•
•
•
•
Train examiners
Ensure examiners READ and sign affidavits the
coordinator retains
Prevent errors
Secure test materials
Verify materials are marked correctly to ensure correct
student scores
Guarantee correct enrollment counts
Complete Accessibility Support Request Form, as
necessary
Return materials promptly to LEA
H2
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 15
Site Coordinators:
Train Examiners
•
•
•
•
READ and sign affidavits.
Emphasize NO unauthorized electronic devices.
MAKE SURE CORRECT TESTS ARE GIVEN.
Students who are not testing may not stay in the
classroom where a test is being administered.
If students need to be taken to another room to finish
testing, BE SURE THEY ARE ESCORTED BY LEA
STAFF. Do not allow students to walk to another room
with test materials by themselves.
•
H2
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 16
Site Coordinators:
Train Examiners (cont.)
• Examiners CANNOT:
– Review test questions before, during, or after testing.
– Check students’ answers including (but not limited
to):
1. Advising students of wrong answer or to check an
answer; or
2. Withholding answer docs until students demonstrate
they have the right answers.
H2
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 17
Site Coordinators:
Train Examiners (cont.)
• Examiners shall monitor students throughout
testing to make sure students are:
– On correct part
– Not going on to other parts or back to a previously
completed part
– Not skipping a question on their answer document
(so that they are off by one or more)
– Not using unauthorized electronic devices during
the testing session
H2
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 18
Site Coordinators:
Train Examiners (cont.)
• Examiners must ensure there is enough time to
complete a part before beginning the part.
H2
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 19
Multiple-Choice PaperPencil Tests
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 20
Paper-Pencil CAASPP Tests
•
CSTs for Science
–
–
Students take grade-level CSTs for Science in grades 5, 8,
and 10
If participating in the EAP, take:
• CST for ELA (Grade 11); and
• CST for Algebra II or Summative High School Mathematics
•
CMA for Science
–
–
•
Students take CMA for Science in grades 5, 8, and 10.
Must have IEP that designates that they will take the CMA for
Science
STS for RLA
–
–
Grades 2–11 RLA
Optional for Spanish-speaking English learners and for Englishspeaking Spanish learners (purchased separately)
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 21
Before Multiple-choice Testing
• Receive boxes:
– All boxes may not come in single delivery.
– Before signing receipt, check number of boxes.
• Prepare answer documents:
– Use only the 2014 scorable answer documents
received in the shipment from the testing
contractor.
– Provide Site Coordinator with information about
which demographics are to be completed.
– Ensure correct NPS code.
H3
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 22
Before Multiple-choice Testing
(cont.)
• Confirm which test(s) each student takes.
• Confirm any Universal Tools, Designated Supports,
and Accommodations students will use and where
they will be tested.
• Prepare materials:
–
–
–
–
Test booklets
No. 2 pencils
Scratch paper
Signs
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 23
During Multiple-choice Testing
•
Use Directions for Administration
(DFAs) correctly.
–
–
–
–
Read ALL “SAY” boxes
exactly as written.
Be sure to read and complete
“First Day of Testing” section
with students.
ONLY translate boxes
with “T” (NO CST/CMA/STS
questions, prompts, or
passages may be translated).
Grades 9−11 are in single DFA
for each test: CST, CMA, STS.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
H4
2014 Pre-Test Workshop | Slide 24
During Multiple-choice Testing
(cont.)
• Check names on test booklets and answer
documents before distributing to make sure
students receive correct documents.
• Mark answer documents:
– Correctly mark test name
 For 2014, this only applies for students taking
Algebra II or Summative High School Mathematics
for EAP use
– Correctly mark version #
H4
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 25
At Start of Testing: Section 1
• All students must complete, even if Pre-ID was used.
• At start of EAP testing, mark EOC test name (either
Algebra II or Summative HS for EAP):
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 26
During Multiple-choice Testing
(cont.)
• Monitor for use of unauthorized electronic devices.
• Make sure students are taking the correct test and
marking answers in the correct section of the answer
document.
• Ensure students complete all parts of each test.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 27
During Multiple-choice Testing
(cont.)
• Breaks
– Give breaks only at end of a part as indicated by
stop sign.
– Individual students may use restroom during test:
• Collect materials
• Monitor student
– Some students may be allowed supervised breaks
(IEP, 504, ELs)
– See DFA for more information on breaks. H 4
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 28
California Standards Tests
(CSTs) for Science and EAP
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 29
California Standards Tests (CSTs)
for Science and EAP
• CST for Science in grades 5 and 8
• CST for Life Science in grade 10
• Take unless IEP designates CMA or CAPA
• If participating in the EAP, take:
– CST for ELA (Grade 11); and
– CST for Algebra II or Summative High School
Mathematics
H5
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 30
Who Takes Which CST for
Mathematics?
• Grade 11 for EAP
– One of the following may be taken by eligible
students
 CST for Algebra II; or
 CST for Summative High School Mathematics
H5
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 31
Summative High School
Mathematics
• Students in grade 11 may take the CST for
Summative High School Mathematics for EAP
based on:
– Completion of Algebra I, Geometry, AND
Algebra II courses in previous years; or
– Completion of course aligned with Integrated
Math 3 blueprint in a previous year; or
– Previously took the CST for Summative High
School Mathematics.
H6
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 32
California Modified
Assessment (CMA) for
Science
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 33
CMA for Science Participation
• Student must have an IEP that designates that
he/she takes the CMA for Science.
• Examiners should check the student’s IEP to see
whether the student should take the CMA instead
of CST.
H6
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 34
2014 CMA for Science Tests
• CMA for Science in grades 5 and 8
• CMA for Life Science in grade 10
H6
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 35
CST/CMA Combined Answer
Document for Grade 5
Right side of inside of grade 5 answer document
CMA section has:
• Different subject
icon from CST
• Alternate row
shading for the
response bubbles
• Three options
• Fewer number of
questions
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 36
Standards-based Tests in
Spanish (STS)
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 37
Who Takes the STS for RLA?
• STS for Reading/Language Arts (RLA) is
optional for Spanish-speaking English learners
(ELs), grades 2–11, who either:
– Receive instruction in Spanish regardless of the
length of time they have been enrolled in schools
in the U.S. or one of its territories; or
– Have been enrolled in a school in the U.S. or one
of its territories less than 12 cumulative months.
H7
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 38
Other STS RLA Stipulations
• Students taking the STS must also take CSTs or
the CMA for Science.
• Students who take CAPA do NOT take STS.
H7
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 39
2014 STS RLA Materials
• STS for RLA in grades 2–11
H7
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 40
California Alternate
Performance Assessment
(CAPA)
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 41
CAPA
• Performance-based, one-on-one test
• For students with significant cognitive disabilities
unable to take the CSTs even with Universal
Tools, Designated Supports, and
Accommodations
• Student must have an IEP
• IEP specifies CAPA and level
• Do not take STS
H8
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 42
CAPA Answer Document
• Use only 2014 answer document.
• Ensure correct CAPA Level is marked in 7a.
• Only Level I can have “5” as a score. The highest
possible score for Levels II through IV is “4.”
H8
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 43
CAPA Observers
•
•
•
Districts must double-rate a minimum of ten percent
(10%) of the CAPA students per level, per site
(including NPS).
Students to be double-rated are randomly selected.
Observers must mark Observer and BOTH examiners
and observers must sign their separate answer
documents.
H8
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 44
Preparing to Administer the CAPA
Observer’s Answer Document
Use blank from overage.
Observers must mark sections.
1 – Name, etc.
3 – Date of Birth
5 – Name
6 – Gender
7a – CAPA Level
7b – Grade
11 – Student ID
12a – SSID
H8
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 45
After Testing
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 46
After Testing
• Paperwork
–
–
–
–
Complete back of answer document.
Transcribe voided answer documents.
Complete SGID.
Complete Master File Sheet.
• Pack: scorables vs. nonscorables
– Attach correct shipping labels.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 47
After Testing: Answer Documents
• Train examiners to:
– Erase NOTHING in answer circles.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 48
After Testing: Answer Documents
(cont.)
• Avoid teaching students to mark through answer
circles to eliminate answers. Such marks MAY
NOT be erased by adults.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 49
After Testing: Complete Back of
Answer Documents
• A1 DO NOT complete without CDE notification
• A2 Special Conditions
• A3 Accommodations and Modifications
– Part a: mark “IEP” and/or “Section 504 plan” to
indicate which program/plan student has, WHETHER
USED UNIVERSAL TOOLS, DESIGNATED
SUPPORTS, AND ACCOMMODATIONS OR NOT.
 Note: IEP is required to take CMA, CAPA.
– Part b, mark codes for all Universal Tools, Designated
Supports, and Accommodations student used as
specified in IEP and/or 504 plan.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 50
After Testing: Complete Back of
Answer Documents (cont.)
– Part b, mark codes for all Universal Tools, Designated
Supports, and Accommodations student used as
specified in IEP and/or 504 plan.
• A4 English Learner Test Variations
– For each test, what was actually used
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 51
16a—Disability Code
•
•
If not in Pre-ID, mark after testing.
For CST and STS:
–
–
•
Mark “000” if no IEP; or
Disability Code from IEP.
For CMA and CAPA:
–
–
–
Disability code is REQUIRED.
“000” not valid for CMA or CAPA.
Also, be sure to mark the “IEP” or
“504 Plan” circle in section A3a even
if the student does not use any
accommodations or modifications.
H9
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 52
CAUTION
• If no disability is marked, but CMA answer circles
have marks or CAPA answer document is
completed:
– Disability defaults to “unknown.”
– Must be corrected in CALPADS or not counted as
participating in API/AYP.
H9
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 53
After Testing
• Transcribe
– Braille and large print (or not processed)
 In Section A3 on the back of the answer document
mark “G” or “H.”
– Damaged answer documents
• Write VOID on
front of answer document(s)
and return with nonscorables.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 54
School and Grade Identification
Sheet (SGID)
•
•
•
Complete for each set of answer
documents or test booklets.
Check counts to be accurate; include
docs of students not tested with reason
why in A2.
Place on answer documents for
correct:
–
–
–
Grade
School
Processing stops
if not correct.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
H9
2014 Pre-Test Workshop | Slide 55
SGID (cont.)
•
Make sure the REQUIRED fields are completed to ensure
accurate processing.
–
–
Test
Grade
 Mark only one
 For CST/CMA, STS only
–
–
Number of documents
Test start date = first day of testing within window
 Used by CDE accountability office
–
School code
 NOT pre-slugged
 For home/hospital or independent study, enter 7-digit district code
H9
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 56
After Testing Master File Sheets
• Return for each school and LEA.
• Check counts of answer docs and SGIDs to make
sure they are accurate.
• Required with scorables if materials were ordered:
– Write “0” (zero), no
blanks, for each item
ordered.
– If not tested, note that
school did not test.
H 11
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 57
Home/Hospital/Independent
Study
• On answer document, A3, mark as accommodation
“M” if home/hospital.
• On SGID, enter correct home hospital/independent
study school code = same as 7-digit county district
code.
• If test booklets/answer documents ordered, but those
with that school code did not test, must return Master
File Sheet with zeros next to each unused, ordered
item.
H 11
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 58
Nonpublic School Answer
Documents
• Put on answer doc each NPS unique school code.
• Put under SGID with 0000001 school code.
• Return with LEA materials.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 59
After Testing: Which Answer
Documents to Return
• An answer document must be returned for
students enrolled on the first day of testing and
designated to take one of the following tests
(even if not tested):
– CST for Science (grades 5, 8, and 10)
– CMA for Science (grades 5, 8, and 10)
– CAPA (any level)
• Return answer documents for students with
special conditions identified in Section A2.
• Must return STS answer document only if test
taken
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 60
After Testing: What to Return
• Must return all CAPA Examiner’s Manuals with
nonscorables
• Must return all test booklets. If only cover or part
returned, considered a security breach.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 61
After Testing: Pack and Return
• Return all documents within an
administration in same shipment.
• Separate scorables (with SGID) from
nonscorables: make sure grade on answer
documents matches grade on SGID.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 62
Late Material Return
• Contact CalTAC.
• Indicate school and LEA with returns.
• If late scorables: Depending on stage of
processing at scoring center, there may be a fee to
process.
• Late returns are considered a security breach.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 63
Early Assessment Program
(EAP)
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 64
2014 EAP
• Students must take the CST for ELA, additional EAP
multiple-choice questions, and the EAP essay to
receive an EAP English status.
• EAP Essay Testing Window has been expanded. The
testing window is February 3 through March 31, 2014.
• Students must take the CST for Algebra II or
Summative High School Mathematics and the
additional EAP questions to receive an EAP math
status.
• Supplemental orders can be placed by contacting
CalTAC.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 65
2014 EAP (cont.)
• EAP Student Results and District Rosters will be
shipped to the LEAs by August 8, 2014, for those
schools that take the complete multiple-choice test
by June 30, 2014.
• EAP electronic student records will be available on
the CST Student Data CD-ROM.
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 66
2014 EAP (cont.)
• Security is important
– Only staff administering the tests should have
access to them.
– Students must return all essay topic booklets to the
school; school must return all essay topic booklets
to the LEA.
– No electronic devices permitted during testing.
• EAP information
– http://www.calstate.edu/eap
– http://www.csusuccess.org
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 67
Summary
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 68
Summary
• What’s New?
• Responsibilities,
including security &
training
• Multiple-choice tests
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
•
•
•
•
•
•
CSTs for Science
CMA for Science
STS for RLA
CAPA
After testing
EAP
2014 Pre-Test Workshop | Slide 69
More Information
• http://www.cde.ca.gov/ta/tg/sr/
• http://www.californiatac.org/
• Or call the California Technical Assistance Center
(CalTAC) at 800-955-2954
Copyright © 2012 Educational Testing Service. All rights reserved.
January 2014
2014 Pre-Test Workshop | Slide 70