2012 Standardized Testing and Reporting
(STAR) Program
Multiple Choice Tests
Pre-Test Workshop for Test Site Coordinators
Middle and K-8 schools
Session One: 3:30-5:30 PM
Wednesday, 2/15/12–Montana Room
Session Two: 9:00-11:00 AM
Thursday, 2/16/12–Montana Room
Presented by:
Mao J. Vang, Ed.D.
Sacramento City Unified School District
Assessment, Research and Evaluation, Box 780
5735 – 47th Ave.
Sacramento, CA 95824
Tel. 916-643-9420
Fax. 916-643-9474
Agenda
•
•
•
•
•
•
Introductions
Objectives
New in 2012
Test Security
STAR Program Overview
Test Site Coordinator Responsibilities
•
•
•
•
•
Documents and Coding
Test Variations, Accommodations & Modifications
Preparing Documents for Return
Additional Resources
Questions & Answers
– Multiple Choice Tests
2
Objectives
• Provide an overview, key requirements, and
administration information for the 2012
Standardized Testing and Reporting (STAR) Program
• Present the requirements for ensuring test security
• Review required student demographic information
• Preview required forms and how to complete them
• Review how to package and return all testing
materials
• Visit Training Resources for Test Site Coordinators
Webpage
3
Key Dates
STAR
Grade
Writing Tests
CST & CMA Writing
4&7
Standards Tests
Multiple-Choice
Tests
CST
CMA
CAPA
STS
Testing Window
March 6 (Make-up March 7)
All schools with grades 4 and 7
Materials Delivery
Materials Pickup
February 27-March 2 March 8-9
Wave 1: March 27-May 3, 2012
New Technology & Nonpublic
March 19-23
Schools
May 7-11
2-11
Wave 2: April 18-May 18, 2012
Traditional Calendar Schools, The April 9-13
Language Academy, & Yav Pem
Suab Academy
May 21-24
Test materials must be ready for pick-up by 8:00 AM on the specific date(s) for pick-up. If
you complete testing ahead of schedule, contact AR&E to arrange for early pickup.
4
New for 2012
• Testing window: 23 days
• Answer documents
– Front: SEID added
– Back: NPS moved
– CAPA (shading of “5”) for Level I ONLY
• Writing tests
– Reading aloud prompt now accommodation
– Writing test can only be given in 1 day
• CMA
– Braille for all
– Grades 8–11 if Pre-ID, receive both CST and CMA Pre-ID
answer documents
5
New for 2012
• District home, hospital, independent study
has a school code
– If district has a program
– Use new district CDS code
http://www.cde.ca.gov/ds/sp/cl/documents/
calpadsupdflash41.doc
• Security Audits
• Mark Discrimination Analysis
6
STAR Program Overview
• California Standards Tests (CST)
Grades 2-11 for most students, includes separate writing test in
grades 4 & 7
• California Modified Assessment (CMA)
Grades 3-11 for students with IEP specification, includes
separate writing test in grades 4 & 7
• California Alternate Performance Assessment (CAPA)
for students with significant cognitive disabilities
• Standards-based Tests in Spanish (STS)
English learners grades 2-11 whose primary language is Spanish
and:
– Receive instruction in Spanish, or
– Have been enrolled in US school < 12 months
7
Testing Requirements
• All students enrolled on the first day of testing
for each district in grades 2-11 needs to be
assessed with one of the following:
– CST/CMA
– CAPA
8
Testing Requirements by CST Content
California Standards Test
Mathematics
Grade
7
8
English
Language Arts
Required +
separate
Writing Test
Required
(Choose one end-of-course (EOC) completed in summer 2011 or will
complete in 2011-12 school year)
Science History-Social
Grade 8 Science Grade 8
Grade-level Math
General Math
Algebra I
Geometry
Required if not in
Algebra I or higher
math
N/A
EOC
N/A
N/A
N/A
N/A
Required if not
in Algebra I or
higher math
EOC
EOC
Required
Required
9
Testing Requirements by CMA Content
California Modified Assessment
Grade
English Language Arts
Mathematics
(Choose one end-of-course (EOC) completed in
summer 2011 or will complete in 2011-12 school
year)
Science
Algebra I
Geometry
Science Grade 8
7
Available+separate Writing Test
Available
N/A
N/A
8
Available
Available
Available
Available
Note: If current Individual Education Plan (IEP) specifies CMA content area for a student, the student does not take
that corresponding part on the CST.
10
CMA Participation
• Current IEP specifying CMA & content area(s)
• Previous participation
– Previous CST Score of FBB or BB in subject area assessed
and may have taken the CST with modifications; and
– 2 years scoring Proficient or Advanced on CAPA
• Not be eligible to take the California Alternate
Performance Assessment (CAPA).
• Response to appropriate instruction
– Receiving grade level instruction and has goals written
to grade level standards
11
Testing Requirements by CAPA Content
California Alternate Performance Assessment
Level
Grades
English
Language Arts
Mathematics
Science
I
2-11
Required
Required
Required
II
2-3
Required
Required
Required
III
4-5
Required
Required
Required
IV
6-8
Required
Required
Required
V
9-11
Required
Required
Required
Note: If current Individual Education Plan (IEP) specifies CAPA for a student, the
student takes CAPA for all content areas.
12
CAPA Overview
• Performance-based, one-on-one test
• For students with significant cognitive disabilities
unable to take the CSTs even with accommodations
and/or modifications or the CMA with
accommodations
• Student must have an IEP
• IEP specifies CAPA and level
• Do not take STS
• Answer document:
– Use only 2012 answer document
– Ensure correct CAPA Level
is marked in 7a
13
CAPA Overview Continued
• CAPA is to be administered by trained licensed or
certificated individuals
• 10% of the CAPA tests by level must be second rated
• CAPA testing window is the same as the multiple-choice
window.
• CAPA materials are include with multiple-choice
materials.
• For questions regarding training for CAPA examiners,
contact:
– Linda Kawahara-Matsuo, District CAPA trainer
– Special Education Department
– 643-9122
14
CAPA Observers
• Districts must double-rate at a minimum of ten
percent (10%) of the CAPA students per level, per
site (including NPS)
• Double ratings are randomly selected
• Observers must mark Observer and BOTH
examiners and observers must sign the answer
document
15
Preparing To Administer the CAPA
Observer’s Answer Doc
Use blank from overage.
Observers must mark sections
1 – Name, etc.
3 – Date of Birth
5 – Name
6 – Gender
7a – CAPA Level
7b – Grade
11 – Student ID
12a – SSID
16
Testing Requirements by STS Content
Standards-based Tests in Spanish
Mathematics
Grade
English Language Arts
2
Available
Available
3
Available
Available
4
Available
Available
5
Available
Available
6
Available
Available
7
Available
Available
8
Available
Available
9
Available
Available
10
Available
Available
11
Available
Available
(Algebra I and Geometry are available for grades 8-11)
Note: Students in grades 8 who are not taking Algebra I or Geometry courses take NO STS math, but do take CST
math.
17
STS Overview
• Required for English learners (ELs) in grades 2-11
whose primary language is Spanish and who either:
– Receive instruction in Spanish regardless of the length
of time they have been enrolled in the U.S.; or
– Have been enrolled in a school in the U.S. less than 12
cumulative months.
• Not to be administered to English-only,
I-FEP, R-FEP, or dual immersion who do not meet the
inclusion criteria stated.
• Students taking the STS must also take CSTs or the
CMA
• Students who take CAPA do NOT take STS
18
View Training Video
• Site Coordinator Segment
– General, first part about security only
– Refer to Site Coordinator Updates for 2012
Handout
19
Security Documents
• The STAR Security Agreements from STAR test site
coordinators (principals) MUST be received by AR&E before
test materials may be delivered to test sites.
– Principals must review and sign the 2012 STAR Test
Security Agreement and send it to
STARSupport@sac-city.k12.ca.us
• STAR test site coordinators MUST have a completed 2012
STAR Test Security Affidavit from test examiners before giving
them testing materials.
20
Test Security Agreement and Affidavit
Sign by Principal or
Designated Test
Site Coordinator
Send copies of
all Test
Security and
Affidavits to
STARSupport
@saccity.k12.ca.us
or
Box 780
by first day of
multiple choice
testing.
Sign by all others having
access to STAR Tests
21
Security Audits
• At randomly-selected schools and district offices
• Before, during, or after testing
• Are materials secure, accounted for, and when
not in use locked-up
• Are correct administrative procedures being
followed:
– Materials have been removed or covered
– Students are not being coached through the exams
– Only appropriate accommodations and or
modifications are being provided, et. al.
22
Mark Discrimination Analysis
• An automated process completed at the time of test
booklet (grades two and three) and answer document
scanning
• Identifies erasures to determine if the response has
changed from:
Wrong left wrong, or
– Correct to wrong, or
Correct left correct, or
– Wrong to wrong, or
No response
– Wrong to correct, or
• From the analyses a report is produced and forward to
the CDE who in turn requests districts to conduct an
investigation based on the analyses
23
Test Site Coordinator (TSC)
Responsibilities Overview
• Attend training provided by district STAR coordinator
(Assessment, Research and Evaluation-ARE)
• Study and become familiar with the documents and
procedures:
– 2012 STAR District and Test Site Coordinator Manual
– Directions for Administration for at least one-grade level CST
and CMA
– STAR Test Site Coordinator Summary of Responsibilities
Handout
24
TSC Responsibilities
Overview Continued
• Schedule all tests and make-ups within the testing
window (See sample schedules posted at Website)
• Inform teachers, students and parents of the testing
schedule and where students are to report on the
day tests are administered
• Train personnel at your site
– Use Examiners Training Videos with Updates for 2012
Handout posted on Website
– Use Test Examiners and Proctors Training Presentation
posted on Website
– Obtain Security Affidavits from all personnel involved
25
TSC Responsibilities
Overview Continued
• Monitor test administration
• Handle defective test materials
• Manage emergency situations
– Use Appendix C: STAR Program Irregularities and
Incidents, pages 80-84 of manual
– Complete the appropriate report form and send a
copy to the district coordinator
26
TSC Responsibilities
Overview Continued
• Maintain the security of all testing materials
– When conducting inventory, begin with Box 1 and use the Test Site
Packing List to verify that all materials were packaged accurately
– Lock Freight Kit packet in secure place with test materials until needed
– Contact Assessment, Research and Evaluation (643-9420) immediately for
any discrepancies.
– Save original boxes for returning materials
• Distribute/collect test materials daily at your site
– No test materials should be left in a classroom overnight
– Use Inventory Forms posted at Website
• Ensure testing of all students in grades 2-11
• Act as liaison between your site and district
coordinator
• Obtain/return all test materials to/from district on
time
27
Pre-identified (Pre-ID) Documents
• Pre-identified students have pre-printed answer
documents
• Newly enrolled students (02/01-04/18/12)
– Check for pre-printed label, if available, put it on answer
document and treat document the same as if pre-ID.
– If no pre-printed label, hand-bubble all demographic fields.
28
CMA Materials 2012
• CMA booklets for grade 3
– Separate scorable test booklet
– If no CST taken, return CST test booklet with nonscorables
• CMA for Grades 4–7
– CST and CMA in same answer document
– Grade 5 ONLY allows calculator
(if written into the IEP)
• CMA for grade 8 if at least one CMA test is pre-identified for a
student, the student will receive both the CMA and the CST preidentified answer documents
• If both CST and CMA taken, must
mark Section 7c for CMA tests
taken
29
CST/CMA Answer Document
Right side of inside of answer doc grades 4−7
CMA section has:
• Different subject
icons from CST
• Alternate row
shading for the
response
bubbles
• Three options
choices
• Fewer number
of questions
30
CMA Grade 7 Answer Document
Mathematics Section
Grade 7 mathematics and Algebra I have different
numbers of questions
31
Coding Student Information
Pre-ID Answer Documents
On the first day of testing,
per teacher-read
instructions, all students
must complete Section 1
Pre-ID Barcode:
Check student name
and give to correct
student
32
Coding Student Information
Blank Answer Documents
On the first day of testing, per
teacher-read instructions, all
students must complete
Section 1
All demographic information
must be hand-gridded.
33
Coding Student Information
Test Version Numbers (Gr. 8)
• Students will have 2 answer docs if they are taking CMA
• Must mark version # for grade level tests and EOC tests
Gr. 8 CST, pp. 2 & 3
Gr. 8 CMA, p. 2
34
34
Coding Student Information
A2: Special Conditions
After Each Test
• Test coordinator
completes A, E, M, P, &
T
• Teacher completes C, F,
L, X, Y, & Z
A3: Accommodations and
Modifications
Examiner marks
• whether student has
IEP or 504 Plan and
• which accommodations
were used
A4: English Learner (EL) Test
Variations
Examiner completes if any EL
variations were used
35
Testing Variations
• Two types of testing variations
– ALL – available for all students
– 1 – available if regularly used in the classroom
36
Accommodations & Modifications
• Students may use accommodations and/or
modifications if
– Specified in IEP or Section 504 Plan and
– Regularly used in the classroom
• Accommodations and modifications are to be used
only to allow a student to access the test, not to
provide an advantage
– Accommodations do not change what the test is measuring
– Modifications change what the test is measuring
Note: Refer to Appendix E: Allowable Test Variations,
Accommodations, and Modifications, pp. 87-91 in Coordinator
Manual
37
Preparing Documents for Return
Transcribing and Voiding Documents
• Transcribe braille and large print
(or not processed)
• Write VOID on any answer
document(s), with marks,
not to be scored; return
with nonscorables
38
Preparing Documents for Return
School Grade Identification Sheet (SGID)
• Complete for each set of
answer documents or test
booklets
Pre-printed
• Check counts to be accurate
• Place on answer documents
for correct
– Grade
– School (school code machinemarked)
39
Preparing Documents for Return
Complete Master File Sheet
• Return with each school
• Check counts to be accurate
• Required with scorables if
materials were ordered:
– Write “0” (zero), no blanks
– If not tested, note that school did
not test
Write in:
• Number of
SGID
• Number of
Scorable
Documents
• Totals
40
Multiple Choice Scorables Packing Order
41
Label Boxes for
Return to District
Multiple Choice Tests
(CST, CMA, CAPA & STS)
Scorable
Materials
Non-scorable
Materials
Orange Labels
Green Labels
42
View Training Video
• Site Coordinator Segment
– CST Middle School
– Refer to Site Coordinator Updates for 2012
Handout
43
Additional Resources: Rosters
• Rosters will be sent from STARSupport@sac-city.k12.ca.us:
– Pre-ID roster
• Students’ demographic information that have been pre-coded on
answer documents or late labels
– STS test roster
• Students who need to take STS
– CMA test roster
• Students who have been identified to participate using CMA on
one or more tests
– End-of-course test roster (Grades 7-11)
• End-of-course tests based on student enrollment. Test site
coordinators need to verify
– Pre-ID roster Code Conversion
44
Resources & Contact Information
All training materials and updates will be posted on the district’s Internet:
http://scusd.s468.sureserver.com/training-resources-test-site-coordinators
STAR Support Contact:
Assessment, Research, and Evaluation
5735 – 47th Ave.
Serna Center, Box 0780
Phone: 643-9420
Fax: 643-9474
Email: STARSupport@sac-city.k12.ca.us
45
Questions and Answers
?
46