2012 Standardized Testing and Reporting
(STAR) Program and CAHSEE Grade 10 Census
Pre-Test Workshop for Test Site Coordinators
High Schools
Session One: 3:30-5:30 PM
Wednesday, 2/16/12–Montana Room
Session Two: 9:00-11:00 AM
Wednesday, 2/17/12–Montana Room
Presented by:
Mao J. Vang, Ed.D.
Sacramento City Unified School District
Assessment, Research and Evaluation, Box 780
5735 – 47th Ave.
Sacramento, CA 95824
Tel. 916-643-9420
Fax. 916-643-9474
Agenda
•
•
•
•
•
•
•
Introductions
CAHSEE Grade 10 Census Overview
Objectives
New in 2012
Test Security
STAR Program Overview
Test Site Coordinator Responsibilities
•
•
•
•
•
Documents and Coding
Test Variations, Accommodations & Modifications
Preparing Documents for Return
Additional Resources
Questions & Answers
– Multiple Choice Tests
2
Objectives
• Provide an overview, key requirements, and
administration information for the 2012
Standardized Testing and Reporting (STAR) Program
• Present the requirements for ensuring test security
• Review required student demographic information
• Preview required forms and how to complete them
• Review how to package and return all testing
materials
• Visit Training Resources for Test Site Coordinators
Webpage
3
Key Dates
STAR
Grade
Testing Window
Materials Delivery
Materials Pickup
Writing Test
EAP Writing Essay
11
March 5-23
All high schools with grade 11
February 27-March 2 March 26-30
Multiple-Choice
Tests
CST
CMA
CAPA
STS
Wave 1: March 27-May 3, 2012
New Technology & Nonpublic
March 19-23
Schools
May 7-11
2-11
Wave 2: April 18-May 18, 2012
Traditional Calendar Schools, The April 9-13
Language Academy, & Yav Pem
Suab Academy
May 21-24
Test materials must be ready for pick-up by 8:00 AM on the specific date(s) for pick-up. If
you complete testing ahead of schedule, contact AR&E to arrange for early pickup.
4
New for 2012
• Testing window: 23 days
• Answer documents
– Front: SEID added
– Back: NPS moved
– CAPA (shading of “5”) for Level I ONLY
• Writing tests
– Reading aloud prompt now accommodation
– Writing test can only be given in 1 day
• CMA
– Braille for all
– Grades 8–11 if Pre-ID, receive both CST and CMA Pre-ID
answer documents
5
New for 2012
• District home, hospital, independent study
has a school code
– If district has a program
– Use new district CDS code
http://www.cde.ca.gov/ds/sp/cl/documents/
calpadsupdflash41.doc
• Security Audits
• Mark Discrimination Analysis
6
STAR Program Overview
• California Standards Tests (CST)
Grades 2-11 for most students, includes separate writing test in
grades 4 & 7
• California Modified Assessment (CMA)
Grades 3-11 for students with IEP specification, includes
separate writing test in grades 4 & 7
• California Alternate Performance Assessment (CAPA)
for students with significant cognitive disabilities
• Standards-based Tests in Spanish (STS)
English learners grades 2-11 whose primary language is Spanish
and:
– Receive instruction in Spanish, or
– Have been enrolled in US school < 12 months
7
Early Assessment Program
• EAP tests measure readiness for college English and
mathematics for CSU and California Community Colleges
(CCC) placement. CCC can begin accepting EAP results in
2010.
– Administered as voluntary augmentations to grade 11 ELA
CST and the Algebra II and Summative High School Math CSTs
– Students must mark ONLY ONE circle
8
Early Assessment Program
• Items included in CST booklet
– Extends CSTs by 15 items in ELA and Math.
– EAP in English also requires a writing test that will
be administered separately from STAR. Essay is
required if English score is desired to be sent to CSU
and or CCC. Allow for an estimated time of 45
minutes to respond to the prompt.
– March 5-23, 2012 writing testing window
Refer to pages 46-47 in Coordinator Manual
9
Testing Requirements
• All students enrolled on the first day of testing
for each district in grades 2-11 needs to be
assessed with one of the following:
– CST/CMA
– CAPA
10
Testing Requirements by CST Content
California Standards Test
Grade
English
Language Arts
Mathematics
(Choose one end-of-course (EOC) completed in
summer 2011 or will complete in 2011-12 school
year)
General
Math
9
Required
Required
if not in
Algebra I
or higher
math
10
Required
N/A
11
Required
(additional
EAP questions
+ separate
EAP Writing
Essay)
N/A
Science
(Choose one end-of-course (EOC)
completed in summer 2011 or will
complete in 2011-12 school year)
History-Social
Science
Summative
Grade 10Earth
World
Algebra I Geometry Algebra II High School
Biology Chemistry
Physics U.S. History
Life Science
Science
History
Math
EOC
EOC
EOC
EOC
N/A
EOC
EOC
EOC
EOC
N/A
EOC
EOC
EOC
EOC
EOC
Required
EOC
EOC
EOC
EOC
N/A
EOC
N/A
EOC
EOC
EOC
EOC
Required
EOC
EOC
EOC
EOC +
EOC +
Additional Additional
EAP
EAP
questions questions
11
Testing Requirements by CMA Content
California Modified Assessment
Grade
English Language
Arts
Mathematics
(Choose one end-of-course completed in summer
2011 or will complete in 2011-12 school year)
Science
Algebra I
Geometry
Grade 10-Life
Science
9
Available
Available
Available
N/A
10
Available
Available
Available
Available
11
Available
Available
Available
N/A
Note: If current Individual Education Plan (IEP) specifies CMA content area for a student, the student does not take
that corresponding part on the CST.
12
CMA Participation
• Current IEP specifying CMA & content area(s)
• Previous participation
– Previous CST Score of FBB or BB in subject area assessed
and may have taken the CST with modifications; and
– 2 years scoring Proficient or Advanced on CAPA
• Not be eligible to take the California Alternate
Performance Assessment (CAPA).
• Response to appropriate instruction
– Receiving grade level instruction and has goals written
to grade level standards
13
Testing Requirements by CAPA Content
California Alternate Performance Assessment
Level
Grades
English
Language Arts
Mathematics
Science
I
2-11
Required
Required
Required
II
2-3
Required
Required
Required
III
4-5
Required
Required
Required
IV
6-8
Required
Required
Required
V
9-11
Required
Required
Required
Note: If current Individual Education Plan (IEP) specifies CAPA for a student, the
student takes CAPA for all content areas.
14
CAPA Overview
• Performance-based, one-on-one test
• For students with significant cognitive disabilities
unable to take the CSTs even with accommodations
and/or modifications or the CMA with
accommodations
• Student must have an IEP
• IEP specifies CAPA and level
• Do not take STS
• Answer document:
– Use only 2012 answer document
– Ensure correct CAPA Level
is marked in 7a
15
CAPA Overview (Continued)
• CAPA is to be administered by trained licensed or
certificated individuals
• 10% of the CAPA tests by level must be second rated
• CAPA testing window is the same as the multiple-choice
window.
• CAPA materials are include with multiple-choice
materials.
• For questions regarding training for CAPA examiners,
contact:
– Linda Kawahara-Matsuo, District CAPA trainer
– Special Education Department
– 643-9122
16
CAPA Observers
• Districts must double-rate at a minimum of ten
percent (10%) of the CAPA students per level, per
site (including NPS)
• Double ratings are randomly selected
• Observers must mark Observer and BOTH
examiners and observers must sign the answer
document
17
Preparing To Administer the CAPA
Observer’s Answer Doc
Use blank from overage.
Observers must mark sections
1 – Name, etc.
3 – Date of Birth
5 – Name
6 – Gender
7a – CAPA Level
7b – Grade
11 – Student ID
12a – SSID
18
Testing Requirements by STS Content
Standards-based Tests in Spanish
Mathematics
Grade
English Language Arts
2
Available
Available
3
Available
Available
4
Available
Available
5
Available
Available
6
Available
Available
7
Available
Available
8
Available
Available
9
Available
Available
10
Available
Available
11
Available
Available
(Algebra I and Geometry are available for grades 8-11)
Note: Students in grades 8 and 9 who are not taking Algebra I or Geometry courses take NO STS math, but do take
CST math.
19
STS Overview
• Required for English learners (ELs) in grades 2-11
whose primary language is Spanish and who either:
– Receive instruction in Spanish regardless of the length
of time they have been enrolled in the U.S.; or
– Have been enrolled in a school in the U.S. less than 12
cumulative months.
• Not to be administered to English-only,
I-FEP, R-FEP, or dual immersion who do not meet the
inclusion criteria stated.
• Students taking the STS must also take CSTs or the
CMA
• Students who take CAPA do NOT take STS
20
View Training Video
• Site Coordinator Segment
– General, first part about security only
– Refer to Site Coordinator Updates for 2012
Handout
2012 STAR Pre-Test Workshop || Slide 21
Security Documents
• The STAR Security Agreements from STAR test site
coordinators (principals) MUST be received by AR&E before
test materials may be delivered to test sites.
– Principals must review and sign the 2012 STAR Test
Security Agreement and send it to
STARSupport@sac-city.k12.ca.us
• STAR test site coordinators MUST have a completed 2012
STAR Test Security Affidavit from test examiners before giving
them testing materials.
22
Test Security Agreement and Affidavit
Sign by Principal or
Designated Test
Site Coordinator
Send copies of
all Test
Security and
Affidavits to
STARSupport
@saccity.k12.ca.us
or
Box 780
by first day of
multiple choice
testing.
Sign by all others having
access to STAR Tests
23
Security Audits
• At randomly-selected schools and district offices
• Before, during, or after testing
• Are materials secure, accounted for, and when
not in use locked-up
• Are correct administrative procedures being
followed:
– Materials have been removed or covered
– Students are not being coached through the exams
– Only appropriate accommodations and or
modifications are being provided, et. al.
2012 STAR Pre-Test Workshop || Slide 24
Mark Discrimination Analysis
• An automated process completed at the time of test
booklet (grades two and three) and answer document
scanning
• Identifies erasures to determine if the response has
changed from:
Wrong left wrong, or
– Correct to wrong, or
Correct left correct, or
– Wrong to wrong, or
No response
– Wrong to correct, or
• From the analyses a report is produced and forward to
the CDE who in turn requests districts to conduct an
investigation based on the analyses
Test Site Coordinator (TSC)
Responsibilities Overview
• Attend training provided by district STAR coordinator
(Assessment, Research and Evaluation-ARE)
• Study and become familiar with the documents and
procedures:
– 2011 STAR District and Test Site Coordinator Manual
– Directions for Administration for at least one-grade level CST
and CMA
– STAR Test Site Coordinator Summary of Responsibilities
Handout
26
TSC Responsibilities
Overview Continued
• Schedule all tests and make-ups within the testing
window (See sample schedules posted at Website)
• Inform teachers, students and parents of the testing
schedule and where students are to report on the
day tests are administered
• Train personnel at your site
– Use Examiners Training Videos with Updates for 2012
Handout posted on Website
– Use Test Examiners and Proctors Training Presentation
posted on Website
– Obtain Security Affidavits from all personnel involved
27
TSC Responsibilities
Overview Continued
• Monitor test administration
• Handle defective test materials
• Manage emergency situations
– Use Appendix C: STAR Program Irregularities and
Incidents, pages 80-84 of manual
– Complete the appropriate report form and send a
copy to the district coordinator
28
TSC Responsibilities
Overview Continued
• Maintain the security of all testing materials
– When conducting inventory, begin with Box 1 and use the Test Site
Packing List to verify that all materials were packaged accurately
– Lock Freight Kit packet in secure place with test materials until needed
– Contact Assessment, Research and Evaluation (643-9420) immediately for
any discrepancies.
– Save original boxes for returning materials
• Distribute/collect test materials daily at your site
– No test materials should be left in a classroom overnight
– Use Inventory Forms posted at Website
• Ensure testing of all students in grades 2-11
• Act as liaison between your site and district
coordinator
• Obtain/return all test materials to/from district on
time
29
Pre-identified (Pre-ID) Documents
• Pre-identified students have pre-printed answer
documents
• Newly enrolled students (02/01-04/18/12)
– Check for pre-printed label, if available, put it on answer
document and treat document the same as if pre-ID.
– If no pre-printed label, hand-bubble all demographic fields.
30
CMA Materials for 2012
Grades 8−11
• If Pre-ID:
– For grades 8–11 if at least one CMA test is
pre-identified for a student, the student will
receive both the CMA and the CST preidentified answer documents
• If NOT Pre-ID:
– Answer documents sent based on test
booklets ordered
CMA Materials for 2012
Grades 8−11 Continued
• CMA for grades 8 and 11
– Both CST and CMA grade-level test booklets available for
each student taking one or more CMA exams
• All students must take the CST History/Social Science in
grade 8 and U.S. History in grade 11
• CMA for grades 9 and 10
– Grade-level CMA test booklets for only the CMA tests to be
administered
• CST available only if needed
• Students in grades 9 and 10 may take only CMA (ELA,
Algebra I, Geometry, grade 10 Life Science)
Coding Student Information
Pre-ID Answer Documents
On the first day of testing,
per teacher-read
instructions, all students
must complete Section 1
Pre-ID Barcode:
Check student name
and give to correct
student
33
Coding Student Information
Blank Answer Documents
On the first day of testing, per
teacher-read instructions, all
students must complete
Section 1
All demographic information
must be hand-gridded.
34
Coding Student Information
Test Version Numbers (Gr. 8-11)
• Students will have 2 answer docs if they are taking CMA
• Must mark version # for grade level tests and EOC tests
Gr. 8 CST, pp. 2 & 3
Gr. 8 CMA, p. 2
35
35
Coding Student Information
A2: Special Conditions
After Each Test
• Test coordinator
completes A, E, M, P, &
T
• Teacher completes C, F,
L, X, Y, & Z
A3: Accommodations and
Modifications
Examiner marks
• whether student has
IEP or 504 Plan and
• which accommodations
were used
A4: English Learner (EL) Test
Variations
Examiner completes if any EL
variations were used
36
Testing Variations
• Two types of testing variations
– ALL – available for all students
– 1 – available if regularly used in the classroom
37
Accommodations & Modifications
• Students may use accommodations and/or
modifications if
– Specified in IEP or Section 504 Plan and
– Regularly used in the classroom
• Accommodations and modifications are to be used
only to allow a student to access the test, not to
provide an advantage
– Accommodations do not change what the test is measuring
– Modifications change what the test is measuring
Note: Refer to Appendix E: Allowable Test Variations,
Accommodations, and Modifications, pp. 87-91 in Coordinator
Manual
38
Preparing Documents for Return
Transcribing and Voiding Documents
• Transcribe braille and large print
(or not processed)
• Write VOID on any answer
document(s), with marks,
not to be scored; return
with nonscorables
39
Preparing Documents for Return
School Grade Identification Sheet (SGID)
• Complete for each set of
answer documents or test
booklets
Pre-printed
• Check counts to be accurate
• Place on answer documents
for correct
– Grade
– School (school code machinemarked)
Preparing Documents for Return
Complete Master File Sheet
• Return with each school
• Check counts to be accurate
• Required with scorables if
materials were ordered:
– Write “0” (zero), no blanks
– If not tested, note that school did
not test
Write in:
• Number of
SGID
• Number of
Scorable
Documents
• Totals
41
EAP Scorables Packing Order
42
Multiple Choice Scorables Packing Order
43
Label Boxes for
Return to District
EAP
English Essay
Multiple Choice Tests
(CST, CMA, CAPA & STS)
Scorable
Materials
Non-scorable
Materials
Scorable
Materials
Non-scorable
Materials
Magenta
Labels
Yellow
Labels
Orange
Labels
Green
Labels
44
View Training Video
• Site Coordinator Segment
– CST High School
– Refer to Site Coordinator Updates for 2012
Handout
Additional Resources: Rosters
• Rosters will be sent from STARSupport@sac-city.k12.ca.us:
– Pre-ID roster
• Students’ demographic information that have been pre-coded on
answer documents or late labels
– STS test roster
• Students who need to take STS
– CMA test roster
• Students who have been identified to participate using CMA on
one or more tests
– End-of-course test roster (Grades 7-11)
• End-of-course tests based on student enrollment. Test site
coordinators need to verify
– Pre-ID roster Code Conversion
46
Resources & Contact Information
All training materials and updates will be posted on the district’s Internet:
http://scusd.s468.sureserver.com/training-resources-test-site-coordinators
STAR Support Contact:
Assessment, Research, and Evaluation
5735 – 47th Ave.
Serna Center, Box 0780
Phone: 643-9420
Fax: 643-9474
Email: STARSupport@sac-city.k12.ca.us
47
Questions and Answers
?
48