Standardized Testing and
Reporting (STAR) Program
Pre-Test Workshop
January 2011
Objectives
STAR coordinators will:
• Follow correct, current, STAR procedures
• Ensure all materials are handled securely and appropriately
• Provide training and monitoring
2011 STAR Pre-Test Workshop || Slide 3
Agenda
• Registration and take quiz
• Introductions
• Objectives and agenda
• New for STAR 2011
• STAR coordinator responsibilities
• Writing tests
• California Standards Tests (CSTs)
• California Modified Assessment (CMA)
• Standards-based Tests in Spanish (STS)
• Multiple-choice tests
• California Alternate Performance Assessment (CAPA)
• After Testing
• Summary
• Early Assessment Program (EAP) tests
2011 STAR Pre-Test Workshop || Slide 4
New for STAR 2011
Overview Coordinator
Manual (M)
• CST and CMA writing test in grade 4
• New CMA tests
Page 2
CMA for English –Language Arts (ELA) in grade 10
CMA for English –Language Arts (ELA) in grade 11
CMA for Geometry in grades 8 –11
• Answer documents:
A3a and A3b
Q 1
2011 STAR Pre-Test Workshop || Slide 5
Quiz Question 1
Which tests are new in 2011?
A. California Standards Tests (CSTs) grade two English−language Arts (ELA) and pre-
Algebra
B. California Modified Assessment (CMA) grades ten and eleven ELA and Geometry
C. California Alternate Performance
Assessment (CAPA) Level I
D. Standards-based Tests in Spanish (STS) grades ten and eleven Reading/language
Arts (RLA) and Geometry
2011 STAR Pre-Test Workshop || Slide 6
Quiz Question 1
Which tests are new in 2011?
B. California Modified Assessment (CMA) grades ten and eleven ELA and Geometry
2011 STAR Pre-Test Workshop || Slide 7
Q 2
STAR District Coordinator
Responsibilities
• Handle testing materials
Ensure test security
Receive, inventory, store, distribute, track, collect, and return materials
• Coordinate testing schedule
• Coordinate collection of demographic data
Pre-ID (preferred)
Or hand-mark answer documents
Complete the Demographic Fields
Form (if needed)
• Train and oversee site coordinators
Train examiners
2011 STAR Pre-Test Workshop || Slide 8
M 9
STAR Site Coordinator Responsibilities
M 54
• Prevent errors
• Keep secure
• Verify materials are marked correctly to ensure correct student scores
• Guarantee correct enrollment counts
• Return materials promptly
2011 STAR Pre-Test Workshop || Slide 9
Quiz Question 2
Which of these is a district STAR coordinator’s most important responsibility?
A. Inventorying Directions For
Administrations (DFAs)
B. Contacting the STAR Technical
Assistant Center (TAC)
C. Training CAPA Examiners
D. Keeping materials secure
2011 STAR Pre-Test Workshop || Slide 10
Quiz Question 2
Which of these is a district STAR coordinator’s most important responsibility?
D. Keeping materials secure
2011 STAR Pre-Test Workshop || Slide 11
Writing Tests
• CST and CMA
• Grades 4 and 7
• Give correct test (CST or CMA)
See bottom of response booklet an d DFA
M 31, 52
2011 STAR Pre-Test Workshop || Slide 12
Writing Tests
• When?
March 1
(makeup March 2)
May 3
(makeup May 4)
Only if not in session March 1
2011 STAR Pre-Test Workshop || Slide 13
After Writing Testing
M 34, 55
• If the student used a word processor:
Mark Section A3, “Accommodations and
Modifications,” D or T
If A3 is not marked, the test will not be processed
Place print-out inside Writing Response
Booklet
Q 3
• Return all materials with either the scorables (student was given test) or nonscorables
• Return by
Sites: one day after testing
Districts: two days after testing
2011 STAR Pre-Test Workshop || Slide 14
Quiz Question 3
What happens if Mike types his response to a writing test and nothing is marked in Section
A3, “Accommodations and Modifications,” on his writing response booklet?
A. Scoring Center will not process the writing test
B. Scoring Center will process the writing test
C. Scoring Center will return the test to school district
D. Scoring Center will mark Section A3 on the writing response booklet
2011 STAR Pre-Test Workshop || Slide 15
Quiz Question 3
What happens if Mike types his response to a writing test and nothing is marked in Section
A3, “Accommodations and Modifications,” on his writing response booklet?
A. Scoring Center will not process the writing test
2011 STAR Pre-Test Workshop || Slide 16
STAR Program
Multiple-Choice Tests M 3, 36
• CSTs
Most students take CSTs
Grades 2 –11 unless taking CMA or CAPA
• CMA
Grades 3 –11; varies by grade and content area
Must have IEP and meet eligibility criteria
• STS
For Spanish-speaking English learners
Grades 2 –11
Must also take CST and/or CMA
2011 STAR Pre-Test Workshop || Slide 17
California Standards Tests (CSTs)
M 36, 82
• Grades 2 –11
• Unless taking CMA or CAPA
• Subjects tested :
English –Language Arts (ELA): all grades writing for grades 4 and 7
Mathematics: grades 2 –7 and end-of-course
(EOC) 7 –11
Science: grades 5, 8, 10, and EOC 9 –11
History –Social Science: grades 8, 11, and EOC
9 –11
2011 STAR Pre-Test Workshop || Slide 18
Who Takes Which CST for Mathematics?
• Grades 2 –6: Grade-level test required
• Grade 7: Grade 7 math test or Algebra I required
• Grades 8 –9: One of the following is required :
EOC mathematics CST; or
CST for Summative High School Mathematics
M 15,
81
(grade 9 only); or
CST for General Mathematics (if no math course or completing a course for which there is not an
EOC mathematics CST)
• Grades 10 –11: One of the following is required :
EOC mathematics CST; or
CST for Summative High School Mathematics
No assessment required if not taking a mathematics course
2011 STAR Pre-Test Workshop || Slide 19
Summative High School Mathematics
Students in grades 9 –11 will take the CST for
Summative High School Mathematics if:
M 15, 81
Previously completed Algebra I and Algebra II and Geometry courses, and completing an advanced mathematics course this year; or
Previously completed a course aligned with the
Integrated Mathematics 3 test blueprint, and completing an advanced mathematics course this year; or
Previously completed Algebra I and Algebra II and Geometry courses and are taking no mathematics course this year; or
Q 4
Previously completed a course aligned with the
Integrated Mathematics 3 test blueprint and are taking no mathematics course this year.
Previously took the CST for Summative High
School Mathematics.
2011 STAR Pre-Test Workshop || Slide 20
Mark Correct Mathematics
Test Taken
Or student will not receive a SCORE.
2011 STAR Pre-Test Workshop || Slide 21
• CST HS video through math only
2011 STAR Pre-Test Workshop || Slide 22
Quiz Question 4
Last school year, Pat, who is in the tenth grade, took the Summative High School
Mathematics test. This year Pat is taking no mathematics classes. What test should Pat take?
A. General Mathematics
B. Algebra II
C. Summative High School Mathematics
D. No mathematics test
2011 STAR Pre-Test Workshop || Slide 23
Quiz Question 4
Last school year, Pat, who is in the tenth grade, took the Summative High School
Mathematics test. This year Pat is taking no mathematics classes. What test should Pat take?
C. Summative High School Mathematics
2011 STAR Pre-Test Workshop || Slide 24
CST for Science
M 17, 82
• Required grade-level science
Grades 5, 8, 10: all students take the grade-level test
• Grades 9 –11 EOC
Based on standards-based science course completed during the school year or the previous summer, whichever is more recent
If more than one standards-based science course will be completed during the school year, the district must determine which test will be taken
Mark correct EOC test and version number on the answer document
2011 STAR Pre-Test Workshop || Slide 25
Q 1
CMA Tests for 2011
M 3,
13, 72
• CMA for ELA in grades 3 –11
(added grades 10, 11 in 2011)
CMA for Writing in grades 4 and 7
• CMA for Mathematics in grades 3 –7
• CMA for Algebra I (EOC for grades 7 –11)
• CMA for Geometry (EOC for grades 8 –11) (new in 2011)
• CMA for Science in grades 5 and 8
• CMA for Life Science in grade 10
2011 STAR Pre-Test Workshop || Slide 26
Who Takes the CMA?
M 16, 72,
• Students:
83
Have an IEP
Meet the SBE-adopted eligibility criteria
Enrolled in grades 3 –11
May take the CMA for some subjects, CST for other subjects
Must take grade-level CSTs when a CMA is not offered
May have previously taken the CMA, regardless of score
Not eligible to take the CAPA
• IEP specifies the CMA and subject(s)
• No modifications; if needed, take the CST
Q 5
2011 STAR Pre-Test Workshop || Slide 27
CMA Materials 2011
• CMA booklets for grade 3
Separate scorable test booklet
If no CST taken, return CST test booklet with non-scorables
• CMA for Grades 4 –7
CST and CMA in same answer document
• If both CST and CMA taken, must mark Section 7c for CMA tests taken on CST answer documents
2011 STAR Pre-Test Workshop || Slide 28
CMA Materials for 2011
Q 6
• CMA for Grades 8 –11
Separate answer documents and test booklets
Must return CST answer document only if CST taken
Return a CST answer document for every
CMA tester who takes a required gradelevel history –social science CST (grades 8 and 11), an EOC science CST (grades 9 –11), and/or an EOC history –social science CST
(grades 9 –11).
If no CST taken, return CST test booklet with non-scorables
Single DFA used for 9 –11
2011 STAR Pre-Test Workshop || Slide 29
CST/CMA Answer Document
Right side of inside of answer doc grades 4−7
CMA section has:
• Different subject icons from CST
• Alternate row shading for the response bubbles
• Three answer choices
• Fewer number of questions
2011 STAR Pre-Test Workshop || Slide 30
CMA Grade 7 Answer Document
Mathematics Section
Grade 7 mathematics and Algebra I have different numbers of questions
2011 STAR Pre-Test Workshop || Slide 31
Quiz Question 5
Terry is in the seventh grade and has scored advanced on the CMA for Mathematics test for the past three years. Should Terry take the CST for Mathematics test in 2011?
A. Yes, if the IEP team decides so
B. Yes, if Terry is taking the CMA for ELA
C. No, Terry should take the CMA for
Algebra I
D. No, Terry should take the CST for
Algebra I
2010 STAR Pre-Test Workshop || Slide 32
Quiz Question 5
Terry is in the seventh grade and has scored advanced on the CMA for Mathematics test for the past three years. Should Terry take the CST for Mathematics test in 2011?
A. Yes, if the IEP team decides so
2010 STAR Pre-Test Workshop || Slide 33
Quiz Question 6
If Mark, a student in the eighth grade, takes the CMA for ELA, Algebra I and
Science, how many answer documents must be returned for Mark?
A. One —CMA
B. One —CST
C. Two —CST and CMA
D. Three —CMA for Science, CMA for
ELA, and CST for Mathematics
2011 STAR Pre-Test Workshop || Slide 34
Quiz Question 6
If Mark, a student in the eighth grade, takes the CMA for ELA, Algebra I and
Science, how many answer documents must be returned for Mark?
C. Two —CST and CMA
2011 STAR Pre-Test Workshop || Slide 35
2011 STAR Pre-Test Workshop || Slide 36
STS
M 3,
14, 17
• STS for Reading/Language Arts (RLA) in grades
2 –11
• STS for Mathematics in grades 2 –7
• STS for Algebra I (EOC for grades 7 –11)
If Algebra I course completed in 2010−11 school year
• STS for Geometry (EOC for grades 8 –11)
If Geometry course completed in 2010−11 school year
Students in grades 8 and 9 who are not taking
Algebra I or Geometry courses take NO STS math, but do take CST math.
Q 7
2011 STAR Pre-Test Workshop || Slide 37
Who Takes the STS?
M 3, 14
• Required for Spanish-speaking English learners (EL), grades 2 –11, who either:
Receive instruction in Spanish; or
Have been enrolled in a school in the U.S. less than 12 cumulative months.
• Districts may also administer to other
Spanish-speaking ELs in grades 2 –11
• Not to be administered to English-only,
I-FEP, or R-FEP students
• All students must also take CSTs or the CMA
• Students who take CAPA do NOT take STS
2011 STAR Pre-Test Workshop || Slide 38
• Video: STS Middle School
2011 STAR Pre-Test Workshop || Slide 39
Quiz Question 7
Marta is an English learner in the eighth grade who has been in U.S. schools for 10 months. If she takes no mathematics course, what mathematics test must she take, if any?
A. CST for General Mathematics
B. CST for General Mathematics and
STS for Algebra I
C. CST for Algebra I and STS for
Algebra I
D. No mathematics test(s)
2011 STAR Pre-Test Workshop || Slide 40
Quiz Question 7
Marta is an English learner in the eighth grade who has been in U.S. schools for 10 months. If she takes no mathematics course, what mathematics test must she take, if any?
A. CST for General Mathematics
2011 STAR Pre-Test Workshop || Slide 41
Pre-ID early
Train
Multiple-Choice Tests
Receive delivery
District 10 –20 days before testing
School 5 –10 days before testing
Inventory
Distribute and track materials
Prepare materials
Test
Ensure correct
Master File and
SGID
Return for scoring
District 5 days after testing
School 2 days after testing
Pack with complete labels
2011 STAR Pre-Test Workshop || Slide 42
Multiple-Choice Tests
Pre-ID early
Train
Receive delivery
District 10 –20 days before testing
School 5 –10 days before testing
Inventory
Distribute and track materials
Test
Prepare materials
Receive boxes
Count before signing receipt: not
Ensure correct all boxes may come
Master File and in single delivery
SGID
Return for scoring
District 5 days after testing
School 2 days after testing
Pack with complete labels
2011 STAR Pre-Test Workshop || Slide 43
Pre-ID early
Train
Multiple-Choice Tests
Receive delivery
District 10 –20 days before testing
School 5 –10 days before testing
Inventory
Distribute and Prepare track materials materials
Test
Prep answer
Ensure correct
Master File and
SGID
Return for scoring •
• 2011 only
Pack with
District 5 days after testing complete labels
School 2 days after testing
2011 STAR Pre-Test Workshop || Slide 44
Pre-ID early
Train
Multiple-Choice Tests
Receive delivery
District 10 –20 days before testing
School 5 –10 days before testing
Inventory
Distribute and track materials
Prepare materials
Test
Ensure correct
Master File and
• SGID
• Return for scoring
•
Dist. 5 days after testing
•
School 2 days after testing
Pack with complete labels
2011 STAR Pre-Test Workshop || Slide 45
During Multiple-Choice Testing
• Use Directions for Administration
(DFAs) correctly
Read “SAY” boxes exactly as written
Translate boxes with “T” ONLY
(NO questions, prompts, or passages)
M 50
2011 STAR Pre-Test Workshop || Slide 46
During Multiple-Choice Testing
M 50
• Give correct test booklets and answer documents to students (e.g. grade 7 math or Algebra I to grade 7)
• Give breaks only at end of part
• Answer documents
Correctly mark test
Correctly mark version #
2011 STAR Pre-Test Workshop || Slide 47
CAPA
M 13−14
• Performance-based, one-on-one test
• Student must have an IEP
• IEP specifies CAPA and level
• For students with significant cognitive disabilities unable to take the CSTs even with accommodations and/or modifications or the
CMA with accommodations
• Do not take STS
• Answer document:
Use only 2011 answer document
Ensure correct CAPA Level is marked in 7a
2011 STAR Pre-Test Workshop || Slide 48
CAPA Observers
M 48−49
• Districts must double-rate at a minimum of ten percent (10%) of the CAPA students per level, per site
• Double ratings are randomly selected
• Observers must mark Observer and sign the answer document
Q 8
2011 STAR Pre-Test Workshop || Slide 49
Preparing To Administer the CAPA
Observers must mark sections
1 - Name, etc.
3 - Date of Birth
5 - Name
6 - Gender
7a - CAPA Level
7b - Grade
11 - Student ID
12 - SSID
2011 STAR Pre-Test Workshop || Slide 50
CAPA video
2011 STAR Pre-Test Workshop || Slide 51
Quiz Question 8
How many students should have a second rater/observer complete an answer document for an elementary school (K –6) with 47 CAPA students (1 Level I, 26 Level
II, and 20 Level III)?
A. 3
B. 4
C. 5
D. 6
2011 STAR Pre-Test Workshop || Slide 52
Quiz Question 8
How many students should have a second rater/observer complete an answer document for an elementary school (K –6) with 47 CAPA students (1 Level I, 26 Level
II, and 20 Level III)
D. 6
2011 STAR Pre-Test Workshop || Slide 53
Pre-ID
Train
Receive delivery
District 10 –20 days before testing
School 5 –10 days before testing
Inventory
Distribute and track materials
Prepare materials
Test
•
Master File and
•
• SGID
SGID Pack with complete labels
School 2 days after testing scorables vs. nonscorables
• Attach correct labels
2011 STAR Pre-Test Workshop || Slide 54
After Testing
Complete Back of Answer Document
• A1
M 34, 63
DO NOT complete without CDE notification
• A2 Special Conditions
• A3 Accommodations and Modifications
Part a: mark “IEP” (required to take CMA) and/or
“Section 504 plan” to indicate what plan(s) student has.
Part b, mark codes for all accommodations student used as specified in IEP and/or 504 plan
• A4 English Learner Test Variations
For each test, what was actually used
2011 STAR Pre-Test Workshop || Slide 55
Disability Code, 16a
• If not in Pre-ID, mark after testing
• Required
000 if no IEP
Valid code if IEP
For CMA and CAPA
000 not valid for
CMA or CAPA
• If 16a is not marked or marked 000 and IEP (A3a) is marked, district data file defaults to 999, unknown disability and must be corrected
M 113,
118−119
2011 STAR Pre-Test Workshop || Slide 56
After Testing
• Transcribe braille and large print
(or not processed)
M 40, 63
• Write
VOID on any answer document(s), with marks, not to be scored; return with nonscorables
2011 STAR Pre-Test Workshop || Slide 57
School Grade Identification Sheet
SGID
• Complete for each set of answer documents or test booklets
Preprinted
• Place on answer documents for correct
Q 9
Grade
School (school code machinemarked)
2011 STAR Pre-Test Workshop || Slide 58
M 24
After Testing
Master File Sheets M 65, 92
• Return with each school and district
• Required if materials were ordered:
Write “0” (zero), no blanks
If not tested, note that school did not test
2011 STAR Pre-Test Workshop || Slide 59
After Testing
Pack and Return M 40, 66
• Return all documents within an administration in same shipment
• Separate scorables (with SGID) from nonscorables: make sure grade on answer documents matches grade on SGID.
• Ensure correct school code correct (not correctable later)
• NPS documents
Under SGID with 0000001 code
With district materials
• Return Home/Hospital with student’s school
NOT NPS
2011 STAR Pre-Test Workshop || Slide 60
Complete Labels Correctly
Both district and school counts required
2011 STAR Pre-Test Workshop || Slide 61
• Multiple-choice video
2011 STAR Pre-Test Workshop || Slide 62
Quiz Question 9
District S has an SGID for McKinley Elementary
School. On which of these sets does this SGID belong?
A. McKinley High School answer documents
B. McKinley Elementary answer documents
C. McKinley Elementary test booklets
D. All late answer documents for District S
2011 STAR Pre-Test Workshop || Slide 63
Quiz Question 9
District S has an SGID for McKinley Elementary
School. On which of these sets does this SGID belong?
B. McKinley Elementary answer documents
2011 STAR Pre-Test Workshop || Slide 64
Quiz Question 10
On the Master File Sheet, what should you write next to the grade if a particular grade listed did not test but the rest of the school did?
A. Not tested
B. Zero
C. Nothing
D. 47
2011 STAR Pre-Test Workshop || Slide 65
Quiz Question 10
On the Master File Sheet, what should you write next to the grade if a particular grade listed did not test but the rest of the school did?
B. Zero
2011 STAR Pre-Test Workshop || Slide 66
Summary
• What’s New?
• Responsibilities, including training
• Writing tests
• CSTs
• CMA
• STS
• Multiple-choice tests
• CAPA
• After Testing
2011 STAR Pre-Test Workshop || Slide 67
For more information, go to: http://www.cde.ca.gov/ta/tg/sr/ http://www.startest.org/
Or call the STAR Technical Assistance Center
800-955-2954
2011 STAR Pre-Test Workshop || Slide 68