Michael Luke
michael.luke@doe.state.nj.us
609-984-9637
Basic Definitions
Test Design 2010
Item Alignment
Calculator Usage
Item Review (Subjective), Field Testing, Rangefinding (Rubric Development), and Item Review (Objective)
Raw Cuts 2008/2009
Results 2008/2009
Questions
Basic Definitions
 MC- multiple choice item, 0/1, 1.5 minutes response
time
 SCR- short constructed response item, 0/1, 2 minutes
response time
 ECR- extended constructed response item, 0/1/2/3, 10
minutes
 Standards, cluster, strand, cumulative progress
indicator (cpi)- see sample item #1
Test Design 2010- Grades 6, 7, & 8
Test Part of 6
Number of Items, Timing
Part 1
10 SCR, 20 minutes
Part 2
8 MC, 1 ECR 22 minutes
Part 3
8 MC, 1 ECR 22 minutes
Part 4
10 MC, 1 ECR 25 minutes
Part 5
10 MC, 1 ECR 25 minutes
Part 6
6 MC, 1 ECR 19 minutes
Test Design Comparison
2009
2010
 SCR 8/10
 10 SCR
 MC 45
 MC 42
 ECR 4
 ECR 5
Test Design 2010- Grades 6, 7 & 8
 Test Length: Grades 6 and 7- day 1 64 minutes, day 2
69 minutes; or Grade 8 133 minutes (+5)
 Each assessment contains embedded field test items49 operational score points (last year 50, 52)
Item Alignment 2010
 Previously, items representing 12/13 raw score points
were aligned to each cluster
 For 2010, raw score points per cluster are proportional
to the number of “bold” CPI’s in the Areas of Focus
documents
http://www.nj.gov/education/aps/cccs/math/njscp.ht
m
Item Alignment 2010
Points by Cluster
Grade 6
Grade 7
Grade 8
1
13
13
13
2
17
13
17
3
9
12
11
4
10
11
8
Calculator Usage 2009 v. 2010
2009
2010
 Grade 6, Part 1 (SCR items)
 Grades 6, 7, and 8, Parts 1, 2,
only was noncalculator
 Grades 7 and 8, entire
assessment was calculator
active
and 3 are noncalculator
 23 raw points from
noncalculator items (47%)
 26 raw points from calculator
active items (53%)
 See memos
Item/Form Development
Item Review (Subjective)
Field Testing
Rangefinding (Scoring)
Item Review
(Objective) Statistics
Review
Form Construction
 Form is then constructed using item statistics, making
sure aligned items meet required Cluster
Representation (see earlier slide), and Item Type
counts (see earlier slide). Items of various difficulties
are used; however, attempt is made to replicate overall
form difficulty of previous year.
Raw Cuts 2008/2009 Teacher Panel
Established Using Bookmark
Method Summer 2008)
Grade
2008-P(200)
2009-P
2008-AP(250)
2009-AP
6 (out of 50)
25
26
41
40
7 (out of 52)
27
27
42
41
8 (out of 52)
29
28
43
42
Results 2008/2009 (Percents of
Student Results in Categories)
Grade
Proficient
2008
Proficient Advanced Advanced
2009
Proficient Proficient
2008
2009
6
51.7
45.7
20.1
26.1
7
44.3
42.5
19.9
24.2
8
42.4
42.6
24.8
29.9
Results 2008/2009 Sums of
Categories (P+AP Percentages)
Grade
2008
2009
6
71.8
71.8
7
64.2
66.7
8
67.2
72.5
Testing Misconceptions
 On the sixth grade 2008 ASK four of the five easiest
points to accumulate are the first point in an ECR item
(scaffolding) and the two toughest points to
accumulate were from MC items.
New Eighth Grade Reference Sheet
for 2010
 See http://www.nj.gov/education/assessment/ms/5-
8/ref/math/G8MathRef09.pdf
Questions?
 michael.luke@doe.state.nj.us
 609-984-9637