CEM Conference
8 June 2011
Using CEM data:
Convincing colleagues, pupils & parents
Bands, percentiles, standardised scores…
C
B
A
D
0
50
60
70
80
90
100
110
120
130
140
Standardised scores
Percentiles:
1
5
10
20
30 40 50 60 70
80
90
95
99
150
Band Profile
Graph: all MidYIS cohort
Overall: Percent in each Band
Year 9/S2 MidYIS Test 2009/2010
100
90
79
80
70
Percent
60
50
40
30
15
20
10
1
5
0
D
C
B
Current Year 10
A
Band Profile Graph: all MidYIS cohort
100
90
81
80
70
Percent
60
50
40
30
20
16
10
0
3
0
D
C
B
Current Year 11
A
The Computer Adaptive Baseline Test (CABT)
In 2009 / 2010 approx 200,000+ students sat the test
• This slide shows data for the top year 9 students. Assess the
information that this data provides to help the teacher?
• Who do you think is on this list?
Average
114.3
118.7
110.8
109.0
116.9
St. error
1.3
1.4
1.3
1.3
1.4
Band
St. Score
MidYIS Score
Band
St. Score
Skills
Band
St. Score
Non Verbal
Band
St. Score
Maths
Band
St. Score
Vocabulary
Sex Cust
M
M
M
M
M
M
M
M
M
M
M
143
133
136
132
131
115
125
125
124
118
126
A
A
A
A
A
A
A
A
A
A
A
129
137
129
132
132
149
134
134
135
142
132
A
A
A
A
A
A
A
A
A
A
A
120
144
105
132
106
110
123
102
112
143
106
A
A
B
A
B
A
A
B
A
A
B
126
146
145
130
123
134
140
110
130
111
96
A
A
A
A
A
A
A
A
A
A
C
138
137
134
134
133
132
131
130
130
130
130
A
A
A
A
A
A
A
A
A
A
A
This slide shows data for the top year 9 students ranked by
Mathematics ability.
• What potentially important information is obtained from this
data to help the teacher?
• Who is on this list?
Surname
Forename
SALE
OLIVER
DU VAL DE BEAULIEU
THOMAS
ROBSON
HARRY
CAIRNS
OSCAR
WHITAKER BEN
BRILL
MAX
KENNEDY EDWARD
WADHAM THOMAS
NEWTON BEN
WATKINS GEORGE
Average
114.3
118.7
110.8
109.0
116.9
St. error
1.3
1.4
1.3
1.3
1.4
Sex
M
M
M
M
M
M
M
M
M
M
Band
St. Score
MidYIS Score
Band
St. Score
Skills
Band
St. Score
Non Verbal
Band
St. Score
Maths
Band
St. Score
Vocabulary
Cust
115
100
118
117
119
133
120
113
115
124
A
C
A
A
A
A
A
A
A
A
149
143
142
141
139
137
137
136
136
135
A
A
A
A
A
A
A
A
A
A
110
112
143
135
126
144
105
120
120
112
A
A
A
A
A
A
B
A
A
A
134
95
111
101
129
146
101
134
106
130
A
C
A
B
A
A
B
A
B
A
132
120
130
129
129
137
129
125
126
130
A
A
A
A
A
A
A
A
A
A
But the questions on the test have
nothing at all to do with my
subject...!
Predictions
7.4 points = A*/A
6.1 points = D
Use data that:
• is reliable
• gives consideration to each subject
• is based on a national representative sample
• provides information in an accessible format
• is easily understood
• IS USED TO HELP INFORM PROFESSIONAL JUDGEMENT
Give due consideration to factors such as:
•
•
•
•
•
•
•
•
Knowledge of student
Parental support/home life
Peer influences/social life
Student attitude, interest and job commitments
Expectations of staff
Department/institution ethos
Resources
The institution’s prior value added data
Individual Pupil Record
Date Of Birth:
Sex:
MAX BRILL
Student Number:
Form:
16/12/95
M
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
110855705547
3S/IT1
MidYIS Band
Stanine
Percentile
Standard
Score
A
A
A
A
A
9
9
9
9
9
99
99.0
99.0
99.0
99.0
133
137
144
146
137
Nationally Standardised Scores with 95% Confidence Band
150
Nationally Standardised Scores
140
130
120
110
100
90
80
70
60
50
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
CHARLES
HAYDNTAYLOR
Individual Pupil Record
Date Of Birth:
Sex:
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
Student
Number:
Form:
06/01/96
M
1043340992
3S/IT6
MidYIS Band
Stanine
Percentile
Standard
Score
A
6
75
110
C
5
46
99
B
5
51
100
A
7
82
114
B
6
63
105
Nationally Standardised Scores with 95% Confidence Band
Nationally Standardised Scores
150
140
130
120
110
100
90
80
70
60
50
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
Individual Pupil Record
Date Of Birth:
Sex:
ALEXANDER BAILEY
Student Number:
Form:
01/01/96
M
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
1043927886
3S/IT5
MidYIS Band
Stanine
Percentile
Standard
Score
A
A
B
C
A
8
9
6
4
9
96
98
66
39
98
126
132
106
96
130
Nationally Standardised Scores with 95% Confidence Band
150
Nationally Standardised Scores
140
130
120
110
100
90
80
70
60
50
Vocabulary
Maths
Non-Verbal
Skills
MidYIS Score
Band Profile Graph: all MidYIS cohort
100
90
81
80
70
Percent
60
50
40
30
20
16
10
0
3
0
D
C
B
Current Year 11
A
Percent in eachin
Band
Skills –Skills:
Percentage
each Band
Year 9/S2 MidYIS Test 2009/2010
100
90
80
70
Percent
60
46
50
40
30
22
23
20
10
9
0
D
C
B
A
Proof Reading: Percent in each Band
Year 9/S2 MidYIS Test 2009/2010
100
90
80
70
Percent
60
50
40
40
30
23
26
20
11
10
0
D
C
B
A
This will be interpreted as
a personalised prediction
GCSE Chemistry
Pupils with a MidYIS Score of 109 (band B) achieved the following spread of results:
35
30
28
26
25
21
Percent
20
17
15
10
6
5
2
0
0
1
U
G
F
0
E
D
Grade
C
B
A
A*
GCSE Chemistry
Pupils with a MidYIS Score of 123 (band A) achieved the following spread of results:
45
40
37
35
30
Percent
30
25
21
20
15
10
10
5
2
0
0
0
0
U
G
F
E
0
D
Grade
C
B
A
A*
This boy’s ‘Baseline Suggested Grade’ is grade A*
Through our progress reporting system teachers
are asked to assess his current progress against
this BSG and to suggest what the likely outcome
is AT THE END OF THE COURSE
The data doesn’t work for
this particular student
Give due consideration to factors such as:
•
•
•
•
•
•
•
•
Knowledge of student
Parental support/home life
Peer influences/social life
Student attitude, interest and job commitments
Expectations of staff
Department/institution ethos
Resources
The institution’s prior value added data
You’re raising false expectation –
he’ll never get that result!
You’re making us accountable for
guaranteeing particular grades –
when the pupils don’t get them
we’ll get sacked and the school will
get sued!
Tips:
1. Make sure that colleagues have every
opportunity to ask questions and be
prepared to go over things multiple
times.
2. Don’t get too focused on the BSGs at
the expense of the chances graphs.
3. Give colleagues forms of words to use
to advise when the data may not work
for a particular individual.
GCSE English
Pupils with a MidYIS Score of 112 (band A) achieved the following spread of results:
45
40
35
35
33
Percent
30
25
20
16
15
13
10
5
2
0
0
0
0
U
G
F
E
0
Grade D
C
B
A
A*
GCSE English
Pupils with a MidYIS Score of 132 (band A) achieved the following spread of results:
75
68
70
65
60
55
50
Percent
45
40
35
30
25
25
20
15
10
6
5
0
0
0
0
0
1
U
G
F
E
D
C
0
Grade
B
A
A*
GCSE English
Pupils with a MidYIS Score of 122 (band A) achieved the following spread of results:
50
45
40
40
38
35
Percent
30
25
20
18
15
10
4
5
0
0
0
0
0
U
G
F
E
D
0
Grade
C
B
A
A*
Make sure you have planned the logistics
well in advance:
•Distribution of graphs
•Data entry of BSGs into MIS
•Process for staff to enter necessary
information
•Process for distributing final progress
sheets
Pupils
1. Make sure they know why they are taking the
test.
2. Make sure they take it seriously
3. Make sure they don’t deliberately mess it up
in order to lower their BSGs!
4. Be prepared to look for clear anomalies and
re-test if necessary
5. Explain the chances graphs to them clearly
Parents
1. Make sure they know why they the pupils are
taking the test
2. Explain the results to them
3. Explain lots of times that the chances graphs
and BSGs do NOT give personalised predictions
4. Ensure that they receive good quality feedback
from staff when ambers or reds are awarded
5. Encourage them to ask lots of questions