Managing Target Setting to Support School Improvement

advertisement
Assessment for Action
ASSESSMENT FOR ACTION
"Managing target setting
to support school improvement"
Assessment for Action
'Data is inert until someone handles it
and makes it powerful'
IBM
Assessment for Action
Contents
Foreword
What are targets and what is target setting?
Explaining the jargon
Indicators of good management practice
Developing and managing the learning culture
Making sense of data
Who does what with data
Setting performance targets
A process for analysing data
Assessment for Action
Foreword
Target setting has become synonymous with school improvement over recent years.
This booklet aims to clarify the various aspects of target setting, the part target
setting has to play in the day-to-day of classroom life and how target setting can
support school self-improvement.
This booklet has drawn from current legislation and government thinking. Ideas and
comments have also been gratefully received from many East Riding Primary
Headteachers and the Secondary School Target Setting Development Group members
who are working hard to implement statutory requirements and develop classroom
practice.
Geoff Mountain
Curriculum Project Manager
July 2001
Assessment for Action
What are targets and what is target setting?
A forecast is an expectation of an outcome, using professional judgement, if current
practice continues and maintains normal progress. In order to improve on this
forecast, changes must be made. This is the added challenge. This is a target.
Target = Forecast + Challenge1
Targets are therefore not predictions. They are aspirational, to be aimed for. There
should not be any recrimination if they are not reached. This is not to say that
professional discussion during evaluation cannot explore reasons for outcome
shortfalls and identify factors beyond control. At such times targets should be
reassessed and alternative ways forward should then be agreed.
Target setting has become an important addition to the vocabulary of schools over
recent years. Target setting is central in the Government’s drive to raise standards in
schools. Like the word assessment, its predecessor, which began to develop a high
profile in educational jargon around ten years ago, target setting is a catch-all phrase
and holds different meanings to different people. Currently it is likely to apply to one
or more of the following situations in a school:
 Setting whole school quantitative performance targets
These targets are all expressed numerically and refer to the achievements of a year
group some time (usually five terms) in the future.
School targets must be published in the Annual Governors' Report to Parents and the
local authority's Educational Development Plan.
At present there is only a requirement to set and publish
targets for:
English and mathematics at the end of KS2
English, mathematics and science at the end of KS3
GCSE (or equivalent) at the end of KS4
1
DfEE From Targets to Action PP98/30478/1197/353
Assessment for Action
These statutory targets will contribute to the national and local published targets.
National targets have been published by the government for literacy and
mathematics at the end of KS2 for 2002 and for GCSE (or equivalent) at the end of
KS4 . There are also national learning targets for post-16 students. LEAs publish a
range of targets in their Education Development Plan including targets for English
and mathematics at the end of KS2, GCSE (or equivalent) at the end of KS4,
unauthorised absence and exclusion. There are also targets for GCSE (or equivalent)
for looked after children on leaving public care.
 Setting subject/year quantitative performance targets
Schools are encouraged2 to set additional whole school targets within school to
support self-improvement, beyond the minimum requirements of statutory targets.
They will reflect the priorities for each school and indicate targets for the outcomes
of children. It is suggested that these targets feature in the school development
plans.
 Setting qualitative school/subject/year targets for improvement
Not all targets will be expressed as numbers. Although the main focus for school
improvement is in terms of the achievements of children, some targets might be to
improve other aspects of the school, such as behaviour or refurbishment, which will in
the fullness of time, have a positive effect on the children's outcomes.
 Setting ‘next steps’ learning targets with children
Learning targets and learning objectives are used with classes, groups or individuals.
Learning targets can be short term - defining the next steps to take in order to
improve, or medium term - for the end of a unit or piece of work. Expressed in a
meaningful way to children (‘childspeak’), they can be linked to progression in the NC,
key skills, behaviour etc. These are sometimes referred to as pupils’ attainment or
progress targets. Learning objectives (what a class, group or individual is expected
to know, understand or be able to do after a piece of work) can be expressed
appropriately and shared with children as learning targets.
2
DfEE From Targets to Action PP98/30478/1197/353
Assessment for Action
 Setting attainment or progress targets with children for the end of
year/key stage
Longer term, end of key stage learning targets can be set and expressed in terms of
NC levels. Sharing numerical targets with children and students is becoming more
common. Great sensitivity must be applied when having these discussions: targets
should motivate, be realistic but not limit potential.
To summarise:
Quantitative performance targets are an outcome of a ‘management’ process
responding to an identified issue. This process analyses data and develops a strategy
for improvement through change (in the curriculum or organisation). It summates
individual children's long term learning targets, views them alongside an historical
perspective and brings them together using professional judgement. A process for
setting performance targets is detailed in the last section of this booklet.
Learning targets are part of teaching and learning – the ongoing process in the
classroom and part of the relationship between the child and subject teacher or
tutor.
Assessment for Action
Indicators of good management practice
Developing the learning culture
Many of the elements which contribute to effective target setting are and always
have been, present in good schools. Teachers will recognise existing good teaching and
learning practice, now expressed in the new language of target setting.
It is the role of senior managers to make the most effective use of this good
practice by bringing together, linking and co-ordinating the different elements. They
can incorporate target setting into the school’s assessment policy and then manage
target setting to support school development.
Effective implementation
Target setting cannot be introduced overnight. Even at the simplest operational level,
for example, the management of data needs careful consideration. Many teachers
have difficulty in accepting the importance of target setting. There may well be a
need to win over hearts and minds. The introduction of target setting therefore
needs to be planned and its implementation phased.
At school level target setting will be supported if:
 There is an on-going commitment and support from senior management - it cannot be
delegated to staff without ‘authority’
 There is a programme of staff development at management, classroom teacher and tutor level
 Appropriate comparative benchmarking data is provided
 A consistent whole school approach to recording information is developed, in terms of subject
specific and general attainment
 The transfer of information between tutors, classroom teachers and managers is organised
 Time is built in for agreeing targets (and subsequently for reviewing progress towards them)
between senior managers and heads of faculty/subject/year, between subject managers/year
leaders and teams, and between classroom teachers/tutors and children
Assessment for Action
What are the essential characteristics of schools where effective target setting
takes place?
A target setting culture will only be effective and lead to improved pupil performance
if it is well managed. The various tiers of management within a school each have their
role to play.
Management at whole school level
At whole school level, the management and development of the processes of
assessment to inform target setting, requires the Headteacher and governors to
have a clear understanding of how target setting can raise standards and a
commitment to target setting, demonstrated through leadership and the priority it is
afforded.
Senior Managers need to ensure that:

There is a staff development programme to explain the purposes of the different aspects of target
setting
 Quantitative and qualitative performance targets appear in faculty, subject, year team and school
development plans
 The managers know and understand their roles and responsibilities in relation to achieving targets
 Target setting with children is integrated into the assessment, recording and reporting policy
 Classroom teachers and tutors understand what is expected of them, in terms of target setting with
children
Assessment for Action
Management at subject and pastoral level
Target setting with children in the classroom will only be effective if its introduction
is planned, phased and resourced.
Subject Leaders will need to ensure that:






Subject teachers have a clear understanding of progression through the key stage in terms of
National Curriculum levels
Lessons/blocks/projects are planned with clearly expressed learning objectives
Learning objectives are shared with children (learning targets
Class/group or individual ‘next steps’ (as appropriate) are shared with children (learning targets), to
help them make progress towards the learning objectives
Learning outcomes are shared with children (what the child will know/understand or be able to do
when they meet their learning target – how they will be assessed)
Children know their aspirational attainment or progress target (level) for the end of year/key stage
as appropriate
In secondary schools Pastoral Managers will need to ensure that:


There is pre-planned regular time for one-to-one/small group review
The tutor has information about pupils’ current subject specific and general strengths and
weaknesses
 The tutor has information about pupils’ potential from an analysis of prior and current attainment
 Class/group or individual ‘next steps’ as appropriate to make progress are shared with children
(learning targets)
 Children know their aspirational attainment or progress target (level) for the end of year/key stage
as appropriate
Assessment for Action
Making sense of data
Schools are faced with a plethora of data. External sources, such as examination
boards, key stage test agencies, the DfEE and the LEA provide data on an annual
basis and schools generate their own. How should it be used to inform target setting
and is it all necessary?
In the Autumn Package, the DfEE poses questions for schools to consider when
reviewing performance and recommends using data within a five stage cycle for
school improvement3. This publication links the school improvement cycle with the
performance management cycle and complements a similar wallchart published earlier
by the DfEE4. Ofsted commissioned a course on using data to inform judgements
about standards of achievement. This led to a useful publication providing further
insight into the use of data5.
A strong message coming from education analysts is that interrogating data does not
provide answers but often does raise issues worthy of further questioning.
Data certainly should not be ignored and outside bodies will use the data on your
school to make some initial assumptions about the children and teachers. A wise staff
will anticipate these assumptions and be able to support or challenge them through a
deeper analysis and interpretation based on their knowledge of their school and its
particular circumstances.
Who does what with data?
When suggesting appropriate sets of data to be used by those with different
responsibilities in school, it must be remembered that in small schools and small
classes, using percentages needs care.
In a group of 20 each child is contributing 5% to the figures, in a group of 10 each
child represents 10% of the figures etc. In these situations one child is sufficient to
have a big positive or negative effect when comparing with national results and it is
important to be able to explain results through a thorough knowledge of what lies
beneath the figures.
3
DfEE wallchart ‘Recognising progress – Getting the most from your data’ DfEE0253/2000 (primary),
DfEE0254/2000 (secondary)
4
DfEE wallchart ‘Getting the most from your data’ AUTLEAF 1-2 (primary), AUTLEAF 3-4
(secondary)
5
The Numbers Game, Hedger & Jesson ISBN 0 9536299 1 0
Assessment for Action
Senior Managers' use of data
The senior management team needs to have a strategic overview of academic
attainment within the school. In a large school it would be inappropriate for this team
to make a detailed analysis of all published data and teacher assessments. The SMT
should in this case delegate specific duties to subject managers and arrange for
feedback (see Indicators of good practice).
An analysis of the DfEE Autumn Package Sections 1 and 3 followed by discussions
with subject managers will help the senior management team to answer the following
questions6:






How do the results in any subject compare with national averages and with results in ‘similar’
schools?
How do boys' and girls' results compare within a subject?
How do boys' and girls' results compare between subjects?
What are the trends in results over recent years?
How do the results of particular groups (ethnic, looked after, more able etc) compare?
Are there any particular features (teaching, grouping etc) which contribute to one subject being
more successful than another?
These questions should lead to identification of emerging priorities across the school
and within subject areas and so feed the school development plans.
There might be further questions the SMT considers appropriate to ask across the
school or to certain subject managers, which reflect the particular circumstances of
the school. For example pupil mobility can result in published figures not reflecting
the true picture of the school’s performance and the school would need to consider
recalculating results to highlight any effects this might have had.
Senior managers will also have to set statutory targets. This process should be
informed by the analysis of data by subject managers and their teams.
Subject Leaders' use of data
Subject leaders need to have knowledge of the overall performance of children in
their area and be aware of how it compares with their performance in other areas.
They need to know how different classes or groups of children within their area
6
These questions are adapted from the DfEE Autumn Package Sections 1 and 3. The school’s PANDA
will provide data for core subjects (and most foundation subjects at KS4).
Assessment for Action
progress over time and their level of attainment over a key stage. It is for the school
to decide how best to ‘track’ children’s progress and when to make teacher
assessments against the National Curriculum.
When analysing end of key stage published data, subject leaders will need to be
aware of the relevant data in sections 1 and 3 of the Autumn Package and make a
detailed analysis using section 27. In a large school it would be appropriate for each
teacher to analyse the results of their own class and feedback to the subject
managers. This will help subject leaders answer the following questions8:






How do the results of different groups or classes compare?
How do the results of particular children (boys, girls, SEN etc) compare?
How does the progress of different groups or classes compare?
How does the progress of particular children (boys, girls, SEN, high prior attainment etc) compare?
Are there any particular features which contribute to one group or class making more progress than
another?
How does performance relate to the targets set for those children?
Using data to look back and reflect on past performance will help identify emerging
priorities within the subject areas and so feed the subject area and school
development plans. Subject leaders will need to look forward and set appropriate
targets for present cohorts of children. This process will be informed by the analysis
each classroom teacher undertakes.
Classroom Teachers use of data
The classroom teachers primary concern is 'tracking' the progress their current
class or teaching groups are making. The school should agree a manageable system
which provides sufficient essential data to enable teachers to do this without
requiring burdensome record keeping beyond the teachers own mark-book.
Many schools now routinely provide each teacher with a set of previous end of key
stage results, the latest teacher assessment levels in the current key stage and
standardised scores for reading, maths or non-verbal reasoning as available.
7
The school’s own records of end of previous key stage results will be needed to enable analysis
These questions are adapted from the DfEE Autumn Package Section 2 and the DfEE wallchart
‘Recognising progress – Getting the most from your data’
8
Assessment for Action
The Autumn Package suggests how teachers might use Section 2 to compare the
progress children in their current classes are making with the progress children, who
reached the end of a key stage in the last academic year, made nationally. This
analysis recognises that comparisons must be made with children of a similar prior
attainment.
Classroom teachers should ask themselves the following questions9:



Have I set appropriate expectations at the beginning of the year for the class?
How do children's (and their parents) own expectations differ from mine?
Are there any particular features I can identify, which contributed to one group or class making more
progress than another over recent years?
Teachers are, of course, free to make more use of data10.
Pastoral Teams use of data in secondary schools
The tutor or member of staff charged with having an 'academic overview' of children
should be examining analyses, provided by the subject teachers, for their general
strengths and weaknesses, progress across the curriculum and any areas standing out
as cause for concern.
9
10
These questions are adapted from the DfEE Autumn Package Section 2
Making pupil Data Powerful, Pringle & Cobb, Network Educational Press Ltd. ISBN 1 85539 052 3
Assessment for Action
Who does what with data - summary
Autumn
Package
section
Section 1
Section 2
Section 3
Section 2
Section 3
Who should analyse
What to look for
Identifying issues
SMT with subject managers
Strengths and weaknesses
Trends in attainment
Rates of progress
Classroom teachers with subject managers
Attainment and rate of progress
(At KS3 foundation subjects construct bar
by gender, SEN, groupings,
charts from section 1 data)
differentiation
SMT with subject managers
Comparing progress across
subjects
Setting targets
Individual and group targets – subject manager
Individual issues
with team
Groupings
Whole school targets – SMT informed by
Support and resources
individual and group targets
Questions to ask
Autumn Package
Autumn Package
p2 of DfEE poster
Autumn Package
Autumn Package
DfEE poster
Assessment for Action
Setting performance targets
Schools have a statutory duty to set numerical, end of key stage performance
targets. The DfEE five stage cycle for school improvement, referred to earlier,
details the steps to follow in order to arrive at any numerical target, through a series
of questions. It is suggested that these questions are applied to each subject or
group for which you wish to set a target.
“How well are we doing?” asks you to question the trend in results over recent years.
This in itself does not give sufficient information for deciding the next target as it
takes no account of the present cohort of children and is of little value in small
schools where large fluctuations in performance are commonplace. In larger schools
or those with broadly similar cohorts, however, it often indicates a pattern and, in
practice, schools must introduce radically different strategies to affect this pattern.
“How do we compare with similar schools?” asks you to ‘benchmark’ your results
against those from ‘similar’ schools. Two sets of benchmark data are provided by the
DfEE – free school meal and more recently, prior attainment which is being taken as a
fairer indicator. For target setting purposes there is nothing to stop schools
calculating the free school meal entitlement figures for a particular cohort (the
school PANDA uses the figure for the whole school) and choosing the appropriate
table in the Autumn Package for benchmarking. Similarly, it might well be appropriate
to calculate the prior attainment for a particular group of children (the school
PANDA uses a figure for those children tested at the end of the previous key stage,
some or many of whom may well be different from the present group).
Assessment for Action
“What more should we aim to achieve?” suggests that you consider each child in the
cohort and forecast their likely outcome. This involves the teacher using the Autumn
Package chances graphs, alongside information held by the school about each child’s
progress and ongoing teacher assessments, to make a professional judgement. The
forecasts can be aggregated for a class or cohort11.
Arriving at the numerical target requires you to consider these three pieces of
evidence together12 and make a sensible decision about the likely outcome and the
realistic degree of challenge you wish to add. This becomes the numerical target.
“What must we do to make it happen?” is the essential question to ask if the target
has any chance of being met. You should now look back at the difference between
the forecast for each child and the set target and ask the following type of question:
How many children will have to move up a level, in order that the school meets
its target?
Who are these children?
What do we need to do to make this happen in terms of changing our teaching,
curriculum, groupings, classroom procedures?
This is “target getting” and as it says in the last chapter of ‘The Numbers Game’ –
“it’s easy really”!
11
12
See table for aggregation of chances at the end of this section
See table for setting targets at the end of this section
Assessment for Action
Setting targets – table for considering data
School
trend over time
Subject
1998
1999
2000
National
FSM benchmark
UQ
Med
LQ
National
Prior attainment
benchmark
UQ
Med
LQ
Forecast from
present
performance
Agreed
target
Notes
Trends over time can have little relevance with small cohorts with fluctuating profiles
When choosing Free School Meal or prior attainment benchmarks from the Autumn Package, use the most appropriate for that
cohort if there is variation in entitlement across the school or the cohort has changed since the end of the previous key stage
Do not confuse a forecast of results based on the children’s present performance with any targets they might have
Assessment for Action
Forecasts from progress charts - example
KS3 aps
1
2
3
4
5
6
7
8
9
10 (n)
n
xn100
Name
Abe
Beth
Carrie
David
Emma
Fred
Garry
Herbert
Irene
John
Total
Group
Numbers
23
33
31
43
35
33
21
31
53
41
% chance
of children
at each
level
U
3
3
6
.6
0
G
12
1
1
1
12
1
28
2.8
0
F
29
2
2
2
2
29
2
66
6.6
1
GCSE English % Chances
E
D
C
35
17
3
10
34
40
10
34
40
2
16
15
44
31
10
34
40
35
17
3
10
34
40
2
16
2
16
112
191
258
11.2
19.1
25.8
1
2
3
B
A
A*
11
11
40
7
11
1
1
32
9
11
40
40
195
19.5
2
1
32
32
107
10.7
1
1
9
9
27
2.7
0
Notes
Each child’s chances are entered from their previous key stage average points score (aps) – in this case English KS3 aps to GCSE
English chances, Y2000 Autumn Package
The chances in each column are totalled, then divided by the number in the group, to give you the % chances for the spread of
levels across the group
The group chances are converted and rounded into the numbers of children forecast to attain each level
Download