The LEA Inclusion Rating Scale

advertisement
The LEA INCLUSION RATING SCALE:
A tool for supporting self-review
Dave Tweddle, Diane Risk, Professor Mel Ainscow, The University of
Manchester, Andy Simpkins, Greater Merseyside SEN Regional Partnership,
Diane Whalley, North West SEN Regional Partnership
dave.tweddle@ukgateway.net
diane.risk@talk21.com
mel.ainscow@manchester.ac.uk.
andy.simpkins@stockport.gov.uk
diane.whalley@btconnect.com
Introduction
During the past three years, the Greater Merseyside and North West Special Educational
Needs (SEN) Regional Partnerships have worked with The University of Manchester on a
range of issues relating to the promotion of inclusive policies and practices. A key component
of this initiative has involved working with Local Education Authorities (LEAs) in the two
regions on the development of a review instrument called The LEA Inclusion Rating Scale.
We need to be clear about what we mean by the term ‘the LEA’. It is understood, of course,
that the maintained schools in a local authority are part of ‘the LEA’. Within this context,
however, we are taking the ‘the LEA’ to mean the people, services and units that comprise
the Council’s Education Department.
It is important to stress that this is not a manual that provides standardised instructions for
using the Rating Scale. Indeed, there is no single correct way of using the instrument. It was
intended to be a flexible tool that can be used in a variety of ways to support the self-review
process. It can help the LEA to orchestrate a process that: engages stakeholders; raises
awareness; identifies issues for further investigation; and, eventually, clarifies priorities for
development. However, the detail of precisely how it is used is a matter for each LEA to
decide and should be influenced by the unique circumstances and context of that LEA.
The Rating Scale materials, and the way in which they have been used in LEAs, have
evolved during this development period. They have not been copyrighted or produced
commercially, and have been made freely available on request with permission to copy or
modify in whatever way seems helpful. This short pamphlet, therefore, describes ‘work in
progress’. It contains the text of the materials currently being used, and provides an account
of their development and some possible applications.
Early Work
This work began in 2001 when the Greater Merseyside SEN Regional Partnership
commissioned the University of Manchester to work with representatives of the six
Merseyside LEAs on ‘the promotion of inclusion’.
A consensus quickly emerged that the first step ought to be to clarify what is meant by
‘inclusion’. Although the term has been in popular use for some years, there was a degree of
confusion about its precise meaning – certainly between, and often even within, individual
LEAs. Reaching agreement on a working definition of inclusion was not as difficult as some
colleagues felt that it might be, and the following key ideas quickly emerged.
It was agreed that inclusion is concerned with the ‘presence, participation and achievement of
all learners’. ‘Presence’ is taken to be about where children and young people are educated,
and whether they attend regularly and arrive punctually. ‘Participation’ is concerned with the
quality of learners’ educational experiences, their self-esteem, whether they feel valued and
that they belong, and the quality of services received by their parents or carers. And,
‘achievement’ (as opposed to ‘attainment’) is about learning outcomes across the whole
curriculum, both inside and outside the classroom.
It was further agreed that our aspiration should be to promote inclusion for all children and
young people. Nevertheless, it was assumed that an emphasis should be placed on those
groups of learners who – for whatever reason – may be at risk of marginalisation,
underachievement or exclusion. Safeguarding the interests of our most vulnerable learners, it
was argued, is a fundamental responsibility of the LEA. It should be noted therefore that,
from a very early stage, this work was not characterised as a SEN initiative.
Finally, it was also recognised that the development of inclusive policies and practices is a
complex and continuous social process. It is concerned with engaging a wide range of
stakeholders in identifying and removing barriers to the inclusion of all learners. In other
2
words, the promotion of inclusive education needs to be seen as a long-term strategic
aspiration.
Agreeing a working definition of inclusion was felt to be a prerequisite to effective
collaboration between the LEAs in the Greater Merseyside region. It was regarded as an
essential first step, providing a basis for the development of procedures for reviewing
inclusive practice, recognising and celebrating good practice, and identifying issues for further
development. Such a definition was eventually agreed that was based on the ideas described
in the previous paragraphs. This was called the ‘Greater Merseyside Position Statement
on Inclusion’. The Statement, which appears in full below, was formally endorsed by the
Greater Merseyside Chief Education Officers’ Group and became the touchstone for all
subsequent developments.
GREATER MERSEYSIDE
POSITION STATEMENT ON INCLUSIVE EDUCATION
Greater Merseyside LEAs are committed to working with each other, and with all
other relevant stakeholder groups, in order to promote inclusive education across
the region. This commitment is underpinned by the following shared understanding
of the meaning of inclusion.
Promoting inclusive education involves identifying and removing barriers to
the ‘presence, participation and achievement’ of all children, young people
and adults. We believe that this commitment embraces a fundamental
responsibility to place a particular emphasis on those learners who may be at
risk of underachievement, marginalisation or exclusion.
‘Presence’ is concerned with where learners are educated, and whether they
attend regularly and arrive punctually. In line with Government policy, we believe
that wherever possible learners should be enabled to receive their education in a
mainstream setting.
‘Participation’ is concerned with the quality of learners’ educational experiences,
whether they feel involved and valued, and the quality of services received by their
carers/parents. We believe therefore that learners’ own views and opinions, and
those of their parents/carers, should form an essential part of any judgements
made about the quality of their participation.
‘Achievement’ is concerned with learning outcomes across the whole curriculum,
both inside and outside the classroom. We believe, therefore, that achievement
should not be judged solely on the basis of test and examination results.
It is acknowledged that the development of inclusive policies and practices is a
complex and long-term social process. It is a process that needs to engage
actively all of those involved in the education of children, young people and adults.
In particular, it is recognised that promoting inclusion should be an aspiration for the
‘whole LEA’ with all individuals, services and units within the organisation
understanding the contribution that they make.
Finally, the Greater Merseyside LEAs are committed to evaluating progress
towards more inclusive policies and practices. We believe that such progress
should be judged in terms of the impact of our policies and practices on the
presence, participation and achievement of all learners.
3
Towards a Review Framework
During the development of this Position Statement, it became clear that the promotion of
inclusion needs to be tackled on a ‘whole-LEA’ basis. In other words, everything that the LEA
does may facilitate or inhibit the development of more inclusive policies and practices. Every
service and unit within the LEA has a contribution to make.
This was an important idea. Everybody in the LEA needs to understand what inclusion is,
‘own’ this shared aspiration to promote inclusion, and work out how they can make a
contribution. This applies to the senior leadership team, finance officers, those responsible
for governor training, school improvement officers, personnel officers, educational
psychologists, pupil welfare officers and so on. This, of course, cannot be achieved by
groups of professionals working in isolation. It requires genuine collaboration across the
whole LEA.
The next step, therefore, was to agree the factors, or aspects of the LEA’s operations, that
might potentially facilitate or inhibit progress towards more inclusive policies and practices.
Twelve factors were identified. These were:
Definition
Leadership
Attitudes
Policies, Planning and Processes
Structures, Roles and Responsibilities
Resourcing
Support and Challenge to Schools
Responding to Diversity
Specialist Provision
Partnerships
Use of Evidence
Staff Development and Training
By this stage, therefore, agreement had been reached on the nature of inclusion itself and
there was a consensus around the idea that the promotion of inclusion needed to involve the
whole LEA. More specifically, the totality of the LEA’s operations had been broken down into
twelve factors that could be used as a starting point for evaluating how effectively the LEA as
a whole is tackling the issue.
The LEA Inclusion Rating Scale
The next step involved taking each of the factors in turn and deciding what a LEA ‘performing
well’ would ‘look like’. In other words, a set of descriptors was developed for each factor
against which the performance of the LEA could be judged. A limit of two or three short
sentences per factor, containing a total of no more than 60 to 70 words, was imposed. This
discipline was intended to ensure that only key ideas were included and that the instrument
did not become unwieldy or cumbersome. Such a set of descriptors was agreed for each of
the twelve factors. The factors, and their associated descriptors, constitute The LEA
Inclusion Rating Scale that appears in full on the next two pages.
4
THE LEA INCLUSION RATING SCALE
 Definition
In a LEA performing well, there is a short and clear definition of ‘inclusion’. It is
understood and supported across all services and units within the organisation, and by
headteachers and others who work in schools. Other key stakeholders outside the LEA,
particularly Health and Social Services, understand and support the LEA’s policy
aspirations in terms of promoting inclusive education.
 Leadership
In a LEA performing well, senior managers provide clear leadership on inclusion issues.
They articulate consistent policy aspirations for the development of inclusive practice.
They acknowledge and celebrate inclusive practice, and they challenge unacceptable
practice.
 Attitudes
A LEA performing well is a positive, ‘can-do’ organisation. Equity and social justice are
two key values. There is a commitment to identifying and removing barriers to the
promotion of inclusion, and the provision of high quality services for ‘at risk’ groups of
learners is a high priority.
 Policies, Planning and Processes
In a LEA performing well, the promotion of inclusive education is strongly featured in
important policy documents. The LEA’s definition of, and commitment to, ‘inclusion’
permeates planning processes and is reflected in the Education Development Plan and
other LEA plans.
 Structures, Roles and Responsibilities
In a LEA performing well, services and units have a clear role in terms of promoting
inclusive policies and practices. They work effectively together, providing a coherent and
co-ordinated service to schools and parents/carers. The management structure of the
LEA facilitates co-ordination on inclusion issues.
 Resourcing
In a LEA performing well, the level of resources available to support inclusion are
comparable to other similar LEAs. The mechanisms used to distribute available
resources, both human and financial, are designed to support inclusion and effectively
target groups of learners that are at risk. Funding mechanisms are designed to empower
individual schools, and groups of schools, to work flexibly and creatively in order to
identify and overcome barriers to inclusion.
5
THE LEA INCLUSION RATING SCALE
 Support and Challenge to Schools
In a LEA performing well, schools receive consistent and effective support and challenge
on inclusion issues. Headteachers understand the criteria that are used to judge how
inclusive schools are. Inclusive practice is recognised and celebrated, and ‘counterinclusive’ practice is challenged. The LEA facilitates arrangements that enable schools to
provide support and challenge to each other on inclusion issues.
 Responding to Diversity
A LEA performing well facilitates the development of additional programmes and
curriculum initiatives in schools that are designed to improve the presence, participation
and achievement of all pupils. The LEA encourages schools to place a particular
emphasis on meeting the needs of those learners most at risk of marginalisation,
underachievement and exclusion.
 Specialist Provision
In a LEA performing well, there is a clear strategy for reducing the number of children and
young people being educated outside mainstream settings. There is a clear role for
specialist provision, including special schools, for promoting inclusive education and
building capacity in mainstream schools. Special schools ensure that their pupils have
access to appropriate mainstream experiences.
 Partnerships
In a LEA performing well, there is a strong partnership with schools that is characterised
by a shared commitment to policy aspirations on inclusion. There is effective cooperation between the LEA, Health and other Council Departments on inclusion. There is
an effective partnership between the LEA and the voluntary and independent sectors on
inclusion.
 Use of Evidence
In a LEA performing well, there are clear success criteria that are linked to a definition of
inclusion. Individual schools and the LEA collect evidence systematically that is linked to
this definition. This evidence is both quantitative and qualitative, and incorporates the
views and opinions of learners and their parents/carers.
 Staff Development and Training
A LEA performing well has a properly funded staff development strategy that recognises
the importance of continuing professional development. The LEA ensures that all
members of staff are provided with appropriate awareness-raising and role-specific
training opportunities on inclusion issues.
6
We next attached a simple, four-point rating scale to the instrument so that the LEA’s
performance could be judged against the descriptors where:
1 means:
2 means:
3 means:
4 means:
NR means:
The LEA is performing well. There are several significant strengths,
and no obvious weaknesses.
The LEA is performing quite well. On balance, strengths outweigh
weaknesses.
The LEA is not performing very well. On balance, weaknesses
outweigh strengths.
The LEA is performing badly. There are no obvious strengths and
several significant weaknesses.
No response. You have insufficient information to make a
judgement.
The LEA Inclusion Rating Scale
Definition
1
2
3
4
NR
Leadership
1
2
3
4
NR
Attitudes
1
2
3
4
NR
Policies, Planning & Processes
1
2
3
4
NR
Structures, Roles & Responsibilities
1
2
3
4
NR
Resourcing
1
2
3
4
NR
Support & Challenge to Schools
1
2
3
4
NR
Responding to Diversity
1
2
3
4
NR
Specialist Provision
1
2
3
4
NR
Partnerships
1
2
3
4
NR
Use of Evidence
1
2
3
4
NR
Staff Development & Training
1
2
3
4
NR
We understand that the Rating Scale is often difficult to complete. There are at least two
reasons for this. First, a single numerical rating must be allocated to each factor that might be
described by two or three different statements. The task, which is often difficult, is to weigh
the evidence and reach a ‘balanced judgement’ for each factor. Secondly, there is no ‘middle’
rating as, for example, a 3 would be in a 5-point scale. If a LEA is not thought to be
performing ‘well’ or ‘badly’, respondents need to decide whether strengths outweigh
weaknesses (2) or weaknesses outweigh strengths (3). We believe that these design
features combine to generate lively discussion, engage participants fully in the process, and
consequently develop a deeper understanding of the issues.
7
Using the LEA Inclusion Rating Scale
It has been emphasised previously that there is no ‘right’ or ‘wrong’ way of using the Rating
Scale. Its purpose is to support the self-review process, and the detail of how it is used
should be decided by each individual LEA to take account of its own context and
circumstances. This section, therefore, does not provide step-by-step instructions. However,
it may be useful to describe some of the lessons that we believe have been learnt, and to
identify some of the key decisions that need to be made in planning the process.
First of all, we have never sent out the Rating Scale, by post or electronically, and asked
stakeholders to return it completed. This has always seemed to us to undermine the function
of engaging stakeholder groups in the debate and raising awareness of the issues. We have
always used the Rating Scale at seminars or conferences that have been specifically
designed to provide opportunities for discussion and generate the most reliable data.
All LEAs that have used the Rating Scale have held at least two such conferences, one for
LEA staff and one for headteachers. Some have held a third conference for other stakeholder
groups such as governors, elected members, the voluntary sector, colleagues from Social
Services and Health, and so on. These conferences have usually lasted for two to two and a
half hours, and have tended to follow a broadly similar format.
All headteachers have usually been invited to the headteachers’ conference. We have found
cabaret seating to work best. This enables inputs to be made ‘from the front’, and colleagues
to work in small groups, without time being wasted moving to and from breakout rooms. The
hour before coffee usually begins with a brief explanation of the process, the assumptions
that underpin it, and the materials that are to be used. For the remainder of this first session,
delegates are asked to record their own rating for each of the twelve factors as each factor is
described in turn. This activity is completed independently – no conferring!
Following coffee, colleagues are asked to share their ratings with others sitting at the same
table. It is suggested that they focus mainly on those factors that have attracted diverse
ratings in order to explore the reasons why this might be so. During this hour, colleagues are
told that they can change their ratings in the light of this discussion if they wish, but there is no
pressure to reach a consensus. Feedback from delegates on this activity is always very
positive. At the end of the conference, delegates hand in their completed Rating Scale.
Attendance at the conference for LEA staff raises more difficult issues. We are clear that the
whole LEA needs to be represented – especially those parts of the organisation that may
think that inclusion has little to do with them! However, difficult decisions need to be made
concerning the ‘seniority’ of those representing each service or unit, bearing in mind the need
to be inclusive but also the nature of the activities to be undertaken.
We have found that this process works well with headteachers and LEA staff who tend to
have clear views about the LEA’s performance on all, or certainly most, of the twelve factors.
This tends not to be the case with colleagues from other stakeholder groups, who often have
strongly held views about particular factors, but no view at all about others. A range of
alternative strategies have therefore been used which are based loosely on the Rating Scale
but allow delegates to focus primarily on those issues most relevant to them. We have often
used flipcharts to record in summary the views of delegates.
There is an issue regarding who facilitates this process. Obviously, LEAs are free to design
and manage their own process although none in the Greater Merseyside or North West
regions, to our knowledge, have done so. We have also discussed the idea of peersupported self-review, or LEAs providing this service for each other, although to our
knowledge this has not yet happened either. Instead, all of those LEAs that have used the
Rating Scale to date have used facilitators from the University of Manchester.
8
Collecting Additional Qualitative Data
It was suggested earlier that the process outlined in the previous paragraphs enables a profile
to be generated that describes the perceptions of different stakeholder groups across all
twelve factors in the instrument. However, additional qualitative data is needed to understand
why some factors are rated highly and others not so. At the close of the conferences,
therefore, these limitations are spelt out to delegates. It is explained that the Rating Scale
data enables us merely to identify the issues that need further investigation. Delegates are
therefore invited to provide their name and a contact telephone number. A sample of
delegates is then contacted by telephone by those who facilitated the conference during the
week or so following the conference. These telephone interviews are structured around
specific questions that have been generated by an analysis of the Rating Scale returns. In
our experience, the overwhelming majority of delegates are willing to have such a discussion
that usually lasts no more twenty to twenty-five minutes.
We believe that this procedure, designed to develop a deeper understanding of the
perceptions of stakeholders, is extremely important. It enables the facilitators to feed back to
the LEA not just what stakeholders think about the performance of the LEA, but also why they
hold the views that they do. However, undertaking a large number of telephone interviews is
a labour-intensive, and ultimately expensive, procedure. We are therefore currently
experimenting with alternative methodologies. One of these, for example, involves asking
each table to nominate a representative to attend a follow-up meeting with the facilitators a
week or so after the conference. The purpose of this follow-up meeting is to discuss the
issues generated by an analysis of the Rating Scale returns.
In summary, we are clear that the Rating Scale does its job in terms of identifying the key
issues. However, we also know that additional qualitative data is needed to make better
sense of the aggregated ratings. Individual interviews provide a rich seam of data, but it is a
costly exercise. In the coming months, we will continue to experiment with alternative, less
expensive processes designed to achieve the same outcome.
The Notion of ‘Levers’
The role of the external facilitators, who manage this process on behalf of the LEA, comes to
an end with the delivery of a report that sets out the quantitative and qualitative data that have
been collected, and provides an analysis of the issues raised by stakeholders. Obviously, the
responsibility for assimilating these findings into existing review and planning processes, and
deciding how best to proceed, rests with the individual LEA. However, within the context of
this exercise, we have found the idea of ‘levers’ to be a useful one.
Levers can be thought of as a ratio of the impact of an activity relative to the financial and
human cost of the activity. So, a ‘high leverage’ activity will have a significant impact on
practice for a modest investment of time and energy. And conversely, a ‘low leverage’ activity
will be costly without achieving a great deal. The data collected by using the Rating Scale
often reveal several issues that it may be useful for the LEA to address. The notion of levers
can be useful in deciding priorities for action. In other words, in the light of evidence that has
been collected, what can the LEA do that will move the inclusion agenda forward most
significantly for the least investment of time and energy?
We firmly believe that the idea of levers is useful in terms of informing a discussion within the
LEA about how to respond to the data generated by the Rating Scale. We are also beginning
to develop an understanding of the leverage that may be associated with the twelve factors
described in the Scale. However, this is an aspect of this work which is ongoing and which,
hopefully, will be the subject of a further publication at some stage in the future.
What the Rating Scale Can and Cannot Do
It may be helpful at this point to summarise our experience of using the Rating Scale in terms
of what we believe it can do and, of equal importance, what it cannot do. The Rating Scale
was designed as a tool for supporting the self-review process. In general terms, we have
9
found that the instrument is successful in terms of what it was intended to do. It is quick and
easy to use. It can be used with a range of stakeholder groups. It is flexible; that is, it can be
used in a variety of ways and in different contexts. Importantly, the data is easily collated and
can be used to generate a quantitative profile of the ratings of each stakeholder group across
all twelve factors in the Scale. In this way, the review process identifies issues that need to
be addressed by the LEA as well as the strengths of existing practice.
We strongly believe that one of the major benefits of this work relates to the review process
itself, as opposed to the aggregated ratings that are generated by the process. In other
words, the Rating Scale has consistently acted as a potent catalyst for generating a debate,
within the LEA and with headteachers and other stakeholders, about the nature of inclusion
and the roles and responsibilities of all those who have a contribution to make.
It is important to be clear that the Rating Scale collects information about perceptions. Using
the Scale with different stakeholder groups will only establish what those groups think about
the LEA’s ‘leadership’, ‘use of evidence’ and so on. Nevertheless, perceptions are important
and need to be dealt with. The use of the Rating Scale, for example, has occasionally
resulted in the LEA communicating its policy differently, rather than changing its policy.
It should be emphasised, too, that whilst data collected using the Rating Scale identifies the
perceived strengths and weaknesses of the LEA’s approach to promoting inclusion, it will not
indicate why. ‘Support and challenge to schools’ or ‘leadership’, for example, may receive
consistently poor ratings. However, collecting additional qualitative data is essential in order
to develop a deeper understanding of the underlying issues.
Finally, the Rating Scale is ‘schools-dominated’. It was not designed to be a ‘Local Authority
Inclusion Rating Scale’. As a result, Education Departments that are already integrated with
Leisure Services, or aspects of Social Care, need to think very carefully before using the
instrument in its present form. However, the Rating Scale has been used by LEAs as part of
their preparations for responding to Every Child Matters.
Future Developments
During 2004-2005, we are hoping to make progress on a number of key issues regarding the
further development of this work. By Easter 2005, seven or eight LEAs in the Greater
Merseyside and North West regions will have undertaken a review of current practice using
the LEA Inclusion Rating Scale. To date, officers from those LEAs have not shared with each
other their impressions of the process, and there has been no formal follow up to find out
what, if anything, has changed as a result of each review. During the spring term 2005,
therefore, it is intended to hold one or more seminars for senior officers representing those
seven or eight LEAs at which the following questions will be addressed:
How can the Rating Scale, and the way in which it is currently used, be improved?
Which factors are most commonly identified as barriers to progress? And what has
been learnt about overcoming those barriers?
More specifically, in responding to the outcomes of the review, what has been learnt
about ‘levers’ in the change process?
During the summer term 2005, it is planned to hold a conference open to representatives from
all LEAs in the North West and Greater Merseyside regions, the purpose of which will be
disseminate the outcomes of this work to date.
10
Download