Stats19 Form design research project LGRAS

advertisement
OFFICIAL
LGRAS (14) 5


Road accident data collection – form design review
Contents
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
Introduction
Background
Aims & Objectives
Research Design/ Methodology
Research Outputs
Ownership & Publication of Outputs
Responsibilities of the Service Provider
Contract Management
Timetable
Access Arrangements
Contract Price
Contract Conditions
Criteria for the Evaluation of Tenders
Guidance for Submitting a Tender
1
OFFICIAL
LGRAS (14) 5
Transport Scotland
May 2014
2
OFFICIAL
LGRAS (14) 5
1.
Introduction
1.1
This work is being commissioned by Transport Analytical Services, part of the
Finance and Analytical Services Directorate within Transport Scotland.
1.2
The aim of the work is to improve personal injury road accident data (STATS19 data)
quality by improving the design of the form used to collect the information by Police
Scotland.
1.3
The work constitutes an individual project.
2.
Background
2.1
The Finance and Analytical Services Directorate collects analyses and disseminates a
variety of transport related data, including road accident data, and commissions
research into relevant aspects.
2.2
Statisticians within Transport Analytical Services are responsible for the collection of
personal injury road accident data from Police Scotland and the provision of the data
to DfT. The data collection system comprises three main parts:
o STATS19 - the data collection form
o STATS20 - the instruction manual
o STATS21 - the procedures for submitting data
2.3
STATS20 contains a sample STATS19 data collection form (MG NSRF/A to D), and
two further samples are provided within the Reported Road Casualties Scotland series
of Scottish Government publications (2012 edition, pages 219-224). There is no
obligation to use any particular form (paper or electronic) as long as data are provided
to Transport Scotland (TS)/DfT in the format required by STATS21. The information
collected covers accidents details, details of each vehicle involved and information on
each casualty. An additional section was added in 2005 to provide data on
contributory factors. All four sections of the form are to be included in this project.
The data collected on injury road accidents is used to inform and monitor road safety
policy and target interventions and campaigns. Local Authorities and the Police use
the data in the identification of sites, routes and areas particularly prone to accidents.
The work of these organisations and other road safety stakeholders ensures continued
progress against the targets set out in Scotland’s Road Safety Framework to 2020
(http://www.scotland.gov.uk/Resource/Doc/274552/0082161.pdf)
2.4
2.5
2.6
2.7
Data accuracy, of which form design is a significant factor, is important to ensure the
correct targeting of policy and identification of emerging road safety issues, it will
also reduce the resource required by the Police, Local Authorities and Transport
Scotland in quality assurance and data validation. Form usability is vital as the police
officer at the scene of the accident, who is responsible for recording the information,
has a number of other priorities on their time. The Stats19 collection needs to collect
the required data accurately and quickly.
STATS19 data quality has long been a concern of Transport Scotland, the Police and
other users of the data, particularly Local Authorities and this project forms part of
on-going work in this area.
Transport Scotland and its predecessors have, since June 1989, supported a Scottish
Liaison Group on Accident Statistics (LGRAS), which provides a focal point for
3
OFFICIAL
LGRAS (14) 5
discussion amongst interested parties, mainly representatives of central government,
local government and police. To date, it has provided the sample forms, and, through
LGRAS, liaised with interested parties (collectors and users) to identify problems
with the STATS19 data. It has then either addressed them directly or passed them on
to DfT’s Standing Committee on Road Accident Statistics (SCRAS) for attention
during the next Quality Review.
2.8
The variables collected are reviewed every five years by the Standing Committee on
Road Accident Statistics (SCRAS) which is chaired by a representative of the
Department for Transport (DfT). These reviews occur every five years or so and the
outcomes of the 2008 review were implemented in Scotland in 2013.
2.9
Previous work on the matter outside of Government includes:
 HUTCHINSON, T. P. (1987) Road accident statistics. Adelaide, S. Aust: Rumsby
Scientific Pub.
 The work carried out by Professor Chris Wright and others at Middlesex
University,
subject
of
the
grant
application:
http://gow.epsrc.ac.uk/NGBOViewGrant.aspx?GrantRef=GR/K89238/01
 ANAGNASTOPOULOU, K. (1998) The Contribution of Information Design to
Road Safety by Improved Data Collection: a case study. Proceedings, 9th
International Conference, Road Safety in Europe, Cologne, Germany.
 WALLACE B., AND ROSS A. (2003) Effective taxonomies for database
management. Municipal Engineer 2003, 158, No. 3, 253-257.
 http://www.chalmers.se/safer/EN/publications/traffic-safetyanalysis/2009/intercoder-agreement
2.10
A summary of known STATS19 data quality problems, together with intended actions
and resolution [is published on the Transport Scotland website and included at Annex
???]. Other issues identified with the collection include:
 differences in aims between collectors and users,
 police officers seeing the form differently to those doing data entry,
 lack of awareness of the instructions for completing the form
 issues with the response options on the forms (not mutually exclusive and
exhaustive).
 The 114 page STATS20 instruction manual.
Some of these issues were exacerbated by differing practises across the eight legacy
police forces, which all used different versions of the form.
2.11
The formation of Police Scotland, a single force for the whole of Scotland, presents an
opportunity to address these problems and to improve form usability, data quality and
consistency. The starting point for the project will be the new single form that is
currently being rolled out across Scotland [a copy of which is included at Annex ???].
3.
Aims & Objectives
3.1
As stated at paragraph 1.2, the aim of the work is to produce a user friendly version of
the Stats19 form to improve usability and the quality of personal injury road accident
data collected in Scotland.
3.2
The main objective is the production of a STATS19 form, which can be introduced
across Scotland. The layout needs to present the required core data and additional
4
OFFICIAL
LGRAS (14) 5
information to meet Police Scotland requirements (including name, address,
…..[ADD MORE HERE OR INCLUDE AS ANNEX]) in a way that ensures ease of
use and improves the quality of the data collected. Whilst the core data required from
the collection cannot be changed in the short term, it is intended that this review will
provide a starting point for the next full SCRAS review of the Stats19 collection.
3.3
It is anticipated that the project will focus on and provide evidence in relation to the
areas listed below.
1:
confirm those aspects of the current STATS19 form from which
quality problems arise.
2:
identify a form design which will meet the objective described at
paragraph 3.2, above.
3.
Conduct the necessary reliability/consensus trials to demonstrate the
increase in effectiveness anticipated and make those adjustments necessitated
by any failures.
4:
identify those variables in the Current STATS19 form which can be
improved in terms of vocabulary or coding options, for attention during the
next Quality Review.
3.4
To achieve the aim and objectives, it is expected that it will be necessary to consult
with Police Scotland and the Scottish Local Authorities, probably through a series of
interviews, to identify problems currently being experienced, both by those recording
and entering the data, and by those using the data. It may also be necessary to build in
findings from other work that has been undertaken in England by English police
forces and local authorities, through suitable points of contact, which will be
provided.
3.5
Once problems have been confirmed and/or identified, it is envisaged that the second
phase of the work would involve production of a mock up of a new form (and relevant
testing) and a set of recommendations to feed into the next GB review of the
STATS19 data collection.
4.
Research Design/ Methodology
4.1
The research design and methodology is a matter for the contractor, though it would
be expected that the project would include work with Police Scotland to identify data
recording and data entry issues, as well as work with end users of the data eg Local
Authorities and would include testing of proposed changes.. The contractor should
outline the rationale for their stated approach including consideration of cost
implications.
4.2
Please provide details of any potential problems or weaknesses with your proposed
approach and how you would seek to address them.
4.3
The successful contractor is responsible for the design of research instruments (such
as survey questionnaires and interview and focus group topic guides), but should
allow time for these to be approved by Transport Scotland prior to commencing
fieldwork.
5
OFFICIAL
LGRAS (14) 5
5.
Research Outputs
5.1
Key outputs will be a final report with a Transport Scotland Research Report that
meets the aims and objectives of the research as outlined in Section 3 of this
specification. This report should include a mock up of the revised form. [Question –
Is there anything else we would require eg for Police Scotland]. The contractor
should submit electronic copies (compatible with Word 97 format) of both the report
and research summary by the dates specified.
5.2
All written reports must be prepared in a clear, accessible and concise manner, they
should be proof-read before submission, and must be submitted in a publishable
standard and in Transport Scotland’s Social Research house-style. Information on this
is
available
in
the
Handbook
for
Contractors
at:
http://www.transportscotland.gov.uk/analysis/research/contractor-guidance
5.3
It is expected that research reports will:
 Set the research findings in the broader policy and research context
 Provide an overview of the research methodology and approach to analysis;
including discussion of the limitations
 Present research findings and conclusions that are supported by the evidence
 Make recommendations that are defensible and clearly linked to the research
findings
5.4
Tenderers should note that one or more drafts of reports are likely to be
required before a final draft is agreed, and that they should allow for this in the
timetable and costs they propose. It is the responsibility of the contractor,
however, to ensure that submitted drafts are of a high quality and are not in
need of proof reading by the client.
5.5
Tenderers may be required to present their findings to the Liaison Group on Road
Accident Statistics (LGRAS), the Transport Scotland statistical advisory committee.
6
Download