Data quality roles and responsibilities

advertisement
Data Quality Framework
V7.0
Last updated by:
Next review date:
Approved by:
Carl Tovey
Silvina Katz
13/04/2015
01/04/2016
15/04/2015
Data Quality Framework
Introduction
Northampton Borough Council is committed to continually seek to improve the quality of
its data to support good decision-making and improved service outcomes. Specific data
quality objectives have been agreed, and will be outlined later in the document
The purpose of this framework is to define how the Council will drive data quality, and
support teams to deliver the objectives, and provide guidance to improve and sustain
performance.
1
Governance, leadership and delivery
1.1
Roles and Responsibilities
Data quality is the responsibility of the whole Council; however there are certain roles
within the Council that will more directly contribute to our approach in improving data
quality. To demonstrate commitment in ensuring that data quality improvement is driven
corporately and within the service areas, a lead Member and Senior Officer have been
assigned specific responsibility for data quality.
Our governance arrangements are:

Member Lead – Cabinet member with responsibility for Performance
Management (Finance Portfolio)

Senior Responsible Officer – Borough Secretary, and Monitoring Officer

Audit Committee

Overview & Scrutiny Committee
A comprehensive table detailing wider data quality roles and responsibilities within the
Council is contained in Appendix C.
Practical support and guidance is available as follows:
 Governance and data quality
o Corporate Performance and Change Team
 Data protection and sharing, transparency, and FOI
o Information Governance Team
Data Quality Framework 2015
Page 2 of 11
1.2
Data quality objectives
In view of the importance of data quality the Council has set the following corporate
objectives:






Achieve 100% accuracy first time, every time
No Corporate Priority or Management Board performance indicators qualified by
external auditors
Ensure adherence to the Roles and Responsibilities specified in Appendix C
Performance data will be collected and reported in an agreed format and to
agreed timescales
Each service area to ensure their own data meets the six characteristics of good
quality data
Annually review and update data quality procedures
2
Systems and processes
2.1
Maintenance and review of systems and processes
Responsibility for maintaining a robust control environment and improving information
systems rests within departments with managers, data collectors, and system users.
The Corporate Performance Team will provide support for implementing and
challenging improvement in this area.
Each system will have a named primary and secondary officer responsible for data
quality issues. The responsible officer(s) are required to ensure that:










There is security of access/amendment
Periodic tests and sampling of the integrity of data are undertaken in accordance
with the Data Quality Framework
Information management and support is available to users
System upgrades are made where necessary (including to accommodate
amendments to PI definitions)
The system meets managers’ information needs
Feedback from users is acted upon
The system can produce robust audit trails
Actions recommended by system reviews (e.g. by the external auditors and/or
agreed Borough Secretary) are implemented
A set of written definitions and procedures exists for the purpose of extracting
performance information and
A business continuity plan for the system exists to protect vital records and data.
Data Quality Framework 2015
Page 3 of 11
2.2
InPhase BMS - The Councils Performance Management System.
Through the use of InPhase BMS, controls are in place to ensure data is robust and
reliable, including:
o Dedicated primary and secondary data entry staff for every indicator, trained to
input indicator data into the system
o Procedure notes and defined methodologies for each indicator, ensuring
calculations are the same each time and that business continuity is in place to
cover for absent staff
o Comprehensive data validation processes, including calculation checks for all
indicators and full background checks (undertaken quarterly and at outturn)
o Centralised management and administration of the software
2.3
Target Setting
Performance targets are agreed at the start of each financial year for all indicators as
part of the Service Planning process. The Target Setting guidance document clearly
defines the methods for the setting of targets and the process for the revision of
approved targets during the reporting year.
Target Setting
Procedure v3.pdf
www.northampton.gov.uk/downloads/download/1365/
2.4
Monitoring
Responsibility for checking the accuracy of performance data vests with individual
services.
The overall objective of the data quality checks is to ensure all key measures from each
area’s Service Plan are fully validated at least once in any financial year. This includes
supporting documents (procedures and definitions, Appendix A) along with the evidence
supplied during each reporting period, and the commentaries made against each
measure.
These checks are designed to give structure to managers checking their measures, and
must be carried out by the last day of each month. By undertaking these checks
managers will be able to ensure that data quality and consistency of approach is
achieved and improved where required.
The method by which this is achieved will be determined by each Head of Service;
however it should be noted that all checks should be performed by an individual who
didn’t input them in the first instance. This is to ensure the integrity of the check, and
quality of the definitions.
Data Quality Framework 2015
Page 4 of 11
The following guidance outlines specific items which should be considered when
determining methodology, and performing the checks required:
Service Area data
quality checks - Guidance.docx
http://www.northampton.gov.uk/downloads/download/1365/
The Borough Secretary Team will support service areas to address any areas of
concern which may be identified during the checks or for general advice.
Corporate-wide measures (Sickness/Absence and invoices etc.) will be quality assured
by the LGSS performance team in line with agreed SLAs. Adherence to this will be
monitored by the Borough Secretary Team as part of their contract management
function.
3
People and Skills
Those employees detailed as having roles and responsibilities for managing and
improving data quality (Appendix C) will be provided with appropriate training and
ongoing support to carry out such responsibilities.
Training needs for data quality will be identified through the employee bi-annual
development reviews but should also be raised on an ad-hoc basis as need arises (e.g.
the arrival of new staff).
Training and support is provided through the Borough Secretary Team and
supplemented by the corporate and directorate training programmes on issues such as:




Data Protection
Freedom of information
Customer Service
Data Transparency
Where dedicated systems are used, software suppliers and in house specialists will be
used to provide specific training where necessary.
Service Areas must assign an officer to undertake regular sample and test checks on
the data used to ensure accuracy.
Data Quality Framework 2015
Page 5 of 11
4
Data Use
The purpose of collecting and reporting robust, good quality data is to inform
management, make improvements to service delivery and to promote accountability to
customers, stakeholders, local residents and Government.
Key aspects;

Data means all data, whether on computer systems, on paper or data coming into
the council or from other organisations that inform some of our measures, for
example contracted functions information from partners.

Compliance with the Data Protection Act 1998 and the Freedom of Information Act
2000 is a legal requirement for all Service areas and Directorates. The Council has
various policies which support this, and should be referred to when required

Data that is used as supporting evidence for a report, or performance measure
must be to the standard outlined in the strategy and this framework. It must also be
in a format that is easily understood. Procedure Notes and Definitions are required
of each measure.

Government returns are required to comply with statutory requirements and
deadlines.

Data collected must be secure and should only be used for authorised purposes.
Changes should only be made where necessary and such changes must be fully
auditable.

Business continuity arrangements should be in place to restore data in the event of
IT failure or a wider catastrophe. The Council’s Disaster Recovery Plan for IT
systems is supported by an off-site real-time backup of key business data for
recovery purposes. Daily backup procedures are in place to protect the integrity of
corporate systems. Service areas and Directorates must ensure that any relevant
systems are included in these high level systems.

Business continuity arrangements should also be in place to protect locally
developed and maintained systems and supporting processes. Service recovery
frameworks should identify critical documents and managers have a responsibility
for ensuring their protection.
Data collected will be used to inform and make decisions at all levels within the Council
and clear ‘smart’ actions identified to address issues. These will be monitored and
progress reported on a regular basis to team leaders and managers to ensure Data
Quality issues are addressed in a timely manner.
Data issues will be discussed at departmental team meetings as appropriate and
proportional. Individual 1 to 1’s and Annual Appraisal meetings will involve discussions
regarding data collected and reported as relevant.
Government returns are required to comply with statutory requirements and deadlines.
Arrangements are put into place by Service Areas to check data prior to submission.
Data Quality Framework 2015
Page 6 of 11
5
Data security and sharing protocols
5.1
Data Security
Data collected must be secure and should only be used for authorised purposes.
Changes should only be made where necessary and such changes must be fully
auditable.
A Data Protection Policy is in place to ensure that personal information is processed
legitimately and is only used for specified purposes.
Security controls should be in place on all key systems to prevent unauthorised data
changes. Controls should be reviewed regularly to ensure protocols and policies are
adhered to.
Business continuity arrangements should be in place to restore data in the event of IT
failure or a wider catastrophe. The Council’s has a Disaster Recovery Plan for IT
systems supported by off-site real-time backup of key business data for recovery
purposes. Daily backup procedures are in place to protect the integrity of corporate
systems.
Business continuity arrangements should also be in place to protect locally developed
and maintained systems and supporting processes. Service recovery frameworks
should identify critical documents and managers have a responsibility for ensuring their
protection.
5.2
Partnerships and data sharing
The Council must ensure data that is shared with, and received from, partners is
accurate and appropriate. When entering into partnerships it is vital that the spirit of this
strategy is followed and that the responsibilities for ensuring data quality are clearly
identified in partnership documentation or agreements.
6
Publication and review
The Data Quality Framework will published on the Internet and reviewed on an annual
basis
Data Quality Framework 2015
Page 7 of 11
APPENDIX A. Procedure and definition notes
Each measure must have a definition which includes what is being measured, and how
to collect any data needed to calculate it. The purpose is to facilitate business
continuity, i.e. to enable others to view them and then be able to add the information
onto the InPhase BMS system.
Procedure notes and definition notes should be;







Clear
Brief
Understandable to all
Up to date
Follow any relevant guidance e.g. Housemark
Uncomplicated
Tested
Information should be recorded on a template which is included below;
PI Definition and
Process template.doc
www.northampton.gov.uk/downloads/download/1365/
Data Quality Framework 2015
Page 8 of 11
APPENDIX B - What does good quality data look like?
The table below outlines the six characteristics of good quality data.
Dimension
Accuracy
Data should be sufficiently accurate for their intended purposes, representing
clearly and in enough detail the interaction provided at the point of activity.
Data should be captured once only, although they may have multiple uses.
Accuracy is most likely to be secured if data are captured as close to the point
of activity as possible. Reported information that is based on accurate data
provides a fair picture of performance and should enable informed decisionmaking.
The need for accuracy must be balanced with the importance of the uses for
the data, and the costs and effort of collection. For example, it may be
appropriate to accept some degree of inaccuracy where timeliness is
important. Where compromises are made on accuracy, the resulting limitations
of the data should be clear to their users. This must be a judgement
determined by local circumstances, and is unlikely to be appropriate in the
case of the data supporting published performance indicators.
Validity
Data should be recorded and used in compliance with relevant requirements,
including the correct application of any rules or definitions. This will ensure
consistency between periods and with similar organisations, measuring what is
intended to be measured.
Where proxy data are used to compensate for an absence of actual data,
bodies must consider how well these data are able to satisfy the intended
purpose.
Reliability
Data should reflect stable and consistent data collection processes across
collection points and over time, whether using manual or computer based
systems, or a combination. Managers and stakeholders should be confident
that progress toward performance targets reflects real changes rather than
variations in data collection approaches or methods.
Timeliness
Data should be captured as quickly as possible after the event or activity and
must be available for the intended use within a reasonable time period. Data
must be available quickly and frequently enough to support information needs
and to influence service or management decisions.
Relevance
Data captured should be relevant to the purposes for which they are used. This
entails periodic review of requirements to reflect changing needs.
It may be necessary to capture data at the point of activity which is relevant
only for other purposes, rather than for the current intervention. Quality
assurance and feedback processes are needed to ensure the quality of such
data.
Completeness
Data requirements should be clearly specified based on the information needs
of the body and data collection processes matched to these requirements.
Monitoring missing, incomplete, or invalid records can provide an indication of
data quality and can also point to problems in the recording of certain data
items.
Data Quality Framework 2015
Page 9 of 11
APPENDIX C – Data quality roles and responsibilities
ROLES
ACCOUNTABILITIES/RESPONSIBILITES
Performance
Owners and
Collectors









Borough
Secretary
Team















Owners and
Operational
Managers /
Team
Leaders






To understand the Council's Performance Management Framework and the
significance of their role in collating/inputting performance data
To be aware of the Council's data quality objectives
To recognise the importance of data quality and report data quality issues to
line manager
To maintain up-to-date procedure notes and definitions for all data collection
processes
To maintain up-to-date knowledge of the definitions of performance
indicators
To input data and commentary in line within agreed timescales
To provide qualitative information on the PI result and provide all necessary
background papers, attached to the Council's performance management
software system, InPhase BMS
To have an understanding of any performance indicators affected by the
data they contribute. Ensure access to technical guidelines, including
nationally set definitions. These definitions must be applied consistently to
allow for comparison over time and with other authorities
To use a two staff member check / verify process to ensure the quality of
Government data submissions
Validate monthly team Data Quality check
Monitor and challenge data quality in the service area
Provide support and guidance to service area
Attend relevant training sessions
Champion data quality within the service area
Conduct sampling and testing spot checks on performance data processes
To check using InPhase BMS, the accuracy of PI data entry, qualitative
information and all necessary background papers
To liaise with collectors/owners and operational managers/team leaders on
any changes in definition in a timely manner
To ensure regular, accurate and efficient extraction and presentation of
information
To ensure those involved in the data collection process are aware of the
impact that the quality of the data they produce has across the Council and
externally
To provide clear guidelines and training for using corporate data collection
systems
Provide advice and guidance regarding collection and calculation of PI’s
To oversee the operation and maintenance of InPhase BMS
To ensure relevant staff are trained in data quality requirements
To report corporate overview of data quality issues to senior management,
councillors and staff
Conduct sampling and testing spot checks on performance data
To provide challenge during target setting
To ensure responsible officers are aware of and comply with their data
quality responsibilities/accountabilities
To investigate with and without Internal Audit, instances of inaccuracy with
data
To verify and sign off PI’s (based on internal sign off process, agreed within
service area)
Monitor and challenge progress made against corporate data quality
objectives and service area data quality action plans
Data Quality Framework 2015
Page 10 of 11
Director /
Heads of
service
Internal
Audit
Cabinet
Members
Overview &
Scrutiny and
Audit
Committee
Members




Manage system upgrades
Review Data Quality issues, track actions and report issues
Sign up to the Data Quality strategy objectives (Charter)
Review DQ issues as they arise via DMTs, and take appropriate action to
correct
 To undertake audit risk assessment of Corporate DQ arrangements
 To review data quality across service area audit work
 To challenge data quality within their portfolio areas, or personal areas of
expertise
 To discuss data quality issues with Directors and Heads of Service at
DMTs
 Review data quality issues highlighted in the monthly Cabinet
Performance Report
 To regularly review performance data (inc Financial) from Cabinet
agendas, and identify areas of concern
 Request reports/analysis from individual service areas and challenge low
performance
Data Quality Framework 2015
Page 11 of 11
Download