Data Quality and Integrity in the Data Supply Chain — Chain

advertisement
AIS-AIMSG/1-SN No. 14
20/11/08
AERONAUTICAL INFORMATION SERVICES-AERONAUTICAL
INFORMATION MANAGEMENT STUDY GROUP (AIS-AIMSG)
FIRST MEETING
Montréal, 2 to 4 December 2008
Agenda Item 7:
7.4:
Agenda Item 8:
8.5:
Annex amendment proposals
Quality
Guidance material
Quality
DATA QUALITY AND INTEGRITY IN THE DATA SUPPLY CHAIN —
CHAIN SOLUTIONS
(Presented by Paul Bosman)
SUMMARY
This study note provides deliverables concerning the Eurocontrol CHAIN
programme, outlines its overall achievements and suggests a way how to best
integrate the individual deliverables into global ICAO documentation. This shall
support other regions to help realizing improvements in relation to data quality
and data integrity. In order to do so, an addition of a recommendation to Annex
15 chapter 3.2 is suggested whilst it also suggested that all supporting detailed
material may be provided through ICAO guidance material.
1.
INTRODUCTION
1.1
ICAO Annex 15, chapter 1 conveys the essential statement: ‘…. The role and importance
of aeronautical information/data changed significantly with the implementation of area navigation
(RNAV), required navigation performance (RNP) and airborne computer based navigation systems.
Corrupt or erroneous aeronautical information/data can potentially affect the safety of air navigation’.
1.2
This confirms that quality of aeronautical information is a key enabler for current and
future navigation methods, and systems rely extensively on accurate and reliable data. To reach the
required levels of performance, ground and airborne navigation systems demand aeronautical information
of considerably higher quality than that currently available.
1.3
Quality of data including quality of service will play an important role for AIM to
become future key enabler for ATM. Therefore, it is a pre-requisite for the transition from AIS to AIM
(11 pages)
106748059
AIS-AIMSG/1-SN No. 14
-2-
that quality requirements are met and quality of service is addressed as a matter of urgency by the States.
High priority needs to be given to the implementation of existing Annex 15 SARPs, in particular the
implementation of a Quality Management System.
1.4
In support of achieving compliance to Annex 15 requirements, this study note proposes
the inclusion of specific material, based on the CHAIN solutions, into global ICAO documentation to
address wider quality attributes and to supply to states a range of means to ease implementation actions.
2.
BACKGROUND
2.1
Several studies in Europe have shown and continue to show that the quality of
information provided by AIS falls far short of the required ICAO values. Particularly in reference to data
integrity. Europe is, at best, able to achieve the levels for routine data (10-3) rather than the required for
critical data (10-8). Far higher performance is required in order to support ATM target levels of safety and
rapidly increasing capacity demand.
2.2
Recognising this common need, Eurocontrol carried out an implementation support
programme between 2005 and 2007 named ‘CHAIN - Controlled and Harmonised Aeronautical
Information Network’. The results of this undertaking are herewith shared and submitted for potential
global exploitation.
Note: The detailed CHAIN solutions are outlined in Appendix A of this paper and the deliverables behind
are provided via separate CD. Further information on CHAIN can be found on:
www.eurocontrol.int/chain.
2.3
Based on the endeavour of Eurocontrol and its member States and based on the criticality
and importance of high quality data, the European Commission (EC) has also recognised AIS/AIM as
being a crucial enabler for future ATM. The EC has, therefore, taken action to prepare an Implementing
Rule on Aeronautical Data Quality (IR ADQ) based on the Interoperability Regulation established under
the Single European Sky I package of legislation. Once published – foreseen for the second quarter of
2009 - this IR will become directly applicable law in all European Union (EU) member States plus those
States, who have signed an aviation agreement with the EU. The SES IR on ADQ in essence strengthens
ICAO SARPs. It complements them to commit all actors in the data supply chain to consistently apply
quality management principles based on a set of defined means of compliance by overlaying those actions
with an oversight management scheme beyond AIS.
3.
THE KEY PROBLEM IN THE DATA SUPPLY CHAIN
3.1
The core problem appears when tasks are performed by multiple actors based on manual
processes with the existence of numerous transaction points. At each of these points data may leave a
semi-electronic or even a fully manual environment and are transferred in paper form (=media break)
rather than in electronic form. As a result, the system is faced with repeated entry and checking, which
involves a high risk of error with a very likely safety impact.
3.2
The mitigation to these risks is standardised processes and procedures, common data
formats and digital data exchange enabling interoperability.
-34.
AIS-AIMSG/1-SN No. 14
THE CHAIN OBJECTIVE
4.1
The objective of CHAIN was to improve the quality of the originated aeronautical data
and its management from the point of origin to the point of publication and to subsequently enable
enhanced processing throughout the entire aeronautical data chain.
4.2
The purpose was to support aeronautical information regulators and service providers in
implementing and maintaining traceable, controlled and auditable processes with a particular focus on
data integrity.
4.3
The scope of CHAIN covered flight-critical and essential navigational aeronautical data
(e.g. a runway threshold) as established in ICAO Annex 15, supplemented by the industry standards
EUROCAE ED-76 and ED-77 (and equivalent RTCA documents).
4.4
CHAIN facilitated a pan-European, and potentially world-wide, adoption of the
deliverables in order to support the transition towards a future digital management of aeronautical
information.
4.5
5.
CHAIN’s achievements were particularly based on two key measures:

establishing the ECIP implementation objective INF051;

support to the establishment of a European legislation: the SES IR on ADQ.
CHAIN SOLUTIONS – DELIVERABLES
5.1
CHAIN delivered a carefully scoped and logically defined ‘suite of deliverables’
(outlined in Appendix A) permitting a stepwise approach towards quality improvements. This enables
stakeholders to select those deliverable(s) that help to realise enhancements in the most critical areas.
Deliverables may be applied either one after the other or all at the ‘same time’, if the operational
environment so requires.
5.2
Through a series of pilot implementations the deliverables were proactively validated and
enhanced, initial implementation experiences were gathered, first success established and a small number
of trials ultimately paved the way for further implementation steps.
5.3
1
Deliverables were realised in the following main areas (details in Appendix A):

Foundation elements (requirements, quality principles for processing);

Data process mapping;

Service level agreements;

Standard input forms;
ECIP stands for European Convergence and Implementation Plan. The implementation objective INF05 addresses: ‘Improve
end-to-end integrity of aeronautical data.’
-4-
AIS-AIMSG/1-SN No. 14
6.

Specification for an automated data quality process;

General elements (safety, training, implementation plan etc.).
MASTERPLAN – THE STEPWISE APPROACH
6.1
Based on CHAIN’s experience a stepwise approach towards improvements is highly
recommended and the following logical steps for implementation should be considered:
1) A Quality Management System (QMS) is a pre-requisite for enhanced service
provision and is to be established. Note: CHAIN solutions are modular and may
exceptionally be applied before establishing a QMS.
2) The CHAIN ‘suite of deliverables’ for process enhancements are to be exploited.
o
First, analyse the document: ‘Data Integrity – Practical Guide’ as it provides
practical tips and tricks including quick wins (start to apply them).
o
Second, study the main document from the Foundation material, called:
‘Integrity of Aeronautical Information - Principles, Data and Quality
Management.’
o
Third, perform an internal Validation & Assessment by using the V & A
criteria deliverable. This will highlight main issues enabling a prioritization
of actions to be taken.
3) Define an initial ‘Data Integrity/Quality action plan’ and involve the key actors
(such as representatives from service providers, the regulator, key data
originator).
o
The establishment of a national ‘data quality group’ will help here. The
group should include key partners (incl. regulator and key data providers)
and it shall be sponsored by management.
4) Establish (an) implementation objective(s)
o
Similar to or based on ECIP implementation objective INF05.
5) Identify main data originators
o
Apply the SLA Originator Index (xls) which will indicate the key providers
and the most critical data that are concerned.
6) Map the data processes.
o
Apply the data process mapping tool to customise and map your processes.
-5-
AIS-AIMSG/1-SN No. 14
7) Establish SLAs with key data originators
o
Exploit the lessons learned and the SLA package. Start with screening the
tutorial package and involve the key originators.
o
Apply technical solutions (e.g. SIF2) helping to realise SLAs.
8) Initiate the establishment of an automated process (to modify or procure systems)
o
7.
Based on the above steps and results from data process mapping and SLA
exploit the specification for an automated data quality process.
CONCLUSION
7.1
The ‘suite of CHAIN solutions’ enables a stepwise approach towards improvements
allowing stakeholders to pick those specific elements that help them realising enhancements in the most
critical areas.
7.2
The challenge is with all supply chain actors - with AIS/AIM in the facilitating role - to
exploit the deliverables to the maximum, to put supplementary building blocks in place and to fully
translate the substantial investments made into national operational benefits.
7.3
It is important to note the proposed deliverables are not a single solution to a single
problem. All supply chain actors have a ‘duty of care’ to be able and ready to satisfy the needs of the
overall ATM system.
8.
PROPOSAL FOR AMENDMENT
8.1
In support of achieving compliance to Annex 15 requirements, this study note proposes
the inclusion of specific material, based on the CHAIN solutions, into global ICAO documentation to
address wider quality attributes. This should supply States with a range of specific means to assist
implementation actions.
8.2
Following new text is recommended to be inserted into Annex 15 after para 3.2.4:
3.2.5 Recommendation.— Guidelines for data supply chain management and in
particular the establishment of Service Level Agreements (SLA), are covered in the
ICAO Doc <Nr.> Manual <title>.
8.3
Recommended application date is Nov 2010.
8.4
The detailed, distinct CHAIN solutions as outlined in Appendix A of this study note and
as supplied through the CD, are proposed for inclusion into specific ICAO guidance material, by either:
2

integration into the ICAO Quality Manual; or

by creating a new Manual addressing the subject of ‘data supply chain management’.
SIF - Standard Input Forms; refer to Annex item 4
-6-
AIS-AIMSG/1-SN No. 14
9.
9.1
ACTION BY THE AIS-AIMSG
The AIS-AIMSG is invited to:
a) discuss the content of this study note;
b) support the inclusion of a new recommendation into Annex 15 following para 3.2.4
as outlined in item 8.2 of this study note; and to
c) endorse the proposal to integrate the detailed, distinct CHAIN solutions into ICAO
guidance material as outlined in item 8.4 and to advise the secretariat on best means
to publish the subject of ‘data supply chain management’.
————————
AIS-AIMSG/1-SN No. 14
Appendix
APPENDIX
CHAIN SOLUTIONS — DELIVERABLES
1.
FOUNDATION ELEMENTS
1.1
The foundation elements are a set of guidance material which clarifies the key
requirements and supports the implementation of processes, procedures and systems throughout the
Aeronautical Information data processing chain. They also provide current good practices.
1.2
A key component is the ‘Family of Data Integrity Documents’. They are guidance,
however, they are written in a style that allows States to adopt them as national regulatory material. They
consist of:

‘Principles – Data and Quality Management’ [CHAIN/0028]. Provides a high level
overview of both the processes and requirements which are applicable throughout the
data chain. It is supported by a separate Abbreviations and Definitions document and
three further documents which detail the three specific functions of the generic data
process.

‘Aeronautical Data Origination’. Sets out the minimum requirements for the
origination of navigation-related data applying to all organisations involved in the
data origination process. The requirements cover the surveying of radio navigation
aids and points whose coordinates contribute to air navigation.
Note: This document is prepared and issued by the Eurocontrol Navigation (NAV)
domain in collaboration with the Air Navigation Team.

‘Data Exchange’ [CHAIN/0029]. Provides the requirements necessary for the
protection of data in transmission from one point to another, be it within an
organisation or between organisations.

‘Data Publication’ [CHAIN/0030]. Sets out the minimum requirements for the
process involved in the provision of aeronautical data publication and applies to all
organisations involved in the publication process for Aeronautical Information.

‘Glossary - Abbreviations and Definitions’ [CHAIN/0031]. Provides abbreviations
and detailed definitions applicable to all documents and organisations.
1.3
Based on the above documents, the ‘CHAIN Validation & Assessment Criteria’
(requirements) have been defined and integrated into 2 distinct tools:

The Excel based V & A tool (basic tool).
AIS-AIMSG/1-SN No. 14
A-2
Appendix

The ‘CHAIN Audit tool’ (advanced tool) exploiting an earlier development of the
AIS Operations Subgroup, initially known as ‘AIP Audit Assistant’. Note: both tools
are using the same V & A criteria.
1.4
Furthermore, during the awareness phase current practices providing a range from quick
solutions to complex actions as applied by individual stakeholders were assembled. Those are published
in the document ‘Data Integrity - A practical Guide’.
2.
DATA PROCESS MAPPING
2.1
The ‘Data Process Model’ (DPM) provides an understanding of the generic steps,
sequences, roles and functions of the actors involved in the data supply chain.
2.2
The output is a ‘Generic Data Process Model’ which can be customised by stakeholders
to model their individual processes. There are two immediate areas where DPM will be beneficial: SLA
and process automation. For both there is a need to clearly understand the processes involved and the
relationships and dependencies.
2.3
3.
The process repository provides following deliverables and formats:

‘Data Process Mapping – Generic Data Process Model’, a report in MS Word (doc
file) with the generalised process based on the input of the six States. This report
enables ‘easy review’ and communication. It has been directly extracted from the
Generic Rational Rose model.

‘Generic Data Process Model’ in html (packed into a zip file) to enable easy viewing
and sharing of the Rose model.

‘Generic Data Process Model’ in Rational Rose (mdl file) enabling to view, edit and
modify the data contained. This model enables customisation of the individual
processes and to capture them into your state/organisation model. In order to do so,
potential users will need to have a version of IBM Rational Rose Data Modeller.

Extraction macros (ebs file) and MS Word template (dot file) for the report creation
out of the Rose model.
SERVICE LEVEL AGREEMENTS (SLA)
3.1
CHAIN has identified the clear need for a more formal arrangement for the provision of
source information to the Aeronautical Information Services (AIS) and such need would be best served
through the utilization of Service Level Agreements (SLA).
3.2
In order to support the implementation of SLAs, a comprehensive ‘SLA package’ has
been developed to support the establishment of agreements between data providers (originators) and
Aeronautical Information Services possibly under the umbrella of a regulator.
AIS-AIMSG/1-SN No. 14
A-3
3.3
4.
Appendix
The SLA package is made up of the following elements:

SLA Guidelines: The introduction to SLA introducing the concept, providing
guidance on its elements and the underlying key process and providing a generic
template.

Originator index: A Microsoft Excel spreadsheet that reflects the structure of the AIP
(as defined in ICAO Annex 15). It is intended to be used to assist in the identification
of the supplier of each data item in the AIP, the approver and the criticality of the
data (again as defined in ICAO Annex 15).

Static Data Procedures (upstream operations): An additional Static Data Procedure
(SDP-21) that has been developed to specify the interface from the Data Provider to
the AIS.

Key Performance Indicators (KPI): A list of selected KPIs which relate to the
performance of exchanging aeronautical information between a Data Originator and
an AIS Service Provider (AISP).

SLA template: A template document which provides the basic structure of an SLA,
some example text and placeholders for the negotiated agreement to be captured.

Set of tutorial slides: To aid training and implementation.

SLA Pilot Implementation - Lessons Learned: Providing specific lessons learned to
aid further implementation and to increase awareness of good practices and potential
risks.
STANDARD INPUT FORMS (SIF)
4.1
The Standard Input Forms (SIF) provide a flexible means to improve the quality and
integrity of aeronautical data. They allow data providers and regulators to collect, distribute and approve
aeronautical data in a structured and secure way. SIF also reduce the risk of human error while
transferring data between aeronautical actors.
4.2
SIF are a set of digital forms based on AIXM covering critical and essential data entities
as defined by ICAO Annex 15, Appendix 7. SIF are extracted from the AIXM 4.5 with embedded
security and basic validation features. At the end of the data supply chain AIS may extract an AIXM
update message to be then loaded into the production system.
4.3
SIF do not impose a way of working on the States and supply chain actors are free to
collectively define the data flow that suits their needs based on an SLA. Whatever data flow they decide
upon, they will still profit from the advantages of enhanced security, capturing of meta data and improved
data quality offered by the SIF.
4.4
The operational concept behind SIF is the principle of ‘store and forward’, meaning that
the package as a whole is distributed to the next intended user. SIF are an intermediate technical means,
AIS-AIMSG/1-SN No. 14
A-4
Appendix
enabling enhanced data input and supply from originators to AIS, before system-wide process automation
takes place.
4.5
The SIF package is provided through a series of files. It is supplemented by a readme file.
Follow the installation procedure described in the SIF manual.
4.6
Manuals: SIF User Manual and SIF Customization Manual.
4.7
Zip files:
5.

Empty-SIF-package.zip: SIF with no data in it (for new or ‘basic’ users). It can be
used immediately for testing. AIS offices can distribute it after having changed the
return address. How? This is explained in the customization documentation.

AIS-tools.zip: Standard package for AIS offices, for day-to-day SIF management.
AIS may import an AIXM snapshot into this package and generate a new 'prepopulated' SIF. AIS offices can also use this package to merge SIF packages.

SIF-customisation.zip: This package is only needed to customize SIFs: change which
fields are editable, which feature types to show etc. This zip file is targeted to
developers, not to AIS operational staff.

SIF-demo-certificates.zip: Providing sample certificates and keys for testing of SIF in
relation to electronic signatures. All passwords are: ‘test’. Attention: These keys are
NOT FOR OPERATIONAL USE!
SPECIFICATION FOR
QUALITY PROCESS
AN
AUTOMATED
DATA
5.1
Inevitably, automation has to be considered when applying a more holistic approach. The
specification for an ‘automated data quality process’ defines the common, underlying requirements for an
automated data process. The specification is intended to be used by data originators and AIS providers to
support improving the overall quality of the data management process, for critical and essential data.
These deliverables will help States to modify or develop specific, automated solutions/systems ensuring a
harmonised approach through common criteria.
5.2
Besides developing the specification itself a series of studies were performed in order to
analyse existing (industry) work flow management solutions and to supply representative case studies.
5.3
Deliverables are:

'Specification for an Automated Data Quality Process' plus an 'Executive Summary'.

Study reports on:
o
Work Flow Management Solutions: presenting primarily factual input from
industry.
AIS-AIMSG/1-SN No. 14
A-5
6.
Appendix
o
Skyguide: implementation of Workflow Management Solutions.
o
United Kingdom Hydrographic Office (UKHO): another industry’s
organisation handling critical data using a workflow management solution in
their data chain.
GENERAL ELEMENTS
6.1
A series of individual activities were performed and elements were provided such as a
Preliminary Safety Case or training elements. The main deliverable areas were supplemented by an
elearning package consisting of six Computer Based Training (CBT) modules:

Module A: Introductory module providing an overview of the CHAIN activity, the
applicable regulations and the CHAIN deliverables overview.

Module B: Foundation module that introduces the CHAIN family of guidance
documents, their relationship, and how they may be applied.

Module C: SLA module that introduces the concept behind the SLAs, together with
an understanding of the problems that may be addressed by SLAs, the content of the
SLA package, the process for implementing SLAs, and the experiences and lessons
learnt during implementation.

Module D: SIF module that explains how to use SIF to exchange aeronautical
information between AIS offices and their data originators. A supporting technical
module is also provided for developers wanting to customise and enhance SIF.

Module E: Specification module providing an overview of the CHAIN deliverable:
‘Specification for an automated Data Quality Process’, including the problems
automation will address, and how the specification should be used.

Module F: Data Process Mapping module that introduces the ‘CHAIN Generic Data
Process Model’ (a rational rose based model).
— END —
Download