Let data from databases in NL flow

advertisement
Informatiehuis Water
Let data from
databases in NL flow
“To let water information flow efficiently and
effectively between water partners and to
make it available to third parties”
POLICY AND
MANAGEMENT
INFORMATION
TRANSFER
DATA
PROCESSING
Monitoring
Cycle
e.g. for
Water
Quality
DATA
ACQUISTION
Database
position(s)
NEED FOR
INFORMATION
MONITORING
STRATEGY
Databases / IT-systems in NL
Dealing with monitoring water
DONAR
• Surface water
Lodingen
Thermos
• Groundwater
LIMS
LMW
• Soil (dredging)
Ecolims
• Drinkingwater sources WABinfo
WVO-info
• Waste water
OWIS
IRIS-basis
• Chemical
IRIS-metingen
Wiski
• Biological
ZUIS/Z-info
• Fysical / Morphological
• Operational watermanagement
• Marine (wave-parameters)
EcoBase
Dawaco
Bulkdatabase
KRW-portal
Limnodata
DINO / BRO
REWAB
Emissieregistratie
Zwemwaterregister
…
Data need to flow
to get to the WFD status reporting
• Data
– 56 Water management areas
RWS, waterboards, provinces, (sub)river basins
– 722 surface water bodies
– 815 monitoring locations (2010)
– 273 physico-chemical substances
Database for
– Thousands of biological species
more purposes
besides the WFD – 36869 WFD objectives
– 92720 representing rules in WFD monitoring program
– Millions of monitoring values
• From different
reporting
databases, systems, organisations,
in different formats
data
Presentation
 Databases in NL
– Many different databases with monitoring data
– Aquo exchange/information model
• Only data-elements which have to exchanged
• Standard -> Base for data quality
 Data quality
– 1. Defined objects (incl. associations) and attributes
normalized, standarized,
including ‘metadata’ and references to code lists
– 2. Still more to do: Data validation
• Examples
• Summary
It’s a fact: they are different
 Mess
 No problem
 Best Practices
 Chance
 Standard
Exchange Model Aquo (UM Aquo)
•
Best Practice = experience
Scope: monitoring (incl. WFD)
measuring point, field measurements, samples
(water, soil, biology) laboratory analysis,
model results, aggregated datam, integrated data
reporting status of e.g. waterbodies etc.
•
All Dutch internal data exchange
1. UML model (transformed to XML schema)
2. Exchange file in GML/XML and CSV new format
3. Entries (substances; units etc) based on code lists
•
Compatible with:
- ISO / OGC / W3C standards
- INSPIRE Conceptual Model
- NEN3610: Base model Geographic Information
•
Structured definition of data
Semantic standard -> quality of data
• Measuring object / point
UM Aquo monitoring
objects and attributes
– …
• Sample
–
–
–
–
–
–
Can consists of sub-samples
Sampling Instrument, measurement instrument
Sampling method
Sample criterium
Compartment: air, water …
…
• Measurement/Observation
–
–
–
–
–
Quantity and Unit (SI)
Chemical substance, Species of object
Capacity
Value determination methode
Value processing method
if value derived from set other values
– On site or Lab.
– …
• Value
– Start date/time
– End date/time
– Value (numerical or
alfanumerical)
– Limit symbol
– Quality judgement code
– Value detection limit
– Precision / # significant digits
– Validation
– …
Aquo Standard and quality
‘Tool for consistency’ : semantic (and technical) data validation
1. Aquo-lex: Definitions
2. Aquo domain tables: code lists (domain values)
3. UM Aquo: exchange/information model
– Attributes (properties)
• Datatypes: references tot code lists: ± 90% of attributes
• Including ‘metadata’ attributes: references to (standarized) methods
– Structure (syntax)
– Associations between objects
To do: • Other validations
– Correct values?
– Dataset complete?
• Modelling:
– Versioning objects:
3 dates/periode: registration / reality / validity
– Owner of data
Distribution layer
WaterDataNet
Access layer
public and internal
Distribution layer
Aquo-standard
Core layer
databases
Aquo-kit experience
• Combining data sets -> view in database or GUI
–
–
–
–
–
Import: semantic validation
Testing: not all attributes are needed
WFD Assessment = consistency in datasets, but not always visible
Precision of values needs attention.
List of (WFD) quality elements and chemical substances
• Some other properties
– Functionality based on document ‘Protocol’
– Aquo-kit is a tool(kit), no data management system
– IHW doesn’t own the data. IHW/toolkit supports:
Users/water managers carry out the testing (against water quality standards/limits)
and WFD assessment and verify the results .
– Nov. 2012: new release with improved GUI and Reports
– 2013: Biological Testing module for WFD / Soil Testing module for all soil-limits
2013+ Water Quality Portal
• Single entrance to all collected water quality data:
More than just WFD
– Extension to and redesign of the WFD-Portal
• Service based architecture
– Testing of water quality indicators
– View services
– Download services
• Automatic production of reports (including RBMP and
EU reporting sheets) and factsheets per water body
More information (in Dutch however!)
www.ihw.nl
www.aquo.nl
Questions about data flows, the Aquo-standard or
systems maintened by IHW: servicedesk@ihw.nl
Download