Introduction to Geographic Information Systems Spring 2013 (INF 385T-28437) Dr. David Arctur Lecturer, Research Fellow University of Texas at Austin Lecture 12 April 4, 2013 A story about Geospatial Data Exchange Standards and the Open Geospatial Consortium http://www.opengeospatial.org © 2013, Open Geospatial Consortium Outline • Overview of key spatial data exchange standards, and meaning of ‘interoperability’ – – – – – Web Services Encodings Sensor Web Observations Distributed processing and workflow • Publishing, Web Catalogues, Metadata • Digital Rights Management • Standards organizational ecosystem • Interoperability issues and challenges • Case studies and experiments © 2013, Open Geospatial Consortium 2 Web Feature Server (highways) Web Coverage Server (rainfall) Web Map Server (basemap) With OGC web services, an analyst or decision maker can dynamically access that data which is relevant to the task at hand, directly from the authoritative data steward, using a variety of tools. © 2013, Open Geospatial Consortium Interoperability allows a Common Reality “What we are doing is facilitating a common picture of reality for different organizations which have different views of the reality, the disaster, the catastrophe, that they all have to deal with collectively” David Schell Founder, OGC © 2013, Open Geospatial Consortium 4 Web Map Service (WMS) can get multiple maps Elevation Water Bodies Borders Cities Multiple overlaid maps One GetMap request: © 2013, Open Geospatial Consortium 5 OGC Geography Markup Language (GML) • GML is application of the eXtensible Markup Language (XML) – Based on XML specified by World Wide Web Consortium (W3C) – Specifies XML Schemas that specify XML encoding of geographic features, their geometry, and their attributes • GML encodes digital feature data – Encodes features, attributes, geometries, collections, etc. – Applications require specifying more specific Application XML Schemas – GML v3, supports 2 1/2 and 3D geometry as well as complex geometry and topology • GML 3 is also ISO 19136 © 2013, Open Geospatial Consortium 6 GML: Representing Geographic Features Another Information Community’s Schema Highway is: _Pavement thickness _Right of way _Width …. One Information Community’s Schema Road is: _Width _Lanes _Pavement type …. Cell tower is: _Owner _Height _Licensees …. Support for complex geometries, spatial and temporal reference systems, topology, units of measure, metadata, feature and coverage visualization. Cell transm. Platform is: _Location _No. of antennas _Elevation …. Mayberry’s Cell Tower (an instance of Cell Transm. Platform in another IC’s schema) Mayberry Road (an instance of Road in one IC’s schema) GML defines a data encoding in XML that allows geographic data and its attributes to be moved between disparate systems with understanding © 2013, Open Geospatial Consortium 7 CAD-GIS Integration: 3D City Models (CityGML) Source: T. H. Kolbe: Standardization of 3D City Models • Urban Planning • Urban Modeling • Microclimate Analysis • Emergency Management and Response • Logistics Flow • Critical Infrastructure Management / Protection • Sustainable Communities • Retail Services © 2013, Open Geospatial Consortium 8 GML Application Activities Profiles – – – – – GML Point Profile GML Simple Features Profile GML GeoShape for use in IETF GML in JPEG2000 GeoRSS: GML Serialization US NSDI GML Schemas for Framework Datasets – – – – – – Base Transportation Roads Governmental Units Linear Reference Systems Dictionaries Hydrology Community Application Schemas – – – – – – – – – Climate Science Modeling Language (CSML) CityGML CleanSeaNet NcML/GML (NetCDF and GML) TDWG Biodiversity GML GeoSciML - Geological Sciences ML MarineXML Ground Water Modeling Language WaterML Further information on OGC Network http://www.ogcnetwork.net/node/210 © 2013, Open Geospatial Consortium 9 OGC Sensor Web Enablement Industrial Process Monitor – Sensors connected to and discoverable on the Web – Sensors have position & generate observations - Sensor descriptions available Automobile As Sensor Probe - Services to task and access sensors - Local, regional, national scalability - Enabling the Enterprise Traffic Monitoring Temp Sensor Satellite-borne Imaging Device Airborne Imaging Device Environmental Monitor Stored Sensor Data Webcam Strain Gauge Health Monitor © 2013, Open Geospatial Consortium 10 Observations • An observation feature binds a result to a feature of interest, upon which the observation was made • Observation - act of observing a property or phenomenon, with the goal of producing an estimate of the value of the property. • Observations are modeled as Features within the context of the General Feature Model [ISO 19101, ISO 19109]. © 2013, Open Geospatial Consortium 11 SWE Languages and Encodings Sensor and Processing Description Language Information Model for Observations and Sensing Observations & Measurements (O&M) GML Observations Application Schema SensorML TransducerML SWE Common Data Structure And Encodings Multiplexed, Real Time Streaming Protocol © 2013, Open Geospatial Consortium 12 Sensor Web Enablement Standards • Information Models and Schema – Observations and Measurements (O&M) – Models and schema for semantic basis of measurements – Sensor Model Language (SensorML) - Models and schema for components, georegistration, response, process models – Transducer Markup Language - Data encoding that enables interoperability and fusion of dissimilar sensor data • Web Services – Sensor Observation Service - Access observations for a sensor or sensor constellation – Sensor Planning Service – Task sensor system for desired observations – Sensor Alert Service – Subscribe to alerts from sensor observations – Sensor Registries – Discover sensors and sensor observations • Built upon OGC, Web and Internet standards © 2013, Open Geospatial Consortium 13 PUCK: Plug and Work • Protocol to get instrument UUID and related info from device itself – 96-byte “data sheet” includes UUID, manufacturer/model ID – “Related info” can include SensorML, driver code, etc... • Defined for RS-232 and Ethernet • MBARI developed for oceanographic applications, but applicable to many sensing domains • Adopted as OGC standard in January 2012 PUCK-enabled data logger from RBR Ltd © 2013, Open Geospatial Consortium 14 SWE services SWE protocol SOS SAS Get instrument description from Access instrument through Instrument host Nonstandard! SPS Instrument Runs on driver Instrument protocol +PUCK Instrument © 2013, Open Geospatial Consortium SensorML Retrieved from Web Processing Service (WPS) WPS-client Communication over the web using HTTP GetCapabilities DescribeProcess WPS Algorithms Repository … Execute Data Handler Repository … … … Algorithm 1 Data Handler A Web Processing Service © 2013, Open Geospatial Consortium 16 “Chaining” Web Services For Decision Support Service chaining enables modeling and integration from observation data Scenario: Tracking spread of wildfire and proximity to highway WCS = Web Coverage Service WCTS = Web Coordinate Transform. Serv. WPS = Web Processing Service OGC Interfaces Decision Support Client Internet SOS WCTS WPS WFS … Web Servers © 2013, Open Geospatial Consortium Location Based Services (OpenLS) • Includes location-based emergency services, location-based information services, location-responsive instantmessaging systems and other services. • OGC's Open Location Services (OpenLS) specification provides standards framework consistent with both telephony standards and geospatial standards. • So, geospatial applications can be easily developed and integrated across a range of location-aware mobile devices and networks. © 2013, Open Geospatial Consortium On the go 18 Short Message Service (SMS) http://en.wikipedia.org/wiki/Short_Message_Service • SMS is supported by most mobile devices • SMS is fixed-rate and everyone is used to it already • SMS is push-and-trigger style communication However, SMS lacks an open standards based approach for location information exchange across platforms. © 2013, Open Geospatial Consortium 19 OGC Open GeoSMS Defines a short messaging service (SMS) encoding to exchange lightweight location information between different mobile devices or applications. Open GeoSMS encoding for location is compatible with other OGC standards, such as those for sensor webs and earth imaging. It is also compatible with other standards such as the OASIS Common Alerting Protocol (CAP) standard and the IETF RFC Presence Information Data Format Location Object (PIDF-LO). © 2013, Open Geospatial Consortium 20 Cross-platform Open GeoSMS http://maps.google.com/maps?q=30.2792,-97.743&GeoSMS I am here for GIS class. Users don’t need to care about target platform or map/navigation service © 2013, Open Geospatial Consortium 21 Publishing and Discovery • Catalogs leverage ISO conformant metadata • Support publishing and discovery of distributed geospatial data and associated services OGC Catalog Service 2.0, ISO 19119 Metadata Standard © 2013, Open Geospatial Consortium 22 Catalogue Service Architecture (WMS, WFS, WCS, SOS, …) Source: OGC 07-006r1 OpenGIS Catalogue Services Specification v2.0.2, p.26 © 2013, Open Geospatial Consortium 23 Metadata • Dataset metadata – characterize geographic data; enables in most efficient manner; facilitates data discovery, retrieval and reuse; fitness for of use – datasets, aggregations of datasets, individual geographic features, – core metadata - subset of the full set of elements – OGC adopted ISO 19115, additional material in OGC 01-111 • Service Metadata – "Get Capabilities" operation common to all OGC Web Services, returns a "capabilities document" describing the service. – OGC Abstract Spec Topic 12 (identical with ISO 19119) • Registry Information Model (RIM) – all metadata and data types are registry objects – Metadata catalog can be enhanced to support queries of dataset-specific fields, not just standard metadata (but more work, less commonly supported) © 2013, Open Geospatial Consortium 24 OGC Web Services (OWS) Just as http:// is the dial tone of the World Wide Web, and html / xml are the standard encodings, the geospatial web is enabled by OGC standards: Web Feature Server Web Map Server Web Coverage Server Web Map Service (WMS) Web Feature Service (WFS) Web Coverage Service (WCS) Catalogue (CSW) Geography Markup Language (GML) OGC KML Others… Relevant to geospatial information applications: Critical Infrastructure, Emergency Management, Weather, Climate, Homeland Security, Defense & Intelligence, Oceans Science, others © 2013, Open Geospatial Consortium 25 Geospatial Rights Management • Digital rights management for geospatial (GeoDRM) builds on larger market with geospatial resources specifics © 2013, Open Geospatial Consortium 26 Reference Architecture Service Distribution Geospatial Portal Viewer Clients Discovery Clients Management Clients Access Control Exposed Services Portal Services Portrayal Portrayal Portrayal Services Services Services Internet Data Data Data Services Services Services Features Gazetteer Coverages Symbology Mgmt Maps Styling Coverages Map Context Catalog Catalog Catalog Services Services Services Data Discovery Service Discovery Catalog Update Query Languages © 2013, Open Geospatial Consortium 27 De Facto Web Standards Organizations OASIS / IETF / W3C OGC De Jure ISO Domains: Object / Abstract Models, Content, Vocabulary Infrastructure: WSDL, UDDI, SOAP, XML Software Interfaces: Instantiate Domain and Dejure into Infrastructure Domain Infrastructure © 2013, Open Geospatial Consortium 28 Ecosystem of Standards Organizations … and others www.opengeospatial.org/ogc/alliancepartners © 2012, Open Geospatial Consortium 29 100+ University/Research Members © 2012, Open Geospatial Consortium North America •Harvard, MIT, WHOI, CUAHSI •Penn State, Columbia U. •Johns Hopkins, U. Maryland •VA Tech, NCSU, UNC, RENCI •Georgia Tech, U. Arkansas, NCSA •UT Austin, Tx A&M, UNM •ASU, SDSC, NCEAS, MBARI, UW •BC Inst. Tech, U. Calgary, Carleton U. Europe-Asia-Australia •U. College London, U. Manchester •U. Nottingham, U. Edinburgh, NERC •U. Bonn, U. München, U. Münster •U. Barcelona, U. Jaume I •Italian Research Council •Indian Inst. of Tech. •U. Tokyo, U. Seoul, Wuhan U. •Feng Chia U. Taiwan •CSIRO, U. Melbourne 30 Thematic Interoperability Issues Hydro-Meteo: Info models, Time series, Forecast time, Integrated modeling frameworks Climate: Longer times, Coupled models, Integrating the modeling frameworks, Provenance, Open science © 2013, Open Geospatial Consortium Cross-cutting: Tracking trust, uncertainty, provenance; Semantics mediation, Adaptive interoperability 31 Broader Interoperability Challenges • Fitness for use: – Availability, completeness and consistency of sensor or process description & provenance – Known coordinate reference system & scale of data capture for best use – Precision, uncertainty, other data quality aspects • Difficulty to relate or compare data content due to different principles of measurement – Remote vs. in-situ sensors; time series vs. sampled observations • Differences in vocabularies & meaning of data among users • Schema does not always accompany the relevant data • Catalogue architecture for networks of networks • Institutional barriers to data access & exchange © 2013, Open Geospatial Consortium 32 Emerging Solutions for Publishing and Citing Data Not just an issue for science… These same issues, in various ways & levels of urgency, also come up in: • Emergency Management / Disaster Response / National Defense • Collecting, maintaining, synchronizing local & national government data © 2013, Open Geospatial Consortium 34 Examples of Distributed GIS • Wildfire management • Typhoon/debris flow warning system • Aeronautical information management • Global flood prediction (eWaterCycle.org) © 2013, Open Geospatial Consortium 35 Wildfire Management • Rapid mobilization of UAV assets – Global Hawk Source: NASA © 2013, Open Geospatial Consortium 36 Sensor Webs and Disaster Management First responder Theme Based Tasking Request Theme: Geo-Emergency Loc: Priority: Witch Fire (SoCal) Oct 23, 2007 1. Emergency 2. Discover available sensor assets over Wizard Internet 3. Wizard assembles possible workflows 4. Workflow engine controls creation of multi-sensor products, processing and Workflow Engine delivery to user desktop Result: Efficient / timely use of assets © 2013, Open Geospatial Consortium 37 Taiwan: Disaster Prediction and Warning • Typhoons and earthquakes trigger landslides and flooding on a frequent basis • OGC services used with an array of spatial data and sensors to provide situational awareness for forecasting, detecting, alerting and response to debris flow situations. • Rapidly deployed network of debris flow sensors, and distributed services performing sensor data analysis and processing © 2013, Open Geospatial Consortium 39 Source: Feng Chia University, GIS Research Center Typhoons – A Busy Region Typhoon invaded or approximated Taiwan in these 2 decades © 2013, Open Geospatial Consortium Source: Feng Chia University, GIS Research Center 40 Disaster Prediction and Warning Pre-typhoon Nov 2008 Post-Morakot Sept 2009 Source: Feng Chia University, GIS Research Center © 2013, Open Geospatial Consortium 41 Sensors in Debris Flow Monitoring Station Geophone Spotlight Flow meter Water Level Meter CCD Camera Rain Gauge Soil Moisture Wire Sensor Load cell © 2013, Open Geospatial Consortium Meteorological sensors 42 Aeronautical Information Management (AIM) (OGC Web Services Testbeds, OWS 6-8) • Develop and test standards-based serviceoriented architecture to support the provision of aeronautical information directly to flight decks and Electronic Flight Bags (EFB) • Support vision for Aeronautical Information Management – Interconnected systems with many actors and many users – Need for real-time information used in flight planning, navigation, rerouting, etc – Right information at the right time at the right place to the right user – End-to-end management of information © 2013, Open Geospatial Consortium 43 OWS-6 Aeronautical Information Management NNEW – NextGEN Network Enabled Weather TAF – Terminal Aerodrome Forecast WXXM – Weather Info. Exchange Model WFS – OGC Web Feature Service © 2013, Open Geospatial Consortium 44 FAA Special Access Airspace (SAA) SAA Pilot Demo page http://www.opengeospatial.org/pub/www/saa/inde x.html OGC Aviation Domain Working Group http://www.opengeospatial.org/projects/groups/avi ationdwg © 2013, Open Geospatial Consortium 45 Global Flood Prediction: eWaterCycle.org © 2013, Open Geospatial Consortium Interoperability is about Organizations “Interoperability seems to be about the integration of information. What it’s really about is the coordination of organizational behavior.” David Schell Founder, OGC © 2013, Open Geospatial Consortium 47 It’s always something… © 2013, Open Geospatial Consortium 48 Summary • Overview of key spatial data exchange standards, and meaning of ‘interoperability’ – – – – – Web Services Encodings Sensor Web Observations Distributed processing and workflow • Publishing, Web Catalogues, Metadata • Digital Rights Management • Standards organizational ecosystem • Interoperability issues and challenges • Case studies and experiments © 2013, Open Geospatial Consortium 49