Workshop “Observing Europe: Networking the Earth Observation Networks in Europe” Paris 21 - 22 Sep 2015 GEOSS Common Infrastructure (GCI) for Earth Observation Networks STEFANO NATIVI Institute of Atmospheric Pollution Research, National Research Council of Italy stefano.nativi@cnr.it GEOSS Discovery and Access Infrastructure Unified, Simplified, Flexible Discovery and Access services interface stefano.nativi@cnr.it GEOSS Users GEOSS Applications GEOSS Applications Applications GEOSS Applications GEOSS GEOSS Application Developers GEOSS Common Governance GEOSS Common Infrast. …. System 1 System 3 System System 2 …. 4 System 3 System 1 System j Domain A GEOSS Providers System 4 …. System 2 System System 1 System 3 4 System 2 …. System z Domain K System i Domain B stefano.nativi@cnr.it GEOSS Information System GEO Home Page GEOSS Apps GEOSS Portal Brokering Framework Registry (CSR) Semantic engines stefano.nativi@cnr.it Ongoing Brokering tests: • • • • • • • • • • IGN DigitalGlobe GBIF Geoscience Australia FP7 GeoCarbon DBs UK.gov FAO RapidEye EO MAP Arctic Data archive System (ADS) stefano.nativi@cnr.it GCI Providers Evolution and statistics Introduction of the Brokering approach CSR brokering Introduction of the Brokering approach stefano.nativi@cnr.it Big Data challenges for the GCI – Volume: • Variety: Different product types (data, services, models, documents); Data Millions of discoverable (small & medium) products; Long EO time/space series, … . models; Protocols; Semantics; Granularity levels; Organizations; Maturity level, … . • Veracity/Validity/Value: Evaluation support, Essential Variables, Discovery Ranking, User Feedbacks, … . o Velocity: serve Countries with limited Internet access, Fast Discovery & Access, Data Transformation and Analytics o Visualization: Preview, Tiling services, visual exploration, … . stefano.nativi@cnr.it Applications, Mobile Apps, Community Portals, Clients WIS (KMA node) ArcGIS online CEOS Water Portal GEOSS App Developers GEOSS Portal APIs ChinaGEOSS Portal Software My-GEOSS Discovery Brokering Services Evaluation Access Processing (simple) Visualization AIP-8 pilots Mediation Tiling Monitoring Tagging Workflow mangmt QoS control Platform .. and more ... Infrastructure Vast Data Supply System stefano.nativi@cnr.it Cloud IaaS and PaaS Computing Storage Monitoring Auto Scaling Load Balancing Routing NoSQL Database Clustering stefano.nativi@cnr.it GEO DAB in the Cloud stefano.nativi@cnr.it GCI (GEO DAB) Usage Statistics Monitor and assess the GCI/GEO DAB Usage* • 2014: more than 410User’s thousands * Only requests contribute to the statistics • First 4 months 2015: more than 150 thousands • Last two weeks: around 12 thousand per day All Time Yearly Monthly Daily 1. PANGAEA • Number of Discovery Queries 2. GRDC GEOWOW 1. Temperature finalized 3. CEOS WGISS 2. River 4.1.Discharge FedEO • Most Searched Keywords Keyword 3. Precipitation 5.2. EEA SDI Data-CORE GEOSS • Most Searched Data Sources 4. Land Cover 6.3. …. . BBOX …. . • Most Used Query 5. Constraints: 4. … . • Simple constraint • Complex constraint http://statistics.geodab.eu/gi-stat/stats stefano.nativi@cnr.it GCI APIs High level open APIs to develop GEOSS applications APIs = Application Program Interfaces Developers JavaScript APIs for GEOSS resources • Discovery • Semantic enriched discovery • Access • Visualization http://api.eurogeoss-broker.eu/docs/index.html GCI stefano.nativi@cnr.it Authentication Support existing and well-used users’ credentials (e.g. Google, Twitter, etc.) GCI Authentication service stefano.nativi@cnr.it Ranking and paging Configurable and flexible stefano.nativi@cnr.it Search refinement To refine search • Filter matching results by: – – – – Sources Keywords Bbox Service type/Data format • Two-steps query – Time series discovery – Time slots selection stefano.nativi@cnr.it Quality check Read CSR Metadata Records Test Link Reachability Q1 Content Classification Test Accessibility Q2 Q3 Harvest Metadata Q4 Update GCI Configuration Knowledge Base Data Base GEOSS CSR stefano.nativi@cnr.it THE NEXT FUTURE Personal Vision stefano.nativi@cnr.it The Architectural Evolutions 2005 2011 2013 2016 1st Evolution [Service driven] Catalog of catalogs 2nd Evolution [Brokering pattern] Brokering framework 3rd Evolution [Big Data] Cloudbased EcoSystem 4th Evolution [VRE] …. Discovery Access (re-)Use stefano.nativi@cnr.it From Data to Knowledge Strategic Targets What if .. . GEOSS Users stefano.nativi@cnr.it Models SocioEconomic Data Earth Observation 2005 GEOSS Implementation Plan Reference © GEO Secretariat stefano.nativi@cnr.it Data Document Socioeconomic Fossil Fuel Use Model Data Global Climate Model [Source: GEO Sec] Climatology Regional Climate Model Data Data Deforestation/ Disturbance Model Observational Data (environment & vector distribution) Data Health Vector Niche Model Biodiversity Infection Rate Model Data Human Population Density and Distribution Model Infection Rates What if… stefano.nativi@cnr.it GEO Model Web A dynamic web of models, integrated with databases and websites, to form a consultative infrastructure where researchers, managers, policy makers, and the general public can go to gain insight into “what if” questions [Coordinators: Stefano Nativi (CNR) and Gary Geller (GEO sec)] stefano.nativi@cnr.it 2015 next decade 2025 stefano.nativi@cnr.it Data Volume EO Data Experts (IT experts) Environmental Experts (Practitioners) Policy Makers (Citizens) Access Re-use Non-IT Experts Observations Essential Variables Indicators (Sustainability) Indexes Inter Discover Interoperability Level IT Experts Global Change Experts (Educators) Users Semantic content (From Data to Knowledge ) stefano.nativi@cnr.it Thank you ! Questions? http://www.sciencedirect.com/science/article/pii/S1364815215000481 Useful links http://api.eurogeoss-broker.eu/docs/index.html http://statistics.geodab.eu/gi-stat/stats stefano.nativi@cnr.it • launched in response to calls for action by the 2002 World Summit on Sustainable Development, Earth Observation Summits, and by the G8 (Group of Eight) leading industrialized countries • voluntary partnership of 99 governments and 87 international organizations • provides a framework within which these partners can develop new projects and coordinate their strategies and investments • charged with developing GEOSS stefano.nativi@cnr.it stefano.nativi@cnr.it