Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac Information access in Météo France Stage 1: Current status – – Stage 2: Information system evolution – – – – Okapi production platform (finalized products) with a Web portal IAA (Random Access on Legacy databases) with a bespoke language via ftp SOA (with a part of OGC services) Information model with geographic references Spatial databases Light and smart client (forecaster station project) Stage 2 bis: WIS solution – – OpenWIS developed with UKMO Metadata generator Stage 1: Production Service Okapi - IAA OKAPI: Three software bricks, loosely linked : – – – Okapi production platform (products factory). Internal production portal : Okapimet (For web and webservice customers). production portal : Climatheque (For web and webservice customers). IAA – – – – Random access On the legacy databases Archive access possible With a bespoke language System schema orchestration, traffic shaping Traffic shaping mechanisms Balanced charge. Product factory (close WTS) Identity management (authorization, authentication) Stage 2: New project Synopsis: Forecaster tools based on SOA Two main requirements SOA – – – – – Development efforts factorization Processing and data pool access Standard interfaces Management of different topologies (local or remote server, standalone) WMO needs and INSPIRE recommendation Client station – – – – – Last technologies Deployment and support easy Light or smart client Scalable, efficient Multi-platforms Technical choices Synopsis Server : – Linux 64 bits : • Re-use of current services in different systems • Use of programs and libraries of ECMWF – Use of bricks OpenSource • • • • Databases: PostgreSQL, PostGIS Image processing: GDAL, Proj4 Mapserver : services OGC Geonetwork for the catalogue The services Different service levels – – – – Metadata access (catalogue) Data access Business processing (graphic processing) Presentation services (images, maps, graphics…); Interoperability for the map services – So : WMS (Web Map Service) et CSW (Web Catalog Service) For INSPIRE, interoperability also on data and processing services (transformation and downloading) – So : WCS (Web Coverage Service) WFS (Web feature Service), WPS (Wep processing Service) …. SOA : Reference architecture Application composite Engine Orchestration Application composite BPM Application composite Business process Supervision Services Registry SAM BAM Bus for messages Data access Business services Processing / Transformation CRUD CRUD Administration Plate-Form CRUD SAM : Service Activity Monitoring Legacy databases BAM : Business Activity Monitoring BPM : Business Process Management CRUD : Create Read Update Delete Interoperability Strategic target Use of the standards OGC standards for geo-referenced data Web Feature Server Web Map Server Web Coverage Server Web Map Service (WMS) Web Feature Service (WFS) Web Coverage Service (WCS) Catalogue (CSW) Geography Markup Language (GML) Web Map Context (WMC) OGC KML Others… SOA : Architecture interoperability on legacy databases with geographic extension Administration Plate-Form Client SYNOPSIS Java Web Start Supervision Plate form Client SYNOPIS Full Web Interface HPOV Other applications composites Bus of messages JMS Data Service WFS BDMO WCS CSW Processing service SOS WPS BDI BDEPI SPS Presentation service WMS BDE Geoextension BDAP Geo-ext BDMO BDI BDEPI BDE BDAP Ref) Ref Ref Ref Ref Legacy databases Catalogue FPS Data Access Services WFS Web Feature Service Coast map lines Objects : Anasyg Services de DONNEES Pi, Sympo2, Aeronautic OACI Annex 3 WCS WFS SOS Portrayal Services WMS Web Map Service Static geographic layers Images Services PRESENTATION Radar, Sat Observation Models plots WMS FPS Objects : Anasyg Pi, Sympo2, Aeronautic OACI Annex 3 Different clients Client VGISC OKAPI Advanced Production Client SYNOPIS INSPIRE answer Light (Full Web) Client SYNOSIS Smart CATALOGUE Service CSW Data access services VGISC Processing services Presentation services (CRUD) WCS WFS WPS SOS SPS FPS BDMO BDI BDEPI BDE BDAP Extension Extension Extension Extension Extension BDMO BDI BDEPI BDE BDAP Ref) Ref Ref Ref Ref Legacy databases WMS General Architecture Data and services catalogue (standard) – On line products and services discovery. – Message bus • Balanced flow (cluster services) • Loosely link between server and client Spatial database – Using MapServer and other OGC implementations Standard interfaces used by the clients – Possibility to access to extern services (without guarantee of performances) – Useful for a wandering forecaster Prototype Architecture Client SYNOPSIS Full Web Client SYNOPSIS JAVA Web Start Network (IP) WMS (cartes) Frontal SYNOPSIS (SynFront) CSW HTTP -> JMS CATALOGUE Middleware ( bus JMS ) WMS Geonetwork ISO 19115-19119 Server SYNOPSIS (SynServ) Business service MapScript Servlet Executable Magics++ MapServer JMS Metadata ISO 19115 ISO 19119 CGI Services on cluster Soprano Transmet File System BD Spatiale (SynBase) PosGIS Retim Alimentation BD ( SynDATA) Premières maquettes Premières maquettes Architecture Target (Back Office) WMS WCS WFS WPS Présentation Access Object access Processing cartes Images PI, SYMPO2 CRS transf. AERO (WXXM) … Modèles Client Synopsis WEB Front End Clients Client Synopsis JAVA Client Production CSW bus JMS internal “Backbone” of services (ESB ?) CLUSTER Serveur SYNOPSIS Serveur SYNOPSIS Servers BDEPI BDE BDI « new » BD spatiale (SynBase) BD’s SOPRANO BDM BDCLIM BDAP BDI PostGIS Geonetwork ISO 19115-19119 WMS Monitoring Administration Sécurity BD’s Spatiales PostGIS CATALOGUE Présentation RMDCN Cartes SOS WMS SOS WPS Access Présentation Processing Obs validated Maps Stats SPS CEP WEB High availability Obs Front End Obs & time series Front End CBD [OKAPI ?] Stage 2 bis: WIS Approach OpenWIS development : – – – – Information fetching: Different use cases OpenWIS: Open interfaces Request or subscription Météo France use two diffusion systems Metadata GTS generator – To populate the WIS catalogue – Mapping between Volume C1 and Core Metadata Profile – Close the prompting question on information sources Ad-hoc Request for a product in the Cache – dissemination via the FSS (GISC function) 7bis: the user receives the products. 5bis: the user obtains the products from the shopping cart. 3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options. 4: The product type is part of the global dataset. The 2: the user is authenticated (several steps) 1: the user discovers local product type in the catalogue requested products are extracted from the Cache. Portal 5: Storage in the shopping cart for an online distrbution, or preparation of the dissemination instructions: they are constructed from the user profile, among other elements. DAR subscriptions (user profile) OpenWIS MSS Routing 6: the products and instructions are forwarded. FSS 7: Dissemination according to instructions. Ad-hoc Request for a local product – dissemination via the FSS (NC or DCPC function) 8bis: the user receives the products. 6bis: the user obtains the products from the shopping cart. 3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options. 2: the user is authenticated (several steps) 1: the user discovers local product type in the catalogue 4: the product type is owned by a local NC or DCPC. Portal 6: Storage in the online shopping cart, or preparation for dissemination. DAR subscriptions (user profile) OpenWIS MSS Routing 7: the products and instructions are forwarded. 5: the required products are extracted and returned. SOURCE FSS 8: Dissemination according to instructions. Arrival of a new GTS product at the MSS (GISC function) 6bis: the user receives the product. 4bis: the user obtains the product from the shopping cart. 3: Is someone subscribed to this type of product ? Portail 2bis: the product is collected and inserted in the GISC Cache DAR subscriptions (user profile) OpenWIS MSS 1: the MSS receives a new product Routing 4: Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions. 5: the product and instructions are forwarded FSS 2: the MSS routes the product according to its routing table 6: Dissemination according to instructions. New local product available (NC or DCPC WIS function) 7bis: the user receives the product. 5bis: the user obtains the product from the shopping cart. Portal 5: Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions. 3: Is someone subscribed to this type of product ? 2: Notification of the product availability DAR subscriptions (user profile) OpenWIS TRANSMET Routage 6: the product and instructions are forwarded 4: the required products are extracted and returned. SOURCE FSS 7: Dissemination according to instructions. 1: New local product DARMet A2 A4 Security Service Authentication User Interface (web portal) Make / Follow Request Metadata service Authorisation Catalogue Access A1 A3 Metadata Catalogue Synchro & Harvesting Browse / Search DAR Admin / Monitoring Data service Manage Requests A6 Monitoring & Control Service A1 A3 A5 Cache Monitoring Collection « Ad Hoc » User & Data Policies A7 External Interface Routine « Push » Replication Administration A1 A3 A5 POSSIBLE CHOICES MSS/FSS DIFF A1 A5 A5 Local System OpenWIS UK MetOffice A1 SIMDAT base GeoNetwork base Sun OpenSSO base MSS SMART / GEMS GTS Metadata Generator Close to prompting question on digitization