Presentation by Jacques Roumilhac

advertisement
Workshop on Information Access Enablers
Météo France Strategy
Geneva
17-18 May 2010
Jacques Roumilhac
Information access in Météo France

Stage 1: Current status
–
–

Stage 2: Information system evolution
–
–
–
–

Okapi production platform (finalized products) with a Web portal
IAA (Random Access on Legacy databases) with a bespoke language via ftp
SOA (with a part of OGC services)
Information model with geographic references
Spatial databases
Light and smart client (forecaster station project)
Stage 2 bis: WIS solution
–
–
OpenWIS developed with UKMO
Metadata generator
Stage 1: Production Service Okapi - IAA

OKAPI: Three software bricks, loosely linked :
–
–
–

Okapi production platform (products factory).
Internal production portal : Okapimet (For web and webservice customers).
production portal : Climatheque (For web and webservice customers).
IAA
–
–
–
–
Random access
On the legacy databases
Archive access possible
With a bespoke language
System schema
orchestration, traffic shaping




Traffic shaping mechanisms
Balanced charge.
Product factory (close WTS)
Identity management (authorization,
authentication)
Stage 2: New project Synopsis: Forecaster tools
based on SOA
 Two main requirements
 SOA
–
–
–
–
–
Development efforts factorization
Processing and data pool access
Standard interfaces
Management of different topologies (local or remote server, standalone)
WMO needs and INSPIRE recommendation
 Client station
–
–
–
–
–
Last technologies
Deployment and support easy
Light or smart client
Scalable, efficient
Multi-platforms
Technical choices

Synopsis Server :
– Linux 64 bits :
• Re-use of current services in different systems
• Use of programs and libraries of ECMWF
– Use of bricks OpenSource
•
•
•
•
Databases: PostgreSQL, PostGIS
Image processing: GDAL, Proj4
Mapserver : services OGC
Geonetwork for the catalogue
The services

Different service levels
–
–
–
–

Metadata access (catalogue)
Data access
Business processing (graphic processing)
Presentation services (images, maps, graphics…);
Interoperability for the map services
– So : WMS (Web Map Service) et CSW (Web Catalog Service)

For INSPIRE, interoperability also on data and processing services
(transformation and downloading)
– So : WCS (Web Coverage Service) WFS (Web feature Service), WPS (Wep
processing Service) ….
SOA : Reference architecture
Application composite
Engine
Orchestration
Application composite
BPM
Application composite
Business process
Supervision
Services
Registry
SAM
BAM
Bus for messages
Data access
Business services
Processing /
Transformation
CRUD
CRUD
Administration
Plate-Form
CRUD
SAM : Service Activity Monitoring
Legacy databases
BAM : Business Activity Monitoring
BPM : Business Process Management
CRUD : Create Read Update Delete
Interoperability
 Strategic target
 Use of the standards
 OGC standards for geo-referenced data
Web Feature
Server
Web Map
Server
Web Coverage
Server
Web Map Service (WMS)
Web Feature Service (WFS)
Web Coverage Service (WCS)
Catalogue (CSW)
Geography Markup Language (GML)
Web Map Context (WMC)
OGC KML
Others…
SOA : Architecture interoperability on legacy
databases with geographic extension
Administration
Plate-Form
Client SYNOPSIS Java Web Start
Supervision
Plate form
Client SYNOPIS Full Web
Interface HPOV
Other applications composites
Bus of messages JMS
Data Service
WFS
BDMO
WCS
CSW
Processing service
SOS
WPS
BDI
BDEPI
SPS
Presentation service
WMS
BDE
Geoextension
BDAP
Geo-ext
BDMO
BDI
BDEPI
BDE
BDAP
Ref)
Ref
Ref
Ref
Ref
Legacy databases
Catalogue
FPS
Data Access Services
WFS
Web Feature
Service
Coast map lines
Objects : Anasyg
Services de DONNEES
Pi, Sympo2,
Aeronautic
OACI Annex 3
WCS
WFS
SOS
Portrayal Services
WMS
Web Map
Service
Static geographic
layers
Images
Services PRESENTATION
Radar, Sat
Observation
Models plots
WMS
FPS
Objects : Anasyg
Pi, Sympo2,
Aeronautic
OACI Annex 3
Different clients
Client VGISC
OKAPI
Advanced
Production
Client SYNOPIS
INSPIRE
answer
Light (Full Web)
Client SYNOSIS
Smart
CATALOGUE
Service
CSW
Data access services
VGISC
Processing services
Presentation services
(CRUD)
WCS
WFS
WPS
SOS
SPS
FPS
BDMO
BDI
BDEPI
BDE
BDAP
Extension
Extension
Extension
Extension
Extension
BDMO
BDI
BDEPI
BDE
BDAP
Ref)
Ref
Ref
Ref
Ref
Legacy databases
WMS
General Architecture
 Data and services catalogue (standard)
– On line products and services discovery.
– Message bus
• Balanced flow (cluster services)
• Loosely link between server and client
 Spatial database
– Using MapServer and other OGC implementations
 Standard interfaces used by the clients
– Possibility to access to extern services (without guarantee of
performances)
– Useful for a wandering forecaster
Prototype Architecture
Client
SYNOPSIS
Full Web
Client SYNOPSIS
JAVA Web Start
Network (IP)
WMS
(cartes)
Frontal SYNOPSIS (SynFront)
CSW
HTTP -> JMS
CATALOGUE
Middleware ( bus JMS )
WMS
Geonetwork
ISO 19115-19119
Server SYNOPSIS (SynServ)
Business service
MapScript
Servlet
Executable
Magics++
MapServer
JMS
Metadata
ISO 19115
ISO 19119
CGI
Services on
cluster
Soprano
Transmet
File System
BD Spatiale
(SynBase)
PosGIS
Retim
Alimentation
BD (
SynDATA)
Premières maquettes
Premières maquettes
Architecture Target (Back Office)
WMS
WCS
WFS
WPS
Présentation
Access
Object access
Processing
cartes
Images
PI, SYMPO2
CRS transf.
AERO (WXXM)
…
Modèles
Client
Synopsis
WEB
Front End
Clients
Client Synopsis
JAVA
Client
Production
CSW
bus JMS internal
“Backbone” of services
(ESB ?)
CLUSTER
Serveur SYNOPSIS
Serveur SYNOPSIS
Servers
BDEPI
BDE
BDI « new »
BD spatiale
(SynBase)
BD’s SOPRANO
BDM
BDCLIM
BDAP
BDI
PostGIS
Geonetwork
ISO 19115-19119
WMS
Monitoring
Administration
Sécurity
BD’s Spatiales
PostGIS
CATALOGUE
Présentation
RMDCN
Cartes
SOS
WMS
SOS
WPS
Access
Présentation
Processing
Obs
validated
Maps
Stats
SPS
CEP WEB
High availability
Obs Front End
Obs & time series
Front End CBD [OKAPI ?]
Stage 2 bis: WIS Approach

OpenWIS development :
–
–
–
–

Information fetching: Different use cases
OpenWIS: Open interfaces
Request or subscription
Météo France use two diffusion systems
Metadata GTS generator
– To populate the WIS catalogue
– Mapping between Volume C1 and Core Metadata Profile
– Close the prompting question on information sources
Ad-hoc Request for a product
in the Cache – dissemination
via the FSS (GISC function)
7bis: the user receives the products.
5bis: the user obtains the products
from the shopping cart.
3: the user composes an ad-hoc
request for the product type.
The user specifies which
products are of interest, and the
chosen dissemination options. 4: The product type is part of the global dataset. The
2: the user is authenticated
(several steps)
1: the user discovers local
product type
in the
catalogue
requested products are extracted from the Cache.
Portal
5: Storage in the shopping cart for an online distrbution, or
preparation of the dissemination instructions: they are
constructed from the user profile, among other elements.
DAR subscriptions
(user profile)
OpenWIS
MSS
Routing
6: the products and instructions are
forwarded.
FSS
7: Dissemination according to
instructions.
Ad-hoc Request for a local
product – dissemination via the
FSS (NC or DCPC function)
8bis: the user receives the products.
6bis: the user obtains the products
from the shopping cart.
3: the user composes an ad-hoc
request for the product type.
The user specifies which
products are of interest, and the
chosen dissemination options.
2: the user is authenticated
(several steps)
1: the user discovers local
product type
in the
catalogue
4: the product type is owned by a local NC or DCPC.
Portal
6: Storage in the online shopping cart, or preparation for
dissemination.
DAR subscriptions
(user profile)
OpenWIS
MSS
Routing
7: the products and instructions are
forwarded.
5: the required products are
extracted and returned.
SOURCE
FSS
8: Dissemination according to
instructions.
Arrival of a new GTS product at
the MSS (GISC function)
6bis: the user receives the product.
4bis: the user obtains the product
from the shopping cart.
3: Is someone subscribed to this type of product ?
Portail
2bis: the product is collected and inserted
in the GISC Cache
DAR subscriptions
(user profile)
OpenWIS
MSS
1: the MSS receives a new
product
Routing
4: Storage in an online shopping cart or preparation for
dissemination: construction of the dissemination instructions.
5: the product and instructions are
forwarded
FSS
2: the MSS routes the
product according to its
routing table
6: Dissemination according to
instructions.
New local product available
(NC or DCPC WIS function)
7bis: the user receives the product.
5bis: the user obtains the product
from the shopping cart.
Portal
5: Storage in an online shopping cart or preparation for
dissemination: construction of the dissemination instructions.
3: Is someone subscribed to this type of product ?
2: Notification of the product availability
DAR subscriptions
(user profile)
OpenWIS
TRANSMET
Routage
6: the product and instructions are
forwarded
4: the required products
are extracted and
returned.
SOURCE
FSS
7: Dissemination according to
instructions.
1: New local product
DARMet
A2 A4
Security
Service
Authentication
User Interface
(web portal)
Make / Follow
Request
Metadata service
Authorisation
Catalogue
Access
A1 A3
Metadata
Catalogue
Synchro &
Harvesting
Browse /
Search DAR
Admin /
Monitoring
Data service
Manage
Requests
A6
Monitoring
& Control
Service
A1 A3 A5
Cache
Monitoring
Collection
« Ad Hoc »
User & Data
Policies
A7
External Interface
Routine
« Push »
Replication
Administration
A1 A3 A5
POSSIBLE CHOICES
MSS/FSS
DIFF
A1 A5
A5
Local System
OpenWIS
UK MetOffice
A1
SIMDAT base
GeoNetwork base
Sun OpenSSO base
MSS
SMART / GEMS
GTS Metadata Generator
Close to prompting question on digitization
Download