WIS/GISC/OpenWIS Progress
OGC TC 2011-09-19, Boulder
Chris Little, Met Office, Co-chair OGC Met. & Oceanography Domain WG
© Crown copyright Met Office
Contents
• WIS Background
• Current Plans
• Progress
• Immediate Future
• Longer Term Future
• Questions and Answers
© Crown copyright Met Office
WIS Background
© Crown copyright Met Office
© Crown copyright Met Office
© Crown copyright Met Office
Global Telecommunication System
Global Telecommunications
System (GTS)
• Managed by WMO - World
Meteorological Organization
Use to exchange
• Observations
• Forecasts
• Warnings
Private Network
• Node to Node network
• NOT an Internet
• ‘Store and Forward’
• Resilient and inflexible
© Crown copyright Met Office
New WMO Information System
© Crown copyright Met Office
WIS Background Summary
• WMO Telecoms, GTS, is reliable, inflexible, ‘push’ only
• Still many point-to-point links
• Managed Network in Europe with two roles:
• Areal Meteorological Data Comms Network AMDCN
• Global Core/Main Trunk Network MTN
• Some of Eastern Europe/Caucasus not yet joined
• Some global centres still joining MTN
• Brasil
• Canada
• South Africa
• Other regions’ AMDCNs not yet happened.
Current Plans
© Crown copyright Met Office
WIS Components
1. Global Information System Centre (GISC)
Global Catalogue + 24 hour operational Global Data Cache
Receives information from NCs and DCPCs
Exchanges information & synchronises with other GISCs
Disseminates, within its area of responsibility, the entire WWW set of data
and products for routine global exchange (GTS function) & maintains at
least 24 hours worth of data (replicates the ‘Cache’)
Generates, maintains and makes accessible metadata catalogues of its data
holdings (synchronizes the catalogue)
Ensures around-the-clock, reliable and secure operations
Enhances/replaces World Met Centres WMCs
© Crown copyright Met Office
WIS Components
2. National Centre (NC)
Exchanges information collected/generated in a country with GISC/DCPC
Serves as portal for national users & administrates their access to WIS
Generates standardised metadata as well as data
Several NCs in a country are possible (not just the NMC)
Replaces National Meteorological Centres NMCs
© Crown copyright Met Office
WIS Components
3. Data Collection & Production Centre (DCPC)
• Neither GISC or NC
• Serves as information production facility, regional or global
• Generates, maintains and makes accessible standardized metadata
catalogues of its data holdings through GISCs
• Supports information “Push” and ”Pull” mechanisms
• Facilitates access/exchange from/to NCs and GISCs
•Replaces/enhances Regional Telecom Hubs RTHs
• Replaces Regional Specialised Meteorological
Centres RSMCs
© Crown copyright Met Office
New WMO Information System
© Crown copyright Met Office
Improved Main Telecommunication Network (IMTN)
After consolidation of clouds
New Delhi
RA VI
Prague
Jeddah
Sofia
RA II
Tokyo
Beijing
Moscow
Washington
Exeter
IMTN cloud
Offenbach
RA IV
Toulouse
Brasilia
Buenos Aires
RA III
Cairo
Dakar
Nairobi
© Crown copyright Met Office
RA I
Algiers
Melbourne
RA V
Interoperability Standards
WMO Data Formats
WMO Telecoms protocols + WMO Extranet + ‘Push’
WMO processes
WMO Data Formats
Internet + WMO Extranet
Global Catalogues
• ISO19115+ISO19139+WMO profile V1.2 +ISO19119
• ISO23950+SRU1.3 (+CSW?)
• OAI-PMH
Global Cache (Bit Torrent proposed)
‘Push & Pull’ Dissemination Ad Hoc & Subscription (PubSub?)
Progress
© Crown copyright Met Office
WIS live demo done!
WMO Congress Geneva May 2011
How WIS can help with a (imaginary)
food security analysis
© Crown copyright Met Office
5 GISCs agreed by WMO
4 Technology solutions:
• CMA China Meteorological Administration (own software)
• DWD Deutscher Wetter Dienst (IBL Moving Weather)
• JMA Japan Meteorological Agency (own software, RSS)
• Météo-France (OpenWIS)
• UK Met Office (OpenWIS)
Interoperability of catalogues, and harvesting of
information demonstrated between all nodes,
plus Brasil, Iran, NCAR
Harvesting protocol agreed by WMO: OAI-PMH:
• Geonetwork (Lucene & Postgres)
• Java OAI API (Oracle)
© Crown copyright Met Office
37 DCPCs endorsed by WMO
CMA China Meteorological Administration: 1
HKO Hong Kong, China: 1
DWD Deutscher Wetter Dienst: 10
JMA Japan Meteorological Agency: 8
Météo-France: 6
Norway: 1
UK Met Office: 8
ECWMF: 1
EUMETSAT: 1
http://www.wmo.int/pages/prog/www/WIS/centres/index_en.php
© Crown copyright Met Office
© Crown copyright Met Office
Demo links: GISCs, DCPCs
UK Met Office user portal
http://exvowtstined01.metoffice.gov.uk:8080/openwis-user-portal/srv/en/main.home
Search and find, then self registration for delivery
Météo-France user portal
http://wisp.meteo.fr:8080/openwis-user-portal/srv/en/main.home
DWD Deutscher Wetter Dienst
http://gisc.dwd.de/GISC_DWD/start_js_JSP.do
CMA China Meteorological Administration 国家气象信息中心简介
http://www.sac346.org.cn/Website/index.php?ChannelID=47
JMA Japan Meteorological Agency
http://www.gisc.kishou.go.jp/
EUMETSAT EO Portal
http://www.eumetsat.int/Home/Main/DataProducts/ProductNavigator/index.htm
Norway IPY
http://arcticdata.met.no/
© Crown copyright Met Office
WIS Technologies
Global Catalogue
• Metadata: ISO 19115 + 19139
• WMO Profile 1.2
• Services could be ISO19119
• Search with ISO23950 + SRU (+ CSW?)
• Harvesting: OAI-PMH
• Prototype: Geonetwork
• Catalogue access for all
• Default access policy, others supported
• No more than 24 hours out of date
© Crown copyright Met Office
WIS Technologies
Subscriptions
• Subscriptions & ad-hoc retrievals for authenticated
and authorised users including self registered
• Using OpenAM/SAML2 (was OpenSSO)
• Need to agree subscription & backup standard
(OGC PubSub?)
Cache
• 24 hours worth of all ‘Essential’, critical, data
• Need to agree Content Distribution standard
(BitTorrent?)
• Stringent global performance standards (2 min
latency end-to-end maximum for Warnings)
© Crown copyright Met Office
Immediate Future
© Crown copyright Met Office
OpenWIS Consortium
• 2009 Météo-France & UK Met Office formed ITT consortium
• Software named ‘OpenWIS’
• 2010-03 Contract awarded to Akka & sub-contractors:
• CampToCamp – web experts
• VCS – Project Management, technical expertise
• Recruited GeoNetwork expert
• 2010-05-11 Kick-Off meeting
• 2010-06-08 Detailed plan agreed with 3 development iterations:
• First delivery for CBS, 2010-11
• Second delivery, ’90%’, for Congress, 2011-04
• Third delivery: monitoring functions, bug fixes, etc 2011-07
• 1 year warranty, optional extra 3 years warranty & development
© Crown copyright Met Office
OpenWIS Software Functionality
OpenWIS software allows functions:
GISC
DCPC
NC
Consortium members currently:
Météo-France
UK Met Office
MF International
KMA, Korea Meteorological Administration
BoM, Australia Bureau of Meteorology
At WMO Congress XVI, May 2011:
Moscow announced intention of joining
Others countries interested. Workshop in Toulouse, Oct 2011
© Crown copyright Met Office
OpenWIS Open Source
Geonetwork (Catalogue)
• Licence compatibility with Open SSO licence
• Use with or without modifications
• More secure, more scalable
• DWD used OAI-PMH Java API
Open SSO / Open AM (Security)
• Licence
Interfaces definition
• Middleware with standards based interfaces
• Postgres D/B
• Possibility to add different software
© Crown copyright Met Office
OpenWIS Future
• Final delivery September 2011, Acceptance
• Start 1 + 3 year warranty
• Release as Open Source software, with governance
• MFI offer commercial installation & support
• Rollout:
• External DCPCs (ECMWF, EUMETSAT, IPY, …), NCs
• Internal DCPCs (9 in Met Office )
• “build your catalogue metadata entries for your data”
• Opera Data Centre to be a vDCPC, joint with MétéoFrance
• Other NCs or DCPCs in UK?
• Back-up with Météo-France & DWD
• Out of Country back-up for Public Weather Service
© Crown copyright Met Office
WMO Future activities
• Lots of WMO Technical work:
• Agree cache replication mechanism (OpenWIS proposes Bit
Torrent over RMDCN)
• Tighten WMO Core ISO19115 Metadata interoperability
• “Business as Usual” operating procedures with CMA, JMA, …
• Back-up between UK & France OpenWIS and DWD IBL
• Improve connectivity of GTS/RMDCN/MTN (ITT in 2012/13)
• Rollout:
• more countries in RA-VI and MTN
• WMO ET work – metadata, registries
• Open source release of OpenWIS, community building
• VCP and project activities (e.g. Algeria, Bangladesh,..)
© Crown copyright Met Office
Longer Term Future
© Crown copyright Met Office
Future WMO Telecoms
• ECMWF planning
• Council approval 2011-12
• Issue ITT for 2012
• Migrate RMDCN 2013
• Technology probably: MPLS, managed, any-to-any
• Options:
• ‘Like for like’ one ‘physical’ network
• Separate AMDCN and MTN
• IP6, Multicast? Built in ‘Cloud’??
• More members: CMC, SAWS, INMET, rest of RA-VI?
• Impact of WIS traffic
© Crown copyright Met Office
WMO Longer Term Future
• Rollout:
• All 189 countries
• VCP and project activities
• 7-10 years?
• Phase out Message Switches?
• WMO Expert Team work
• metadata, registries, taxonomies
• Influence open standards
© Crown copyright Met Office
OpenWIS demo (possibly)
© Crown copyright Met Office
© Crown copyright Met Office
© Crown copyright Met Office
Questions & Answers
© Crown copyright Met Office
Spare slides, to be used only if required
© Crown copyright Met Office
POSSIBLE CHOICES
2009 Draft
Architecture
SIMDAT base
Geonetwork base
Sun OpenSSO base
MSS
SMART / GEMS
User &
Data Policies
User Role Assignment
Procedure
Make / Follow
Request
Browse /
Search DAR
Applicable Data Policy
Information Search
Requests
Catalogue
Access
Authentication
User
Requests
I3
Admin /
Monitoring
Authorisation
Portal
Information Search Results
Manage
Requests
Catalogue Browse
Requests
Maintain and Expose
Catalogue of Services
A3
and Information
Assign User Role &
Authorise Access to
Information
A2 & A4
DAR Metadata
Catalogue
Information Services
O1
Dissemination
Metadata
Portal
Subscription
Authorized
Requests for
Information
Delivered Information
via « Pull » Services
(time-critical &
non-time-critical)
« Ad Hoc »
« Ad Hoc »
Delivered Information
via « Push » Services
(time-critical &
non-time-critical)
Routine
« Push »
Observations, Products
and Associated Metadata
I2
I1
Reference Information
(WIGOS, IOC, etc)
Information
Collection
A5
metadata
Reports of Performance
against Requirements
Retrieval
Administration
Synchro &
Harvesting
Replication
Collect Observations,
Create Products and
Archive Information
A1
© Crown copyright Met Office
Deliver Information
to Users
O2
Cache
Monitoring Data
From all functions
Control Actions to
All functions
Monitoring
Legacy Databases
Manage System
Performance
A6
POSSIBLE CHOICES
2009 Draft
Architecture
SIMDAT base
Geonetwork base
Sun OpenSSO base
MSS
SMART / GEMS
User &
Data Policies
User Role Assignment
Procedure
Make / Follow
Request
Browse /
Search DAR
Applicable Data Policy
Information Search
Requests
Catalogue
Access
Authentication
User
Requests
I3
Admin /
Monitoring
Authorisation
Portal
Information Search Results
Manage
Requests
Catalogue Browse
Requests
Maintain and Expose
Catalogue of Services
A3
and Information
Assign User Role &
Authorise Access to
Information
A2 & A4
DAR Metadata
Catalogue
Information Services
O1
Dissemination
Metadata
Portal
Subscription
Authorized
Requests for
Information
Delivered Information
via « Pull » Services
(time-critical &
non-time-critical)
« Ad Hoc »
« Ad Hoc »
Delivered Information
via « Push » Services
(time-critical &
non-time-critical)
Routine
« Push »
Observations, Products
and Associated Metadata
I2
I1
Reference Information
(WIGOS, IOC, etc)
Information
Collection
A5
metadata
Reports of Performance
against Requirements
Retrieval
Administration
Synchro &
Harvesting
Replication
Collect Observations,
Create Products and
Archive Information
A1
© Crown copyright Met Office
Deliver Information
to Users
O2
Cache
Monitoring Data
From all functions
Control Actions to
All functions
Monitoring
Legacy Databases
Manage System
Performance
A6
OpenWIS 2009 Draft Architecture Interfaces
VGISC System
WIS Harness
MSS/FSS
DISS
Local System
© Crown copyright Met Office
Where do the wires actually go?
© Crown copyright Met Office
WMO Regions I – VI
© Crown copyright Met Office
http://www.wmo-dra.info/gmap/WMO_NMHS_regions/metservices.html