UPDATE ON THE ACTIVITIES OF THE OECD"S
STATISTICAL INFORMATION SYSTEM
COLLABORATION COMMUNITY
MSIS2013
By Jonathan Challener
Who we are?
OECD
AUSTRALIAN BUREAU OF STATISTICS
STATISTICS ESTONIA
EUROPEAN COMMISSION
STATISTICS NEW ZEALAND
INTERNATIONAL MONETARY FUND
UNESCO INSTITUTE FOR STATISTICS
ITALIAN NATIONAL INSTITUTE OF STATISTICS
UNIVERSITY OF MANCHESTER
Interested?
INSEE
National Bank of Belgium
"Rich in functionalities and easy to use"
"Built for ENDUSERS"
"Very good process automation options"
"Modern user interface and functionality"
"Good perspective"
"Develop our own tool will take a long time and a lot of resources"
"Other similar available tools seem to no longer be improved or have blocking limitations"
"To be part of a collaboration community"
Why collaborate?
Why collaborate?
Co-producing and co-developing state-of-the-art Statistical
Information Systems by leveraging on community capacities.
Sharing of experiences, knowledge and best practices through
multilateral collaboration and building of a collective capacity.
Enabling innovation at an optimal cost in a minimal time with all
members benefiting from each other in terms of ideas and methods.
Provide a platform for Open Data projects as identified
as a priority for major member countries.
Implementing standards (SDMX) for data sharing across organisations
in order to improve data accessibility and quality, and reduce costs.
Why collaborate?
On what?
.Stat is the central repository ("warehouse")
where validated statistics and related metadata are stored.
It provides the sole and coherent source of statistical data
and related metadata for an organisation"s statistical data
sharing, publication and electronic dissemination
processes.
.Stat positioning in SIS
.Stat architecture
SQL Server db with
star schema, .Net
Flexible multidimensional datasets
Web services, web
and other client
applications
Structured for human
consumption
Autonomous data
owners
Loosely coupled,
platform independent
Priority to extractions
Flexible access rights
Referential metadata,
flags, 2 languages
Hierarchical and
common dimensions
.Stat key components
• Synchronised transactional 24/7
data loads
• XML + CSV
• E-mail notification
• Optional user-friendly GUI
• Theme navigation & search
• Flexible data tables, selection and
view options
• Interactive graphs
• Default and personal queries
• Excel, CSV, PC-Axis exports
Entry gate, DPI
Web browser
• .Stat Populator
• DotStatGet tool suite
• Direct SQL access
• V2.0 and partly 2.1
• SOAP + REST
• DSD, MSD, Generic Data, Compact
Data, generic Metadata
• Authentication, Streaming
Internal access
SDMX
How?
Community enablers
Governance,
process and
funding
Tools and
technology
Members
and culture
Community framework
Strategic 5 year directions
100% community consensus
100%
community
consensus
OECD yearly workplan
100% OECD
with
community
validation
Community yearly
workplan
100% OECD
but made
available
for use by
community
Governance model
Bilateral
agreement
between
"x" and
OECD
Intellectual property
MOU
updated yearly; renewed every 5y
100% OECD
shared with
community
Community activities
Bilateral activities plan
Community activities
Sign off governance model
Strategic level
Management level
Operational/Technical
level
Sign off MOU
Sign off Grant
Sign off the 5 year strategic
roadmap and its yearly
update
Prepare MOU
Sign off yearly workplan
Prepare Grant request
Monitor ongoing progress
(Quarterly reviews…)
Sign off SoW for GP
On-demand meetings
Prepare Governance
model, Strategic roadmap
Installation and support
Integration of other tools
Progress reporting
Prepare SoW for GP
Acceptance of GP
deliverables
Prepare yearly workplan
Coordinate the different
development streams
Supporting activities
Application Lifecycle management
Source code management in TFS, quality assurance, SCRUM
Technical support network
Install package, collaboration portal (documentation, discussions), capacity building
Management meetings
Quarterly management meetings, frequent developer meetings
Annual workshops
Collaboration partners, Interested and industry experts, interactive sessions
Global development partner
Support, maintenance and development
Funding model
Standard financial
contribution by
SIS-CC members
OECD
Contribution
Ad-hoc financial or inkind contribution by
SIS-CC members
SIS-CC
SIS-CC
coordination
Community
& support
OECD
Workplan
Workplan
Contributing to product roadmap
Option 0: SIS-CC Member contributes in-kind through onsite or
remote developments
Option 1: SIS-CC members contributes in-kind through direct
contract with OECD Global Partner
Option 2: SIS-CC Member contributes financially through OECD
funding
ACHIEVEMENTS TO DATE
.Stat World Wide platform
….. more to follow soon:
-
UIS.Stat,
-
EC.Stat,
-
ES.Stat (Estonia)
-
…..
.Stat enrichment
•
•
•
•
•
•
•
•
•
•
•
•
Security enhancements
3-tier architecture and 2 new web services
SDMX-RI prototype integration
New interface design
New data structure
Support of Time Series IDs
Support Non-calendar year based reporting
Unit and Powercode management
Management of sparse datasets
Improved installation package
Search API to connect to 3rd party engine
Open data web services
Community leveraging
• As part of the 2012 workshop a process was
initiated to define a JSON format based on
SDMX by the SDMX-TWG
– This year we launched the very first "BETA" API using
an early implementation of SDMX-JSON
http://oe.cd/OpenDataAPI/
The results speak for themselves
Open Data API initiative for developers
INEGI
http://www3.inegi.org.mx/rnm/sdmx
OECD
https://c9.io/h4mu/sdmx-jsonapps/workspace/memory/memory.html
UIS
http://www.uis.unesco.org/das/Country/OdataTest
DRASTIC DATA
http://www.drasticdata.nl/ProjectOECD/
Directions for the
.Stat roadmap
REUSABLE
NON
REUSABLE
sdmx-json
SVG
Search odata
The same language said differently
FRAMEWORK EVOLUTIONS
Framework evolutions
• Put in place 5 year strategic directions:
– roadmap, community vision, architecture, business
vision, and industrialisation
• Create an architecture group to drive technical
and business architecture
• Introduce a Bi-annual workplan, reviewed
annually
• Explore future directions for plug and play
architecture and international positioning
Further information
Questions?
Email:
jonathan.challener@oecd.org
or
dotstatcollaborationsupport@oecd.org