SISMER Systèmes d’Informations Scientifiques pour la Mer French NODC TMSI/IDM/SISMER Contribution to IODE and New Perspectives in the frame of the Operational Oceanography presented by Catherine MAILLARD JODC Meeting, Hydrographic Department of Japan, Tokyo March 2000 1 Summary of the presentation TMSI/IDM/SISMER Context and History National Oceanographic Data Bank Projects Quality Assurance New developments for Real Time Data Management Human Support and Facilities Conclusion, Perspectives, New Challenges for Data Management in France and in Europe 2 TMSI/IDM/SISMER IFREMER IFREMER (the French Institute of Research and Exploitation of the Sea), a public institute of industrial and commercial nature, created by a decree of 5 June 1984, is the only French body with an exclusively maritime vocation. It is placed under the joint authority of the Ministries of Research and Technology, of Fisheries and Equipment and Transport. Annual budget : one billion French Francs, 1700 executives, researchers, engineers, seamen, technicians and administrative staff, 72 laboratories and research departments, located in 24 stations and centres along the metropolitan coast and overseas, 7 vessels, 2 manned submersibles, equipped with scientific instruments. 3 History of the Data Centre • TMSI/IDM/SISMER • • SISMER (Systèmes d'Informations Scientifiques pour la Mer) was created in 1990, and since 1997 belongs to the Informatics and Marine Data Department (IDT) of IFREMER, the main French government research agency devoted to ocean research and exploitation. SISMER is the Designated National Oceanographic Data Centre for France (French NODC) for the International Oceanographic Data Exchange programme (IODE) of UNESCO Intergovernmental Oceanographic Commission, following the former Bureau National des Données Océaniques (BNDO). This national data banking activity dates from 1968, and covers the fields of marine physics, chemical, underway geophysics and general information on French oceanographic cruises and data sets. SISMER contributes to data management structures of several national and international scientific projects, especially in the frame of the European MAST programme. 4 IFREMER IDM Department and Facilities • Brest Services – – – – RIC : network, archiving system and centralised facilities ISIB : information system engineering in Brest SISMER : data centre COM : Oceano-meteo services TMSI/IDM/SISMER • Centralised Facilities in Brest – – – – Brest centre mainframe - RDBS & WWW servers Central archiving backup system Network Administration RDBS + GIS Software Administration • Distributed Facilies – SUN UNIX Work stations – DOS personal computers + Office software – Software : MATLAB, Expert QC software, Loading/Extracting Data 5 TMSI/IDM/SISMER MISSIONS • to design and operate scientific information systems and databases in the domain of the sea; • sets the standards of quality to be respected for data storage; • maintains an inventory of information systems and databases, the responsible scientists and rules for their availability; • represents IFREMER within national and international authorities concerned with the management of sea data; • provides training and transfer of knowledge within its field of competence. 6 National Oceanographic Data Bank Catalogues -Meta-databases French Oceanographic Cruise Summary Reports - ROSCOP (>4700 cruises) TMSI/IDM/SISMER Marine Data Sets Inventory - MEDI/EDMED National Geophysical Data Bank National Physical and Chemical Data Bank Real Time Data Management - Operational Oceanography Reference Data - Data Products from other data centres 7 Projects Catalogues - Meta-Databases – MAST-EURONODIM - European cooperative network for oceanographic data & information management Related with the Geophysical Data Bank – DORSALES TMSI/IDM/SISMER Related with the Physical and Chemical Database – – – – MAST-MEDAR/MEDATLAS II MAST-MTP II/MATER MAST-OCTOPUS - Tomographie Acoustique MAST-ROBLINKS - Propagation Acoustique Related with the (Pre-)Operational Oceanography – – – – TOGA/WOCE/CLIVAR MAST-MFSPP- Mediterranean Forecasting System MAREL CORIOLIS 8 9 TMSI/IDM/SISMER 10 TMSI/IDM/SISMER National Geophysical Data Bank Vertical Bathymetry : 353 Cruises Multibeam Bathymetry : 278 Cruises Gravity : 213 Cruises Magnetism : 256 Cruises imagery : 64 Cruises TMSI/IDM/SISMER Related Project : DORSALES-RIDGE 11 TMSI/IDM/SISMER DORSALES-RIDGE 12 National Physical and Chemical Data Bank CTD Bottle Casts Current Meter Time Series Thermistor Chain Time Series MEDAR/MEDATLAS, MATER, OCTOPUS, ROBLINKS 2500 2000 1500 Bouteilles CTD 1000 Bo Courantos 500 0 19 09 19 23 19 27 19 31 19 35 19 47 19 51 19 55 19 59 19 63 19 67 19 71 19 75 19 79 19 83 19 87 19 91 19 95 TMSI/IDM/SISMER Related Projects : 16 790 34 111 1853 126 13 MTPII-MATER MAss Transfer and Ecosystem Response (MAS3-CT96-0051) Physics VERTICAL PROFILES TIME SERIES 3013 CTD CTD TIME SERIE 572 XBT 21 THERMISTOR STRING 461 ADCP VERTICAL PROFILES 110 CURRENT METER LAGRANGIAN FLOAT 105 Oceanographic Cruises TMSI/IDM/SISMER Biochemistry VERTICAL PROFILES TIME SERIES 1473 BOTTLES STATIONS 37 SEDIMENT TRAPS 126 Moorings 269 BIOLOGICAL STATIONS Other parameters : meteorology, biology, model outputs 3 Regional Data Centres and an Animation Task 14 MAST- MEDAR/MEDATLASII Mediterranean Data Archaeology and Rescue of Temperature, Salinity and Bio-chemical Parameters UL/GHER ICES Liège, Belgium Copenhaguen, Dk IFREMER/SISMER Brest, France IOC Paris, France RIHMI-WDC Obninsk, Russia OGS Trieste, Italy ENEA La Spezia, Italy CNR/IMGA Bologne, Italy MHI/MIST Sevastopol, Ukraine NIMH Sofia, Bulgaria TMSI/IDM/SISMER IEO Madrid, Spain TN/DNHO Istanbul, Turkey NCMR/HNODC Athens, Hellas ISMAL Alger, Algeria UM-PO Msida, Malta NCSR-NCMS FD-MANRE/CyNODC Batroun, Lebanon Nicosia, Cyprus INRH/DOTM Casablanca, Morocco NIOF/ENODC Alexandria, Egypt IOLR Haifa, Israel Collaborations and Scientific Advisers : GODAR Project - WDC-A, NODC-Croatia, DNA Tunisia, DNA Georgia EUROGOOS, MEDGOOS, IODE Network 15 MEDAR/MEDATLAS II OBJECTIVES AND METHODOLOGY 1. to complete the data-void areas in the Eastern and Southern parts of the Mediterranean Sea and Black Sea with new observations, through a wide cooperation of the Mediterranean countries; the core parameters identified as necessary to archive for the ecosystem following up and modelling are : TMSI/IDM/SISMER Temperature Nitrate Nitrite Ammonia Total Nitrogen Salinity Phosphate Total P Silicate Chlorophyll-a Oxygen Alkalinity pH H2S 2. to make available comparable and compatible data sets of temperature, salinity and bio-chemical profiles issuing from different sources, by using a common protocol for formatting and quality checking based on the available preliminary knowledge of the core parameters distribution and the internationally agreed standards; 3. to prepare value added products including climatological gridded statistics and maps that will be useful for the understanding and modelling of the Mediterranean and Black Sea by using efficient and robust objective analysis techniques; 4. to extend the protocol for data qualification to each stage of the data processing; 5. to facilitate the access to the archived data and enhance the data for various scientific, educational, industrial and environmental needs, through electronic publishing on widely disseminated media and promotion. 16 Centre International de Données de sub-surface TOGA/WOCE/CLIVAR 474688 profiless of temperature 1985-1998 (2000) Automatic and Visual QC WWW Interface to access data TMSI/IDM/SISMER Related Projects : CORIOLIS , MFSPP 17 MFSPP Mediterranean Forecasting Pilot Project TMSI/IDM/SISMER (MAS3-CT98-0171) Model predictions with Assimilation of RT in situ data from VOS, from multidisciplinary mooring in Aegean Sea, satellite and meteorological data 18 Loading and Extraction Tools TMSI/IDM/SISMER – Input interface – ON LINE Data Extraction + dedicated software for automatic file indexation 19 Publication Tools • Automatic edition of WWW Catalogues from RDBS : htql • Paperprint catalogues and Mailing • Data products on Cdrom TMSI/IDM/SISMER data selection through several criterions including geographical areas 20 Data Dissemination 1998 : DATA FROM NATIONAL DATA BANKS 113 REQUESTS TMSI/IDM/SISMER France Private Sector 8% Foreign 15% IFREMER 36% France Public Sector 41% Base TOGA/WOCE/CLIVAR : 50 (8 on line, 42 manual diffusion) Cdrom MEDATLAS : 14 exchanged + 30 sold Cruise catalogue : about 200 hit /day on WWW 21 TMSI/IDM/SISMER COASTAL MONITORING - MAREL 22 CORIOLIS provor float cycling cycle period launching reference date cycle period reference date + 1 period argos argos TMSI/IDM/SISMER argos cycle 0 cycle 1 cycle 2 does not match the period 23 CORIOLIS data center functions Interopérability with argo gts control data quality control technical monitoring of equipments web TMSI/IDM/SISMER collection mail internet gts cd-rom paper... favorite medium data base catalogue - archive dissemination public / private mail mailing lists products graphics and charts statistics analyses quality insurance for exploitation cd-rom or other support on request hardware & software management - backup 24 TMSI/IDM/SISMER provor profilers 25 TMSI/IDM/SISMER description of a provor 26 TMSI/IDM/SISMER display of a provor profile 27 TMSI/IDM/SISMER provor in pommier area 28 TMSI/IDM/SISMER provor temperature map 29 Reference Data Gridded Climatologies ... (Levitus, MODB, MEDATLAS, Atlantique T. Reynaud) Topographic Data TMSI/IDM/SISMER (ETOP5, TOPO_2mn, Gravi_2mn, traits de cote, IGN) Tide Predictions - SHOM Data products on CDroms & diskettes received at SISMER Dissemination on Internet or Intranet depending on copyright 30 TMSI/IDM/SISMER FORMATS • Meta-data : RDBS • Small-medium size files : autodescriptive ASCII (MEDATLAS) • Large volume files : NetCDF • Satellite data format 31 Quality Assurance TMSI/IDM/SISMER QC0 : Check the format and the completeness of the information QC1 : Check the location and date QC2 : Check the data points References - Standards – CIEM-Marine Data Management working Group (CIEM) – UNESCO/COI/IODE : International Oceanographic Data & Information Exchange 32 TMSI/IDM/SISMER QC1 Control of the location and Date - Data collected in station 33 TMSI/IDM/SISMER QC1: Control of the location and Date - Time series on fixed mooring 34 TMSI/IDM/SISMER QC2 - Control of the Data points 35 Conclusion 1 TMSI/IDM/SISMER Current Objectives of Data Management • to insure perennial safeguarding, access and promotion of the national data holdings • to make available long time series of coherent and comparable observations of the same type • to contribute to a better exploitation of the oceanographic work among scientific, engineering educational and decision maker community • to have access to foreign data sets through data exchange • to assist the scientists in preparing projects 36 Conclusion 2 New Needs & Challenges FURTHER NEEDS EXPRESSED BY THE USERS Access to multidisciplinary data, especially biochemical data Archives of large volumes Real time or near RT data TMSI/IDM/SISMER Quality data to get compatibility and comparability within long times series DATA MANAGERS SHOULD IMPROVE THEIR EXPERTISE Convince the scientists to decrease the time lag between data collection and data submission to data centres - avoid to the data to become archaeological for automatic data collection, Data Centres should take in charge part of the scientific validation to prepare value added products easy to process by non-specialists NEED FOR INTERNATIONAL COOPERATION to get information on data availability to establish and develop standards - Reference Manuals to share the tasks during international projects 37