CYCLOPS Project:
Implementation of Geosciences services
on Grid platform for GMES applications
Paolo Mazzetti
Stefano Nativi
Mirco Mazzucato
Marco Verlato
Jerome Bequignon
Outline




2
Project Overview
Main Activities
CYCLOPS Architectural Framework
Geospatial services implementation in
the CYCLOPS Framework
mazzetti@imaa.cnr.it
Project Overview
3
mazzetti@imaa.cnr.it
What is CYCLOPS?

CYCLOPS:
CYber-Infrastructure for CiviL protection
Operative ProcedureS

Main Goal:
–
4
to bridge the gap between Grid and GMES
communities making Civil Protection people be
aware of the services provided by Grid
infrastructures, and, at the same time, letting Grid
researcher to be aware of Civil Protection specific
requirements and service enhancement needs.
mazzetti@imaa.cnr.it
CYber-Infrastructure for CiviL
protection Operative ProcedureS
(CYCLOPS)






Specific Support Action of EGEE
Duration: 24 months (01/06/2006 – 31/05/2008)
Web site: www.cyclops-project.eu
Contact person: nativi@imaa.cnr.it (Technical
Manager)
Key words: GMES, GRID, Geospatial information,
Civil Protection
Collaboration with:
–
5
PREVIEW, Risk EOS, RISK-AWARE, BOSS4GMES,
EGEE
mazzetti@imaa.cnr.it
Participants
–
–
–
–
–
–
–
6
Grid Community Representative
INFN (Istituto Nazionale di Fisica Nucleare)
Civil Protection Agencies
CP-CH (Civil Protection of Chania Prefecture)
DDSC (Direction de la Défense et de la Sécurité Civiles)
DPC (Dipartimento della Protezione Civile)
SNBPC (Serviço Nacional de Bombeiros e Protecção
Civil)
Scientific/Technological partners
IMAA-CNR (Istituto di Metodologie per l’Analisi
Ambientale del Consiglio Nazionale delle Ricerche)
TEI-CR (Technological Educational Institute of Crete)
mazzetti@imaa.cnr.it
Context

Needs
–
–
–

New technological instruments available
–
–

Grid technologies have been developed to allow Virtual Organizations
(such as Civil Protection) to share coordinated resources made
available on-demand
Recent Geospatial Science development provides the basis for
Geographic Information interoperability
Proposal
–
7
Civil Protection emergency management (forecasting, warning,
management, assessment) involves different actors (Civil Protection
systems, public bodies, research centers, etc.)
They need to share resources (computing, data, services, knowledge,
expertise, etc) in a coordinated and effective way
Many Civil Protection emergency management applications are high
demanding
To use Grid technologies to enhance/enable Civil Protection applications
for emergency management.
mazzetti@imaa.cnr.it
Rationale

Current Grid platforms were mainly
designed for intensive processing and data
management
–

Grid research is facing new important
issues
–
–
–

8
offer high computing and storage capabilities
sensor interaction
knowledge management
communication quality of service.
Need an enhancement to support complex
Civil Protection applications
mazzetti@imaa.cnr.it
Main Activities
9
mazzetti@imaa.cnr.it
CYCLOPS Activities

CYCLOPS is not a R&D project. It will not develop
services and/or infrastructures.

Definition of research and innovation strategies
–
–
–
–

Cross-dissemination between GRID (EGEE) community
and GMES (Civil Protection) community.
–
–
10
Analysis of CP systems
EGEE Request for Enhancements
Research strategies for enabling CP applications on Grid
infrastructure
Guidelines for CP innovation towards the adoption of Grid
technologies
Seminars, workshops, tutorials directed to CP personnel
Reports to EGEE Working Groups
mazzetti@imaa.cnr.it
Contribution to standards

GRID community
–

test and validate, the middleware re-engineered by
EGEE and EGEE-2 in compliance with the current open
standards (GGF, OMII Europe)
Geospatial science community
–
–
–
INSPIRE (The INfrastructure for SPatial InfoRmation in
Europe )
GEOSS (Global Earth Observation System of Systems)
OGC (Open Geospatial Consortium)




11
Risk and Crisis Management Working Group
Sensor Web Enablement Working Group
Earth Observation Working Group
Civil Protection community
–
GMES (Global Monitoring for Environment and Security)
mazzetti@imaa.cnr.it
Main Activities

Coordination with EGEE activities
–

Civil Protection system analysis
–

Coordinated by DDSC (Direction de la Défense
et de la Sécurité Civiles)
Research and Innovation Strategies
definition
–
12
Coordinated by INFN (Istituto Nazionale di
Fisica Nucleare )
Coordinated by CNR-IMAA (Istituto di
Metodologie per l’Analisi Ambientale del
Consiglio
Nazionale delle Ricerche)
mazzetti@imaa.cnr.it
Civil Protection Analysis:
Use cases

Selection criteria
–
–
–
–

First candidates
–
–
–
–
–
13
Added value of GRID to the process
Relationship with a GMES service
Usage of sensor networks
Suitability of process to prototyping
Flood forecast
Flood monitoring / dam break
Landslide monitoring
Large forest fire propagation
Earthquake quick damage assessment
mazzetti@imaa.cnr.it
Candidate use case: flood forecast



14
Involves heavily meteorology and hydrological modelling
Involves many sensors (floods gauges, rain radars, meteo sats)
Linked to GMES flash flood anticipation service
mazzetti@imaa.cnr.it
Candidate use case: flood monitoring
/ dam break



15
Dam breaks are frequent but location
is rather unpredictable
Involves many sensors (floods
gauges, rain radars, meteo sats)
Linked to GMES flood mapping
service
mazzetti@imaa.cnr.it
Candidate use case : Large forest
fire propagation

Propagation models used
on the field are simplistic
due to computational
limitations

More sophisticated models
require heavy
computations, large
number of field and meteo
parameters

French research project
PAREFEU, link with GMES
service PREVIEW
After Sero-Guillaume et al.
16
mazzetti@imaa.cnr.it
Candidate use case : Landslide
monitoring





17
In situ observing
networks
Role of meteo / rain
forecasts
geophysical models
Repeated Radar
interferometric
observations requiring
heavy computations
Linked to GMES
PREVIEW and
TERRAFIRMA
services
mazzetti@imaa.cnr.it
Candidate use case : quick
earthquake damage assessment





18
In situ observing
networks
geophysical models are
available (Italy,
Portugal…)
Actual estimate of
damages require realtime computations
Could be compared with
results of Radar
interferometric
observations and very
high resolution satellite
images
Linked to GMES
PREVIEW and
TERRAFIRMA services
mazzetti@imaa.cnr.it
Architectural Framework
19
mazzetti@imaa.cnr.it
Rationale

Civil Protection applications/systems have specific
requirements:
–
to access infrastructure, run models and search
information in a real-time (RT) or near-real-time (NRT)
way

–
–
to control sensors networks and acquisition systems and
modify their acquisition strategy and processing chain
to share geospatial information that has complex
characteristics:

–
–
20
privileging time of response instead of accuracy
Huge amounts of remotely-sensed observations, which are
multidimensional and frequently updated
To formalise the knowledge required to analyse data and
provide decision-makers with effective information
To implement the strict data policy and the security
requirements typical of dual systems (civil/military);
mazzetti@imaa.cnr.it
Objective & Research Strategies

Conceive a complete Grid-based platform
supporting Civil Protection applications
–

The CYCLOPS platform
Many open issues must be addressed
–
Integration & Interoperability (with EGEE platform)


–
Define specific services for CP applications



21
Integrate sensor networks and acquisition systems in the
EGEE platform
Implement Spatial Data Infrastructures (SDI) services in the
EGEE platform
Define the advanced services (knowledge-based services,
Quality-of-Service management, etc.)
Define the Data Policy and Security services
Define the generic Business Logic, Presentation and
Fruition services
mazzetti@imaa.cnr.it
CYCLOPS Architectural Framework
Real Time and Near Real Time
Applications for Civil Protection
(Data integration, high-performance computing and distributed environment for simulations)
CYCLOPS Platform
Presentation and Fruition Services
CYCLOPS Infrastructure
Grid Services for Earth Sciences
Advanced Grid Services
GRID Platform (EGEE)
Processing Systems
Infrastructure
22
Spatial Data Infrastructure Services
mazzetti@imaa.cnr.it
Service for Earth Sciences
Resources
Data Systems
Environmental Monitoring
Resource Infrastructure
Interoperability Platform
Security Infrastructure
Business logic Services
Architecture design and
development


This reference architecture is the essential
framework to guide CYCLOPS studies and
analyses
As a Specific Support Action, CYCLOPS will not
develop the infrastructure
–

23
To study and define the platform
Future R&D projects will be directed towards the
implementation of the specified infrastructure
mazzetti@imaa.cnr.it
Geospatial services
implementation
24
mazzetti@imaa.cnr.it
Implementing OWS on the top of
a Grid Platform

Approach #1: Grid-enabling OWS
–

Approach #2: Gridifying OWS
–
25
Build OWS implementations which make use
of Grid capabilities
Expose OWS as Grid computational elements
(CE) which run native calls to external WS
mazzetti@imaa.cnr.it
Grid-enabling OWS
netCDF
Portal/
submissi
on tool
HDF
GRIB
on Grid
User
Interface
Others...
SE
SRM
interface
26
CE
OWS implementation Software
(published via GRIS)
DLS (Data Location
Service)
based on LFC
mazzetti@imaa.cnr.it
Resource
Broker/ WM
proxy
From OWS
request to
JDL
Grid-enabling OWS

Data Aggregation levels
Geospatial
Information
netCDF
HDF
GRID platform
GRIB
---
SE
Host
File Block
Dataset
File
Coverage/Layer/Map
---
Host name  LFN for a file block
27
mazzetti@imaa.cnr.it
Logical Aggregation
Level
Grid-enabling OWS:
OWS function Vs. Grid job
1.
2.
3.
1.
2.
OWS server URL
HTTP-GET OWS.function request
HTTP response + OWS.function response
document
OWS server URL  LFN for file block
HTTP-GET OWS.function request  Grid job for
a.
b.
 the OWS software tag;
CE publishing
CE close to the SE containing
a LFN replica
Service Register

3.
HTTP response
Service
Consumer
Get
job output
28
netCDF
+ OWS.function response document
 GRIB
HDF
mazzetti@imaa.cnr.it

(OWS Server)
Service Provider
Grid-enabling WCS

A prototype of Grid-enabled WCS on top of
EGEE Platform

Implementation of basic WCS functionalities
like subsetting, resampling and interpolation
using GRID capabilities

Expected advantages:
–
–
–
29
Grid support of file replicas
Use of mobile code instead of mobile data
High performances working on large datasets
mazzetti@imaa.cnr.it
GRID-enabling WCS
CE near file-based Dataset
DAG Job
•
•
•
30
mazzetti@imaa.cnr.it
WCS Request
Gridifying OWS

Run application software which calls OWS
external services
–
–

Implement a Grid application which makes
use of OWS service chaining
Possible use of all Grid job types: collection,
DAGs, Parametrics, MPI, etc.
Minimal case: Run an existing OWS
function as a Grid job
netCDF
31
HDF
GRIB
mazzetti@imaa.cnr.it
+
+
Grid Job
Gridifying OWS
SE
Resource
Broker/ WM
proxy
CE
Native call
WSDL
OWS
OWS
OWS
32
mazzetti@imaa.cnr.it
netCDF
HDF
GRIB
Others...
Virtualize Sensors

Two approaches:
–
A new Grid sensor element

–
33
Instrument Element (like GridCC?)
Make use of OGC Sensor Web Enablement
services
mazzetti@imaa.cnr.it
Thank you for your attention
34
mazzetti@imaa.cnr.it