Earth Observation Data Centre
for Water Resources Monitoring
An open and international cooperation
Bringing Earth Observation data, software development and
information extraction together -
Introducing the EODC IT capacities
Dr. Werner Mücke :: EO Open Science 2.0 :: October 13th, 2015
About EODC
 Who we are



Company founded in 2014
Public-Private-Partnership
Cooperation network
3 individuals, 4%
each
GeoVil
le
20%
Cataly
sts
20%
 What we do



TU
Vienn
a
24%
ZAMG
24%
High Performance Computing
Data provision and value-added products
Virtual research, development and operations
environments
...more information @ www.eodc.eu
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
2
EO infrastructure landscape
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
3
Connecting Science and Operations
NORA
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
4
NRT Operations and Rolling Archive
 Principle:


High-Availability
Dedicated connection to archive
 Input/Output Service:


data download from ESA
data distribution to LT archive
 Monitoring Service:

data sets, system performance
 Compute services:

NRT processing
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
5
Connecting Science and Operations
SIDP
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
6
Science Integration and Development
 Fully equipped and flexible cloud
infrastructure


managed by EODC
virtual machines
 Remote Workstation: develop methods &
algorithms from virtually anywhere


run applications on remote environments
performance = local desktops
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
7
Science Integration and Development
 EODC Portal

Creation and Management of Virtual Machines
•

access via e.g. RDP
Order / book services
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
8
Science Integration and Development
 Browser-based development services
Data handling
Prototyping / Testing
and visualization
Code development / IDE
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
9
Science Integration and Development
 Code management / Continuous Integration
Testing / Deployment
Taking well-established industry standards and applying them to
EO applications.
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
10
SIDP to host public services
 Multi-Sensor Evolution Analysis MEA
(WCS and WCPS services) developed by MEEO)
and hosted at EODC’s SIDP
http://eodatacube.eu/
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
11
Connecting Science and Operations
GTR VSC-3
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
12
EODC GTR - Vienna Scientific Cluster 3
 Hosted by Science Center of TU Wien

physically co-located with EODC SIDP and storage

direct infiniband interconnected
 Specifications:


> 2000 nodes
 ca. 32.000 cores
>600 Teraflops
 #85 Top500 Nov/14
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
13
Simplified access to HPC cluster
Browse Results
Trigger Processing
Processing
Containers
Source Code &
Configuration
Data Processing
Cluster Setup
• submit, track, monitor processing job
• manageDr.job
queues, interact with scheduler / cluster
Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
14
Connecting Science and Operations
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
15
EODC GTR SuperComputing Experiment
 Experiment carried out by




Geo coding / terrain correction of 624 Sentinel-1 images
from Austria, Sudan and Zambia with Sentinel-1 toolbox
Each image is about 1 GB in size
Serial processing with one node would take about 2 weeks
 Approach

Parallel processing on 312 nodes, whereas 2 images were
simultaneously launched on a single computing node
 Results

Processing was completed within 45 min
(without queue time)
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
16
Data availability @ EODC
 Sentinel-1 data

Public coverage maps: currently available ~2,5
hours after its processing time and 6,25 hours after
acquisition time (median value for August 2015)
 66556 acquisitions (Oct. ‘15)
Thank you for your attention!
werner.muecke@eodc.eu
www.eodc.eu
Dr. Werner Mücke :: EO
OpenScience 2.0 :: October 13th, 2015
17
https://www.eodc.eu/sentinel-1-coverage-maps/
Extra Slides
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
18
EODC services
Data Services
o
o
o
Procurement
Archiving & Distribution
Data catalogue & discovery
Community Services
o
o
o
Communication
Knowledge base
Task / Project management tools
Software Services
o
o
o
Software development
User support
Testing and benchmarking
Platform Services
o
o
o
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
Web-based processing
Visualisation
Hosting
19
EODC GTR = Vienna Scientific Cluster 3
Petabyte-Scale
Disk Storage
24/7 Near real-time
Operations
& Rolling Archive
Tape Storage
Long term Archive
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
20
EODC GTR = Vienna Scientific Cluster 3
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
21
EODC GTR = Vienna Scientific Cluster 3
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
22
NRT Operations and Rolling Archive
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
23
Data availability @ EODC
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
24
S-1 Flood Mapping
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
25
Currently available S-2 data @ ESA
„Display 1 to 11 of 11 products“
Dr. Werner Mücke :: EO OpenScience 2.0 :: October 13th, 2015
26