OGSA-DAI in OMII-Europe
Neil Chue Hong
EPCC, University of Edinburgh
processing
diversity
scale
access
longevity
administration
It’s all about
DATA
storage
description
discovery
transfer
security
location
integration
3
EU project: RIO31844-OMII-EUROPE
Data Service Goals
Make access transparent
Make integration easy
Make management simple
4
EU project: RIO31844-OMII-EUROPE
Data Service Challenges
Diversity
of data resource types, vendors,
middleware, schema, metadata
Scale
of collections, formats, geographical,
political and social distance
Ownership
on individual, group, and organisation
levels; intersecting yet independent
Security
for client, service and data owner;
at many levels, with many tradeoffs
5
EU project: RIO31844-OMII-EUROPE
OGSA-DAI In One Slide
•
•
•
•
•
An extensible framework for data
access and integration.
Expose heterogeneous data
resources to a grid through web
services.
Interact with data resources:
– Queries and updates.
– Data transformation /
compression
– Data delivery.
Customise for your project using
– Additional Activities
– Client Toolkit APIs
– Data Resource handlers
A base for higher-level services
– federation, mining, visualisation
6
EU project: RIO31844-OMII-EUROPE
Application
The OGSA-DAI
Framework
Client Toolkit
OGSA-DAI service
Engine
SQLQuery
readFile
XPath
XSLT
GZip
GridFTP
Activities
JDBC
XMLDB
File
Data
Resources
SQL
MySQL
DB2
Server
XIndice
SWISS
PROT
Databases
7
EU project: RIO31844-OMII-EUROPE
OGSA-DAI service
Engine
SQLQuery
Multiple
JDBC
SQL GDS
SQL
SQL
JDBC
JDBC
MySQL
SQL
SQL
JDBC
JDBC
8
EU project: RIO31844-OMII-EUROPE
Challenges for OMII-Europe
Diversity
of data resource types, vendors,
middleware, schema, metadata
OGSA-DAI
Scale
of collections, formats, geographical,
political and social distance
OMII-Europe
Ownership
Security
on individual, group, and organisation
levels; intersecting yet independent
for client, service and data owner;
at many levels, with many tradeoffs
9
EU project: RIO31844-OMII-EUROPE
Challenge 1: Grid Middleware
• OGSA-DAI currently runs on GT4, OMII_2 and Axis
1.2
– want to extend this to UNICORE(GS), EGEE,
CrownGrid
• Different, but similar architectural models
– addressing and naming
– versioning
• Unicore/GS prototype developed (no security)
• MUST keep client APIs the same
– ideally service code and configuration will stay similar
10
EU project: RIO31844-OMII-EUROPE
Challenge 2: Security
• OGSA-DAI uses GSI for GT4, and WSS4J for
Axis/OMII
– x509 cert based, TLS and MLS
– many security levels: macro, service, resource, activity
• Want to utilise standards where possible
– move to SAML
– interaction with other OMII-Europe work
• Delegation, authorisation, etc., should support a
single developer model, multiple provider
implementations
11
EU project: RIO31844-OMII-EUROPE
Challenge 3: Interoperation and Intersection
• The technology must work together in mixed and
dynamic domains
– security is of primary importance
– also data transfer
– both together would be nice
• Many other “supplemental” components will need to
interoperate for full functionality
– e.g. discovery services, auditing services
• If we solve this, we make the Grid useful
12
EU project: RIO31844-OMII-EUROPE
Three Challenges Together
Data operation workflow
Distributed query
Admin domain 1
OGSA-DAI
DS1
GT4
DB1
MyNotes
Admin domain 2
How do we handle?
– security
delegation
between
middleware
– addressing DBs
across domains
Results transfer
OGSA-DAI
DS2
EGEE
Resilient query
DB2
Results1
DB3
Results2
Admin domain 3
OGSA-DAI
DS3
UNICORE
DB4
GroupDB
Update
13
EU project: RIO31844-OMII-EUROPE
Summary
• Data services provide a means of addressing the
challenges of managing and using increasing
amounts of data
• OGSA-DAI provides components which present a
model of transparency and abstraction for data
resources
• OMII-Europe aims to extend OGSA-DAI services to
address challenges of differing middleware, diverse
security domains and interoperation between
intersecting dynamic virtual organisations
14
EU project: RIO31844-OMII-EUROPE
Thank you for listening
Any questions?
http://www.omii-europe.com
http://www.ogsadai.org.uk
15
EU project: RIO31844-OMII-EUROPE