UK Role in Open Grid Services Architecture
Towards an Architectural Road Map
A Report to the Technical Advisory Group
from
The Architecture Task Force
Malcolm Atkinson
Director of NeSC
20th March 2002
Outline
Background — What is OGSA?
The Confluence of
X
Web Services & Grid
Why Engage with OGSA
What should the UK do
How should we do it
Web Services
Grid Technology
Grid Services
Web Services
Rapid Integration
Dynamic binding
Commercial Power
Financial & Political
Independence
Client from Service
Service from Client
Separation
Function from Delivery
Description
WSDL, WSC, WSEF, …
Tools & Platforms
Java ONE, Visual .NET
WebSphere, Oracle, …
www. w3c. org / TR / SOAP or TR/wsdl
Grid Technology
Virtual Organisations
Sharing & Collaboration
Security
Single Sign in, delegation
Distribution & fast FTP
But Various Protocols
Resource Mangement
Discovery
Process Creation
Scheduling
Monitoring
Portability
Ubiquitous APIs & Modules
Gov’nm’t Agency Buy in
Foster, I., Kesselman, C. and Tuecke, S., The Anatomy of the Grid: Enabling Virtual
Organisations, Intl. J. Supercomputer Applications, 15(3), 2001
Open Grid Services Architecture
Applications
Using operations
Virtual Grid Services
Implemented by
Multiple implementations of
Grid Services
OGS infrastructure
Foster, I., Kesselman, C., Nick, J. and Tuecke, S., The Physiology of the Grid:
An Open Grid Services Architecture for Distributed Systems Integration
Why Change?
Ambition
Data Challenge
Deluge of Data
Fire fighting safety
Do it for everything
Eruption, Flood & Pollution Response
•More, Faster Digital Streams
Diagnosis & Treatment Planning
•Heterogeneous evolving models
Whole population health monitoring
it quickly
Epidemic Detection & Management
•UncertaintyDo
about
data quality
Change
it
often
Understanding Cells & Organs
In Flight problem management
Finding the Nuggets
Oceans, Climate, Ecosystems, …
Reason to Trust theDoAnswer
it often
Software Challenge
Dependability Challenge
Geographic Distribution
Composing Software
•Encapsulating understanding
Keep it running
•Multiple technologies
•Heterogeneous evolving models
•Uncertainty about component quality
Solving a Problem
Reason to Trust the Answer
An Answer in Time
•scientists, resources & instruments
•Diverse: Organisations & Countries
Pay for it people & phenomena
•Mobile: equipment,
•Uncertainty about communication quality
Sustaining
Run it for everyone
the Computation
•Problem Detection & Recovery, Security, …
Reason to Trust System Dependability
Affordable
Why Change?
Ambition
Fire
fighting
safety
Description
Driven
Dynamic Integration (WS)
AutomatedFlood
Generation
of Code (WS)
Eruption,
& Pollution
Response
Resource Discovery
(WS &Planning
Grid)
Diagnosis
& Treatment
High-level
Platform (WS
& Grid)
Whole
population
health
monitoring
Tools (WS)
Epidemic Detection & Management
Distribution & Heterogeneity (WS & Grid)
Understanding
Cells & Organs
…
In Flight problem management
Oceans, Climate, Ecosystems, …
Software Challenge
Composing Software
•Encapsulating understanding
•Multiple technologies
•Heterogeneous evolving models
•Uncertainty about component quality
Solving a Problem
Reason to Trust the Answer
An Answer in Time
Data Challenge
Deluge of Data
•More, Faster Digital Streams
•Heterogeneous evolving models
•Uncertainty about data quality
Finding the Nuggets
Reason to Trust the Answer
Dependability Challenge
Geographic Distribution
•scientists, resources & instruments
•Diverse: Organisations & Countries
•Mobile: equipment, people & phenomena
•Uncertainty about communication quality
Sustaining the Computation
•Problem Detection & Recovery, Security, …
Reason to Trust System Dependability
Affordable
Why Change?
Ambition
Fire fighting safety
Eruption, Flood & Pollution Response
Grid Data
(Giggle)
Diagnosis
& Management
Treatment Planning
Grid FTP
Whole population
health monitoring
Databases
& Transactions
(WS)
Epidemic
Detection
& Management
DataCells
Mining
Understanding
& Organs
Knowledge
In Flight
problemManagement
management
Oceans, Climate, Ecosystems, …
Software Challenge
Composing Software
•Encapsulating understanding
•Multiple technologies
•Heterogeneous evolving models
•Uncertainty about component quality
Solving a Problem
Reason to Trust the Answer
An Answer in Time
Data Challenge
Deluge of Data
•More, Faster Digital Streams
•Heterogeneous evolving models
•Uncertainty about data quality
Finding the Nuggets
Reason to Trust the Answer
Dependability Challenge
Geographic Distribution
•scientists, resources & instruments
•Diverse: Organisations & Countries
•Mobile: equipment, people & phenomena
•Uncertainty about communication quality
Sustaining the Computation
•Problem Detection & Recovery, Security, …
Reason to Trust System Dependability
Affordable
Why Change?
Ambition
Fire fighting safety
Eruption, Flood & Pollution Response
Diagnosis & Treatment Planning
Grid Protocols
& Services
Whole population
health
monitoring
SOAP
multiple
mappings
Epidemic Detection & Management
Grid Monitoring
& Organs
Management
Understanding
Cells &
Security (WS
& Grid)
In Flight problem
management
Oceans, Climate, Ecosystems, …
Software Challenge
Composing Software
•Encapsulating understanding
•Multiple technologies
•Heterogeneous evolving models
•Uncertainty about component quality
Solving a Problem
Reason to Trust the Answer
An Answer in Time
Data Challenge
Deluge of Data
•More, Faster Digital Streams
•Heterogeneous evolving models
•Uncertainty about data quality
Finding the Nuggets
Reason to Trust the Answer
Dependability Challenge
Geographic Distribution
•scientists, resources & instruments
•Diverse: Organisations & Countries
•Mobile: equipment, people & phenomena
•Uncertainty about communication quality
Sustaining the Computation
•Problem Detection & Recovery, Security, …
Reason to Trust System Dependability
Affordable
UK Focus: Data → Knowledge
The Picture from Space
Phase 1: Foundations & Planning
GGF Collaboration on OGSA Design & Prototyping
Common Infrastructure
Education & Consultation
Baseline DB Access & Integration
Validation & Testing
Baseline Logging Infrastructure
Trustable Services
Performance Engineering
Dependable Engineering
Design for Testability
Engineering for Change
Management & Ops Support
Privacy, Ethics & Legal
Phase 2: Automation↑ & Information↑
Refining & Exploiting Description Languages
Data → Information → Semantic Grid
Advanced DB Integration
Scheduling for Data Intensive Computation
Computational Grid Economies
The First Steps
Advanced Information Handling
Semantics of WS Description Languages
Logging & Monitoring
Beta release to selected projects
Demo., Design & Review
Grid DB Access Services
Infrastructure: GS APIs, Types & Primitives
Web Services & GSI & Axis
Trials: Grid DB Access Services
Requirements & Standards
Trials of Web Services & GSI & Axis
Pilot Project & Community Consultation
Best available platform from industry & Globus
OGSA Features
WSDL + WSIL + WSEL + …
Description
Discovery
Tools & Platforms
Apache axis
…
Invocation
SOAP
RPC / RMI
…
Representations
XML + Schema
Life Time Management
Factories
Transient & Persistent GS
GS Handles
GS Records
Soft State
Notification
Authentication
Certificates +
Delegation
Change Management
Platform
Foster, I., Kesselman, C., Nick, J. and Tuecke, S., The Physiology of the Grid:
An Open Grid Services Architecture for Distributed Systems Integration
OGSA Development
More Description
More Languages
X
X
X
X
Trustworthy services
Owners, Costs & Charging
Transaction & Coordination
Work Flow
Precision & Semantics
Tools & Platforms
Partial Models
X
X
X
Varied, open, analysis, synthesis
Directed composition
Change Managers
Invocation & Reps
Standard Schemas
Namespaces
Engineering
Factories
Transient & Persistent GS
GS Handles
GS Records
Soft State
Notification
Design for Testability
Dynamic Testing
Change Management
Dynamic Evolution
Platforms
Mapping to host,
invocation, notification,
protocol transmission,
authentication
OGSA Development 2
Higher-Level Description
Information-level
Semantic-level
Virtualisation
Tools & Platforms
Higher-level Models
User-Guided Automation
Invocation & Reps
Agreed Semantic Models
Trustworthy Translation
Engineering
Accessible Trade-offs
Dynamic Control
Autonomic
Design for QA
Q Testing & Certification
Change Management
Dynamic Evolution
Platforms
Raising their level
More high-level
facilities
X
X
X
Coherent
Understandable
Specified