UK Role in Open Grid Services Architecture
Towards an Architectural Road Map
Malcolm Atkinson
Director of NeSC
18th April 2002
Outline
Background — What is OGSA?
The Confluence of Web Services & Grid
X
Presented already by Ian Foster
The UK Architectural Task Force
Why Engage with OGSA
What should the UK do
Web Services
Grid Technology
Grid Services
UK ATF
Malcolm Atkinson
Jon Crowcroft
David De Roure
Vijay Dialani
Andrew Herbert
Ian Leslie
Ken Moody
Steven Newhouse
Tony Storey
…………… Plus consultations
UK Role in Open Grid Services Architecture, Version 0.6
11th March 2002
www.nesc.ac.uk
→ teams
→ ATF
Why Change?
Ambition
Data Challenge
Deluge of Data
Fire fighting safety
Do it for everything
Eruption, Flood & Pollution Response
•More, Faster Digital Streams
Diagnosis & Treatment Planning
•Heterogeneous evolving models
Whole population health monitoring
it quickly
Epidemic Detection & Management
•UncertaintyDo
about
data quality
Change
it
often
Understanding Cells & Organs
In Flight problem management
Finding the Nuggets
Oceans, Climate, Ecosystems, …
Reason to Trust theDoAnswer
it often
Software Challenge
Dependability Challenge
Geographic Distribution
Composing Software
•Encapsulating understanding
Keep it running
•Multiple technologies
•Heterogeneous evolving models
•Uncertainty about component quality
Solving a Problem
Reason to Trust the Answer
An Answer in Time
•scientists, resources & instruments
•Diverse: Organisations & Countries
Pay for it people & phenomena
•Mobile: equipment,
•Uncertainty about communication quality
Sustaining
Run it for everyone
the Computation
•Problem Detection & Recovery, Security, …
Reason to Trust System Dependability
Affordable
Why Change?
Ambition
Fire fighting safety
Eruption, Flood & Pollution Response
Diagnosis & Treatment Planning
Whole population health monitoring
Epidemic Detection & Management
Understanding Cells & Organs
In Flight problem management
Oceans, Climate, Ecosystems, …
Software Challenge
Composing Software
•Encapsulating understanding
•Multiple technologies
•Heterogeneous evolving models
•Uncertainty about component quality
Solving a Problem
Reason to Trust the Answer
An Answer in Time
Data Challenge
Deluge
Data
Best ofofBoth
Worlds
Description
Driven Dynamic
Integration (WS)
•More, Faster
Digital Streams
Automated Generation of Code (WS)
•Heterogeneous
Security
(Grid & WS)evolving models
Resource Discovery (WS & Grid)
•Uncertainty
about
data
quality
High-level
Platform
(WS &
Grid)
Tools (WS)
Finding
the&Nuggets
Distribution
Heterogeneity (WS & Grid)
…
Reason to Trust the Answer
Dependability Challenge
Geographic Distribution
•scientists, resources & instruments
•Diverse: Organisations & Countries
•Mobile: equipment, people & phenomena
•Uncertainty about communication quality
Sustaining the Computation
•Problem Detection & Recovery, Security, …
Reason to Trust System Dependability
Affordable
Why Change?
Ambition
Dominant
Data:
Fire fighting
safetyCommon Needs
Metadata
& Discovery
Eruption,
Flood & Pollution Response
Grid
Data Management
(Giggle)
Diagnosis
& Treatment
Planning
Grid
FTPpopulation health monitoring
Whole
Databases
&Detection
Transactions
(WS)
Epidemic
& Management
Distributed
Data Mining
Understanding
Cells & Organs
Information
Management
In Flight problem
management
Knowledge
Management
Oceans, Climate,
Ecosystems, …
Software Challenge
Composing Software
•Encapsulating understanding
•Multiple technologies
•Heterogeneous evolving models
•Uncertainty about component quality
Solving a Problem
Reason to Trust the Answer
An Answer in Time
Data Challenge
Deluge of Data
•More, Faster Digital Streams
•Heterogeneous evolving models
•Uncertainty about data quality
Finding the Nuggets
Reason to Trust the Answer
Dependability Challenge
Geographic Distribution
•scientists, resources & instruments
•Diverse: Organisations & Countries
•Mobile: equipment, people & phenomena
•Uncertainty about communication quality
Sustaining the Computation
•Problem Detection & Recovery, Security, …
Reason to Trust System Dependability
Affordable
Why Change?
Ambition
FireCommon
fighting safety
Issues
Eruption, Flood & Pollution Response
Diagnosis & Treatment Planning
Grid
Protocolshealth
& Services
Whole
population
monitoring
SOAPDetection
multiple mappings
Epidemic
& Management
Grid Monitoring
Management
Understanding
Cells & Organs
Security
(WS &
Grid)
In Flight
problem
management
… Climate, Ecosystems, …
Oceans,
New Opportunity
Software Challenge
Composing Software
•Encapsulating understanding
•Multiple technologies
•Heterogeneous evolving models
•Uncertainty about component quality
Solving a Problem
Reason to Trust the Answer
An Answer in Time
Data Challenge
Deluge of Data
•More, Faster Digital Streams
•Heterogeneous evolving models
•Uncertainty about data quality
Finding the Nuggets
Reason to Trust the Answer
Dependability Challenge
Geographic Distribution
•scientists, resources & instruments
•Diverse: Organisations & Countries
•Mobile: equipment, people & phenomena
•Uncertainty about communication quality
Sustaining the Computation
•Problem Detection & Recovery, Security, …
Reason to Trust System Dependability
Affordable
UK Focus: Data → Knowledge
The Picture from Space
Phase 1: Foundations & Planning
GGF Collaboration on OGSA Design & Prototyping
Requirements, Education & Consultation
Common Infrastructure
Baseline DB Access & Integration
Validation & Testing
Baseline Logging Infrastructure
Trustable Services
Performance Engineering
Dependable Engineering
Design for Testability
Engineering for Change
Management & Ops Support
Privacy, Ethics & Legal
Phase 2: Automation↑ & Information↑
Refining & Exploiting Description Languages
Data → Information → Semantic Grid
Advanced DB Integration
Scheduling for Data Intensive Computation
Computational Grid Economies
Project Transitions
GT3
Testers
Early
Adopters
GT2
Demo at GGF
Specification & Motivation
Now
Q2
Q3
2002
Q4
Q1
Q2
Q3
2003
Q4
Building OGSA Capability
GT3
Testers
Early
Adopters
www.epcc.ed.ac.uk~neilc/gsiws/
GT2
Early DB Integration
Advanced Integration Components
components
Architecture Road Map &Review Semantic Grid
GSI + WS Advisory Documents
Components
Grid economy infrastructure
Requirements &
Consultation
New Core M/W Projects
Demo at GGF
Specification & Motivation
Now
Alpha GT3
Q2
Q3
2002
Beta GT3
Q4
Q1
Production GT3
Q2
Q3
2003
Q4
The First Steps
Advanced Information Handling
Semantics of WS Description Languages
www.epcc.ed.ac.uk~neilc/gsiws/
Logging & Monitoring
Beta release to selected projects
Demo., Design & Review
Grid DB Access Services
Infrastructure: GS APIs, Types & Primitives
Web Services & GSI & Axis
Trials: Grid DB Access Services
Requirements & Standards
Trials of Web Services & GSI & Axis
Pilot Project & Community Consultation
Best available platform from industry & Globus
What does it mean?
More Description
What it does
How it delivers
Security
Coordination
…
More Support
Late dynamic binding
Context adaptation
Tools & Automation
Visualisations
Autonomic infrastructure
…
Increased Flexibility
Industrial Forces
Supported technology
Political force
Immovable force?
Standards
…
Extensive Families
Type systems & Schema
Composable Services
Standards requirement
…
Changes
The way we share
The way we think
Higher-level Discourse
Web Services
Rapid Integration
Dynamic binding
Commercial Power
Financial & Political
Independence
Client from Service
Service from Client
Separation
Function from Delivery
Description
WSDL, WSC, WSEF, …
Tools & Platforms
Java ONE, Visual .NET
WebSphere, Oracle, …
www. w3c. org / TR / SOAP or TR/wsdl
Grid Technology
Virtual Organisations
Sharing & Collaboration
Security
Single Sign in, delegation
Distribution & fast FTP
But Various Protocols
Resource Mangement
Discovery
Process Creation
Scheduling
Monitoring
Portability
Ubiquitous APIs & Modules
Gov’nm’t Agency Buy in
Foster, I., Kesselman, C. and Tuecke, S., The Anatomy of the Grid: Enabling Virtual
Organisations, Intl. J. Supercomputer Applications, 15(3), 2001
Open Grid Services Architecture
Applications
Using operations
Virtual Grid Services
Implemented by
Multiple implementations of
Grid Services
OGS infrastructure
Foster, I., Kesselman, C., Nick, J. and Tuecke, S., The Physiology of the Grid:
An Open Grid Services Architecture for Distributed Systems Integration
OGSA Features
WSDL + WSIL + WSEL + …
Description
Discovery
Tools & Platforms
Apache axis
…
Invocation
SOAP
RPC / RMI
Optimised binding
Representations
XML + Schema
Life Time Management
Factories
Transient & Persistent GS
GS Handles
GS Records
Soft State
Notification
Authentication
Certificates +
Delegation
Change Management
Platform
Foster, I., Kesselman, C., Nick, J. and Tuecke, S., The Physiology of the Grid:
An Open Grid Services Architecture for Distributed Systems Integration
OGSA Development
More Description
More Languages
X
X
X
X
Trustworthy services
Owners, Costs & Charging
Transaction & Coordination
Work Flow
Precision & Semantics
Tools & Platforms
Partial Models
X
X
X
Varied, open, analysis, synthesis
Directed composition
Change Managers
Invocation & Reps
Standard Schemas
Namespaces
Engineering
Factories
Transient & Persistent GS
GS Handles
GS Records
Soft State
Notification
Design for Testability
Dynamic Testing
Change Management
Dynamic Evolution
Platforms
Mapping to host,
invocation, notification,
protocol transmission,
authentication
OGSA Development 2
Higher-Level Description
Information-level
Semantic-level
Virtualisation
Tools & Platforms
Higher-level Models
User-Guided Automation
Invocation & Reps
Agreed Semantic Models
Trustworthy Translation
Engineering
Accessible Trade-offs
Dynamic Control
Autonomic
Design for Q and Test
Q Testing & Certification
Change Management
Dynamic Evolution
Platforms
Raising their level
More high-level
facilities
X
X
X
Coherent
Understandable
Specified