Grid Services: Where will they lead us?
Malcolm Atkinson
Director of NeSC
Universities of Edinburgh and Glasgow
15 th February 2002

Take Home Message
Our Axes need Sharpening and …

Take Home Message
Our Axes need Sharpening and
We Can Sharpen them …

Take Home Message
Our Axes need Sharpening and
We Can Sharpen them
Start by using Open Grid Services
Architecture

percept ion
a
stamin reactio n times
-
SOP’s airframe models crew capabil ities
accura
Ambition wing models
•lift capabiliti es
•drag capabiliti es
•respons iveness landing stabilizer models
•deflection capabilities
•responsiv engine models gear models
Advanced Photon Source wide-area dissemination real-time collection archival storage
DOE X-ray grand challenge: ANL,
USC/ISI, NIST, U.Chicago

Ambition in-flight data airl ine grou nd stati on global network eg SITA
DS&S Engine Health Center internet, e-mail, pager maintenance centre data centre
Distributed Aircraft Maintenance Environment: Universities of Leeds, Oxford, Sheffield
&York
Fire fighting safety
Volcanic Eruption Prediction
Flood & Pollution Response
Diagnosis & Treatment Planning
Whole population health monitoring
Collision avoidance
Epidemic Detection & Management
Understanding Cells & Organs
In Flight problem management
Oceans, Climate, Ecosystems, …

Challenge 1
Composing Software
• Encapsulating ideas, methods & understanding
• Developed independently
• Multiple technologies
• Heterogeneous models and interfaces
• Changing components
• Uncertainty about component quality
Solving a Problem
•
Iteration
Reason to Trust the Answer
An Answer in Time

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

Challenge 1

QoS?
Challenge 1

QoS?
Challenge 1
Engineering
Trade offs?

QoS?
Problem Handling?
Challenge 1
Engineering
Trade offs?

QoS?
Problem Handling?
Flexibility?
Challenge 1
Engineering
Trade offs?

QoS?
Problem Handling?
Flexibility?
Challenge 1
Engineering
Trade offs?
Understood?

QoS?
Problem Handling?
Flexibility?
Challenge 1
Engineering
Trade offs?
Understood?
Reuse?

Challenge 2
Deluge of Data
• More Digital Sources
• Faster Digital Streams
• Faster Data Generation
• Heterogeneous models and standards
• Changing structures
• Uncertainty about data quality
Finding the Nuggets
• Iteration, Search, Indexing, Mining, Statistics, Inference
Reason to Trust the Answer

Challenge 3
Geographic Distribution
• Intrinsic: scientists, resources & instruments
• Diverse & Independent Regimes: Organisations, Countries
• Faster Networks
• Mobile: equipment, people & phenomena
• Changing structures
• Uncertainty about communication quality
Sustaining the Computation
• Problem Detection & Recovery, Security, Authentication, …
Reason to Trust the System’s Dependability

Ultimate Challenge
Challenge 1 + Challenge 2 + Challenge 3
Do it often
Do it quickly
Do it for everybody
Do it for everything
Change it quickly

Human Race Exhausted

Needs
Framework / Architecture
Tools
Methods
Composable Components
Dependable Foundations

Requirements
Self-Sustaining Infrastructure
• With regular well defined structure
Adequately Described Components
• Function, Behaviour, QoS, …
Models Supporting Analysis & Reasoning
•
Finding appropriate components
•
Determining how they compose
Tools for Composition, Diagnosis & Change
Sustainable Economic Model
Reason to Trust the System’s Dependability

Web Services
Grid Technology
Grid Services

Web Services
Independence
Client from Service
Service from Client
Description
Web Services DL
…
Separation www.w3.org/TR/SOAP Function from Delivery
Tools & Platforms
Java ONE
Visual .NET
WebSphere
Oracle
Commercial Buy in www. w3c. org / TR / SOAP or TR/wsdl

Grid Technology
Distribution
Various Protocols
FTP
Security
Single Sign in
Resource Sharing
Discovery
Process Creation
Scheduling
Portability
APIs
Gov’nm’t Agency Buy in
Foster, I., Kesselman, C. and Tuecke, S., The Anatomy of the Grid: Enabling Virtual
Organisations, Intl. J. Supercomputer Applications, 15(3), 2001

Open Grid Services Architecture
Applications
Virtual Grid Services
Multiple implementations of
Grid Services

OGSA Features
WSDL + WSIL
Description
Discovery
Tools & Platforms
Apache axis
…
Invocation
SOAP
RPC
…
Representations
XML + Schema
Life Time Management
Factories
Transient & Persistent GS
GS Handles
GS Records
Soft State
Notification
Authentication
Certificates +
Delegation
Change Management
Platform
Foster, I., Kesselman, C., Nick, J. and Tuecke, S., The Physiology of the Grid:
An Open Grid Services Architecture for Distributed Systems Integration

OGSA Development
More Description
More Languages




QoS
Owners, Costs & Charging
Transaction & Coordination
Work Flow
Precision & Semantics
Tools & Platforms
Partial Models



Varied, open, analysis, synthesis
Directed composition
Change Managers
Invocation & Reps
Standard Schemas
Namespaces
Engineering
Factories
Transient & Persistent GS
GS Handles
GS Records
Soft State
Notification
Design for Testability
Dynamic Testing
Change Management
Dynamic Evolution
Platforms
Mapping to host, invocation, notification, protocol transmission, authentication

OGSA Development 2
Higher-Level Description
Information-level
Semantic-level
Virtualisation
Tools & Platforms
Higher-level Models
User-Guided Automation
Invocation & Reps
Agreed Semantic Models
Trustworthy Translation
Engineering
Accessible Trade-offs
Dynamic Control
Autonomic
Design for QA
Q Testing & Certification
Change Management
Dynamic Evolution
Platforms
Raising their level




More high-level facilities
Coherent
Understandable
Specified

Families of Components
Members of a Family
Address a Domain

Data Integration




Biological Search
Fluid Dynamics
Ecological Models
…
Comply with Rules



Terms for Description
Schemas / Namespaces
Standard Operations
Varied Implementation



Development
Trade offs
Constructive Rivalry
Design
For change
For test
For performance
Engineer
Measure
Operational
Usage
Effects on Science
Review and Revise
Based on Real use
Accredit

The Yellow Brick Road
Many Players
Join in
Many Paths
Many Challenges
Worthwhile Goal