eDIKT
Status and Plans
Stuart Anderson
Rob Baxter
Malcolm Atkinson
Arthur Trew
www.nesc.ac.uk
2nd May 2002
Agenda
Global & National Context (Malcolm Atkinson)
OGSA Overview (Malcolm Atkinson)
OGSA-DAI Grid Core Project (Rob Baxter)
OGSA & eDIKT (Rob Baxter)
eDIKT Status (Arthur Trew)
eDIKT Plans (Arthur Trew)
Budgetary Issues (Arthur Trew)
Discussion
UK e-Science
e-Science and the Grid
‘e-Science is about global collaboration in key
areas of science, and the next generation of
infrastructure that will enable it.’
‘e-Science will change the dynamic of the
way science is undertaken.’
John Taylor
Director General of Research Councils
Office of Science and Technology
From presentation by Tony Hey
UK Grid Network
Edinburgh
Glasgow
Newcastle
Belfast
Daresbury Lab
Manchester
Cambridge
Hinxton
Oxford
Cardiff
RAL
London
Southampton
From Tony Hey 27 July 01 with adjusted geography
eDIKT Context
World Stage
GGF5/HPDC11, GGF Working Groups
Argonne National Lab, ISI, SDSC, NPACI, …
European Projects
National Stage
National e-Science Centre
X
Strong inter-university collaboration
DBTF, TAG, Architecture Task Force, …
Major UK Pilot and Industrial Projects
Aspirations
Europe’s Leading Supercomputing Centre
X
Research, Data Curation, Facilities, Products, Services
e-Science Potential
Crisis Response: Fire fighting safety,
Eruptions, Floods & Fugitive Pollutants
Diagnosis & Treatment Planning
Whole population health monitoring
Epidemic Detection & Management
Understanding Cells & Organs
Understanding our Universe
Engineering Design & Diagnostics
Oceans, Climate, Environment, Ecosystems
…
The Challenge
Ambition
Data Challenge
Deluge of Data
Fire fighting safety
Do it for everything
Eruption, Flood & Pollution Response
•More, Faster Digital Streams
Diagnosis & Treatment Planning
•Heterogeneous evolving models
Whole population health monitoring
it quickly
Epidemic Detection & Management
•UncertaintyDo
about
data quality
Change
it
often
Understanding Cells & Organs
In Flight problem management
Finding the Nuggets
Oceans, Climate, Ecosystems, …
Reason to Trust theDoAnswer
it often
Software Challenge
Dependability Challenge
Geographic Distribution
Composing Software
•Encapsulating understanding
Keep it running
•Multiple technologies
•Heterogeneous evolving models
•Uncertainty about component quality
Solving a Problem
Reason to Trust the Answer
An Answer in Time
•scientists, resources & instruments
•Diverse: Organisations & Countries
Pay for it people & phenomena
•Mobile: equipment,
•Uncertainty about communication quality
Sustaining
Run it for everyone
the Computation
•Problem Detection & Recovery, Security, …
Reason to Trust System Dependability
Affordable
The Big Challenge
Ambition
Data Challenge
Deluge of Data
Fire fighting safety
Do it for everything
Eruption, Flood & Pollution Response
•More, Faster Digital Streams
Diagnosis & Treatment Planning
•Heterogeneous evolving models
Whole population health monitoring
it quickly
Epidemic Detection & Management
•UncertaintyDo
about
data quality
Change
it
often
Understanding Cells & Organs
In Flight problem management
Finding the Nuggets
Oceans, Climate, Ecosystems, …
Reason to Trust theDoAnswer
it often
Software Challenge
Dependability Challenge
Geographic Distribution
Composing Software
•Encapsulating understanding
Keep it running
•Multiple technologies
•Heterogeneous evolving models
•Uncertainty about component quality
Solving a Problem
Reason to Trust the Answer
An Answer in Time
•scientists, resources & instruments
•Diverse: Organisations & Countries
Pay for it people & phenomena
•Mobile: equipment,
•Uncertainty about communication quality
Sustaining
Run it for everyone
the Computation
•Problem Detection & Recovery, Security, …
Reason to Trust System Dependability
Affordable
OGSA: Science & Commerce Converge
Web Services
Grid Technology
Grid Services
Service
Registry
Find
Service
Requestor
Publish
Bind
Service
Provider
Service-Oriented Architecture
Web Services
Rapid Integration
Dynamic binding
Commercial Power
Financial & Political
Independence
Client from Service
Service from Client
Separation
Function from Delivery
Description
WSDL, WSC, WSEF, …
Tools & Platforms
Java ONE, Visual .NET
WebSphere, Oracle, …
FT IT supplement 1 May 02
Grid Technology
Virtual Organisations
Sharing & Collaboration
Security
Single Sign in, delegation
Distribution & fast FTP
But Various Protocols
Resource Mangement
Portability
Ubiquitous APIs & Modules
Gov’nm’t Agency Buy in
USA > $.5B in last 2 years
EU €40M in last 3 years
UK £118M
IT Companies Investing
E.g. IBM > $1B/year
Foster, I., Kesselman, C. and Tuecke, S., The Anatomy of the Grid: Enabling Virtual
Organisations, Intl. J. Supercomputer Applications, 15(3), 2001
IT Industry Responses
‘All of our systems will be enabled to work
with the grid, and all of our middleware will
integrate with the software’
Irving Wladawsky-Berger, IBM
‘Grid Computing is one of the three next big
things for Sun and our customers’
Ed Zander, COO Sun
OGSA-DAI project
Develop data access & integration
services within OGSA framework
£3.3m over 18 months
NeSC/EPCC (8 staff), eSNW, NEReSC
IBM UK, IBM US, Oracle
Links with key Grid players
Globus Project (Argonne National Lab & ISI)
UK e-Science Data Base Task Force
AstroGrid, myGrid, GridPP, RealityGrid
OGSA-DAI roadmap
Started Feb 2002
GSI + Web Services productised 15 Apr
Milestone 1: 30 Apr
draft Grid data services spec
alpha release of XML data services
Milestone 2: 19 July (GGF5)
v1.0 Grid data services spec
beta release of XML data services
alpha demo of RDB data services
Milestone 3: 30 Sept.
plan for extension for Phase II
OGSA in eDIKT
novel
astro
AstroGrid
AVO
NVO
OGSA-DAI
CS research
GridPP
EDG
ScotGrid
DataTAG
Astro
large
genomic
groups
function
Higgs
boson
PP
Bio
Med
info
info
DB integration & data
management
MRC
Wellcome
drugs
& s/w
semantic
Grid
generic m/w
& tools
autonomics
Grid
web services
OGSA
(enhanced)
Fabric
management
products &
services
CS research
OGSA in eDIKT: plan
Plan eDIKT in web services environment
the emerging industry standard infrastructure
for integration
Strain-test OGSA-DAI under eDIKT
feed in specs and code releases
As OGSA-DAI is proved, migrate eDIKT
infrastructure to Grid services
migration path simple from web services
OGSA-DAI important, but not critical path
Overview
Aspiration: to make Edinburgh/Glasgow the
e-Science centre for Europe
On a scale to rival the biggest US centres
Strategy: to combine resources for maximum impact
top UK CS research groups; leading applications researchers
funding to create critical mass
X
X
X
£33M of e-Science funding to E+G in last 12 months
£2.3M additional IRC funding to link basic research to e-Science
£50M for HPC services
– Big iron gives international visibility and weight
eDIKT status
Assimilating OGSA revolution
Requires thought & enhances our potential
Project Manager in place (Rob Baxter)
Final interviews for first two staff next week
Adverts for all other staff in press
Closing date mid-May
Database server procurement planning underway
Initial planning exercise in conjunction with IBM
Working relations with test beds established
Testbed status: Astronomy
Key contacts: Prof Andrew Lawrence & Dr Bob Mann
(Edinburgh)
For linkage to AstroGrid, AVO, Vista
All key UK/European projects
US links: Professor Alex Szalay (Johns Hopkins) and
Dr Jim Gray (Microsoft)
Give links to Sloan Digital Sky Survey and NVO
…and to industry activities
Requirements capture underway
Expected start date 1 August 2002
Testbed Status: Particle Physics
Key contacts: Dr Tony Doyle (Glasgow) Dr
Steve Playfer (Edinburgh)
Give links to GridPP, BaBar, DataTAG
US contact: Professor Richard Mount
(Stanford)
Strenghtens Babar (SLAC) connection and links
us into GriPhyN
Requirments understood, now starting
detailed project definition
Expected start date 1 September
Bioinformatics:
Building the Community
Biology
Medicine
Links with
EBI, Dundee
myGrid
data integration,
matching & analysis
Richard Baldock
Keith Johnson
Peter Ghazal
Julian Dow
Peter Buneman
Malcolm Atkinson
Bonnie Webber
David Gilbert
Ian Ford
Anna Dominizak
David Porteous
David Webb
Joanna Wardlaw
Neuroinformatics
David Willshaw
Nigel Goddard