GRID Interoperability: Beyond OGSI

advertisement
QuickTime™ and a
GIF decompressor
are needed to see this picture.
GRID Interoperability:
Beyond OGSI
Dr. David Snelling
Fujitsu Laboratories of Europe
d.snelling@fle.fujitsu.com
UK/Japan N by N Meeting
October 3, 2003
24 October 2003
Fujitsu Laboratories of Europe © 2003
The Grid is Great, but ...
What is it?
Some People say ->
Not this ->
QuickTime™ and a
GIF decompressor
are needed to see this picture.
24 October 2003
2
Fujitsu Laboratories of Europe © 2003
What the Grid is!
“Distributed computing across multiple
administrative domains.”
Distributed computing covers a lot.
The rest makes it interesting,
as if distributed computing wasn’t.
Something that still needs defining!
When were you last asked, “What is the Web?”
Roadmap
Relationship of OGSI to OGSA
OGSA Process
Beyond OGSA
QuickTime™ and a
GIF decompressor
are needed to see this picture.
24 October 2003
3
Fujitsu Laboratories of Europe © 2003
What OGSI Means
OGSI has been Published
“Open Grid Services Infrastructure”
Additional functionality on top of Web Services.
Global Grid Forum “Proposed Recommendation” status
That means we’re done, doesn’t it?
We all implement to OGSI and it all works, right?
Well, yes and no!
Three Questions:
Is OGSI the whole story?
Can all OGSI implementations really talk to each other?
What Next?
QuickTime™ and a
GIF decompressor
are needed to see this picture.
24 October 2003
4
Fujitsu Laboratories of Europe © 2003
What OGSA is
Open Grid Service Architecture
OGSA build-outS&TC
e-business
Common
GUI
OGSA Autonomic Management Services
Common
Install
Config
Deployment
Maintenance
Dynamic
Disaster Automation
Provisioning Recovery
Data
Access /
Replication
Avaki
OGSA Meta-OS Services
Security
Policy
This bit is OGSI!
OGSA Grid Middleware
ServicesGlobus
Platform
Problem
Determination
Entropia...
OGSA Domain Svcs.
Logs
Clustering
Service
Collections
OGSA Infrastructure
Discovery Lifecycle
.Net
Platform Uniq
24 October 2003
Resource
Instrumentation
/
Metering
etc.
New classes of applications and Grid's
End-Users and Admin Staff
Workload
Management Cluster
Management
xSP
z/OS
AIX
zSeries
pSeries
Registry
Manageability
(serviceData+)
Factory
HandleMap
Notification
JBOS
OS/400 Linux
Windows Storage
iSeries z,p,i,xSeries xSeries
Shark
Solaris
Linux
Storage
&
Windows Network
HP/UX
Sun
&
HP
Dell
Compaq
...
Cisco
Nortel
...
The rest is
work in progress.
Veritas
...
QuickTime™ and a
GIF decompressor
are needed to see this picture.
5
Fujitsu Laboratories of Europe © 2003
OGSA Roadmap
What are we doing about it?
GGF OGSA Working Group
A Framework for Other Working Groups
CMM, DAIS, OREP, OGSA-SEC, OGSA-Auth,
GESA, JSDL, ...
The OGSA “Brand”
Usage: OGSA-Climate Model
Reference the Open Grid Services Architecture
Fit into the architecture
QuickTime™ and a
GIF decompressor
are needed to see this picture.
24 October 2003
6
Fujitsu Laboratories of Europe © 2003
Open Grid Services Architecture
Domain-specific services
Service taxonomy
(user’s view)
Program
Data
Core services
Service hierarchy
(provider’s view)
OGSA
Services
90% of Recent
e-mails from
industry
Platform
Services
VOs
CMM
Acc.
Agree.
OGSI
Slide courtesy of Fred Maciel, Hitachi
QuickTime™ and a
GIF decompressor
are needed to see this picture.
24 October 2003
7
Fujitsu Laboratories of Europe © 2003
Beyond OGSA
Assume all of OGSA exists.
OGSA Platform:
OGSI, CMM, Agreement, ...
OGSA Services:
Registries, VO Services, Metering &
Accounting, Deployment & Provisioning, ...
What else needs to be done?
Interoperability
Extension and Composition
QuickTime™ and a
GIF decompressor
are needed to see this picture.
24 October 2003
8
Fujitsu Laboratories of Europe © 2003
Multiple Interoperability Levels
OGSI Pushes the Web Services Envelope
Extensibility Elements (Opaque)
Extensions to WSDL 1.1
Current Definition of Interoperable
“It works with GT3.”
OGSA
OGSI
Web Services
SOAP
http(s)
IP
24 October 2003
9
⇐ Domain specific work to do here
⇐ No problems here (Well I would have to say that)!
⇐ Adapting OGSI extensions (GWSDL)
⇐ Encoding of data types
⇐ OK, but alternative protocols needed for performance
⇐ No Problems here
Fujitsu Laboratories of Europe © 2003
QuickTime™ and a
GIF decompressor
are needed to see this picture.
Composition & Extension
On top of OGSA
Application
Workflow etc.
Services
On top of OGSI
This OGSA
Parallel to OGSI
WS-Security, etc.
Binding
Underneath OGSI
OGSA
OGSI
Web Services
SOAP
http(s)
IP
Binding level needs to be invisible at WS level.
But where does the binding start?
E.g. MIME Encoded Attachments
A Choice to Think About
Live with two communication protocols
Break the rules about the WS binding layer
QuickTime™ and a
GIF decompressor
are needed to see this picture.
24 October 2003
10
Fujitsu Laboratories of Europe © 2003
Roadmap Revisited
Hype
OGSA
Invisible Grid
GT2/Unicore
Next Generation Grids
The Last Grid
Time
Have you ever noticed “Mile Stones”
look like “Grave Stones”?
R.I.P.
QuickTime™ and a
GIF decompressor
are needed to see this picture.
24 October 2003
11
Fujitsu Laboratories of Europe © 2003
NaReGI Project
National Research Grid Initiative
R&D Project Funded by MEXT 2003 to 2007
~17M$ budget in FY2003
GRID Technology for Nano-Science
Unicore as Initial Grid Infrastructure
A new use of Unicore.
Training Session in Japan
QuickTime™ and a TIFF (Uncompressed) decompressor are needed to see this picture.
Two days formal sessions
Two days “open” project labs.
QuickTime™ and a
GIF decompressor
are needed to see this picture.
24 October 2003
12
Fujitsu Laboratories of Europe © 2003
Project Overview
Broker
Deploy and test the Manchester Broker
Done, but needed the old version of the client.
Condor
Build and test a Condor TSI.
Done, for basic job invocation, job control next.
NJS Load Monitor
Build a plugin to monitor load (# of jobs) on NJSs.
Done 2.5 times
QuickTime™ and a
GIF decompressor
are needed to see this picture.
24 October 2003
13
Fujitsu Laboratories of Europe © 2003
Project Overview Continued
RPC
Build a Gateway extension for RPC.
Basic implementation done.
Visualization
File streaming for visualization
Too complicated to implement in time.
PovRay Animations
Extend PovRay to display animations.
Two versions, at 99%
QuickTime™ and a
GIF decompressor
are needed to see this picture.
24 October 2003
14
Fujitsu Laboratories of Europe © 2003
Project Overview Continued
Boltzmann Wizard
GUIs for input and control, and a refresh button.
Done.
SuperScheduler
Add a simple scheduler to the NJS.
Interface defined, buggy implementation integrated.
QuickTime™ and a
GIF decompressor
are needed to see this picture.
24 October 2003
15
Fujitsu Laboratories of Europe © 2003
Download