QuickTime™ and a GIF decompressor are needed to see this picture. GRID Interoperability: Beyond OGSI Dr. David Snelling Fujitsu Laboratories of Europe d.snelling@fle.fujitsu.com UK/Japan N by N Meeting October 3, 2003 24 October 2003 Fujitsu Laboratories of Europe © 2003 The Grid is Great, but ... What is it? Some People say -> Not this -> QuickTime™ and a GIF decompressor are needed to see this picture. 24 October 2003 2 Fujitsu Laboratories of Europe © 2003 What the Grid is! “Distributed computing across multiple administrative domains.” Distributed computing covers a lot. The rest makes it interesting, as if distributed computing wasn’t. Something that still needs defining! When were you last asked, “What is the Web?” Roadmap Relationship of OGSI to OGSA OGSA Process Beyond OGSA QuickTime™ and a GIF decompressor are needed to see this picture. 24 October 2003 3 Fujitsu Laboratories of Europe © 2003 What OGSI Means OGSI has been Published “Open Grid Services Infrastructure” Additional functionality on top of Web Services. Global Grid Forum “Proposed Recommendation” status That means we’re done, doesn’t it? We all implement to OGSI and it all works, right? Well, yes and no! Three Questions: Is OGSI the whole story? Can all OGSI implementations really talk to each other? What Next? QuickTime™ and a GIF decompressor are needed to see this picture. 24 October 2003 4 Fujitsu Laboratories of Europe © 2003 What OGSA is Open Grid Service Architecture OGSA build-outS&TC e-business Common GUI OGSA Autonomic Management Services Common Install Config Deployment Maintenance Dynamic Disaster Automation Provisioning Recovery Data Access / Replication Avaki OGSA Meta-OS Services Security Policy This bit is OGSI! OGSA Grid Middleware ServicesGlobus Platform Problem Determination Entropia... OGSA Domain Svcs. Logs Clustering Service Collections OGSA Infrastructure Discovery Lifecycle .Net Platform Uniq 24 October 2003 Resource Instrumentation / Metering etc. New classes of applications and Grid's End-Users and Admin Staff Workload Management Cluster Management xSP z/OS AIX zSeries pSeries Registry Manageability (serviceData+) Factory HandleMap Notification JBOS OS/400 Linux Windows Storage iSeries z,p,i,xSeries xSeries Shark Solaris Linux Storage & Windows Network HP/UX Sun & HP Dell Compaq ... Cisco Nortel ... The rest is work in progress. Veritas ... QuickTime™ and a GIF decompressor are needed to see this picture. 5 Fujitsu Laboratories of Europe © 2003 OGSA Roadmap What are we doing about it? GGF OGSA Working Group A Framework for Other Working Groups CMM, DAIS, OREP, OGSA-SEC, OGSA-Auth, GESA, JSDL, ... The OGSA “Brand” Usage: OGSA-Climate Model Reference the Open Grid Services Architecture Fit into the architecture QuickTime™ and a GIF decompressor are needed to see this picture. 24 October 2003 6 Fujitsu Laboratories of Europe © 2003 Open Grid Services Architecture Domain-specific services Service taxonomy (user’s view) Program Data Core services Service hierarchy (provider’s view) OGSA Services 90% of Recent e-mails from industry Platform Services VOs CMM Acc. Agree. OGSI Slide courtesy of Fred Maciel, Hitachi QuickTime™ and a GIF decompressor are needed to see this picture. 24 October 2003 7 Fujitsu Laboratories of Europe © 2003 Beyond OGSA Assume all of OGSA exists. OGSA Platform: OGSI, CMM, Agreement, ... OGSA Services: Registries, VO Services, Metering & Accounting, Deployment & Provisioning, ... What else needs to be done? Interoperability Extension and Composition QuickTime™ and a GIF decompressor are needed to see this picture. 24 October 2003 8 Fujitsu Laboratories of Europe © 2003 Multiple Interoperability Levels OGSI Pushes the Web Services Envelope Extensibility Elements (Opaque) Extensions to WSDL 1.1 Current Definition of Interoperable “It works with GT3.” OGSA OGSI Web Services SOAP http(s) IP 24 October 2003 9 ⇐ Domain specific work to do here ⇐ No problems here (Well I would have to say that)! ⇐ Adapting OGSI extensions (GWSDL) ⇐ Encoding of data types ⇐ OK, but alternative protocols needed for performance ⇐ No Problems here Fujitsu Laboratories of Europe © 2003 QuickTime™ and a GIF decompressor are needed to see this picture. Composition & Extension On top of OGSA Application Workflow etc. Services On top of OGSI This OGSA Parallel to OGSI WS-Security, etc. Binding Underneath OGSI OGSA OGSI Web Services SOAP http(s) IP Binding level needs to be invisible at WS level. But where does the binding start? E.g. MIME Encoded Attachments A Choice to Think About Live with two communication protocols Break the rules about the WS binding layer QuickTime™ and a GIF decompressor are needed to see this picture. 24 October 2003 10 Fujitsu Laboratories of Europe © 2003 Roadmap Revisited Hype OGSA Invisible Grid GT2/Unicore Next Generation Grids The Last Grid Time Have you ever noticed “Mile Stones” look like “Grave Stones”? R.I.P. QuickTime™ and a GIF decompressor are needed to see this picture. 24 October 2003 11 Fujitsu Laboratories of Europe © 2003 NaReGI Project National Research Grid Initiative R&D Project Funded by MEXT 2003 to 2007 ~17M$ budget in FY2003 GRID Technology for Nano-Science Unicore as Initial Grid Infrastructure A new use of Unicore. Training Session in Japan QuickTime™ and a TIFF (Uncompressed) decompressor are needed to see this picture. Two days formal sessions Two days “open” project labs. QuickTime™ and a GIF decompressor are needed to see this picture. 24 October 2003 12 Fujitsu Laboratories of Europe © 2003 Project Overview Broker Deploy and test the Manchester Broker Done, but needed the old version of the client. Condor Build and test a Condor TSI. Done, for basic job invocation, job control next. NJS Load Monitor Build a plugin to monitor load (# of jobs) on NJSs. Done 2.5 times QuickTime™ and a GIF decompressor are needed to see this picture. 24 October 2003 13 Fujitsu Laboratories of Europe © 2003 Project Overview Continued RPC Build a Gateway extension for RPC. Basic implementation done. Visualization File streaming for visualization Too complicated to implement in time. PovRay Animations Extend PovRay to display animations. Two versions, at 99% QuickTime™ and a GIF decompressor are needed to see this picture. 24 October 2003 14 Fujitsu Laboratories of Europe © 2003 Project Overview Continued Boltzmann Wizard GUIs for input and control, and a refresh button. Done. SuperScheduler Add a simple scheduler to the NJS. Interface defined, buggy implementation integrated. QuickTime™ and a GIF decompressor are needed to see this picture. 24 October 2003 15 Fujitsu Laboratories of Europe © 2003