QuickTime™ and a GIF decompressor are needed to see this picture. GRID Interoperability: Beyond OGSI Dr. David Snelling Fujitsu Laboratories of Europe d.snelling@fle.fujitsu.com UK/Japan N by N Meeting October 3, 2003 31 May 2016 Fujitsu Laboratories of Europe © 2003 The Grid is Great, but ... What is it? Some People say -> Not this -> QuickTime™ and a GIF decompressor are needed to see this picture. 31 May 2016 2 Fujitsu Laboratories of Europe © 2003 What the Grid is! “Distributed computing across multiple administrative domains.” Distributed computing covers a lot. The rest makes it interesting, as if distributed computing wasn’t. Something that still needs defining! When were you last asked, “What is the Web?” Roadmap Relationship of OGSI to OGSA OGSA Process Beyond OGSA QuickTime™ and a GIF decompressor are needed to see this picture. 31 May 2016 3 Fujitsu Laboratories of Europe © 2003 What OGSI Means OGSI has been Published “Open Grid Services Infrastructure” Additional functionality on top of Web Services. Global Grid Forum “Proposed Recommendation” status That means we’re done, doesn’t it? We all implement to OGSI and it all works, right? Well, yes and no! Three Questions: Is OGSI the whole story? Can all OGSI implementations really talk to each other? What Next? QuickTime™ and a GIF decompressor are needed to see this picture. 31 May 2016 4 Fujitsu Laboratories of Europe © 2003 What OGSA is Open Grid Service Architecture OGSA build-outS&TC e-business xSP etc. New classes of applications and Grid's End-Users and Admin Staff Common GUI OGSA Autonomic Management Services OGSA Grid Middleware Workload Dy namic Platf orm Disaster Automation ServicesGlobus Management Cluster Management Common Install Conf ig Deploy ment Maintenance Resource Instrumentation / Metering Prov isioning Recov ery Data Access / Replication Av aki Entropia... OGSA Meta-OS Services Security Policy Problem Determination Logs OGSA Domain Svcs. Clustering Serv ice Collections OGSA Infrastructure Discov ery Lif ecy cle .Net Registry Manageability (serviceData+) Factory zSeries AIX pSeries HandleMap Notif ication JBOS Solaris z/OS Platform Unique 31 May 2016 This bit is OGSI! OS/400 Linux & Window s Storage HP/UX iSeri es z,p,i ,xSeriesxSeries Shark Sun & HP Linux Storage Windows Netw ork Dell Cisco Compaq Nortel ... ... The rest is work in progress. Veritas ... QuickTime™ and a GIF decompressor are needed to see this picture. 5 Fujitsu Laboratories of Europe © 2003 OGSA Roadmap What are we doing about it? GGF OGSA Working Group A Framework for Other Working Groups CMM, DAIS, OREP, OGSA-SEC, OGSA-Auth, GESA, JSDL, ... The OGSA “Brand” Usage: OGSA-Climate Model Reference the Open Grid Services Architecture Fit into the architecture QuickTime™ and a GIF decompressor are needed to see this picture. 31 May 2016 6 Fujitsu Laboratories of Europe © 2003 Open Grid Services Architecture Domain-specific services Service taxonomy (user’s view) Program Data Core services Service hierarchy (provider’s view) OGSA Services 90% of Recent e-mails from industry Platform Services VOs CMM Acc. Agree. OGSI Slide courtesy of Fred Maciel, Hitachi QuickTime™ and a GIF decompressor are needed to see this picture. 31 May 2016 7 Fujitsu Laboratories of Europe © 2003 Beyond OGSA Assume all of OGSA exists. OGSA Platform: OGSI, CMM, Agreement, ... OGSA Services: Registries, VO Services, Metering & Accounting, Deployment & Provisioning, ... What else needs to be done? Interoperability Extension and Composition QuickTime™ and a GIF decompressor are needed to see this picture. 31 May 2016 8 Fujitsu Laboratories of Europe © 2003 Multiple Interoperability Levels OGSI Pushes the Web Services Envelope Extensibility Elements (Opaque) Extensions to WSDL 1.1 Current Definition of Interoperable “It works with GT3.” OGSA OGSI Web Services SOAP http(s) IP 31 May 2016 9 Domain specific work to do here No problems here (Well I would have to say that)! Adapting OGSI extensions (GWSDL) Encoding of data types OK, but alternative protocols needed for performance No Problems here Fujitsu Laboratories of Europe © 2003 QuickTime™ and a GIF decompressor are needed to see this picture. Composition & Extension On top of OGSA OGSA OGSI Application Workflow etc. Services On top of OGSI This OGSA Parallel to OGSI WS-Security, etc. Binding Web Services SOAP http(s) Underneath OGSI IP Binding level needs to be invisible at WS level. But where does the binding start? E.g. MIME Encoded Attachments A Choice to Think About Live with two communication protocols Break the rules about the WS binding layer QuickTime™ and a GIF decompressor are needed to see this picture. 31 May 2016 10 Fujitsu Laboratories of Europe © 2003 Roadmap Revisited Hype OGSA Invisible Grid GT2/Unicore Next Generation Grids The Last Grid Time Have you ever noticed “Mile Stones” look like “Grave Stones”? R.I.P. QuickTime™ and a GIF decompressor are needed to see this picture. 31 May 2016 11 Fujitsu Laboratories of Europe © 2003 NaReGI Project National Research Grid Initiative R&D Project Funded by MEXT 2003 to 2007 ~17M$ budget in FY2003 GRID Technology for Nano-Science Unicore as Initial Grid Infrastructure A new use of Unicore. Training Session in Japan Qu i ck Ti m e ™ an d a T IF F ( Un co m p re ss ed ) d ec om pr es so r a r e ne ed ed t o s ee th Two days formal sessions Two days “open” project labs. QuickTime™ and a GIF decompressor are needed to see this picture. 31 May 2016 12 Fujitsu Laboratories of Europe © 2003 Project Overview Broker Deploy and test the Manchester Broker Done, but needed the old version of the client. Condor Build and test a Condor TSI. Done, for basic job invocation, job control next. NJS Load Monitor Build a plugin to monitor load (# of jobs) on NJSs. Done 2.5 times QuickTime™ and a GIF decompressor are needed to see this picture. 31 May 2016 13 Fujitsu Laboratories of Europe © 2003 Project Overview Continued RPC Build a Gateway extension for RPC. Basic implementation done. Visualization File streaming for visualization Too complicated to implement in time. PovRay Animations Extend PovRay to display animations. Two versions, at 99% QuickTime™ and a GIF decompressor are needed to see this picture. 31 May 2016 14 Fujitsu Laboratories of Europe © 2003 Project Overview Continued Boltzmann Wizard GUIs for input and control, and a refresh button. Done. SuperScheduler Add a simple scheduler to the NJS. Interface defined, buggy implementation integrated. QuickTime™ and a GIF decompressor are needed to see this picture. 31 May 2016 15 Fujitsu Laboratories of Europe © 2003