UK Role in Open Grid Services Architecture Towards an Architectural Road Map A Report to the Technical Advisory Group from The Architecture Task Force Malcolm Atkinson Director of NeSC 15th April 2002 Outline Background — What is OGSA? The Confluence of Web Services & Grid Why Engage with OGSA What should the UK do How should we do it Web Services Grid Technology Grid Services Web Services Rapid Integration Dynamic binding Commercial Power Financial & Political Independence Client from Service Service from Client Separation Function from Delivery Description WSDL, WSC, WSEF, … Tools & Platforms Java ONE, Visual .NET WebSphere, Oracle, … www. w3c. org / TR / SOAP or TR/wsdl Grid Technology Virtual Organisations Sharing & Collaboration Security Single Sign in, delegation Distribution & fast FTP But Various Protocols Resource Mangement Discovery Process Creation Scheduling Monitoring Portability Ubiquitous APIs & Modules Gov’nm’t Agency Buy in Foster, I., Kesselman, C. and Tuecke, S., The Anatomy of the Grid: Enabling Virtual Organisations, Intl. J. Supercomputer Applications, 15(3), 2001 Open Grid Services Architecture Applications Using operations Virtual Grid Services Implemented by Multiple implementations of Grid Services OGS infrastructure Foster, I., Kesselman, C., Nick, J. and Tuecke, S., The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration OGSA Features WSDL + WSIL + WSEL + … Description Discovery Tools & Platforms Apache axis … Invocation SOAP RPC / RMI Optimised binding Representations XML + Schema Life Time Management Factories Transient & Persistent GS GS Handles GS Records Soft State Notification Authentication Certificates + Delegation Change Management Platform Foster, I., Kesselman, C., Nick, J. and Tuecke, S., The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration OGSA Development More Description More Languages Trustworthy services Owners, Costs & Charging Transaction & Coordination Work Flow Precision & Semantics Tools & Platforms Partial Models Varied, open, analysis, synthesis Directed composition Change Managers Invocation & Reps Standard Schemas Namespaces Engineering Factories Transient & Persistent GS GS Handles GS Records Soft State Notification Design for Testability Dynamic Testing Change Management Dynamic Evolution Platforms Mapping to host, invocation, notification, protocol transmission, authentication OGSA Development 2 Higher-Level Description Information-level Semantic-level Virtualisation Tools & Platforms Higher-level Models User-Guided Automation Invocation & Reps Agreed Semantic Models Trustworthy Translation Engineering Accessible Trade-offs Dynamic Control Autonomic Design for Q and Test Q Testing & Certification Change Management Dynamic Evolution Platforms Raising their level More high-level facilities Coherent Understandable Specified Why Change? Ambition Data Challenge Deluge of Data Fire fighting safety Do it for everything Eruption, Flood & Pollution Response •More, Faster Digital Streams Diagnosis & Treatment Planning •Heterogeneous evolving models Whole population health monitoring it quickly Epidemic Detection & Management •UncertaintyDo about data quality Change it often Understanding Cells & Organs In Flight problem management Finding the Nuggets Oceans, Climate, Ecosystems, … Reason to Trust theDoAnswer it often Software Challenge Dependability Challenge Geographic Distribution Composing Software •Encapsulating understanding Keep it running •Multiple technologies •Heterogeneous evolving models •Uncertainty about component quality Solving a Problem Reason to Trust the Answer An Answer in Time •scientists, resources & instruments •Diverse: Organisations & Countries Pay for it people & phenomena •Mobile: equipment, •Uncertainty about communication quality Sustaining Run it for everyone the Computation •Problem Detection & Recovery, Security, … Reason to Trust System Dependability Affordable Why Change? Ambition Fire fighting safetyDynamic Integration (WS) Description Driven AutomatedFlood Generation of Code (WS) Eruption, & Pollution Response Resource Discovery (WS &Planning Grid) Diagnosis & Treatment High-level Platform health (WS & Grid) Whole population monitoring Tools (WS) Epidemic Detection & Management Distribution & Heterogeneity (WS & Grid) Understanding Cells & Organs … In Flight problem management Oceans, Climate, Ecosystems, … Data Challenge Deluge of Data •More, Faster Digital Streams •Heterogeneous evolving models •Uncertainty about data quality Finding the Nuggets Reason to Trust the Answer Software Challenge Composing Software •Encapsulating understanding •Multiple technologies •Heterogeneous evolving models •Uncertainty about component quality Solving a Problem Reason to Trust the Answer An Answer in Time Dependability Challenge Geographic Distribution •scientists, resources & instruments •Diverse: Organisations & Countries •Mobile: equipment, people & phenomena •Uncertainty about communication quality Sustaining the Computation •Problem Detection & Recovery, Security, … Reason to Trust System Dependability Affordable Why Change? Ambition Fire fighting safety Eruption, Flood & Pollution Response Grid Data (Giggle) Diagnosis & Management Treatment Planning Grid FTP Whole population health monitoring Databases & Transactions (WS) Epidemic Detection & Management DataCells Mining Understanding & Organs Knowledge In Flight problemManagement management Oceans, Climate, Ecosystems, … Data Challenge Deluge of Data •More, Faster Digital Streams •Heterogeneous evolving models •Uncertainty about data quality Finding the Nuggets Reason to Trust the Answer Software Challenge Composing Software •Encapsulating understanding •Multiple technologies •Heterogeneous evolving models •Uncertainty about component quality Solving a Problem Reason to Trust the Answer An Answer in Time Dependability Challenge Geographic Distribution •scientists, resources & instruments •Diverse: Organisations & Countries •Mobile: equipment, people & phenomena •Uncertainty about communication quality Sustaining the Computation •Problem Detection & Recovery, Security, … Reason to Trust System Dependability Affordable Why Change? Ambition Fire fighting safety Eruption, Flood & Pollution Response Diagnosis & Treatment Planning Grid Protocols & Services Whole population health monitoring SOAP multiple mappings Epidemic Detection & Management Grid Monitoring & Organs Management Understanding Cells & Security (WS & Grid) In Flight problem management Oceans, Climate, Ecosystems, … Data Challenge Deluge of Data •More, Faster Digital Streams •Heterogeneous evolving models •Uncertainty about data quality Finding the Nuggets Reason to Trust the Answer Software Challenge Composing Software •Encapsulating understanding •Multiple technologies •Heterogeneous evolving models •Uncertainty about component quality Solving a Problem Reason to Trust the Answer An Answer in Time Dependability Challenge Geographic Distribution •scientists, resources & instruments •Diverse: Organisations & Countries •Mobile: equipment, people & phenomena •Uncertainty about communication quality Sustaining the Computation •Problem Detection & Recovery, Security, … Reason to Trust System Dependability Affordable UK Focus: Data Knowledge The Picture from Space Phase 1: Foundations & Planning GGF Collaboration on OGSA Design & Prototyping Common Infrastructure Education & Consultation Baseline DB Access & Integration Validation & Testing Baseline Logging Infrastructure Trustable Services Performance Engineering Dependable Engineering Design for Testability Engineering for Change Management & Ops Support Privacy, Ethics & Legal Phase 2: Automation & Information Refining & Exploiting Description Languages Data Information Semantic Grid Advanced DB Integration Scheduling for Data Intensive Computation Computational Grid Economies The First Steps Advanced Information Handling Semantics of WS Description Languages Logging & Monitoring Beta release to selected projects Demo., Design & Review Grid DB Access Services Infrastructure: GS APIs, Types & Primitives Web Services & GSI & Axis Trials: Grid DB Access Services Requirements & Standards Trials of Web Services & GSI & Axis Pilot Project & Community Consultation Best available platform from industry & Globus Project Transitions GT3 GT2 Now Q2 2002 Q3 Q4 Q1 Q2 Q3 2003 Q4 ?