UK Role in Open Grid Services Architecture Towards an Architectural Road Map Malcolm Atkinson Director of NeSC 18th April 2002 Outline Background — What is OGSA? The Confluence of Web Services & Grid Presented already by Ian Foster The UK Architectural Task Force Why Engage with OGSA What should the UK do Web Services Grid Technology Grid Services UK ATF Malcolm Atkinson Jon Crowcroft David De Roure Vijay Dialani Andrew Herbert Ian Leslie Ken Moody Steven Newhouse Tony Storey …………… Plus consultations UK Role in Open Grid Services Architecture, Version 0.6 11th March 2002 www.nesc.ac.uk teams ATF Why Change? Ambition Data Challenge Deluge of Data Fire fighting safety Do it for everything Eruption, Flood & Pollution Response •More, Faster Digital Streams Diagnosis & Treatment Planning •Heterogeneous evolving models Whole population health monitoring it quickly Epidemic Detection & Management •UncertaintyDo about data quality Change it often Understanding Cells & Organs In Flight problem management Finding the Nuggets Oceans, Climate, Ecosystems, … Reason to Trust theDoAnswer it often Software Challenge Dependability Challenge Geographic Distribution Composing Software •Encapsulating understanding Keep it running •Multiple technologies •Heterogeneous evolving models •Uncertainty about component quality Solving a Problem Reason to Trust the Answer An Answer in Time •scientists, resources & instruments •Diverse: Organisations & Countries Pay for it people & phenomena •Mobile: equipment, •Uncertainty about communication quality Sustaining Run it for everyone the Computation •Problem Detection & Recovery, Security, … Reason to Trust System Dependability Affordable Why Change? Ambition Fire fighting safety Eruption, Flood & Pollution Response Diagnosis & Treatment Planning Whole population health monitoring Epidemic Detection & Management Understanding Cells & Organs In Flight problem management Oceans, Climate, Ecosystems, … Data Challenge Deluge Data Best ofofBoth Worlds Description Driven Dynamic Integration (WS) •More, Faster Digital Streams Automated Generation of Code (WS) •Heterogeneous Security (Grid & WS)evolving models Resource Discovery (WS & Grid) •Uncertainty about data quality High-level Platform (WS & Grid) Tools (WS) Finding the&Nuggets Distribution Heterogeneity (WS & Grid) … Reason to Trust the Answer Software Challenge Composing Software •Encapsulating understanding •Multiple technologies •Heterogeneous evolving models •Uncertainty about component quality Solving a Problem Reason to Trust the Answer An Answer in Time Dependability Challenge Geographic Distribution •scientists, resources & instruments •Diverse: Organisations & Countries •Mobile: equipment, people & phenomena •Uncertainty about communication quality Sustaining the Computation •Problem Detection & Recovery, Security, … Reason to Trust System Dependability Affordable Why Change? Ambition Dominant Data: Fire fighting safetyCommon Needs Metadata Eruption, & Discovery Flood & Pollution Response Grid Diagnosis Data Management & Treatment(Giggle) Planning Grid Whole FTPpopulation health monitoring Databases Epidemic &Detection Transactions & Management (WS) Distributed Understanding Data Mining Cells & Organs Information In Flight problem Management management Knowledge Oceans, Climate, Management Ecosystems, … Data Challenge Deluge of Data •More, Faster Digital Streams •Heterogeneous evolving models •Uncertainty about data quality Finding the Nuggets Reason to Trust the Answer Software Challenge Composing Software •Encapsulating understanding •Multiple technologies •Heterogeneous evolving models •Uncertainty about component quality Solving a Problem Reason to Trust the Answer An Answer in Time Dependability Challenge Geographic Distribution •scientists, resources & instruments •Diverse: Organisations & Countries •Mobile: equipment, people & phenomena •Uncertainty about communication quality Sustaining the Computation •Problem Detection & Recovery, Security, … Reason to Trust System Dependability Affordable Why Change? Ambition FireCommon fighting safety Issues Eruption, Flood & Pollution Response Diagnosis & Treatment Planning Grid Protocolshealth & Services Whole population monitoring SOAPDetection multiple mappings Epidemic & Management Grid Monitoring & Organs Management Understanding Cells & Security (WS & Grid) In Flight problem management … Climate, Ecosystems, … Oceans, New Opportunity Data Challenge Deluge of Data •More, Faster Digital Streams •Heterogeneous evolving models •Uncertainty about data quality Finding the Nuggets Reason to Trust the Answer Software Challenge Composing Software •Encapsulating understanding •Multiple technologies •Heterogeneous evolving models •Uncertainty about component quality Solving a Problem Reason to Trust the Answer An Answer in Time Dependability Challenge Geographic Distribution •scientists, resources & instruments •Diverse: Organisations & Countries •Mobile: equipment, people & phenomena •Uncertainty about communication quality Sustaining the Computation •Problem Detection & Recovery, Security, … Reason to Trust System Dependability Affordable UK Focus: Data Knowledge The Picture from Space Phase 1: Foundations & Planning GGF Collaboration on OGSA Design & Prototyping Requirements, Education & Consultation Common Infrastructure Baseline DB Access & Integration Validation & Testing Baseline Logging Infrastructure Trustable Services Performance Engineering Dependable Engineering Design for Testability Engineering for Change Management & Ops Support Privacy, Ethics & Legal Phase 2: Automation & Information Refining & Exploiting Description Languages Data Information Semantic Grid Advanced DB Integration Scheduling for Data Intensive Computation Computational Grid Economies Project Transitions GT3 Testers Early Adopters GT2 Demo at GGF Specification & Motivation Now Q2 2002 Q3 Q4 Q1 Q2 Q3 2003 Q4 Building OGSA Capability GT3 Testers Early Adopters www.epcc.ed.ac.uk~neilc/gsiws/ GT2 Early DB Integration Advanced Integration Components GSI + WS components Architecture Road Map &Review Advisory Documents Requirements & Consultation Demo at GGF Specification & Motivation Now Semantic Grid Components Grid economy infrastructure New Core M/W Projects Alpha GT3 Q2 2002 Q3 Beta GT3 Q4 Q1 Production GT3 Q2 Q3 2003 Q4 The First Steps Advanced Information Handling Semantics of WS Description Languages www.epcc.ed.ac.uk~neilc/gsiws/ Logging & Monitoring Beta release to selected projects Demo., Design & Review Grid DB Access Services Infrastructure: GS APIs, Types & Primitives Web Services & GSI & Axis Trials: Grid DB Access Services Requirements & Standards Trials of Web Services & GSI & Axis Pilot Project & Community Consultation Best available platform from industry & Globus What does it mean? More Description What it does How it delivers Security Coordination … More Support Late dynamic binding Context adaptation Tools & Automation Visualisations Autonomic infrastructure … Increased Flexibility Industrial Forces Supported technology Political force Immovable force? Standards … Extensive Families Type systems & Schema Composable Services Standards requirement … Changes The way we share The way we think Higher-level Discourse ?