LEAD Project Discussion Presented by: Emma Buneci for CPS 296.2: Self-Managing Systems Source for many slides: Kelvin Droegemeier, Year 2 site visit presentation. Mesoscale Weather 2 What Weather & IT Today Do … 3 Radars Do Not Adaptively Scan 4 5 6 7 8 9 The Case for Dynamic Adaptation 1. Adaptation in Time 2. Adaptation in Space 3. Ensemble Forecasting 4. Adaptive Observing Systems 5. Adaptive Cyber-infrastructure 6. Managing Forecast and Simulation Process 10 Adaptation in Time 11 Adaptation in Space 12 Ensemble Forecasting 13 Adaptive Observing Systems 14 Adaptive Cyberinfrastructure 15 Managing the Forecast & Simulation Process • Current State: 50,000 lines of Perl code. • In Progress: LEAD Workflow Environment 16 17 18 LEAD Service Oriented Architecture Desktop Applications • IDV • WRF Configuration GUI User Interface LEAD Portal Architecture? Why A Service-Oriented Crosscutting Services Education Workflow Visualization • Flexible and malleable • Platform independence (emphasis on protocols, not platforms) • Loose integration via modularity • Evolvable and re-usable (e.g. Java) • Interoperable by use of standards Resource Access robustness Services Portlets MyLEAD Query Ontology Control Browse Monitor Control Application & Configuration Services Workflow Engine/Factories Host Environment Application Host GPIR Workflow Services Workflow Monitor Execution Description VO Catalog Application Description Geo-Reference GUI WRF, ADaM, IDV, ADAS THREDDS Stream Service Control Service Query Service Ontology Service Decoder/ Resolver Service Transcoder Service/ ESML Data Services Authentication Application Resource Broker (Scheduler) Catalog Services Authorization Configuration and Execution Services Client Interface Monitoring Grid FTP GRAM Scheduler SSH OPenDAP LDM Generic Ingest Service RLS OGSADAI Notification Distributed Resources Source: LEAD Team Computation Observations • Streams • Static • Archived Specialized Applications Steerable Instruments Data Bases Storage 19 20 21 22 23 Some Discussion Points • Complexity of the infrastructure to support LEAD – Lesson learned: viable solution where small number of services are persistent; remaining are on-demand • Challenges for the system administrators – Large scale networks, supercomputers; different for sys. Admins in industry setting? • What lessons from this experiment will apply to building similar infrastructures in other domains • Future impact of LEAD 24 25