Distributed Diagnostics on the Grid: DAME Progress Report Professor Jim Austin/Tom Jackson University of York Project Partners EPSRC Funded, £3.2 Million, 3 years, commenced Jan 2002. UK pilot project for e-Science 4 Universities: – University of York, Dept of Computer Science – University of Sheffield, Dept of Automatic Control and Systems Engineering – University of Oxford, Dept of Engineering Science – University of Leeds, School of Computing and School of Mechanical Engineering Industrial Partners: – Rolls-Royce – Data Systems and Solutions – Cybula Ltd Distributed Aircraft Maintenance Environment - DAME Operational Scenario Engine flight data London Airport Airline office New York Airport Grid Diagnostics Centre Maintenance Centre American data center European data center Distributed Aircraft Maintenance Environment - DAME DAME Grid Challenges Building a demonstration system as proof of concept for Grid technology in the aerospace diagnostic domain. Two primary Grid challenges: – Management of large, distributed and heterogeneous data repositories; – Rapid data mining and analysis of fault data; Other key (commercial) issues: – Remote, secure access to flight data and other operational data and resources; – Management of distributed users and resources; – Quality of Service issues (and Service Level Agreements) Distributed Aircraft Maintenance Environment - DAME Progress March 2004 Mid term demo completed Aug 2003. Main thrust since then has been to: – – – – – – Develop services Develop data and services infrastructure Work on Dependability and Security System middleware – SLA, workflow engine Publish papers! Gain acceptance of commercial users in technology Distributed Aircraft Maintenance Environment - DAME Demonstrator Fully operational system on the WRG – Demonstrated the basic system architecture and main services Maintenance Engineer Maintenance Analyst Toolbench Distributed Aircraft Maintenance Environment - DAME Services – Data Management and Search Data management and searching is the main challenge within DAME – Main aim is to manage >1Tb per year of Aero Engine vibration and maintenance data. – A data architecture has been defined based on Globus and SRB. – Interlinks with search and reasoning services. Distributed Aircraft Maintenance Environment - DAME DAME Data Architecture Distributed Aircraft Maintenance Environment - DAME Service - Engine Data Explorer EDE Data visualisation and search control • Need to allow users to view and search data • Built on top of the York/Cybula AURA technology • Directs search via the DAME data architecture Distributed Aircraft Maintenance Environment - DAME Services – Engine Data Explorer Distributed Aircraft Maintenance Environment - DAME Services – Engine model The engine simulation • Aims to model correct engine operation. As Grid services: • GSI enabled secure engine performance simulation • a number simulation instances generated by the factory service; different engine simulation can be performed simultaneously • Only lightweight computers or PDAs are needed to perform the engine simulation, while still benefit from highperformance/high-throughput computing power provided by the Grid Distributed Aircraft Maintenance Environment - DAME Services – Engine model Distributed Aircraft Maintenance Environment - DAME Services – Case Based Reasoning CBR Maintenance Advisor Service • Integrates fault information and knowledge gained from fault diagnosis process • Advises maintenance personnel on appropriate maintenance action • Deployed as a Grid service on the Grid • Accessible by user via a web browser across the Internet • Secure access with X.509 user and host authentication, SSL encryption. Distributed Aircraft Maintenance Environment - DAME Services - CBR Distributed Aircraft Maintenance Environment - DAME Services – Workflow advisor Workflow advisor • Provides workflow advice and workflow scripts for diagnosing faults based on case history of DAME usage; • Captures ‘domain expert’ knowledge and offers knowledgebased search across complex workflow information; • Integrated with CBR system; • Builds on the research work on provenance data Distributed Aircraft Maintenance Environment - DAME Services – Workflow advisor Interaction Maintenance Engineers Domain Experts DAME System Observation Workflow Observer Trace generation Automated Workflow Advisory Direct Workflow Advisory Workflow Advisor Primitive Trace TR-TR-TR-... Process Analyser Process extraction Process reuse Workflow Processes Process-1 Process-2 … Process-n Distributed Aircraft Maintenance Environment - DAME DAME Provenance Architecture Provenance Database Provenance Viewer Workflow Advisor Workflow Definition (BPEL) Workflow Script Workflow Manager Workflow Instance Workflow Instance Workflow Instance Workflow Instance Workflow Instance Service Instance Distributed Aircraft Maintenance Environment - DAME Services – XTO advisor • Grid based deployment of the vibration analysis algorithms • Provides – Opportunity for finer grain analysis; – More powerful algorithms; – Testing environment for development of new algorithms; • Working on integration of more complex algorithms for engine modelling based on fusion of performance and vibration data. Distributed Aircraft Maintenance Environment - DAME Services – XTO advisor Distributed Aircraft Maintenance Environment - DAME Middleware – Work flow Manager Management of services • Services are managed at the portal via a Workflow Engine • Workflow Engine provides management of manual and automated workflows. • Also handles certification and role management Distributed Aircraft Maintenance Environment - DAME Middleware – Work flow Manager Browser Portal Role Database MyProxy Server Event Generator Engine Data Store Workflow Credential Workflow Manager SDM to XTO XTO Aura-G CBR Engine Model Broker Distributed Aircraft Maintenance Environment - DAME Middleware – Brokerage & SLA Brokerage system is used for job allocation on available Grid resource • Due to commercial application domain, broker should also demonstrate capability to manage QoS issues, and specifically Service Level Agreements (SLA’s) • Integrates with GGF Grid Economic Architecture Distributed Aircraft Maintenance Environment - DAME Dependability and Security Contribute to the GRID community dependability and security studies, where possible. • Provide dependability and security analysis to support the ultimate deployment of DAME as a working engine diagnosis environment. • If possible, provide a basis (identify good practices) for dependability and security analysis for the deployment of DAME as a working diagnosis environment for other domains e.g. medical. • Dependability analysis has meant need for business process analysis, asset identification, risk identification. Distributed Aircraft Maintenance Environment - DAME Commercial take-up • Rolls-Royce evaluating DAME system in Engine Pass off testing. • DS&S and Cybula starting to develop markets for EDE system and data management system. Distributed Aircraft Maintenance Environment - DAME Final Demonstrator • Final demonstrator will act as a more explicit vehicle for demonstration of core research activities; – – – – – – Distributed Data Management and SRB Job brokerage Time-series pattern matching and data-mining QoS and SLA’s Security management Workflow capture and provenance systems • Will drive studies on business case for commercial deployment of the DAME system; Distributed Aircraft Maintenance Environment - DAME Paul Anuzis (RR) Georges Honoré (L) Haydn Thompson (S) Peter Cowley (RR) Alison McKay (L) Rob Davis (Y) Graham Hesketh (RR) Sarfraz Nadeem (L) Martyn Fletcher (Y) Jack Crawford (RR) Paul Hayton (O) Tom Jackson (Y) Charlie Dibsdale (DS&S) Lionel Tarassenko (O) Mark Jessop (Y) Paul Irving (DS&S) Simukai Utete (O) Julian Young (Y) Peter Lobner (DS&S) Jeff Allan (S) Bojian Liang (Y) Richard Bagshaw (L) Peter Fleming (S) John McDermid (Y) Pete Dawson (L) V. Kadirkamanathan (S) Andy Wellings (Y) Peter Dew (L) Max Ong (S) Andy Pasley (Y) Karim Djemame (L) Xiaoxu Ren (S) + PhDs…. Iain Gourlay (L) Vernon Bailey (O) Thanks! Distributed Aircraft Maintenance Environment - DAME