DAME: A Distributed Diagnostics Environment for Maintenance Duncan Russell University of Leeds Project Partners • EPSRC Funded, 3 years, £3.2 million. Ends Dec ‘04 • 4 Universities: – University of Leeds, School of Computing and School of Mechanical Engineering – University of Oxford, Dept of Engineering Science – University of Sheffield, Dept of Automatic Control and Systems Engineering – University of York, Dept of Computer Science • Industrial Partners: – Rolls-Royce – Data Systems and Solutions – Cybula Ltd Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds Operational Scenario Engine flight data London Airport Airline office New York Airport Grid Diagnostics Centre Maintenance Centre American data center European data center Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds DAME Grid Challenges • • • Building a demonstration system to demonstrate proof of concept for Grid technology in the aerospace diagnostic domain Two primary Grid challenges: – Management of large, distributed and heterogeneous data repositories – Remote, secure access to diagnostics tools, flight data and other operational data Other key issues: – Rapid data mining and analysis of fault data • York AURA technology is critical component for data mining activity – Management of distributed users and resources – 24/7 operation – QoS issues Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds DAME Architectural Overview DAME Diagnostics Portal Modelling/ Simulation Grid Services Management Case Based Reasoning ... Decision Support QUOTE Novel Data The Grid 100111011011 Vibration Shaft Speed Fuel Flow Software AURA Hardware AURA Cluster AURA Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds Parts Data Operational Data AURA Service Data Aura-G Raw Engine Data Matches WRG Distribution Sheffield York Modeling & Decision Support Data Mining Services EngineModel-G AURA-G GT3 Service Zmod data search facility Zmod Viewer GT3 Service Browser based data viewer for zmod files DAME GUI GT3 Service Browser based GUI to DAME services DataStore-G GT3 Service Simulates arrival & storage of QUOTE data AURA-G Database GT3 Service BD25 Engine model wrapped as Grid Service WRG GT3/2 CBRAnalysis-G GT3 Service CBR advisor SDM Database Collaboration tools GT3 Service Toolset for multiuser collaboration WRG GT3/2 DAME workbench Leeds Grid Middleware Services WRG GT3/2 Oxford Engine Data Store Engine Data Database Workflow WRG GT3/2 DAME WRG Sign-on Portal Security GT3 Security Service ProxyManagement Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds Browser based workflow tool. Compliant with Resource Broker DataVisualiser GT3 Service Jchart Viewer for viewing XTO output XTO-G GT3 Service XTO plug-ins via a Grid Service Resource Broker GT2 Service Schedule workflow tasks on WRG resource Complex Virtual Organisation Engine Manufacturer (RR) Airline / Maintenance Contractor (at Airport) Information / request for advice Dowload Engine Data Investigate using tools Perform Minor Repair Local Diagnosis Domain Expert (DE) - engine expert Remote / Distributed Tools and Services Upload Engine Data Ground Support System Update Engine Records Distributed Aircraft Maintenance Environment (DAME) - Miscellaneous Providers. DAME Diagnosis Engine Data Center (EDC) - DS&S Service Data Manager (SDM) - RR Request advice from MA Maintenance Engineer (ME) Provide Diagnosis / Prognosis / Advice Investigate using tools Update Engine Record Remove engine and dispatch for major overhaul Request advice from DE Return overhauled engine to service Information / request for advice Provide Diagnosis / Prognosis / Advice Update Engine Record Update Engine Records Maintenance Analyst (MA) - maintenance expert Data Center (DS&S) Engine Maintenance Repair and Overhaul (MRO) Facility (RR / Contractor) Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds Specifying Workflow Workflow instances are specified through UML sequence diagrams. AURA-G and CBR-G Grid Services can be directly accessed by the M aintenance Analyst as necesary - without using the RunDetailedDiagnosisPrognoisis workflow Parmeters may be provided by the M aintenance Analyst to tune the operation. The W orkflowManager-G The CBRW orkflowAdvisorG The AURA-G The M aintenance Analyst RunDetailedDiagnosisPrognosisW orkflow() AdviseOnW orkFlow() Search() SearchForMatchingCaseAndRankResults() Detailed Diagnosis / Prognosis Result This is an interchangeable sub workflow. Also the M aintenance Analyst will be able to select the parameters used in these calls from the W orkflow Manager. Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds Specifying Workflow Business workflows as Activity Diagrams Airp ort DS&S Main te na nce En gi ne er Rolls Royce Maintenance Analys t (Fleet Manager) Dom ain Expert Airc ra ft Lan ds Vis ua l Ins pection Quote Diagnos is DAME Brief D iag nos is Check Diagnos es [ unknown ] [ diagnos is ] Analys is [ fault unres olved ] [ Clear ] [ known ] Provide Info rm a tio n Reques t Inform ation [ inform ation required ] [ unk nown ] Detailed Analys is [ diagnos is ] Mai nte na nc e Pr oced ur e [ info rm atio n r equired ] Pr ovid e Furth er Details Releas e Engine [ fault res olved ] Sign-off Diagnos is Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds Reques t Further Details Workflow Requirements • Diagnostic Workflows – Automatic; initiated by novel event being detected – Manual; launched by engineer through diagnosis workbench • Manage provenance data for diagnosis ‘cases’ • Management of secure services – Role management – Certificate handling • Business Workflows – Job Assignment and Tracking Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds Workflow System • Components for the workflow system have been identified: – Workflow Manager; runs workflow instantiations – Workflow Generator; creates and manages workflows – Workflow Advisor; advisory system providing domain knowledge on how to deploy workflows Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds DAME Services & Workflow Architecture EngineDataStore-G QUOTE / GSS +constructor() +Initialise() +StoreDataRecord() +RetrieveDataRecord() +Copy() XTO-G WorkflowManager-G Maintenance Engineer Decision Support Portal CollaborativeWorkingEnvironment +View() +Control() +constructor() +Initialise() +RunBriefDiagnosisPrognosisWorkflow() +RunDetailedDiagnosisPrognosisWorkflow() +RunDetailedAnalysisWorkflow() +InstallNewWorkflow() +DeleteExistingWorkflow() +RunAndDebugWorkflow() +RenameWorkflow() +ReplaceExistingWorkflow() +Copy() +RunPerformClusterSearch() +constructor() +Initialise() +XTO() +JChart() +Copy() +InstallNewAlgorithm() +RunAndDebugAlgorithm() AURA-G +constructor() +Initialise() +Store() +Remove() +Search() Workflow Subsystem SDM-G +SDMSource() +getEventData() +getEventItem() +getEventAircraft() +getEventEngine() +getEventFromSerialDate() DataBaseMiner-G WorkflowGenerator-G Maintenance Analyst +constructor() +Initialise() +CreateNewWorkflow() +EditExistingWorkflow() +AddWorkflowElement() +EditWorkflowElement() +SaveWorkflow() +GetWorkflow() +Copy() XTOOutputDataVisualiser-G +constructor() +Initialise() +Visualise() +Copy() CBRWorkflowAdvisor-G Domain Expert +constructor() +Initialise() +AdviseOnWorkFlow() +StoreNewCaseInCBRCasebase() +UpdateExistingCaseInCBRCasebase() +Copy() CBRAnalysis-G EngineModel-G +constructor() +Initialise() +ModelEnginePerformance() +Copy() Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds +constructor() +Initialise() +SearchForMatchingCaseAndRankResults() +StoreNewCaseInCBRCasebase() +UpdateExistingCaseInCBRCasebase() +Copy() Current Progress • Workflow Manager has been implemented – Workflows captured as Java classes – Workflow enactment via apache server hosted at the DAME portal – Workflow Manager handles secure authorisation through management of X509 certificates Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds Workflow Implementation Browser Portal Role Database MyProxy Server Event Generator Engine Data Store Workflow Credential Workflow Manager SDM to XTO XTO Aura-G CBR Broker Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds Engine Model Workflow Implementation StoreEngi neData( ) : Ground Support System : Engi neDataStore : Port al NewEngi neData(param s) GetEngineData( ) : Mai ntenance Engineer : EventAgent getResul ts(workfl owId) runWorkfl ow(exi stingConnecti on, workflowNam e, param s) getStatus(workflowId) : Mai ntenance Analy st notifyChange(WorkflowId, param s) runWorkflow (workflo wNam e, rol e, param s) noti fy(workfl owId) : Portal Co nnecti on getStatus(workfl owId) getResults(workflowId) : Workli st : Workfl owM anager getResul ts(workfl owId) getStatus(workflowId) runWorkfl ow(workfl owNam e, rol e, param s) : Dom ain Expert propert yC hange(propertyChangeEvent ) getStatus( ) getResults( ) XT OJob : Xto createWorkflow(workflowNam e, rol e, cred, param s) attachWork(newW ork) Resource Broker : WorkflowFactory : WorkflowBri efDi agnosis setId(workfl owId) setRol e(rol e) execute( ) execute( ) Workfl ow System Boundary : RunCBR Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds Future Work • Workflow Generator – – – – Dynamic Workflow Generation Means to edit/adapt workflows Means to visualise workflows Would like to adopt existing e-Science technology • Development of Workflow Advisor – Case Based Reasoning system – Uses workflow provenance to build diagnosis case histories and capture domain knowledge • Richer Security models – Authorisation across computing domains – Finer grain definition of role and access rights. – Dynamic control of virtual organisations Duncan Russell, Informatics Research Institute, School of Computing, University of Leeds