IBM Involvement in UK eScience Grid Projects Dr Brian M Collins
advertisement
UCISA IBM Involvement in UK eScience Grid Projects Dr Brian M Collins Grid Project Manager and Consulting IT Specialist IBM Involvement in UK eScience Projects | 23/10/03 | UCISA © 2003 IBM Corporation UCISA IBM UK Grid Projects § European Union 5th Framework EDG - European Data Grid § UK eScience gViz – Scientific Virtual Reality MyGrid - Biology Combi-Chem OGSA-DAI (Open Grid Services Architecture – Data Access and Integration) eDiaMoND (UK Digital Mammography National Database) § Some Observations 2 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA OGSA-DAI Open Grid Services Architecture – Data Access and Integration IBM Involvement in UK eScience Projects | 23/10/03 | UCISA © 2003 IBM Corporation UCISA OGSA-DAI from 10000 Feet Data Resources As Grid Services XMLDB RDBMS Grid Service Volatile Memory The “Grid” Grid Service Grid Service Grid Service File System Grid Service Experimental Equipment 4 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA The OGSA-DAI Project § Joint funded by UK eScience and industry IBM, Oracle § Project team members drawn from commercial and noncommercial organizations Universities of Edinburgh, Manchester and Newcastle § Two parts to the project DAIS – contribution to the GGF standardization effort OGSA-DAI Implementation – An implementation that is tracking the DAIS specification work § Project runs until July 2003 OGSA-DAI implementation will support DB2, Oracle, MySQL and Xindice in the first instance 5 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA OGSA-DAI and Globus Toolkit 3 HTTP Server HTTP 6 Axis Globus Toolkit 3 Client Grid Service Stub Web Application Server OGSA-DAI DBMS IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA eDiaMoND Digital Mammography National Database IBM Involvement in UK eScience Projects | 23/10/03 | UCISA © 2003 IBM Corporation UCISA eDiaMoND – Collaborators 8 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA eDiaMoND – Sponsors & Customer University Relations Life Sciences Worldwide Grid Hardware, Software and People Skills eDiaMoND eDiaMoND Breast Screening Programmes People Skills Engineering and Physical Sciences Research Council Medical Research Council 9 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA eDiaMoND – Project Deliverables Prototype Prototype (end-2003) (end-2003) eDiaMoND eDiaMoND Prototype Prototype (mid-2004) (mid-2004) BluePrint BluePrint Production Production (Next (NextPhase) Phase) • Grid Infrastructure Breast Screening Programmes • Grid-connected Workstation • Database for Storage & Retrieval of Images & Metadata • Computation for CADe, CADi and Statistical Analyses • Required Hardware, Software & Network for given Service Levels 10 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA UK Breast Screening – Today Paper Film 1,300,000 - Screened in 2001-02 65,000 - Recalled for Assessment 8,545 – Cancers detected 300 - Lives per year Saved 230 - Radiologists (Double Reading) Began in 1988 Women 50-64 Screened Every 3 Years 1 View/Breast ~100 Breast Screening Programmes - Scotland - Wales - Northern Ireland - England Statistics from NHS Cancer Screening web site 11 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA UK Breast Screening – Challenges Digital Digital 2,000,000 - Screened every Year 120,000 - Recalled for Assessment 10,000 - Cancers 1,250 - Lives Saved 230 - Radiologists (Double Reading) 50% - Workload Increase 12 IBM Involvement in UK eScience Projects | 23/10/2003 Began in 1988 Women 50-70 Screened Every 3 Years 2 Views/Breast + Demographic Increase ~100 Breast Screening Programmes - Scotland - Wales - Northern Ireland - England © 2003 IBM Corporation UCISA UK Breast Screening – Workflow Missed 1 Call 1000 Recall Screening Screening All Clear 960 40 Previous Current Interval Cancers Assessment Assessment Cancer 6 All Clear 34 Training Training ~100 Breast Screening Programmes 13 IBM Involvement in UK eScience Projects | 23/10/2003 Epidemiology Epidemiology © 2003 IBM Corporation UCISA eDiaMoND – Scope Workstation Screening Screening Screening Screening Screening Screening Screening Screening Diagnosis Diagnosis Diagnosis Diagnosis Diagnosis Diagnosis Teaching Teaching Training Teaching Training Teaching Teaching Teaching Epidemiology Epidemiology Epidemiology Epidemiology Epidemiology Epidemiology Epidemiology Epidemiology Grid Data Data 32 MB / Image 256 TB / Year Previous Current Compute Compute Standard Standard Mammo Mammo Format Format CADe CADe CADi CADi Data Data Mining Mining ~4 Breast Screening Programmes 14 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA eDiaMoND – Data Data Patient Patient Age Age 107258 107258 55 55 236008 62 236008 62 700266 700266 59 59 895301 58 895301 58 ……… ……… … … ……… … ……… … ……… ……… … … ……… … ……… … ……… ……… … … ……… … ……… … ……… ……… … … ……… … ……… … … … … … … … … … … … … … … … … … … … … … … … … … … … Images Image Image 1.dcm 1.dcm 2.dcm 2.dcm 3.dcm 3.dcm 4.dcm 4.dcm …….. …….. …….. …….. …….. …….. …….. …….. …….. …….. …….. …….. …….. …….. …….. …….. Grid Data Data DICOM DICOM DICOM DICOM DICOM DICOM DICOM DICOM Compute Compute Standard Standard Mammo Mammo Format Format CADe CADe CADi CADi Data Data Mining Mining Logical View is One Resource 15 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA eDiaMoND – Compute Mammograms have different appearances, depending on image settings and acquisition systems Standard Standard Mammo Mammo Format Format Temporal mammography Computer Aided Detection 3D View 16 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA eDiaMoND – Non-Functional Anonymisation Anonymisation Grid Grid Screening Screening Screening Screening Screening Screening Screening Screening Diagnosis Diagnosis Diagnosis Diagnosis Diagnosis Diagnosis Teaching Teaching Training Teaching Training Teaching Teaching Teaching Epidemiology Epidemiology Epidemiology Epidemiology Epidemiology Epidemiology Epidemiology Epidemiology Ethics Ethics Legal Legal Security Security Performance Performance Scalability Scalability Manageability Manageability Auditability Auditability …… …… Lossless LosslessCompression Compression Encryption Encryption 256MB 256MB& &55secs secs response response ~100 ~100Centres Centres Systems Systems Administration Administration Non-Repudiation Non-Repudiation 17 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA eDiaMoND - Prototype Development (OUCL) Oxford / Churchill Edinburgh Aberdeen OUCL LAN Oxford LAN Edinburgh LAN Aberdeen LAN OUCL LAN Oxford LAN Edinburgh LAN Aberdeen LAN JANET Network IBM LAN Mirada LAN UCL LAN KCL LAN IBM LAN Mirada LAN UCL LAN KCL LAN Development (IBM) Development (Mirada) UCL / St Georges KCL / Guys Grid Boundary 18 Server IBM Involvement in UK eScience Projects | 23/10/2003 Workstation T221 © 2003 IBM Corporation UCISA eDiaMoND – Prototype Workstation Two IBM T221 Each 9.2 Megapixels – 3840 x 2400 Each 200dpi 19 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA Some Observations IBM Involvement in UK eScience Projects | 23/10/03 | UCISA © 2003 IBM Corporation UCISA Commerce & Academia have Different Agenda’s § Legal Framework Non-Disclosure Agreements Collaboration Agreements Open Source Licenses; Commercial Licenses Copyright and Intellectual Property § Publicity Press Releases Publications outside of Project § Project Management CSF’s, Requirements, Architecture, Design, Implementation, Test, Packaging, Documentation, Deployment, Maintenance…….. Oh and Research Plans, Work Packages and Deliverables…….. Oh and Research Status Meetings – Access Grid…….. Oh and Research Steering - Project Board, Technical Board…….. Oh and Research External Review – DTi, Commercial Partners…….. Oh and Research Full-time Project Manager on eDiaMoND and OGSA-DAI 21 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA eDiaMoND - Summary Project Plan Jan 2003 Mid 2003 Requirements Analysis End 2003 Mid 2004 End 2004 Prototype (workstation and Grid) Technology Design Build Foundation, single node – Phase 0 Build Multi node – Phase 1 Test and refine Implement Phase 1 Design – Phase 2 Build – Phase 2 Test and refine Implement Phase 2 Proving …. Data Acquisition Analysis and preparation Digitising and Processing Data Mining Local eDiamond Research Local Blueprint Definition and Refinement 22 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA eDiaMoND - September/October Activities Phase 0 Build Documentation CVS Phase 1 ..tidy ..tidy .. Complete test Closedown .. Lessons learned 23 1 2 3 4 5 6 Planning Unpack, Setup, Install, Test Develop S/W -Data Acquisition -Basic Screening -Grid Distributed IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA eDiaMoND – Applications and Work Packages Screening Training Epidemiology Data Mining Admin Client MIR Annotation Client MIR/UED/UCL Viewer Client MIR Training Client UED/UCL Study Analysis Client KCL Data Mining Client UOX Load Service IBM/OUCL/MIR Load Service IBM/OUCL/UED/UCL Load Service IBM/OUCL/KCL Load Service IBM/OUCL/UOX Phase 0 Phase 1 Phase 2 Client Grid Study Acquisition Client Data Acquisition Client MIR/KCL MIR/UOX Load Service IBM/OUCL “Compute” Service IBM/OUCL/UOX Data Acquisition Acquisition Client MIR Load Service IBM/OUCL Query Service IBM/OUCL Retrieve DICOM Service IBM/OUCL Grid Database Screen DB Schema IBM/OUCL/MIR Training DB Schema IBM/OUCL UED/UCL Epidem DB Schema IBM/OUCL/KCL Mining DB Schema IBM/OUCL/UOX Core DB & DICOM Schema IBM/OUCL 24 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA Commerce & Academia Working Together § Project Infrastructure Space and Infrastructure for Project Personnel and Equipment (Visiting & Local) Communication – eMail, Teleconference, Access Grid, Mailing Lists, Discussion Forums, Face-to-Face Documentation – TWIKI Software Development – Methodologies, Tools, CVS Repository, Build, Test Harnesses Backup and Recovery Security - Remote Login and Access Control § Hardware, Software and Networks Systems Management – Full-time on eDiaMoND Inventory Control (where’s the kit ?) Firewalls, VPN, Anti-Virus, OS Security Fixes, JANET Connection § Data Ownership, Control, Use, Ethics, Consent, Anonymisation, Encryption Audit Trails 25 IBM Involvement in UK eScience Projects | 23/10/2003 © 2003 IBM Corporation UCISA IBM Involvement in UK eScience Grid Projects Dr Brian M Collins Grid Project Manager and Consulting IT Specialist IBM Involvement in UK eScience Projects | 23/10/03 | UCISA © 2003 IBM Corporation
