GLAST LAT Project Gamma-ray Large Area Space Telescope DOE/NASA Status Review, March 30 & 31, 2004 GLAST Large Area Telescope: Integration & Test Elliott Bloom SU-SLAC I&T Manager elliott@slac.stanford.edu 650-926-2469 Integration and Test 1 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Organization of I&T – Overview Electrical Ground Support Equipment (EGSE) / Online Software Mechanical Ground Support Equipment (MGSE) Particle Test Science Verification Analysis and Calibration (SVAC) Integration Facilities Configuration and Test (IFCT) Integration, Test, and Calibration Integration and Test Management 2 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Integration and Test Elliott Bloom, Manager (SU-SLAC) Brian Grist, I&T Engineer (SU-SLAC) WBS 4.1.9, 4.1.9.1 Integration, Facilities, Configuration, and Test Larry Wai, Manager (SU-SLAC) Thomas Borden, IFCT Engineer (SU-SLAC) WBS 4.1.9.6 Brian Horwitz Eliazar Ortiz Electrical Engineer Mechanical Engineer TBD 2 TBD 1 Electrical Technician Electrical Technician Lead Mechanical Ground Support Equipment Eric Gawehn, Manager TBD 3 Dave Kiehl Tom Neiland Mechanical Technician Mechanical Technician Online Software Particle Test Ric Claus, Manager (SU- Gary Godfrey, SLAC) WBS 4.1.9.5 Manager (SU-SLAC) WBS 4.1.9.7 Environmental Test Michael Lovellette, Manager (NRL) WBS 4.1.9.8 Bill Olson Jim Panetta Mechanical Engineer Engineering Physicist Designer Leo Manger Mechanical Technician Lead Electrical Technician (SU-SLAC) WBS 4.1.9.4 Patrick Williams Mark Molini Mechanical Technician Lead Selim Tuvi I&T Tracker liaison and test group Hiro Tajima Physicist Reggie Rogers Mechanical Technician Johann CohenTannugi Science Verification, Analysis, and Calibration Physicist Mission Elliott Bloom, Manager (SUSLAC) WBS 4.1.9.A Eduardo do Couto e Silva, Manager (SU-SLAC) WBS 4.1.9.9 Various Personnel from NRL Anders Borgland Engineering Physicist Software Developer Xin Chen Steve Score Alicia Kavelaars Software Developer Software Engineer Designer TBD 4 Warren Focke Engineering Physicist Engineering Physicist Integration and Test 3 16 MAR 2004 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Scope of I&T Presentation • Preparation for LAT integration – Integration, Facilities, Configuration and Test (IFCT) – Electrical Ground Support Equipment (EGSE)/Online – Mechanical Ground Support Equipment (MGSE) – Particle Test – Science Verification, Analysis, and Calibration (SVAC) – Management • Peer Reviews of I&T departments 6/14/04 - 6/18/04 • Integration Readiness Review – 7/8/04 • Installation of one tower and testing begins– 8/13/04 • Installation of two towers and testing begins – 9/04 • Two Tower CPT begins – 10/04 • Two Tower CPT complete – 11/04 Integration and Test 4 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Integration and Test Sequence Through Two Towers (LAT-MD-00676) Receive Grid Receive Calorimeter, TEM/TEM PS Flight Units A Integrate Grid onto Rotation Stand Install in Metrology Bay for Shimming & Assembly Grid Optical Survey Test CAL A & TEM/TEM PS A Integrate Tracker A into Grid Integrate Cal/TEM/TEM -PS A into Grid Integration and Test Receive Tracker Flight Unit A Receive Calorimeter, TEM/TEM PS Flight Units B Receive Tracker Flight Unit B Install in Metrology Bay for Shimming & Assembly Install tower in Single Bay Test CAL B & TEM/TEM PS B Install tower in Single Bay Test Single Bay Tower Test Single Bay Tower De-Install Tower from EM single bay De-Install Tower from EM single bay Single Tower Test in Grid Optical Survey Integrate Tracker B into Grid Integrate Cal/TEM/TEM -PS B into Grid Single Tower Test in Grid Two Tower CPT 5 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 I&T Overview to Start of Integration Requirements LAT-MD-02730 6/10/04 * Integration Procedures Mechanical and Electrical 6/18/04 I&T Plan LAT-MD-01376 5/1/04 Survey Plan 5/1/04 draft 5/31/04 final EGSE Hwr Deliveries 6/1/04 MGSE Development Plan v.2 5/15/04 Integration and Test Training & Procedure Verification 6/18/04 Particle Test Equipment 6/18/04 Electronics Test-Bed 5/04 I&T Functional Test Scripts 6/1/04 LATTE v.3.0 4/1/04 Subsystem Scripts 5/1/04 Drawings 5/1/04 Electronics Test-Bed 5/04 Fabrication 6/14/04 Bldg 33 Cert 6/18/04 I&T Mockup 4/1/04 Training & Script Verification 6/1/04 – 7/1//04 Integration Readiness Review 7/8/04 LATTE v.3.n V &V 5/8/04 – 7/8/04 Receive Flight Hardware Start Integration Proof Testing 7/21/04 * Final though two tower CPT, releases to support integration procedure development 6 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Recent Accomplishments • MGSE Review – February 5th and February 24th. • Held an Integration Kick-off Meeting – March 9th. • Assembly plan under review for release (Design Engineering document) – March 12th. • Hired 6 of 10 open I&T positions as of March 25th. • Training Mockup ready for use March 31st. • Initial Online software for integration of LAT, LATTE v.3.0 released – April 1st. Integration and Test 7 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Integration, Facilities, Configuration, and Test (IFCT) Flow Procedure Writing (March – June) Mockup Preparation (March) Mockup Training (April – June) Facility Preparation (March – May) Facility Training (May – June) Testbed Preparation (March – April) Testbed Training (May – June) Integration and Test Integration Readiness Review 7/8/04 8 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Integration, Facilities, Configuration, and Test (IFCT) - Procedures for Single and Two Towers • Single bay procedures (12 total) – 9 procedures partially or fully tested in EM1 test series – 3 procedures never exercised yet: Tracker installation, Optical survey, TEM/PSU shimming – Includes critical operations and facility procedures. – 7 complete by 4/9/04, 3 complete by 4/19/04, 1 by 5/19/04, and 1 by 6/18/04. • Two-bay procedures (6 total) – Top concern: GASU/PDU test procedures; will be sending IFCT personnel to ELX test lab to develop and exercise procedures. – 3 complete by 4/9/04 and 3 by 6/18/04 including two tower comprehensive performance test. • Related MGSE procedures (13 total) – Use and proof test procedures ready by the IRR. Integration and Test 9 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 IFCT - Facility Overview / Monitoring system Subsystem Receiving Main Integration Particle Count Temperature Humidity Integration and Test Example of monitoring system data: • Cleanroom typically operating within limits 99.7% of time • Hardware bag w/ nitrogen purge covered remaining 0.3% of time 10 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 IFCT - Facility Project Schedules • Cleanroom air conditioning hot water back-up boiler - new issue as of 3/25 (SLAC SEM investigating) • Network Firewall - ECD 3/31 • Nitrogen purge line certification - ECD 3/31 • Cleanroom Monitoring Automated Data Archival System (SCS) - ECD 4/30 • Cleanroom air conditioning air intake duct stack - ECD 4/30 • ACD Test Area - ECD 5/31 • ELX Thermal Chamber Installation - ECD 5/31 • ELX T-Vac Installation - ECD 5/31 • Building 33 Back-Up Power Generators - ECD 5/31 (Proposed awaiting quote/Project approval) Integration and Test 11 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 IFCT – I&T Mock-up Description of parts: • Rotation stand supporting plate spanning full-width of LAT • EM single bay can fasten to central bay • CAL baseplate external features • Shear plates • Cable trays • Population of cables, electronics boxes for bays 815 (50% of LAT) Status • All major parts in hand or in manufacturing • Ready for training 31-Mar-04 Integration and Test 12 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Planned Operations Meetings • Ongoing weekly I&T meeting, Thursdays 1:30 PM – 3 PM (telecon). • During integration – Daily 8 AM meeting in Bldg 33 to define work for the day. • Attended by all technicians on day shift that day. • Led by electrical and mechanical floor engineers. – Daily 4 PM meeting in Bldg 33 to review progress of the day shift and define work for the swing shift. • Attended by all technicians on day and swing shift that day. • Led and organized by IFCT department manager. • Electrical and Mechanical floor engineers define work for the swing shift. • Short technical presentation relevant to the days work will be made. Integration and Test 13 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Mechanical Ground Support Equipment (MGSE) Flow Metrology Bay 3/8/04 - 4/19/04 Formal Stress Analysis 2/6/04 – 4/9/04 Personnel Access Platforms and proof 4/19/04 – 6/14/04 Grid Perimeter Ring Support Shaft 3/29/04 – 5/14/04 Drive Gear and Bearings 3/15/04 – 5/7/04 1x4 Lift Fixture and proof 4/12/04 – 6/10/04 Rotation Stand Weldment 3/29/04 – 6/15/04 Z-Axis Horizontal Lift Spreader 3/29/04 – 6/11/04 Rotation Stand Assembly & Proof Test 6/16/04 – 7/21/04 Grid Perimeter Ring and brackets 3/29/04 – 5/14/04 4x4 Lift Fixture and Proof 4/12/04 – 5/27/04 Integration and Test Proof Test Assemblies 4/5/04 – 6/14/04 Integration Readiness Review 7/8/04 14 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Mechanical Ground Support Equipment (MGSE) – LAT MGSE Status Tracking Status (All items complete byMatrix IRR) LAT I&T MGSE Item 4x4 Integration Stand 4x4 Rotation / Support Stand Grid Perimeter Ring - Brackets Support Shaft - Flange Assemblies Personnel Access Platforms Z Axis Up Lift Fixture Z Axis Up Lift Spreader Z Axis Up Tension Rod Assemblies Z Axis Horizontal Lift Fixture Z Axis Horizontal Lift Spreader Z Axis Horizontal Shackles Z Axis Horizontal, Crane Scale Mod Crane Scale Height Modification 4x4 MGSE Proof Test Assemblies CAL -Z Up Lift Fixture CAL Alignment Tool CAL Alignment Rods CAL Inversion Stand / Interface E-Box Shimming Metrology Bay with Stand Clamps, Align Rods, Lift Eyes, etc TWR Mass Simulators EM-2 Single Bay ( TKR Interface Plate) 1x4 Lift Fixture 1x4 Lift Spreader 1x4 Tension Rod Assemblies TKR - TKR No Touch at Ascent Tool Integration and Test Stress Analysis Status Report Design - Drafting Modeled Detailed Released √ √ √ 40% 75% 95% 95% √ √ √ 65% 90% 99% 99% 15% √ √ 95% 95% √ 30% 90% 45% √ √ √ √ 95% 95% 95% 95% √ √ √ √ 95% 95% 95% 95% √ √ √ √ * * * √ √ 90% √ √ √ 90% √ 95% √ √ √ √ √ 80% √ √ 80% 60% n/a n/a √ √ √ n/a √ √ 90% 90% Procurement Assembly Ordered In-House Status Proof Test 9% 50% 50% 30% √ √ √ √ √ n/a 95% √ √ 100% √ √ √ √ √ √ √ 40% 50% 50% 30% n/a n/a n/a n/a n/a * Hardware in hand and proof test complete 15 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Personnel Access Platform TKR • PAP provides ready access to allow crew to Attach or Remove TKR Lift Fixture from any bay position • TKR cables will need to be dressed to their –Z end to allow TKR motion up and over other installed TKRs PAP at Highest Position Integration and Test PAP Can Extend to Any Desired Bay 16 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Electrical Ground Support Equipment (EGSE) / Online Flow LATTE v.3.0 with GASU support 4/1/04 EGSE Hwr Deliveries (Electronics) 6/1/04 I&T Functional Test Scripts 6/1/04 Subsystem Scripts 5/1/04 Electronics Test-Bed 5/04 Integration and Test Script / Software Configuration Control 7/8/04 Electronic Logbook / MateDemate Log 6/1/04 Hardware Monitoring 5/8/04 Power Up Sequence 5/8/04 Training 6/18/04 Integration Readiness Review 7/8/04 Peer Review 6/18/04 LATTE v.3.n release 5/8/04 Security – Configuration Control 5/8/04 LATTE v.3.n V &V 5/8/04 – 7/8/04 Event Prescaling 5/8/04 17 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Electrical Ground Support Equipment (EGSE) / Online - Test Stand Definitions through two tower Status: Stand No. EGSE Software Flight Software PC with VME crate, LCB and SBC X board Power Complete Complete 1st Release TS-1 TS-2a TS-2b >=LATTE 2 EM1 X LATTE 2+ EM1 X LATTE 3 EM2 X X Bench and EGSE TEMPS Bench EM or flight PDU Spacecraft Interface Simulator (SIS) Test phase description Tracker or Cal receiving test TKR installation in EM single bay ACD receiving test Cal/TEM/TEMPS integration Tower integration in EM Single Bay and in grid 2+ towers in grid through GASU and PDU installation, can be used up to launch for low level tests including ACD Tests EPU and SIU after installation, including before all 16 towers are integrated Full up LAT testing Integration and Test X X X X X 18 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Single Tower EGSE Configuration (TS-1 / 2a) Online Workstation Subsystem (or simulator) CPU • Commanding • Telemetry • Monitoring AEM/TEM • Hardware Drivers LAT-COMM DC Power •External Trigger • Test Exec • Configuration • Commanding • Telemetry • Event Processing • Monitoring • Visualization • Data base • Message logger • Alerts • Electronic log Main Dataflow Ethernet Central Database WAN Back door debug RS-232 Ethernet Ethernet Router and Firewall VME Chassis External Hardware Subsystem/simulator Integration and Test Electronics/Online 19 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Multi-Tower EGSE (TS-2b) EGSE Crate ACD or Sensor Simulator CPU 28 V Supply WAN LCB GASU VME AEM EBM TEMs 28 V Supply PDU Firewall GEM Central Database Online Workstation CAL, TKR or Sensor Simulator T&DF System (LAT) Integration and Test SLAC EGSE 20 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Particle Test Van de Graaff Cosmic Ray Scintillator BGO Monitor Status: Needs data acquisition system upgrade 6/18/04 Status: •1 kHz g into 4p sr during EM test •> 100 kHz g into 4p sr with upgraded VdG in work •Electron veto upgrade in work •Complete by 6/18/04 Procedures for equipment setup complete by 6/18/04 Spare Parts for 22 components (8 already have, 14 ordered by 4/15/04) Integration and Test Status: Needs upgraded support 6/18/04 •Bi-weekly verification of VdG by recording BGO spectrum •Bi-weekly verification of Scintillator telescope by recoding cosmic rate Integration Readiness Review 7/8/04 21 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Science Verification, Analysis, and Calibration (SVAC) • • • Calibrations – To verify that offline/online calibrations agree – To improve calibrations by using additional LAT information not available to subsystems – To develop trend analyses to provide history of calibrations Data analyses – To apply SAS reconstruction algorithms on real data – To uncover and quantify any instrumental effects that could have an impact on science data analysis SVAC depends strongly on work outside SVAC – Subsystem inputs – SAS Calibration infrastructure – SAS Pipeline Infrastructure – SAS/Online Event Format definitions Integration and Test Data Files Calibrations Data Analyses Databases Trending Analyses Infrastructure 22 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Science Verification, Analysis, and Calibration (SVAC) - Roadmap SAS Calibration Algorithms (May) SAS Database (May) SVAC Acceptance and Test of SAS Algorithms (May - July) SVAC Database and Calibration trending (March - July) SVAC Data Pipeline (May-June) SAS Pipeline Infrastructure (March - April) SAS Geometry Review (April) 1 & 2 Tower Geometry (April – May) MC Datasets 1 & 2 tower (May) Integration Readiness Review 7/8/04 Instrument Test Analysis (March – July) EM 1 data analysis (March - May) SVAC Workshop (May) EM 2 data analysis (April - June) Integration and Test 23 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Variances Schedule and Cost • Schedule – Budgeted Cost of Work Scheduled (BCWS): 3125 k$ – Budgeted Cost of Work Performed (BCWP): 3111 k$ – Schedule Variance: -14 k$ or 0.5% • Cost – Budgeted Cost of Work Performed (BCWP): 3111 k$ – Actual Cost of Work Performed (ACWP): 3037 k$ – Cost Variance: +74 k$ or 2.4% • The Integration and Test Subsystem schedule and costs are under control. Integration and Test 24 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Critical Path to Integration of First Flight Module Tower Integration EGSE Dev & Support 5/18/04 (0) Receive / Inspect Cal Module A 8/13/04 (-24) EGSE Validation for Tower Integration 5/19/04 (0) Integrate Flight TKR/Cal Towers A 8/27/04 (-11) EGSE Ready for Integration 5/20/04 (0) Functional Tower Test - A 9/13/04 (-11) Completion Date (Baseline Variance) Issues driving critical path • Test requirements – Working closely with Systems in weekly meetings to drive to closure • LAT Performance and Operations Test Plan LAT-MD-02730 6/10/04 – Rapid progress possible on I&T Test plan • Integration and Test PlanLAT-MD-01376 5/1/04 – Working with Design Integration and Tracker in weekly meeting to drive to closure • Survey Plan, 5/1/04 draft, 5/31/04 final • Subsystem scripts – I&T EGSE/Online working closely with subsystems to enable delivery by 5/1/04 • Time on Electronics Test-Bed for EGSE V&V and technician training – Electronics will give I&T required access to needed equipment starting on 5/1/04 Integration and Test 25 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Approved Cost Changes Since Rebaseline (k$) 4.1.9 Baseline, November 03 $6,384 Changes: • Additional I&T Manpower • IFCT Engineering/Design • Tracker/Grid Interface Redesign • Stanford Benefits Rate Increase Total Change $ $ $ $ $ 4.1.9 Baseline, February 04 $7,373 523* 284 35 147 989 *Corresponding NASA funding increase, change was pending during rebaseline effort. Integration and Test 26 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Where will I&T be in 6 months? • • • • The Integration Readiness Review (IRR) will have been completed. – The procedures for integration have will been completed. – The MGSE for LAT integration will have been built and tested. – The EGSE/Online for integration will have been completed and tested in place. – Configuration control in place. – Technicians will have been trained. – Facility will be certified. – Van de Graaff will be ready. The Grid will have been received and installed on the rotation stand. The first tower will have been received, installed and tested. The second tower will have been received and work will have begun on installation and testing. Integration and Test 27 GLAST LAT Project DOE/NASA Status Review, March 30 & 31, 2004 Summary • I&T is on track to begin integration as currently scheduled. Integration and Test 28