GLAST LAT Project Gamma-ray Large Area Space Telescope ISOC CDR, 4 August 2004 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section 5 Software Architecture Steve Culp SLAC sculp@slac.stanford.edu 650-926-8987 Document: LAT-PR-04500 Section 5 1 GLAST LAT Project ISOC CDR, 4 August 2004 Agenda Requirements Mapped to Software Software Architecture Development and Testing Schedule Staffing Level (ROM) Demo Document: LAT-PR-04500 Section 5 2 GLAST LAT Project ISOC CDR, 4 August 2004 Requirements Mapped to Software – – – – Reviewed all ISOC level III requirements Identified which required software Identified existing tools which satisfied all or part of reqt Identified where new development needed Document: LAT-PR-04500 Section 5 3 GLAST LAT Project ISOC CDR, 4 August 2004 Requirements breakdown Each requirement was identified as: 1. Procedural (non-software) 42 2. Existing software (commercial or other well-established software -- i.e. implementation Done!) 277 3. Under development by SAS (mostly done, refer to SAS for status) 39 4. To be developed by others (I&T, FSW, ITOS) 21 5. Remaining new development 88 total 467 Some requirements map to multiple categories or SW tools, so total exceeds total number of level IIIs (379) Document: LAT-PR-04500 Section 5 4 GLAST LAT Project ISOC CDR, 4 August 2004 1. Procedural (no SW development) Name # Level 3 Reqts % of Reqts N/A 19 4.1% Ops Procedures 12 2.6% SCS 11 2.4% 42 9.0% (e.g. facility reqts) (SLAC Computer Services) Total Document: LAT-PR-04500 Section 5 5 GLAST LAT Project ISOC CDR, 4 August 2004 2. Existing software Name Description # Level 3 Reqts % of Reqts ITOS satellite C&T package 215 46.0% GSFC ATNS Anomaly Tracking and Notification System 32 6.9% FASAT (commercial) or RXTE SOF Process Mgr (RXTE) secure file transfer 15 3.2% FastCopy (commercial), DTS (HEASARC) CVS file config mgmt tool 5 1.1% Open Source STK Satellite Tool Kit 4 0.9% commercial LAT documentation management tool 4 0.9% existing SLAC LAT tool NTP synchronize computers 1 0.2% Open Source email electronic mail 1 0.2% Open Source 277 59.3% FastCopy / DTS LATDocs Total Document: LAT-PR-04500 Source Section 5 6 GLAST LAT Project ISOC CDR, 4 August 2004 3. Under Development by SAS Name Description # Level 3 Reqts % of Reqts GINO pipeline manager 21 4.5% DATACHKTOOL check quality of science data telemetry 6 1.3% SASTOOL1 generate level 1 science data products 6 1.3% SASTOOL2 generate level 2 science data products 4 0.9% SASAUTO manage automatic generation of level 1 & 2 data products 2 0.4% 39 8.4% Total Document: LAT-PR-04500 Section 5 7 GLAST LAT Project ISOC CDR, 4 August 2004 4. To be developed by others Tool Name Description # Level 3 Reqts % of Reqts Source ELOG electronic log book 8 1.7% I&T Online (mostly done) DIAGTOOL diagnostic access 7 1.5% FSW ITOS Enhancements minor changes to ITOS to meet specific reqts 3 0.6% GSFC IRFTOOL generate instrument response function 2 0.4% SVAC DBCAL create database of LAT calibration data 1 0.2% SVAC 21 4.5% Total Document: LAT-PR-04500 Section 5 8 GLAST LAT Project ISOC CDR, 4 August 2004 5. Remaining to be developed Tool Name Description # Level 3 Reqts % of Reqts Comments PLOTTOOL plotting 28 6.0% combination of existing tools (e.g. ROOT, HippoDraw, JAS, IDL) & new dev TRENDTOOL trending 16 3.4% combination of IDL, DTAS (used by MOC), and/or TAPS (GSFC) PLANTOOL mission planning 6 1.3% generate timeline and commands for LAT operation CONSTRAINT TOOL check command sequences against constraints 12 2.6% DB database definition and implementation 10 2.1% DBIN ingest ISOC data 7 1.5% WEBTOOL provide web access to data products 9 1.9% 88 18.8% Total Document: LAT-PR-04500 partially done by SAS, I&T, FSW coordinating dev with SAS, I&T, FSW, SCS Section 5 9 GLAST LAT Project ISOC CDR, 4 August 2004 Software Architecture Document: LAT-PR-04500 Section 5 10 GLAST LAT Project ISOC CDR, 4 August 2004 Primary Software Data Flows LAT ISOC MOC Level 0 Data, Integrated Observ. Timeline, As-Flown Timeline, Flight Dynamics Products, Anomaly Reports, PDB updates, LAT/GBM Sci Alerts, LAT/GBM/SC Problem Alerts Level 0 Sci Data Receive & Archive Science Data Analysis Pipeline Level 0 Hkpg Data Science Plan LAT Science Activity Timeline, LAT Instrument Commands, LAT Instrument Loads Mission Planning Receive & Archive Commands to Verify Anomaly Tracking & Notification System Alerts, Logs, Process status, File status Document: LAT-PR-04500 Archive & Send GSSC CHS monitoring & trending Integrated Observ. Timeline, As-Flown Timeline, Flight Dynamics Products GSSC Level 1&2 Sci Data Products Level 1&2 Sci Data Products, LAT Science Activity Timeline, LAT Instrument Commands, LAT Instrument Loads LAT Test Bed Contingency: LAT Instrument Commands, LAT Instrument Loads Archive & Send MOC Tested OK All data into ISOC, and products out Database Section 5 Web Access 11 GLAST LAT Project ISOC CDR, 4 August 2004 Automatic Telemetry Processing LAT ISOC Science Data Analysis Pipeline Calib. DB Calibration Trending Level 0 sci & hkpg telemetry MOC GINO & FastCopy/DTS Receive & Archive Level 0 science telemetry Apply Calibration Reconstruction System-level Monitor Archive & Send Level 1&2 data products Level 2 processing Subsystemlevel monitor Realtime Level 0 hkpg telemetry (during contacts) GINO & FastCopy/DTS Level 1 processing GCN GSSC Transient Search Level 0 hkpg telemetry ITOS Monitor hkpg parameters Text & Stripchart displays (optional) Monitor Trends ITOS Monitor Data Reports, Log entries, Data Products received and sent Alerts, Logs, Process status, File status FASAT Anomaly Tracking & Notification System Database STOL Config monitor scripts Beeper / email message Beeper / email message Document: LAT-PR-04500 Section 5 12 GLAST LAT Project ISOC CDR, 4 August 2004 Report Generation and Use Report Frequency Source Auto Generation Manual Input Destination Read By Daily ISOC Yes Optional Web Human Daily (TBR) ISOC Yes Optional Web Human Level 0 Transmission Level 0 receipt ISOC Yes No MOC Computer Data Trending Level 0 receipt ISOC Yes No Web Human Daily (TBR) ISOC Yes No Web Human Level 0 receipt ISOC Yes No Web Human LAT Incident Reports As needed ISOC No Yes MOC Human SC Incident Reports As needed MOC No Yes ISOC Human TBD MOC Yes TBD ISOC Computer/ Human LAT Health and Status LAT Performance LAT Command History Data Processing Reports As-Flown Timeline Document: LAT-PR-04500 Section 5 13 GLAST LAT Project ISOC CDR, 4 August 2004 Command and Telemetry Definition File Verification LAT ISOC Modify .dbx file(s) MOC .dbx files Project Database (master Cmd &Tlm definitions) OK (test passed with new .dbx file(s) ITOS Replay Commands & Receive Telemetry CCSDS Commands LAT Testbed telemetry Command log, error log and optional Text/Stripchart displays Test Suite of STOL Commands Document: LAT-PR-04500 Section 5 14 GLAST LAT Project ISOC CDR, 4 August 2004 Nominal LAT Command Process Mission Operations Center (MOC) GLAST Science Support Center (GSSC) Final Science Timeline Science Plan (Phase 2) TDRSS Schedule Engineering Plan Mission Timeline Preliminary and Final Science Timelines Command Plan ISOC Command Plan ATS Commands Mission Planning Operations Plan Command Plan Build & Review Verification & Validation File Uploads Command Procedures Feedback Document: LAT-PR-04500 Section 5 15 GLAST LAT Project ISOC CDR, 4 August 2004 Command Load Generation & Verification LAT ISOC Command Load (new) Generate Command Load & Perform Constraint Checking Verified OK GSSC STOL commands ITOS Issue Commands & Receive Telemetry CCSDS Commands LAT Test Bed telemetry Command log, error log and optional Text/Stripchart displays Document: LAT-PR-04500 Section 5 16 GLAST LAT Project ISOC CDR, 4 August 2004 Data Display and Analysis Support Web access – Data products (logs, reports, level 0/1/2 data) – Electronic logbook provides log entry, log and report viewing, and file download – Password protection on privileged actions (e.g. log entry, data download) Tools – Includes ROOT, HippoDraw, IDL, and JAS – Used in ISOC to generate reports accessible over web – Data download allows users to process data locally with tools installed on their machine Document: LAT-PR-04500 Section 5 17 GLAST LAT Project ISOC CDR, 4 August 2004 Electronic Logbook Running record of ISOC and its data products in and out – Program currently in use by I&T can meet ISOC requirements – All entries go in relational database – Web-accessible Includes – Record of data products received and sent and links to each – User comments – Time tag on each entry Suggested Metric for ISOC – Response times – e.g. from receipt of level 0 data to sending of level 1 & 2 products Document: LAT-PR-04500 Section 5 18 GLAST LAT Project ISOC CDR, 4 August 2004 ISOC Network and Hardware Architecture SLAC Internet LAT ISOC Web Server … Firewall PVO Workstations FSW Workstations CHS Workstations Linux PC (Hkpg Replay ITOS) (Realtime connection ITOS) Firewall Gateway System (Oracle, GINO, FastCopy/DTS) Firewall SCS CPU Farm SAS/SP Workstations Linux PC Abilene Network SCS Storage Farm MOC GSSC Solaris Workstation (VxWorks tools) 1553 LAT Test Bed SIIS LVDS (S/C Sim) Linux PC (Test Bed ITOS) LAT Test Bed Lab Document: LAT-PR-04500 Anomaly Tracking & Notification System Section 5 19 GLAST LAT Project ISOC CDR, 4 August 2004 Software Development & Testing Schedule Document: LAT-PR-04500 Section 5 20 GLAST LAT Project ISOC CDR, 4 August 2004 Testing Four software releases – Each level 3 requirement will • be mapped to the release where first needed • have test procedures defined – Each release includes functionality required for subsequent GRTs • R3 (Dec 05) includes all requirements • R4 (Jul 06) includes enhancements based on user experience (e.g. during Mission Simulation) – Two weeks prior to each release • test that requirements newly included in that release are met • regression test previously included requirements Document: LAT-PR-04500 Section 5 21 GLAST LAT Project ISOC CDR, 4 August 2004 Summary of ISOC Software Capabilities for GRTs & ETEs Date What Release 15-Apr-05 GRT 2 ISOC 1 (1 Apr 05) 15-Jun-05 GRT 3 “ 1-Sep-05 GRT 4 ISOC 2 (15 Aug 05) 15-Nov-05 GRT 5 “ 11-Feb-06 ETE 1 ISOC 3 (15 Dec 05) 15-Feb-06 GRT 6 “ contingencies added 15-Apr-06 ETE 2 “ provide instrument commands and file loads, support memory dumps of instrument 1-May-06 GRT 7 “ clean-up and regression tests 1-May-06 Mission Sims “ full ISOC capabilities to support Mission Sims (from May 2006 through launch) 15-Jun-06 ETE 3 “ support basic observatory operations 25-Aug-06 ETE 4 ISOC 4 (25 Jul 06) 14-Oct-06 ETE 5 “ regression test and contingencies 1-Feb-07 ETE 6 “ final ETE at launch facility Document: LAT-PR-04500 Required ISOC capabilities receive real-time HK data from MOC, provide basic LAT P&S (Planning & Scheduling) level 0 data processing on science data, IOC processes science level 0 data into level 1 products receive level 0 data from MOC provide level 1 and 2 data products to GSSC, provide more complex LAT P&S, provide LAT file uploads to GSSC, provide simulated science data provide Level 1 data products to GSSC, receive Level 0 files from MOC (post-test) instrument turn on Section 5 22 GLAST LAT Project ISOC CDR, 4 August 2004 ISOC Software Development Schedule Phase / Milestone A u g 0 4 S e p 0 4 O c t 0 4 N o v 0 4 D e c 0 4 J a n 0 5 F e b 0 5 M a r 0 5 A p r 0 5 M a y 0 5 J u n 0 5 J u l 0 5 A u g 0 5 S e p 0 5 O c t 0 5 N o v 0 5 D e c 0 5 J a n 0 6 F e b 0 6 M a r 0 6 A p r 0 6 M a y 0 6 J u n 0 6 J u l 0 6 A u g 0 6 S e p 0 6 O c t 0 6 N o v 0 6 D e c 0 6 J a n 0 7 F e b 0 7 ISOC CDR ITOS setup/configuration ISOC Verif. with Test Bed Diagnostic Tool Dev Mission Planning Dev DB/Web/E-logbook Dev Plotting/Trending Dev SW enhancements ISOC Demos ISOC Simulation Testing ISOC SW Releases 1 2 4 3 Ground Readiness Tests 2 3 4 5 7 6 End-to-End Tests 1 2 3 4 6 5 Environmental tests at NRL ISOC testing at NRL ISOC ready to take over LAT operation ISOC used to I/F with LAT (front-door only) Mission Simulations Launch SW Dev Slack Times Document: LAT-PR-04500 Section 5 23 M a r 0 7 GLAST LAT Project ISOC CDR, 4 August 2004 Staffing Level (ROM) Based on review of level 3 requirements – Average LOC per reqt is >10 and <100 – 80 LOC per reqt appears conservative (probably high) Of 467 reqts, 88 remain to be developed and all need to be verified – 88 reqts x 80 LOC/reqt = ~7,000 LOC (ROM) – Estimate 2,000 LOC per programmer per year – 7,000 LOC to develop / 2,000 LOC/pgmr-yr = 3.5 programmer years Release 4 is July 06 – ~ 2 calendar years of development – But with slack time and more intensive 1st year of development, need 3 programmers + 1 tester Document: LAT-PR-04500 Section 5 24 GLAST LAT Project ISOC CDR, 4 August 2004 Status Architecture concept is solid Ready to proceed – Refine and document software design – Implement it – Lots of testing and demos I.e. lots of work to do… Document: LAT-PR-04500 Section 5 25 GLAST LAT Project ISOC CDR, 4 August 2004 ITOS Demo Document: LAT-PR-04500 Section 5 26 GLAST LAT Project ISOC CDR, 4 August 2004 ITOS Demo Play back simulated LAT housekeeping telemetry • In real-time -this simulates: – Real-time connection to MOC for S/C contact periods – ISOC test bed use for verifying command sequences and ITOS Command & Telemetry definition files • Fast replay -this simulates: – Rapid replay of LAT and S/C housekeeping data files received from MOC after download from SSR • Examine print file generated during playback – Configured to record parameters of interest – Available for download through e-logbook Document: LAT-PR-04500 Section 5 27