GLAST LAT Project
ISOC CDR August 4, 2004
GLAST Large Area Telescope:
Gamma-ray Large
Area Space
Telescope
Instrument Science Operations Center
CDR
Section 8
Management, Cost, Schedule & Risk
William Craig
Stanford Linear Accelerator Center
ISOC Subsystem Manager
bcraig@slac.stanford.edu
LAT-PR-04500
Section 8 Management 1
GLAST LAT Project
ISOC CDR August 4, 2004
Topics
•
•
•
•
•
•
•
•
Organization/Staff
Management Process
Requirements Traceability
Document Status
Test Philosophy
Procurement Plans
Schedule
Issues and Concerns
LAT-PR-04500
Section 8 Management 2
GLAST LAT Project
ISOC CDR August 4, 2004
Ground System/Ops Organization
Ken Lehtonen
Ground System/Ops Manager
GSFC
Howard Dew
Ground Sys Engineer
GSFC
Ross Cox/ASRC
Ernest Canevari/ASRC
Bruce Wagner/ITMI
Dave Harmon
QA Engineer
Tybrin
Beth Pumphrey
Test Lead
GSFC
Leslie Ambrose
MOMS/NENS Support
GSFC
Bob Sodano
Mission Director
GSFC
Mark Woodard
FD Engineer
GSFC
Dennis Small
MOC Lead
GSFC
Doug Spiegel/Omitron
MOC Manager
John Nagy/Omitron
FOT Lead
LAT-PR-04500
Bill Craig
LAT IOC/LOF Lead
SLAC
Richard Dubois
LAT IOC/SAS Lead
SLAC
Michael Corcoran
HEASARC GLAST Lead
GSFC
Jay Heberle
USN Support
USN
Stan Rubin
NISN Support
GSFC
Ken Lewis
Observatory Ops Lead
Spectrum Astro
Bill Paciesas
GBM IOC Lead
UAH
Jay Norris
GSSC Lead
GSFC
Scott Barthelmy
GCN Lead
GSFC
Robert Preece/UAH
Implementation Lead
Section 8 Management 3
GLAST LAT Project
ISOC CDR August 4, 2004
ISOC Elements & Functions
ISOC Manager
Database
4.1.B.10
Command, H&S
4.1.B.11
FSW
4.1.B.12
Performance V&O
4.1.B.14
Science Analysis
Tools
4.1.B.13
Science Products
Commanding
Thermal Control
Calibration
Level 1
CRs, gammas,
diagnostics
Simulation
Health & Safety
Trigger
Performance
Trending
Level 2
Transients, GRBs
Calibration
Configuration
Filter
Standard Source
Monitoring
Pipeline Server
Reconstruction &
Event Classif.
Testbed
IRF Generation
LAT-PR-04500
Transient Source
Analysis
Section 8 Management 4
GLAST LAT Project
ISOC CDR August 4, 2004
Staffing profile
• The staffing profile for the ISOC has been developed and the
budget for activities agreed upon with SLAC management.
– See chart on next page for staffing by function
– The large jump in FY05 reflects the CD4 milestone (delivery
to NRL for environmental test) and the end of the
construction phase of the project; at this point most LAT
staff (e.g. SAS, FSW etc) are in the ISOC.
• We have hired a software engineer (Steve Culp) who has
developed an architecture for the ISOC operations software.
• We have hired a software engineer (Jim Lemon) who will
implement the ISOC databases
• We have hired a technical writer (Lee Steele) who will develop
the remaining ISOC documents including the Operations
handbook.
• We will need additional software developers/physicists later in
CY 04. We have no current unfilled slots.
LAT-PR-04500
Section 8 Management 5
GLAST LAT Project
ISOC CDR August 4, 2004
ISOC Staffing Plan
ISOC Staffing by Job Function
FTE
60
50
Support
40
Scientist
Technician
30
Software
20
Engineering
10
Management
0
1
5
9
13 17 21 25 29 33 37 41 45 49 53
Months since March 04
Plan matches actuals through July 04
LAT-PR-04500
Section 8 Management 6
GLAST LAT Project
ISOC CDR August 4, 2004
ISOC Management Process
• The ISOC has established the following meetings in support of ISOC
development and coordination:
– Weekly ISOC staff meeting to track schedule, RFAs and any
coordination issues.
– Weekly ISOC-FSW coordination meeting, attended by ISOC staff and
the FSW manager, to work issues of joint importance and ensure
that jointly held requirements are executed in the most efficient
manner.
– Bi-weekly meetings between ISOC manager and GLAST project
scientist to work overall science planning and mission issues.
– Database development meetings as required.
– Regular interaction with I&T including shared personnel.
• Participate in:
• Weekly GOWG meeting with GSFC
– Address ICDs, timeline, and operation issues
• Weekly FSW and I&T working group meetings
– Coordinate script development and test activities
LAT-PR-04500
Section 8 Management 7
GLAST LAT Project
ISOC CDR August 4, 2004
Requirements Traceability
•
Formal process established and in-place for requirement traceability,
flow down and decomposition for the LAT ISOC
Established ICDs in placed with GLAST-MOC and GSSC
Science
Requirements
Document
433-SRD-0001
Mission System
Specification
433-SPEC-0001
Operations Data
Products (ICD)
Interface
Rqmts
Science
Rqmts
LAT-SC Interface
Requirements
Document
433-IRD-0001
Mission
Rqmts
Science Data
Products (ICD)
Ground System
Requirement
Documents
433-RQMT-0006
Mission
•
Mechanical
Subsystem
Specification
LAT-SS-00115
TCS Performance
Specification
LAT-SS-00715
LAT
Environmental
Specification
LAT-SS-00778
Trigger & Dataflow
Subsystem
Specification
LAT-SS-00019
ACD Subsystem
Specification
LAT-SS-00016
LAT-PR-04500
LAT ISOC
Performance
Specification
LAT-SS-00015
LAT-SC Interface
Control
Documents
TKR Subsystem
Specification
LAT-SS-00017
Power
Subsystem
Specification
LAT-SS-00136
SAS
Subsystem
Specification
LAT-SS-00020
CAL Subsystem
Specification
LAT-SS-00018
ISOC
Subsystem
Specification
LAT-SS-00021
LAT Subsystem
LAT Performance
Specification
LAT-SS-00010
LAT
Interface
Rqmts
Section 8 Management 8
GLAST LAT Project
ISOC CDR August 4, 2004
Document Status
Document
Number
MD-2513
MD-04443
SS-00015
SS-00021
SS-01378
SS-01783
Not
assigned
Not
assigned
LAT-PR-04500
Last
Estimated
Revision Completion
Date
Date
Author
6/23/2004
8/15/2004 L. Bator
W. Craig,
7/30/2004
7/30/2004 D. Lung
L. Bator,
J. Martin
7/22/2004
L. Bator,
W. Craig,
S. Digel,
D. Lung,
7/14/2004
7/30/2004 J. Martin
L. Bator,
W. Craig,
S. Digel,
D. Lung,
7/30/2004
7/30/2004 J. Martin
Draft
11/1/2004 L. Bator
Title
Lat ISOC Verification and Validation Plan
LAT Instrument Science Operation Center
Management and Development Plan
LAT ISOC Performance Specification-Level II(B)
Specification
LAT ISOC Subsystem Specification Level III
Specification
9/15/2004 S. Culp
LAT Operations Plan
LAT Operations Facility Level 4 specification
ISOC Ground Software and Operations Tools
Description
4/15/2005 J. Martin
ISOC Test Plan
Section 8 Management 9
GLAST LAT Project
ISOC CDR August 4, 2004
Document Status (2)
Document
Number
Not assigned
Last
Revision
Date
Estimated
Completion
Date
Author
Title
Instrument Operations Handbook
Not assigned
10/1/2005 L. Bator
R.
11/1/2004 Cameron
Not assigned
2/15/2004 W. Craig
ISOC/I&T Transition Document
Not assigned
9/1/2004 S. Culp
ISOC Configuration Management Plan
Not assigned
9/1/2006 L. Bator
On-orbit Operations Procedures
Not assigned
12/1/2006 L. Bator
Launch and Early Orbit Operations
Not assigned
1/15/2005 FSW
Telemetry and Command Handbook
LAT-PR-04500
ISOC Team Coordination Plan
Section 8 Management 10
GLAST LAT Project
ISOC CDR August 4, 2004
Test Philosophy
• Schedule constructed to test as early as possible
– LAT testbed allows frequent and meaningful tests while
instrument is being assembled
• Frequent demonstrations and simulations precede major
software releases.
• Six end to end tests during Observatory I&T to provide
confidence in final major release of software.
LAT-PR-04500
Section 8 Management 11
GLAST LAT Project
ISOC CDR August 4, 2004
Summary of ISOC Software Capabilities
for GRTs & ETEs
Date
What
Release
15-Apr-05
GRT 2
ISOC 1
(1 Apr 05)
15-Jun-05
GRT 3
“
1-Sep-05
GRT 4
ISOC 2
(15 Aug 05)
15-Nov-05
GRT 5
“
11-Feb-06
ETE 1
ISOC 3
(15 Dec 05)
15-Feb-06
GRT 6
“
contingencies added
15-Apr-06
ETE 2
“
provide instrument commands and file loads,
support memory dumps of instrument
1-May-06
GRT 7
“
clean-up and regression tests
1-May-06
Mission Sims
“
full ISOC capabilities to support Mission Sims (from May 2006 through launch)
15-Jun-06
ETE 3
“
support basic observatory operations
25-Aug-06
ETE 4
“
instrument turn on
14-Oct-06
ETE 5
“
regression test and contingencies
1-Feb-07
ETE 6
“
final ETE at launch facility
LAT-PR-04500
Required ISOC capabilities
receive real-time HK data from MOC,
provide basic LAT P&S (Planning & Scheduling)
level 0 data processing on science data,
IOC processes science level 0 data into level 1 products
receive level 0 data from MOC
provide level 1 and 2 data products to GSSC,
provide more complex LAT P&S,
provide LAT file uploads to GSSC,
provide simulated science data
provide Level 1 data products to GSSC,
receive Level 0 files from MOC (post-test)
Section 8 Management 12
GLAST LAT Project
ISOC CDR August 4, 2004
ISOC Development Schedule
Phase / Milestone
A
u
g
0
4
S
e
p
0
4
O
c
t
0
4
N
o
v
0
4
D
e
c
0
4
J
a
n
0
5
F
e
b
0
5
M
a
r
0
5
A
p
r
0
5
M
a
y
0
5
J
u
n
0
5
J
u
l
0
5
A
u
g
0
5
S
e
p
0
5
O
c
t
0
5
N
o
v
0
5
D
e
c
0
5
J
a
n
0
6
F
e
b
0
6
M
a
r
0
6
A
p
r
0
6
M
a
y
0
6
J
u
n
0
6
J
u
l
0
6
A
u
g
0
6
S
e
p
0
6
O
c
t
0
6
N
o
v
0
6
D
e
c
0
6
J
a
n
0
7
F
e
b
0
7
ISOC CDR
ITOS setup/configuration
ISOC Verif. with Test Bed
Diagnostic Tool Dev
Mission Planning Dev
DB/Web/E-logbook Dev
Plotting/Trending Dev
ISOC Demos
ISOC Simulation Testing
ISOC SW Releases
1
2
4
3
Ground Readiness Tests
2
3
4
5
7
6
End-to-End Tests
1
2
3
4
5
Environmental tests at NRL
ISOC testing at NRL
ISOC takes over LAT operation
ISOC used to I/F with LAT (front-door only)
Mission Simulations
Launch
SW Dev Slack Times
LAT-PR-04500
Section 8 Management 13
6
M
a
r
0
7
GLAST LAT Project
ISOC CDR August 4, 2004
ISOC Software Release Schedule
• New software architecture in place, centralizing all software
releases; eliminating the various separate software release
schedule as in the PDR schedule
• The schedule has been coordinated with GSFC Ground System
plans
– ISOC Software Release 1 (April 1, 2005)
• Support Ground Readiness Test (GRT) 2 and 3
– ISOC Software Release 2 (August 15, 2005)
• Support GRT 4 and 5
– ISOC Software Release 3 (December 15, 2005)
• Support End-to-End 1, ETE 2, ETE 3, GRT 6, GRT 7, and
Mission Sim
– ISOC Software Release 4 (July 25, 2006)
• Support remaining ETE’s 4, 5, and 6
LAT-PR-04500
Section 8 Management 14
GLAST LAT Project
ISOC CDR August 4, 2004
ISOC Cost Profile
FY04
FY05
FY06
FY07
FY08
ISOC Management
CHS Team
FSW Team
PVO Team
SDP Team
SAS Team
SAC Team
158.11
405.99
0.00
83.90
12.63
364.49
0.00
557.18
1450.14
346.68
652.51
467.00
1483.90
270.17
554.94
1484.14
1240.70
1264.75
703.94
2095.21
1716.84
638.92
1536.09
1284.12
1309.02
728.58
1839.66
1979.31
667.36
1186.11
906.47
1222.87
754.08
1825.76
2252.82
Total (Functional Units)
Total (With SAC)
1025.12
1025.12
4957.42
5227.58
7343.68
9060.52
7336.40
9315.71
6562.65
8815.46
The ISOC budget presented here is completely ‘off
project’ and is primarily funded by SLAC’s research
division.
LAT-PR-04500
Section 8 Management 15
GLAST LAT Project
ISOC CDR August 4, 2004
Procurement plans
• The large disk and CPU farms needed for pipeline storage and
processing are supplied by SCS.
• The handful of ISOC workstations will be procured in phases
but will all be in place for the final software release
• Third party software is largely in place already
– STK will be purchased in CY2004
– Final build/buy decisions on other tools by November ’04.
• No issues foreseen with H/W or purchased S/W.
LAT-PR-04500
Section 8 Management 16
GLAST LAT Project
ISOC CDR August 4, 2004
ISOC Risk Status
Number Date
Rank
Originator
Description
Mitigation
ISOC-0001
5/15/04
1
B. Craig
ISOC lacks accepted
architecture and plan
for software
implementation.
Trade study between
possible front ends to
be completed by
6/15/04. Hires into s/w
architecture position.
Successful CDR
retires risk
ISOC-0002
5/15/04
3
B. Craig
No response to PDR
RFAs
Schedule and track
RFA’s weekly. 3
remain as of 8/02
ISOC-0003
5/17/04
2
B. Craig
Inadequate staffing
plan for ISOC.
Draft staffing plan
complete. Culp,
Lemon, Steele hired,
S/W developers
needed in Sep/Oct
ISOC-0004
5/21/04
4
B. Craig
No facility location
identified for ISOC
Long-term solution
identified, short term
space to be requested
from SLAC
management.
LAT-PR-04500
Section 8 Management 17
GLAST LAT Project
ISOC CDR August 4, 2004
RFA 3 – ISOC Risk Status
Number Date
Rank
Originator
Description
Mitigation
ISOC-0005
5/21/04
2
B. Craig
No requirements
levied on I&T and Flt
S/W subsystems
Mechanism in place
with I&T and FSW
Final disposition after
joint requirements
review.
ISOC-0006
5/21/04
1
B. Craig
ISOC will be unable
to hold schedule due
to staffing delays and
unscoped work
Definition of work plan
follows architecture
development.
Additional support
supplied as requested
but need to balance
new hires vs transfers
from other
subsystems.
LAT-PR-04500
Section 8 Management 18
GLAST LAT Project
ISOC CDR August 4, 2004
Issues and Concerns
• Frontloaded software support needed.
– Need to limit hires to account for expected transfers from
other subsystems.
• Database architecture not as well developed as we would like
– Need to deliver I&T databases soon while retaining an
overall structure that makes sense for the ISOC
• Requirement completeness,
– late start adds risk of missing requirements
• Many software elements need to interoperate smoothly
– Early testing reduces problem, and certainly easier than
writing the code anew
LAT-PR-04500
Section 8 Management 19
GLAST LAT Project
ISOC CDR August 4, 2004
Summary
• Great effort from ISOC staff over past 3 months to respond to
PDR, devise and firm up an architecture for the ISOC.
• Help from GSFC (particularly Canevari, Teter & Greer) has
made a large impact and significantly improved our approach
• Although issues remain we are poised to build a system that
meets all requirements while meeting schedule.
LAT-PR-04500
Section 8 Management 20