GLAST LAT Project
Gamma-ray Large
Area Space
Telescope
Integration and Test CDR Peer Review, March 28, 2003
GLAST Large Area Telescope:
I & T Peer Review
EGSE/Online System
Elliott Bloom
SU-SLAC
Subsystem Manager
elliott@slac.stanford.edu
650-926-2469
Document: LAT-PR-01779-01
Section 6 - Page 1
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Outline
 How subsystem work integrates with I&T
 Items that are deliverables.
 Flow of Flight SW test and GSE migration
 Engineering Models
 EM 1 (ACD, CAL, DAQ, TKR)
 EM 2 (DAQ, Test Bed)
 CU (I&T)
 FU (I&T, IOC)
 Command and telemetry Database Coordination
 Test Bed for Verification
Document: LAT-PR-01779-01
Section 6 - Page 2
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Division of Responsibility
•
•
•
•
•
•
GLAST Mission
– Coordinate with spacecraft
vendor EGSE
LAT
– Coordinate EGSE flow
across subsystems
ELECTRONICS
– EGSE hardware (except for
workstation) & front end
software
I&T
– EGSE workstation,
workstation software and
support. I&T test, analysis,
visualization, and script
software
SAS
– LAT event reconstruction
software
IOC
– Ultimate customer
Document: LAT-PR-01779-01
Mission
LAT
SAS
I&T
Elect.
IOC
ONLINE
Section 6 - Page 3
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
EGSE Deliverables (Electronics + I&T Support)
• Hardware/Software support for various incarnations of I&T test-stands
 Engineering Model 1 (EM1). Delivered 12/02.
– Engineering Model 2 (EM2). Due 8/03.
– Calibration Unit (CU). Due 2/04
– Flight Unit (FU). Due 5/04.
• Test-stand system composition
 Infrastructure (workstations, networking, crates, etc.)
 Test executive
 Graphical User Interfaces (GUIs)
– Databases and tools
 Data analysis tools
 Data archiver
– Test procedures
 Code management, release control and distribution
 Remote debugging tools
Document: LAT-PR-01779-01
Section 6 - Page 4
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Migration
•
•
•
•
•
EM-1: No FSW beyond hardware drivers
– Will be used for the EM test (cosmic rays, Van de Graaff photons)
EM-1+: EM-1 plus additional code from FSW
– FSW for commanding, telemetry and housekeeping
EM-2: Development platform for multi-tower support
– Embedded systems run FSW code
– Commanding will be done through a more realistic dictionary
– Event format changes from TEM/AEM output to FSW filter output
– Test bench scripts will still be able to be run
CU: Four tower system used for the Beam Test at SLAC
– Limited ACD contribution
– Evolution of EM-2
– Will need to handle external sources of data
– 1553, SSR and SIS communications not required to satisfy test
– Test bench scripts will still be able to be run
FU/LAT: The complete system
– Communications through SIIS (1553 and SSR), and test point.
– Will need IOC/MOC-like interface.
– Test bench scripts will still be able to be run (via test point).
Document: LAT-PR-01779-01
Section 6 - Page 5
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Subsystem I&T Test-stand Requirements and Schedule
Type
Number of
instances
Release date
Development support
EM1
4
Done
Subsystem support
EM1
2 CAL+ 3 ACD +
4 TKR
Done
Integration Testing
EM1
1
Done
SLAC DAQ hardware
development
EM1
4
Done
Flight Software Testbed
EM2
1
5/03
Calibration
CU
2
3/04
Flight Unit I&T
FU
2
10/04
Test-stand
Document: LAT-PR-01779-01
Section 6 - Page 6
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
EGSE & Online Software
• Real-time system
– Embedded processors running the VxWorks RTOS
– Data acquisition and control by Trigger & Dataflow system
– Gathering of Housekeeping quantities
– 3rd party data acquisition, e.g., during beam tests
• LAT Test Executive (LATTE) developed using Python, Qt and
XML provides:
– Configuration management
– Commanding
– Online data acquisition, archiving and distribution
• Persistent data stored in FITS files
– Data quality and Housekeeping quantity monitoring
• Data visualization and analysis
– HippoDraw: a visualization tool.
Document: LAT-PR-01779-01
Section 6 - Page 7
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
EM1 EGSE Configuration
Online
Workstation
Subsystem
(or simulator)
CPU
• Commanding
• Telemetry
• Monitoring
AEM/TEM
• Hardware Drivers
LAT-COMM
DC Power
•External Trigger
• Test Exec
• Configuration
• Commanding
• Telemetry
• Event Processing
• Monitoring
• Visualization
• Data base
• Message logger
• Alerts
• Electronic log
Main Dataflow
Ethernet
Central
Database
WAN
Back door
debug RS-232
Ethernet
Ethernet Router
and Firewall
VME Chassis
External Hardware
Subsystem/simulator
Document: LAT-PR-01779-01
Electronics/Online
Section 6 - Page 8
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Testing LAT System: Tower EGSE
Power-PC
Processor
Flight
Software
28-V Power Supply
•
•
•
•
•
•
•
•
Processor: Motorola Power-PC
Flight Software
PMCIA LAT Communication Board for
– LAT Communication
Transition Board
– Trigger
TEM DAQ Assembly
TEM Power-Supply Assembly
28-V Supply
LAT-TD-00861
Document: LAT-PR-01779-01
LCB: LAT
Communication
Module
Transistion-card:
Trigger Module
TEM DAQ
Assembly
Tower Power
Supply
Assembly
(1.5V/2.5V/3.3V/
0-100V/0-150V)
Section 6 - Page 9
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
GASU Based Configuration (EM-2)
EGSE Crate
ACD
or
Sensor
Simulator
CPU
GASU
WAN
LCB
28 V Supply
VME
AEM
Central
Database
EBM
TEMs
Firewall
GEM
Online
Workstation
CAL, TKR
or
Sensor
Simulator
T&DF System (LAT)
Document: LAT-PR-01779-01
EGSE
SLAC
Section 6 - Page 10
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Beam Test (CU) Configuration
EGSE Crate
ACD
or
Sensor
Simulator
CPU
GASU
WAN
LCB
28 V Supply
VME
AEM
Central
Database
EBM
Firewall
GEM
Online
Workstation
TEMs
External Data
CAL, TKR
or
Sensor
Simulator
T&DF System (LAT)
CPU
LAT-COMM
External
Hardware
EGSE
SLAC
VME
Document: LAT-PR-01779-01
Section 6 - Page 11
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
ACD
or
Sensor
Simulator
GASU
SIU
Spacecraft
simulator
CPU
Discretes
1553
1553
LCB
28 V Supply
Central
Database
SSR
AEM
EBM
GEM
3 EPUs
TEMs
Test Point on
LAT EMI Skirt
T&DF System (LAT)
Document: LAT-PR-01779-01
Firewall
CPU
LCB
CAL, TKR
or
Sensor
Simulator
WAN
LAT Assembly Configuration
Online
Workstation
EGSE Crate
CPU
LCB
EGSE
SLAC
Section 6 - Page 12
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
ACD
or
Sensor
Simulator
GASU
SIU
Spacecraft
simulator
CPU
Discretes
1553
1553
LCB
28 V Supply
AEM
Central
Database
SSR
EBM
GEM
3 EPUs
TEMs
Test Point on
LAT EMI Skirt
T&DF System (LAT)
Document: LAT-PR-01779-01
Firewall
CPU
LCB
CAL, TKR
or
Sensor
Simulator
WAN
Complete Flight Unit Configuration
Online
Workstation
EGSE Crate
CPU
LCB
EGSE
SLAC
Section 6 - Page 13
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
FU On-Orbit Configuration
ACD
GASU
CPU
Discretes
1553
1553
LCB
28 V Supply
WAN
SIU
Spacecraft
Central
Database
SSR
AEM
GEM
3 EPUs
Firewall
EBM
CPU
LCB
TEMs
CAL
and
TKR
Test Point on
LAT EMI Skirt
IOC
Workstation
(Flight cover
installed Green Tag
item)
T&DF System (LAT)
Document: LAT-PR-01779-01
MOC
SLAC
Section 6 - Page 14
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Command and telemetry Database Coordination
• The command and telemetry database must be coordinated
between FSW, I&T and IOC.
• IOC will build upon and maintain the software produced by I&T.
• The Schema describing commands and telemetry will written
in a meta language (TBD, e.g., XML or MySQL)
• Schema design will be driven by the details of the ITOS and
Astro RT data bases. We will have the ability to translate to
either.
• The choice of META language may be influenced by the ease of
creating/changing/maintaining the data base.
• The decision of META language and the database partially
populated by IOC CDR.
Document: LAT-PR-01779-01
Section 6 - Page 15
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Flight Software Test Bed - EGSE Verification
•
•
•
•
•
•
•
Full DAQ set with EM2 hardware (identical interfaces and functionality as flight)
Incremental built according to plan (complete test bed Feb04)
All DAQ modules including 16 TEM’s
TKR and CAL front-end electronics for 1 tower, front-end simulator boards for
other 15 towers
Harness like flight
TKR and CAL Electronics Simulators
Full set of ACD EM2 electronics
– DAQ electronics module (DAQ-EM)
Spectrum Astro SC simulator
– Power-supplies for tower electronics
Global-Trigger/ACD-EM/Signal-Distribution Unit*
3 Event-Processor Units (2+1 spare)
– Event processing CPU
– LAT Communication Board
Spacecraft Interface Unit
–
–
–
Spacecraft Interface
Board (SIB): Spacecraft
interface, control & data
LAT control CPU
LAT Communication
Board (LCB): LAT
command and data
interface
EPU-1
EPU-2
Pwr Dist. Box
spare
spare
GASU
spare
spare
ACD
spare
Spectrum Astro
Simulator
SIU
SC
simulator
EPU-3
Power-Distribution Unit (PDU)*
– Spacecraft interface,
power
– LAT power distribution
– LAT health monitoring
12 ACD Electronics Cards
LAT EGSE
LAT EGSE
Document: LAT-PR-01779-01
Section 6 - Page 16
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Extra Slides
Document: LAT-PR-01779-01
Section 6 - Page 17
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Quantities (1)
TEM Functional Block Total Number per TEM
GTEM
Tower Electronics Module
GCCC
Calorimeter Cable Controller
GCRC
Calorimeter Readout Controller
GCFE
Calorimeter Front-End ASIC
GTCC
Tracker Cable Controller
GTRC
Tracker Readout Controller
GTFE
Tracker Front-End ASIC
GTIC
Trigger Interface Controller
Totals:
Document: LAT-PR-01779-01
Number of Registers per Block
1
6 x 32-bits
4
7 x 32-bits
16 = 4 x 4
8 x 16-bits
192 = 16 x 12
3 x 16-bits
8
6 x 32-bits
72 = 8 x 9
2 x 64-bits
1728 = 72 x 24
5 x 64-bits
1
18 x 32-bits
~2000
~10000
Section 6 - Page 18
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Quantities (2)
AEM Functional
Block
GAEM
ACD Electronics Module
GARC
Calorimeter Readout Controller
GAFE
Calorimeter Front-End ASIC
Totals:
Total Number per AEM
Number of Registers per Block
1
5 x 32-bits
12
43 x 16-bits
216 = 18 x 12
11 x 16-bits
~200
~3000
1 LAT = 16 TEMs + 1 AEM + 1 GEM
= ~160000 + ~3000 + few registers
= ~165000 registers
Document: LAT-PR-01779-01
Section 6 - Page 19
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Multi-Tower and ACD System EGSE (EM2)
Document: LAT-PR-01779-01
Section 6 - Page 20
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Transition Board
Document: LAT-PR-01779-01
Section 6 - Page 21
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
DAQ EGSE to support ACD FREE
Document: LAT-PR-01779-01
Section 6 - Page 22
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Event Building/CPU Communications
LAT
GASU
GLT
AEM
Tower 0
Tower 15
EPU 0 Tx
EPU 1 Tx
SIU Tx
Document: LAT-PR-01779-01
20 Mbps
20 Mbps
20 Mbps
20 Mbps
?? Mbps
20 Mbps
160 Mbps
20 Mbps
160 Mbps
20 Mbps
160 Mbps
SSR
EPU 0 Rx
EPU 1 Rx
SIU Rx
Section 6 - Page 23
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
GASU
SIU
GASU
Command/Response
RAD750
cPCI
CRU
? x ? bit registers
PDU
TEM0
TEM1
TEM2
.
.
TEM15
SIB
LCB
EB
31 x 32 bit registers
EPU
cPCI
RAD750
Event Builder
SIU In
SIU
EPU 0 In
(SIB)
EPU 1 In
LCB
Merge
EPU 0
GEM
EPU 1
22 x 32 bit registers
17 x 64 bit registers
19 x 96 bit registers
1 x 112 bit register
SSR
cPCI
EPU
RAD750
AEM
(SIB)
GEM
LCB
Event Data Fragments
Combinatoric
Logic
TEM0
TEM1
TEM2
.
.
TEM15
Event Data
Command/Response
Trigger Data
Trigger Data
Document: LAT-PR-01779-01
Section 6 - Page 24
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
T&DF Overall Architecture (not accurate)
Tower Front End Electronics
Tower Electronics Module
Tower PWR Mgt
HSK/LRS
TKR
CAL
TKR ASICS
Spacecraft
~4
16
Event Builder
C
O
N
T
R
O
L
P
C
I
Processor
CAL ASICS
B
U
S
1
CPU I/O
Trigger Primitives
ACD Electronics Function
ACD Front End Electronics
Event Processing Unit
Interconnect Function
Global Trigger Function
Spacecraft Interface Unit
DAQ PWR Mgt
Tower PWR Mgt
HSK/LRS
ACD
ACD ASICS
C
O
N
T
R
O
L
C
O
N
T
R
O
L
HSK/LRS
~4
TRG FIFO
CPU I/O
LAT I/O
TRG Configuration
P
C
I
B
U
S
1553
Processor
SSR
Trigger Primitives
Trigger Logic
Spacecraft I/O
Discretes
Key
Trigger Primitives:
Trigger Message:
Document: LAT-PR-01779-01
Event Data:
All event fragments:
Configuration/Housekeeping/Low Rate Physics Data:
Command, Configuration and Control:
Section 6 - Page 25
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Hardware hierarchy
LAT
GASU
GEM
AEM
TEM
GLT
RC
CC
FE
RC
FE
Document: LAT-PR-01779-01
Section 6 - Page 26
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Software hierarchy
GTEM
GCCC
registers
GTIC
GCRC
registers
registers
GTCC
registers
GTRC
registers
GCFE
registers
GTFE
registers
Tower Electronics Module
GAEM
registers
GGEM
GARC
registers
GAFE
registers
AntiCoincidence Detector Electronics Module
Document: LAT-PR-01779-01
registers
GGLT
registers
Global Trigger Electronics Module
Section 6 - Page 27
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Run Control State Diagram
Reset
Setup
Teardown
Stopped
Start run
Stop
Stop run
Pause
Paused
Resume
Running
Document: LAT-PR-01779-01
Section 6 - Page 28
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Run Control
Document: LAT-PR-01779-01
Section 6 - Page 29
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
HippoDraw Views (1)
Document: LAT-PR-01779-01
Section 6 - Page 30
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
HippoDraw Inspector
Document: LAT-PR-01779-01
Section 6 - Page 31
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Housekeeping Monitoring
Document: LAT-PR-01779-01
Section 6 - Page 32
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Message Logger
Document: LAT-PR-01779-01
Section 6 - Page 33
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Block Diagram Tower EGSE
Document: LAT-PR-01779-01
Section 6 - Page 34
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Read Schema
simpleTemschema.xml read
GTEM 0, GCCC 3, GCRC 0
selected
Document: LAT-PR-01779-01
Section 6 - Page 35
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Write Schema
New GLAT, TEM 0 added
Document: LAT-PR-01779-01
GCCCs for TEM 0 added
Section 6 - Page 36
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Write Schema
GCRCs for GCCC 0 added
Document: LAT-PR-01779-01
GCFEs for GCCC 0, GCRC 0 added
Section 6 - Page 37
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Software block diagram
Workstation (NT, Python, etc.)
Disp.
tools
Command
Client
Script
Execution
Engine
Data
Logger
Document: LAT-PR-01779-01
Embedded System (VxWorks)
Command
Server
Network
Interface
Event Data
Client
Network
(LAN or 1553)
Network
Interface
Processing
Hardware
Interface
Event Data
Server
Section 6 - Page 38
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
System Block diagram
Ethernet
Debug
1553
SSR
Analogs
Discretes
Power
LAT
Spacecraft
Interface
Simulator
Document: LAT-PR-01779-01
“MOC”
CCSDS
packets
Online
“IOC”
CCSDS
packets
MOC simulator
Section 6 - Page 39
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Command Model
Online/EGSE Test stand/Instrument
Command
Request
“IOC”
CCSDS
packets
Open
Raw Cmd
Encoder
Raw Cmd
Decoder
Raw
Command
Packet
Raw
Command
Packet
Raw to CCSDS
CCSDS to Raw
Open CCSDS
Command
Packet
Open CCSDS
Command
Packet
Obfuscator
Deobfuscator
NDA/ITAR
Command
Packet
NDA/ITAR
Command
Packet
Command
Dispatch
Restricted
“MOC”
CCSDS
packets
Document: LAT-PR-01779-01
Section 6 - Page 40
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Telemetry Model (1)
Test stand/Instrument Online/EGSE
TEM
or
AEM
Event Data
Server
Raw
Data
Packet
Raw
Data
Packet
Event Data
Dispatch
• Only one TEM or AEM allowed in the system at a time
Document: LAT-PR-01779-01
Section 6 - Page 41
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Telemetry Model (2)
Test stand/Instrument Online/EGSE
TEM
…
Raw Data
Filter (EPU)
AEM
Event
Data
Packet
Event
Data
Packet
Event Data
Dispatch
• Multiple contributors (TEMs, AEM, GEM, filter statistics, etc.)
allowed
Document: LAT-PR-01779-01
Section 6 - Page 42
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Telemetry Model (3)
Test stand/Instrument Online/EGSE
TEM
…
Raw Data
Filter (EPU)
Event Data
Compression
CCSDS
Encoding
Telemetry
Data
Packet
Event Data
Decompression
Event Data
Dispatch
AEM
Telemetry
Data
Packet
CCSDS
Decoding
• Multiple contributors (TEMs, AEM, GEM , filter statistics, etc.)
allowed
• Development for EM-2
• Will also be used for the CU beam test
Document: LAT-PR-01779-01
Section 6 - Page 43
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
EGSE: Front-End Data Simulator
One of 16
Towers
7
PC (one for 2 TEM’s)
0
T
C
P
I
P
•
•
•
•
•
H
a
r
d
D
i
s
k
PCI Bridge Card
PCI Bridge Card
PCI Bridge Card
TEM
High-Speed
Serial
Connection
P
C
I
CAL FrontEnd Data
Simulator
P
C
I
TKR FrontEnd Data
Simulator
Data into TEM
like CAL and
TKR subsystem
electronics
PCI Bridge Card
System uses 9 PC’s
– 8 PC’s for 16 TEM’s
– 1 PC for ACD
Data transported to towers via high-speed data link; PCI bridge to local bus on
simulator
Data Simulators interface to TEM like CAL and TKR sub-system electronics
– CAL and TKR simulator board identical except code in FPGA’s
– Patch cable connect simulator to CAL and TKR TEM connectors
Can operate TEM or LAT with data generated from simulations
Data simulator board in layout
Document: LAT-PR-01779-01
Section 6 - Page 44
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
Verification & Test: Spacecraft Interface
•
•
•
•
•
Use Spectro-Astro provided Spacecraft
Instrument Interface Simulator (SIIS)
Power
– Manual off-on switch
Control & Data Handling (C&DH)
– MIL1553
– Science Interface (LVDS)
– 1-PPS timing signal (LVDS)
– GBM GRB Candidate signal (LVDS)
– Discretes (CMOS)
– Analog Monitoring
Present Plan is for SIIS to only provide
– primary interface
• can’t test prim-redundant interface
response
– Timing accuracy of 1 PPS interface not
sufficient to test timing interface
performance
Work in progress
Power
MIL1553
SIIS
Science Data
LAT
1 PPS
GBM GRB
Candidate
Discretes
Digital
Analogs
LVDS: Low-Voltage-Differential-Swing signaling
Document: LAT-PR-01779-01
Section 6 - Page 45
GLAST LAT Project
Integration and Test CDR Peer Review, March 28, 2003
I&T Schedule Overview
•
•
•
•
•
•
•
EM test
– March/April 2003 through September 2003
– EM-1+ FSW coming August 2003
CDR
– May 2003
SIIS (Spacecraft Instrument Interface Simulator)
– April 2003
CU beam test
– April/June 2004
FU/LAT integration & Test
– June 2004/January 2005
Environmental testing at NRL
– February/May 2005
Ready to ship
– May/June 2005
Document: LAT-PR-01779-01
Section 6 - Page 46