XCS Instrument Final Instrument Design Review
XCS Photon Controls and Data Systems
Gunther Haller
LUSI XCS FIDR
June 17, 2009
1
1
G. Haller
haller@slac.stanford.edu
Near and Far Hall Hutches
Near Experimental Hall
1
AMO
Part of
LCLS
2
SXR
X-ray Transport
3
4
XCS
Mono
XPP
XCS
5
6
CXI
H6
Installation
Part of LCLS
MEC
ARRA Funds
Beam Transport
LCLS
LUSI
Offset Monochromator
Exp. Chamber
Detector
H6
LUSI XCS FIDR
June 17, 2009
Far Experimental Hall
2
2
G. Haller
haller@slac.stanford.edu
LCLS X-Ray Endstation (XES) Provided Controls
Subsystems
Following sub-systems are provided to XCS by LCLS
XES and are thus not described in this review (reviewed
separately)
Hutch Protection System
Machine Protection System
User Safeguards (include Oxygen Deficiency Monitoring)
Laser Femto-Second Timing System
Machine Timing System
Networking
EPICS Control system
Online/Offline Processing System
LUSI XCS FIDR
June 17, 2009
3
3
G. Haller
haller@slac.stanford.edu
Specification and Interface Control Documents
Released Engineering Specification Documents (detailed
requirements regarding controls and data systems needs
of instrument)
XCS Controls ESD (SP-391-001-24)
XCS DAQ ESD (SP-391-001-26)
Released Interface Control Documents (specify where the
interface is, who is responsible for what)
XES-LUSI ICD (1.1.523)
XES XCS Controls ICD (SP-391-001-25)
Status: all documents are released
http://confluence.slac.stanford.edu/display/PCDS/CXI_XCS-PDR
LUSI XCS FIDR
June 17, 2009
4
4
G. Haller
haller@slac.stanford.edu
Reviews
XCS Controls and Data Systems Preliminary Design Review held May
11, 09
Presentations are at
http://confluence.slac.stanford.edu/display/PCDS/CXI_XCS-PDR
Many controls items are already used in other (earlier) photon
sections, XTOD and AMO, both are past the Final Design Review
stage and are being assembled. XTOD is in the commissioning stage.
In addition XPP and CXI will be installed before XCS.
LUSI XCS FIDR
June 17, 2009
5
5
G. Haller
haller@slac.stanford.edu
Risks and Procurements
No technical, schedule, cost risk items except
Usual risk that devices are changed or added without controls
being informed
Mitigated by
Regular meetings
Keep ESD and ICD documents up-to-date
No long term lead-time or > $100k items
Components are ordered with sufficient margin
LUSI XCS FIDR
June 17, 2009
6
6
G. Haller
haller@slac.stanford.edu
ES&H
Hutch Protection Systems provided by LCLS XES, hutch 4
(XCS) is the fifth hutch to be operated
Same for User Safeguards (Oxygen Deficiency Monitor)
Electrical Safety
All cables/equipment are rated for their use
All equipment will be NRTL listed or inspected and approved under
SLAC's Electrical Equipment Inspection Program
LUSI XCS FIDR
June 17, 2009
7
7
G. Haller
haller@slac.stanford.edu
XCS Instrument
Hutch 4
Optics, Diffractometer
Large Angle detector Mover
X-Ray Transport Hall (XRT)
Split and Delay Area
Post-Monochromator
Large Offset Monochromator
LUSI XCS FIDR
June 17, 2009
8
8
G. Haller
haller@slac.stanford.edu
Controls Subsystems
Vacuum
Motion
Viewing
Power Supplies
Racks and Cabling
Other items
Software: EPICS/Python/Qt
Type of controls
Valve Control
Vacuum Controls
Pop-In Profile Monitor Controls
Pop-In Intensity Monitor Controls
Intensity-Position Monitor Controls
Slit Controls
Attenuator Controls
Pulse Picker Controls
X-Ray Focusing Lense Control
Vision Camera Controls
Detector Stage Controls
DAQ Controls
LUSI XCS FIDR
June 17, 2009
9
9
G. Haller
haller@slac.stanford.edu
XCS Components to Control
X-Ray Optics and Support Tables, Stopper
Motion
Viewing
Diffractometer
Motion
Large Angle Detector Mover
Motion
XRT Large Offset Mono
Motion
XRT Post Mono
Motion
Split-And-Delay
3rd Party, need integration
Vacuum System
XRT and Hutch 4: Valve and Vacuum Controls
LUSI XCS FIDR
June 17, 2009
10 10
G. Haller
haller@slac.stanford.edu
XCS Components to Control con’t
Diagnostics and Common Optics
Pop-In Profile Monitor
Motion, Viewing
Pop-In Intensity
Motion, Digitization
Intensity Position
Motion, Digitization
Slit System
Motion
Attenuator
Motion
Pulse-Picker
Motion, Viewing
X-Ray Focusing Lense
Motion
Harmonic Rejection Mirror
Motion
XCS specific interface and programming
Racks & Cabling
Workstations
Vision Cameras
Beam Line Processor
Channel Access Gateway
Machine Protection System
Configuration
Data Acquisition
LUSI XCS FIDR
June 17, 2009
11
11
G. Haller
haller@slac.stanford.edu
EPICS/Python/Qt
EPICS (Experimental Physics and Industrial Control System):
Control software for RT systems
Monitor (pull scheme)
Alarm
Archive
Widely used at SLAC and other labs
More: http://www.aps.anl.gov/epics/
Python/Qt is a user interface between the EPICS drivers and records
and the user
System is used for XTOD and AMO, provided as part of the XES
Photon Controls Infrastructure
Support for “spec” interface. spec sits on top of EPICS and provides
an alternative scripting environment for instrument control. Support is
provided to facilitate porting of spec scripts used at other facilities.
LUSI XCS FIDR
June 17, 2009
12 12
G. Haller
haller@slac.stanford.edu
Example of Python/Qt user interface
LUSI XCS FIDR
June 17, 2009
13 13
G. Haller
haller@slac.stanford.edu
Example: Vacuum
All gauge controllers are MKS 937A
Interface
Terminal server – DIGI TS16 MEI
Automation Direct PLC
All ion pump controllers are Gama Vacuum DIGITEL MPC dual
All valves are controlled by PLC relay module
The out/not-out state of all valves go into the MPS system to prevent
damage if a valve closes unexpectedly.
LUSI XCS FIDR
June 17, 2009
14 14
G. Haller
haller@slac.stanford.edu
Example: Motion
Control System provides support for all motions
Motors
IMS MDrive Plus2 integrated controller and motor
IMS MForce Plus2 controller for control of in vacuum and other specialized
motors
Newport motor controllers
Others as required
Pneumatic motion
Solenoid Driver chassis, SLAC 385-001
LUSI XCS FIDR
June 17, 2009
15 15
G. Haller
haller@slac.stanford.edu
Fast (DAQ) Camera System
LUSI XCS FIDR
June 17, 2009
16 16
G. Haller
haller@slac.stanford.edu
Data System Architecture
Instrument
specific
Photon Control Data Systems (PCDS)
Beam Line
Data
L1: Acquisition
(Many)
Digitizers + Cameras
Timing
L0: Control
(One)
L2: Processing
(Many)
L3: Data Cache
(Many)
DAQ system primary features
Trigger and readout
Process and veto
Monitoring
Storage
Provided to by XES, same system as used for AMO and XPP and CXI
LUSI XCS FIDR
June 17, 2009
17 17
G. Haller
haller@slac.stanford.edu
XAMP plus XCS 2D-Detector Control and DAQ Chain
Beamline Instrument Detectors
Fiber
XPP/XCS 2D detectorASIC
XAMP (XPP) LUSI instrument custom integrated
circuits from Brookhaven are already connected at
SLAC to SLAC LCLS high-performance DAQ
system
XPP BNL XAMP Detector 1,024 x 1,024
array
Uses 16 each 64-channel FexAmps
BNL custom ASICs
Instantaneous readout: 4 ch x 20
MHz x 16bit= 20 Gbit/sec into FPGA
Output FPGA: 250 Mbytes/s at 120
Hz (1024x1024x2x120)
First use XPP detector
Detector for XCS in design at BNL
ASIC for XCS is modification of XPP ASIC, is in
design
LUSI XCS FIDR
June 17, 2009
SLAC FPGA
front-end
board
ATCA crate with SLAC
DAQ boards, e.g. the
SLAC Reconfigurable
Cluster Element Module
ATCA
Advanced Telecommunication Computing Architecture
Based on backplane serial communication fabric, 10-G E
2 SLAC custom boards (also used in other SLAC experiments)
8 x 2.5 Gbit/sec links to detector modules
Dataflow and processing
Managed 24-port 10-G Ethernet switching
Essentially 480 Gbit/sec switch capacity
Naturally scalable
18 18
G. Haller
haller@slac.stanford.edu
XCS Online Processing
Electronics gain correction (in RCE)
Response of amplifying electronics is mapped during calibration
Science data images are corrected for channel gain non-uniformity + non-linearity.
Dark image correction (in RCE)
Dark images accumulated between x-ray pulses
Averaged dark image subtracted from each science data image
Flat field correction (in RCE)
Each science data image is corrected for non-uniform pixel response
Event filtering (in RCE or later)
Events are associated with beam line data (BLD) via timestamp and vetoed based upon BLD
values. Veto action is recorded.
Images may be sparsified by predefined regions of interest.
LUSI XCS FIDR
June 17, 2009
19 19
G. Haller
haller@slac.stanford.edu
XCS Online Processing con’t
Event processing (processing stage)
Examples are
Sparcification (region of interest)
Locating center
Reducing data by binning pixels
Mask errant pixels (saturated, negative intensity from dark image subtraction due to e.g. noise, nonfunctioning pixels, edge pixels from moving center)
Filling in missing data with centro-symmetric equivalent points
Transforming camera geometry due solid angle coverage and dead space between tiles
Radial averaging, showing intensity versus scattering angle or momentum transfer
Compute 2D autocorrelation function (single FFT) and store. Essentially at rate of 1 Hz with 4 MB (2Mpixel x
2 bytes) frames.
Peak finding (locate and fit Gaussian intensity peaks). There may be multiple peaks in some cases and the
peak finding algorithms should be able to identify up to a few thousand peaks.
LUSI XCS FIDR
June 17, 2009
20 20
G. Haller
haller@slac.stanford.edu
XCS Monitoring
A copy of the data is distributed (multicast) to monitoring nodes on the DAQ
subnet.
The monitoring nodes will provide displays for experimenters’ viewing:
corrected detector images at ≥ 5 Hz
histories of veto rates, beam intensity, + other BLD values.
Reduced analysis of sampled binned data (versus scan parameter) or other
processing tbd
Implemented with Qt (C++/Python open source GUI)
LUSI XCS FIDR
June 17, 2009
21 21
G. Haller
haller@slac.stanford.edu
Common Diagnostics Readout
E.g. intensity, profile monitor, intensity
position monitors
E.g. Canberra PIPS or IRD SXUV large
area diodes (single or quad)
Amplifier/shaper/ADC for
control/calibration/readout
Quad-Detector
R2
q1
q2
R1
Target
L
• Fourdiode
design
• On-board calibration circuits not shown
• Board designed, fabricated, loaded, is in test
LUSI XCS FIDR
June 17, 2009
22 22
G. Haller
haller@slac.stanford.edu
WBS for LUSI XCS Controls & Data Systems
1.6.5.1 XCS H3 Controls Requirements, Design and Setup
1.6.5.2 XCS H3 Standard Hutch Controls
1.6.5.3 XCS H3 Specific Controls
LUSI XCS FIDR
June 17, 2009
23 23
G. Haller
haller@slac.stanford.edu
Milestones
Controls Dates for Installation in FEH (incremental
installation driven by instrument component availability)
Start: Early
Finish: Early
Finish “Early Science” Commissioning before
LUSI XCS FIDR
June 17, 2009
24 24
~Dec 2010
~Mar 2011
~Jun 2011
G. Haller
haller@slac.stanford.edu
Summary
Interface and Requirements documents released
Clear what needs to be done
No issues, design meets requirements
Design Mature
Most items are already used (hardware and software) in XTOD and AMO, plus XPP
and CXI ahead of XCS
XCS Preliminary Design Review completed
Most items similar to XTOD and AMO which already had Final Design Reviews for
Controls and Data Systems (XTOD is being installed, AMO will follow in July 09)
Team
Engineers and technicians from PPA Research Engineering Group, sufficient manpower available for XCS
LUSI XCS FIDR
June 17, 2009
25 25
G. Haller
haller@slac.stanford.edu