Electron Controls
System Status
FAC
June 2009
1
1
Patrick Krejcik
pkr@slac.stanford.edu
Progress since the last FAC
E-beam controls installation complete
~40 accounts have been closed
CPI & SPI indices  1
High level of controls integrity achieved with
successful pre-beam checkout
E-beam cleanly transported to final dump in just a few
shots
Controls, diagnostic and software in place to achieve
lasing ahead of schedule
Moving forward to off-project activities
E.g. fast feedback
FAC
June 2009
2
2
Patrick Krejcik
pkr@slac.stanford.edu
Responses to Comments from the Last FAC
Control Progress
“End (of the tunnel) is in sight”
We are out of the tunnel into the sunshine
Beam cleanly transported through to final dump in just a few shots
MPS
MPS is now in routine operation
PPS
LTU-Undulator-Dump PPS commissioned
FEC, NEH PPS to be commissioned mid June
Software
Test plans now routinely used for software installation
Coordinated through Elog and Controls Deputy
Controls Program Deputy in MCC is a good thing
Continuing until start of operations for science
Feedback
Team in place and working
RDB
Plans exist to move it inside LCLS network
done
A dedicated controls DBA would be an advantage
Interviewing new hires
Future Upgrades
In progress
HLAs
Identify those apps that benefit most from the conversion from Matlab
Online mode and RDB in full swing for all HLAs; Testing and Releasing new Java LEM HLA this
week
Patrick Krejcik
3
3
FAC
June 2009
pkr@slac.stanford.edu
IOC Installation statistics
As of June 2009
Number of IOCs in LCLS system:
326 IOCs in total
124 iocs
155 embedded iocs
47 soft iocs
366,902 PVs in total
FAC
June 2009
4
4
Patrick Krejcik
pkr@slac.stanford.edu
IOC Reliability
Reliability and seamless recovery from
reboots are focus of our present attention
We initiated a IOC Reliability Reboot
Festival
Scheduled for completion including the
final report and checked-off spreadsheet
by June 2009
FAC
June 2009
5
5
Patrick Krejcik
pkr@slac.stanford.edu
IOCs RTEMS Upgrade Status
IOC administrative management for reliability
required enhancements to RTEMS
223 Upgraded to RTEMS 4.9.1
33 Still with RTEMS 4.7.1
23 IOCs Pending upgrades
-------------------------------------------------279 Hard IOCs in Total (iocs + eiocs)
FAC
June 2009
6
6
Patrick Krejcik
pkr@slac.stanford.edu
Selected Highlights from Critical Subsystems
PPS
MPS
Timing System
BPMs
Motion Controls
Laser Heater controls
High-level Applications
Fast Feedback
FAC
June 2009
7
7
Patrick Krejcik
pkr@slac.stanford.edu
PPS
New LTU and Undulator PPS fully operational
FAC
June 2009
8
8
Patrick Krejcik
pkr@slac.stanford.edu
PPS Front End Enclosure
On schedule for commissioning mid June
New hires to support further upgrades
FAC
June 2009
9
9
Patrick Krejcik
pkr@slac.stanford.edu
Distributed Machine Protection System
Fully operational,
protecting undulator and beamlines
Fast beam shutoff at photoinjector & kicker
FAC
June 2009
10 10
Patrick Krejcik
pkr@slac.stanford.edu
MPS Link Nodes
32 Link Nodes, each with:
Eight analog inputs for each SLAC QADC
IndustryPack Module
Two Rocket IO transceivers (one for GbE)
Serial connections with USB 1.1 and RS-232
Ninety-six digital inputs
Eight SSR outputs
Four TTL trigger inputs
Four TTL trigger outputs
FAC
June 2009
11
11
Patrick Krejcik
pkr@slac.stanford.edu
MPS Databases and Configuration Control
All MPS Input
Devices
up to 3000 channels
MPS logic – truth
tables
Auto documentation
feature
MPS fault history
database
Post mortem analysis
Statistical analysis of
performance
FAC
June 2009
12 12
Patrick Krejcik
pkr@slac.stanford.edu
MPS User Interface
Multiple
views
Summary
Inputs
Logic
History
FAC
June 2009
13 13
Patrick Krejcik
pkr@slac.stanford.edu
MPS Next Steps & Lessons Learned
Begin conversion of upstream linac
systems to new MPS
Old TIU hardware is unreliable
Problems we encountered
Redundant timing verification for gated
signals and actuators
Scope creep
Laser heater protection
Photoinjector maintenance activities
Beam loss monitor synchronous acquisition
Beam loss monitor dose integration
FAC
June 2009
14 14
Patrick Krejcik
pkr@slac.stanford.edu
LCLS Timing/Event System Architecture
~
Linac main drive line
Low Level RF
FIDO
PDU
Raw 360 Hz
Linac
Master Osc
SLC
MPG
LCLS Timeslot Trigger
LCLS Master 476 Sync/Div
MHz
Oscillator
119 MHz
360 Hz
P
E
I
LCLS
N SLC
O events V
E events
C
G
T
*
F
A
N
EPICS Network
*MicroResearch
FAC
June 2009
LCLS Timing System
components are in RED
System is based around the
EVent Generator and EVent
Receiver
fiber
distribution
I E
O V
C R*
P P
m N D
P E U
T
Precision<10 ps
D
E
V
TTL-NIM
convert.
TTL
Digitizer
LLRF
BPMs
Toroids
Cameras
Wire Scanner
SLC klystrons
SLC Trigs
15 15
Patrick Krejcik
pkr@slac.stanford.edu
Timing System Upgrades
Reliability and maintenance issues
Need status of the RF clock into the control system.
Diagnostics from the fanout modules.
Upgrade front end timing hardware
Make the new EVG a standalone system
Move functions from the old timing system master
pattern generator to the EVG IOC.
Correct handling of multiple event codes (accelerate and
standby)
When 2 event codes trigger a device on the same pulse, the
second event restarts the delay. The second event must be
ignored instead.
Interrupt from the EVG on fiducial trigger (AC line
trigger).
FAC
June 2009
16 16
Patrick Krejcik
pkr@slac.stanford.edu
LCLS Beam Diagnostics
L0
TCAV0
heater
L1X
3 wires
2 OTR
3 OTR
4 wire
scanners
L1S
3 wires
3 OTR DL1
135 MeV
sz1
BC1
250 MeV
L2-linac
stopper
sz2
L3-linac
BC2
TCAV3
4.3 GeV 5.0 GeV
old
screen
BSY
DL2
14 GeV 14 GeV
2 Transverse RF cavities (135 MeV & 5 GeV)
179 BPMs
13 Toroids
7 YAG screens (at E 135 MeV)
12 OTR screens at E  135 MeV
15 wire scanners (each with x & y wires)
CSR/CER pyroelectric bunch length monitors at BC1 & BC2
4 beam phase monitors (2856 – 51 MHz)
3 Energy spectrometers: Gun, injector, dump
FAC
June 2009
17 17
4 wire
scanners +
4 collimators
m wall
gun
vert.
dump
undulator
14 GeV
• YAG screens
• OTR screens
• Wire scanners
Patrick Krejcik
pkr@slac.stanford.edu
Beam Position Monitors
Stripline BPMs
Digitizer in successful operation for some time since
injector commissioning
Exceeded specifications and as a bonus meet requirements
for the 0.02 nC LCLS operation.
Successfully commissioned in the new LTU beamline
this year
Upgrade of the remaining linac BPMs scheduled for
this year
RF Cavity BPMs
Successfully commissioned this year
also outperformed LCLS design requirements
New VME form factor
FAC
June 2009
18 18
Patrick Krejcik
pkr@slac.stanford.edu
BPMS
Stripline BPMs equipped with EPICS controlled digitizers
Superior resolution (few microns) and stability
(continuously calibrating)
Upgrade entire linac
FAC
June 2009
19 19
Patrick Krejcik
pkr@slac.stanford.edu
BPM Performance
Noise can be measured by performing
a linear regression to predict one BPM
reading based on the other BPMS.
FAC
June 2009
Beam / BPM stability for 1 day at
end of Injector. Approximately
15 um RMS, Beam size ~50um RMS
at this location
20 20
Patrick Krejcik
pkr@slac.stanford.edu
Undulator Cavity BPM and Quad
FAC
June 2009
21 21
Patrick Krejcik
pkr@slac.stanford.edu
Readout
4 Channel VME
ADC
(1 of 36)
FAC
June 2009
Undulator Readout
Racks (1 of 2)
22 22
Patrick Krejcik
pkr@slac.stanford.edu
SLAC 4-Channel VME Digitizer
4 channels
16 bits
LTC2208 ADC chip
Up to 130 M samples/sec
Optional: use internal 120
MHz clock
Typically use external 119
MHz clock locked to linac RF
Optional quadrature digital
IF downconversion in
FPGA
(not used at present)
FAC
June 2009
23 23
Patrick Krejcik
pkr@slac.stanford.edu
Resolution Measurement
Example:
Fit the 26th BPM (the BPM on the 23rd
undulator girder) to a linear combination
of Y measurements in previous 2 BPM
and next 2 BPM 120 beam pulses.
Plot fit & residual.
FAC
June 2009
0.2 micron resolution
24 24
Patrick Krejcik
pkr@slac.stanford.edu
Precision undulator measurements with BPM
Measure ~10 nr deflection due to
undulator field integral measurement
FAC
June 2009
25 25
Patrick Krejcik
pkr@slac.stanford.edu
BPM Orbit Display GUI
FAC
June 2009
26 26
Patrick Krejcik
pkr@slac.stanford.edu
Buffered data from the Orbit Display GUI
Beam Synchronous Acquisition
FAC
June 2009
27 27
Patrick Krejcik
pkr@slac.stanford.edu
40 Undulators Delivered, ~30 Installed
FAC
June 2009
28 28
Patrick Krejcik
pkr@slac.stanford.edu
Undulator Motion Control
Multiple degrees of freedom controlled by physics parameters
Beam Finder Wire
FAC
June 2009
Undulator alignment
29 29
Quad alignment
Patrick Krejcik
pkr@slac.stanford.edu
Undulator Magnet and Motion Controls
FAC
June 2009
30 30
Patrick Krejcik
pkr@slac.stanford.edu
Undulator Beam-Based Alignment Converged
Final
Round of
BeamBased
Alignment
Earth’s field
pattern
RMS = 64 µm
100 µm
Verify
alignment
with quad
strength
variations
RMS = 26 µm
40 µm
FAC
June 2009
31 31
Patrick Krejcik
pkr@slac.stanford.edu
Undulator Re-Pointing
FAC
June 2009
32 32
Patrick Krejcik
pkr@slac.stanford.edu
Laser Heater Controls Commissioning
YAGS2
RF deflector ON
energy
time
Laser OFF
σE/E < 12 keV
YAGS2
Laser-Heater to increase
energy spread
Dec. 10, 2008
Laser: 40 µJ
σE/E  45 keV
FAC
June 2009
33 33
YAGS2
Laser: 230 µJ
σE/E  120 keV
Patrick Krejcik
pkr@slac.stanford.edu
Tuning of the laser heater for optimum energy spread
Laser OFF
FAC
June 2009
Laser energy 230 µJ
σE/E  120 keV
Laser energy 210 µJ
σE/E  110 keV
Laser
size too
large
Laser
size
matched
34 34
Patrick Krejcik
pkr@slac.stanford.edu
Laser Heater System Device Block Diagram
Power Meter Sensors
J-10MB-LE-5m
J25LP-3-010
J50LP-3A-010
Newport Actuators
CMA-12CCCL
CMA-25CCCL
SR50CC rotation stage
PR50CC rotation stage
Camera
OTRs
Photodiode
OTR
Controller,
Camera
LeCroy
Oscilloscope in
Laser Room
Devices
Controller
Coherent EPM2000
LabMax-Top
Newport
XPS
C-8
Camera Link
Fiber
RS-232
Analog
EPICS IOCs
Digi
Terminal
Server
to Soft IOC
Trigger
VME
IOC
VME
IOC
VME
IOC
CA Network
FAC
June 2009
35 35
Patrick Krejcik
pkr@slac.stanford.edu
Laser Heater Synoptic Display
Change Between
Systems
FAC
June 2009
36 36
Patrick Krejcik
pkr@slac.stanford.edu
High Level Applications
Successful working paradigm of rapid development of physics
GUIs in Matlab
With robust applications developed by software engineers for
operations
Infrastructure such as online modeling in XAL
Workhorse applications such
as orbit display, buffered
data acquisition, Model,
MPS GUI, MKBs etc. done
with Java in XAL-like
framework
New maintenance contract
with COSY Lab for JCA
FAC
June 2009
37 37
Patrick Krejcik
pkr@slac.stanford.edu
Widespread use of ORACLE RDB
Machine configuration control
SCORE application
Online Model
Java ModelManager GUI
Project Database tied to online model
MPS Fault History
Future Archive Server
New hire for DB Manager
FAC
June 2009
38 38
Patrick Krejcik
pkr@slac.stanford.edu
Online Model Manager GUI
FAC
June 2009
39 39
Patrick Krejcik
pkr@slac.stanford.edu
Multiknob GUI
FAC
June 2009
40 40
Patrick Krejcik
pkr@slac.stanford.edu
Summary Displays
Graphical images
of the machine
annotated with
key PVs and
strip charts
FAC
June 2009
41 41
Patrick Krejcik
pkr@slac.stanford.edu
Expanded role of HLA Group
Developing core applications to support rapid
prototyping by accelerator physicists
Infrastructure applications common to many other
applications, such as online model and RDB
Priority given to robust applications used by
operations as they gradually take over tuning and
setup of the machine
Support for tools
Evaluating CSS and Archive Viewer
Alarm Handler
One new hire in HLA group
Plus new position for a Software Development
Environment Manager
FAC
June 2009
42 42
Patrick Krejcik
pkr@slac.stanford.edu
Laser & Electron-Based Feedback Systems
Transverse Loops:
Laser spot on cathode
Gun launch angle
Injector trajectory
X-band cavity position
Linac trajectory
Undulator launch
Laser
gun
Longitudinal Loops
V0
d0
1
DL1
sz1
sz2
d1
d2
V1
L1
FAC
June 2009
Bunch Charge
Longitudinal Loops:
DL1 energy
BC1 energy
BC1 bunch length
BC2 energy
BC2 bunch length
Final energy
X
2
V2
L3
BC2
43 43
d3
V3
L2
BC1
BPMs
CSR detectors
Steering Loop
DL2
Patrick Krejcik
pkr@slac.stanford.edu
Beam-Based Feedbacks Prototyped in Matlab
FAC
June 2009
44 44
Patrick Krejcik
pkr@slac.stanford.edu
Fast Feedback Development Tasks
120 Hz operation with timeslot differentiation expected by
January 2010
New dedicated Fast Feedback network (multicast Ethernet)
A few new Feedback Loop Controller IOCs
Interface to new network
MATLAB algorithms ported to microprocessor
Upgrade magnet and RF control
120Hz control
Pattern-aware control
Interface to new network
Upgrade BPMs and BLENs
Interface to new network
New configuration application
Runtime control and performance monitoring
BLD IOC provides beam line data to XES Photon Controls
FAC
June 2009
45 45
Patrick Krejcik
pkr@slac.stanford.edu
Fast Feedback Conceptual Block Diagram
FAC
June 2009
46 46
Patrick Krejcik
pkr@slac.stanford.edu
Fast Feedback Schedule
ID
1
2
3
4
5
6
7
8
9
10
11
12
13
Task Name
Duration
Requirements
Design
Network
BPM and BLEN IOC Upgrades
RF and Magnet IOC Upgrade
Beam Line Date Interface
Setup Test Facility
Loop Controller Application
55d
65d
100d
40d
125d
45d
55d
141d
Runtime Control Display
Loop Configuration App
Lab Testing
Installation
Commissioning
30d
98d
15d
28d
30d
FAC
June 2009
Mar Apr May Jun
2009
2010
Jul Aug Sep Oct Nov Dec Jan Feb Mar
47 47
Apr
May
Patrick Krejcik
pkr@slac.stanford.edu
EPICS Slow & BLD Fast Data Transfer
FAC
June 2009
48 48
Patrick Krejcik
pkr@slac.stanford.edu
Network Issues - In Progress
Data Transfer between ebeam and photon sections
EPICS Slow Data transfer via PV Gateway
Use a pair of PV gateways to simplify communication and unicast both
requests and beacons to other network
Beam Line Data – deliver 5 calculated values to PCDS clients within 3
120Hz pulses
Initially create BLD IOC which collects ebeam values, calculate values, build
one PCDS packet, multicast single packet to photon clients who have joined
the multicast group
Later convert to 120Hz Feedback infrastructure
Connecting Photon B950 MPS link nodes to central processor
Computing Infrastructure
Migrating Oracle from SCCS servers to MCC servers
Creating teststand for S20-BSY Linac Upgrade for unique devices, and
convert magnets to EPICS
Planning for B999 MPS and PPS support; initial accelerator
switch online
FAC
June 2009
49 49
Patrick Krejcik
pkr@slac.stanford.edu
System Issues
Channel Archiver
Improved Archiver Data Server to automatically retrieve data without
specifying indexes. Resolved the 2GB limit issue of index files.
Completed design review of improving performance of Archiver data
retrieval for long time range requests. In progress to implement.
Enhanced Archiver Viewer GUI to meet operation’s need.
Computing systems
Created two powerful dedicated servers, one for Java based HLAs, one
for Matlab based daemons.
Improved Linux and Sunray server load balancing.
Completed upgrading Linux based OPIs. In plan to phase out Sunray
based OPIs (will only use Sunray for CUDs).
Elog: added Elog system monitoring and services auto-restart,
enhanced Elog security.
CMLOG: improved reliability of CMLOG system (error logging).
In plan to improve Java based CMLOG viewer.
FAC
June 2009
50 50
Patrick Krejcik
pkr@slac.stanford.edu
Electron and Photon Gateways
FAC
June 2009
51 51
Patrick Krejcik
pkr@slac.stanford.edu
Diffracted X-Ray Laser Spot
Thanks for being a part of our enterprise!
(supplemental slides follow)
FAC
June 2009
52 52
Patrick Krejcik
pkr@slac.stanford.edu
Normalized phase space centroid jitter after BC1 (~4% of rms beam size)
RMS AxN = 3.9%
RMS AyN = 3.4%
Stability is
not so far
from the
goal (~10%)
1-s
beam
size
D. Ratner
… near end of linac (10-15% of rms beam size)
RMS AxN = 14%
RMS AyN = 9%
DE/E jitter  0.03%
DQ/Q jitter  1.5%
Q = 0.25 nC
FAC
June 2009
53 53
Patrick Krejcik
pkr@slac.stanford.edu
Beam Profile Measurements
Fluorescent Screens
YAG has Good sensitivity
Saturate at high intensities (>0.04pC/um2)
Typical LCLS 1nC, 50 micron spot is 10X this density
Used in LCLS at 135MeV and below
Wire Scanners
Good resolution, Nearly non-invasive, work with high intensity beams
Slow, and integrated profile only
Mechanical vibration problems
Used in LCLS at 135MeV and above
Optical Transition Radiation Monitor
Good resolution, work with high intensity beams
Coherent effects limit use in LCLS (discussed later in this talk)
Installed in LCLS at 135MeV and up, but only useable before first
bunch compressor
FAC
June 2009
54 54
Patrick Krejcik
pkr@slac.stanford.edu
Sample Images from YAG screens
YAG image for 1nC beam at 6MeV
Also possible to image cathode at low charge (30pC)
FAC
June 2009
55 55
Patrick Krejcik
pkr@slac.stanford.edu
Wire Scans
Scan before addition of
10X reducer gear
Scan after addition of
10X reducer gear
FAC
June 2009
Wire scan at 250MeV after first bunch compressor
Asymmetric Gaussian fit (LCLS standard)
56 56
Patrick Krejcik
pkr@slac.stanford.edu
Emittance at end of Linac 0.5nC
Ex = 1.33, Ey = 0.96. 0.5nC,
normal compression 12.6 um
bunch length.
Measurements slow since we
are using wire scanners.
FAC
June 2009
57 57
Patrick Krejcik
pkr@slac.stanford.edu
66 Beam Finder Wires (BFW) Tested and Aligned
Used to center the undulator gap on the
beam
And in combination can also measure
emittance
FAC
June 2009
58 58
Patrick Krejcik
pkr@slac.stanford.edu
Automated Emittance Software
Matlab application menu driven to select wire scanners along the machine
and collect beam size measurements
Online model data accessed to compute emittances from beam sizes
Emittance Application
Wire scanner application
H. Loos
FAC
June 2009
59 59
Patrick Krejcik
pkr@slac.stanford.edu
OTR Foils: COTR Problems
A predicted consequence of very short bunches at LCLS
OTR after BC1, normal compression
250pC, upstream OTR foil inserted
In compressor Chicane to spoil
Longitudinal Phase space
With upstream foil removed, signal
Is saturated. Neutral density filters
Give approximately 60M counts
10X increase
~60 Mcounts
5 Mcounts
FAC
June 2009
60 60
Patrick Krejcik
pkr@slac.stanford.edu
But it swamps all downstream screens!
FAC
June 2009
61 61
Patrick Krejcik
pkr@slac.stanford.edu
Temporal Measurements
LCLS has 2 transverse deflection cavities
135 MeV before DL1 bend
4.3 GeV after BC2 compressor (COTR -> use fluorescent
screen).
RF off-axis screen
‘streak’
2.4 m
V(t)
e-
sz
FAC
June 2009
sy
S-band (2856 MHz)
single-shot, absolute bunch
transverse RF deflector
length measurement
62 62
Patrick Krejcik
pkr@slac.stanford.edu
Bunch length after BC1 and BC2
Approximately 5 micron minimum bunch
length observed, limited by TCAV /
fluorescent screen resolution
FAC
June 2009
63 63
Patrick Krejcik
pkr@slac.stanford.edu
BC2 Bunch Length Monitor
Bunch length monitor signal for
BC2 while compression is
varied in L2.
BC2 bunch length monitor
similar to BC1 monitor except
no focusing optics is used,
detector is positioned directly
above Silicon vacuum window.
Bunch length monitors now
calibrated in approximate peak
Amps.
FAC
June 2009
64 64
Patrick Krejcik
pkr@slac.stanford.edu
Phase jitter measurement using the beam
e-
S-band (2856 MHz)
BPM
V(t)
slope = -2.34 mm/deg
BPM Y Position (mm)
Q = 0.25 nC
Now measure BPM jitter both
with transverse RF OFF, and
then ON (at constant phase)
TCAV OFF
TCAV ON
9 mm rms
110 mm rms
Dt  ±0.6 ps
Timing Jitter (w.r.t. RF) = (110 mm)/(2.34 mm/deg) = 0.047 deg  46 fsec rms
FAC
June 2009
65 65
Patrick Krejcik
pkr@slac.stanford.edu
RF Systems Global Summary Page
FAC
June 2009
66 66
Patrick Krejcik
pkr@slac.stanford.edu