COTS Technologies for Control,
Diagnostics and Measurements
in Big Physics Applications
ni.com
Diversity of Applications
Telecom
ATE
ni.com
Automotive
Military/Aerospace
Semiconductors
Advanced
Research &
Big Physics
2
Electronics
Petrochemical
Food
Processing
Computers
Textiles
Graphical System Design
A Platform-Based Approach
Test
Desktops and
PC-Based DAQ
ni.com
Monitor
Embedded
PXI and Modular
Instruments
Control
RIO and Custom
Designs
3
Cyber Physical
Open Connectivity
with 3rd Party I/O
Big Physics at NI
CONTROL
SYSTEM
PARTICLE
PHYSICS
PLASMA
PHYSICS
LIGHT SOURCES
TELESCOPES
ni.com
PHYSICS
EXPERIMENTS
ACCELERATOR
COLLIDER
DETECTOR
FUNDAMENTAL
PHYSICS
CANCER THERAPY
TOKAMAK
STELLARATOR
INERTIAL FUSION
FUSION ENERGY
NUCLEAR WEAPONS
LASER
SEMICON
COMMUNICATIONS
MIRROR CONTROL
ADAPTIVE OPTICS
SPECTROSCOPY
CAMERA
FACILITIES
•LANSCE, SNS,
SLAC, NDCX-II,
FAIR, CNAO
• LHC
• Borexino
• Max Planck, JET,
DIII-D, KSTAR, ITER
• Czech IPP
• NIF, LMJ, Z Pinch
Control, Measurement &
MATERIAL STUDY
• BNL, SOLEIL,
Diagnostic
Systems
BIOMEDICAL
SYNCHROTRON
ALBA, Diamond,
4
Spring8
• PHELIX, UT
• SALT, E-ELT,
TMT, GMT, SKA,
NSO
4
ni.com
5
CERN: LHC
•
•
•
ni.com
•
Collimators Control System
> 120 PXI Systems over 27 km
FPGA Based Motion Control Algorithms
<1 ms synchronization
6
CERN Collimator Alignment
•
•
•
•
550+ axes of motion
Across 27 km distance
The jaws have to be positioned with an accuracy which is
a fraction of the beam size (200μm)
Synchronized to
•
•
ni.com
< 5ms drift over 15 minutes
Maximum jitter in μs
7
CERN – LHC Collimator Project
•
•
•
•
120 PXI systems running LabVIEW Real-Time
Communication
• PXI systems are connected through Ethernet
• Linux (Corba) host via a protocol called DIM (future FESA)
Synchronization
• Control systems are distributed over the 27 km tunnel
• Synchronization using PXI 10 MHz backplane clock
Embedded / FPGA
• Closed loop motor control systems with redundant
feedback
• Softmotion algorithms running in a synchronized FPGA
ni.com
8
CERN Custom High Availability Chassis
•
•
•
Redesigned to mechanically fit into a custom rack
Independently powered, redundant hot swap power supplies
and fans
Remote Monitoring : Chassis Temperature, Fan Status,
Power Supplies
ni.com
9
NI PXIe-1086 High Availability Chassis
•
Features
–
–
–
–
–
PCI Express Gen 2 x8 link to every
peripheral slot
16 hybrid slots
2 link / switch architecture (8 to 9 slots
behind each switch)
Wider air cooling channel
Hot swappable, individually replaceable
fans and power supplies
• Availability
– Target Ship Date: Oct 2013
ni.com
10
NI PXIe-1086
MASHA - JINR
(MASS ANALYZER OF SUPER
HEAVY ATOMS)
•
•
ni.com
•
PXI-based measurement and
control system
LabVIEW-based software
11
Migration to PXI from KAMAK
•
•Borexino
Neutrino Detectors:
•
•Marco
Pallavicini
Università di Genova & INFN
ni.com
14
•
•Abruzzo,
Italy
•120 Km from Rome
•Laboratori
•Nazionali del
•Gran
•External Labs
Sasso
•Assergi
(AQ)
•Italy
•~3500
•Borexino
ni.com
•Austin
(TX), August 3rd, 2009 M. Pallavicini - Università di Genova & INFN
15
Detector and Plants
m.w.e
•
•Current
system
•Custom
trigger
board
ni.com
•Austin
(TX), August 3 rd , 2009
16
•Laben
•M
•.
board (TDC & ADC)
P a l l a vi c i ni Uni ver s i t à di Genova & INFN
•
•Numbers
in short
•Channels:
~ 2000
•Typical signal in one channel:
•15 mV before FE, 10 ns base width, AC coupled, ~ 1kHz rate
•Typical trigger in the detector: a set of PMTs (minimum ~ 20
•max ALL) fire within a few 100s of ns. Typical triggering rate
•10-50 Hz
•Muons every 30 s --> huge signals, but relatively rarely
•Data flow without zero suppression: 1 Gs/s x 2000 =
•2. 1012 byte/s --> very hard
•Data flow after zero suppression: 1 kHz x 2000 x 100
•samples = 200 Mb/s to be processed. Not trivial but feasable
•Typical data flow after group trigger: ~ 100 sample x 100
•hits x 100 Hz ~ 1 Mb/s ... peanuts
ni.com
17
Austin (TX), August 3rd, 2009 M. Pallavicini - Università di Genova & INFN
NEW oscilloscope PXIe-5162
•
•
•
•
•
•
•
Bandwidth: up to 1,5 GHz
Sampling rate: up to 5 GHz
Up to 4 channels/module
Resolution: 10 bit
Memory: up to 1 GB
Input voltage range: up to 50 V
Input impedance: 50 Ohm (SMA)
68 channels – 1,25 GHz
ni.com
19
Tokomaks
ni.com
ITER
•
•
•
ni.com
> 4500 Measurement Channels
PXI Based Fast Controllers
CompactRIO for Interlock System
21
ITER-NI: Long Term Collaboration
2007
2008
2009
2010
•
Investigated bidding for a CODAC Tender
•
Expression of interest with Jo Lister
Consultation with CODAC Engineers
•
•
•
•
•
•
2011
•
•
2012
2013
ni.com
•
•
•
Technology / product gap analysis
Proof of concept (PoC) for Fast controllers, T&S
Addressed technology gaps (R&D)
Built WW teams with ITER focus
Supported WW DAs and established relationship
Open source RHEL drivers & EPICS support on NI devices
Environmental testing
Global support and services agreements initiated
Strategic agreement moving forward
RASM discussion with NI R&D
22
Customizing COTS Drivers for Linux / EPICS
•
Fully compatible with CODAC Software Suite (CCS)
requirements
•
•
•
Red Hat Enterprise Linux and Real-Time Kernel (MRG)
Open source and documentation
Current drivers available for timing, fast controllers, data
acquisition and FPGA devices
ni.com
23
Linux Source Code Developed by Customer
•
•
•
•
•
•
Register-level programming for Data Acquisition
Generic interface for OSs such as Windows CE, Linux,
Mac OS X , QNX, etc…
Most DAQ devices (X*, M, E, S, AO, DIO, CNTR)
Driver developed entirely by the customer
Source code only, very small footprint
For ITER many drivers developed for Red Hat and MRG
Real Time Extensions:
•
ni.com
PXI 6259, PXIe 6368, PXI 668X, PXI 6528
24
NI Real-Time Hypervisor for Linux
Windows PC
Hypervisor System*
*Must program
LabVIEW Real-Time
application from Windows
Supported
RT I/O
ni.com
26
Supported
Linux I/O
EPICS Software Architecture
Distributed Clients (OPI – Operator Interface) and
Servers (IOC – I/O Controllers)
• Network protocol: Channel Access (CA) with
Process Variables (PVs)
•
OPI
OPI
(Operator
Interface)
(Operator
Interface)
CA (Channel Access)
IOC
IOC
IOC
IOC
(I/O Controller)
(I/O Controller)
(I/O Controller)
(I/O Controller)
I/O HW
I/O HW
I/O HW
I/O HW
Analog I/O, Digital I/O, Motion Control, Image Acquisition, etc.
ni.com
27
Example – Los Alamos LANSCE
•
Migration to a cRIO with embedded
EPICS
•
•
•
•
12 binary outputs
36 binary inputs
12 analog inputs
5 stepper motor channels
Full IOC functionality allows access to
all record fields and EPICS utilities
• Maximum flexibility for partitioning the
problem
•
•
•
ni.com
LabVIEW for beam diagnostic
EPICS for industrial control
28
EPICS connectivity with NI HW&SW
•
1
LabVIEW
I/O Server
EPICS CA
Client or Server
•
2a
LabVIEW RT
on cRIO
Shared Memory
EPICS IOC
on VxWorks
•
2b
LabVIEW RT
on PXI
Hypervisor
Shared Memory
EPICS IOC
on Linux
•
3
PXI
(No LabVIEW)
Linux Driver
Device Support
EPICS IOC
on Linux
ni.com
29
Gamma Radiation Testing at ENEA Casaccia
ni.com
30
Radiation Testing for NI Platforms
ni.com
31
Fast and Thermal Neutron Testing
Frascati Neutron Generator, ENEA, Italy
(Fast)
ni.com
TRIGA Reactor, JSI, Slovenia
(Thermal)
32
Failure Rate vs Neutron Flux
ni.com
33
High Magnetic Field Testing at DESY
mT
Magnetic Field at Position 6
120
100
80
60
40
20
0
Magnetic Field Profile (mT)
Set Point
(A)
0
10
20
25
30
40
50
0
ni.com
20
40
60
Amps
80
100
120
34
Actual (A)
0.252
10.2
20.2
25.2
30.2
40.2
50.2
Loc 1 Loc 2 Loc 3
0.76 0.73 1.49
10 10.05 14.4
19.6 19.4 25.5
24.2 24.2 30.2
28.8 29.1 35.8
38.1 38.3 45.9
47.9 47.9 55.8
Loc 4
0.78
10.3
20.1
24.7
29.5
39.1
48.7
Loc 5
0.78
10.3
19.9
24.7
29.3
39
48.4
Loc 6
0.67
10.2
19.8
24.8
29.7
39.4
48.9
Magnetic Test Results (INITIAL)
•
PXI
•
•
•
•
Fans failed at 12 – 13 Amps – MUCH sooner than expected
Fans failed permanently – had not seen before
2 dead fans halted testing of PXIe-1075
cRIO
•
•
•
•
ni.com
Worked with 0 errors up to 45 mT
AI (9205) failed permanently at 45 mT
Communication fails at 55 mT
FPGA, AO, DIO work up to at least 100 mT
35
Custom Connectivity and Routing for ITER
•
Cubicle from SAREL
•
Work on 3D Models of Cabinet Layout and
cable routing
•
3D Models to be used for creating
snapshots for catalog
•
Assembly at NI Hungary with available
hardware to validate design
•
Thermal analysis for each individual
configuration
ni.com
36
ITER PCDH - Fast Controllers
http://www.iter.org/doc/www/edit/Lists/WebsiteText/Attachments/94/SD14_v1_3.pdf
ni.com
37
NI COTS Platforms CUSTOMIZED for ITER
DAQ
(Diagnostics
Data Acquisition)
I&C
(Fast Control
Interlock)
Industrial PC
cRIO
PXIe
C Series Modules
M Series DAQ
X Series DAQ
NI FlexRIO
ni.com
38
Tokamak T-15
•
•
•
ni.com
•
•
20+ diagnostics and control system (2000+
channels)
LabVIEW for software development
PXI-based data acquisition and control systems
CompactRIO for interlock
Launch - 2016
PIAF - PIK
•
•
•
ni.com
•
•
Scientific Reactor Monitoring System
> 900 Analog Input Channels
> 6800 Digital Input Channels
cFP-based monitoring system (stage 1)
Migration to cRIO in 2014-2018
Summary
•
•
•
•
National Instruments works with major scientific labs all
over the world and is ready for cooperation;
National Instruments products have been used for variety
of control and instrumentations in accelerators, fusion
machines, synchrotrons, lasers and telescopes;
National Instruments not only provides measurement
equipment and software but also forms international
teams working on big physics projects;
National Instruments is committed to making adaptations
such as Linux, EPICS, High Availability and Radiation
Testing.
ni.com
41