KM3NET-IT TOWER
DATA ACQUISITION AND DATA TRANSPORT
ELECTRONICS
CARLO A. NICOLAU
ON BEHALF OF THE
KM3NET – ITALY COLLABORATION
Outline:
• KM3NeT-Italy Layout
• Tower Layout
• Data and Timing Link
• Floor Electronics
• Optical Module Electronics
• Conclusions
VLVnT 2015 – Very Large Volume Neutrino Telescope
14 – 16 September 2015, University “Sapienza”, Rome - Italy
Carlo A. Nicolau – INFN Sez. Roma
carlo.nicolau@roma1.infn.it
KM3NeT – IT Layout
ON-SHORE
OFF-SHORE
KM3NeT-IT
Towers
FCM
FCM
FCM
Guest House
FCM
Control Room
DAQ
Power Feeding
Equipment
TB
Shore Laboratory in Capo Passero harbour
Junction
Box
20 x opt. fibers
up to 10 kV
MVC
Opt. Splitter
375 VDC
Junction
Box
~100 km
VLVnT 2015 – Very Large Volume Neutrino Telescope
14 – 16 September 2015, University “Sapienza”, Rome - Italy
KM3NeT-IT Tower – Data Acquisition
and Data Transport Electronics
KM3NeT
String DUs
Carlo A. Nicolau – INFN Sez. Roma
carlo.nicolau@roma1.infn.it
Tower Layout
Detection Unit Characteristics
• Design based on NEMO
• All data to shore approach
• Tower
FCM
Floor #14
FCM
Floor #13
FCM
Floor #2
FCM
Floor #1
TB
Tower Base
• 14 Floors
• Vertical floor spacing is 20m
• Star connection topology
• Base Module
• Optical link distribution DWDM
• Power control and distribution
• Floor
• 8 m long
• Floor Control Module Vessel
• 6 Optical Modules
• 2 Hydrophones
• Optical Module
• Single 10” PMT
• Front End Module
• LED Beacon (2 per floor)
Junction
Box
375 VDC
2 opt. fibers
VLVnT 2015 – Very Large Volume Neutrino Telescope
14 – 16 September 2015, University “Sapienza”, Rome - Italy
KM3NeT-IT Tower – Data Acquisition
and Data Transport Electronics
Carlo A. Nicolau – INFN Sez. Roma
carlo.nicolau@roma1.infn.it
Tower Base
Tower Base Module
• Photonics Pod
• MUX/DEMUX lambdas from/to floors
• Power Pod
• Distribution, Control, Monitoring
PHOTONICS POD
O
O
O
E
E
E
EO
1
EO
2
MANIFOLD
• Contains 3 vessels
JUNCTION BOX
TOWER BASE
ELECTRONICS POD
POWER POD
EO
FLOOR 1
EO
FLOOR 14
...
EO
13
EO
14
• Electronics Pod
• Communication, Monitoring,
Laser beacon control
F1 F2
uC
AD
….
Photonics Pod
Electronics Pod
AES3
BTS
Tower Base
Control Module
Board
(same as Floor)
375 V
Opt
Amp
375 V
RS232
RS232
Hydrophone
Power Pod
Photonics Pod
Laser Beacon
Controller
PSS Board
From Floors & E. Pod
BTS
Opt
Amp
VLVnT 2015 – Very Large Volume Neutrino Telescope
14 – 16 September 2015, University “Sapienza”, Rome - Italy
ADD
V-I Monitor
To Floors & E. Pod
F14
DROP
Power Pod
KM3NeT-IT Tower – Data Acquisition
and Data Transport Electronics
Carlo A. Nicolau – INFN Sez. Roma
carlo.nicolau@roma1.infn.it
Floor Layout
Optical
Module
Center - Floor
Vessel
To/from
Tower Base
375 V
PSS
Board
Front End
Module
Board
Power, Clock
Data IN/OUT
Floor Control
Module Board
HV
PSU
To/from
other
5 OMs
12V, Clock
AES3
To/from
2 x Digital St. Hydr.
KM3NeT-IT
Floor
FCM
VLVnT 2015 – Very Large Volume Neutrino Telescope
14 – 16 September 2015, University “Sapienza”, Rome - Italy
KM3NeT-IT Tower – Data Acquisition
and Data Transport Electronics
Carlo A. Nicolau – INFN Sez. Roma
carlo.nicolau@roma1.infn.it
Data & Timing Link Model
KM3NeT-IT
Floor
GPS
GPS Time
Distribution
FCM
DWDM
MUX
DWDM
MUX
~100km
• Point to point link
Phase Noise Jitter
Lab Measures
(Agilent E5052B SSA)
• Each Floor is assigned a couple of
lambdas (rx/tx) in DWDM spectrum
• Standard component
• Lambda drift monitoring and tuning
10 MHz
38.5 ps rms
Sampling Clock
200 MHz
52.3 ps rms
Recovered
80 MHz
35.2 ps rms
80 MHz
9.7 ps rms
• Fully synchronous link
• Clock, Data and Timing embedded
in a single 8b/10b stream
• Each device is time-stamp aware
GPS
• Fixed latency
Time
Distrib.
DAQ
FPGA
(short)
FCM
FEM
• Round-trip time monitoring
+ pre-deployment calibration
VLVnT 2015 – Very Large Volume Neutrino Telescope
14 – 16 September 2015, University “Sapienza”, Rome - Italy
KM3NeT-IT Tower – Data Acquisition
and Data Transport Electronics
Carlo A. Nicolau – INFN Sez. Roma
carlo.nicolau@roma1.infn.it
Center Floor Electronics
Floor Control
Module
Power Supply
System
375 V
OM #0
OM #1
OM #2
OM #3
OM #4
OM #5
2 x Digital AES3
Hydrophone
RS232 Port
Ext Instrument
(Isolated, +12V)
Spare RS232 Port
(Isolated, +12V)
RS232 Port
Compass (+3.3V)
H/T
Sensor
Power Connectors
1.2 V, 3.3 V, 5 V, 12 V
(V & I Measurement)
DC/DC Converters
375 V -> 5 V
5 V -> 12 V
5 V -> 1.2V, 2.5V, 3.3V
Spartan 6 FPGA
• Fixed-latency transceiver
• No external PLL
• 6 x OM interfaces (clock distribution, data rx / tx), 2 x AES3
• Host a microblaze-based system on-chip
• Slow control communication
• Slow-control functions (OM power control and monitoring)
• Voltage and Current Monitoring
• I2C bus, Serial Ports
• Flash Read/Write
• Full remote safe reprogrammability with multiboot (3 full images + data)
VLVnT 2015 – Very Large Volume Neutrino Telescope
14 – 16 September 2015, University “Sapienza”, Rome - Italy
KM3NeT-IT Tower – Data Acquisition
and Data Transport Electronics
Carlo A. Nicolau – INFN Sez. Roma
carlo.nicolau@roma1.infn.it
Optical Module Layout
GATE In
TO/ FROM FCM
Front End
Module
HV
PSU
PMT signal
CLOCK
HVPSU
Power
Control
Feedback
DIN / VCC
DOUT / GND
LED Beacon
Power
Trigger
USER CONN
(Power, AIN, GPIO, I2C, RS232, ...)
Data Acquisition Chain
To FCM
20 Mbps
8b/10b
enc.
FIFO
L0-Trig
ADC
2048 Samples
+ timestamp
rising and falling
thresholds
14 bit
200 Mhz
LPF
PMT
Timestamping
Events:
Timestamp (5 ns)
Waveforms
Timestamp (5 ns) + Samples
VLVnT 2015 – Very Large Volume Neutrino Telescope
14 – 16 September 2015, University “Sapienza”, Rome - Italy
Samples
14 bit / 200 Mhz
voltage pulses
~15 ns rising time
KM3NeT-IT Tower – Data Acquisition
and Data Transport Electronics
current pulses
~3 ns rising time
Carlo A. Nicolau – INFN Sez. Roma
carlo.nicolau@roma1.infn.it
Front End Module
Analog Front End
• Differential shaping filter
• Linear
• Fully passive
• Adjustable Offset
Clock out driver
DC/DCs LMZ10501
Line Interface
• Clock (LVDS)
• DATA IN/OUT (LVDS)
• GND/VCC on COM
Fast ADC TI ADS4149
Differential 200 MHz 14 bit
T/H I2C sensor
Spartan 6LX25 FPGA
• Level 0 trigger (zero-skipping)
• Programmable threshold
• Programmable number of
tail samples
• 2 ksample FIFO
• Timestamping
• Lossless compression on spe
• Line interface encode/decode
• Rate monitoring in realtime
• Sustained spe rate up
to ~150kHz
• Microblaze-based SOC
• Full remote safe
reprogrammability with
multiboot (3 images + data)
Slow DACs/ADCs
AFE conditioning (pedestal)
HVPSU Control / monitoring
LED-Beacon control
LED Beacon V
DC/DC based generator (24V)
AFE Control
& Monitor
HVPSU Control
& monitor
DAQ Core
16bit DAC
16bit ADC
AD4149
14bit/200MHz
Config.
FSL
16bit DAC
I2C
16bit ADC
uBlaze
H/T Sensor
Sensirion SHT21
VLVnT 2015 – Very Large Volume Neutrino Telescope
14 – 16 September 2015, University “Sapienza”, Rome - Italy
SPI
64kB
UART
KM3NeT-IT Tower – Data Acquisition
and Data Transport Electronics
Micron N25Q032
Flash
3 x Ext. Serial
Ports
Carlo A. Nicolau – INFN Sez. Roma
carlo.nicolau@roma1.infn.it
Front End Module
Data acquired by tower #0 in 2014/nov
spe peak
nhits : ~150k
mean : 9.5 pC
std : 6.2 pC
~1/4 spe
Equivalent
threshold
Pedestal
Linear analog frontend  fixed relation ADC channel vs input current
( ~0.0228 pC per ADC channel)
VLVnT 2015 – Very Large Volume Neutrino Telescope
14 – 16 September 2015, University “Sapienza”, Rome - Italy
KM3NeT-IT Tower – Data Acquisition
and Data Transport Electronics
Carlo A. Nicolau – INFN Sez. Roma
carlo.nicolau@roma1.infn.it
Conclusions
Front End Module
Floor Control Module
Previous Design
(NEMO)
KM3NeT-IT
Simplified integration, lower cost
5 different boards
2 boards
7 processing units
3 architectures
(Xilinx FPGA, Microchip PIC,
Freescale DSP)
1 processing unit
1 architecture
(Xilinx FPGA w/ uBlaze MCU)
Dissipative linear
voltage regulators
Active low noise DC/DC
2 x 8 bit ADC (100 Msps)
Non-Linear Analog Comp.
Single ADC 14 bit
Linear Front end
2 processing units
2 architectures
(Xilinx FPGA, Freescale DSP)
1 processing unit
1 architecture
(Xilinx FPGA w/ uBlaze MCU)
Same codebase as FCM
Dissipative linear
voltage regulators
Active low noise DC/DC
VLVnT 2015 – Very Large Volume Neutrino Telescope
14 – 16 September 2015, University “Sapienza”, Rome - Italy
Simplified elaboration
No need to “decompress” signals
Simplified calibration process
No need to calibrate each single FEM at
different temperatures
Easier code maintainance
• From VHDL / DSPASM / C
To VHDL / C++
• One common code-base for all
slow-control functions and communication
Reduced power consumption
FEM :
From ~2 W / OM
To ~1 W / OM
FCM:
From ~7.5 W
To ~3 W
KM3NeT-IT Tower – Data Acquisition
and Data Transport Electronics
Carlo A. Nicolau – INFN Sez. Roma
carlo.nicolau@roma1.infn.it
Thank You
VLVnT 2015 – Very Large Volume Neutrino Telescope
14 – 16 September 2015, University “Sapienza”, Rome - Italy
KM3NeT-IT Tower – Data Acquisition
and Data Transport Electronics
Carlo A. Nicolau – INFN Sez. Roma
carlo.nicolau@roma1.infn.it