RD53 RD-53 Progress on High Rate Pixel Readout chip M. Garcia-Sciveres Lawrence Berkeley National Lab Pixel 2014, Niagara Falls, Sept. 3, 2014 1 RD53 ● Contents Introduction to RD53 ● Overview of working groups ● Development timeline ● The high rate challenge ● Information flow within the chip ● Data compression (*) ● Conclusion (*) Ref: M.G-S and Xinkang Wang, not part of RD53. Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 2 RD53 RD-53 www.cern.ch/RD53 Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 3 RD53 ● ● ● ● ● ● 19 Institutes so far (2 new institutes joining) Bari, Bergamo-Pavia, Bonn, CERN, CPPM, Fermilab, LBNL, LPNHE Paris, Milano, NIKHEF, New Mexico, Padova, Perugia, Pisa, Prague IP/FNSPE-CTU, PSI, RAL, Torino, UC Santa Cruz. ~100 collaborators Spokespersons: Maurice Garcia-Sciveres, LBNL (ATLAS), Jorgen Christiansen, CERN (CMS) Institute Board ● ● ● ● About RD53 IB chair: Lino Demaria, Torino Regular IB meetings MOU finalized and ready to be signed Collaboration meetings ● Spring 2014: April 10 & 11 at CERN ● Fall 2014: October 16 & 17 at RAL Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 4 RD53 ● Establish guidelines for radiation hardness of CERN frame contract foundry to 1 Grad ● ● ● Or decide the process cannot be used to this level Develop tools and methodology adequate for 5x108 transistor mixed signal chip in this technology Define pixel size and and low threshold operation strategy: ● ● RD53 Critical Issues 50um x 50um chip pixels (sensor aspect ratio can vary) Develop high bandwidth readout (2-4 Gbps / chip) including cable transmission models Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 5 RD53 ● ● ● ● ● ● ● ● ● RD53 Working Groups Radiation hardness: will be covered in separate talk Simulation test bench: Verification framework customized for complex pixel chips based on system Verilog and UVM (industry standard for ASIC design and verification) High abstraction level down to detailed gate/transistor level Benchmarked using FEI4 design Internal generation of appropriate hit patterns Integration with ROOT to import hits from detector simulations and for analyzing results. Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 6 RD53 ● ● ● ● ● ● ● RD53 Working Groups (cont.) Analog design: Evaluation, design and test of appropriate low power analog pixel Front-Ends Develop analog front-end specifications Planar, 3D sensors, capacitance, threshold, charge resolution, noise, deadtime,... Alternative architectures –implementations to be compared, designed and tested by different groups TOT, ADC, Synchronous, Asynchronous, Threshold adjust, Auto zeroing, etc. Design / prototyping of FE's ongoing Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 7 RD53 ● ● ● ● ● ● ● ● ● RD53 Working Groups (cont.) “IP” blocks: Make IP blocks required to build pixel chips About 30 IP's defined and assigned to groups Review of IP specs June 2014 Defining how to make IPs ready for integration into design flow IP expert panel Common IP/design repository Prototyping/test of IP blocks 2014/2015 IP blocks ready 2015/2016 Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 8 RD53 ● ● ● ● ● RD53 Working Groups (cont.) Top Level: Global architecture and floorplanning Metal stack; power and bias distribution and shielding; integration of matrix and IP blocks. Front ends and bumps for 4 pixels Synthesized digital “sea” ● ● ● ● I/O: Command input and data output protocols. ● Single serial input encoding clock and command High speed drivers. Simulation of performance with candidate low mass cable designs (interaction with experiments on cable R&D). Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 9 RD53 ● ● ● ● ● RD53 Timeline Radiation hardness conclusions – early 2015 Analog, I/O and IP prototype tests chips – now to end of 2015 (multiple submissions) Full or half-size prototype(s) – 2016 (wafer run order) ● In CERN frame contract process Test, design iteration and refinements – 2017 Hand over to ATLAS and CMS for final chip designs – 2018 Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 10 RD53 ● ● The high rate challenge imaging analogy Normal intensity image (present LHC rate and present detectors) To see finer details (precision Higgs physics, etc.), turn up the intensity (future high luminosity LHC) Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 11 RD53 ● ● The high rate challenge Turn up the intensity--> need a faster camera As the rate goes, so goes the radiation dose (same source for both) Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 12 RD53 Single Pixel Details today future Pixel output voltage Pixel size threshold time ~50 kHz for ATLAS / CMS ● For 50um x 50um (“future”) pixels, this is 2Ghz / sq. cm. Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 13 Digital perspective voltage RD53 threshold 0000 0001 0000 0000 0111 0010 0000 0000 0000 0000 0100 0010 0000 0000 0000 0000 0000 1100 1001 0011 0000 0000 time Contentaddressable memory readout What is this data rate per chip? Triggers (selected slice times) Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 14 RD53 ● Data rate (simple analysis) If the total number of possible hit patterns in a chip is known: ● ● tion a m r o Inf and they are all equally likely, the information entropy is just the number of bits needed to count up to this number Can estimate the number of possible hit patterns by assuming all the hits are random (clusters change the answer, see later) ● For example, take N=40k pixels per chip ● 50kHz / pixel gives 50 hits every 25ns ● Information entropy for picking 50 out of 40K is 550 bits ● This gives 22Gb/s for the big green arrow. ● For 50um x 50um pixels that's per cm 2 Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres ions) t a n i b om Log 2(c 15 RD53 ● Interesting comparison Are high rate pixel detectors memory chips? This is for a memory module containing 8 silicon chips, so GB/module = Gb/chip (and this is not rad hard) Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 16 RD53 ● Implications for experiments ATLAS / CMS have 220Tb/s per m2 of detector ● ● Triggerless would need 500 data links with 400Gb/s each. While 400Gb/s is the next generation commercial standard, those will not be rad hard, and need significant space. ● => triggerless unlikely. Keep external trigger architecture ● In RD53 we are assuming 2MHz trigger rate (experiments currently asking for 1MHz) ● (LHCb has 10x lower data rate (lower luminosity) ● Only 50 400Gb/s links (or 500 40Gb/s) ● Plenty of space to put them due to fixed target geometry ● Lower radiation.) Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 17 RD53 Classic Pixel Readout Chip Layout ● ● ● ● Array is primarily an analog circuit Try to keep clocks and digital activity out of array Limited intelligence in bottom of chip- mainly buffering and serialization Current generation already has gone beyond this classic picture Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 18 RD53 ● ● ● Present generation readout chip Logic and buffering moved into array Bottom of chip blocks shrank. Added system functions to bottom of chip ... Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 19 RD53 A look inside FE-I4 ● ● Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres Column composed of identical 4-pixel regions Each region logic is one synthesized block (10K gates) 20 RD53 digital memory & control analog digital analog digital analog analog digital Trend is Clear digital digital control (looks like commercial chip) 10 yrs ago <1Gb/s /cm2 Sept. 3, 2014 today RD-53 5Gb/s /cm2 RD53 High Rate Redout Chip – M. Garcia-Sciveres 25Gb/s /cm2 21 RD53 Work in Progress Demonstrator Layout Bump pads on 50um x 50um grid Each of these front-end blocks produces 200kHz of hits Synthesized logic few 1000 gates per pixel 1FE-I4 pixel ● 22Gb/s data “input” to this memory is highly distributed, unlike computer memory chip with 16 input pins Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 22 RD53 ● ● ● ● ● 2 MHz Triggered readout – back of the envelope IBL readout of 160Mb/s/chip will handle 2x1034 luminosity at 13TeV, with 100KHz trigger rate. Multiply by 2.5 to get to 5x1034 Multiply by 20 to get to 2MHz Result: 8 Gbps / chip. That's too high. Need to find a factor of >2 ● Phase 2 inner layer is a bit further out than IBL ● ● ● Sept. 3, 2014 Better data compression- being studied (see later) Reduced information?- being studied. Could go binary for innermost layer (this would be a knob one can turn) On-chip clustering and data reduction- proposed, just conceptual for now RD53 High Rate Redout Chip – M. Garcia-Sciveres 23 RD53 BW affects internal architecture as well ● ● ● ● ● Hits form any part of the chip must make it to the periphery fast enough to join the high speed readout for the event they belong to. => Matrix to periphery latency must be smaller than chip output. Low latency drives BW up. Data transmission within the chip is being studied in RD53. Want low power, but also constant power consumption to minimize parasitic effects on threshold ● RD53 chip in-time threshold target is <1000e. ● ● This is needed due to small pixels and thin sensors Its a challenge Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 24 RD53 Data compression efficiency is clearly of interest Lossless Compression 10010111001001010000111010011000101011 Compressed data Can recover hit pattern Hit pattern ● ● What is the actual amount of information? This lets us calculate an efficiency: Efficiency = ● information entropy (in bits) number of bits in compressed data Can we calculate the information content in a general way? Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 25 RD53 ● Calculating information content Done first for simplest case of binary strip detectors. See JINST 9 P04021 (2014) and JINST proceedings of WIT2014 ● ● Work in progress for case of pixel detectors with pulse height ADC Decompose pattern. Calculate entropy for components. Add them up. H(Cluster positions): approximately random (can calculate random) + H(Cluster shapes): many shapes possible but only a few shapes dominate. Which ones depends on where chip is in detector + Ensemble of Hit patterns H(Cluster total charge): straightforward because we know what energy deposition looks like. Precision limited by noise. + H(Fraction of charge in each pixel): less straightforward. Work in progress- not covered here. Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 26 RD53 ● ● ● H(Cluster positions) If positions are random this is just a combinatorial problem. H = -log2 (number of possible cluster positions within the chip) Obviously depends on number of clusters (which is the occupancy) ● So can naturally calculate position entropy vs. occupancy Chip size (pixels) Position entropy per cluster (in bits) vs. Occupancy (note we traditionally use a fixed number of bits per address!) Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 27 Cluster charge useful information H= -Σ pi log2(pi) (Measured – true) RMS error (arb. units) RD53 Entropy, H (bits) Equal probability bins 200e- noise Equal size bins Charge PDF used for above Sum of 5 Landau's with different means to cover a range of momenta / incidence angles Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 28 RD53 ● ● ● ● H(Cluster shapes) Even for small-ish cluster size there are hundreds of possible cluster shapes (unlike the case for strip detectors where cluster size is the end of the story) But, similar situation to cluster charge, where in spite of many ADC bins, entropy is low because most bins are unlikely. HOWEVER, which shapes are likely depends on what sensor is connected to the chip and where it is placed in a detector (barrel, endcap, B-field, tilt, eta...) => To efficiently read out cluster shapes (number of bits close to entropy), chip will have to learn on-the-job which shapes are likely and assign short Huffman codes to those ● ● Sept. 3, 2014 Chip generates form its own data a Huffman code table for shapes User decides when to read out that table and tells the chip what table to use to encode shapes RD53 High Rate Redout Chip – M. Garcia-Sciveres 29 RD53 ● ● ● ● Conclusion RD53 collaboration is in place to design next generation readout chips for ATLAS and CMS. High hit rate of order 2GHz/cm2 is the leading challenge. This drives ● Readout electronics with high digital logic density, with bandwidths comparable to high speed computer memory chips ● Extreme radiation tolerance At one order of magnitude lower hit rate, as for LHCb, triggerless readout appears feasible. ● But for ATLAS and CMS RD53 is assuming 2 MHz trigger rate. Data compression plays an important role in enabling high trigger rate ● Analysis of information content (entropy) will allow to optimize data compression. Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 30 RD53 BAC K U P Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 31 RD53 ● ● Sensor Bump Pattern Much discussion can be summarized with one question: Is there any sensor design that prefers one of the two options? Grid Pattern ● Sept. 3, 2014 ● Need sensor metal routing to reach bumps from rectangular pixels Offset Pattern ● Need sensor metal routing to reach bumps from square pixels RD53 High Rate Redout Chip – M. Garcia-Sciveres 32 RD53 ● ● Yes: One was claimed 3D sensor with 25um x 100um pixels need offset bumps All other sensor designs work equally well with either one. NO YES Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 33 RD53 Offset or Grid bump patterns can actually look very similar No need for more difficult variant (no need to stagger every column. Staggering every pair achieves same thing) Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 34 RD53 Sept. 3, 2014 Multicore Concept RD53 High Rate Redout Chip – M. Garcia-Sciveres 35 RD53 Rad Hard logic lagged Moore's Law due to ELT, but now caught up 65nm 130nm 0.25um ELT Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 36 RD53 ● ● FE-I4 Digital Region Digital block is shared with 4 inputs- each form an identical analog pixel. A simple digital processing “core” 100 m 500 m Sept. 3, 2014 RD53 High Rate Redout Chip – M. Garcia-Sciveres 37