InfiniBand Trade Association Active Time Domain Testing for FDR Cables InfiniBand Trade Association Revision 1.6 03/27/2014 Tektronix Active Time Domain Method of Implementation: FDR Active Cables Credit 20’th Century Fox 1974, adaptation of Mary Shelley's novel Frankenstein “Young Frankenstein” from which the concept of MOI’s was derived. This material is provided for reference only. The InfiniBand Trade Association does not endorse the vendor’s equipment outlined in this document. This document is provided "AS IS" and without any warranty of any kind, including, without limitation, any express or implied warranty of non-infringement, merchantability or fitness for a particular purpose. In no event shall IBTA or any member of IBTA be liable for any direct, indirect, special, exemplary, punitive, or consequential damages, including, without limitation, lost profits, even if advised of the possibility of such damages Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 1 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Table of Contents Glossary ............................................................................................................................................................3 References:............................................................................................................................................................................... 4 Equipment List.......................................................................................................................................................................... 4 NOTE : Reference Appendix 6 for specific guidance on measurement windows for allowable in this setup and calibration process. .................................................................................................................................................................................... 5 Quick Overview of Fixture Calibration and DUT testing .......................................................................................................... 5 Divider Networks...................................................................................................................................................................... 6 TEKTRONIX 72004 Real-Time Oscilloscope DPOJet Setup Files ............................................................................................... 6 TEKTRONIX DSA8300 Equivalent-Time Oscilloscope Setup Files ............................................................................................. 6 Voltage Range Setting for FDR AOC Assemblies Using Mellanox-Diolan I2C-Bridge ............................................................... 8 STEP-1 - Calibrate the Counter-Propagating (output) Aggressor Signals Required for Victim Stressed-Eye-Calibration........ 8 STEP-2 - Co-Propagating Cross-talk (FEXT) Calibration ............................................................................................................ 8 STEP-3 - Victim Stressed-Eye Calibration ................................................................................................................................. 9 STEP 4 - Calibrating the Counter-Propagating (Input) Aggressors (NEXT) On MCB-2.............................................................. 9 Step 5 - DUT Testing ................................................................................................................................................................. 9 Appendix 1: Tables of QDR and FDR IBTA Victim Specifications............................................................................................ 14 Appendix 2: Tables of QDR and FDR IBTA Aggressor Parameters ......................................................................................... 15 Appendix 3: Tables of FDR Settings used at Plug-Fest-22 ...................................................................................................... 16 Appendix 4: Table of FDR Victim Measurements taken at IBTA Plug-Fest-22 October 2012 ................................................ 17 Appendix 6: Allowable Spec and Measurement value margins. ............................................................................................ 19 Appendix 8: Diagram at Active Optical Time Domain DUT Test Fixture ................................................................................ 20 Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 2 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Glossary This section provides definitions of the terminology used throughout this document. The reference diagram in Figure 1 is a considerably simplified representation of the ATD test system presented in this document, illustrating the terms defined in the glossary. Active-Optical Cable assembly. Cable assemblies that use fiber–optic transceivers and fiber-optic interconnects to transmit high-speed serial data such as InfiniBand and Ethernet. Active Time-Domain testing. A test methodology for active-cable-assemblies, (primarily Active Cable) where time-domain parameters such as jitter, eye-height and eye-width are measured on a stressed victim signal. The phenomena of a signal transmitted on one channel coupling energy onto an adjacent channel, causing an undesirable effect. Adjacent channels which generate crosstalk energy and are driven from the input side of the test system and propagate in the same direction as the victim channel. Adjacent channels which are driven from the output side of the test system, propagating in the opposite direction as the victim channel, and imposing crosstalk energy onto the victim channel at the output side of the ATD test system. Adjacent channels which are driven from the output side of the test system, propagating in the opposite direction as the victim channel, and imposing crosstalk energy onto the victim channel at the input side of the ATD test system. Far-End Cross-Talk. Cross-Talk which occurs at the Far-End of a link. In ATD testing, the location of the FarEnd is defined with respect to where the victim measurement is performed. FEXT will normally occur at the input of the ATD test system. AOC ATD Cross-Talk Co-Propagating Input Aggressors Counter-Propagating Output Aggressors Counter-Propagating Input Aggressors FEXT Host Compliance Board. PCB board or interface with known signal integrity characteristics that allow testing of host or switch specifications. The HCB is used for calibrating signals in the ATD test system. (HCB not illustrated below) Module Compliance board. PCB board or interface with known signal integrity characteristics which allows testing of “modules” such as QSFP cable assemblies. Near-End Cross-Talk. Cross-Talk which occurs at the Near-End of a link. In ATD testing, the location of the Near-End is defined with respect to where the victim measurement is performed. NEXT will normally occur at the output of the ATD test system. Pulse Pattern Generator. Signal generator used to generate pseudo random binary data for traffic. HCB MCB NEXT PPG ATD TEST SYSTEM Co-propagating aggressors ATD INPUT TERMINATE Victim Tx1 Rx1 Tx2 Rx2 Tx3 Rx3 Tx4 Rx4 Rx1 Tx1 Rx2 Tx2 Rx3 Tx3 Rx4 Tx4 Counter-propagating Input Aggressors MCB-1 MCB-2 Active Cable / DUT Victim SCOPE Victim Measurement PPG Counter- Propagating Aggressor Source Counter-propagating Output Aggressors Figure 1. Glossary Reference Diagram Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 3 of 20 ATD OUTPUT PPG Victim Source NEXT TERMINATE PPG Co-Propagating Aggressor Source FEXT InfiniBand Trade Association Active Time Domain Testing for FDR Cables References: IBTA Volume 2 Physical Specification Draft – November 6th 2012 Equipment List Tektronix PPG3002 – 30Gbps two channel Pulse Pattern Generator Tektronix PPG3001 or BSA286CL - 30Gbps 1 channel Pulse Pattern Generator, or a BSA286CL 28.6G BERTScope in cases where BER performance measurements are required. Tektronix LE320 – 32Gbps Linear 9 Tap Equalizer Tektronix DSA 72004 – Real-Time Digital Signal Analyzer 20GHz Oscilloscope (Used for SDR, DDR, QDR Speeds) Tektronix DSA8300 – Equivalent-Time Digital Signal Analyzer (Used at QDR, FDR and EDR Speeds) Tektronix 80E10B – 50 GHz sampling Head Tektronix 82A04B – 30 GHz phase reference Tektronix CR286A – (Option HS, 80A08 Cabling & Splitters) if retiming occurs within AOC. Molex zQSFP+ 25Gbps Test Board (MCB) Qty 2 – PN: PCB-111114-3020-REVA – Molex Host Compliance Board Molex MCB requires 12 short <1ps phase matched cable pairs 6” in length to extend to power combiners. Tek part number 174636200 or equivalent. -orWilder TF-QSFP+-TPA100G-HCB-P: Qty 2 – QSFP+ Test Point Adaptor, Host Compliance Board Plug Wilder TF-QSFP+-TPA100G-MCB-R: QSFP+ Test Point Adaptor, Module Compliance Board Receptacle Wilder MCB will require 12 male to male SMA interconnects to adapt the power splitter female to Wilder MCB female cables. SMA Interconnect Cables: Qty8 – Specified to a bandwidth of at least 18Ghz (25GHz Preferred); Phased matched pairs to +/- 2pS Picosecond Pulse Labs 5334-135(FDR Speeds) or 5334-257 (EDR Speeds): Qty 4 – 5 Way Power Splitters. Mellanox/Diolan I2C-Bridge –I2C to USB Adaptor Dongle PC Running Windows – Used to control the I2C-Bridge device Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 4 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables NOTE : Reference Appendix 6 for specific guidance on allowable measurement windows. Quick Overview of Fixture Calibration and DUT testing NOTE: This setup assumes TX4 is the victim o Any of the lanes could be tested as victims, and if this kind of testing was really done thoroughly each of the four victim lanes would be tested in turn. At IBTA Plug-Fest events there is only time to test one of the lanes as an audit. Other lanes could be selected as the victim for the audit on a case by case basis. Quick Overview of calibration steps: o Set up connections to Tektronix test equipment Refer to Figure-2 or Figure-5 Victim and Co-Propagating Crosstalk (FEXT) Calibration Block Diagram Use MCB -HCB mated pair Divider networks are used for the FEXT and NEXT aggressors Load the proper Tektronix 80SJNB setup file for the victim stressed eye testing FDR uses a hexagonal mask QDR uses a diamond max o Initial rough calibration of Victim stressed-eye y to set amplitude and emphasis tuning The victim signal should be roughly setup before FEXT and NEXT aggressors are calibrated The Tektronix PPG3002 and the LE320 emphasis unit should be tuned to output a rough approximation of the amplitude and emphasis required for The victim eye should be initially measured at the TEK DSA8300 using 80SJNB SW o Calibration of FEXT aggressors Refer to Figure-2 Victim and Co-Propagating Crosstalk (FEXT) Calibration – Block Diagram The FEXT aggressors are measured at TP6A using the TEK DSA8300 o Calibration of NEXT aggressor Refer to Figure-3 Counter Propagating (NEXT Calibration) – Block Diagram Use MCB –HCB mated pair The NEXT aggressor are measured at TP6A using the TEK DSA8300 o Calibration of Vitim with properly calibrated FEXT and NEXT aggressors It will likely take a few tuning trials until all victim stressed eye specifications are met Adjust the amplitude and emphasis of the victim to meet victim eye-mask and jitter specs The settings on the jitter generator will need to modified as required The Final measurements of the victim should be recorded A 80SJNB report should be generated and saved Quick Overview of DUT Testing: Refer to Figure 1 which is a diagram named: “Limiting Active – TimeDomain Testing – DUT Testing – Block Diagram” o Figure-1 shows the complete setup for DUT testing o All Calibration steps for the victim, NEXT aggressors and FEXT aggressors need to be completed before DUT testing can proceed o The victim input signals and the co-propagating (FEXT) aggressors are connected to MCB-1 o Counter-propagating (NEXT) Crosstalk are connected to the Tx connectors of MCB-2 o The stressed eye Victim measurements are taken off MCB-2 using a Tektronix DSA8300 Equivalent Time Oscilloscope for QDR, FDR and EDR speeds. o A 80SJNB automated routine measures all the appropriate parameters o Results are collected and a report is generated from the 80SJNB tool. Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 5 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Divider Networks Power Divider networks that split a signal coming from the PPG into multiple signals. This allows two PPG units to drive all the aggressor signals required for testing There are obvious pros and cons of using divider networks, for testing o Divider networks are primarily used to limit the number of PPG units required for testing o It is desirable to have more PPG units for added flexibility of aggressor signal generation Please note in the setup diagrams, that the second PPG unit used to drive the NEXT aggressors is set to a slightly lower data rate of 14.0Gbps, compared to 14.0625 for the victim and FEXT aggressors. o This is to make the NEXT aggressors out of phase with the victim input signal Also note that the signal ended “P” and N” pairs for the NEXT and FEXT signals should be alternated so that lanes are 180º out of phase with each other TEKTRONIX 72004 Real-Time Oscilloscope DPOJet Setup Files Tektronix DPOJet setup files have been created or both FDR and QDR ATD testing o These setup files are controlled by the IBTA and the IOL Any setup files that are used should be verified that they are using parameters from the latest IBTA specification TEKTRONIX DSA8300 Equivalent-Time Oscilloscope Setup Files Tektronix DSA8300 setup files which contain the QDR, FDR and EDR Mask geometries can be downloaded here. https://danahertm.box.com/s/e63icjum1eg2qhpgdt0u These Masks should be imported into the DSA8300 as follows: Note: (To be incorporated into setup file at some future date) Ensure sampling density is set to 1000 Waveforms to be accrued before stop should be set to 2000 Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 6 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables In this configuration, the display shows 2 UI’s of data. Only the center UI is measured against the mask. This means 1000 samples * 2000 accrued waveforms / 2UI which offers 5.0E-5 mask certainty with 50 hits maximum. Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 7 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Voltage Range Setting for FDR AOC Assemblies Using Mellanox-Diolan I2C-Bridge NOTE: Please refer to the IBTA specification for full information on range settings for FDR AOC assemblies. The range setting on FDR AOC assemblies needs to be set at both DUT plug-ends o Range settings in FDR AOC assemblies are a non-sticky setting in the AOC QSFP memory map Range settings are accessed on Page-3 bytes 238 and 239 (0xEE and 0xFF) The IBTA / IOL uses the Mellanox-Diolan I2C-Bridge USB to I2C dongle to program the proper bytes o A PC is used to control the Diolan I2C-Bridge device o PLEASE see the Appendix for “bat” files that have been created to program range settings o DUT “Plug-2” is connected to MCB-2 where the O-scope measurement is made The DUT measurement must be made with Range-0 set Bytes 238 and 239 should be set to “zero” o DUT “Plug-1” is connected to MCB-1, where the victim signal is driven Plug-1 should be set to Range-0, to emulate the worst case cross-talk environment Bytes 238 and 239 should be set to “zero” STEP-1 - Calibrate the Counter-Propagating (output) Aggressor Signals Required for Victim Stressed-Eye-Calibration Please refer to Figure-2: diagram titled: “Victim and Co-Propagating Crosstalk (FEXT) Calibration - Block Diagram” o Connect the HCB to MCB-1 to form a mated pair o Connect the counter-propagating Crosstalk (NEXT) sources from the divider network driven by Tektronix PPG3002 CH2 to the HCB-RX SMA connectors (Rx1P, RX1N,RX2P,RX2N,RX3P,RX3N,RX4P,RX4N) o Measure the Counter-propagating (output) NEXT aggressor signals on the MCB-1 at TP7a RxSMA Connectors - Rx1P, RX1N,RX2P,RX2N,RX3P,RX3N,RX4P,RX4N) Changed the cross-talk source settings on the PPG as required to meet the specified limits amplitude and rise and fall transition time limits o Please see Ampendix-2 for target value for amplitude and transition times of the NEXT outputaggressors Note: These aggressors emulate the counter-propagating signals at the output of the cable DUT which will be set to amplitude range 0 o For FDR The measured r/f transition time at MCB-1 TP7A should measure 17ps at each test pointMeasured with a 17GHz low-pass filter STEP-2 - Co-Propagating Cross-talk (FEXT) Calibration Start with same mated pair setup from Step-1; with the now calibrated counter-propagating Cross-talk source o Terminate the MCB-1 the eight RX SMA connectors with 50-ohm loads (Rx1P, RX1N,RX2P,RX2N,RX3P,RX3N,RX4P,RX4N) o Plug the Victim generating source into the selected victim TX lane of MCB-1: Tx4P and TX4P We will calibrate the victim in Step 3; For now leave the victim to work on the three other copropagating cross-talk lanes o Connect the Co-Propagating Cross-talk (FEXT) sources from the divider network driven by Tektronix PPG3001 CH-1 into MCB-1 on into the non-victim” Tx lines: TX1P,TX1N, TX2P, TX2N, TX3P,TX3N Turn on the crosstalk source generator o One by one, measure the six Co-propagating cross-talk signals at TP6A of the HCB: TX1P,TX1N, Tx2P,Tx2N,TX3P,TX3N, Changed the cross-talk source settings as required to meet the specified limits o Please refer to Appendix-2 for target value for amplitude and transition times of the FEXT Input signals Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 8 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables o The rise /fall transition time at TP6A should be measured with a 17GHz low-pass filter o After each crosstalk signal is successfully measured to spec limits, terminate the SMA connectors with 50-ohm loads STEP-3 - Victim Stressed-Eye Calibration Start with same mated pair setup from Step 2, with all of the cross-talk sources calibrated and terminated in the correct places o Verify that the Victim source generator is connected and is set up to reasonable starting settings (for instance the settings from PF-21 are a good starting point) o Connect the Victim output on the HCB TX4P, TX4N to a TEK DSA8300 equivalent time oscilloscope with 80SJNB80SJNB based Jitter and eye-mask measurement tools Load the 80SJNB setup configured for ATD Victim calibration found here. https://danahertm.box.com/s/c4nt3xiwz3bdihjm8w6u o Measure the eye-mask, jitter and DDPWS parameters Modify the amplitude, emphasis and jitter sources to meet the victim input specs in the presence of Far-end and near-end crosstalk; It will most likely take several trial before the specifications are met o Please see Appendix--1 Victim-Input Specifications for the target parameters of the Stressed-eye Victim Measurements in the presence of FEXT and NEXT crosstalk should STEP 4 - Calibrating the Counter-Propagating (Input) Aggressors (NEXT) On MCB-2 Please Refer to Figures-3 and 6: Limiting Active – Time-Domain Testing – Counter Propagating (NEXT Calibration) - Block Diagram (Tektronix configured generators) NOTE: The signals for the NEXT aggressors are driven by a second PPG in Frame-B. The PPG-2 for these signals uses a second synthesizer clock that is set to 14.0GHz; Slightly out of phase with PPG-1. (See Figure3) o Disconnect HCB from MCB-1 o Remove the crosstalk sources from RX lines on HCB o Connect the HCB to MCB-2 to form a mated pair o Connect the “counter-propagating” cross-talk sources to the TX SMA connectors on MCB-2 TP5a: TX1P, TX1N, TX2P, TX2N, TX3P,TX3N,TX4P,TX4N o Turn on the Counter propagating Cross-talk source generator Tektronix PPG 3002 (Figure 3) Note the input clock to the Pattern generator is intentionally set to 14.0GHz The data rate of the counter propagating PPG will slightly offset form the standard data rate of 14.1Gbps to help create a worst case aggressor source o Measure the (input) counter-propagating signals at the HCB TP6A: TX1P, TX1N, TX2P, TX2N, TX3P,TX3N,TX4P,TX4N o Please see Apendix-2 for the amplitude and transition time parameters to be measured at TP6A Note: These aggressors emulate the counter-propagating signals generated by the switch (or host) to the input of the cable o The measured r/f transition time at TP6A measured with a 17GHz low-pass filter o After each crosstalk signal is successfully measured to spec limits, terminate the SMA connectors with 50-ohm loads o Disconnect the HCB from MCB-2 Step 5 - DUT Testing All calibration steps must be completed before DUT testing can commence o Figure-1 shows the complete setup for DUT testing Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 9 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables o Connect Plug-1 of the DUT cable into MCB-1 that has victim and aggressors calibrated using step-2 above o Connect Plug-2 of the DUT cable into MCB-2 that has the counter-propagating aggressors (NEXT) calibrated using Step-4 above o Run the proper I2C-USB Bridge commands to set Plug-2 in MCB-2 to range-0 for DUT testing Plug-1 in MCB-1 should be set to Range-1 o Connected the TEK DSA8300 equivalent time Oscilloscope to the MCB-2 victim lane (RX4P, RX4N) o Load the proper TEK 80SJNB and Mask setup files for FDR Limiting Active Cable Testing o Run TEK 80SJNB80SJNB and Measure the victim to IBTA Specifications: Eye-mask hit ratio test set at Tx amplitude Range-0 o Record measured values in proper DUT spreadsheet o Perform a print to file operation on 80SJNB to capture a full report for this DUT.80SJNB o NOTE: It is recommended that the DSA8300 Bandwidth be limited (Setup->Vertical Menu) to 20GHz for QDR, 30GHz for FDR and 60GHz for EDR speeds. Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 10 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Limiting Active – Time-Domain Testing - DUT Testing - Block Diagram Primary Reference: IBTA Volume 2 Physical Specification Release – November 6th 2012 FDR -- Range-1 TP7a Rx2 Rx1 Data Victim D, D_N Data CH2 (14.0625) C2 Jitter Impairments (Not Used) D, D_N Co-Propagating Aggressors QSFP PCB Connector (FEXT) (Diff Pairs) TP5a Divider Network X2 Tx1 D, D_N Co-propagating Aggressors (FEXT) I2C-Clk / Tx2 FDR -- Range-0 Data Rx1-Rx4 50-Ohm Terminated MCB-1 Tx2 D, D_N Tx3 D, D_N TP7a Rx1 TP6A Rx2 Rx4 QSFP PCB Connector DUT DUT Plug-2 DUT Plug-1 DUT –Limiting Active Cable Assembly Victim Calibration Measurement point MCB-2 HCB – Rev3 – Counter-Propagating Aggressors (NEXT) (Diff Pairs) (Diff Pairs) TP5a TP8a Rx4 Tx1 Rx2Tx2 Tx4 Rx1 Tx3 Rx3 Counter- D, D_N propagating (input) Aggressors PN: PHY-SI QSFP28 P and N outputs of the NEXT and FEXT divider networks should plugged in 180-degees out of phase with each other SMA cables used ideally should be rated for 26GHz, (NEXT) low loss, phased matched, 18-inches P and N outputs of the NEXT and FEXT divider networks should plugged in 180-degees out of phase with each other Divider Network X2 Power Dividers are 5 way resistive couplers Tektronix part number 174-6214-00. Required 4 units. 2.92 Cables are 16 pairs of Tektronix part number PMCABLE1M (phase matched pairs). C. Cole – Intel Corporation 2-27-2013 J. Calvin J. Dunford – Tektronix 8-27-2013 Figure 1: ATD DUT Test Diagram, Tektronix Generator Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx TP6A Victim D, D_N TEK DSA8300 Equivalent Time Scope – (80SJNBT Software) BW 70GHz set to reasonable limits D, D_N D, D_N D, D_N D, D_N PPG3001 or BSA286C (1 Ch Gen) CH1 (14.0G) Rx3 Tx3 Tx4 Rx2-Rx4 50-Ohm Terminated Rx4 - Victim Data I2C-Clk / Data MCB è Module Compliance Board Tx1 - Victim CH1 Jitter Impairments Tek LE320 Emphasis “IB_FDR_Victim” Preset Tx4 - Victim PPG3002 (2 Ch Gen) CH1 (14.0625) Rx3 PC Connected to a Diolan USB/I2C Adaptor 03/27/2014 Revision 1.6 Page 11 of 20 DUT Eye-Mask Measurement - by TEK DSA8300 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Limiting Active – Time-Domain Testing – Victim and Co-Propagating Crosstalk (FEXT) Calibration - Block Diagram Primary Reference: IBTA Volume 2 Physical Specification Release – November 6th 2012 PPG3002 (2 Ch Gen) CH1 (14.0625) Data Tek LE320 Emphasis “IB_FDR_Victim” Preset Victim Rx1 D, D_N D, D_N Rx3 D, D_N QSFP PCB Connector MCB-1 Divider Network X2 Co-Propagating Aggressors D, D_N QSFP Plug HCB (FEXT) (Diff P airs) TP5a Tx2 Tx1 D, D_N TP6a (Diff P airs) Tx1 Tx2 Tx3 Tx1, Tx2, Tx3 50-Ohm Terminated Rx4 D, D_N Tx3 TP6a (Diff P air) D, D_N TEK DSA8300 Equivalent Time Time Scope – BW 70GHz (80SJNB Software) (Diff P airs) Rx1 Rx2 D, D_N D, D_N (FEXT) D, D_N Rx3 Victim Eye-Mask Measurement - by TEK DSA8300 Rx4 D, D_N D, D_N Counterpropagating (output) Aggressors (NEXT) PPG3001 or BSA286C (1 Ch Gen) CH1 (14.0G) P and N outputs of the NEXT and FEXT divider networks should plugged in 180-degees out of phase with each other Tx4 - Victim Data CH2 (14.0625) C2 Jitter Impairments (Not Used) Rx2 HCB è Host Compliance Board used for calibration only MCB è Module Compliance Board Co-Propagating X-TALK Measuring P oint. Tx1, Tx2, Tx3. Measured one at a time. Terminate when not measured MCB-HCB Mated Pair TP7a Rx1-Rx4 50-Ohm Terminated Tx4 - Victim CH1 Jitter Impairments Counter-Propagating X-TALK Measuring P oint. Rx1, Rx2, Rx3, Rx4 - Measured one at a time. Terminate when not measured Note: Input calibration eye-mask will actually be a hexagonal mask (this was the measuremen t at PF-21 Divider Network X2 Power Dividers are 5 way resistive couplers Tektronix part number 174-6214-00. Required four units. 2.92 Cables are 16 pairs of Tektronix part number PMCABLE1M (phase matched pairs). C. Cole – Intel Corporation: 2-27-2013 J. Calvin , J. Dunford: Tektronix: 8-29-2013 Figure 2: ATD Victim and FEXT Calibration, Tektronix Generator Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 12 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Limiting Active – Time-Domain Testing – Counter Propagating (NEXT Calibration) - Block Diagram Primary Reference: IBTA Volume 2 Physical Specification Release – November 6th 2012 HCB è Host Compliance Board used for calibration only MCB è Module Compliance Board MCB-HCB Mated Pair PPG3002 (2 Ch Gen) CH1 (14.0625) Data Data CH2 (14.0625) C2 Jitter Impairments (Not Used) Rx1 Rx2 Rx3 TP6A TP7a Tx2 Rx2 Tx3 Rx3 Tx4 Rx4 Rx2-Rx4 50-Ohm Terminated Rx4 Rx1-Rx4 50-Ohm Terminated HCB QSFP Plug D, D_N QSFP PCB Connector Victim Calibration Measurement point MCB-2 Divider Network X2 HCB – Rev3 – Counter-Propagating PN: PHY-SI QSFP28 Aggressors (NEXT) (Diff Pairs) (Diff Pairs) TP5a TP8a Rx4 Tx4 Tx1 Rx2Tx2 Rx1 Tx3 Rx3 (Diff Pairs) TP6a Tx1 FEXT -Aggressors – Tx2 Tx3 Tx4 NOT CONNECTED D, D_N D, D_N D, D_N D, D_N during Victim and D, D_N D, D_N D, D_N D, D_N NEXT calibration Tx1, Tx2, Tx3, Tx4 - Measured one at a time – Terminate when not measured TEK DSA8300 Equivalent Time Scope (80SJNB Software) BW: 20GHz – QDR BW: 30GHz – FDR BW: 70GHz - EDR D, D_N PPG3001 or BSA286C (1 Ch Gen) CH1 (14.0G) Rx4 - Victim Not Used for NEXT Cal Tx1 - Victim CH1 Jitter Impairments Tek LE320 Emphasis “IB_FDR_Victim” Preset D, D_N TP6A TEK DSA8300 Equivalent Time Scope (80SJNB Software) BW: 20GHz – QDR BW: 30GHz – FDR BW: 70GHz - EDR Counterpropagating (input) Aggressors (NEXT) Divider Network X2 Power Dividers are 5 way resistive couplers Tektronix part number 174-6214-00. Required four units. 2.92 Cables are 16 pairs of Tektronix part number PMCABLE1M (phase matched pairs). Divider Network Block Diagram – Four Power Dividers required – 16 phased matched SMA interconnect cables will be required for two PPG driving aggressors C. Cole – Intel Corporation 2-27-2013 J. Calvin/J. Dunford – Tektronix Inc 09/03/2013 Figure 3: NEXT Calibration Diagram, Tektronix Generator Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 13 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Appendix 1: Tables of QDR and FDR IBTA Victim Specifications Victim Input Specifications - FDR Data Rate 14.0625Gbps UI 71.111ps Pattern PRBS31 (PRBS9-DDPWS) X1* 0.11UI 7.822ps X2* 0.31UI 22.004ps Y1* 95mV 190mVpp Swing Y2* 350mV 700mVpp Swing J2* 0.19UI 13.51ps J9* 0.34UI 24.17ps DDPWS* 0.11UI 7.82ps * Governed by Table 72 Victim Input Specifications - QDR Data Rate 10.0Gbps UI 100ps Pattern PRBS7 X1* 0.15UI 15ps Y1* 250mV 500mVpp Swing Y2* 600mV 1200mVpp Swing TJ* 0.30UI 30ps * Governed by Table 68 Victim Output Specifications - FDR Data Rate 14.0625Gbps UI 71.111ps Pattern PRBS31 X1-Max* 0.30UI 21.333ps Y1* 50mv 100mVpp Swing Y2* 225mV 450mVpp Swing J2-Max* 0.44UI 31.28ps J9-Max* 0.69UI 49.06ps tr-Min* 17ps (20/80) * Governed by Table 73 Victim Output Specifications - QDR Data Rate 10.0Gbps UI 100ps Pattern PRBS7 X1* 0.36UI 36.0ps Y1* 100mV 200mVpp Swing Y2* 600mV 1200mVpp Swing TJ* 0.72UI 72.0ps tr-Min NA (Not Specified) * Governed by Table 69 Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 14 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Appendix 2: Tables of QDR and FDR IBTA Aggressor Parameters Co-Propagating FEXT Input Aggressors - FDR Data Rate 14.0625Gbps Comment UI 71.111ps Pattern PRBS31 Amplitude +/- 20% victim VMA Initial setting 220-250mVpp tr** 24ps (20/80) No faster than ** Govered by Table 71 and 49 Co-Propagating FEXT Input Aggressors - QDR Data Rate 10.0Gbps Comment UI 100ps Pattern PRBS7 Amplitude +/-20% victim VMA Initial setting 600-700mVpp tr** 30ps (20/80) No faster than ** Govered by Table 45 Counter Propagating NEXT Output Aggressors - FDR Data Rate 14.0Gbps Comment UI 71.428ps Pattern PRBS31 Amplitude 450mV PP NOT to exceed* tr** 17ps (20/80) No faster than *Intention is to source largest amplitude allowed by Table 72 ** Govered by Table 49 Counter Propagating NEXT Output Aggressor - QDR Data Rate 9.9Gbps Comment UI 99ps Pattern PRBS7 Amplitude 1200mV PP NOT to exceed* tr** 30ps (20/80) No faster than * Intention is to source largest amplitude allowed by Table 69 ** Govered by Table 45 Counter Propagating NEXT Input Aggressors - FDR Data Rate 14.0Gbps Comment UI 71.428ps Pattern PRBS31 Amplitude 700mV PP NOT to exceed* tr** 24ps (20/80) As close as possible *Intention is to source largest amplitude allowed by Table 71 ** Govered by Table 49 Counter Propagating NEXT Input Aggressors - QDR Data Rate 9.9Gbps Comment UI 99ps Pattern PRBS7 Amplitude 1200mV PP NOT to exceed* tr** 30pS (20/80) No faster than * Intention is to source largest amplitude allowed by Table 68 ** Govered by Table 45 Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 15 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Appendix 3: Tables of FDR Settings used at Plug-Fest-22 Co-Propagating Input Aggressors -Target @250mVMA tr 24pS Divider Diff Pair TEK Measurement VMA Tx1 Amp 0.363Vpp SE 0.251 Diff TX1 Rise pS Tx1Fall pS VMA Tx4 Amp 0.363Vpp SE 0.244 Diff TX4 Rise pS Tx4Fall pS Divider Math - For Individual Diff Pair (Amp pp SE * 2 ) /4 = Vpp diff - loss thru divider PPG Vpp Amp Vpp divide by 4 Vpp SE Diff Diff Units Vpp 0.726 1.452 Diff 0.363 Clock: 14.065-GHz – 1800A - Frame-A Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx Counter-Prop Output Aggressors -Target 450mVpp - tr 17pS Divider Diff Pair TEK Measurement Vpp RX1 Amp 0.433 Vpp SE 0.452 Diff RX1 Rise pS RX1 Fall pS Vpp RX3 Amp 0.433 Vpp SE 0.454 Diff RX3 Rise 37.43 pS RX3 Fall pS Divider Math - For Individual Diff Pair (Amp pp SE * 2 ) /4 = Vpp diff - loss thru divider PPG Vpp divide by 4 Vpp SE Amp Vpp Diff Diff Units Vpp 1.12 2.24 Diff 0.560 Clock: 14.000-GHz 1800A - Frame-B 03/27/2014 Revision 1.6 Page 16 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Appendix 4: Table of FDR Victim Measurements taken at IBTA Plug-Fest-22 October 2012 Victim Measurements on TEK 72004 TEK DSA 72004 Real-Time Scope Parameter Value Units Pattern Vpp Amplitude 0.428 Diff PRBS31 J2-A 8.42 pS PRBS31 J2-B 11.31 pS PRBS31 J2-Average 9.865 pS PRBS31 J9-A 21.16 pS PRBS31 J9-B 22.34 pS PRBS31 J9-Average 21.75 pS PRBS31 DDPWS 0.0696 UI PRBS9 tr 21.4 pS PRBS31 Note: J2 and J9 Measurements are “bracketed” on the TEK DSO72004 Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 17 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Appendix 5: FDR Range Settings Commands using the Mellanox-Diolan – I2C-Bridge Device These are the contents of “bat” files that have been created to control the Mellanox-Diolan I2C Bridge dongle Set Range 0 – File name: w238-239_to0.bat o Contents: cd C:\Program i2c r -s:0x50 i2c w -s:0x50 i2c r -s:0x50 Files (x86)\Diolan\I2CBridge.x64\bin -a:0x1:0x7f -d:0x1 -a:0x1:0x7f -d:0x1 3 -a:0x1:0x7f -d:0x1 i2c r -s:0x50 -a:0x1:0xee i2c w -s:0x50 -a:0x1:0xee PING 127.0.0.1 -n 1 >nul i2c r -s:0x50 -a:0x1:0xef i2c w -s:0x50 -a:0x1:0xef PING 127.0.0.1 -n 1 >nul i2c r -s:0x50 -a:0x1:0xee -d:0x1 -d:0x1 00 -d:0x1 -d:0x1 00 -d:0x2 Set Range 1 – File name: w238-239_to1.bat o Contents: cd C:\Program Files (x86)\Diolan\I2CBridge.x64\bin i2c r -s:0x50 -a:0x1:0x7f -d:0x1 i2c w -s:0x50 -a:0x1:0x7f -d:0x1 3 i2c r -s:0x50 -a:0x1:0x7f -d:0x1 i2c r -s:0x50 -a:0x1:0xee -d:0x1i2c w -s:0x50 -a:0x1:0xee -d:0x1 11 PING 127.0.0.1 -n 1 >nul i2c r -s:0x50 -a:0x1:0xef -d:0x1 i2c w -s:0x50 -a:0x1:0xef -d:0x1 11 PING 127.0.0.1 -n 1 >nul i2c r -s:0x50 -a:0x1:0xee -d:0x2 Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 03/27/2014 Revision 1.6 Page 18 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Appendix 6: Allowable Spec and Measurement value margins. Key sections of this MOI outline spec precise target measurement and calibration values. This table outlines acceptable upper and lower bounds on these measurements. Parameter Window Size Unit Min Nominal Max Margin Data Rate 1 UI Gb/s ps 14.0611 - 14.0625 71.111 14.0639 - 100ppm Mask Hit Ratio PRBS 31 - 4 x 10-5 - 5 x 10-5 1 x 10-5 ps UI ps UI ps UI 12.83 0.18 22.93 0.32 7.43 0.1 13.51 0.19 24.14 0.34 7.82 0.11 14.19 0.2 25.35 0.36 8.21 0.12 1.35 0.02 2.42 0.03 0.78 0.01 CounterPropagating NEXT mV 686 700 700 CounterPropagating FEXT mV CoPropagating FEXT mV J2 PRBS 31 J9 PRBS 31 DDPWS PRBS9 MOI Step Notes Per Spec Per Spec Mask Hits/Violations Step 5 441 441 450 450 450 450 Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 5% 5% 5% 2% 2% 2% Step 3 Calculated Normative Spec Calculated Normative Spec Calculated Normative Spec Step 4 Nominal per spec Step 1 Nominal per spec Step 2 Nominal per spec Step 3 Step 3 70 45 45 03/27/2014 Revision 1.6 Page 19 of 20 InfiniBand Trade Association Active Time Domain Testing for FDR Cables Appendix 8: Diagram at Active Optical Time Domain DUT Test Fixture Figure 2: Picture of an AOC assembly being tested using Tektronix BSA286C, LE320, PPG3002 test equipment. __________________________________________________________________________________________ Tektronix ATD MOI for FDR Active Cables_Rev1_6a.docx 3/27/2014 Revision 1.0.6 Page 20 of 20