Basic Economics of 10GE over Structured UTP IEEE 802.3 10GBASE-T Study Group Ahmet Tuncay 10GE LAN Application Requirements ! Gig-to-the-Desktop Migration ! ! ! Distributed Computing ! ! ! Fat Pipes for system connection 16 to 48 ports per data-center Switch (typical cluster size) IP Storage ! ! ! Stackable Switch Aggregation (10GE uplinks) 8 to 16 ports per data-center Switch Aggregation for storage systems 32 to 64 ports per data-center Switch (typical SAN size) All require < 10 x $[1000BASE-T] connection 1/2/2003 IEEE Vancouver Jan 2003 2 Enterprise (LAN) Statistics ! ! Over 600 million Ethernet UTP ports are installed Nearly all new installs are CAT5e & CAT6 UTP 50% of data centers have only UTP Ports (Millions) ! Ethernet Port Shipments per Year 450 400 350 300 250 200 150 100 50 0 421 375 325 Copper 268 208 Fiber 208 Wireless 26 3 2000 41 10 30 6 2001 2002 50 14 2003 58 17 2004 69 21 2005 Year Cahners In-Stat July 2001 1/2/2003 IEEE Vancouver Jan 2003 3 UTP Transition Case Studies 1,000,000 100,000 41,069 62,283 10Mbps Total Ports (K) 25,902 Ports Shipped (1000's) 15,974 35,136 9,835 10,000 4,158 53,287 22,161 6,035 13,666 100Mbps Total Ports (K) 6,077 1,442 10Mbps UTP Ports (K) 3,095 100Mbps UTP Ports (K) 1,000 222 363 1GE Total Ports (K) 100 1GE UTP Ports (K) 13 Sources: Switch Port Shipment: Dell’Oro NIC & LOM Shipments: Smith Barney Copper IC Shipments: Smith Barney 10 1 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 It’s about the Cost of Ownership 1/2/2003 IEEE Vancouver Jan 2003 4 LAN Cost of Ownership Elements ! Capital Equipment ! ! ! ! ! ! ! ! 1/2/2003 ! Switch (HW, SW) – Chassis, Module, Port NIC Port (HW, SW) Cabling & Connectors Labor Closet/HVAC Patch cords Patch panels Wall boxes Operating ! ! ! ! ! Moves, Adds, Changes Maintenance & monitoring tools & time Troubleshooting & repair tools & time Training & materials FCAPS (Fault, Configuration, Accounting, Performance, Security) Management IEEE Vancouver Jan 2003 5 LAN Capital Cost Comparison 2007 Sample Network Cost Comparison Relative Cost NIC Port Overall network connectivity costs dominated by the cost of the silicon &/or optics on NICs & switch ports. Switch Port Cabling & Connectors Labor Closet/HVAC Patchcords Patch Panel 1000BASE-T 10GBASE-T Installed Installed Structured Structured Wiring Wiring 10GBASE-T New Cat-5e UTP 10GBASE-T New Cat-6 UTP 10G Installed 10G New 50u 50u MMF w/ MMF - 850nm VCSEL 850nm VCSEL Wall Boxes Sample data-center network of 25 application servers, 6 back-end servers, Connected over structured cabling (average link 85m). 1/2/2003 IEEE Vancouver Jan 2003 6 LAN Capital Cost Trends Sample Network Total Cost Comparison (Normalized to 1000BASE-T in 2007) 35 33 Normalized Relative Cost 30 25 10GBASE-T Installed Structured Wiring 27 26 17 10GBASE-T New Cat-6 UTP 18 15 5 10GBASE-T New Cat-5e UTP 22 20 10 10GBASE-T trend will get us to 10x performance at 3x price 3 10G Installed 50u MMF w/ 850nm VCSEL 11 2 1 7 1 2006 2007 0 2004 1/2/2003 1000BASE-T Installed Structured Wiring 2005 Year IEEE Vancouver Jan 2003 10G New 50u MMF 850nm VCSEL 7 Closer Look at Ethernet LAN Equipment Departmental Switches W2K NT Storage Devices (iSCSI HBA) Corporate Servers/Filers Unix Collapsed Backbone Corporate Storage NAS Cache/ Router DRAM MAC UTP PHY MAC UTP PHY SRAM BackPlane I/f Departmental Servers/Filers NP Ctrl Proc DRAM MAC UTP PHY MAC UTP PHY DRAM SRAM uP (TCP Offload) WAN/ Internet MAC UTP PHY Bus Controller Server: NIC or HBA Switch: Multi-port I/O Blade 1/2/2003 IEEE Vancouver Jan 2003 8 LAN Equipment Cost Factors UTP solutions have significant cost advantages 1/2/2003 IEEE Vancouver Jan 2003 9 PHY Cost Elements ! Analog Front End (AFE) & DSP ! ! ! ! ! ! CMOS Process, Mask & Metal Layers Die & Package Size, Package Pin Count Gate & Transistor count, memory Power supplies, heat sinks Clocks, external circuits UTP Front End ! 1/2/2003 Magnetics, Transformers, Regulator(s), Discretes IEEE Vancouver Jan 2003 10 PHY ASP Comparison Ethernet PHY IC ASPs (Per Port) .13 CMOS 10/100 Single PHY First Standard Products 9x$ of 1000Base-T Relative Cost 10/100 Quad/Octal PHY .35 CMOS First Standard Products 9x$ of 100Base-T 1000BASE-T Single PHY 1000BASE-T Quad/Octal PHY .22 & .18 CMOS ASP approaches unity When desktop market Drives demand/volume Regardless of initial price .13 CMOS 10GBASE-T Single PHY 10GBASE-T Quad/Octal PHY 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 Year 1/2/2003 IEEE Vancouver Jan 2003 11 Summary ! ! ! ! UTP media dominates LAN cabling & will not be obsoleted by anything else UTP wins in the LAN due to operational experience & lowest cost of ownership Economic benefits of using UTP for 10GE in the LAN are apparent & easily quantifiable 10GBASE-T enables 10GE deployment by lowering capital equipment & ownership costs to levels expected by traditional Ethernet 1/2/2003 IEEE Vancouver Jan 2003 12