400 Gigabit Ethernet
Call-For-Interest
Consensus
IEEE 802.3 Ethernet Working Group
IEEE 802 March 2013 Plenary, Orlando, FL
1
Objective for this Meeting
• To measure the interest in starting a study group
to address 400 Gb/s Ethernet interconnect
– Defining “Core OTN Transport” beyond the scope of this
effort
• We don’t need to
–
–
–
–
–
Fully explore the problem
Debate strengths and weaknesses of solutions
Choose any one solution
Create PAR or five criteria
Create a standard or specification
• Anyone in the room may speak / vote
• RESPECT… give it, get it
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
2
What Are We Talking About?
• At highest rates Ethernet is becoming dominant
traffic for client- and line-side
•
– “Core OTN Transport” is defined by the ITU-T
Interdependent problems, but not interchangeable solutions
IEEE defined Ethernet
IEEE defined Ethernet
ITU-T defined
“Core OTN Transport”
carrying Ethernet traffic
X,000 km
OUR SCOPE
March 19, 2013
OUR SCOPE
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
3
Agenda
• Presentations
– “The Bandwidth Explosion,” David Ofelt, Juniper
– “Beyond 100 Gigabit Ethernet, Technical
Challenges,” Mark Nowell, Cisco.
– “400 Gigabit Ethernet- Why Now,” John
D’Ambrosia, Dell.
• Straw Polls
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
4
Presented by
David Ofelt, Juniper
IEEE 802.3 Working Group
Orlando, FL, USA
March 19, 2013
THE BANDWIDTH EXPLOSION
March 19, 2013
5
The Ethernet Eco-System Today
Backbone Networks
Enterprises
Consumer
Internet eXchange and
Interconnection Points
Data Centers
Mobile
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
6
Changes since 2007 HSSG
• Infrastructure / Devices
–
–
–
–
–
–
–
• Applications
Smart Phones
Tablets
Wi-Fi Deployments
3G / 4G / LTE
10G Server Deployment
Internet Enabled TV
The “Cloud”
Device
Traffic Multiplier
Tablet
1.1
64-bit laptop
1.9
Internet Enabled TV
2.9
Gaming Console
3.0
Internet 3D TV
3.2
March 19, 2013
–
–
–
–
–
–
–
Cloud-based Businesses
Practical Cloud Storage
Ubiquitous Video Streaming
Social Media Explosion
Video Calling Commonplace
New Database Technology
Online Gaming
Compared against a 32 bit laptop*
*Source: http://www.ieee802.org/3/ad_hoc/bwa/BWA_Report.pdf
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
7
40/100 CFI
802.3ba start
You Are
Here
802.3ba end
Devices
40G
100GE Shipped 10G
LTE BASE-T servers
Social
networking
Tablets
Smart Phones
Internet TV Devices
Social Media
… Social Media …Social Media… Social Media …Social Media
Streaming
Games
MMOG Streaming Video
Cloud Services
Platforms&
Science
Applications
infrastructure
Standards
Highlights since IEEE P802.3ba
LHC
Cloud Storage
2006
2007
2008
2009
2010
2011
2012
2013
2014
Year
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
8
2015 Global Users and Network Connections
North America
Western Europe
Central/Eastern Europe
288 Million Users
2.2 Billion Devices
314 Million Users
2.3 Billion Devices
201 Million Users
902 Million Devices
Japan
116 Million Users
727 Million Devices
Latin America
Middle East & Africa
Asia Pacific
260 Million Users
1.3 Billion Devices
495 Million Users
1.3 Billion Devices
1330 Million Users
5.8 Billion Devices
Source: nowell_01_0911.pdf citing Cisco Visual Networking Index (VNI) Global IP Traffic Forecast, 2010–2015,
http://www.ieee802.org/3/ad_hoc/bwa/public/sep11/nowell_01_0911.pdf
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
9
Global Broadband Speed 2010-2015
Average broadband speed will grow 4X; from 7 to 28 Mbps
North America
Western Europe
Central/Eastern Europe
3.7-Fold growth
7.5 to 27 Mbps
3.9-Fold growth
9.2 to 36 Mbps
3.3-Fold growth
6.1 to 20 Mbps
Japan
4.1-Fold growth
15.5 to 64 Mbps
Latin America
Middle East & Africa
Asia Pacific
2.9-Fold growth
2.8 to 8 Mbps
2.5-Fold growth
2.8 to 7 Mbps
4.6-Fold growth
5.5 to 25 Mbps
Source: nowell_01_0911.pdf citing Cisco Visual Networking Index (VNI) Global IP Traffic Forecast, 2010–2015,
http://www.ieee802.org/3/ad_hoc/bwa/public/sep11/nowell_01_0911.pdf
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
10
Global IP Traffic Growth, 2010–2015
Regional contributions to the Zettabyte journey
North America
Western Europe
Central/Eastern Europe
22.3 EB/Month by 2015
26% CAGR, 3X Growth
18.9 EB/Month by 2015
32% CAGR, 4X Growth
3.7 EB/Month by 2015
39% CAGR, 5X Growth
Japan
4.8 EB/Month by 2015
27% CAGR, 3X Growth
Latin America
Middle East & Africa
Asia Pacific
4.7 EB/Month by 2015
48% CAGR, 7X Growth
2.0 EB/Month by 2015
52% CAGR, 8X Growth
24.1 EB/Month by 2015
35% CAGR, 4X Growth
Source: nowell_01_0911.pdf citing Cisco Visual Networking Index (VNI) Global IP Traffic Forecast, 2010–2015,
http://www.ieee802.org/3/ad_hoc/bwa/public/sep11/nowell_01_0911.pdf
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
11
Some Interesting Facts & Forecasts
•
Facebook Facts:*
–
–
–
•
Forecast May 30, 2012**
–
–
–
–
•
Every minute - 72 hours of video are uploaded
Each month 4 billion hours of video are watched
25% of global views come from mobile devices
Traffic from mobile devices tripled in 2011
Netflix
–
•
•
•
•
•
Mobile video to represent 66% of all mobile data traffic by 2017
YouTube Statistics ****
–
–
–
–
•
By 2016 – 1.2 million video minutes traveling Internet every second
“Fixed” video users: 0.792B (2011) to 1.5B (2016)
“Mobile” video users – fastest growing mobile service, 0.271B (2011) to 1.6B (2016)
Desktop videoconferencing users – 26.4M (2011) to 218.9M (2016)
Forecast Feb 2013 ***
–
•
Dec 2006 – 12 Million Users
Dec 2010 – 608 Million Users
Oct 2012 – Over 1 Billion Users
Oct 28, 2011 – “Netflix represents 32.7% of North America’s peak web traffic”
* Facebook Newsroom, Timeline, http://newsroom.fb.com/Timeline.
** May 30, Press Release, “2012, Cisco VNI Forecast,” http://newsroom.cisco.com/press-release-content?articleId=888280.
*** Visual Networking Index , Cisco, http://www.cisco.com/en/US/netsol/ns827/networking_solutions_sub_solution.html#~forecast, Feb, 2013.
****Youtube Statistics, http://www.youtube.com/t/press_statistics, data obtained Feb 15, 2013.
***** Techspot – “Netflix represents 32.7% of North America’s peak Web traffic, Oct 28, 2011, http://www.techspot.com/news/46048-netflixrepresents-327-of-north-americas-peak-web-traffic.html.
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
12
Science: Big Data Sources
CERN is “the tip of the iceberg”
Today
Future
•
•
Belle-II
– 250PB of experimental data in first 5
years of operation
•
Square Kilometer Array (SKA)
– ~2800 receivers in telescope array
– 2 petabytes/sec to central correlator
• sending @ ~100 Gb/s to
analysis centers
•
Source:
CERN
– Atlas detector in LHC (Large Hadron
Collider) generates ~1 petabyte/sec
– Trigger farm reduces to 450MB/sec
• Tens of Gb/s of outbound traffic
to analysis centers
Genome sequencing
– Per-instrument data rate strongly ↗
(~10x over 5 years)
– Data costs plummeting  vastly
increased data volume
– http://www.genome.gov/sequencingc
osts/
http://www.ieee802.org/3/ad_hoc/bwa/public/dec11/dart_01_1211.pdf (updated:
interview Eli Dart, August 29, 2012)
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
13
Findings of IEEE 802.3 BWA Ad Hoc
Traffic relative to 2010 value
100
Financial sector
fit to Figure 15
CAGR = 95%
Science
fit to Figure 13
ESnet 2004 to 2011
CAGR = 70%
10
1
Figure 39 Euro-IX
historical data
Peering
fit to Figure 39
HSSG tutorialCAGR = 64%
Cable Slide 22 core
Figure 20 CAGR = 58%
CAGR = 50%
HSSG tutorial
IP traffic Slide 22 server I/O
CAGR = 36%
Figure 2
CAGR = 32%
0.1
Figure 15 NYSE
historical data
0.01
2004
2006
2008
2010
2012
2014
2016
2018
2020
Source: http://www.ieee802.org/3/ad_hoc/bwa/BWA_Report.pdf
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
14
The Server Roadmap
1,000,000
Server Upgrade Path
100,000
Rate Mb/s
Core Networking
Doubling ≈18
mos
100 Gigabit Ethernet

2014: 40 GbE
40 Gigabit Ethernet

2017: 100 GbE

10 Gigabit Ethernet
10,000
Gigabit Ethernet
1,000
Server I/O
Doubling ≈24
mos

Blade Servers

802.3ba: 10 GbE to 40 GbE

802.3bj: 40 GbE to 100 GbE
Other Future Server I/Os

40GBASE-T

100GbE over MMF
100
1995
2000
March 19, 2013
2005
2010
2015
2020
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
15
10GbE Server Deployments
10GbE Server-class Adapter & LOM
Shipments
Server-class Adapter & LOM
10GBASE-T Shipments
8
520
2012 Results:
+50% Y/Y growth
Ports in Thousands
Ports in Millions
6
4
2
0
260
0
CREHAN RESEARCH Inc.
March 19, 2013
CREHAN RESEARCH Inc.
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
16
40GbE Server Deployment Forecast
Server-class Adapter & LOM
40GbE Shipments
Ports in Millions
6
Example: Dual port 40GbE server
40 GbE
QSFP
Ports
Source – Shane Kavanagh, Dell DCS
4
2
0
CREHAN RESEARCH Inc.
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
17
Center of the Storm – Data Centers
Demand From the North:
More Users
More Bandwidth
More Devices
More applications!
East / West Traffic
New Applications
New Databases
New Architectures
East / West
Traffic from
Next Door!
Demand From the South:
More Storage
Faster Storage
March 19, 2013
More Servers
Faster Servers
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
18
High Performance Computing
#1 SuperComputer: Performance Trend
1.E+10
1.E+09
Rmax (Gflops /s)
1.E+08
1.E+07
• Increased processing
capability will require
bigger pipes!
1.E+06
1.E+05
1.E+04
1.E+03
1.E+02
1.E+01
1.E+00
1992
Source: Top500. ORG - http://www.top500.org/statistics/sublist/.
1996
2000
Rmax
March 19, 2013
2004
2008
2012
2016
2020
Expon. (Rmax)
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
19
You Are
Here
■
■
■
2012
2013
2014
2015
More users
More mobile
More video
More devices
More data
More applications
More networked science
Larger flows
40G & 100G servers
2016
2017
2018
Social
networking
Applications
devices
■
■
■
■
■
■
infrastructure
Beyond 100 GbE
Platforms&
Science!
standards
Highlights since IEEE P802.3ba
2019
2020
Year
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
20
Link Aggregation
■
Problem: Need to scale the Network (density & cost)
■
Temporary Solution: Link Aggregation
■
Pros: Addresses bandwidth requirements between
releases of faster links
■
Cons:
● Non-deterministic performance
● Fastest flow limited to individual link speed
● Exponential bandwidth growth implies:
○ Exponential growth in number of links
○ Growth in operational & management issues
● Doesn’t scale forever.
■
Faster links address these issues and they will be
LAGGed!
Courtesy, David Ofelt, Juniper.
Physical Mockup: “80xN”
LAG using 80 links
•
•
Used 25% of all front
panel ports for single
“LAG”
OpEx Challenges
March 19, 2013
BW
100GbE
400GbE
2015
Terabit
10 x 100
3 x 400
2020
10 Terabit
100 x100
25 x 400
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
21
Section Summary
 Unrelenting



End users / devices!
Applications!
Video!
 Core

bandwidth growth everywhere
OTN Transport
Beyond scope of this effort
 Ethernet


Interconnect
Must scale to support bandwidth growth
Example – Data centers pressured from all directions
E
Enabling bandwidth
Enables applications
Drives bandwidth
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
22
Presented by
Mark Nowell, Cisco
IEEE 802.3 Working Group
Orlando, FL, USA
March 19, 2013
BEYOND 100 GIGABIT ETHERNET
TECHNICAL CHALLENGES
March 19, 2013
23
What Are We Talking About?
• At highest rates Ethernet is becoming dominant
traffic for client- and line-side
•
– “Core OTN Transport” is defined by the ITU-T
Interdependent problems, but not interchangeable solutions
IEEE defined Ethernet
IEEE defined Ethernet
ITU-T defined
“Core OTN Transport”
carrying Ethernet traffic
X,000 km
OUR SCOPE
OUR SCOPE
Economics & Optimal
Solutions are Different
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
24
CMOS Roadmap
■
CMOS IC features have shrunk by ~2x since 100Gb/s
MAC/PCS was defined in 802.3ba
■
CMOS International Technology Roadmap for
Semiconductors, 2011 Revision Overview:
■
ITRS Sponsoring Industry Associations (IAs): European
Semiconductor IA, Japan Electronics and Information
Technology Association, Korea Semiconductor IA,
Taiwan Semiconductor IA, (US) Semiconductor IA
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
25
Technology Building Blocks (1 of 2)
Electrical Signaling Development
• 25 Gb/s
–
–
–
–
•
IEEE P802.3bj (NRZ / PAM-4)
IEEE P802.3bm
OIF CEI-28G
32G Fibre Channel
OIF CEI-56G
Courtesy, Ali Ghiasi, Broadcom
x16
Connector
Modulation
Courtesy, Mark Bugg, Molex
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
26
Technology Building Blocks (2 of 2)
300 Pin MSA
(x16 interface)
GaAs
Photonics
Courtesy, Finisar Corp.
Courtesy, Atsushi Takai, Oclaro
InP
Photonics
x16 Optical
Connector
& Cable
Courtesy, CyOptics Inc.
Silicon
Photonics
Courtesy, US Conec
Courtesy, Tom Palkert, Luxtera
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
27
100G?
50G
400G (8X50G) Gen 2
25G
TbE (10x100G) Gen 1
Modulation
TBD
Modulation
TBD
400G (16x25G) Gen1
100G (4x25G) Gen 2
XLAUI
XFI
2002
March 19, 2013
???
2004
400GbE?
CAUI-4
802.3bm
CAUI
40G (4 X10)
10G
???
CEI-56G-VSR*
CEI-28G-SR*
CEI-28G-VSR*
100G (10X10) Gen 1
10G
ELECTRICAL SIGNALING RATE PER LANE
Ethernet Module Electrical Interfaces
Industry Development Efforts
Past & Possible Future
802.3ba
SFI
2006
2008
* - OIF specification or
work under way
2010
2012
2014
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
2016
2018
2020
28
An Ethernet Overview of the Problem
MAC
RECONCILIATION
CGMII
100GBASE-R PCS
PHY
Electrical Functions
•
•
•
Increase interface channel count
Increase interface rate
Increase interface modulation order
FEC
PMA
Optical Functions
•
•
•
PMD
Increase interface channel count
Increase interface rate
Increase interface modulation order
MDI
Media
MEDIUM
March 19, 2013
•
•
Increase fiber count
Increase lambda count
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
29
MAC Technical Feasibility
NP
Packet I/F
40x12.5G
100x12.5G
MAC/PCS
Module I/F
16x25G
OPTICS
40x25G?
400 Gb/s and 1 Tb/s first generation implementation, with a separate
MAC/PCS device (1 Tb/s interface widths are very challenging)
400 Gb/s and 1 Tb/s MAC options
MAC Rate
Node
Technology
Bus Width
Clock Rate
100 Gb/s
45, 40nm
ASIC
160 bits
644 MHz
100 Gb/s
45, 40nm
FPGA
512
195 MHz
400 Gb/s
28, 20nm
ASIC
400
1 GHz
400 Gb/s
28, 20nm
FPGA
1024
400 MHz
1 Tb/s
28, 20nm
ASIC
1024
1 GHz
1 Tb/s
28, 20nm
FPGA
2560
400 MHz
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
Notes
Challenging
30
A System Perspective
Switch
Backplane
Network
Processor
MAC
PHY
Module
March 19, 2013
• Interface width is not just a
module consideration, but an
overall system issue
• Wider interfaces > more pins
• More pins > More traces to route
• More power
• More cost
• More complexity
Sample architecture highlights all places that
might be needed to support interfaces in a system
Next slide shows the impact!
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
31
The Impact of the
Electrical Interface Width
60
32 Ports
50
Power → Lower
Cost → Lower
Complexity → Lower
Number of Connections (k)
1 Port
X16 Width: Historical
Maximum Module Interface
40
30
20
10
0
0
20
40
60
80
100
120
140
160
Instances of Interfaces in a System
40 Lane
March 19, 2013
20 Lane
16 lane
8 Lane
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
32
Example: Anatomy of an
Optical Module Implementation
Definition of these interfaces…
March 19, 2013
Electronics
Optics
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
Opt connector
Elec connector
… drives complexity of the module implementation
33
Matching Needs with Capabilities
Technology Options
“Mature”
“Development”. “Bleeding edge”
The never ending balancing acts!
It’s all going
to change
with time
March 19, 2013
Cost, Power,
& Density
BW
Demand
Cost, Power
Density
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
34
Potential Technology Axes for increasing
Gbit/s in the Optical and Electrical Domains
1
2
(e.g. NRZ) (e.g. PAM4)
4
(e.g. 16QAM)
Modulation
(i.e. Bits per Symbol)
P802.3bj
10
25
50
75
100
Signaling Rate
(i.e. Gb/s)
XLAUI
4
CEI-28G
8
XLAUI
4
CEI-56G
12
CAUI
8
16
Space Division Multiplexing
(i.e. Multiple Electrical Channels)
XSBI
12
16
Wavelength Division
Multiplexing (i.e. λs )
10 x 10
-LR4
4
8
12
16
Space Division Multiplexing
(i.e. Multiple Optical Fibers)
-SR4
March 19, 2013
-SR10
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
35
Example: Finding a Path to 400Gbit “Gen 1”
1
2
(e.g. NRZ) (e.g. PAM4)
4
(e.g. 16QAM)
Modulation
(i.e. Bits per Symbol)
X
P802.3bj
10
25
50
75
100
Signaling Rate
(i.e. Gb/s)
X
XLAUI
4
CEI-28G
CEI-56G
8
12
16
X
XLAUI
4
CAUI
8
XSBI
12
16
Wavelength Division
Multiplexing (i.e. λs )
X
10 x 10
-LR4
4
8
12
16
Space Division Multiplexing
(i.e. Multiple Optical Fibers)
X
-SR4
March 19, 2013
Space Division Multiplexing
(i.e. Multiple Electrical Channels)
-SR10
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
36
Example: Finding a Path to 400Gbit “Future”
1
2
(e.g. NRZ) (e.g. PAM4)
4
(e.g. 16QAM)
Modulation
(i.e. Bits per Symbol)
X
P802.3bj
10
25
50
75
100
Signaling Rate
(i.e. Gb/s)
X
XLAUI
4
CEI-28G
CEI-56G
8
12
16
X
XLAUI
4
CAUI
8
XSBI
12
16
Wavelength Division
Multiplexing (i.e. λs )
X
10 x 10
-LR4
4
Space Division Multiplexing
(i.e. Multiple Electrical Channels)
8
12
16
Space Division Multiplexing
(i.e. Multiple Optical Fibers)
X
-SR4
March 19, 2013
-SR10
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
37
Summary
• Time is not on our side:
– 2015 Capacity Requirements: 10x 2010: 1 Terabit
– 2020 Capacity Requirements: 100 x 2010: 10 Terabit
• Technology for 400 Gigabit Ethernet
–
–
–
Leverage 100GbE building blocks
Plausible implementations for today and next generation
Fits with dense 100GbE technology roadmap
• Not “can it be done” but “can it be done at right cost!”
– Power, cost, density
• We believe there is a path forward to cost-effective
400 Gb/s Ethernet!
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
38
Presented by
John D’Ambrosia, Dell
IEEE 802.3 Working Group
Orlando, FL, USA
March 19, 2013
400 GIGABIT ETHERNET WHY NOW?
March 19, 2013
39
Findings of IEEE 802.3 BWA Ad Hoc
Traffic relative to 2010 value
100
Financial sector
fit to Figure 15
CAGR = 95%
Science
fit to Figure 13
ESnet 2004 to 2011
CAGR = 70%
10
1
Figure 39 Euro-IX
historical data
Peering
fit to Figure 39
HSSG tutorialCAGR = 64%
Cable Slide 22 core
Figure 20 CAGR = 58%
CAGR = 50%
HSSG tutorial
IP traffic Slide 22 server I/O
CAGR = 36%
Figure 2
CAGR = 32%
0.1
Figure 15 NYSE
historical data
0.01
2004
2006
2008
2010
2012
2014
2016
2018
2020
Source: http://www.ieee802.org/3/ad_hoc/bwa/BWA_Report.pdf
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
40
The Future is Here…
2012 Summer Olympics
Source: https://labs.ripe.net/Members/fergalc/internettraffic-during-olympics-2012
After First Round of
Euro 2012 Matches
Source: https://labs.ripe.net/Members/fergalc/internettraffic-after-first-round-of-euro-2012-matches/AMSIXNL.png
Thanks to Bijal Sanghani, Euro-IX.
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
41
The Need for 400 Gb/s Ethernet
• Traffic is growing everywhere
–
–
–
–
–
More Internet users
More ways to access the internet faster
Higher bandwidth content
New applications enabled
And it goes on
• IEEE 802.3 BWA Forecast
– 2015 Capacity, 10x requirements of 2010 - Terabit
– 2020 Capacity 100x requirements of 2010 – 10 Terabit
• Time is not on our side…
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
42
Summary
• Bandwidth – exponential growth continues!
• New bandwidth generating applications constantly
being introduced
• Higher Speed @ lower cost per bit needed by
Ethernet Interconnect
• Past efforts took 3 to 4 years
– 10 Gigabit Ethernet
– Ethernet First Mile
– 40 Gigabit and 100 Gigabit Ethernet
• We need to begin the process to study the problem
• “The Next Speed is not the Last Speed”
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
43
Contributors
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Pete Anslow, Ciena
Chris Cole, Finisar
Kai Cui, Huawei
John D’Ambrosia, Dell
Mark Gustlin, Xilinx
Mike Li, Altera
Jeff Maki, Juniper
Andy Moorwood, Infinera
Gary Nicholl, Cisco
Mark Nowell, Cisco
David Ofelt, Juniper
Brian Teipen, ADVA
Jim Theodoras, ADVA
Steve Trowbridge, Alcatel-Lucent
IEEE 802.3 Higher Speed Ethernet Consensus Ad Hoc
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
44
Supporters Across the Eco-System (1 of 3)
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Ghani Abbas, Ericsson
John Abbott, Corning
Shamim Akhtar, Comcast
Arne Alping, Ericsson
Jon Anderson, Oclaro
Pete Anslow, Ciena
Liav Ben Artsi, Marvell
Andrew Bach, Juniper
Thananya Baldwin, Ixia
Shen Bailin, ZTE
Stephen Bates, PMC-Sierra
Mike Bennett, LBNL
Chris Bergey, Luxtera
Gary Bernstein, Leviton
Ralf-Peter Braun, Deutsche
Telecom
David Brown, Semtech
Matt Brown, Applied Micro
Steve Carlson, High Speed
Design
Martin Carroll, Verizon
Derek Cassidy, BT
March 19, 2013
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Dave Chalupsky, Intel
Frank Chang, Vitesse
Che-Hoo Cheng, CUHK/HKIX
Wheling Cheng, Juniper
Derek Cobb, LINX
Chris Cole, Finisar
Kai Cui, Huawei
John D’Ambrosia, Dell
Wael Diab, Broadcom
Chris DiMinico, MC
Communications
Dan Dove, Applied Micro
Mike Dudek, Qlogic
Hesham ElBakoury, Huawei
Arash Farhood, Cortina
Jan Filip, Maxim Integrated
Alan Flatman, LAN Technologies
Harry Forbes, Nexans
Howard Frazier, Broadcom
Galen Fromm, Cray
Ilango Ganga, Intel
Ali Ghiasi, Broadcom
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
• Mark Gustlin, Xilinx
• Marek Hajduczenia, ZTE
• Hiroshi Hamano, Fujitsu
Labs
• Bernie Hammmond, TE
Connectivity
• Adam Healey, LSI
• Brian Holden, Kandou Bus,
S.A.
• Lu Huang, China Mobile
• Xi Huang, Huawei
• Alexander Ilin, MSK-IX
• Scott Irwin, MoSys
• Hideki Isono, Fujitsu Optical
Components
• Tom Issenhuth, Microsoft
• Jack Jewell, Independent,
CommScope
• Mark Jones, Xtera
Communications
• Shinkyo Kaku, Allied Telesis
• Jonathan King, Finisar
• Scott Kipp, Brocade
45
Supporters Across the Eco-System (2 of 3)
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Paul Kolesar, CommScope
Masashi Kono, Hitachi
Ryan Latchman, Mindspeed
Greg Lecheminant, Agilent
David Lewis, JDSU
Junjie Li, China Telecom
Mike Li, Altera
Sharon Lutz, US Conec
Valerie Maguire, Siemon
Jeff Maki, Juniper
Edwin Mallette, Bright House
Networks
Roger Marks, Consensii LLC
Arthur Marris, Cadence
Tomizawa Masahito, NTT
Tom McDermott, Fujitsu Network
Communications
John McDonough, NEC
Greg McSorley, Amphenol
Mounir Meghelli, IBM
Rich Mellitz, Intel
Inder Monga, ESnet
March 19, 2013
• Andy Moorwood, Infinera
• Shimon Muller, Oracle
• Karl Muth, Texas Instruments
• Ed Nakamoto, Spirent
• Gary Nicholl, Cisco
• Arnold Nipper, DE-CIX
• Susumu Nishihara, NTT
• Takeshi Nishimura, Yamaichi
Electronics
• Mark Nowell, Cisco
• David Ofelt, Juniper
• Hirotaka Oomori, Sumitomo
Electric
• Tom Palkert, Xilinx, Luxtera,
Molex
• Pravin Patel, IBM
• Martin Pels – AMS-IX
• Petar Pepeljugoski, IBM
• Jerry Pepper, Ixia
• Randy Perrie, OneChip
Photonics
• John Petrilla, Avago
• Rick Pimpinella, Panduit
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
• Scott Powell, Clariphy
• Rick Rabinovich, AlcatelLucent
• Michael Ressl, Hitachi
• Jorge Salinger, Comcast
• Sam Sambasivan, AT&T
• Martin Saner, SNT
• Shawn Searles, Independent
• Ted Seely, Sprint
• Oren Sela, Mellanox
• K. Seto, Hitachi Cable
• Megha Shanbhag, TE
Connectivity
• Song Shang, Semtech
• Steve Shellhammer,
Qualcomm
• Kapil Shrikhande, Dell
• Scott Sommers, Molex
• Xiaolu Song, Huawei
• Ted Sprague, Infinera
• Peter Stassar, Huawei
• Henk Steenman, AMS-IX
• Andre Szczepanek, Inphi
46
Supporters Across the Eco-System (3 of 3)
• Daniel Stevens, Fujitsu
Semiconductor Europe
• Steve Swanson, Corning
• Norm Swenson, Clariphy
• William Szeto, Xtera
Communications
• Akio Tajima, NEC
• Takejiro Takabayashi, JPIX
• Tomoo Takahara, Fujitsu Labs
• Toshiki Tanaka, Fujitsu Labs
• Katsuhisa, Tawa, Sumitomo
Electric
• Brian Teipen, ADVA
• Jim Theodoras, ADVA
• Masahito Tomizawa, NTT
• Hidehiro Toyoda, Hitachi
• Nathan Tracy, TE Connectivity
• Matt Traverso, Cisco
• Francois Tremblay, Semtech
• Steve Trowbridge, AlcatelLucent
• Eddie Tsumura, Sumitomo
Electric
March 19, 2013
• Sterling Vaden, OCC
• Paul Vanderlaan, Nexan
• Arien Vijn, AMS-IX
• Xiaofeng Wang, Qualcomm
• David Warren, HP
• Winston Way, Neophotonics
• Cheng Weiqiang, China Mobile
• Glenn Wellbrock, Verizon
• CK Wong, FCI USA LLC
• Chengbin Wu, ZTE
• Helen Xuyu, Huawei
• Andy Zambell, FCI
• Wenyu Zhao, CATR
• Pavel Zivny, Tektronix
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
47
STRAW POLLS
March 19, 2013
48
Call-For-Interest
• Should a Study Group be formed for “ 400 Gb/s
Ethernet”?
Y:
March 19, 2013
N:
A:
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
49
Participation
• I would participate in the “400 Gb/s Ethernet”
Study Group in IEEE 802.3.
Tally: xx
• My company would support participation in the
“400 Gb/s Ethernet” Study Group in IEEE 802.3
Tally: xx
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
50
Future Work
• Ask 802.3 on Thursday
– Form 400 Gb/s Ethernet SG
• If approved, on Friday
– Request 802 EC informed of 400 Gb/s Ethernet SG
– First 400 Gb/s Ethernet SG meeting, week of May 2013
IEEE 802.3 Interim.
March 19, 2013
400 Gigabit Ethernet Call-For-Interest Consensus, V1.0
Orlando, FL, USA
51
THANK YOU!
March 19, 2013
52