HOT TRENDS IN
FIBRE CHANNEL
Mark Jones
President – Fibre Channel Industry
Association
Director, Technical Marketing
Emulex Corp.
10/30/2013
AGENDA
2
1
How the FC Industry Innovates
2
2013: 11-11-11
3
Why Fibre Channel
4
The Fibre Channel Roadmaps
5
Innovations Abound
6
16GFC is needed for today's Datacenter
FIBRE CHANNEL: TIMELINE
2016+:
128GFC
Cloud
Ready
(4 “striped”
parallel lanes
of 32GFC)
2015+:
32Gb FC
2012:
16Gb FC
Virtualization
NPIV
2009: FCOE
2008: 8Gb FC
Arbitrated
Loop
2005: 4Gb FC
2001: 2Gb FC
1997: 1Gb FC SAN
products emerge
3
1988: Work begins
on protocol
Fabric
Services
Converged
Networks
2013 – FIBRE CHANNEL MILESTONES!
• 11 Million ports shipped
[1]
• $11+ Billion spent on FC technology
• 11 Exabytes in FC storage shipped
[1]
[2]
[3]
4
[2]
[3]
Worldwide Storage Area Network Market – Fibre Channel Forecast, January 2012
Worldwide External Enterprise Storage Systems Revenue by Topology, Installation, and Protocol 2006-2015 ($B), IDC, 2011
Worldwide External Enterprise Storage Systems Capacity Shipped by Topology, Installation and Protocol 2006-2015 (PB), IDC, 2011
WHY FIBRE CHANNEL?
Non-Stop
• Fibre Channel is the only purposebuilt, data center proven network
infrastructure for storage that
keeps running, no matter what
• Enables resilient IT infrastructure
that optimizes availability and
minimizes application disruptions
• Industry leading network reliability
minimizes management resources
and costs
5
High Performance
• Fibre Chanel delivers 16Gb Fibre
Channel and 40Gb FCoE
performance ideal for high
density virtualization, cloud
infrastructure, and SSD storage
• Lossless and deterministic
networking ensures predictable
performance under high
utilization
• FC dedicated networks are
inherently low latency and secure
Scalable and Simple
• Fibre Channel fabrics are flat,
simple, and elastic networks that
easily scale up and down as
needed
• Backward compatibility enables
scalability with new technology
while leveraging legacy
infrastructure
HOW THE FC INDUSTRY INNOVATES
End-User Influence
Fibre Channel Industry
Requirements
Needs
Fibre
Channel
Industry
Association
(Marketing)
Press/Analysts
Collateral /Education
6
FC
Innovations
Tight
Collaboration
Storage
Innovations
INCITS T11
Standards
Organization
(Technical)
Standards/
Profiles
FIBRE CHANNEL SPEEDMAP
FC
Product
Naming
Throughput
(MBps)
Line Rate
(GBAUD)
T11 Spec
Technically
Completed (Year)‡
1GFC
200
1.0625
1996
1997
2GFC
400
2.125
2000
2001
4GFC
800
4.25
2003
2005
8GFC
1600
8.5
2006
2008
16GFC
3200
14.025
2009
2011
32GFC
6400
28.05
2013
2015
128GFCp
25600
4x28.05
2014
2015
64GFC
12800
TBD
2016
Market Demand
128GFC
25600
TBD
2019
Market Demand
256GFC
51200
TBD
2022
Market Demand
512GFC
102400
TBD
2025
Market Demand
1TFC
204800
TBD
2028
Market Demand
•
“FC” used throughout all applications for Fibre Channel infrastructure and devices, including edge and ISL interconnects. Each speed
maintains backward compatibility at least two previous generations (I.e., 8GFC backward compatible to 4GFC and 2GFC)
•
Line Rate: All “…GFC” speeds listed above are single-lane serial stream I/O’s. All “…GFCp” speeds listed above are multi-lane I/Os
‡ Dates: Future dates estimated
7
Market
Availability
(Year)‡
FIBRE CHANNEL SPEEDMAP
FCoE
Product
Naming
Throughput
(MBps)
Line Rate
(GBAUD)
Spec
Technically
Completed
(Year)
10G FCoE
2400
10.3125
2008
2009
40G FCoE
9600
4x10.3125
2010
2013
100G FCoE
24000
10x10.3125
2010
Market
Demand
100G FCoE
24000
4x25.78125
2015
Market
Demand
400G FCoE
96000
TBD
TBD
Market
Demand
Market
Availability
(Year)
Fibre Channel over Ethernet tunnels FC through Ethernet. For compatibility all 10GFCoE FCFs and CNAs are
expected to use SFP+ devices, allowing the use of all standard and non standard optical technologies and
additionally allowing the use of direct connect cables using the SFP+ electrical interface. FCoE ports
otherwise follow Ethernet standards and compatibility guidelines.
8
DEDICATED / CONVERGED NETWORKS
Dedicated
Networks - FC
Dedicated
Networks - FCoE
NIC
FC
HBA
Ethernet
Switch
CNA
Converged
Networks
NIC
FCoE
FCoE/DCB
Switch
CNA
FCoE
IP
FCoE/DCB
Switch
FC
Switch
LAN
FC
FC HBA
9
LAN
LAN
FCoE
FCoE
FC
Ethernet
CNA
FC HBA
Ethernet
Ethernet
CNA
INNOVATIONS –
COMPLIMENTS OF FIBRE CHANNEL
The FCIA is helping to extend the FC
protocol through close cooperation with
the T11 Standards Organization
through innovation in multiple areas:
10
32GFC
• 32GFC Specification currently under development
within ANSI T11
• Doubles data bandwidth over 16GFC to 6400MB/s1
• Backwards compatible two generations
• 1x single-lane
• 28.05GBaud with 64b/66b encoding
• 100 Meter on OM4
• Forward Error Correction
•
Performance / Reliability
• ANSI T11 to complete specification by Q4 2013
• First vendor commercial products in 2015
1. Full Duplex data transmission
11
• 128GFCp based on 4 lanes of 32GFC
• 25,600MB/s1 - 4x the bandwidth of 32GFC
• Backwards compatible to single lane 32GFC or 16GFC
• 4x 28.05GBaud lanes with 64b/66b encoding
• QSFP cable connectors
• Forward Error Correction across striped lanes
•
Performance / Reliability
• ANSI T11 to complete specification in 2013
• First vendor commercial products possible in 2015
1. Full Duplex data transmission
12
BLOCK SPRAYING ACROSS 4 LANES
128GFC will leverage the work of Ethernet as
much as possible including:
– 66-bit block striping across 4 lanes
– Reed Solomon (528/514) Forward Error Correction at the
128GFC level instead of the 32GFC level
32GFC lanes
128GFC Data Stream
=3
Figure 82-6 – PCS Block Distribution
Source: IEEE 802.3-2012
13
128GFC CABLING
128GFC will require two 4-lane ports
The ports can be either QSFP28, CFP2, CFP4 or
some future 4 lane interface
12 fiber ribbon with MPO connectors
4 Tx, 4 Rx and 4 dark fibers
QSFP28,
CFP2 or CFP4
AOC – Active Optical Cable
Up to 50 meters
DAC – Direct Attach Cable
Active up to 5 meters
14
QSFP28,
CFP2 or CFP4
BREAKOUT CABLING
128GFC port can be broken out to individual
16GFC or 32GFC lanes with a breakout cable
16GFC SFP+ -2 fibers
32GFC SFP+ -2 fibers
QSFP28
32GFC SFP+ -2 fibers
16GFC SFP+ -2 fibers
DAC – Direct Attach Cable
Active up to 5 meters
15
MPO connector – 12 fibers
4 Tx, 4 Rx and 4 dark
40GBE FCOE
• 40GbE link rate for FCoE
• 4x the bandwidth of 10GbE
• Greater in-fabric performance per switch faceplate
density
• Utilizes 4x10.3125 Gbaud links
• Products will use optical QSFP modules with MPO
cables
• Server connectivity - PCIe 8GT/s x8 required for 1p,
x16 for 2p
• Specification was complete in 2010
• Switch products GA in 2013, Adapters in 2014
1. Full Duplex data transmission
16
FC-BB-6
• VN2VN port – Virtual Node to Virtual Node
• No FCF required – Lowers Cost of FCOE adoption
• Separate Fibre Channel network not required
• Each VN2VN port learns about all others in it’s VSAN
• No FC Zoning, use VLANs and LUN masking
• Scalability must be managed due to amount of
context information to maintain
• ANSI T11 in comment resolution, Q4 2013 complete
• Vendor adoption 2014
1. Full Duplex data transmission
17
=
16GFC Improves Host Flash Write IO
18
16GFC Improves Host Flash Performance
=
“
My organization is planning
to deploy 16GFC HBAs in
the next 12 months in…
”
#1 Answer is Virtualization servers
September 2013 16GFC adoption survey
• All Major Hypervisors
support 16GFC
• 16GFC offers double the
throughput
• Higher VM densities
19
16GFC
VMs @
40MB/s
8GFC
10Gb iSCSI
1Gb iSCSI
0
50
RELEVANT INCITS T11 FIBRE CHANNEL
STANDARDS
www.t11.org
– Recently Published
•
FC-SB-4 FICON
•
FC-LS-2 Link Service
•
FC-FS-3 Framing and Signaling Protocol
•
FC-PI-5 16GFC
•
FC-MSQS 16GFC Testing and Performance
•
FC-IFR Inter-Fabric Routing
•
FC-SCM Simplified Configuration
•
FC-MI-3, Interoperability Profile
•
FC-DA-2, Interoperability Profile
•
FC-SP-2, Security
– Work In Progress
20
•
FC-BB-6 FCoE Enhancements
•
FC-PI-6 / MSQS-2 32GFC
•
FC-SW-6 Fabric Enhancements (Includes FCoE)
•
FC-GS-7 Management Enhancements (Includes FCoE)
•
FC-EE Energy Efficiency
•
SM-HBA-2 HBA Management 2, At INCITS
•
FC-LS-3 Link Service
•
FC-FS-4 Framing and Signaling Protocol
SUMMARY: FIBRE CHANNEL…
Industry Milestone - 11-11-11
Non Stop, High Performance and Scalable
Speed Roadmap continues to lead the industry
Same FC protocol for either DN or CN
32GFC/128GFCp
40GbE FCoE
FC-BB-6 and VN2VN
Flash = 16GFC
Virtualization = 16GFC
21
Thank You
www.Fibrechannel.org
www.T11.org
Mark.Jones@Emulex.com
22