EXTRAORDINARY EXTENSION
Mark S. Detrick
BCFP, BCAF, BCNE, CISSP, CCIE
Global Solutions Architect
Portland, OR
+1 (503) 645-2488
July 2012
Legal Disclaimer
All or some of the products detailed in this presentation may still be under
development and certain specifications, including but not limited to, release dates,
prices, and product features, may change. The products may not function as intended
and a production version of the products may never be released. Even if a production
version is released, it may be materially different from the pre-release version
discussed in this presentation.
NOTHING IN THIS PRESENTATION SHALL BE DEEMED TO CREATE A WARRANTY OF ANY
KIND, EITHER EXPRESS OR IMPLIED, STATUTORY OR OTHERWISE, INCLUDING BUT NOT
LIMITED TO, ANY IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A
PARTICULAR PURPOSE, OR NONINFRINGEMENT OF THIRD-PARTY RIGHTS WITH
RESPECT TO ANY PRODUCTS AND SERVICES REFERENCED HEREIN.
Brocade, the B-wing symbol, BigIron, DCFM, DCX, Fabric OS, FastIron, IronView,
NetIron, SAN Health, ServerIron, TurboIron, and Wingspan are registered trademarks,
Brocade Assurance, Brocade NET Health, Brocade One, Extraordinary Networks,
MyBrocade, and VCS are trademarks of Brocade Communications Systems, Inc., in the
United States and/or in other countries. Other brands, products, or service names
mentioned are or may be trademarks or service marks of their respective owners.
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
2
Brocade Extension Innovations
The Leader in All Extension
1st with 10GE FCIP
1st with FastWrite
1st with FICON Emulation (XRC, Teradata, & Tape)
1st with PP-TCP-QoS
1st with FCIP Trunking
1st with OSTP
1st with FCR
1st
with SO-TCP
1st with ARL
1st with IPsec
Brocade 7800 & FX - Brocade CONFIDENTIAL
Brocade’s 4 Disciplines of Extension
• Open Systems Extension (RDR & Tape)
• FICON Extension (Emulation)
• Native FC/FICON Extension
• FC Routing
March 2012
3
Solution price range (hardware and software)
Next-Generation Extension Products
Global 1000/
Large Enterprise
DCX 8510-8
Brocade Network Advisor
DCX 8510-4
FX base
GE - 10 Gbps
SMB/Enterprise
Small/Medium
Business
FX 10GE license
10GE - 20 Gbps
Brocade 7800 +
PoD license
FX8-24 blade for
Brocade DCX 8510
7800 Base
Standalone
Director-Class
High-touch services, product flexibility, scalability
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
4
RDR over IP Networks
Business Challenge
Solution
• Create nonstop IT operations for business
continuance
• Application failover and data access
• Leverage secondary site for failover
• Deploy direct-connected FX8-24 Extension
Blades over MLX IP network
• Provide protected data, very small RPO
and RTO
Mainframe
and/or
Open
Systems
Mainframe
and/or
Open
Systems
FICON
Primary
Data Center
Disk Array
with RDR
Secondary
Data Center
FC
IP WAN each other using FC
Arrays replicate data between
MLXe
L2/L3 Switch
MLXe
L2/L3 Switch
Brocade DCX
FX8-24 Extension Blades
Brocade 7800 & FX - Brocade CONFIDENTIAL
Disk Array
with RDR
Brocade DCX
FX8-24 Extension Blades
March 2012
5
BROCADE EXTENSION
PRODUCT DETAILS
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
September 2010
66
Brocade Extension Solutions
Legacy Features
The fastest, most reliable, and most cost-effective network
infrastructure for remote data replication, backup, and migration
• FCIP-FW (FCIP FastWrite) accelerates SCSI write processing, enabling
synchronous and asynchronous disk replication over any distance
• OSTP accelerates read and write tape processing, minimizing backup
and restore windows
• SO-TCP optimizes TCP window size and flow control, accelerating TCP
transport for storage applications
• FICON Accelerator for accelerating disk and tape read and write
operations,
maximizing FICON performance
• True interoperability with Brocade switches and management
software simplifies deployment and administration
• Advanced Fabric Services address the most challenging requirements
Brocade FX8-24 Extension
Blade for the Brocade
DCX 8510
Brocade 7800
Channel Extender
The most comprehensive extension solutions
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
7
Brocade Extension Solutions
Features Introduced with 7800/FX
Accelerates and optimizes replication, backup, and migration over any
distance using advanced Fibre Channel and FCIP networking technology
• FCIP Trunking creates an ISL spanning multiple physical
ports for load balancing and network failure resiliency
• ARL dynamically adjusts bandwidth limits to ensure efficient
utilization and sharing of available bandwidth
• PP-TCP-QoS prioritizes handling of initiator-target flows within an
FCIP tunnel to optimize bandwidth and performance by application
Brocade FX8-24 Extension
Blade for the Brocade
DCX 8510
• Advanced Compression architecture provides flexibility to optimize
compression ratios and maximize throughput
• 200 ms Round-Trip Time (RTT) of latency supports
distances approaching 17,500 kilometers (nearly 11,000 miles)
• Brocade Network Advisor FCIP management unifies management of
Fibre Channel and FCIP network infrastructures
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
Brocade 7800
Channel Extender
8
Brocade FX8-24 Extension Blade
Blade Options
• Brocade FX8-24 Extension Blade
• Twelve 8G FC ports, ten GE interfaces
• Functionality enabled through optional licenses
Ten GE FCIP
interfaces
Two 10GE FCIP
interfaces
Twelve 8 Gbps
FC or FICON
ports
• 10GE Interfaces
• Enables 10GE interfaces and doubles FCIP bandwidth to 20 Gbps
• Supported 10GE interface configurations
•
Ten GE and one 10GE or
•
Two 10GE
• Advanced Extension: FCIP Trunking and ARL
• Adaptive Networking: Activates FC and FCIP QoS functionality
• Enterprise Bundle: Advanced Performance Monitoring, Adaptive
Networking, Fabric Watch, Brocade Trunking, and Server Application
Optimization (SAO)
• Advanced Accelerator for FICON: Enables high-performance FICON tape,
XRC, and Teradata over distance
• FICON Management Server: Control Unit Port (CUP) enables host control
of switches in mainframe environments
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
9
Brocade 7800 Extension Switch
Platform Options
• Two models
• Brocade 7800 4/2: Four 8G FC ports, two GE interfaces
• Brocade 7800 16/6: Sixteen 8G FC ports, six GE interfaces
• Functionality enabled through optional licenses
• Brocade 7800 16/6 Upgrade License: Enables all ports and OSTP
• Advanced Extension: FCIP Trunking and ARL
• Adaptive Networking: FC and FCIP QoS functionality
• Enterprise Bundle: Advanced Performance Monitoring, Adaptive Networking, Fabric Watch, Brocade
Trunking, and SAO
• FICON Management Server: CUP enables host control of switches in mainframe environments
• Advanced Accelerator for FICON: Enables high-performance FICON tape and replication over distance
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
10
Brocade 7800 Switch
Front and Back Panels
Brocade 7800 4/2
Brocade 7800 4/2
4x 8G FC or FICON ports
2 GE FCIP interfaces
(Configurable as RJ-45 or SFP)
Brocade 7800 Brocade 7800 16/6
Management access ports
(RJ-45, GE, and USB)
Brocade 7800 16/6
16x 8G FC or FICON ports
6 GE FCIP interfaces
(2 ports configurable as RJ-45 or SFP)
Brocade 7800
Dual redundant, 150W hot-swappable power supplies with integrated fans
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
11
Brocade Network Advisor
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
13
Brocade Network Advisor
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
14
Brocade Network Advisor
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
15
In-band Management
Management via FCIP Interfaces
• Management communications via the FCIP interfaces
• Ethernet based
• Facilitates CLI, NMS and BNA management platforms
BNA server
or NMS Site
Storage
Array
Brocade
7800
FC
Brocade 7800 & FX - Brocade CONFIDENTIAL
Mgmt
FCIP & Mgmt
IP Cloud
March 2012
Storage
Array
Brocade
7800
FCIP & Mgmt
FC
16
Brocade Fabric OS
• Fabric OS v7.0.1
• FC and FICON features based on Brocade Condor2 ASIC
• Well-known
• Proven reliability
• Hugely successful
• Supported by all OEMs
• True interoperability with FOS and M-EOS
• Fully supported by BNA
• Configuration
• Current and historical monitoring
• Seamless integration with other Brocade products
• Capabilities and manageability of FOS-based products increasing with
every release
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
17
Storage Optimized TCP
A suite of TCP enhancements
1. Optimized Fast Recovery
2. Quick Start
3. Congestion Avoidance – Disable
4. Optimized Retransmit Timer
SO-TCP makes different assumptions about the network
• Assumptions appropriate to storage applications
• Results in increased overall throughput
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
21
FX Architecture
Front Facing
12x 8G FC Ports
FCIP Complex 1
10x 4G FC VE Ports
Condor2
FCIP Complex 0
10x 4G FC VE Ports
L2
Switch
10x GE
Cavium
Proc
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
Blaster
FPGA
Cavium
Proc
FCIP Complex 0
Blaster
FPGA
10GE-0
10GE-1
FCIP Complex 1
Backplane Facing
8x 8G FC Ports
22
7800 Architecture
Front Facing
16x 8G FC Ports
5x 4G FC VE Ports
GoldenEye2
FCIP Complex
FC
Blaster
FPGA
Ethernet
L2
Switch
PCI
6x GE
Cavium
Proc
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
23
FC ROUTING
A Brocade Innovation
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
24
IR with 7800/FX8-24
Best Practice Routing: Edge-BB-Edge
EX_Ports
Integrated Routing
License
Required
7800
EX_Ports
7800
IP network
Edge
Fabric
Edge
Brocade 7800 & FX - Brocade CONFIDENTIAL
Brocade MLXe
Brocade MLXe
Backbone
March 2012
Edge
Fabric
Edge
25
Fault Isolation
FCIP + FCR provides fault isolation between fabrics
•No routing—FICON cannot be routed
One merged fabric
No routing, no edge fabrics
DCX w/
FX8-24
DCX w/
FX8-24
IP Cloud
N_Port
MLXe
F_Port
FCIP Tunnel
VE_Port
VE_Port
F_Port
N_Port
MLXe
•Open Systems when not directly attached to array, going through fabric
Isolated Edge Fabric
7800
Isolated Edge Fabric
IP Cloud
E_Port
March 2012
EX_Port
FCIP Tunnel
VE_Port
Brocade 7800 & FX - Brocade CONFIDENTIAL
VE_Port
EX_Port
E_Port
Edge
Fabric
Backbone
7800
Edge
Fabric
26
FCIP TUNNEL ENHANCEMENTS
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
28
Designed to Maintain High Utilization
Many factors determine FCIP utilization of available bandwidth
• Improved Protocol Efficiency
• Batching of sequences
• 7800 and FX8-24 have FastWrite, FICON Emulation and SO-TCP
• Improved Buffering
• Optimized data flow management ingress and egress
• 7800 and FX8-24 have huge buffers and new buffer management algorithms
• Enhanced Compression System
• Capacity of compression engine to maintain data flow
• Maximize MTU of outgoing datagrams
• 7800 and FX8-24 compress at the most efficient stage and batch multiple FC frames per TCP
segment
• TCP Windows
• Storage-optimized TCP (SO-TCP)
• Proper TCP windowing (RFC 1323) and control of outstanding segments
• MTU Utilization
• Fills datagrams to MTU, sending fewer larger datagrams for greater efficiency
• MTU optimization more efficiently utilizes BW with less overhead
• DF bit is set to eliminate fragmentation in IP network
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
29
Enhanced Compression System
• Developed by Brocade
• Technology leveraged from Brocade Encryption Switch (BES)
• Mode 1: Brocade-optimized LZ (Lempel-Ziv) algorithm
• Typical 2:1 compression
• High-speed 40 Gbps FC comp (per FCIP complex)
• Very low latency added at about ≈ 10 µs
• Can be used with synchronous applications
• Mode 2: Dynamic Huffman-Encoded LZ (Lempel-Ziv) algorithm
• Typical 2.5:1 compression ratio
• Maximum ingress rate is 8 Gbps
• Mode 3: Deflate (GZIP) algorithm
• Typical 4:1 compression ratio
• Maximum ingress rate is 2.5 Gbps
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
30
Brocade 7800 vs. Cisco MDS 9222i
400
350
300
250
200
9222i
150
7800
100
50
0
0 ms
10 ms
20 ms
40 ms
60 ms
7800
120 ms
200 ms
9222i
250 ms
300 ms
FCIP performance with comparable settings and compression
Measurements in MB/s
Brocade FOS 7.0.1 and Cisco NX 5.2.1
KGen compressible data generator (20%)
2x 8G FC Ingress, 1x GE Egress, IPsec enabled
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
31
Brocade 7800 vs. Cisco MDS 9222i
250
200
150
100
9222i
7800
50
0
0 ms
10 ms
20 ms
40 ms
60 ms
7800
120 ms
200 ms
9222i
250 ms
300 ms
FCIP performance with comparable settings and compression
Measurements in MB/s
Brocade FOS 7.0.1 and Cisco NX 5.2.1
KGen compressible data generator (50%)
2x 8G FC Ingress, 1x GE Egress, IPsec enabled
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
32
Brocade 7800 vs. Cisco MDS 9222i
400
350
300
250
200
150
9222i
100
7800
50
0
0 ms
10 ms
20 ms
40 ms
60 ms
7800
120 ms
200 ms
9222i
250 ms
300 ms
FCIP performance with comparable settings and compression
Measurements in MB/s
Brocade FOS 7.0.1 and Cisco NX 5.2.1
KGen compressible data generator (All 0)
2x 8G FC Ingress, 1x GE Egress, IPsec enabled
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
33
Brocade 7800 vs. Cisco MDS 9222i
120
100
80
60
9222i
40
7800
20
0
0 ms
10 ms
20 ms
40 ms
60 ms
7800
120 ms
200 ms
9222i
250 ms
300 ms
FCIP performance with comparable settings and compression
Measurements in MB/s
Brocade FOS 7.0.1 and Cisco NX 5.2.1
KGen compressible data generator (Random)
2x 8G FC Ingress, 1x GE Egress, IPsec enabled
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
34
FCIP Encapsulation
End-to-End Devices Negotiate FC Frame Size (2048 Bytes for FX8-24 or 7800)
7800 or FX
FC
7800 or FX
FC
IP MTU 1500 bytes
FC frames entering extension
A Batch
2080 Bytes
FC Frame Encapsulation
This is then sent to TCP for processing.
RFC 3643 (Common Encapsulation)
Protocol Number
1 Byte
The header below is prepended to batches of up to 8 FC frames
creating a single FCIP Frame.
Version
1 Byte
1’s Compliment of Protocol
Number
1 Byte
1’s Compliment of Version
1 Byte
Encapsulating Protocol Specific 2 Words
28-Byte
Header
Flags
6 Bits
Frame Length
10 Bits
1’s Compliment of Flags
6 Bits
1’s Compliment of Frame Length
10 Bits
Time Stamp (Seconds) 1 Word
Time Stamp (Seconds Fraction) 1 Word
CRC 1 Word
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
35
FCIP Batches
• Up to 14 FC frames in a Open Systems batch, 4 for FICON
• Compression occurs first upon FC ingress
• All frames are from the same exchange
• Only data FC frames are batched
• Processed as a single entity
• End of Sequence bit in FC frame causes immediate send
FC Frame
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC Frame
Frame Frame Frame Frame Frame Frame Frame Frame Frame Frame Frame16
Frame Frame Frame
14
13
12
11
10
9
8
7
6
5
4
2 15 1
EoS bit 3set
FCIP
FCIP
Header
Header
FCIP Batch
March 2012
Brocade 7800 & FX - Brocade CONFIDENTIAL
36
FC to FCIP Method without Jumbo Frames
Brocade 7500/FR4-18i Method
FCIP frames to be sent
FCIP Frame 4
2108 bytes
FCIP Frame 3
2108 bytes
TCP Segment TCP
Header
656 bytes 28 bytes
IP Payload
684 bytes
FCIP Frame 2
2108 bytes
TCP Segment
1452 bytes
IP Payload
1480 bytes
IP Header
20 bytes
FCIP Frame 1
2108 bytes
TCP
TCP Segment
Header
28 bytes 656 bytes
IP
Header
20 bytes
IP Payload
684 bytes
TCP
Header
28
bytes
TCP Segment
1452 bytes
TCP
Header
28 bytes
IP Payload
1480 bytes
IP Header
20 bytes
IP Header
20 bytes
IP Compression
IP Packet 2
704 bytes
IP Payload IP Header
352 bytes 24 bytes
IP Payload
750 bytes
IP Packet 4
376 bytes
Brocade 7800 & FX - Brocade CONFIDENTIAL
IP
IP Header IP Payload
Header
24 bytes 352 bytes
24 bytes
IP Packet 3
774 bytes
IP Packet 2
376 bytes
IP Payload
750 bytes
IP Packet 1
MTU 1500 bytes
IP Header
24 bytes
Assume 2:1
compression
to Ethernet
IP Packet 1
774 bytes
March 2012
37
FC to FCIP Method with Jumbo Frames
Brocade 7500/FR4-18i Method
FCIP frames to be sent
FCIP Frame 4
2108 bytes
FCIP Frame 3
2108 bytes
FCIP Frame 2
2108 bytes
TCP
Header
28 bytes
TCP Segment
2108 bytes
IP Payload
2136 bytes
FCIP Frame 1
2108 bytes
TCP Segment
2108 bytes
IP Payload
2136 bytes
IP Header
20 bytes
TCP
Header
28 bytes
TCP
Header
28 bytes
TCP Segment
2108 bytes
IP Payload
2136 bytes
IP Header
20 bytes
IP Header
20 bytes
IP Compression
IP Packet 1
2156 bytes
IP Payload
1078 bytes
IP Header
24 bytes
IP Packet 3
1102 bytes
Brocade 7800 & FX - Brocade CONFIDENTIAL
IP Payload
1078 bytes
IP Packet 2
1102 bytes
IP
Header
24 bytes
IP Payload
1078 bytes
IP Header
24 bytes
Assume 2:1
compression
to Ethernet
IP Packet 1
1102 bytes
March 2012
38
FCIP to Ethernet
Brocade 7800/FX8-24 Method
FC Data Frames within an exchange to be sent…
Seq 1, FC
Frame 8
2084 Bytes
Seq 1, FC
Frame 7
2084 Bytes
Seq 1, FC
Frame 6
2084 Bytes
Seq 1, FC
Frame 5
2084 Bytes
Seq 1, FC
Frame 4
2084 Bytes
Seq 1, FC
Frame 3
2084 Bytes
Seq 1, FC
Frame 2
2084 Bytes
Seq 1, FC
Frame 1
2084 Bytes
Note:
4 frames/batch with
FICON
HW FCcomp
≈ 2:1
8
1024
B
7
1024
B
6
1024
B
5
1024
B
4
1024
B
3
1024
B
2
1024
B
1
1024
B
FCIP
Header
28 B
…
TCP Segment
1460 B
TCP
Header
20 B
TCP Segment
1460 B
TCP
Header
20 B
TCP Segment
TCP
Header
20 B
1460 B
Create
FCIP Batch Frame
TCP Segment
1460 B
TCP
Header
20 B
In this example the MTU
is 1500 bytes
Fill MTU for maximum
efficiency
IP Payload
1480 B
IP
Header
20 B
IP Payload
1480 B
IP Packet 4
Brocade 7800 & FX - Brocade CONFIDENTIAL
IP Packet 3
IP
Header
20 B
IP Payload
IP
Header
20 B
1480 B
IP Packet 2
March 2012
IP Payload
1480 B
IP
Header
20 B
Sent to
Ethernet
IP Packet 1
39
FCIP Tunnel Enhancements
Trunks, Circuits and Interoperability
• An FCIP Tunnel or FCIP Trunk is single logical ISL
• Brocade 7800/FX8-24: an FCIP tunnel can have one or more circuits
• A circuit is an FCIP connection between two unique IP addresses
• One or more circuits may be assigned to any GE interface
• Brocade 7500/FR4-18i and 7800/FX8-24 are not FCIP-interoperable
FCIP Circuits
WAN
7800
Brocade 7800 & FX - Brocade CONFIDENTIAL
GE0,1,2
FCIP Trunk
VE_Port to VE_Port
March 2012
GE0,1,2
FX8-24
40
VE_Port to VE_Port (Dedicated Ethernet Ports)
VE_Port  FCIP Trunk  IP Interface  Circuit  Ethernet Interface
Logical
Source IP
Interfaces
Physical
Ethernet
Interfaces
Physical
Ethernet
Interfaces
Circuits
Unique IP Address
GE0
GE0
Unique IP Address
GE1
GE1
Logical
Destination IP
Interfaces
Circuits
VE_Port 16
FCIP
Trunk1
VE_Port 16
Unique IP Address
GE2
Unique IP Address
GE3
GE3
Unique IP Address
GE4
GE4
Unique IP Address
GE5
GE5
WAN
IP Cloud
GE2
FCIP
Trunk 1
• FCIP Trunks (multiple circuits) or Tunnels (single circuit) are logical entities
• IP interfaces are logical entities
• Circuits and Ethernet interfaces are physical entities
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
41
VE_Port to VE_Port (Shared Ethernet Ports)
VE_Port  FCIP Tunnel  IP Interface  Circuit  Ethernet Interface
Multiple
Source IP
Interfaces
Unique IP
VE_Port 16
FCIP
Trunk 1
Circuits
Physical
Ethernet
Interfaces
Physical
Ethernet
Interfaces
VE_Port 16
Unique IP
Unique IP
Multiple
Destination IP
Interfaces
Circuits
GE0
The WAN
IP Cloud
GE0
FCIP
Trunk 1
Unique IP
VE_Port 17
FCIP
Trunk 2
VE_Port 17
Unique IP
Unique IP
Brocade 7800 & FX - Brocade CONFIDENTIAL
GE1
GE1
March 2012
FCIP
Trunk 2
42
FCIP Trunking
Brocade exclusive feature
• Is an FCIP Tunnel with more than 1 circuit
• FCIP Trunking provides
•
•
•
•
•
Single logical ISL in routing table as a single link, ULP see single link
Bandwidth Aggregation of each circuit
Load Balancing per batch across circuits
Failover to remaining circuits
Lossless Link Loss (LLL)
• Data in-flight is not lost when a link goes down, will be retransmitted same as with TCP
• In-Order-Delivery (IOD) Does not require IOD to be enabled
• Data in-flight will be delivered in the correct order, even after data lost in-flight
• Works with both FICON and FC
• Supports FastWrite, OSTP, and FICON emulation over multiple circuits
• FCIP Trunking is a proven technology
• Leveraged from widely deployed McDATA/CNT technology
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
43
FCIP Trunking
FCIP trunk 16
(VE_Port 16)
Patent pending
Batches round robin
across member
circuits within trunk
Four priority TCP
sessions make up
each circuit
Brocade 7800 & FX - Brocade CONFIDENTIAL
Class-F
high
med
low
Circuit 0
GE0
Class-F
high
med
low
Circuit 1
GE1
Class-F
high
med
low
Circuit 2
GE2
Class-F
high
med
low
Circuit 3
GE3
Two or more circuits
make up an FCIP
Trunk
FCIP Trunks perform load balancing, lossless failover, and provide multiple
links for FastWrite, OSTP, and FICON emulation
March 2012
44
FCIP Trunking Concept
L3 Lossless Link Loss (LLL)
FICON Emulation
FastWrite
OSTP
Supervisor TCP Session
X X X
1
3
Circuit 1 with TCP session
FCIP
Batches
4
2
3
Circuit 2 with TCP session
Received
FICON Data
Emulation
FastWrite
OSTP
3?
FCIP
Batches
Supervisor TCP Session
• Encapsulates the circuits’ TCP sessions within a FCIP Trunk
• Provides granular load-balancing
• Retransmits lost frames due to circuit loss
• For operational links, the TCP sessions within the circuit handle loss
• Ensures FC frames are delivered in order (IOD)
• Prevents IFCC on the mainframe
• Supports FastWrite, OSTP, and FICON emulation
• FCIP Trunk appears as a single logical ISL
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
45
Protocol Optimization & State Machines
Protocol Optimization State Machines
•FCIP-FastWrite
•OSTP
Protocol Optimization State
•FICON Emulation
Machines live within each
FCIP tunnel
State Machine Setup
for this Exchange
Path 1
?
?
Path 2
State Machine doesn’t
exist for this exchange in
progress!
Error! SCSI Broken
Brocade 7800 & FX - Brocade CONFIDENTIAL
WRT_CMD
WRT_CMD
XFER_RDY
XFER_RDY
1 FCIP
2 FCIP
Trunk
tunnels
- 1 State
has Machine with
2 different State
multiple
Machines
circuits
Fabric can cause inconsistent path
relative to opposite side
March 2012
46
Path Definition
VE_Port  FCIP Tunnel  Circuits (IP Ports)  Ethernet Interface
Multiple
Source IP
Interfaces
Physical
Ethernet
Interfaces
Physical
Ethernet
Interfaces
Circuits
Unique IP Address
VE_Port 16
FCIP
Tunnel 1
FCIP
Tunnel 2
Circuits
GE0
GE0
Traffic Isolation Zone
or VF LS for
VE_Port 16
The WAN
Unique IP Address
GE1
GE1
Unique IP Address
GE2
GE2
IP Cloud
Unique IP Address
VE_Port 17
Multiple
Destination IP
Interfaces
GE3
FCIP
Tunnel 1
GE3
Traffic Isolation Zone
or VF LS for VE_Port 17
Unique IP Address
GE4
GE4
Unique IP Address
GE5
GE5
Brocade 7800 & FX - Brocade CONFIDENTIAL
VE_Port 16
March 2012
VE_Port 17
FCIP
Tunnel 2
47
Metric = 0
Circuit Metrics and Traffic Flow
FCIP
Tunnel
• Circuits with a different metric
• All traffic goes through circuits with the
lowest metric and no traffic goes through
circuits with a higher metric
• If all circuits with the lowest metric fail,
circuits with a higher metric are used
• All circuits have the same metric
Metric = 1
FCIP
Tunnel
• Traffic flows on all circuits
X
Metric = 1
• The remote end of a tunnel reorders
frames to maintain in-order delivery
Metric = 0
Metric = 0
X
FCIP
Tunnel
X
Metric = 1
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
48
ADAPTIVE RATE LIMITING
A Brocade Innovation
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
49
Rate Limit Problem – Oversubscribed
High Availability Architecture
Bad Solution – Do not do this, even with SO-TCP
• Aggregate Port Egress Bandwidth = 2 x OC-12 = 1.244 Gbps
• Oversubscribed during normal operation
• Results in a massive number of dropped frames – TCP flow contrrol
Channel Extender B1
Channel Extender A1
Port Rate Limit = OC-12
Site A
Channel Extender
A2
Buffer
overflow
Port Rate Limit = OC-12
Site B
Channel Extender B2
IP Network OC-12
Oversubscribed 2:1
Port Rate Limit = OC-12
Port Rate Limit = OC-12
RDR Application
OC-12 = 622 Mbps
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
50
Rate Limit Problem – Undersubscribed
High Availability Architecture
Better Solution – Not Perfect
• Aggregate Egress Bandwidth = 2 x ½(OC-12) = 622 Mbps
• No oversubscription during normal operation
• Less than 622 Mbps at times of failure of equipment or when application is offline
Channel Extender B1
Channel Extender A1
Port Rate Limit
½ OC-12
Site A
Port Rate Limit
½ OC-12
Site B
Channel Extender B2
Channel Extender
A2
IP Network OC-12
At times of outage undersubscribed
Port Rate Limit
½ OC-12
Port Rate Limit
½ OC-12
RDR Application
½ OC-12 = 311 Mbps
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
51
Adaptive Rate Limiting – Perfect
High Availability Architecture
Best Solution
• Aggregate Egress Bandwidth is always 622 Mbps
• Not oversubscribed or underutilized
• Rate Limiting automatically changes with network conditions
Channel Extender B1
Channel Extender A1
ARL
Min ½ OC-12
Max OC-12
Site A
Channel Extender
A2
ARL
Min ½ OC-12
Max OC-12
Site B
Channel Extender B2
IP Network OC-12
Fully Utilized
ARL
Min ½ OC-12
Max OC-12
ARL
Min ½ OC-12
Max OC-12
RDR Application
½ OC-12 = 311 Mbps
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
52
Adaptive Rate Limiting
High Availability Architecture
Normal Operation
Offline Path Operation
• Link BW  Number of Interfaces = BW of interface
• Not oversubscribed or underutilized
• Link BW  Number of Remaining Interfaces = new
BW of interface
• Rate Limiting automatically changes with device or link failures
• Not oversubscribed or underutilized
•Optics, smashed cables, FW upgrades, configuration
errors, defects…
• Applies to the entire path from end device to end
device
Channel Extender B1
Channel Extender A1
ARL
Operating
at ½ OC-12
Not Operating
Site A
ARL
Min ½ OC-12
Max OC-12
50%
Channel Extender
A2
50%
100%
Site B
Channel Extender B2
IP Network OC-12
Fully Utilized
ARL
ARL
Operating
Operatingat
atOC-12
½ OC-12
ARL
Min ½ OC-12
Max OC-12
RDR Application
½ OC-12 = 311 Mbps
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
53
ARL
Optimization after a path failure
When a second interface is enabled, the
network experiences a congestion event and the
first interface drops its rate down to the
minimum configured rate. From here it will seek
the ceiling again
With one interface online,
all available bandwidth is
consumed up to the
maximum rate
9000000
8000000
7000000
6000000
5000000
This interface ramps up to fully
utilize the available WAN BW. It
stops seeking a ceiling at the
maximum configured rate
4000000
3000000
2000000
1000000
0
0
50000
100000
150000
200000
The second interface starts
off by claiming its minimum
configured rate
Brocade 7800 & FX - Brocade CONFIDENTIAL
250000
300000
350000
Offline equipment/link
results in available BW
March 2012
54
Adaptive Rate Limiting—Varying BW Usage
Multiple applications in HA architecture
Depending on the time of day, BW may become available for other
applications
•Aggregate egress bandwidth is always 622 Mbps
•If an application is not using BW, then it is free to be used by other applications
•Each GbE interface will get at least ¼ OC-12 up to a maximum of full OC-12
Channel Extender A1
Channel Extender B1
ARL
Min ¼ OC-12
Max OC-12
ARL
Min ¼ OC-12
Max OC-12
Blue is TIZ
for Tape
Site A
Channel Extender A2
Channel Extender B2
Site B
IP Network OC-12
Tape Media
Server
ARL
Min ¼ OC-12
Max OC-12
ARL
Min ¼ OC-12
Max OC-12
Tape Library
RDR and Tape Applications
¼ OC-12 = 155 Mbps
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
55
ARL
Application bandwidth optimization
Tape ramps up using the
spare bandwidth made
available by reduced
RDR demand
Traffic in TIZ for Tape
7000000
6000000
5000000
4000000
3000000
2000000
1000000
0
0
50000
100000
150000
Traffic in TIZ for RDR
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
200000
250000
300000
350000
During nighttime, this
application is using less
bandwidth
56
PER PRIORITY TCP QOS
A Brocade Innovation
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
57
QoS Single TCP Stream Problem
• Does it make any sense to map multiple levels of service to one TCP stream? No!
• If one TCP stream is used, all levels of service are affected during congestion
• Undesirable behavior
• TCP is very rigid and puts everything back in the same order as it was transmitted
• Not an issue with autonomous TCP streams
•
The same TCP stream cannot tolerate different paths and maintain adequate performance
• There is no way to treat each stream independently with a single TCP session
• Priority (802.1P)
• DSCP in the IP network
•
That is, different DSCP values can be mapped to different MPLS labels within the service provider’s network
• Today this problem is solved using multiple tunnels to the same remote site
•
•
•
•
Difficult to implement
Difficult to manage each tunnel’s bandwidth and behavior
Each tunnel carries a different priority flow
Protocol optimization requires Traffic Isolation Zones
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
58
Per Priority TCP QoS
• Three QoS priorities per FCIP tunnel for data
• High (50%) — Medium(30%) — Low(20%)
• Four TCP streams per FCIP tunnel
• There is an additional class-F TCP stream with strict queuing
• Strict means all class-F data is sent first
• Class-F is not optional and not user configurable
• Each stream is autonomous in the IP network
• Each has its own TCP stack
• Each has its own settings for 802.1P & DSCP
• Egress enforcement into WAN
• QoS is enforced only during contention for bandwidth
• Priorities are mapped to VCs and the associated TCP session automatically
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
59
PP-TCP-QoS
QOSH_<zone name>
High Priority
7800/FX will
map VCs into
PP-TCP-QoS
FCIP Tunnel
FC ISL
FCIP Circuit
7800
7800
DCX
Virtual
Channels
FC ASIC will put
traffic into
priority VC
Brocade 7800 & FX - Brocade CONFIDENTIAL
TCP Sessions
QOSL_<zone name>
Low Priority
March 2012
60
FC CS_CTL Priority Classification
End-to-End Granular QoS
7800/FX will
map VCs into
PP-TCP-QoS
Same FC port
Same pWWN
LUN1: CS_CTL = High
LUN2: CS_CTL = Med
Array
FCIP
Trunk/Tunnel
DCX
Tape
QOSL_<zone> = Low
FC ISL
H/M/L
Virtual
Channels
FCIP Circuit
7800
7800
F-class/H/M/L
TCP Sessions
FC ASIC will put
traffic into
priority VC
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
61
Per Priority TCP QoS
QoS enforcement at egress
• Class-F – strict access to BW
• High/Med/Low BW is balanced according
to user configurable weights for each level
Per Priority TCP QoS Sessions
An FCIP tunnel with 4 TCP
sessions. It is possible to
have multiple
circuits/tunnels per
interface
TCP session for class-F
TCP session for High
TCP session for Medium
TCP session for Low
Local
IP Network such as MPLS
Remote
• Incoming Virtual Channels are mapped to corresponding TCP session automatically
• Assigned by zoning for directly attached devices
• If any one TCP session experiences congestion, the other TCP sessions are not necessarily
affected
• Each TCP session can be routed and treated independently of the others via autonomous
settings for Priority Tagging (802.1P) and/or DSCP
• ARL is applied per tunnel, not to individual TCP sessions
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
62
IPsec
No Additional License
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
63
IPsec
• There is no license for IPsec
• It is included in the base unit
• It adds only 5 µs of latency
• It operates at line rate
• All it costs is the effort to configure
• Uses PSK (Pre-Shared Keys)
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
64
FICON EMULATION
A Brocade Innovation
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
65
Mainframe Business Continuity
XRC emulation
• Host generates entire Read
Record Set (RRS) channel
program from Define Subsystem
Operation (DSO):
Primary
Data Center
Recovery
Data Center
System z
Mainframe
System z
Mainframe
• DSO has all the info needed to build
local emulated command set
• Network-emulated protocol for
XRC RRS channel program
XRC System
Data Mover
IP Network
Brocade DCX
w/ FX
• Keeps the IU pacing:
• Open at host side when link latency
would normally close it
Primary
DASD
Brocade DCX
w/ FX
Target/Secondary
DASD
• Data frames and final CE/DE are
queued at channel for SDM
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
66
FICON Emulation: Tape Write
FICON tape acceleration over any distance
• Tape Write Pipelining:
• Pre-acknowledges write sequences received
from the channel
• Write chains sent to remote side for actual
writes to the control unit
• Simultaneous outstanding write command
acknowledgments:
• Configurable, default is 32
• Tape Write Pipelining mode works only
with typical write channel programs:
•
•
•
•
Mode set
Write
No-op
Channel Path No-op
• Other commands are noncompliant,
pipelining gracefully exits emulation
sequence
Brocade 7800 & FX - Brocade CONFIDENTIAL
System z
Mainframe
Primary
Data Center
Write seq
pre-acknow.
sent to host
and data is
continuously
sent to
network
1
2
3
Write
channel
programs
delivered
to CU and
CE/DE
Brocade
DCX w/
FX
Final
Program
Status
Local
CE
Writes
sent
async to
remote
side
4b
1a 2a 3a
4a
IP Network
Ending
Status DE
1b 2b 3b
Brocade
DCX w/
FX
4
Ending
Status DE
Virtual Tape
Controller
March 2012
Tape
Library
67
FICON Emulation: Tape Read
FICON tape acceleration over any distance
• Tape Read Pipelining
• Enables industry-leading performance
for FICON read operations over
extended distances
• Two modes of FICON read
emulation
• Read channel program
Primary
Data Center
Read
programs
are
analyzed
1
for trends
in size of
reads
Read
program is
known and
channel is
suspended
with retry
Reads
satisfied
locally
2
3b
4b
5b
Brocade
DCX w/
FX
Retry
• Read block operation
Multiple
reads
sent
to CU
• Tape Read Emulation
• Discovers the mode of a read block or a
read channel program
Reads are
performed
and
“piped” to
host side
• Pre-reads data and sends it to host side
for presentation
• Host channel is released and all read
responses are presented to the channel
when requested
Brocade 7800 & FX - Brocade CONFIDENTIAL
System z
Mainframe
2a
3
3a
4
4a
5a
Buffers
“piped”
to
host
IP Network
Brocade
DCX w/
FX
5
Virtual Tape
Controller
March 2012
Tape
Library
68
FICON Extension: Optica Prizm and ESBT
FICON Accelerator License
• New interoperability with Optica Prizm and ESBT
•
•
•
•
Useful for FICON Printers
Has to be a device type qualified by Optica and Brocade
IBM’s has announced z196 will be last platform for ESCON
Prizm is FICON to ESCON converter
• FICON is extended and converted at the device end
Local
Mainframe
Brocade
7800 4/2
Brocade
7800 4/2
Remote
ESCON Tape
Optica
IP Cloud
FCIP: FICON Emulation
ESCON
Remote
ESCON Printer
FICON
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
69
FICON Extension: Optica Prizm and ESBT
FICON Accelerator License
Local
Mainframe
FICON DCX
Director w/FX
FICON DCX
Director w/FX
Remote
ESCON Tape
Optica
IP Cloud
FCIP
ESCON
FICON
Local
Mainframe
FICON DCX
Director w/FX Optica
FICON DCX
Director w/FX
Optica
Remote
ESCON Printer
Remote B&T
Printer
IP Cloud
FCIP
ESCON
Bus & Tag
FICON
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
70
FICON Extension: Teradata Emulation
FICON Accelerator License
• Teradata Emulation for both read & write
• Acceleration of Teradata FICON protocols
• Greatly reduces droop caused by latency
• Supported on: 7800 4/2 or 16/6, and FX
Local
Mainframe
FICON DCX
Director w/FX
FICON DCX
Director w/FX
Remote
Teradata
IP Cloud
FCIP: FICON Emulation
FICON
Brocade
©
2011 Brocade
7800 & FX
Communications
- Brocade CONFIDENTIAL
Systems, Inc. CONFIDENTIAL - Customer NDA Required
March 2011
2012
71
FICON Emulation: Teradata Write
FICON Teradata Write acceleration over any distance
• Teradata Write Pipelining:
• Once a Teradata controller has been
discovered, we will automatically enter write
pipelining (a process similar to Tape
processing). This process optimizes
performance of bulk database load
operations or restore operations.
• Write chains pre-acknowledged (to a pipeline
limit) and are sent to remote side for actual
writes to the Teradata control unit
• Simultaneous outstanding write
command acknowledgments:
• Configurable, default is 32
• Teradata Write Pipelining mode
accelerates only the bulk data transfer
Teradata sequences (database load).
Brocade 7800 & FX - Brocade CONFIDENTIAL
System z
Mainframe
Primary
Data Center
Write seq
pre-acknow.
sent to host
and data is
continuously
sent to
network
1
2
3
Local
CE/DE or CE
Writes
sent
async to
remote
side
Write
channel
programs
delivered
to CU and
CE/DE
March 2012
Final
4b
Program
Status –
will update
the write
pipeline
1a 2a 3a
1b 2b 3b
Ending
Status
CE/DE
Ending
Status
CE/DE
4a
Brocade
DCX w/
FX
IP Network
Brocade
DCX w/
FX
4
Teradata
Controller
72
FICON Emulation: Teradata Read
FICON Teradata acceleration over any distance
• Teradata Read Pipelining
Primary
Data Center
• Optimizes performance of database
backup type operations (bulk data read
Teradata
from the controller)
controller
Read
• Discovers when database bulk read
chain is
received.
operations are in effect and will preRead
read a fixed number of blocks of data processing
starts
and sends it to host side for
presentation. Read pipe is configurable
with a default of 32 pre-read blocks.
1
• Host channel is presented the read
data as read commands are received
and pre-read data is present in the local
(channel connected switch). When data
is not available channel is presented a
command retry status until data is
received from the remote switch from
the Teradata controller.
Brocade 7800 & FX - Brocade CONFIDENTIAL
System z
Mainframe
If read data
Reads
is available,
satisfied
present it, or
locally
issue Cmd
2
3b
Retry
4b
5b
Brocade
DCX w/
FX
Retry
Read
Cmds
2a
are
issued to
device
Reads are
performed
and
“piped” to
host side
3
3a
4
4a
5a
Buffers
“piped”
to
host
IP Network
Brocade
DCX w/
FX
5
Teradata
Controller
March 2012
73
DESIGN
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
74
Best-Practice RDR Network
Separate RDR Network
Primary
Secondary
WAN A
7800/FX
7800/FX
MLX
MLX
WAN B
7800/FX
7800/FX
Dedicated
RDR ports
Array
Fabric
1A
Array
Fabric
1B
Production Fabrics
Hosts
Brocade 7800 & FX - Brocade CONFIDENTIAL
Fabric
2A
Fabric
2B
Hosts
March 2012
75
Infrastructure
WAN Infrastructure Types
MPLS/VPLS
Core
Switches/Routers
Core
Switches/Routers
Aggregation
Level
Aggregation
Level
Access
Level
Access
Level
TDM
IP
IP
GDPS
DWDM
FICON
A
B
SONET
Storage Tape Storage
DASD
Brocade 7800 & FX - Brocade CONFIDENTIAL
DASD
March 2012
Storage Tape
Storage
76
10GbE FCIP
FICON
GDPS
10GE FCIP
B
10GbE FCIP
10GbE FCIP
A
IP
IP
Using VF to Get to Edge-Backbone-Edge
Fab-A LS
Fab-A LS
E_Port
E_Port
Edge A
Local
Edge A
Remote
Base LS
EX
EX
VE_Port
VE_Port
Base LS
Backbone Fabric
FCIP Tunnel
• Both xISL and EX_Ports in the Base Switch are not supported
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
77
Using VF for FICON Production and
Extension Isolation
XRC SDM
Fab-A LS
Production Logical
Switches
VE_Port
Fab-A LS
VE_Port
Base LS
Base LS
Extended FICON Fabric
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
78
DWDM 10GE Lambdas vs. FC or GE
Brocade 7800 & FX - Brocade CONFIDENTIAL
10GE lambdas are relatively inexpensive
DWDM
Native 2, 4, 8, and 10G FC are
very expensive
DWDM
GE not fast enough
DWDM
10GE satisfies speed, latency,
distance, and cost requirements
DWDM
March 2012
79
FCIP vs. FC at 75 KM
• FX 10GbE FCIP at 75 km has:
• Faster response times
• More throughput
• Capability for longer distances
FX 10GE FCIP
Native 10G FC
Response
Time (µs)
Throughput
(Gbps)
Response
Time (µs)
Throughput
(Gbps)
1282
16
1697
10
• Compression mode 1
• FastWrite enabled
• 512-byte payload
• Compression n/a
• FastWrite n/a
• 512-byte payload
Tests performed at 75 KM
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
80
Designing an FCIP RDR Network
Direct or fabric attached?
Local Storage
Subsystem
Direct Attached
Edge Fabric
Direct Attached
Fabric Attached
Fabric Attached
Remote
Storage
Subsystem
Edge Fabric
•Direct attach or fabric attached?
•Best practice is direct attached
•Scalable solution is fabric attached
•Never preclude fabric attached if that is what makes sense
•Why is direct attach a best practice?
•Firmware upgrades do not have to coincide with production fabric
•Single router per site does not have to compromise separate A and B fabrics
•Less risk of disruption to production fabric (even when a separate Brocade 7800 is used per fabric)
•Less points of failure in the path
•Less chance for configuration error (like zoning issues)
•Less complexity
•Less risk that a unforeseen bug can bring down more of the fabric than is absolutely necessary
•Isolates the RDR network from the production SAN—because you can never be too cautious
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
81
Best Practice: A and B Physical Separation
Merging fabrics A and B is not the point here!
FOS is common
NOT PHYSICALLY ISOLATED
No redundant fabrics!
Fab A
For each edge fabric, FCR runs
the following:
• NS
• FSPF
• SCR/RSCN
• Routing
• PSS
• DIA
• Others
Fab B
Fab A
Fab B
VF is not any better
Supported by Brocade and OEMs, but is
considered high risk and poor practice
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
82
Typical Four-Brocade 7800 Solution
• Solution:
•2 FCIP Trunks
•1 FCIP Trunk per 7800
• 2 circuits in each trunk
•Array sees 2 parallel paths
MLX Core
7800 4/2
MLX Core
7800 4/2
GE FCIP
FC path A
GE FCIP
FC path A
GE FCIP
FC path B
IP WAN Link
FC path B
Service Provider
GE FCIP
7800 4/2
(Possibly carrier Ethernet)
MLX Core
MLX Core
7800 4/2
• ARL used on all 4 circuits
•Max is link BW or interface line rate, whichever is smaller
•In this example: Min = Max  4
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
83
High-Availability Design
Multiple paths
• Four Brocade 7800/FX
• Two IP Networks
• Most RDR applications load-balance across multiple paths
• Most RDR applications will fail over to the remaining paths
• Supports FastWrite, OSTP, and FICON Emulation
FCIP
Fabric 1A
WAN A
7800
Fabric 2A
7800
FCIP
Storage
Local
WAN B
Fabric 1B
Brocade 7800 & FX - Brocade CONFIDENTIAL
7800
Fabric 2B
7800
March 2012
Storage
Remote
84
What Not To Do!
TheOtherEnd, TX
A
A
B
B
A
A
B
7800
RA2
B
B
A
A
B
B
A
A
B
B
A
A
B
B
RA2
7800
A
B
B
A
A
B
B
A
A
B
B
RA4
RA4
Brocade 7800 & FX - Brocade CONFIDENTIAL
RA3
RA2
Array
RA3
GE Circuits
RA1
RA1
RA4
RA4
A
7800
Array
RA3
RA2
Array
RA2
GE Circuits
RA1
RA1
RA4
RA3
B
RA4
RA3
A
7800
Array
ROUND TRIP LATENCY 40 – 60 milliseconds
RA3
RA2
Array
Array
A
RA1
RA1
Somewhere, NJ
March 2012
85
NETWORK MONITORING
SERVICE
Brocade Exclusive
Brocade Network Monitoring Service (NMS)
• 7800 and FX blade were designed with NMS
in mind
• Perfect Integration
• Have the Tier 1 Support organization monitor
and support your RDR network
Around-the-clock, remote monitoring of data
center extension devices and networks
Proactive device polling allows Brocade experts
to quickly identify potential problems
• Faster fault isolation and resolution,
improving availability
Performance statistics and reporting available
via secure web portal, including real-time and
historical data for trending analysis
Brocade 7800 & FX - Brocade CONFIDENTIAL
• Reduces downtime 54 minutes per
event on average
• More effective capacity planning
• Improves resource utilization
March 2012
87
QUESTIONS?
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
88
THANK YOU
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
90
Extension Roadmap Update
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
91
FR4-18i Product Life Cycle Plan
• FR4-18i is part of the EOL plan for all 4G blades
• Announcement letter in Feb 2012
• Last customer ship in Aug 2012
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
92
Qualification of Additional SFPs in FOS 7.0.1
• For 7800 and FX8-24 FC Ports
• 4G ELWL – 100km (SmartOptics)
• 8G CWDM – 70km (SmartOptics) (delayed to post FOS 7.0.1)
• 8 wavelengths from 1470nm-1610nm
• For 7800 and FX8-24 GE Ports
• GE CWDM – 80km (BR branded)
• 8 wavelengths from 1470nm-1610nm
• Brocade P/N: 00600-29x (x=1 to 8)
• For FX8-24 10GE Ports
• 10GE ER – 40km (BR branded) (delayed to post FOS 7.0.1)
• Brocade P/N: 57-0000085-01
• 10GE CWDM – 70km (SmartOptics) (delayed to post FOS 7.0.1)
• 8 wavelengths from 1470nm-1610nm
• FOS 7.0.1 accepts above listed 3rd party (SmartOptics)
“boutique” SPFs by the P/N in SFPs’ EEPROM
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
93
Emulation for Select ESCON and B&T Printers
• Emulation for the following printer models will be supported for extending
z/OS host to printer connection
• 3203, 3800-1, IPDS 3900, IPDS 4100
• Solution requires Optica Prizm/ESBT for ESCON/Bus & Tag to FICON
conversion
• Solution allows customers to upgrade IBM System z hosts and upgrade
ESCON to FICON channels while keeping legacy printers to avoid costly
equipment and operation support upgrade
• The IBM System zEnterprise 196 and 114 are the last system z servers to support
ESCON channels
Tape
IBM
System z
Brocade 7800
Brocade 7800
FICON
FICON
Prizm
IP Network
Printer
ESCON
Brocade 7800 & FX - Brocade CONFIDENTIAL
ESCON
March 2012
ESBT
Tape
Bus&Tag
Printer
94
Non-Brocade Fabric Extension (FOS 7.1)
H1
VSAN_Zone1
Non-Brocade
or Brocade
Fabric 1
T2
T1
N-port port
group 1
vT1
7800
vH2
N-port
port
group 2
FCIP
N-port port
group 1
Non-Brocade
vH1
or Brocade
7800
vT2
Fabric 2
N-port
port
group 2
H2
• Extend non-brocade fabric to non-Brocade or Brocade fabric
• Provide N_Port port group support with N_Port failover
• All 7800 FCIP extension features will be available
• FastWrite, OSTP, QoS, FCR, etc…
• Devices to be connected to remote fabric need to be
imported to remote 7800 manually
• 7800 registers virtual device which has same pWWN and nWWN as
the imported device to connected fabric
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
95
Additional Features Planned for FOS 7.1
(Subject to Change)
• VF (eight LS) support on 7800
• Support 1 sec granularity in the counters
• Support interval option in portshow fciptunnel/fcipcircuit for
real-time monitoring
• Real-time counter for FCIP tunnel compression ratio
• Cperf support (individual circuit performance)
• All counters related traffic stats need to be able to be reset to
zero
• Monitor individual TCP session within individual circuits with
BNA
• USGv6/IPv6
• IPsec over IPv6
• Extend bottleneck detection to FCIP ports
Brocade 7800 & FX - Brocade CONFIDENTIAL
March 2012
96