Force10 Switch/Router
Solutions for R&E
Debbie Montano
dmontano@force10networks.com
Jan 21, 2008
Force10 Networks, Inc. - Confidential and Proprietary
Solutions for R&E

Topics
– New Force10 LAN Switches
– The Greening of the Data Center
Force10 Networks, Inc. - Confidential and Proprietary
Force10’s Product Portfolio –
End to End Reliable Networks
E-Series
E300 / E600 / E1200
C-Series
FTOS
Modular OS
C150 / C300
S-Series
S25P / S50N / S50V
S2410P / S2410CP
FTOS
Modular OS

Core Switch/Routers
FTOS
Modular OS

SFTOS
LAN Switches

Access Switches
Force10 Networks, Inc. - Confidential and Proprietary
C-Series: Delivering Advantages
from the Data Center to the LAN
Reliability
Network
Control
Scalability
Enterprise LAN
Combining the highest
performance and resiliency
in mid-range, cost-competitive
modular platform
Midsize
Data Centers
Force10 Networks, Inc. - Confidential and Proprietary
Why Reliability Now?
…In the
Wiring Closet
Data
Center
LAN
Core
Wiring
Closet
As critical as
data center to
organizations
Expect same
experience as
hosted application
Growing #
of Apps
Software as a
service running
at the desktop
Force10 Networks, Inc. - Confidential and Proprietary
C-Series Key Features
Resilient LAN Switch

High performance GbE and 10 GbE

Best-in-class reliability
FTOS
Modular OS
– Proven FTOS Modular OS with resilient
chassis design –
– Online insertion removal (OIR) of all
hardware components
– Inline diagnostics, serviceability
and monitoring

Familiar Cisco-styled CLI and full
range of standard-based protocols

Room to grow with 1.536 Tbps
switching capacity
Force10 Networks, Inc. - Confidential and Proprietary
C300 Hardware Overview
Redundant Fans
8 Line Card Slots
Redundant Power
Supply Modules
(PSMs): 2+1 System
4+1 for PoE
Passive Copper
Backplane
Redundant Route
Processor Modules
and Integrated
Switching Fabrics
(RPMs): 1+1
1.536 Tbps Fabric
Switching Capacity
Intelligent Power Management:
Ensures that that critical ports
maintain power in case of failure
Force10 Networks, Inc. - Confidential and Proprietary
C150 Chassis Overview
Redundant Fans
4 Line Card
Slots
Redundant Power
Supply Modules
(PSMs):
1+1 System
2+2 PoE
Passive Copper
Backplane
Redundant Route
Processor Modules
and Integrated
Switching Fabrics
(RPMs): 1+1
768 Gbps Fabric
Switching Capacity
Force10 Networks, Inc. - Confidential and Proprietary
Force10 C300
A Competitive Comparison
Cisco
4510R
Line Card Slots
8
Industry Standard CLI
Yes
Modular OS
No
Serviceability
Yes
System Power Redundancy
1+1
Switching Capacity (Gbps)
136
Slot Capacity (Gbps)
6
Line-rate GbE Ports
56
4
Line-rate 10 GbE Ports
(Management
Module)
Force10
Force10
C300
C300
88
Yes
Yes
Yes
Yes
Yes
Yes
2+1
2+1
1536
1536
Cisco
6509
7/8
Yes
Yes
Yes
1+1
720
96
40
384
384
96
384
32
64
32
(No
Redundant
Control)
Force10 Networks, Inc. - Confidential and Proprietary
C-Series

Key Applications:
– Low cost 100/1000 Mbps server aggregation for small- to
medium-sized data centers (100s to 1,000s of servers)
– Cost-effective LAN core switch for small- and mediumcampuses (100s to 1,000s of PCs)
– High density GbE aggregation for distribution into a multiple
Gbps or 10 GbE backbone
– Cost-effective PoE-enabled 10/100/1000Base-T wiring closet
aggregation of VoIP phones, wireless access points, video
cameras or other IEEE 802.3af-compliant devices

High availability architecture
– 1+1 Route Processor Module (RPM) design
– Continuous runtime data plane monitoring and advanced inservice CLI diagnostic functions
– Power supply redundancy with load sharing power bus
enabling uninterrupted VoIP calls during a power supply failure
Force10 Networks, Inc. - Confidential and Proprietary
FTOS and HA Check List
What Is Common?
Feature
E-Series
C-Series
S-Series


Industry Standard CLI
Identical CLI

Hot Insertion
N/A
Protected Memory (ECC)

Control and Data Plane
Separation

Serviceability

Modular OS
NetBSD
Hitless RPM Failover

Partial
N/A
Hitless Software Upgrade

Partial

3 CPUs



Force10 Networks, Inc. - Confidential and Proprietary
Benefits of a Force10 Network?

Force10 philosophy
– Buy less
– Build best-of-breed, open and converged networks

2-Tier model – Core/Distribution & Access
– Less switches ~ lower CapEx, OpEx & networking points of failure

Network design with standards-based protocols/features
– Interoperability with other vendors
– Customers to build multi-vendor best-of-breed networks
– No need to worry about features being disabled/unsupported

Inter-dependency of features also based on standards
– Can change features/products without worrying about changing the
network design/architecture
Force10 Networks, Inc. - Confidential and Proprietary
Line Card Hardware Details

96 Gbps fabric capacity per slot
– C300: 8 line card slots
– C150: 4 line card slots

Up to 384 line-rate GbE ports
– 48-port line-rate 10/100/1000 card with
15.4W PoE per port
– 48-port line-rate 10/100/1000 card
– 48-port line-rate GbE card, SFP
pluggable optics

Up to 64 line-rate 10 GbE ports
– 8-port line-rate 10 GbE card, XFP
pluggable optics
– 4-port line-rate 10 GbE card, XFP
pluggable optics

CPU
– IBM 500 MHz PowerPC 440GX

Memory
– 256 MB RAM, 256 KB NVRAM
Force10 Networks, Inc. - Confidential and Proprietary
C-Series RPM Details

CPU
– IBM 640 MHz PowerPC 750FX

Memory
–
–
–
–

1 GB RAM
128 KB NVRAM
512 MB internal CompactFlash (flash:)
External CompactFlash slot (slot0:)
Console
– RJ45 RS232 port (DTE)
– Same as the E-Series
– Requires
– DB9 to RJ45 adaptor (included)
– Rollover RJ45 cable (not included)

Management Ethernet
– 10/100/1000Base-T RJ45
– Auto-sensing, auto-MDIX
Console Pinout
Pin 1
Not Used
Pin 2
DTR
Pin 3
TxD
Pin 4
GND
Pin 5
GND
Pin 6
RxD
Pin 7
DSR
Pin 8
Not Used
Force10 Networks, Inc. - Confidential and Proprietary
Product Capacity Summary –
Architecture
E-Series
C-Series
S-Series
(S25P/S50N/S50V)
5 Tbps
1.536 Tbps
N/A
40 GbE and 100 GbE Ready



Multi-processor RPM Architecture
3
1
1
Separate Management and
Switching Fabric Cards



Line-rate Full Mesh Under All
Conditions



Hot Swap of All Components



Integrated Cable Management



56.25 Gbps
96 Gbps
N/A
320 MB
4 MB
4 MB/2MB
L2, IPv4, IPv6
L2, IPv4 (IPv6 Roadmap)
L2, IPv4 (IPv6 Roadmap)
Programmable Packet Processing



CAM Profiles



Ethernet, POS
Ethernet, PoE
Ethernet, PoE
FTOS Modular OS


 (FTOS Roadmap)
Hitless Failover

Partial

Hitless Software Upgrade

Partial

Chassis and Hardware
Backplane Capacity
Line Cards
Slot Capacity
Buffering
Packet Forwarding
Interfaces
Software
Force10 Networks, Inc. - Confidential and Proprietary
C-Series Intelligent
Power System Design Summary
C150
C300
6
8
System Power
Redundancy
1+1
2+1
PoE Power
Redundancy
2+2
4+1
3
4
192
384
Number of PSMs
Minimum PSMs
Needed for PoE
Class 3 PoE Ports
@15.4W
PSM Ordering
Information
CC-C-1200W-AC
(Country-specific Power Cables are Additional)
Force10 Networks, Inc. - Confidential and Proprietary
C-Series Intelligent Power System
Design – Number of PoE Ports
PSM
C150
PoE Ports at 15.4W
C300
PoE Ports at 15.4W
1
0
0
(System PSM)
(System PSM)
0
0
(Redundant System PSM)
(System PSM)
2
0
3
96
4
192
96
5
Up to 192
192
6
(Redundant PoE PSM)
Up to 192
(Redundant PoE PSM)
(Redundant System PSM)
288
7
—
384
8
—
Up to 384
(Redundant PoE PSM)
Force10 Networks, Inc. - Confidential and Proprietary
C-Series Intelligent Power System
Design – Prioritization

Load sharing resilient power
bus design

Power manager continuously
monitors system and PoE
power
Lower
Priority
Ports
Mission
Critical
Ports
3
Selective
Power
Shutoff
– Extensive CLI for
configuration and monitoring

Deterministic failure mode of
PoE power in case the
required number of PSMs
are unavailable

Port prioritization so that
critical ports maintain power
during PSM failures
2
1
Failur
e
Prioritization for
Mission Critical Ports
Force10 Networks, Inc. - Confidential and Proprietary
Customer Reference: University
of Tennessee, Knoxville
Who

Top 40 public university in U.S., founded in 1794
 26,400 students, 8,300 faculty
 Co-manages w/ Battelle, Oak Ridge National
Laboratory, Dept of Energy's largest science and
energy lab
 Connected to GLORIAD (with Force10 E300)
Solution





HPC cluster expansion to CERN
L2 switching only
Stability of switch was key (redundant power,
RPMs, & stable OS)
Predictable line-rate performance across cluster
Familiar OS (E-Series deployed on GLORIAD)
Deploying: C300
Also Considered: Cisco
Force10 Networks, Inc. - Confidential and Proprietary
Customer Reference: First
Advantage True Data
Who

Innovative data-driven information and
risk-mitigation solutions
 Provides litigation, services, computer
forensics, electronic data recovery, etc.
 Based in Pasadena, CA;
10 data centers total
Solution

10 GbE core in data center architecture
 Required reliable, fast, cost-effective Ethernet
 Technical fit with BlueArc storage
Deploying: C300, C150 (future)
Also Considered: Foundry
Force10 Networks, Inc. - Confidential and Proprietary
Customer Reference: 3ality Digital
Who

Produces highest quality 3D films
 Built world’s first all-digital online 3D post
facility, used in U2 concerts and SuperBowl
 1st data center in Burbank, expanding to 3
Solution

Line-rate GbE LAN to all servers & desktops
 40 x uncompressed “2K” video streams = 128 Gbps
 Expansion ability to 10 GbE for NAS and high
performance servers
 Price conscious no frills required or desired!!!
Deploying: C300 and S2410
Also Considered: Cisco
Force10 Networks, Inc. - Confidential and Proprietary
C-Series Product Matrix
C300
C150
Switch Fabric Capacity
1.536 Tbps
768 Gbps
Full-Mesh Forwarding Capacity
952 Mpps
476 Mpps
I/O Line Card Slots
8
4
Line-rate 10/100/1000 Base-T with
Class 3 IEEE 802.3af PoE
384 ports at 15.4 W
192 ports at 15.4W
Line-rate 100Base-FX or GbE SFP
384
192
Line-rate 10 GbE XFP
64
32
Chassis Size
13 rack units
3 units per 19” rack
9 rack units
4 units per 19” rack
Hardware Redundancy
Power, Route Processor, Switch Fabric, Passive
Copper Backplane
Operating System
Fully Modular, Force10 Operating System (FTOS)
Force10 Networks, Inc. - Confidential and Proprietary
The Greening of The Data Center

Until recently power efficiency in the Data Center has not
been paramount in IT rollouts

This is now changing and is being driven by:
–
–
–
–
Rising power costs
Blackouts/Brownouts and capacity planning
Limits to grid/sub-station scaling (No more power available)
Politic pressures and “green” legislation to drive greater data
center efficiencies
If we as an industry don’t lead
the process we will be dragged
to an unacceptable position
Force10 Networks, Inc. - Confidential and Proprietary
Data Center Crisis:
Power/Cooling
Moore’s Law: More Transistors…
More MIPs… More Watts… More BTUs
1 watt of power consumed requires 3.413 BTU/hour
of cooling to remove the associated heat
Data Center Power Density Went from
2.1 kw/Rack in 1992 to 14 kw/Rack in 2006
3 Year Costs of Power and Cooling,
Roughly Equal to Initial Capital Equipment Cost
of Data Center
63% of 369 IT professionals said that running out
of space or power in their data centers had
already occurred
Force10 Networks, Inc. - Confidential and Proprietary
Growing Power Density
Force10 Networks, Inc. - Confidential and Proprietary
Growing Power Density
Culprit or Savior?
Brave New
World of >15 KW
per sq foot
Force10 Networks, Inc. - Confidential and Proprietary
Force10 Customers
Data Center Power Considerations
Force10 Networks, Inc. - Confidential and Proprietary
Force10 Customers
Data Center Power Considerations
1.Prime mover in budgets
2.Network 10% of power budget…Biggest relief
by increasing density and utilization
3.From planning to build >12 months
Force10 Networks, Inc. - Confidential and Proprietary
The Big Picture –
The Watt Walkthrough
Total system efficiency comprises three main elements- the Grid, the Data Centre
and the IT Components. Each element has its own efficiency factor- multiplied
together for 100 watts of power generated, the CPU receives only 12 watts
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
Grid
Data Centre
IT Components
Go the “other way” and saving 6 watts means reducing 60 watts of power plant generation
Force10 Networks, Inc. - Confidential and Proprietary
A Series of Conversion
Efficiencies
Carbon
Efficiency
Grid
Efficiency
Data Centre
Efficiency
IT
Efficiency
OS/Software
Efficiency
100%
90%
Fuel Source
Server
Utilisation
80%
70%
Carbon
Conversion
factor
60%
Operating
System
Efficiency
50%
40%
30%
Software
Optimisation
20%
10%
U
D
C
/D
C
C
P
C
on
ve
rs
io
ns
su
pp
ly
/S
S
P
ow
er
S
U
P
ia
ry
nc
ill
A
C
oo
lin
g
C
ab
lin
g
on
Tr
an
sf
or
m
er
is
si
Tr
an
sm
ow
er
St
at
io
n
0%
P
Renewables
Grid
Data Centre
IT Components
Force10 Networks, Inc. - Confidential and Proprietary
Data Center Best Practices



Majority of efficiency improvement from rectifying
inefficient cooling (60% of your wattage work set)
Hot/Cold Row Cooling
Minimize leakage/blocking/bypasses
Force10 Networks, Inc. - Confidential and Proprietary
IT Comprehensive Approach

Minimize power consumption and maximize power
efficiency at every level within the infrastructure
CPU Chips
Power Supplies
Servers
Storage Devices
Cabling
Networking
Force10 Networks, Inc. - Confidential and Proprietary
Switch/Routers

Little difference in Gbps/watt
for fixed configuration and
stackable switches

Considerable differences for
modular switch/routers due to
backplane technology and
box-level densities
– Heavy copper traces reduce
backplane resistance and wasted
power consumption
– Force10 E-Series uses patented
4 layer, 4 ounce copper backplane
that has power efficiency of 4.5
Gbps/watt (= backplane capacity/
power consumption)
– 10-20x less resistance
Force10 Networks, Inc. - Confidential and Proprietary
Unified Data Center Fabric

Ethernet can provide LAN connectivity, storage networking,
and cluster interconnect across the data center

With a unified fabric, power is conserved
–
–
–
–
No additional sets of switches for specialized fabrics
Higher utilization on existing switches
Only one network adapter per server
Efficient cable management
LAN
Users
Cluster
IPC
Servers
SAN or
Storage Cluster
NAS
Disc Arrays
Force10 Networks, Inc. - Confidential and Proprietary
Virtualization-Ready Networking
Single, most effective way to manage and scale
power is to increase server/storage/network utilization

Applications draw on a
shared pool of resources

No resources dedicated
to a single application –
higher utilization

Workloads of various
applications peak at different
times in the business cycle

Shared resource model:
Do the same job with far
fewer resources
SOA
Applications
Services
Traditional
Applications
Enterprise
Service Bus
Cluster
Applications
Cluster
Middleware
Workload Management
Infrastructure Virtualization
Common Pool of Computing Resources
Switches
Switches
Firewalls/
Load Balancers
Firewalls/
Load Balancers
Servers
Storage
Servers
Storage
PODs
Force10 Networks, Inc. - Confidential and Proprietary
E1200 System Power Efficiency
System configured with full switch fabric, route processor,
and power redundancy and 672 line-rate GbE 1000 Base-T ports
Slot
Watts
Chassis (common + SFMs)
1,055
0
48-port 1000base-T (LR)
290
1
48-port 1000base-T (LR)
290
2
48-port 1000base-T (LR)
290
3
48-port 1000base-T (LR)
290
4
48-port 1000base-T (LR)
290
5
48-port 1000base-T (LR)
290
6
48-port 1000base-T (LR)
290
RP0
RPM-EF
125
RP1
RPM-EF
125
7
48-port 1000base-T (LR)
290
8
48-port 1000base-T (LR)
290
9
48-port 1000base-T (LR)
290
10
48-port 1000base-T (LR)
290
11
48-port 1000base-T (LR)
290
12
48-port 1000base-T (LR)
290
13
48-port 1000base-T (LR)
290
Total Power
5,365
Power Efficiency in Gbps/watt
8 (=5365/672)
DC Current @ 40V
134
Force10 Networks, Inc. - Confidential and Proprietary
Maximizing Network
Power Efficiency

In the Core and
Data Center
– E-Series resilient, scalable,
high density switches
– collapsed Distribution/
Access Tier--2-Tier switching
– elimination of numerous low
density switches
E-Series in the Core
Layer 2/3
Routers &
Switches
Firewall/LB
Power Saved on 270 Node DC
2
Force10
E1200s
=
10,600 watts
5
Legacy
Switch
=
20,000 watts
Servers
NAS/SCSI
Source: Enterprise Rental Car
Force10 Networks, Inc. - Confidential and Proprietary
Maximizing Network
Power Efficiency

In the Wiring Closet
– C-Series resilient,
scalable, high density
wiring closet switches
– Collapsed Distribution/
Access Tier--2-Tier
switching
– Eliminate numerous low
density switches
C-Series in the Core
Core
Vertical
Risers
Distribution/
Access
Switch
Wiring
Closet
Comparison – Large Campus
3
C-Series
=
9,400 watts
8
Legacy
Switch
=
22,000 watts
Force10 Networks, Inc. - Confidential and Proprietary
Force10 Networks, Inc. - Confidential and Proprietary