Unified Compute System (UCS)
Architectural Overview
Steve McQuerry. CCIE #6108
Session ID 20PT
UCS System and Connectivity View




Single Management Interface for up to 160 blade servers
Role Based Access for LAN, SAN, and Server Administrators
Clustered for fault tolerance and no single point of failure for any chassis
Open APIs for third party integration
SAN
Network
SAN A
LAN
Server
BRKSPM-2604_c1
Mgmt
© 2010 Cisco and/or its affiliates. All rights reserved.
SAN B
Cisco Confidential
2
Single Point of Management
Unified ComputingReduced
System
(UCS)points
# of management
Reduced firmware management
Single Point of Management
Reduced time to resolve issues
Reduced complexity
Unified Fabric
Stateless Servers
with
Virtualized Adapters
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
3
Unified Fabric
Unified Computing
System (UCS)
Unified Fabric
Reduced # of adapters
Reduced # of switches
Single Point
of
Management
Reduced
LAN and SAN edge ports
Reduced cabling costs
Reduced power due to less H/W
Stateless Servers
with
Virtualized Adapters
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
4
Unified Computing System (UCS)
Single Point of Management
Unified Fabric
Large Memory
Reduced server costs
Reduced power and cooling costs
Reduced software costs
Stateless Servers
with
Virtualized Adapters
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
5
Unified Computing System (UCS)
Single Point of Management
Unified Fabric
Virtualization & Stateless Servers
Reduced type of servers via H/W virtualization
Reduced # of standby servers for HA
Reduced downtime due to service profiles
Reduced time to resolve issues with VM’s
Stateless Servers
with
Virtualized Adapters
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
6
Cisco Unified Computing System
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
7
System Components
SAN
LAN
MGMT
SAN
 Fabric Interconnect
G
S
G
S
Fabric
A
Interconnect
G
G
G
G
(40 or 20 10GE ports) + (2 or 1 GEM slots)
Fabric
A
Interconnect
G
G
G
G
 Chassis
Upto 8 half width blades or 4 full width blades
Compute Chassis
Fabric
Extender
I
R
x8
C
C
I
x8
Fabric
Extender
R
x8
x8
 Fabric Extender
Host to uplink traffic engineering
Up to 80Gb Flexible bandwidth allocation
M
B
Adapter
P
P
B
Adapter
Adapter
X X
X X X X
x86 Computer
x86 Computer
 Adapter
Virtualized adapter for single OS and hypervisor
systems
 Compute Blade
Compute Blade
(Half slot)
BRKSPM-2604_c1
Compute Blade
(Full slot)
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
8
System Components – Details
 Altos ASIC
SAN
LAN
G
S
G
S
Fabric
Switch
A
G
MGMT
G
SAN
G
G
Fabric
Switch
G
 Gatos ASIC
A
G
G
0.56 Tbps Xbar
10GE/FC/1GE Media Access Controllers
G
Forwarding - Ethernet, Fibre Channel, Multipath
Compute Chassis
Fabric
Extender
I
R
x8
C
C
Policy Engine
I
x8
Fabric
Extender
R
x8
x8
Packet Buffering
 Redwood ASIC
Host to uplink traffic engineering
Connectivity detection & management portal
E/Q
B
Adapter
P
P
B
Adapter
Adapter
X X
X X X X
x86 Computer
x86 Computer
Compute Blade
(Half slot)
Compute Blade
(Full slot)
 Palo ASIC Data Plane
Virtualized adapter for both single OS and
hypervisor systems
Ethernet, FC
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Direct Data Placement for Fibre Channel
Cisco Confidential
9
Wire for Bandwidth, Not Connectivity
Uplinks
20Gb/s




40Gb/s
80Gb/s
Wire Once Architecture
All links can be active all the time
Policy-driven bandwidth allocation
Virtual interface granularity
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
10
Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
11
Unified Computing System Manager
•
•
•
•
Embedded device manager for family of UCS components
Enables stateless computing via Service Profiles
Efficient scale: Same effort for 1 to N blades
APIs for integration with new and existing data center infrastructure
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
12
UCS Manager
 Single point of management for UCS system of
components
Custom Portal or Tools
GUI
CLI
Systems Management
Software
Adapters, blades, chassis, fabric extenders, fabric
interconnects
 Embedded device manager
Discovery, Inventory, Configuration, Monitoring,
Diagnostics, Statistics Collection
UCS Manager
Coordinated deployment to managed endpoints
 APIs for integration with new and existing data
center infrastructure
SMASH-CLP, IPMI, SNMP
XML-based SDK for commercial & custom
implementations
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
13
Management Protocols
SNMP
CIM XML
SMASH CLP
syslog
IPMI
Call-home
Remote KVM
UCS CLI and GUI
Serial Over LAN
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
UCS XML API
Cisco Confidential
14
Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
15
UCS 6100 Series Fabric Interconnects
6100 Series Fabric Interconnects
• 10 Gigabit Ethernet, FCoE capable, SFP+ ports
• 20 and 40 fixed port versions with Expansion slots for additional
Fiber Channel and 10 GE connectivity
• Upto to 1.04 Tbps of throughput
• Hot pluggable fan and power supplies
• Hardware based support for Cisco VN-Link technology
• Fully managed by UCS Manager through Fabric Interconnect
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
16
UCS 6100 Series Expansion Modules
FC-only (8 ports
@ 1/2/4 Gbsec)
FC-only (6 ports
@ 1/2/4/8 Gbsec)
Combo FC + Ethernet
Ethernet-only
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
17
UCS 6248UP Fabric Interconnect
Benefit

Scalable platform for high density, high
performance, unified infrastructure

Platform for future app and virtualization needs
Feature details
• UCS 6248UP chassis
• 32 fixed Unified Ports
• 1 expansion module slot (16 ports)
• Double the port density in 1RU
• Foundation for future network scalability
• 1.92 Tbps throughput
• 4096 VLANs
• Dual power supplies for both AC and DC
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
18
Unified Ports
Dynamic Ports Allocation: Lossless Ethernet or Fibre Channel
 Convert protocol support on the
same port dynamically
Unified Port
 All ports on UCS 6200 Series
 16-port Expansion Module for
6248UP and 6296UP
Native Fibre Channel
Benefits
Lossless Ethernet:
1/10GbE, FCoE, iSCSI, NAS
Use-cases
 Simplify switch purchase remove ports ratio guess work
 Flexible LAN & storage convergence
based on business needs
 Increase design flexibility
 Service can be adjusted based on the
demand for specific traffic
 Remove bandwidth
bottlenecks
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
19
UCS 6200 Expansion Module
UCS-FI-E16UP
• 16 “Unified Ports”
• Ports can be configured as either
Ethernet or Native FC Ports
• Ethernet operations at 1/10 Gigabit
Ethernet
• Fibre Channel operations at 8/4/2/1G
• Uses existing Ethernet SFP+ and
Cisco 8/4/2G and 4/2/1G FC Optics
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
20
Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
21
UCS 2104 Fabric Extender
2104 Fabric Extender
• Connects UCS blade chassis to the Fabric Interconnect
• Four 10 Gigabit Ethernet, FCoE capable, SFP+ ports
• Up to 2 Fabric Extenders per chassis for redundancy and up to 80
Gbps of bandwidth per chassis
• Built-in chassis management functionality
• Hardware based support for Cisco VN-Link technology
• Fully managed by UCS Manager through Fabric Interconnect
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
22
UCS 2208XP I/O Module
Customer benefits
I/O scalability and flexibility
Feature details
• Double the uplink bandwidth
• 8 x 10 Gig network-facing ports
• Quadruple the server-facing bandwidth
• 32 x 10 Gig = 4 per half width slot
• Two I/O Modules per chassis
• 80Gbps to a single half-width blade
(40Gbps left and right)
• 160Gbps to a full-width blade
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
23
Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
24
UCS 5108 Blade Chassis
Chassis
• Up to 8 half slot blades
• Up to 4 full slot blades
• 4x power supplies, N+N grid redundant
• 8x fans included
• 2x UCS 2104 Fabric Extender
• All items hot-pluggable
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
25
UCS 5108 Blade Chassis Parts
2 Fabric
Extenders
8 Fan Modules
4 Power
Connectors
4 to 8 Blades
4 Power
Supplies
6U, 19” Rack
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
26
UCS 5108 Blade Chassis Backplane
I/O Modules
PSU Connectors
Blade Connectors
Redundant data and management paths
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
27
Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
28
Compute overview
Blade
B200 M2
2 Socket Intel 5600, 2 SFF Disk, 12 DIMM
B230 M2
2 Socket Intel E7, 2 SSD 7mm Disk, 32 DIMM
B250 M2
2 Socket Intel 5600, 2 SFF Disk, 48 DIMM
Rack Mount
B440 M2
4 Socket Intel E7,4 SFF Disk, 32 DIMM
C200 M2
2 Socket Intel 5600, 4 Disks, 12 DIMM, 2 PCIe, 1U
C210 M2
2 Socket Intel 5600, 16 Disks, 12 DIMM, 5 PCIe, 2U
C250 M2
2 Socket Intel 5600, 8 Disks, 48 DIMM, 5 PCIe, 2U
C260 M2
2 Socket Intel E7, 16 Disks, 32/64 DIMM, 6 PCIe, 2U
C460 M2
4 Socket Intel E7, 12 Disks, 64 DIMM, 10 PCIe, 4U
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
29
Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
30
Compute overview
Blade
B200 M2
2 Socket Intel 5600, 2 SFF Disk, 12 DIMM
B230 M2
2 Socket Intel E7, 2 SSD 7mm Disk, 32 DIMM
B250 M2
2 Socket Intel 5600, 2 SFF Disk, 48 DIMM
Rack Mount
B440 M2
4 Socket Intel E7, 4 SFF Disk, 32 DIMM
C200 M2
2 Socket Intel 5600, 4 Disks, 12 DIMM, 2 PCIe, 1U
C210 M2
2 Socket Intel 5600, 16 Disks, 12 DIMM, 5 PCIe, 2U
C250 M2
2 Socket Intel 5600, 8 Disks, 48 DIMM, 5 PCIe, 2U
C260 M2
2 Socket Intel E7, 16 Disks, 32/64 DIMM, 6 PCIe, 2U
C460 M2
4 Socket Intel E7, 12 Disks, 64 DIMM, 10 PCIe, 4U
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
31
Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects
6100
6200
UCS Fabric Extenders
Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis
Flexible bay configurations
Logically part of Fabric Interconnect
UCS Blade Servers
Different blade types
Mix blade types within enclosure
UCS Rack Servers
Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
32
I/O Adapters for B-Series M72KR-Q
High Performance 10Gbps per port
maximum throughput for high bandwidth
SAN and LAN traffic
Full hardware offload for FCoE protocol
processing
250,000 IOPS per port deliver high I/O
Up to 8Gb FC throughput
Full support for TCP/IP and Ethernet with
enhancements
 Priority-based Flow Control (802.1Qbb)
 Jumbo frames
 Checksum offloads
 Segmentation offloads
Common driver for CNAs and HBAs
Low power ~ 5W
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
33
I/O Adapters for B-Series M72KR-E
 Full 10Gbps network performance
with support both LAN and SAN traffic
 Full hardware offload for FCoE
protocol processing
 PCIe Express 2.0 (x8, 5GT/s), MSI-X
support
 Integrated data buffer and code space
memory
 Theoretical 10Gb FC throughput
 Common driver for UCNAs and HBAs
 Support for Jumbo frames
 Cannot do per priority pause on
Ethernet traffic.
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
34
I/O Adapters for B-Series M61KR-I
 Interface Type PCIe v2.0 (5.0GT/s)
 Intel® VT-dVMDq, SR-IOV
 Full support for TCP/IP and Ethernet
with enhancements:
 Priority-based Flow Control (802.1Qbb)
 Jumbo frames
 Checksum offloads
 Segmentation offloads
 Low power ~7W
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
35
I/O Adapters for B-Series M51KR-B
 Broadcom NetXtreme II 57711 DualPort 10 Gigabit Ethernet PCIe Adapter
 x8 PCI Express base specifications
v2.0 and v1.1
 iSCSI offload
 Virtual LANs (VLANs), IEEE 802.1q
 IEEE 802.3x flow control
 TCP, IP, UDP checksum offload - TCP
segmentation
 iSCSI Boot capable
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
36
Palo Based Mezzanine Card M81KR-VIC
Adapter designed for both single-OS and
VM-based deployments
•
•
Network Interface Virtualisation support
VN-link capable hypervisor integration
PCIe standard compliant
Power of 18 watts
Cut-through architecture
High Performance
•
•
•
Eth
Eth
FC
FC
2x 10Gb
Low latency
600K IOPS
HW capable of up to 128 vNICs
•
•
•
Ethernet vNIC, and FC vHBA
Two ports to the backplane
Switch and network see all vNIC and vHBA
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
0
Cisco Confidential
1
2
119
37
UCS 1280 2nd Gen VIC
Customer benefits
Dual 4x10 Gb to a single slot
VM-FEX scale, up to 116 VM interfaces /w ESX 5.0
Feature details
• Dual 4x10 Gbps to a single slot
• Host connectivity PCIe Gen2x16
• HW Capable of 256 PCIe devices
• OS restriction apply
• PCIe virtualization OS independent (similar to
Palo)
• OS drivers for 1st Gen VIC and 2nd Gen VIC
same
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
38
3rd Party Adapters for UCS C-series
I/0 Adapters:
N2XX-ABPCI02
N2XX-ABPCI03
N2XX-ABPCI01
UCSC-PCIE-BSFP
- Broadcom BCM57711, 10 GbE Dual Port NIC (TwinAx Cable Only)
- Broadcom BCM5709, GbE Quad Port GE NIC
- Broadcom BCM5709, GbE Dual Port GE NIC
- Broadcom BCM57712, 10GbE Dual Port NIC
N2XX-AEPCI01
N2XX-AEPCI03
N2XX-AEPCI05
- Emulex OneConnect OCe10102-F FCoE CNA (TwinAx Cable Only)
- Emulex LPE 11002 4Gb Dual Channel FC HBA
- Emulex Lpe 12002 8Gb Dual Port FC HBA
N2XX-AIPCI01
N2XX-AIPCI02
- Intel Ethernet X520 10GbE Dual Port Server Adapter (TwinAx Cable Only)
- Intel Quad Port GE NIC
N2XX-AQPCI01
N2XX-AQPCI03
- Qlogic QLE 8152 (FCoE) 10 Gb 2-port CNA (TwinAx Cable Only)
- Qlogic 2462 4Gb Dual-Channel FC HBA
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
39
Connectivity
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
40
UCS 6100 Operating Modes
End Host
•
External LAN sees UCS 6100 as an end-host
Switch
•
External LAN sees UCS 6100 as a traditional
Ethernet switch (STP = PVST+)
with multiple adapters (no STP)
•
Active/Active use of uplinks by pinning
•
Some uplinks blocked by STP (no pinning)
•
Single or disjoint upstream L2 domain
•
Single or disjoint L2 domains
•
More scalable than switch mode
•
MAC learning on uplink/server interfaces
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
41
UCS Ethernet Connectivity
IP Storage
FCoE Storage
LAN
uplinks
appliance
UCS 6100
storage target
UCS 6100
monitor
Nexus 2248
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Nexus 2248
Cisco Confidential
42
Port Types vs. FI Operating Mode
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
43
From Chassis to Fabric Interconnect
Fabric
Interconnects
(UCS 61XX)
Module
SFP+
Module
SFP+
IO Module to 61XX
Blades pinned to uplink based
On Slot number
IO Modules
UCS 2104
UCS 2104
Midplane
Mezz
10Gb Mezz
x16 Gen 2
x16 Gen 2
Server Blade
IOH
CPU
CPU
Blade Chassis
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
44
From Chassis to Fabric Interconnect New
Fabric
Interconnects
(UCS 6248)
16x
SFP+
16x
SFP+
Module
16x
SFP+
16x
SFP+
Module
IO Module to 6248 links user
configuration Ether channel
IO Modules
(UCS 2208)
UCS 2208
UCS 2208
Midplane
Mezz
(UCS 1280)
UCS 1280
x16 Gen 2
x16 Gen 2
Server Blade
IOH
CPU
 4x10 Gbps Ether channel from VIC-2 to 2208 IO Modules
 No user configuration required
 vNIC flows are 5-tuple LB across links
 Each individual flow limited to 10Gb
 Fabric Failover available
CPU
Blade Chassis
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
45
FC Switch mode
SAN Fabric
Storage Arrays
Fibre Channel
Fabric A
Fabric B
Core
Direct Attach
Ethernet
Unified I/O
FCoE
FC Storage
FCoE Storage
SAN Edge B
SAN Edge A
UCS 6100
UCS 6100
 Must have connection to
MDS FC Switch or N5K
 Data traffic doesn’t have to go
through FC switch or N5K
 Only works with Cisco
FC Switches or N5K
UCS B-Series
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
46
UCS C-Series Integration to UCSM
Management path via FEX, Data path directly connected
6100 running UCSM
6100 running UCSM
Mix of B & C Series
is supported
Nexus 2248
Nexus 2248
2 LOM ports
exclusive CIMC
connectivity
GE LOM
CIMC
PCIe Adapter
CPU
Mem
OS or Hypervisor
Adapter support:
Emulex CNA
Qlogic CNA
Intel 10g NIC
Broadcom 10g NIC
Cisco VIC
Mgmt Traffic
C200, C210, or C250
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Data Traffic
Cisco Confidential
47
UCS Manager C-Series Integration
Phase 2, UCS 2.0+ (Capitola +1) Server Bundle/ MR (Target Q1
CY2012)
Customer benefits

Simplified topology with converged FEX

Scalable up to 160 servers (target scale, not QA verified)
UCS
Manager
Feature details

Stateless computing and management services benefits of
Phase 1

Improved C-Series server connectivity
UCS 6100 or 6200
UCS 6100 or 6200
•Management and data connectivity through 2232PP FEX
Nexus 2232
Nexus 2232
•Phase 1 topology will no longer be supported (from this
server pack forward, a 2248 topology will not work).
•Note that you will not be able to direct connect the data
plane to the FI in this topology. Also, the mgmt and data
connections from the rack mounts to the 2232 are separate
(single wire mgmt is an uncommitted ask for a later software
release)

•
•
10 Gb CNA
1 or 10 Gb LOM
GLC-T connector
Server Support
Phase 1 supported servers (C200 M2, C210 M2, C250 M2)
Additional C-series models shipping at time of Phase 2 (e.g.,
C200 M2 Small Form Factor, C260 M2, C460 M2)
Mgmt Connection
Data Connection
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
48
Highlights of the New Topology
 New topology
Both mgmt and data connect into a single Nexus 2232 which plugs in to UCS fabric
interconnects. A pair of Nexus 2232 is required for HA. Mgmt ports will require a
1000Base-T SFP Transceiver Module (RJ-45 connector).
 Required software version
UCS 2.x (maintenance release) – This is NOT part of 2.0 FCS, but rather a follow-on
server pack
 New topology benefits
Topology simplification (converged connectivity i.e both mgmt and data plane connect
into a Nexus 2232)
Increased scale up to 160 servers (targeted value, subject to modification)
·
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
49
VM-FEX
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
50
Modes of VM-FEX
VMDirectPath
Emulated Mode
BRKSPM-2604_c1
Standard Mode
High Performance Mode

12%-15% CPU performance
improvement

Co-exists with Standard mode


Bypasses Hypervisor layer
vMotion supported

30% improvement in I/O performance

vMotion supported with ESX 5.0
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
51
User
VM-FEX with KVM Architecture
Management
Tools
Guest 1
Guest 2
Application
Application
Guest
OS
virtio-net
Libvirt
Netlink
Socket
Kernel
vhost-net
Macvtap 1
eth0
Cisco VIC
Port Profile1:
Qos1, vlan1
Guest
OS
virtio-net
Port Profile2:
Qos2, vlan2
vhost-net
Macvtap
Interface
Macvtap 2
eth2…… ethn
eth1
PF
KVM
VF1
……
VF2
Netdev
Interface
VFn
Adapter Port
Switch Port
Veth 1
Port Profile1: UCS Switch
Qos1, vlan1
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
Veth 2
Port Profile2:
Qos2, vlan2
52
Complete Your Session Evaluation
 Please give us your feedback!!
Complete the evaluation form you were
given when you entered the room
 This is session BRKxxx-xxxx
Don’t forget to complete the overall
event evaluation form included in
your registration kit
YOUR FEEDBACK IS VERY
IMPORTANT FOR US!!! THANKS
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
53
BRKSPM-2604_c1
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
54