Scaling OpenStack with Cisco UCS
and Nexus
Duane DeCapite, OpenStack Product Manager
November 2013
©
2013 Cisco Systems, Inc. All rights reserved
1
COMMUNITY PARTICIPATION
• Code Contributions and blueprints across Core services
• Networking model, Compute Service and
Dashboard, HA, Scheduling,
• OpenStack Foundation Board member
CISCO OPENSTACK ENGINEERING
OpenStack
@ Cisco
• Automation (Puppet) and architectures (HA) for
production deployment and operational support
• Quantum/Neutron/Nova Plug-ins for Cisco
product lines
• UCS, Nexus, CSR1000V
• Scalable networking services
• FWaaS, LBaaS, VPNaaS
CUSTOMERS
• Private, Public
• Extend cloud model for rapid provisioning of network
services, bare-metal, intelligent workload placement
• Drive innovation through real-world use cases
©
2013 Cisco Systems, Inc. All rights reserved
2
Innovation through OpenStack and Cisco UCS, Nexus SDN
Applications each see
their own logical DC
API-driven
Open Cloud Platform
VM
VM
VM
VM
VM
VM
OpenStack
Compute
OpenStack
Networking
OpenStack
Storage
(Nova)
(Neutron)
(Swift, Cinder, CEPH)
Platform
APIs
Programmable
Infrastructure
One Platform Kit (onePK)
on ISR G2, ASR 1K
©
2013 Cisco Systems, Inc. All rights reserved
VM
a
Controllers
and Agents
Cisco ONE Controller SW
Openflow Agents
Virtual
Overlays
VXLAN Gateway, Openstack,
Service Chaining
CSR 1KV
3
©
2013 Cisco Systems, Inc. All rights reserved
4
As of Q3FY13 UCS revenue reached a $2B annualized run rate.
In Q3FY13, Data Center revenue was 515M growing 77% Y/Y
As of May 2013, there are over 23,000 unique UCS customers which
represents 89% Y/Y growth
More than half of all Fortune 500 customers have invested in UCS
Over 500 customers have booked over 1 Million in UCS solutions
and over 1,200 have booked over $500,000
Over 3,400 Channel Partners are actively selling UCS worldwide and
over 1700 UCS specialized partners in the channel world wide
As of CY12 Q4 Cisco is one of the Top 5 Server Vendors, #2 in Blade
servers based on Worldwide Revenue Share1
73 World Record Performance Benchmarks to date
Source: 1 IDC Worldwide Quarterly Server Tracker, Q1 2013, May 2013, Revenue Share
©
2013 Cisco Systems, Inc. All rights reserved
5
Performance Optimized for Bare Metal, Virtualized, and Cloud Applications
Cisco UCS: Many Server Form Factors, One System
Blade
Rack
Scale Out
©
Industry-Leading Compute Without Compromise
Enterprise
Intensive / Mission Critical
Performance
UCS C240 M3
UCS C24 M3
Entry, Expandable Rack
Server for Storage
Intensive Workloads
Ideal Platform for Big Data,
ERP, and Database
Applications
UCS C22 M3
UCS C220 M3
Entry Rack Server for
Distributed and Web
Infrastructure Applications
Versatile, General Purpose
Enterprise Infrastructure, and
Application Server
UCS B22 M3
UCS B200 M3
Entry Blade Server for IT
Infrastructure and Web
Applications
Optimal Choice for VDI,
Private Cloud, or Dense
Virtualization/
Consolidation Workloads
2013 Cisco Systems, Inc. All rights reserved
UCS C420 M3
Enterprise Class, 4-Socket
Server for Large, MemoryIntensive Bare Metal, and
Virtualized Applications
UCS C460 M2
UCS C260 M2
Mission-Critical, 4-Socket
Server for Large, CPUIntensive Applications
Mission-Critical, 2-Socket
Extended Memory Server for
Large, Memory-Intensive
Applications
UCS B440 M2
UCS B420 M3
Mission-Critical, 4-Socket
Enterprise Class, 4-Socket
Blade for Large, CPUBlade for Large, MemoryIntensive Bare Metal
Intensive Bare Metal
UCS B230 M2
and Virtualized Applications
and Virtualized Applications
Density-optimized CPU and
Memory-Intensive 2-Socket
Blade for Bare Metal and
Virtualized Applications
6
Storage-intensive
2 Control/Storage Nodes
UCS C240-M3s
nova-api
keystone-api
glance-api
cinder-api
horizon-UI
Network Node
quantum-api
CEPH
MON/MDS/RAD
OS
©
2013 Cisco Systems, Inc. All rights reserved
6 Compute/Storage Nodes
UCS C240-M3s
nova-api
quantum-api
cinder-api
KVM Hypervisor
CEPH Deploy
CEPH Object
Storage Devices
7
Blade and Rack Servers Managed a Cohesive Resource Pool
UCS Manager
UNIFIED MANAGEMENT
A SINGLE UNIFIED SYSTEM FOR
BLADE AND RACK SERVERS
ServiceService
Profile: HR_App1
UCS
Profile
C-Series Rack
Optimized Servers
A Major Market
Transformation in Unified
Server Management
©
2013 Cisco Systems, Inc. All rights reserved
VNIC1
Unified Device Management
MAC: 08:00:69:02:01:2E
HR_WEB_VLAN (ID=50)
Network Policy
VNIC2
MAC: 08:00:69:02:01:2F
HR_DB_VLAN (ID=210)
Policy
HBAStorage
1 and 2
WWN: 5080020000075740
WWN: 5080020000075741
Server
VSAN
ID: 12 Policy
Boot Order: SAN
BIOS Settings:
Turbo On
HyperThreading On
Benefits of UCS Manager and
Service Profiles for Both Blade
and Rack-Optimized Servers
B-Series
Blade Servers
Add Capacity
Without Complexity
8
©
2013 Cisco Systems, Inc. All rights reserved
9
Cisco Unified Fabric
Continuous Market Leadership
DC TECHNOLOGY LEADER
40,000+
11M+
Cisco NX-OS
Customers
10GE Ports
Shipped
Cisco FabricPath
Customers
Cisco FEX
Customers
1,500+
11,000+
DATA CENTER SWITCHING LEADER
#
Market share by revenue
in Q3 2012 for DC Ethernet
Switching at 71.7%*
1
#
Market share by revenue
in Q3 2012 for FCoE SAN
Switching at 87.3%**
1
*Source: Infonetics, Q3 2012 DC Network Equipment Report, December 2012 **Source: Dell’Oro, SAN Switching, November 2012
Data
current
of December
Cisco Confidential
© 2011 Cisco
and/or itsas
affiliates.
All rights reserved. 2012. Subject to change without notice.
10
LAN
LAN/SAN
Cisco
Cisco
Cisco
Nexus
5000
Nexus 3000 Nexus 4000
Cisco Nexus ® 1010
Cisco
Cisco
Nexus 7000
Nexus 6000
Cisco
Nexus 2000
Cisco Nexus 1000V
CISCO NX-OS: From Hypervisor to Core CISCO DCNM: Single Pane of Management
DELIVERING TO YOUR DATA CENTER NEEDS
Resilient, High
Performance,
Scalable Fabric
© 2011 Cisco and/or its affiliates. All rights reserved.
Workload
Mobility Within/
Across DCs
Secure
Separation/
Multitenancy
LAN+SAN
Convergence
Operational Efficiency
Cisco Confidential
11
©
http://docwiki.cisco.com/wiki/OpenStack:Grizzly-Nexus-Plugin
2013 Cisco Systems, Inc. All rights reserved
12
• Automated VLAN Provisioning
Configure VLANs on the Nexus switch
• Layer 3 Gateway
Map Nexus Switch Virtual Interface (SVI) to tenant VLAN
Scalability with Top of Rack (ToR) Nexus as default Layer 3 Gateway
• Multi-Homed Host Deployments
Virtual Port Channel (vPC) for High Availability (HA) to multiple Nexus switches
• Hardware and Software-based Networking
Performance benefits of hardware-based ToR switch (Nexus 3000, 5000, 6000, 7000)
Flexibility of software-defined Networking with Nexus 1000V
©
2013 Cisco Systems, Inc. All rights reserved
13
Management Network
nova-compute
nova-compute
nova-compute
nova-compute
*-plugin-agent
*-plugin-agent
*-plugin-agent
*-plugin-agent
dhcp-agent
• Flat Networking Traffic
• VLAN Traffic across Nodes
• GRE or VXLAN tunnels across Nodes
*-plugin-agent
Network Node
Compute
Node
L2B/OVS
Compute
Node
Compute Node
Compute Node
Data Network
• Removes bottleneck of generic
server-based network node
with Linux IP tables
©
2013 Cisco Systems, Inc. All rights reserved
nova-scheduler
neutron-server
keystone
L2B/OVS
L2B/OVS
• SVI configured on Nexus for L3
forwarding and external
Gateway
nova-api
mysql, rabbit...
Nexus PI
Cloud Controller
Node
API Network
External Network
Internet
API Network is
typically routable to
enable public access
14
•
Foundation of Virtual Services Architecture
• vPath Service Insertion/Chaining
• VXLAN Overlay Networking
Management Network
dhcp-agent
dhcp-agent
dhcp-agent
*-plugin-agent
*-plugin-agent
*-plugin-agent
l3-agent
l3-agent
l3-agent
nova-compute
nova-compute
nova-compute
nova-compute
*-plugin-agent
*-plugin-agent
*-plugin-agent
*-plugin-agent
VSM/N1000V
Network
NetworkNode
Node
Network Node
Compute
Node
N1000V
Compute
Node
Compute Node
Compute Node
nova-api
nova-scheduler
neutron-server
keystone
Data Network
mysql, rabbit...
Cloud Controller
Node
API Network
External Network
Internet
©
2013 Cisco Systems, Inc. All rights reserved
API Network is
typically routable to
enable public access
15
Management Network
Network or Compute node(s) hosts CSR
nova-compute
nova-compute
nova-compute
nova-compute
*-plugin-agent
*-plugin-agent
*-plugin-agent
*-plugin-agent
dhcp-agent
CSR Provides per tenant
isolation and full IOS
capabilities including VPN,
BGP, OSFP, MPLS, etc.
*-plugin-agent
nova-api
nova-scheduler
quantum-server
keystone
CSR 1000V
VSM/N1000V
Network Node
Compute
Node
N1000V
Compute
Node
Compute Node
Compute Node
Data Network
mysql, rabbit...
Cloud Controller
Node
API Network
External Network
Internet
©
2013 Cisco Systems, Inc. All rights reserved
API Network is
typically routable to
enable public access
16
©
2013 Cisco Systems, Inc. All rights reserved
17
To run the install script, copy and paste the following on your command line (as root with your proxy set if necessary as above):
curl -s -k -B https://raw.github.com/CiscoSystems/grizzly-manifests/multi-node/install_os_puppet | /bin/bash
With a proxy, use:
https_proxy=http://proxy.example.com:80/ curl -s -k -B https://raw.github.com/CiscoSystems/grizzly-manifests/multinode/install_os_puppet > install_os_puppet
chmod +x install_os_puppet
./install_os_puppet -p http://proxy.example.com:80/
The Cisco OpenStack High-Availability Guide differs from the OpenStack High Availability Guide by
providing an active/active, highly scalable model for OpenStack deployments. The architecture
consists of the following components used to provide high-availability to OpenStack services
Galera Cluster for MySQL ,RabbitMQ Clustering, RabbitMQ Mirrored Queues, HAProxy,
Keepalived
http://docwiki.cisco.com/wiki/COE_Grizzly_Release:_High-Availability_Manual_Installation_Guide
©
2013 Cisco Systems, Inc. All rights reserved
19
Cisco offers a complete scale-out OpenStack Compute, Networking and Storage solution with UCS & Nexus
Please let us know how we can help you scale OpenStack by contacting us at Openstack-support@cisco.com
More information can be found at www.cisco.com/go/OpenStack
