VMware and Cinder Alex Jauch, Product Line Manager (@ajauch) Kartik Bommepally, MTS (Cinder Driver Team) Confidential © 2011 VMware Inc. All rights reserved OpenStack on VMware 2 Confidential – Not for External Distribution VMware Vision: Software Defined Storage Software-Defined Storage Vision “Bronze” SLA Reduce Storage Cost and Complexity Availability = Availability = 99% Throughput =99.99% 100 R/s,10 W/s Latency = 90% under 10 ms DR= 60’, RTO 1 hour DR RPO RTO= = 360’ Back up = weekly Security = Max encryption Laten “Gold” SLA Availability = 99.99% Availability = 99% DR= RTO = 1 20 W/s Throughput 1000 R/s, Latency = 95% under 5 ms DR RPO = 1’, RTO = 10’ Back up = hourly Capacity res = 100% Web Server Database Server Software Defined Storage “Silver” Array(s) Deliver policy-based automated storage management Automatically enforce per-VM SLAs for all apps across different types of storage Distributed Storage SSD Hard disks 3 Enable tight integration with storage ecosystem Tighter integrations with broad storage ecosystem through APIs App Server “Gold” Array(s) Enable new storage tiers Enable DAS & server flash for shared storage along with enterprise SAN/NAS SSD Hard disks Confidential – Not for External Distribution Virtual SAN (VSAN) What is Virtual SAN? Key Features Converged compute + storage solution vCenter Server Utilizes DAS and server attached disks Auto-tiering between SSD and HDD Intelligent policy driven data placement across the cluster vSphere vCenter-integrated, instant storage provisioning Virtual SAN ……………. Customer Benefits SSD Hard disks SSD Hard disks SSD Hard disks Distributed Storage Aggregated Datastore Clusters internal server disks to provide scalable shared storage with cloud agility and efficiency. 4 High performance storage at up to 50% lower cost Radically Simple Storage – configure and manage without complex workflows Designed for dynamic scalability and high resiliency Confidential – Not for External Distribution Virtual Volumes What are Virtual Volumes? Current Paradigm VMDKs on LUNs Key Features Existing SAN/NAS systems become VM-aware Native representation of VMDKs on SAN/NAS vSphere New API for data operations at VMDK granularity LUNs replicated Virtual Volumes Customer Benefits vSphere VMDKs on storage systems VMDK replicated Broad partner ecosystem 5 Native representation of VMDKs on storage Snapshots, replications and other operations at VM granularity on external storage Works with existing SAN/NAS storage systems VM level storage SLA enforcement Confidential – Not for External Distribution Storage Policy Based Management (SPBM) Key Features What is Policy-based Management? SLA Definitions Availability = 99.99% Availability = 99.99% DR RTO = 1 hour Back up = daily Storage capacity = 1 TB Performance = High I/O Security = High DR RTO = 1 hour Max Laten SLA Definitions Availability = 99.99% Availability = 99% DR RTO = 4 hour Back up = weekly Storage capacity = 10 TB Performance = High I/O Security = High DR RTO = 1 hour Max Laten • Simple policies to specify app SLA requirements • Automation of storage provisioning and VM placement across clusters • Works for any protocol : block, file and object • SLA Compliance monitoring & automatic remediation Customer Benefits Software Defined Storage Virtual SAN BLOB Storage • Drastically simplify storage provisioning • Management of different storage tiers as one • Reduce storage cost by optimizing consumption Enterprise SAN/ NAS 6 Confidential – Not for External Distribution The Basics: Storage Abstraction in vSphere The Datastore is the fundamental persistence abstraction. The VMDK is the Disk abstraction Storage Policy Based Management (SPBM) is the Control Plane VMware is Moving Away from LUN based policy and towards VMDK based policy • For Local Storage, this is done via VSAN • For Shared Storage, this is done via VVOL VMware is Moving Away from Raw Device Map (RDM) Disks Thus, a VMDK Driver for Cinder 7 Confidential – Not for External Distribution Cinder VMDK Driver Work Flow As with Nova, vSphere Admin Sets Up Capacity Pools • For Storage this Means Datastores in Havana • For Icehouse, this will include SPBM Cloud Admin Creates Cinder Volume Types • Volume Type is our MetaData Injection Vehicle Consumer Creates New Cinder Volume • This Allows us to create meta data Consumer Attaches Cinder Volume • We Lazy Create the VMDK Based on VM Target • VMDK Is Mounted By vSphere Against Target 8 Confidential – Not for External Distribution Volume types and extra specs Driver allows additional configuration for volume creation via extra specs in the volume type VMDK type • Use extra spec key ‘vmware:vmdk_type’ • Legal Values: ‘thin’, ‘thick’ and ‘eagerZeroedThick’ • Default type is ‘thin’ Clone type • Use extra spec key ‘vmware:clone_type’ • Legal Values: ‘full’ and ‘linked’ • Default type is ‘full’ 9 Confidential – Not for External Distribution What the Heck is a “Shadow” VM? 10 In vSphere There is No “First Class Disk” Object. Yet. When You Create a VMDK It Must be the Child of a VM However, Cinder Assumes a First Class Disk Therefore, A “Shadow” VM is inserted <<<KARTIK, INSERT SCREEN SHOT HERE OF SHADOW VM>>> Confidential – Not for External Distribution DEMO VMware VMDK Driver for Cinder 11 Confidential – Not for External Distribution Current API Support Create volume • Supported VMDK types – thin, thick, eagerZeroedThick • From scratch • From glance image • From an available source volume – full clone and linked clone • From a snapshot – full clone and linked clone 12 Attach volume to an instance Detach volume from an instance Snapshot an available volume Delete snapshot of an available volume Upload an available volume as glance image Delete volume Confidential – Not for External Distribution Committed Roadmap 13 Support for Storage Policy Based Management (SPBM) Fix for SnapShot/Clone Issues with Attached Volumes Move Core Storage Code into Oslo Implement Remaining API Items Incorporate Additional Icehouse APIs Nova Support for SPBM Confidential – Not for External Distribution Thoughts Beyond Icehouse Common Meta Data Model Between Cinder and Nova Support For Application Consistent Snapshots DR/HA Considerations in Cinder • How Do we Abstract Availability Zones? Storage QOS • How Do We Represent Performance Contracts? Inter DC Data Mobility Services Alerting/Policy Violation Support, Ceilometer? Others? 14 Confidential – Not for External Distribution Learn More! http://vmware.com/go/openstack Day Time Room Title User Panel: How did you bring OpenStack Cloud to your company Speaker Tuesday 2:50 PM Sky City Marriott Grand Ballroom C Panel Tuesday 3:40 PM Expo Breakout Room 1 Bridging the Gap: Explaining OpenStack to Scott Lowe VMware Administrators Wednesday 11:15 AM Expo Breakout Room 1 OpenStack + VMware: Customer Success Stories & What’s Next Dan Wendlandt Wednesday 5:30 PM Expo Breakout Room 1 Network Virtualization with OpenStack Neutron & VMware NSX Somik Behera Dimitri Desmidt Thursday 9:50 AM Sky City Marriott Meeting Room 4 Differentiated Services == Differentiated Scheduling Gary Kotton Thursday 2:40 PM Sky City Marriott Grand Ballroom C Open vSwitch Deep Dive: The Virtual Switch for OpenStack Eric Lopez Justin Pettit Thursday 3:30 PM Sky City Marriott Meeting Room 4 Bridging the Gap: Cinder and vSphere Alex Jauch Kartik Bommepally Thursday 5:20 PM Sky City Marriott Grand Ballroom C How to Write a Neutron Plugin, If You Really Need To Salvatore Armando Friday 11:00 AM Sky City Marriott Grand Ballroom A&B Hands-on with OpenStack + vSphere Gary Kotton Friday 1:30 PM Sky City Marriott Grand Ballroom A&B OpenStack Networking Hands-on Lab Eric Lopez Aaron Rosen 15 Confidential – Not for External Distribution Demo VMware vSphere on OpenStack by Scott Lowe Location: Sponsor Demo Theatre Date: Wed @ 2 PM General Session Navigating the Transition to Network Virtualization With Martin Casado Location: Asia World – Summit Hall 2 Date: Tues @ 12:05 PM Thank You! 16 Confidential – Not for External Distribution