EMC INFRASTRUCTURE FOR VMWARE CLOUD ENVIRONMENTS EMC Symmetrix VMAX 40K, EMC Symmetrix FAST VP, EMC SRDF, and VMware vSphere 5 EMC Solutions Group © Copyright 2012 EMC Corporation. All rights reserved. 1 Agenda Solution & Technology Overview Configuration Details Deploying Storage on VMAX 40K with Unisphere for VMAX Virtualization and Application Profiles Validation and Testing Summary and Solution Benefits © Copyright 2012 EMC Corporation. All rights reserved. 2 Solution and Technology Overview © Copyright 2012 EMC Corporation. All rights reserved. 3 Business Case Support for all of your missioncritical applications and databases Assure performance at production and remote sites with FAST VP and FAST VP coordination with SRDF Reduce time to manage storage resources with Unisphere for VMAX Increase your ROI—Maximize use of Tier 1, 2, and 3 storage assets with federated tiered storage © Copyright 2012 EMC Corporation. All rights reserved. 4 Introducing Symmetrix VMAX 40K New Bigger, better, faster – 2X performance and 2X capacity New 2.5” SAS drive support – 400 drives in standard 24” cabinet System Bay Dispersion – Flexible expansion for spaceconstrained data centers © Copyright 2012 EMC Corporation. All rights reserved. 5 Powerful Scale and Consolidation Engine 1 Massive scale-out VIRTUAL MATRIX New Up to 8 Engines Transform your hybrid cloud environments © Copyright 2012 EMC Corporation. All rights reserved. 6 Solution Overview Deploy multiple critical database applications on a VMware private cloud enabled by a VMAX 40K array running Enginuity 5876 Code and optimized by FAST VP with site protection enabled by EMC SRDF replication Simulate a highly active customer database environment, serving Tier-1 Applications Online Transactional Databases • Oracle Database 11g R2 • SAP ERP 6.0 EHP 4 • Microsoft SQL Server 2012 Data Warehouse • Microsoft SQL Server 2012 © Copyright 2012 EMC Corporation. All rights reserved. 7 Solution Overview, continued Managed, monitored, and optimized through EMC Unisphere for VMAX – Simplified array management of FAST VP using “Allocation by Policy” feature of FAST VP – Assured performance in DR scenarios enabled by SRDFaware FAST VP (Enginuity 5876) with constant, automated tuning of application storage at both production and disaster recovery sites Virtualized with VMware vSphere 5 update 1 © Copyright 2012 EMC Corporation. All rights reserved. 8 Solution Architecture and Design Two ESXi servers configured at each site Oracle, SAP, and SQL Server deployed on VMs EMC VMAX 40K storage arrays optimized by FAST VP protected by SRDF/S 8 GBs FC SAN running between hosts and sites 1 GB Ethernet network connection between hosts and sites © Copyright 2012 EMC Corporation. All rights reserved. 9 Solution Hardware Component Quantity Configuration Storage array 2 EMC Symmetrix VMAX 40K, with: • 3 Engines • 384 GB Cache • 32 x 200 GB Flash drives • 126 x 600 GB 10K FC drives • 64 x 450 GB 15K FC drives • 72 x 2TB 7.2 K SATA drives VMware ESXi servers (Production virtual environment) 2 ESXi Server with: • 8 x Ten-core Intel Xeon E7 CPU @2.4 GHz • 1 TB RAM • 2 x dual Port Brocade 825 8 GB FC HBA VMware ESXi servers (Disaster recovery virtual environment) 2 ESXi Server with: • 4 x Ten-core CPU Intel Xeon E7CPU @2.4GHz • 128 GB RAM • Dual 1 Gb NICs • Dual 10 Gb CNAs FC switches 2 Brocade DCX 4S 8GB FC Director Class switch Ethernet switches 2 1 Gb/s Ethernet switches © Copyright 2012 EMC Corporation. All rights reserved. 10 Solution Software Software Version EMC Symmetrix VMAX Enginuity code 5876 EMC PowerPath PowerPath/VE V5.7 for VMware EMC Unisphere for VMAX 1.0 EMC Solutions Enabler 7.4 VMware vSphere ESXi 5 Update 1 Applications SAP ERP 6 EHP 4 Oracle ASM Lib 2.0.5 Oracle Database 11gR2 11.2.0.3 SQL Server 2012 RTM Operating systems Windows Server 2008 R2 SuSE Enterprise Linux 11 Red Hat Linux 5.7 Workload simulation test tools SQL Server 2012: MSTPCE (OLTP) toolkit and Quest BMF (DSS/DW) Oracle: SwingBench 2.3 HP LoadRunner 9.52 Build 3188 © Copyright 2012 EMC Corporation. All rights reserved. 11 Key Technology Components EMC components: – – – – – – Symmetrix VMAX 40K with Enginuity 5876 Unisphere for VMAX Symmetrix Remote Data Facility (SRDF) Symmetrix FAST VP with SRDF coordination PowerPath/VE VMware Storage Integrator(VSI) Applications – Oracle Database 11g R2 Enterprise Edition – Microsoft SQL Server 2012 – SAP ERP 6.0 EHP 4 © Copyright 2012 EMC Corporation. All rights reserved. 12 Symmetrix VMAX 40K Array with Enginuity 5876 Operating Environment High-end enterprise storage array with simple, intelligent, modular design that allows system to grow seamlessly and cost-effectively from entry-level configuration to world’s largest storage array New dense configuration options with 2.5” Flash, FC, SAS drives – – Up to 33% more drives in the same footprint More performance per Watt Virtual provisioning provides non-disruptive, on-demand thin provisioning FLASH FC SATA FAST VP provides automatic storage tiering at the sub-LUN level FAST VP SRDF coordination ensures performance at disaster recovery sites Federated tiered storage, maximizing your ROI on Tier 1, 2, and 3 storage Capacity efficient snapshot capabilities with TimeFinder VP SNAP Simplified configuration and management with Unisphere for VMAX © Copyright 2012 EMC Corporation. All rights reserved. 13 EMC Virtual Provisioning Overview Improves storage utilization Reduces storage provisioning complexity and overhead Automates processes to easily grow storage ESXi 1 10 TB ESXi 2 10 TB ESXi 3 10 TB 4 TB 3 TB 3 TB Physical allocation Overprovision storage to last lifetime of application, without providing all the physical storage up front Add capacity non-disruptively and on demand Automatically rebalance thin pools to maintain performance Common Storage Pool Simplifies storage management with Unisphere for VMAX © Copyright 2012 EMC Corporation. All rights reserved. 14 EMC Symmetrix FAST VP – Overview Automatic storage tiering for Virtual Provisioning thin pools Flash FC SATA • Radically simplifies storage management • Optimizes performance • Increases storage efficiency Analysis and data movement at sub-LUN level: – Spreads data from a single thin device across multiple pools – Places very active parts of a LUN on highperforming Flash Drives – Places less active parts of a LUN on highercapacity, more cost-effective FC or SATA drives Moves data at the extent group level (7,680 KB) Moves data based on user-defined policies and application performance needs Data movement is automatic and nondisruptive Symmetrix VMAX with FAST VP – Getting the right data, to the right place, at the right time © Copyright 2012 EMC Corporation. All rights reserved. 15 Symmetrix FAST VP – Components Storage tier: A set of one or more virtual pools containing devices with the same technology type, drive speed and RAID protection level. Storage group: A logical grouping of storage devices for common management. FAST policies: A set of tier usage rules that is applied to associated storage groups. A policy assigns an upper usage limit for each tier, specifying how much data from a storage group can reside on each tier. © Copyright 2012 EMC Corporation. All rights reserved. Administrators can set: • High-performance policies that use more Flash drive capacity for critical applications • Cost-optimized policies that use more SATA drive capacity for less-critical applications 16 FAST VP SRDF Coordination FAST VP continually monitors and adjusts data placement at production site Performance stats captured at both sites and exchanged every hour Decisions on data placement made on both sites using data from the active site Symmetrix VMAX with FAST VP and SRDF Co-Ordination– Getting the right data, to the right place, at the right time at both Production and DR Sites © Copyright 2012 EMC Corporation. All rights reserved. 17 Configuration Details © Copyright 2012 EMC Corporation. All rights reserved. 18 Storage Configuration-Virtual Pools Drive Size/ Thin Pool Name Technology /RPM RAID Protection Number of Number TDAT Size DATA Device of Drives (TDAT) Pool Capacity FLASH_3RAID5 200GB Flash RAID5 (3+1) 32 68.8 GB 64 4.2TB FC10K_RAID1 600GB FC 10K RAID1 126 66 GB 504 32TB FC15K_RAID1 450GB FC 15K RAID1 64 49.2 GB 256 12.2TB SATA_6RAID6 2TB SATA 7.2K RAID6 (6+2) 72 240GB 256 60TB © Copyright 2012 EMC Corporation. All rights reserved. 19 Virtual Pool Use by Application SAP, Oracle, and MS SQL OLTP share common Flash, FC, and SATA pools MS SQL DSS application shares a common SATA pool with all applications but is bound to a separate FC pool © Copyright 2012 EMC Corporation. All rights reserved. 20 Front End Port Usage Isolate write intensive applications to dedicated front end ports to ensure consistent performance Common traffic on common ports PowerPath/VE managing load balancing and failover © Copyright 2012 EMC Corporation. All rights reserved. 21 Configuring FAST VP FAST VP is either enabled or disabled Data Movement should be set to automatic Relocation Rate controls aggressiveness of FAST New Feature Allocateby-Policy simplifies capacity management of thin Provisioned environments © Copyright 2012 EMC Corporation. All rights reserved. Time windows Create time windows to specify when data can be collected for performance analysis and when data movements can be executed. Recommend to have windows always open so FAST VP can use most recent analysis to optimize data placement. 22 Configuring FAST VP 1. Create FAST VP Tiers from VP pools 2. Define policies, by specifying percentage of Flash, FC, SATA 3. Apply to application © Copyright 2012 EMC Corporation. All rights reserved. 23 Tiers Demand Reports Capacity management is simplified How much storage is currently used Maximum Demand from FAST VP SG per tier Excess GB shows how much space is left in each tier • Use Tier Demand reports from Unisphere to monitor tier usage and demand © Copyright 2012 EMC Corporation. All rights reserved. 24 Deploying Storage on VMAX 40K Using Unisphere for VMAX © Copyright 2012 EMC Corporation. All rights reserved. 25 Simplified Storage Provisioning with Unisphere for VMAX • Unisphere’s common tasks wizards guides new users through the process of provisioning storage to hosts. • Prompts guide the user to next steps, resulting in an intuitive flow and learning process. © Copyright 2012 EMC Corporation. All rights reserved. 26 Cascaded Storage Groups New feature with 5876 providing the ability to nest multiple storage groups in a single masking view Simplifies FAST VP configurations in virtual environments Multiple application within a single masking view managed with its own storage group and FAST policy Simplified monitoring and management at application level made easier © Copyright 2012 EMC Corporation. All rights reserved. 27 Enable FAST VP Coordination on Storage Groups With this feature enabled, FAST VP sends device usage statistics from R1 to R2 to ensure that the FAST engine at the standby/failover site has up-to-date metrics on which to base decisions. Enabled under storage group management in Unisphere: – Check Box: Enable FAST VP RDF Coordination Coordination must to be enabled on storage groups at both source and target VMAX © Copyright 2012 EMC Corporation. All rights reserved. 28 Virtualization and Application Profiles © Copyright 2012 EMC Corporation. All rights reserved. 29 VMware Configuration Reduce HBA queuing for vSphere ESXi servers by changing the queue depth – esxcli system module parameters set -p bfa_lun_queue_depth=64 -m bfa Virtual Machine boot LUNs configured to use LSI SAS adapter VMware Paravirtual SCSI (PVSCSI) adapters are used to configure DATA LUNs for high performance vCenter screenshots © Copyright 2012 EMC Corporation. All rights reserved. 30 EMC Virtual Storage Integrator and VMAX 40K © Copyright 2012 EMC Corporation. All rights reserved. 31 Application Configuration Oracle OLTP MSSQL OLTP (TPC-E Like) 1 Oracle DB instance, 12 vCPUs with 53 GB RAM 2 SQL instances, 16 vCPUs with 32 GB RAM 1 DB per VM, 2 TB capacity 1 DB per VM, 1 TB capacity SwingBench entry workload on 400 users, 60:40 R/W ratio Mixed workloads to simulate hot, warm applications, 85:15 R/W ratio SAP OLTP MSSQL OLAP (DSS, TPC-H Like) 3 SAP ERP 6 IDES EHP 4 instances, 16 vCPUs with 32 GB RAM 1 SQL instance, 32 vCPUs with 128 GB RAM 1 Oracle DB instance at 845 GB capacity 1 DB per VM, 2 TB capacity 1000 LoadRunner Update users + local client copy simulation, 80:20 R/W ratio 2 concurrent loads, 100% Read © Copyright 2012 EMC Corporation. All rights reserved. 32 Validation and Testing • • • • Application Performance Validation Online Policy Tuning SRDF Coordination Application Failover with Rapid Ramp-Up © Copyright 2012 EMC Corporation. All rights reserved. 33 Application Performance Summary Four mission-critical, high-transaction applications running mixed workloads operating in a VMware vSphere 5.0 private cloud deployed on VMAX 40K – – – – SAP OLTP 2 x SQL Server OLTP Instances 1 x SQL Server Data Warehouse Instance Oracle OLTP © Copyright 2012 EMC Corporation. All rights reserved. 34 FAST VP Policies The table below details the FAST VP Policies set for our baseline configuration: Storage group FAST policy name Flash FC SATA MSSQL1_OLTP MSSQL_OLTP 5% 40% 100% MSSQL2_OLTP MSSQL_OLTP 5% 40% 100% MSSQL_DSS MSSQL_DSS 0% 100% 100% Oracle Oracle 15% 35% 50% SAP SAP 10% 80% 10% Both MSSQL1 and MSSQL2 applications share the same FAST policy Policies restrict Flash tier to prevent any single application from dominating Flash resources © Copyright 2012 EMC Corporation. All rights reserved. 35 Build Validation—All Applications Running OLTP Application Server Transactions Per Minute DSS/OLAP Application Average Read Response Time Average Throughput MSSQL DSS Oracle 97,846 5.5 ms MSSQL1 37,920 10 ms MSSQL 2 139,020 11 ms © Copyright 2012 EMC Corporation. All rights reserved. 808 MB/s Application SAP Server Transactions Per Minute Average Dialogue Response time 2894.8 929.93 ms 36 Validating FAST VP SRDF Coordination SRDF coordination – Balance at Source and target – Similar tier usage at both sites Solid lines are source devices Dotted lines are target devices © Copyright 2012 EMC Corporation. All rights reserved. 37 SRDF Coordination, continued [root@solenabler1 ~]# symcfg list -tdev -range 426:426 -bound -detail -v -sid 542 Symmetrix ID: 000195700542 Source Array Enabled Capacity (Tracks) : 1826068704 Bound Capacity (Tracks) : 1048590 SYMMETRIX THIN DEVICES ---------------------------------------------------------------------Pool Pool Total Bound Flags Total Subs Allocated Written Sym Pool Name ESPT Tracks (%) Tracks (%) Tracks (%) ---- ------------ ----- ---------- ----- ---------- --- ---------- --0426 FC10K_RAID1 F..B 1048590 0 546156 52 1044754 100 FLASH_3RAID5 -.-312924 30 - SATA_6RAID6 -.-186540 18 - Total Tracks ---------- ----- ---------- --- ---------- --1048590 0 1045620 0 1044754 0 [root@solenabler1 ~]# symcfg list -tdev -range 426:426 -bound -detail -v -sid 541 Symmetrix ID: 000195700541 Device has been balanced across all tiers in a similar distribution on both R1 and R2 Enabled Capacity (Tracks) : 1826068704 Bound Capacity (Tracks) : 1048590 Disaster Recovery Array SYMMETRIX THIN DEVICES ---------------------------------------------------------------------Pool Pool Total Bound Flags Total Subs Allocated Written Sym Pool Name ESPT Tracks (%) Tracks (%) Tracks (%) ---- ------------ ----- ---------- ----- ---------- --- ---------- --0426 FC10K_RAID1 F..B 1048590 0 570996 54 1044492 FLASH_3RAID5 -.-352524 34 SATA_6RAID6 -.-120972 12 Total Tracks © Copyright 2012 EMC Corporation. All rights reserved. 100 - - - ---------- ----- ---------- --- ---------- --1048590 0 1045620 0 1044754 00 38 Failover Test Application loads were run for extended periods at R1 site and FAST VP balanced storage groups on both arrays RDF links split to simulate failover SAP and Oracle were brought up on remote ESXi Server Performance was monitored before and after failover Oracle & SAP Running at R1 Oracle & SAP Failed over and running at R2 © Copyright 2012 EMC Corporation. All rights reserved. 39 Failover Test, continued Following failover performance at application levels were on par with production Transactions per minute and response times observed were equal © Copyright 2012 EMC Corporation. All rights reserved. 40 FAST VP Responsiveness and Flexibility At 7:40am SQL OLTP policy adjusted to add additional Flash capability After 30 minutes performance improved SQL txn/sec increased and latency dropped After 2 hours the SQL performance stabilized Zero impact observed by other running applications © Copyright 2012 EMC Corporation. All rights reserved. 41 Summary and Solution Benefits VMAX 40K provides an ideal platform for virtualized critical database applications, running varied workloads. End-to-end visibility with VMware Storage Integrator from EMC enables simplified management and identification of VMAX devices direct from vCenter FAST VP Cascaded storage groups enable simplified management of ESX environments with FAST. Allocate by policy reduces time to balance FAST VP storage groups and the amount of data FAST VP needs to move. FAST VP is tunable and responsive. By adjusting FAST policies, performance can be tuned to meet changing business performance needs. Increased performance within 30 minutes with no negative impact to other running workloads. SRDF coordination with FAST VP ensures production level performance at the R2 site in FAST VP environment in the event of a failover when configurations are similar. This delivers the performance and cost benefits of FAST VP at both production and disaster recovery sites. © Copyright 2012 EMC Corporation. All rights reserved. 42 Questions? © Copyright 2012 EMC Corporation. All rights reserved. 43