EMC INFRASTRUCTURE
FOR VMWARE CLOUD
ENVIRONMENTS
EMC Symmetrix VMAX 40K,
EMC Symmetrix FAST VP, EMC SRDF,
and VMware vSphere 5
EMC Solutions Group
© Copyright 2012 EMC Corporation. All rights reserved.
1
Agenda
 Solution & Technology Overview
 Configuration Details
 Deploying Storage on VMAX 40K with
Unisphere for VMAX
 Virtualization and Application Profiles
 Validation and Testing
 Summary and Solution Benefits
© Copyright 2012 EMC Corporation. All rights reserved.
2
Solution and
Technology Overview
© Copyright 2012 EMC Corporation. All rights reserved.
3
Business Case
 Support for all of your missioncritical applications and databases
 Assure performance at production
and remote sites with FAST VP and
FAST VP coordination with SRDF
 Reduce time to manage storage
resources with Unisphere for VMAX
 Increase your ROI—Maximize use
of Tier 1, 2, and 3 storage assets
with federated tiered storage
© Copyright 2012 EMC Corporation. All rights reserved.
4
Introducing Symmetrix VMAX 40K
New
 Bigger, better, faster
– 2X performance and 2X capacity
 New 2.5” SAS drive support
– 400 drives in standard 24”
cabinet
 System Bay Dispersion
– Flexible expansion for spaceconstrained data centers
© Copyright 2012 EMC Corporation. All rights reserved.
5
Powerful Scale and Consolidation
Engine 1
Massive
scale-out
VIRTUAL
MATRIX
New
Up to
8 Engines
Transform your
hybrid cloud
environments
© Copyright 2012 EMC Corporation. All rights reserved.
6
Solution Overview
 Deploy multiple critical database applications on a
VMware private cloud enabled by a VMAX 40K array
running Enginuity 5876 Code and optimized by FAST
VP with site protection enabled by EMC SRDF
replication
 Simulate a highly active customer database
environment, serving Tier-1 Applications
Online
Transactional
Databases
• Oracle Database 11g R2
• SAP ERP 6.0 EHP 4
• Microsoft SQL Server 2012
Data Warehouse
• Microsoft SQL Server 2012
© Copyright 2012 EMC Corporation. All rights reserved.
7
Solution Overview, continued
 Managed, monitored, and optimized through
EMC Unisphere for VMAX
– Simplified array management of FAST VP using “Allocation
by Policy” feature of FAST VP
– Assured performance in DR scenarios enabled by SRDFaware FAST VP (Enginuity 5876) with constant, automated
tuning of application storage at both production and
disaster recovery sites
 Virtualized with VMware vSphere 5 update 1
© Copyright 2012 EMC Corporation. All rights reserved.
8
Solution Architecture and Design
 Two ESXi servers
configured at each site
 Oracle, SAP, and SQL
Server deployed on VMs
 EMC VMAX 40K storage
arrays optimized by
FAST VP protected by
SRDF/S
 8 GBs FC SAN running
between hosts and sites
 1 GB Ethernet network
connection between hosts
and sites
© Copyright 2012 EMC Corporation. All rights reserved.
9
Solution Hardware
Component
Quantity
Configuration
Storage array
2
EMC Symmetrix VMAX 40K, with:
• 3 Engines
• 384 GB Cache
• 32 x 200 GB Flash drives
• 126 x 600 GB 10K FC drives
• 64 x 450 GB 15K FC drives
• 72 x 2TB 7.2 K SATA drives
VMware ESXi servers
(Production virtual
environment)
2
ESXi Server with:
• 8 x Ten-core Intel Xeon E7 CPU @2.4 GHz
• 1 TB RAM
• 2 x dual Port Brocade 825 8 GB FC HBA
VMware ESXi servers
(Disaster recovery virtual
environment)
2
ESXi Server with:
• 4 x Ten-core CPU Intel Xeon E7CPU @2.4GHz
• 128 GB RAM
• Dual 1 Gb NICs
• Dual 10 Gb CNAs
FC switches
2
Brocade DCX 4S 8GB FC Director Class switch
Ethernet switches
2
1 Gb/s Ethernet switches
© Copyright 2012 EMC Corporation. All rights reserved.
10
Solution Software
Software
Version
EMC Symmetrix VMAX Enginuity code
5876
EMC PowerPath
PowerPath/VE V5.7 for VMware
EMC Unisphere for VMAX
1.0
EMC Solutions Enabler
7.4
VMware vSphere
ESXi 5 Update 1
Applications
SAP ERP 6 EHP 4
Oracle ASM Lib 2.0.5
Oracle Database 11gR2 11.2.0.3
SQL Server 2012 RTM
Operating systems
Windows Server 2008 R2
SuSE Enterprise Linux 11
Red Hat Linux 5.7
Workload simulation test tools
SQL Server 2012: MSTPCE (OLTP) toolkit and Quest BMF (DSS/DW)
Oracle: SwingBench 2.3
HP LoadRunner 9.52 Build 3188
© Copyright 2012 EMC Corporation. All rights reserved.
11
Key Technology Components
 EMC components:
–
–
–
–
–
–
Symmetrix VMAX 40K with Enginuity 5876
Unisphere for VMAX
Symmetrix Remote Data Facility (SRDF)
Symmetrix FAST VP with SRDF coordination
PowerPath/VE
VMware Storage Integrator(VSI)
 Applications
– Oracle Database 11g R2 Enterprise Edition
– Microsoft SQL Server 2012
– SAP ERP 6.0 EHP 4
© Copyright 2012 EMC Corporation. All rights reserved.
12
Symmetrix VMAX 40K Array with
Enginuity 5876 Operating Environment
 High-end enterprise storage array with simple, intelligent, modular
design that allows system to grow seamlessly and cost-effectively from
entry-level configuration to world’s largest storage array
 New dense configuration options with 2.5” Flash, FC, SAS drives
–
–
Up to 33% more drives in the same footprint
More performance per Watt
 Virtual provisioning provides non-disruptive, on-demand thin
provisioning
FLASH
FC
SATA
 FAST VP provides automatic storage tiering at the sub-LUN level
 FAST VP SRDF coordination ensures performance at disaster recovery
sites
 Federated tiered storage, maximizing your ROI on Tier 1, 2, and 3
storage
 Capacity efficient snapshot capabilities with TimeFinder VP SNAP
 Simplified configuration and management with Unisphere for VMAX
© Copyright 2012 EMC Corporation. All rights reserved.
13
EMC Virtual Provisioning Overview
 Improves storage utilization
 Reduces storage provisioning complexity and
overhead
 Automates processes to easily grow storage
ESXi 1
10 TB
ESXi 2
10 TB
ESXi 3
10 TB
4 TB
3 TB
3 TB
Physical
allocation
 Overprovision storage to last lifetime of
application, without providing all the physical
storage up front
 Add capacity non-disruptively and on
demand
 Automatically rebalance thin pools to
maintain performance
Common
Storage Pool
 Simplifies storage management with
Unisphere for VMAX
© Copyright 2012 EMC Corporation. All rights reserved.
14
EMC Symmetrix FAST VP – Overview
 Automatic storage tiering for Virtual
Provisioning thin pools
Flash
FC
SATA
• Radically simplifies
storage management
• Optimizes performance
• Increases storage
efficiency
 Analysis and data movement at sub-LUN
level:
– Spreads data from a single thin device across
multiple pools
– Places very active parts of a LUN on highperforming Flash Drives
– Places less active parts of a LUN on highercapacity, more cost-effective FC or SATA
drives
 Moves data at the extent group level
(7,680 KB)
 Moves data based on user-defined policies
and application performance needs
 Data movement is automatic and
nondisruptive
Symmetrix VMAX with FAST VP – Getting the right data, to the right place, at the right
time
© Copyright 2012 EMC Corporation. All rights reserved.
15
Symmetrix FAST VP – Components
 Storage tier: A set of one
or more virtual pools
containing devices with the
same technology type, drive
speed and RAID protection
level.
 Storage group: A logical
grouping of storage devices
for common management.
 FAST policies: A set of tier
usage rules that is applied to
associated storage groups.
A policy assigns an upper
usage limit for each tier,
specifying how much data
from a storage group can
reside on each tier.
© Copyright 2012 EMC Corporation. All rights reserved.
Administrators can set:
• High-performance policies that use more Flash
drive capacity for critical applications
• Cost-optimized policies that use more SATA
drive capacity for less-critical applications
16
FAST VP SRDF Coordination
 FAST VP continually
monitors and adjusts data
placement at production
site
 Performance stats
captured at both sites and
exchanged every hour
 Decisions on data
placement made on both
sites using data from the
active site
Symmetrix VMAX with FAST VP and SRDF Co-Ordination–
Getting the right data, to the right place, at the right time at both Production and DR Sites
© Copyright 2012 EMC Corporation. All rights reserved.
17
Configuration Details
© Copyright 2012 EMC Corporation. All rights reserved.
18
Storage Configuration-Virtual Pools
Drive Size/
Thin Pool Name Technology
/RPM
RAID
Protection
Number of
Number
TDAT Size DATA Device
of Drives
(TDAT)
Pool
Capacity
FLASH_3RAID5
200GB Flash
RAID5 (3+1)
32
68.8 GB
64
4.2TB
FC10K_RAID1
600GB FC 10K
RAID1
126
66 GB
504
32TB
FC15K_RAID1
450GB FC 15K
RAID1
64
49.2 GB
256
12.2TB
SATA_6RAID6
2TB SATA 7.2K
RAID6 (6+2)
72
240GB
256
60TB
© Copyright 2012 EMC Corporation. All rights reserved.
19
Virtual Pool Use by Application
 SAP, Oracle, and MS SQL
OLTP share common
Flash, FC, and SATA
pools
 MS SQL DSS application
shares a common SATA
pool with all applications
but is bound to a
separate FC pool
© Copyright 2012 EMC Corporation. All rights reserved.
20
Front End Port Usage
 Isolate write intensive applications to dedicated front end ports
to ensure consistent performance
 Common traffic on
common ports
 PowerPath/VE
managing load
balancing and
failover
© Copyright 2012 EMC Corporation. All rights reserved.
21
Configuring FAST VP
 FAST VP is either enabled
or disabled
 Data Movement should
be set to automatic
 Relocation Rate controls
aggressiveness of FAST
 New Feature Allocateby-Policy simplifies
capacity management of
thin Provisioned
environments
© Copyright 2012 EMC Corporation. All rights reserved.
Time windows
Create time windows to specify when data
can be collected for performance analysis
and when data movements can be
executed.
Recommend to have windows always open
so FAST VP can use most recent analysis to
optimize data placement.
22
Configuring FAST VP
1. Create FAST VP
Tiers from VP
pools
2. Define policies,
by specifying
percentage of
Flash, FC, SATA
3. Apply to
application
© Copyright 2012 EMC Corporation. All rights reserved.
23
Tiers Demand Reports
 Capacity management is simplified
How much
storage is
currently used
Maximum Demand
from FAST VP SG
per tier
Excess GB shows
how much space
is left in each tier
• Use Tier Demand reports from Unisphere to monitor tier
usage and demand
© Copyright 2012 EMC Corporation. All rights reserved.
24
Deploying Storage
on VMAX 40K Using
Unisphere for VMAX
© Copyright 2012 EMC Corporation. All rights reserved.
25
Simplified Storage Provisioning with
Unisphere for VMAX
• Unisphere’s common tasks
wizards guides new users
through the process of
provisioning storage to
hosts.
• Prompts guide the user to
next steps, resulting in an
intuitive flow and learning
process.
© Copyright 2012 EMC Corporation. All rights reserved.
26
Cascaded Storage Groups
 New feature with
5876 providing the
ability to nest multiple
storage groups in a
single masking view
 Simplifies FAST VP configurations in virtual environments
 Multiple application within a single masking view managed
with its own storage group and FAST policy
 Simplified monitoring and management at application level
made easier
© Copyright 2012 EMC Corporation. All rights reserved.
27
Enable FAST VP Coordination
on Storage Groups
 With this feature enabled, FAST VP sends device usage statistics from R1 to R2
to ensure that the FAST engine at the standby/failover site has up-to-date
metrics on which to base decisions.
 Enabled under storage group management in Unisphere:
–
Check Box: Enable FAST VP RDF Coordination
 Coordination must to be enabled on storage groups at both source and target
VMAX
© Copyright 2012 EMC Corporation. All rights reserved.
28
Virtualization and
Application Profiles
© Copyright 2012 EMC Corporation. All rights reserved.
29
VMware Configuration
 Reduce HBA queuing for vSphere ESXi servers by
changing the queue depth
– esxcli system module parameters set -p
bfa_lun_queue_depth=64 -m bfa
 Virtual Machine boot LUNs configured to use LSI
SAS adapter
 VMware Paravirtual SCSI (PVSCSI) adapters are
used to configure DATA LUNs for high
performance
vCenter
screenshots
© Copyright 2012 EMC Corporation. All rights reserved.
30
EMC Virtual Storage Integrator
and VMAX 40K
© Copyright 2012 EMC Corporation. All rights reserved.
31
Application Configuration
Oracle OLTP
MSSQL OLTP (TPC-E Like)
1 Oracle DB instance, 12 vCPUs with
53 GB RAM
2 SQL instances, 16 vCPUs with
32 GB RAM
1 DB per VM, 2 TB capacity
1 DB per VM, 1 TB capacity
SwingBench entry workload on 400
users, 60:40 R/W ratio
Mixed workloads to simulate hot, warm
applications, 85:15 R/W ratio
SAP OLTP
MSSQL OLAP (DSS, TPC-H Like)
3 SAP ERP 6 IDES EHP 4 instances,
16 vCPUs with 32 GB RAM
1 SQL instance, 32 vCPUs with
128 GB RAM
1 Oracle DB instance at 845 GB
capacity
1 DB per VM, 2 TB capacity
1000 LoadRunner Update users +
local client copy simulation,
80:20 R/W ratio
2 concurrent loads, 100% Read
© Copyright 2012 EMC Corporation. All rights reserved.
32
Validation and
Testing
•
•
•
•
Application Performance Validation
Online Policy Tuning
SRDF Coordination
Application Failover with Rapid Ramp-Up
© Copyright 2012 EMC Corporation. All rights reserved.
33
Application Performance Summary
 Four mission-critical, high-transaction
applications running mixed workloads
operating in a VMware vSphere 5.0 private
cloud deployed on VMAX 40K
–
–
–
–
SAP OLTP
2 x SQL Server OLTP Instances
1 x SQL Server Data Warehouse Instance
Oracle OLTP
© Copyright 2012 EMC Corporation. All rights reserved.
34
FAST VP Policies
The table below details the FAST VP Policies set for our
baseline configuration:
Storage group
FAST policy name
Flash
FC
SATA
MSSQL1_OLTP
MSSQL_OLTP
5%
40%
100%
MSSQL2_OLTP
MSSQL_OLTP
5%
40%
100%
MSSQL_DSS
MSSQL_DSS
0%
100%
100%
Oracle
Oracle
15%
35%
50%
SAP
SAP
10%
80%
10%
 Both MSSQL1 and MSSQL2 applications share the same FAST policy
 Policies restrict Flash tier to prevent any single application from
dominating Flash resources
© Copyright 2012 EMC Corporation. All rights reserved.
35
Build Validation—All Applications Running
OLTP
Application
Server Transactions
Per Minute
DSS/OLAP Application
Average Read
Response Time
Average Throughput
MSSQL DSS
Oracle
97,846
5.5 ms
MSSQL1
37,920
10 ms
MSSQL 2
139,020
11 ms
© Copyright 2012 EMC Corporation. All rights reserved.
808 MB/s
Application
SAP
Server Transactions
Per Minute
Average Dialogue
Response time
2894.8
929.93 ms
36
Validating FAST VP SRDF Coordination
 SRDF coordination
– Balance at Source
and target
– Similar tier usage at
both sites
 Solid lines are
source devices
 Dotted lines are
target devices
© Copyright 2012 EMC Corporation. All rights reserved.
37
SRDF Coordination, continued
[root@solenabler1 ~]# symcfg list -tdev -range 426:426 -bound -detail -v -sid 542
Symmetrix ID: 000195700542
Source Array
Enabled Capacity (Tracks) : 1826068704
Bound Capacity (Tracks) : 1048590
SYMMETRIX THIN DEVICES
---------------------------------------------------------------------Pool
Pool
Total
Bound
Flags
Total Subs
Allocated
Written
Sym Pool Name ESPT
Tracks (%)
Tracks (%)
Tracks (%)
---- ------------ ----- ---------- ----- ---------- --- ---------- --0426 FC10K_RAID1 F..B 1048590
0
546156 52 1044754 100
FLASH_3RAID5 -.-312924 30
- SATA_6RAID6
-.-186540 18
- Total
Tracks
---------- ----- ---------- --- ---------- --1048590
0 1045620 0 1044754 0
[root@solenabler1 ~]# symcfg list -tdev -range 426:426 -bound -detail -v -sid 541
Symmetrix ID: 000195700541
 Device has been
balanced across
all tiers in a
similar
distribution on
both R1 and R2
Enabled Capacity (Tracks) : 1826068704
Bound Capacity (Tracks) : 1048590
Disaster
Recovery
Array
SYMMETRIX THIN DEVICES
---------------------------------------------------------------------Pool
Pool
Total
Bound
Flags
Total Subs
Allocated
Written
Sym Pool Name ESPT
Tracks (%)
Tracks (%)
Tracks (%)
---- ------------ ----- ---------- ----- ---------- --- ---------- --0426 FC10K_RAID1 F..B
1048590
0
570996 54 1044492
FLASH_3RAID5 -.-352524 34
SATA_6RAID6 -.-120972 12
Total
Tracks
© Copyright 2012 EMC Corporation. All rights reserved.
100
- - -
---------- ----- ---------- --- ---------- --1048590
0 1045620 0 1044754 00
38
Failover Test
 Application loads were run for extended periods at R1 site and FAST VP
balanced storage groups on both arrays
 RDF links split to simulate failover
 SAP and Oracle were brought up on remote ESXi Server
 Performance was monitored before and after failover
Oracle & SAP
Running at R1
Oracle & SAP
Failed over and
running at R2
© Copyright 2012 EMC Corporation. All rights reserved.
39
Failover Test, continued
 Following failover
performance at
application levels were on
par with production
 Transactions per minute
and response times
observed were equal
© Copyright 2012 EMC Corporation. All rights reserved.
40
FAST VP Responsiveness and Flexibility
 At 7:40am SQL OLTP
policy adjusted to add
additional Flash
capability
 After 30 minutes
performance improved
 SQL txn/sec increased
and latency dropped
 After 2 hours the SQL
performance stabilized
 Zero impact observed by
other running
applications
© Copyright 2012 EMC Corporation. All rights reserved.
41
Summary and Solution Benefits
 VMAX 40K provides an ideal platform for virtualized critical database
applications, running varied workloads.
 End-to-end visibility with VMware Storage Integrator from EMC enables
simplified management and identification of VMAX devices direct from vCenter
 FAST VP Cascaded storage groups enable simplified management of ESX
environments with FAST.
 Allocate by policy reduces time to balance FAST VP storage groups and the
amount of data FAST VP needs to move.
 FAST VP is tunable and responsive. By adjusting FAST policies, performance
can be tuned to meet changing business performance needs. Increased
performance within 30 minutes with no negative impact to other running
workloads.
 SRDF coordination with FAST VP ensures production level performance at the
R2 site in FAST VP environment in the event of a failover when configurations
are similar. This delivers the performance and cost benefits of FAST VP at both
production and disaster recovery sites.
© Copyright 2012 EMC Corporation. All rights reserved.
42
Questions?
© Copyright 2012 EMC Corporation. All rights reserved.
43