© Copyright 2015 EMC Corporation. All rights reserved.
1
VNX HYBRID FLASH
VNX DATA MOBILITY STRATEGIES, TOOLS, & CONSIDERATIONS
MIKE MCKAY
CORPORATE SYSTEMS ENGINEERING, VNX
© Copyright 2015 EMC Corporation. All rights reserved.
2
ROADMAP INFORMATION DISCLAIMER
• EMC makes no representation and undertakes no obligations with
regard to product planning information, anticipated product
characteristics, performance specifications, or anticipated release
dates (collectively, “Roadmap Information”).
• Roadmap Information is provided by EMC as an accommodation to the
recipient solely for purposes of discussion and without intending to be
bound thereby.
• Roadmap information is EMC Restricted Confidential and is provided
under the terms, conditions and restrictions defined in the EMC NonDisclosure Agreement in place with your organization.
© Copyright 2015 EMC Corporation. All rights reserved.
3
VNX UNIFIED HYBRID FLASH!
All Workloads
No need for Workload Segregation
Unified Storage
File and Block
Cloud Ready
Private or Hybrid Cloud
Hybrid Flash
Performance of Flash with the Cost of Disk
© Copyright 2015 EMC Corporation. All rights reserved.
4
AGENDA
WHAT’S COVERED?
 Why Do We Need Data
Migrations?
 Block Migrations
 File Migrations
 VDM and VNX Replicator
Review
 SAN Copy
 VNX File Migration Feature
 VNX with RecoverPoint
 Cloud Tiering Appliance
 VNX with VPLEX
 CIFS File Server
Consolidation and Migration
Tools
 LGDUP, EMCOPY,
SHAREDUP
© Copyright 2015 EMC Corporation. All rights reserved.
5
WHY DATA MIGRATIONS?
VNX5600
VNX5800
VNX5800
VNX5800
VNX5800
VNX5400
VNX5600
Consolidation
Tech Refresh
Balancing
Restructure
Data Centers
Arrays
File Servers
EOL
Maintenance
New Features
Utilization
Capacity
Tiering/SLA’s
Merger/Acquisition
Divestiture
Application
© Copyright 2015 EMC Corporation. All rights reserved.
6
BLOCK MIGRATION TECHNOLOGIES
Off-Array
OnArray
Block
SAN Copy
RecoverPoint
VPLEX
3rd Party
© Copyright 2015 EMC Corporation. All rights reserved.
7
SAN COPY
© Copyright 2015 EMC Corporation. All rights reserved.
8
SAN COPY
TECH REFRESH, CONSOLIDATIONS
 VNX Built-in Flexible Array Based
Block Migration Product
 Host and OS Independent
 No Host Software
 Host is not in the Data path
 Optimal Performance
 Connectivity
 Fiber Channel, iSCSI, IP-extended SANs
 Interoperability
 CX, VNX, VMAX, and 3rd Party*
*refer to current Support Matrix
© Copyright 2015 EMC Corporation. All rights reserved.
9
SAN COPY KEY CONCEPTS
TECH REFRESH, MINIMIZE DOWNTIME
Target
Source
 VNX Running SAN Copy Can
Data To A Remote LUN
 Local Read, Remote Write
FC/IP WAN
SnapShot
DeltaMaps
*refer to current Support Matrix
PUSH = remote write operation
PULL = remote read operation
© Copyright 2015 EMC Corporation. All rights reserved.
 Source LUN Online During
Full And Incremental Copies
 Leverages SnapShots and
DeltaMaps for Incremental
Change Tracking
 Source Must Be A CX, VNX,
VNX2*
10
SAN COPY KEY CONCEPTS
TECH REFRESH, 3RD PARTY SOURCE
Source
Target
 VNX Running SAN Copy Can
Data From A Remote
LUN
 Remote Read, Local Write
 Full Copy, No Incremental
FC/IP WAN
*refer to current Support Matrix
PUSH = remote write operation
PULL = remote read operation
© Copyright 2015 EMC Corporation. All rights reserved.
 Source LUN Offline To The
Host
 VMAX And 3rd Party
Support*
11
VNX WITH RECOVERPOINT
© Copyright 2015 EMC Corporation. All rights reserved.
12
RECOVERPOINT
TECH REFRESH
• Appliance Based Local And Remote
Block Replication
• Application Independent, DVR like PiT
recovery improving RPO/RTO
Production
Local
Copy
© Copyright 2015 EMC Corporation. All rights reserved.
Remote
Copy
• WAN optimization up to 90% with
RecoverPoint deduplication and
Compression
• Simplified Management with
Unisphere and CLI
• Heterogeneous Support (EMC VNX,
VMAX, And 3rd Party Arrays Via
VPLEX)
13
RECOVERPOINT FOR VNX
TECH REFRESH
Local
Protection
LAN/WAN
Sync / Async
IP
Local Copies
© Copyright 2015 EMC Corporation. All rights reserved.
Remote
Protection
Remote Copies
14
RECOVERPOINT/VE FOR VNX
TECH REFRESH
FC/iSCSI
Local
Protection
iSCSI
WAN
Sync / Async
IP
VMware ESXi
Lndon
© Copyright 2015 EMC Corporation. All rights reserved.
Local Copies
FC/iSCSI
Remote
Protection
VMware ESXi
Remote Copies
iSCSI
New York
15
RECOVERPOINT FOR VM’S
VIRTUAL MACHINE GRANULARITY
VMware
vCenter
Plug-in
RDM
© Copyright 2015 EMC Corporation. All rights reserved.
Plug-in
WAN
VMware
ESXi
Production
VMware
vCenter
VMware
ESXi
RDM
Journal
Replica
RDM
Journal
Replica
16
RECOVERPOINT FOR MIGRATIONS
TECH REFRESH, CONSOLIDATION
• Use Physical RecoverPoint for larger block migrations
for most performance
• Use Virtual RecoverPoint for smaller migrations and
lower TCO
• Use RecoverPoint for Virtual Machines if you require
per-VM granularity
© Copyright 2015 EMC Corporation. All rights reserved.
17
VNX WITH VPLEX
© Copyright 2015 EMC Corporation. All rights reserved.
18
VPLEX MIGRATION OVERVIEW
TECH REFRESH
Batch A
Batch B
Batch C
Eliminates CUTOVER DOWNTIME
Migrations occur during WORKING HOURS
LUN
A(V)
A
LUN
B(V)
B
LUN
C(V)
C
LUN
A
LUN
B
LUN
C
REDUCES time and cost of migrations
Purchase and
Install VPLEX
Batch A
Schedule
Maintenance
Timeline
© Copyright 2015 EMC Corporation. All rights reserved.
Batch B
Scheduled
Maintenance
All Storage Purchase and
Batch C
Non-Disruptive
Completed
Scheduled Virtualized Install New
Data MOBILITY
Storage
Maintenance
Storage
During Working Hours Refresh
Migration Time
19
SIMPLIFIED BLOCK MIGRATIONS
TECH REFRESH
Transparent Tech Refreshes
ZERO DOWNTIME
Year 4
VPLEX
Year 1
Year 2
Year 3
VNX5300
VNX5300
VNX5300
ZERO IMPACT
VNX5800
ZERO HEADACHES
ZERO impact to hosts
© Copyright 2015 EMC Corporation. All rights reserved.
20
GETTING THE MOST OUT OF YOUR VNX
REBALANCING, TIERING
Transparent Rebalancing
LUN Tiering Across Arrays
VPLEX
VPLEX
Flash
Flash
NLSAS
SAS
VNX5600
VNX5600
VNX5300
VNX5400
VNX5800
INCREASED performance
© Copyright 2015 EMC Corporation. All rights reserved.
VNX5600
VNX5300
NLSAS
VNX5800
SCALABLE tiering
21
VNX BLOCK MIGRATION WITHOUT VPLEX
• Overlap up to 1 year migrating from old system to new.
• Meanwhile new assets are not being utilize, old assets are still being paid for, you may be
getting maintaining 2 support contract for essentially the same data
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
12 month tech refresh = double ownership
for 12 months = additional cost
Current Arrays
Purchase next Arrays
Under-utilization = wasted assets =
additional cost
Next Arrays
Legacy tech refresh = DIFFICULT and EXPENSIVE
© Copyright 2015 EMC Corporation. All rights reserved.
K
E
Y
Under Utilized
Utilized / OK
Maintenance Cost
Double Ownership
22
VNX AND VPLEX LONG TERM
• Deploying A Persistent And Transparent Virtualization Layer NOW Has
Significant Cost Benefit On CURRENT and FUTURE Tech Refreshes
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
Low Cost Persistent VPLEX “Transparent Virtualization” Layer
Current
Getting off the old asset quicker saves money
Next Refresh
EASY &
ONLINE tech
refresh in <
30 days +
Almost
Immediate
Utilization!
Next Refresh
Solve the
problem
permanently
© Copyright 2015 EMC Corporation. All rights reserved.
K
E
Y
Next
Under Utilized
Utilized / OK
VPLEX
23
BLOCK SUMMARY
TAKEAWAYS
• SAN Copy
–
–
Flexible, heterogeneous, built-in(free) Block Migration Tool
CX/VNX and 3rd party to VNX2 Block LUN Feature.
• Non-CX/VNX source requires cold pull operation
• RecoverPoint
–
–
–
–
DVR Like Disaster Recovery Product For LUNS/Consistency Groups
Rollback To A Point In Time Immediately Prior To Corruption Event Maximizing RPO
Use For Block Migrations, Initial Synchronization Online
Heterogeneous migrations supported between RecoverPoint Supported EMC Arrays
• VPLEX
–
–
–
Active/Active Block Device Mirroring And Virtualization Product With Built-in Online Transparent
Migration Functionality
With A VPLEX Virtualization Layer All Storage Virtualized By VPLEX Can Be Migrated Online
Heterogeneous including 3rd party array migrations
© Copyright 2015 EMC Corporation. All rights reserved.
24
FILE MIGRATION TECHNOLOGIES
Off-Array
OnArray
File
3rd Party
© Copyright 2015 EMC Corporation. All rights reserved.
VDM File Migration
CTA
LGDUP, EMCOPY,
SHAREDUP
25
VDM FILE MIGRATION
© Copyright 2015 EMC Corporation. All rights reserved.
26
ANATOMY OF A VDM
CONTAINERIZATION
Configuration
128MB File System
© Copyright 2015 EMC Corporation. All rights reserved.
CIFS Server
NFS Endpoint
Name Mapping
Mount Points
File Systems
Checkpoints
Replicated File Systems
Network
CIFS Server Interface
NFS Endpoint Interface
27
VIRTUAL DATA MOVERS (VDM)
WHY VDMS?
Data Mover
NFS
CIFS
NFS
CIFS
© Copyright 2015 EMC Corporation. All rights reserved.
Containerizes FS And
CKPT Mount Points,
Interfaces, And
CIFS/NFS Configurations
Simplifies DR Failover
Operations And
Migrations
Basis For Multi-tenancy
With File Storage
28
VNX REPLICATOR WITH VDM
• VNX Replicator Is An
Asynchronous File System Level
Replication Technology
DM3
DM3
TECH REFRESH, CONSOLIDATION
DM3 40MB/s Throttle
DATA IP LAN/WAN
MGMT IP
LAN/WAN
Replication Sessions
Interconnect or “Logical Pipe”
GUI/CLI
CS
DM2
DM2
CS
Control
–
“max time out of sync”
• Bandwidth Throttling per
Interconnect
DM2 No Throttle
GUI/CLI
• User Definable RPO per Session
–
Interconnect: Logical pipe or point
to point channel between Source
and Target DM
• One To Many And Cascading
Replications
Array to Array Control Path
© Copyright 2015 EMC Corporation. All rights reserved.
29
VDM FILE MIGRATION TOOL
WHAT IS IT?
 New Feature Which
Orchestrates The Migration
Process From Celerra/VNX To
VNX2 Using VNX Replicator And
VDMs
 GUI : VDM File Migration utility
 Easy to use
 Standalone Windows App
 CLI : nas_migrate
 Flexible, scriptable, on control
station
© Copyright 2015 EMC Corporation. All rights reserved.
30
VDM FILE MIGRATION TOOL
WHAT DOES IT DO FOR ME?
System Settings
VDM
File systems
Automated
Simple
Granular
LDAP, FTP, SFTP, HTTP, NIS,
DNS, NTP, Usermapper,
passwd, group, CEPP, CAVA,
server_params, netgroup,
nsswitch, and hosts
VDM + Filesystems,
Checkpoints (RO), And
Checkpoint Schedules
Choose Subset Of File
Systems To Migrate From
VDM Or DM
Flexible
Choose To Migrate All Or
Only A Subset Of Settings
© Copyright 2015 EMC Corporation. All rights reserved.
Disaster Recovery
Preservation
Incrementally Reestablish VNX Replicator Sessions Of
Migrated File Systems Between New VNX And Original DR
31
VDM FILE MOBILITY
TECH REFRESH, CONSOLIDATION, REBALANCING
Simply move a VDM or individual
FS from one VNX to another
Optionally takeover IP addresses
Replicator
© Copyright 2015 EMC Corporation. All rights reserved.
32
MIGRATING FILE REPLICATION
TECH REFRESH, CONSOLIDATION, BALANCING
 Protects replication session to DR site during the migration
 Migrates replication session from source to target
 Continuous protection during migration
REMOTE
DR SITE
REPLICATION
© Copyright 2015 EMC Corporation. All rights reserved.
REPLICATION
33
CLOUD TIERING APPLIANCE
© Copyright 2015 EMC Corporation. All rights reserved.
34
CLOUD TIERING APPLIANCE (CTA)
TECH REFRESH, CONSOLIDATION, TIERING
• Simple, Scalable, Policy-based File Tiering
And Migration Appliance (Physical And
Virtual Available)
• Optimizes VNX File Storage by moving
inactive files to lower cost secondary
storage
–
–
–
–
Different Tier Same Array
Different Array
Private or Public Cloud
~8K Stub Files
• File Encryption For Security When Archiving
To Cloud
• Automated User Defined Policy and
Simulations
© Copyright 2015 EMC Corporation. All rights reserved.
35
CTA MIGRATION TYPES
TECH REFRESH, TIERING
Repository / Secondary
• Repository Migration
–
3rd Party Public Cloud
–
Atmos
CTA
CTA Migrates Secondary Storage
(Archived Files) To A Different NAS, On
Premise Or Service Provider Cloud
CTA Updates Stub Files On Primary
Storage To Reflect Changed Secondary
• File Migration
–
–
Moves primary files to new storage
Evaluates/Converts stub files without
recalling from secondary
Primary
© Copyright 2015 EMC Corporation. All rights reserved.
36
VNX CIFS UTILITIES FOR MIGRATIONS
LGDUP.EXE, EMCOPY.EXE, SHAREDUP.EXE
© Copyright 2015 EMC Corporation. All rights reserved.
37
LGDUP
TECH REFRESH, FILE SERVER CONSOLIDATION
• CLI CIFS Local Group Migration Utility
• Use prior to CIFS data copy to ensure target CIFS
server contains local group and local user from the
source CIFS server
• Enables CIFS File Server Consolidation with Local
groups Merge option as well as Local group Prefix
option.
© Copyright 2015 EMC Corporation. All rights reserved.
38
EMCOPY
TECH REFRESH, CONSOLIDATION, RESTRUCTURE
• CLI CIFS tool which replicates file/folder structure
from one location to another
• Replicates NTFS Security
• Multithreaded directory tree scanning and file copy
for optimal performance
• Automatically asserts NTFS backup privilege
• Supports simulation with /l(ist) option
© Copyright 2015 EMC Corporation. All rights reserved.
39
EMCOPY 4.17+
TECH REFRESH, CONSOLIDATION, SPACE EFFECIENT
• /COMPRESS initiates a VNX File Deduplication and
Compression thread on each file when written
• /TRFWINDOW (transfer window) sets limit on the
total inflight data capacity (pre-compressed) to
prevent over consumption of target space
– Helpful when multiple threads encounter large files at the
same time. /TRFWINDOW will pause remaining threads
until total inflight capacity is reduced
© Copyright 2015 EMC Corporation. All rights reserved.
40
EMCOPY 4.17+
COMPRESSION
Without EMCOPY /Compress and VNX File Deduplication and Compression
Out of
Space /
autoextend
TH 1
TH 2
TH 3
TH 4
\\Source\share
© Copyright 2015 EMC Corporation. All rights reserved.
emcopy
\\VNX\share
41
EMCOPY 4.17+
COMPRESSION
With EMCOPY /Compress and VNX File Deduplication and Compression
TH 1
TH 2
TH 3
TH 4
\\Source\share
© Copyright 2015 EMC Corporation. All rights reserved.
emcopy
\\VNX\share
42
SHAREDUP
TECH REFRESH, FILE SERVER CONSOLIDATION
• EMC CIFS Utility for migrating CIFS Share
information, security, remarks etc.
• CIFS Server consolidation
• Allows for share path modification in cases where
physical drive path to shared folder changes
– Old: EngApps c:\oldfs\eng\apps
– New: EngApps c:\newfs\eng\apps
© Copyright 2015 EMC Corporation. All rights reserved.
43
FILE SUMMARY
TAKEAWAYS
• VDMs, VNX Replicator, and VDM File Migration Tool
–
–
–
CLI And GUI Feature To Simplified VNX Replicator Celerra/VNX File Migrations
Orchestrates And Automates Steps Required To Migrate System Settings With VDM Or Per FS
Granularity
Uses Incremental Attach Functionality To Migrate DR VNX Replication Sessions Without Need For
Full Resynch.
• CTA
–
–
–
User definable policy driven File archiving appliance with built-in File migration functionality
Heterogeneous migration support
Intelligent ‘Stub Aware’ Migrations
• LGDUP, EMCOPY, SHAREDUP
–
–
–
Powerful lightweight toolset for File Server consolidation and migration onto VNX.
Space efficiency when used with VNX File Deduplication and Compression
Useful for migrations where data/folder restructuring or resizing is required
© Copyright 2015 EMC Corporation. All rights reserved.
44
REFERENCES
Documents
•
•
•
•
•
•
EMC VNX Replication Technologies -WP
Using VNX® File Migration Technical Notes P/N 300-014-344
Cloud-Tiering-Appliance-and-Cloud-Tiering-Appliance-VE-10.0-SP2-Getting-Started-Guide.pdf
Strategies for Migrating Block Data to EMC VNX Series Unified Storage Systems -WP
Virtual Data Movers on EMC VNX- WP
EMC SAN Copy A Detailed Review – WP
Related EMC World Sessions
Session ID
Title
ctdTT.40
ctdTT.40
Day
Start Time
VNX & VNXe Disaster Recovery Strategies
(On-Array, Off-Array & DR to the Cloud)
Lecture with Demonstration
Tue
8:30am
VNX & VNXe Disaster Recovery Strategies
(On-Array, Off-Array & DR to the Cloud)
Lecture with Demonstration
Thu
11:30am
© Copyright 2015 EMC Corporation. All rights reserved.
Type
45
VISIT THE EMC
“TRANSPARENT DATA CENTER”
IT’S INSPIRING. INNOVATIVE. INTERACTIVE.
Conversation Stations
•
•
•
•
•
Flash, Big Data, Cloud
Converged Infrastructure
virtual VNX
Product Demos
More…
Flash Performance
Calculator
POWERED ON,
OPERATIONAL
SYSTEMS
Talk & Chalk with
SMEs
Systems Showcase
• VNX/VNXe
• VMAX3
• XtremIO
• ScaleIO
• Isilon
• Data Protection
Theater
Presentations
© Copyright 2015 EMC Corporation. All rights reserved.
46
QUESTIONS?
© Copyright 2015 EMC Corporation. All rights reserved.
47