Klemen Bačak
Field Technical Sales Specialist, IBM Slovenija d.o.o. klemen.bacak@si.ibm.com, GSM:040/456-607
Storage Virtualization with SVC:
Simplify Procedures, Reduce Risk, Enhance Usage
29.09.2010
© 2010 IBM Corporation
Primary CIO Storage Investment Priorities
SVC
SVC
SVC
SVC
3
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Virtualization Everywhere
Application
SOA
Grid,
Clustered applications
Middleware
Middleware
•Virtual machines
VM (mainframe)
VMware, HyperV
PowerVM (AIX)
Virtual file systems
Storage
5
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Disk Virtualization Primer
6
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Today's SANs
SAN
7
klemen.bacak@si.ibm.com
SAN-attached disks
look like local disks to
the OS & application
© 2010 IBM Corporation
SANs – with Virtualization
SAN
Virtual disks start as
images of migrated
non-virtual disks.
The 1:1 relation is not
mandatory afterwards
Virtualization
layer
8
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Become truly flexible !
SAN
Virtual disks remain
constant during physical
infrastructure changes
Virtualization
layer
9
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Enable tiered Storage !
SAN
Virtualization
layer
10
klemen.bacak@si.ibm.com
Moving virtual
disks between
storage tiers
requires no
downtime
© 2010 IBM Corporation
Avoid planned Downtime !
SAN
Upgrade
11
klemen.bacak@si.ibm.com
Replacement or
upgrade of the
virtualization
hardware require
no downtime
© 2010 IBM Corporation
In-band Storage Virtualization : Compiled Benefits
CACHE
Pooling
Isolation
1.
2.
3.
Flat interop. matrix
Single point administration
No-cost multipathing
Performance
1.
2.
3.
Higher (pool) utilization
Cross-pool-striping: IOPS
Thin Provisioning: free GB
Mirroring
Mirroring
×
1.
2.
3.
Performance increase
Hot-spot elimination
Boost for old SANs
1.
2.
3.
License economies
Cross-vendor mirror
Favorable TCO
License $$
12
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Migration into Storage Virtualization (and back!)
ZONE
SAN
SAN Volume
Controller
Virtual disks in transparent
Image Mode, before being
converted to Full Striped
This works backwards too
(no vendor lock-in)
13
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Dito with redundant SANs
ZONE
SAN A
14
klemen.bacak@si.ibm.com
SAN B
1
:
4
SAN Volume
Controller
© 2010 IBM Corporation
SAN Volume Controller
15
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
SAN Volume Controller : Virtualization Device
ƒ
Single product number
ƒ
Clustered ×2…8
ƒ
SVC comes in pairs with
mirrored cache (IOgroups)
ƒ
Multi-use Fibrechannel in & out
ƒ
Linux bootcode, 100% IBM stack
1 node pair
Acquisition cost:
1. Hardware
2. per-TB license
3. per-TB mirroring license
16
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
3 Success Reasons for SAN Volume Controller
1. Continuity
2. Proven scalability & stability
3. Proven TCO benefits
+
20.000
ears
y
7
n
i
sold
ƒ
17
1 node pair
…4 node pairs
Market leader (Gartner, IDC…)
klemen.bacak@si.ibm.com
* 20.000 nodes @ 3500 customers (04/2010)
© 2010 IBM Corporation
Continuity
… 5th Generation
ƒ Continuous development
initial Release
ƒ Firmware is backwards compatible
(64 bit not for 32 bit Hardware)
ƒ Replace while online
SAN Volume Controller CF8 – Firmware v5.1
MODELS
:
SVC 4F2 SVC 8F2 SVC 8F4 SVC 8G4 SVC CF8 -
:
18
klemen.bacak@si.ibm.com
4GB cache, 2Gb SAN (Rel.3 / 2006)
8GB cache, 2Gb SAN (ROHS comp.)
8GB cache, 4Gb SAN
155.000 SPC-1™ IOPS
+Dual-core Processor
272.500 SPC-1™ IOPS
24GB cache, Quad-core 315.043 4-node SPC-1 IOPS
380.483 6-node SPC-1 IOPS
© 2010 IBM Corporation
Proven Scalability & Stability
ƒ Fleet availability: 99,999 ~ 99,9999%
ƒ Full redundancy and cache mirroring
160.000 IOPS / 2-node
ƒ Very low overhead (invisible 60µs)
ƒ SVC shows predictable & deterministic characteristics
under heavy load, due to avoidance of I/O interrupts
Technology = State-loop with adapter polling
19
klemen.bacak@si.ibm.com
60µs
SVC v5.1
60µs
© 2010 IBM Corporation
TCO Advantage
In many cases SVCs had a return on investment
within < 18 months due to these characteristics.
CACHE
Pooling
Isolation
1.
2.
3.
Flat interop. matrix
Single point administration
No-cost multipathing
Performance
1.
2.
3.
Higher (pool) utilization
Cross-pool-striping: IOPS
Thin Provisioning: free GB
Mirroring
Mirroring
×
1.
2.
3.
Performance increase
Hot-spot elimination
Boost for old SANs
1.
2.
3.
License economies
Cross-vendor mirror
Favorable TCO
License $$
20
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Attractive Entry Price : SVC "lite"
ƒ SAN Volume Controller Entry Edition
ƒ "Lite" hardware e.g. single core
ƒ Attractive price point
approx. 60% performance for 60% cost
SVC Entry Edition
ƒ Licensed for up to 250 virtualized spindles (unlimited capacity)
ƒ Optional mirroring license* is spindle-based (unlimited capacity)
ƒ FlashCopy and Multipathing for all clients included in base license
21
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Attaching the Midmarket
FC
23
klemen.bacak@si.ibm.com
iSCSI
© 2010 IBM Corporation
Free SVC Features
24
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Thin Provisioning and integrated Flash Memory*
ƒ
SVC adds fine-grained "thin provisioning" to any storage
Flash*
ƒ
SVC
The smallest
SVC grain
size is 32kB
IBM
ƒ
700µs
non-IBM
Maximizes
the use of
your storage
* automated "easy tiering"
to become available soon
25
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Free Campus Failover for VMs
26
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Symmetric Disk Mirroring with "stretched" SVC
VM
VM
VM
Host
VM
SVC 1 node A
LUN1
27
klemen.bacak@si.ibm.com
VM
High availability + protection
for virtual machines
One storage system. Two locations.
Å FC longwave Distance (x km) Æ
VM
VM
Host
VM
SVC 1 node B
LUN1'
© 2010 IBM Corporation
Planned & unplanned Failover Scenario
VMotion, Partition Mobility, …
VM
VM
VM
VM
Host
VM
VM
Host
No LUN
rescan
required
VM
SVC IO group must be interconnected over 1 switch hop (no ISL)
SVC 1 node A
SVC 1 node B
FC
FC
DR failover
works w/o
training
LUN1
LUN1'
Quorum
Split-brain Tiebreaker
28
klemen.bacak@si.ibm.com
Quorum =
consistency
guarantee
© 2010 IBM Corporation
Solid State (Flash) Memory
29
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
SVC 5 (Model CF8) with Flash SSD Option
8×
Boost any storage with SSD drives – at the heart of the SAN
30
Per SSD
Per IO Group
Per Cluster
(Mirrored SSDs)
(Mirrored SSDs)
Raw Capacity
146GB
1168GB
4672GB
Read 4KB IOPs
35,000+
200,000+
800,000+
Mixed 4KB IOPs
(70/30)
19,000
83,000
333,000
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
SAN Volume Controller Æ QoS Virtualization
P re
vie
w
Applications
SVC
(
)
t
t
n
n
e e
m
n em
g
i
s lac
s
A a pNew Chipc
i
at
m
d
Memory
n a ed
y
D as
-b
S
Qo FC 15K
SAS 15K
Flash
SVC R5 since 2009
+Integrated Flash tier
SATA
SVC R5.x – 2010
+Easy Tier Automation
31
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Copy Services Enhancements
32
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Multicluster Mirroring "any-to-any"
SAN
SANVolume
Volume
Controller
Controller
SAN
SANVolume
Volume
Controller
Controller
Datacenter1
Datacenter 2
SAN
SANVolume
Volume
Controller
Controller
Datacenter 3
SAN Volume
Controller
Datacenter 4
33
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Multiple Flashcopies with individual "Flashback"
t0
Saved state 12:00
Saved state 13:00
SAN
SANVolume
Volume
Controller
Controller
Saved state 14:00
Saved state 15:00
:
Virus
×256
SAN
SANVolume
Volume
Controller
Controller
34
klemen.bacak@si.ibm.com
Reverse Flashcopy is
instant. Earlier and later
copies stay consistent.
© 2010 IBM Corporation
MS Exchange / MS SQL Data Protection / Backup
MS Exchange
VSS
MS SQL
VSS
t0
Saved state 12:00
(space efficient)
t0
SAN
SANVolume
Volume
Controller
Controller
Saved state 13:00
(space efficient)
:
TSM for Copy Services in conjunction with SVC's Space Efficient FlashCopy function can provide
multiple, incrementally updated backups for MS Exchange and MS SQL Server.
When the VSS provider for SVC 4.3 or later is configured to use Space Efficient (SE) target volumes in the pool used to satisfy VSS snapshot requests (and the
background copy rate is set to 0), TSM will be able to perform frequent snapshot backups of Exchange and SQL server data volumes where each snapshot
contains only the changed blocks since the prior VSS snapshot backup. There is no background copy of the full source volumes in this case so snapshots can be
created at a high frequency because there is no need to wait for a background copy to finish. Thus, use of SE target volumes on SVC enables frequent, block level
incremental backups to be created through VSS snapshots where multiple backup versions can be retained. However, SVC does not currently support FlashCopy
restore from SE target volumes so the TSM instant restore feature is not available when SE target volumes are used. TSM fast restore (file copy) can be done from
the VSS snapshot backups. These VSS backups can also (optionally) be sent to TSM server storage (tape or disk) as usual.
Since SE target volumes depend on the source volumes for any unchanged data, we recommend use of mirrored RAID configurations to protect against physical
disk failures.
Check out IBM FlashCopy Manager
35
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Open Software Interfaces
36
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
SVC Third-Party Mgmt Software available*
Large,
Large, Gold-class
Gold-class VDisks
VDisks
with
with low
low average
average load.
load.
Drag'n'drop
Drag'n'drop onto
onto suitable
suitable
storage
storage tier,
tier, using
using BVQ*
BVQ*
SVC
SVC will
will manage
manage the
the
migration
migration w/o
w/o disruption.
disruption.
37
klemen.bacak@si.ibm.com
*BVQ, Business Volume Qualicision®, from IBM Partner SVA
© 2010 IBM Corporation
Free "Community" Software Tools for SVC
ƒ http://www.alphaworks.ibm.com/tech/svctools/faq
An interface and
scripting tools
using Perl for
automating tasks
in SAN Volume
Controller
38
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
SAN Volume Controller Naming Scheme
Virtual Disks:
May have ‘any’ size, independent
from underlying storage layout.
I/O Group
I/O Group
SAN Volume Controllers nodes
Managed Disk Group
46
klemen.bacak@si.ibm.com
Managed Disk Group
IO group: Two nodes keeping
write cache consistency. An IO is
acknowledged when both caches
accept the write operation.
Cluster: All nodes participating
in a logical SVC instance and
‘knowing’ the virtual layout.
Managed Disks:
Hidden beneath SVC. Static.
Typically grouped in pools of
LUNs from each storage
device, RAID level, or rpm
speed.
© 2010 IBM Corporation
Available Virtual Disk Modes in SVC
Image Mode:
Pass thru; Virtual Disk = Physical LUN
A
Sequential Mode:
Virtual Disk mapped sequentially
to a portion of a managed disk
B
C
Virtual Disks
MDG3
MDG1
A
47
klemen.bacak@si.ibm.com
Striped Mode:
Virtual Disk striped
across multiple managed
disks (=preferred mode)
B
C
MDG2
C
© 2010 IBM Corporation
SVC Integration in Fabrics
50
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
SVC Drop-in Installation in single or dual fabrics
No need to
change the
SAN layout!
MPIO
Free
Multipathing
8 ports per Node-pair
4 ports
SAN1
4 ports
SAN2
Simple or
redundant
SAN fabrics
supported
51
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Simplified Zoning / Masking
52
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Simplified Zoning with SAN Volume Controller
Static Host Zones:
Hosts are zoned only to
SAN Volume Controller.
This does never change.
SAN Volume Controller
node pair
Static Device Zone:
Devices are zoned only to
the SAN Volume Controller.
This does never change.
(except for subsystems replacement)
53
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Traditional Zoning X-to-Y Complexity
Traditionally, host
systems are zoned to
the disks they are
allowed to ‘talk’ to.
Zoning administration
is “duplicate work” and
needs to always match
LUN mapping.
54
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
TESTED & Approved Compatibility
56
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Current Version on ibm.com/storage/svc under “Interoperability”.
SAN Volume Controller – Ever growing Support Matrix
IBM
z/VSE
Novell
NetWare
VMware
Microsoft
Windows
Hyper-V
iSCSI to hosts
Via Cisco IPS
(native iSCSI in R5)
IBM AIX
IBM i 6.1
Sun
Solaris
HP-UX 11i
Tru64
OpenVMS
SAN with 4Gbps fabric
Point-in-time Copy
Full volume, Copy on write
256 targets,
Incremental, Cascaded
Space-Efficient
Entry Edition software
SAN
Volume Controller
Linux
SGI
(Intel/Power/zLinux)
RHEL
IRIX
SUSE
IBM N series
& Netapp
Gateway
IBM TS7650G IBM
Apple
Mac OS
BladeCenter
Continuous Copy
Metro Mirror
Global Mirror
(log file enhanced)
Space-Efficient Virtual Disks
1024
Hosts
SAN
SAN
Volume Controller
Virtual Disk Mirroring
IBM
IBM
ESS,
DS
DS4000
FAStT
IBM
IBM
XIV N series
DS5000
DS6000
DS8000
57
klemen.bacak@si.ibm.com
HP
Hitachi
EMC
Sun NetApp
MA,
EMA,
MSA
Lightning
CLARiiON StorageTekFAS
EVA 4/6/8400
Thunder
Symmetrix
TagmaStore XP 24000/20000
AMS, WMS, USP
NEC
Fujitsu Pillar
iStorage Bull Eternus Axiom
StoreWay
300, 500
600
© 2010 IBM Corporation
Summary
58
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
Summary : When to consider Disk Virtualization?
1. Low capacity utilization
2. Compatibility chaos
3. Too high migration effort
4. Unhappy with storage performance
5. Too complex site failover process
SVC
6. Need to realize quick ROI
– Simplified administration, including copy services: 1 same process
– Online re-planning is now possible due to great migration flexibility
– Storage effectiveness (ongoing optimization) can be maintained over time
– Move applications up one tier as required, or down one tier when stale
– Don't care about data placement on RAID arrays, just define striped pools
59
klemen.bacak@si.ibm.com
© 2010 IBM Corporation
60
klemen.bacak@si.ibm.com
© 2010 IBM Corporation