Storage Virtualisatie
Sjef van Ham
Storage Support
Meerheide 101
5521 DZ Eersel
s.van.ham@storagesupport.nl
26-maart-2009
1
Storage Opslag
DAS
Direct Attached Storage
NAS
Network Attached Storage
SAN
Storage Area Network
2
Wat is een SAN ?
1) Gecentraliseerde opslag op basis van een extern
schijvencabinet voor verschillende typen servers
« alles in één doos »
gecentraliseerd beheer
hoge schaalbaarheid door veel schijfruimte
hogere hardware redundantie en databeveiligingsfuncties : RAID,
spare disks
2) Speciaal storage netwerk
Fibre-Channel
grote afstand (optische kabels )
hoge bandbreedte (4Gb)
iSCSI ethernet
direct toepasbaar en flexibel
lage TCO en infrastructuurkosten
3
Voordelen van gecentraliseerde opslag
•
Flexibel en eenvoudig toewijzen
van capaciteit
•
Gemiddelde benutting in een
DAS-omgeving is < 50% (SAN = 85%)
•
Schijf en tape in hetzelfde opslag netwerk (50-75% minder tape drives)
•
Minder LAN-verkeer
•
Gecentraliseerd beheer
•
Beheer met minder mensen
(efficiency stijgt met factor 10)
•
Opslag, switches en tape toevoegen zonder applicaties stop te zetten
•
Zo veel redundantie als gewenst
4
iSCSI Storage
•
iSCSI staat voor Internet SCSI (Small Computer System Interface). Dit
is een op het Internet Protocol (IP) gebaseerde standaard voor IP
netwerken. Deze technologie is een versmelting van twee technieken
die zich in de industrie bewezen hebben. Het gaat om de technologie
die ontwikkeld is voor communicatie (ip netwerken) en de technologie
bedoeld voor dataopslag , SCSI opslag.
Door deze te combineren werd het mogelijk zowel de data als de
dataopslagcommando's over ip-netwerken te versturen.
•
Een netwerk protocol voor storage netwerken
•
Gebruikt de standaard ethernet tcp/ip netwerktechnologie eb hardware
5
Fibre Channel SAN
•
Fibre Channels work on a single popular storage networking protocol
that offer compatibility to all common storage and database servers.
•
Fibre Channels use the FCP protocol ( Fibre Channel Protocol) which
is simply a serial bus SCSI protocol.
•
This FCP (Fiber Channel protocol) works really well in networks with a
high bandwidth requirement.
•
Fibre Channel is een protocol dat voornamelijk wordt gebruik om data
binnen storage netwerken te transporteren. Vaak wordt Fibre Channel
geassocieerd met alleen glasverbindingen, maar het protocol kan
zowel over glas als koperverbindingen worden gebruikt.
6
iSCSI voordelen door Eenvoud
Geen noodzaak meer om te investeren in FC technologie of FC
kennis
Ethernet is bekende technologie
Ethernet heeft een lagere TCO en infrastructuur
Geen noodzaak meer om te investeren in FC technolog
of FC kosten
Geen FC HBAs meer nodig, optionele iSCSI ethernet kaarten voor
hogere prestaties
7
IP based versus FC based
FC HBA’s
2-4-8 GB
Standaard Netwerk ip-kaarten
1GBe-10GBe
•
Fibre Kabels
UTP kabels
•
Fibre Switches
Ethernet Switches
2-4-8 GB
1-10 GBe
8
De markt Fibre - iSCSI
Revenue Forecast by Installation
Environment
GB/$
$14B
$40
DAS
$35
$12B
$/GB
$30
$10B
FC SAN
$25
$8B
$20
$6B
$15
iSCSI SAN
$4B
$2B
$10
NAS
$5
Other SAN
$0
2009
2008
2007
2006
2005
2004
2003
2002
$0B
9
Storage Requirements for the Traditional
Data Center
Performance
Supports current workloads. No performance degradation
Scalability
Scale capacity and performance without disruption
Availability
Data stays online during a site failure, recover from disaster
Manageability
Simple to admister
10
Typical Storage Array Architecture
• Monolithic Array
Not scalable
• Controller head
becomes bottleneck
• Scales capacity only
Single point of failure
Forklift upgrades
11
WHICH CAN BE COMBINED IN OUR
FRAMELESS ARCHITECTURE
Performance
Scale when you need, as large as you need it,
but view as a single SAN
Number of disks
12
Typical iSCSI SAN
Exchange
SQL
Archive
Switched Gb Ethernet
Exchange
Archive
SQL
Storage Pool
1
2
Pages
RAID
RAID 10, 50 or 5
Disks
N
PS Series Array 1
13
Exchange
SQL
Archive
Switched Gb Ethernet
Exchange
Archive
SQL
Storage Pool
1
2
Pages
3
RAID
4
N
RAID 10, 50 or 5
RAID 10, 50 or 5
PS Series Array 1
PS Series Array 2
Disks
Automatic and transparent load balancing across arrays
14
The LeftHand Difference
15
SAN/iQ Storage Clustering
•
Storage cluster
•
Aggregates all components for
performance
Data is load balanced across all nodes
Predictable scalability
Grow on your terms
•
Non-disruptive scalability
No forklift upgrades
Scale everything
Throttle bandwidth
Create tiers of storage
•
SAS
SATA
Each optimized for type of data
Online volume migration
Simple centralized management
Provisioning
Monitoring
Security
Centralized Management Console
16
SAN/iQ Network RAID
•
Beyond component redundancy
Protects data from array failure
Synchronous replication
Configure on a per-volume basis
Configure on-the-fly, no down time
•
High availability
Multiple disks, controllers, or
arrays
Zero disruption of data access
Ensures “high availability” for data
SAN/iQ Cluster
A
D
A
D
A
B
A
B
C
B
C
B
C
D
C
D
17
SAN/iQ Multi-site SAN
•
Protect Storage By:
Rack
Room
Floor
Building
Site
•
SAN/iQ ClusterSAN/iQ Multi-site SAN
A
D
A
D
A
B
A
B
C
B
C
B
C
D
C
D
Keep Data Online During:
Facility disruption
Natural disaster
Site maintenance
Volumes Remain Online
18
SAN/iQ Thin Provisioning
•
Eliminate Initial Over-Purchasing
No Wasted and/or over-allocated
capacity
Purchase what you need today
•
SAN/iQ Cluster
Delay Future Storage Purchases
Grow capacity as warranted
•
Simple to Manage
Enable/Disable with radio button
on per-volume basis
Allocate only as data is written to
the volume
No Reserve necessary
Full Provisioned
Thin Provisioned
Allocated 200GB
Available 0GB
Used
0GB
50GB
100GB
Wasted
200GB
150GB
100GB
Allocated 100GB
0GB
50GB
50 GB written
50 GB written
50 GB written
50 GB written
200 GB Volume
200 GB Volume
Available 100GB
200GB
150GB
Used
0GB
50GB
100GB
Wasted
0GB
0GB
SAN/iQ Snapshots
•
Simplified Backup and Recovery
•
Point-in-time volume copies
Scheduled, Ad Hoc or Scripted
Functional
•
Volume rollback
Recover granular data
Backup Integration
• Microsoft VSS
• VMware VCB
Space Efficient
Thin provisioned always
Delta changes only
No snap reservation
SAN/iQ Cluster
1:00
1:00
2:00
3:00
20
SAN/iQ Remote Copy
Asynchronous Replication
•
Simple to Manage
SAN 1
SAN 2
Vol_1
(Remote
(Primar
y)
)
Per volume basis
Scheduled or manual
Thin provisioned
No reserve space required
Vol_1
(Primary)
•
Recovery
Server
Bandwidth management
Failover / Failback Wizard
1:00
1:00
2:00
2:00
3:00
3:00
Baseline Copy
Incremental Copy
Incremental Copy
21
Network Storage Server (NSS)
Intelligent Storage Virtualization
•
True heterogeneous intelligent storage virtualization
•
Application-aware data protection
•
WAN optimized disaster recovery services protect operations and save
on WAN costs
•
Increased storage efficiency through Thin Provisioning of resources
•
Your Storage, Your Infrastructure, Your Solution
22
TOTALLY Open Storage Virtualization
Platform
Exchange
Oracle
Windows
SQL
Linux
iSCSI
VMware
Solaris
Notes
DB2
HP-UX
AIX
SAP
Netware
InfiniBand
FC
Any
application
Any storage
protocol
Any operating
system
Any disk
array
Virtual
Physical
Data
Existing SAN
volumes via Storage
Service Enabler
Virtualized SAN
volumes
Thin provisioned
SAN volumes
23
Control storage management cost
and complexity
•
Consolidate heterogeneous storage management through virtualization
•
Minimize storage costs with thin provisioning
•
Centralized management of client systems simplifies operations
24
The Solution Starts with Consolidation
Critical Applications
SAN
File Servers
Application Servers
Backup Severs
SAN
• Enhanced storage
utilization
• Consolidated storage
management
• Opens the door for a
host of solutions and
innovations
25
How storage virtualization works
•
Quickly create virtual volumes from
across or within any physical disk
resources
- Simple wizard interface
- Physical LUN and virtual devices
up to 16TB
- Expand volumes as needed
•
Securely assign volumes to servers
through NSS interface
Virtual
disks
Physical
disks
26
Storage abstraction layer
•
Move the storage intelligence
and security into the SAN fabric
Hosts
NSS creates a storage
abstraction layer
•
•
Fabric
Storage services no longer
dependent on vendor-exclusive
disk functionality
Consolidates services and
operations
Storage
abstraction
layer
Disk
27
Thin Provisioning:
Better Storage Utilization
•
Create a virtual volume to match
size of data provisioning request
•
Allocate a smaller amount of
actual physical disk space
•
Additional physical space
allocated automatically as needed
•
Reduces wasteful over
provisioning of storage
•
Saves disk space and power
consumption
“800 GB”
Application
server sees
virtual volume
size
Virtual
800
GB
Physical
Data
200
GB
Thin provisioned SAN volume
28
Minimize downtime
• Highly available systems ensure continuous
operation
•
• Cross-array mirroring for ultimate data
protection
• Seamless, zero-downtime data migration
29
NSS high availability deployment model
Shared Storage Failover
•
NSS appliances deployed in
failover pairs
•
Each NSS server supports its own
set of client servers during normal
operations
SAN
•
If one devices fails, the second
device takes over servicing clients
30
Data mirroring, zero downtime migration
•
Any-to-any storage array synchronous data
mirroring
•
Ultimate data protection across arrays
•
Seamless data migration across storage
devices.
Writes
acknowledged
from both
arrays to
ensure
integrity
Create mirror
Switch primary/mirror status without any
break in application processing
Remove mirror (old array)
Primary
Mirror
Mirror
Primary
31
Ensure comprehensive data protection
• Application-aware snapshots provide rapid data recovery
• WAN optimized data replication for disaster recovery and
failback
• Host-free, accelerated backup eliminates all backup
windows
32
Application aware snapshots
•
Up to 256 snapshots per volume
•
Instant recovery to any captured
MS Exchange Oracle VMware
DB2 Informix SAP MS SQL Sybase
Notes/Domino Progress Pervasive SQL
point in time
•
Fully mountable as read/write
volumes
•
Each volume
has its own
snapshot
schedule
Application agents and consistency
groups for 100% transactional
integrity
1:00
1:30
2:00
1:00
5:00
9:00
8:00
9:00
10:00
2:30
11:00
33
WAN Optimized Disaster Recovery
• Easily configured any-to-any
remote replication
• Continuous or periodic modes
…
…
DR Site
Full replicas
• WAN optimized out of the box
• Includes WAN data encryption,
compression and QoS
Snapshots
Copy to tape
34
WAN Optimized Data Replication
•
•
Applications and file
systems write far more
data to disk than actual
changes
NSS scans the changes at
a 512 byte level and
replicates only the changed
data
- Avoids constant resending of duplicate
data
512
byte
= empty disk sector
= data written by application or file system
= sector with actual data change
512
byte
Disk sectors
A typical 8k write of
data. Many systems
send all 8k or more.
CDP sends only the
35
truly changed sectors.
VMware Advanced Features
•
Because continuous uptime is so critical, VMware has created
several advanced features designed to help system uptime
- VMware High Availability
- VMotion
- VMware Distributed Resource Scheduler
36
VMware High Availability/Vmotion/Scheduler
•
VMware High Availability automatically restarts virtual machines affected by
physical server failure
X
Shared storage pool
37
The Power of the Virtual SAN
•
The FalconStor Network Storage Server Virtual Appliance transforms
internal disk storage into an iSCSI SAN
- No additional storage network investment needed
•
Enables VMware advanced features
•
Cost effective, highly available infrastructure for the SMB and ROBO
38
FalconStor NSS Virtual Appliance Architecture
Virtual
Machines
VMFS
Volume
Virtual
Machines
VMFS
Volume
FalconStor
NSS VA
IP Network
Physical Ethernet Adapter
Virtual Switch
Virtual LUN for VMDK files
Server Internal RAID
39
High Availability via NSS VA Cross-Mirror
Virtual Infrastructure HA
supported without SAN
storage
To client
Standby NSS VA
Same size
virtual
LUN
Cross-over
Gigabit connection
Active Access Point
Passive Access Point
40