IPStor

advertisement
FalconStor: Simplifying
Data Protection for the
Enterprise
2006 Users Conference
Christopher L Poelker
VP Enterprise Solutions
FalconStor Software
FalconStor: Making the complex simple
Common Information Technology Goals
 Institute a Services Oriented Architecture for compute,
network and storage resources while leveraging
standards and best practices (ITIL) to:
 Reduce overall IT costs (CAPEX/OPEX)
 Reduce risk
 Improve ROI
 Improve service quality
 Leverage more business value out of IT
 Enable greater business productivity and flexibility
 Improve business objectives for RTO and RPO at the
lowest possible cost with the best possible return
FalconStor Software Confidential
2
Common Customer Requirements
 Solution must integrate with currently installed SAN and
backup solutions
 Solution must improve backup and recovery speed
 Reduce tape media requirements
 Eliminate tape shipping
 Reduce hardware costs
 Reduce footprint
 Integrate with existing policies and procedures
 Reduce storage requirements for retention
 Improve RTO and RPO objectives
 Provide centralized management
FalconStor Software Confidential
3
FalconStor’s Portfolio of Enabling Solutions
FalconStor Vision: Virtualized Data Services with Continuous Protection

Heterogeneous Storage Virtualization (Gain Operational Efficiency)

Multi-Protocol Storage Provisioning and Pooling (FC, IB, iSCSI, iSER, NAS)

CDP services for all data (Unified Data Protection)

CDR services for all data (Cost Effective Disaster Recovery)

VTL services (Reduce Backup Cost and Complexity)

Data reduction (Cost Effective Archive with User Based Recovery)

Regulatory Compliance (SEC17a4, HIPPA, etc.. WORM compliance)

Remote to Core services (Consolidate Backup, Protect all data)

Desktop/Laptop services (Continuous Protection with Bare Metal Recovery)

WAN optimization and Encryption (MicroScan+RUDP Reduces WAN Costs,
Encryption Reduces Risk)

PrimeVault DR Service
FalconStor Software Confidential
4
FalconStor: Unified Data Services
Complex Business Applications
FalconStor Technology
Heterogeneous Provisioning
Virtual Data Services
Heterogeneous Storage Pooling
Unified under a single Platform
Application SAN,
Quality
iSCSI,
of Service,
NAS, IB,
Capacity
Desktop,
on Demand
Remote Office
Simplicity
and
Value
iSCSI, FCP, IB, iSER, CIFS, NFS and GRID Storage
IPStor
Host Transparent Data Migration
Data Encryption, Compression
Core Data Protection Services
Redundant Data Elimination
Virtual Tape Backup
WAN Services
Continuous Data Protection and Replication
Remote Office Data Protection
Desktop, Laptop Data Protection (Bare Metal Restore)
Off-Site Disaster Recovery and Hosting (PrimeVault)
FalconStor Control of Resources
FalconStor Software Confidential
5
Traditional SAN Infrastructure
FalconStor Software Confidential
6
Future-Proof Datacenter Paradigm
FalconStor Software Confidential
7
Application Focused Recovery
DB Servers
App Servers
Web Servers
DAS
DAS
DAS
DAS
DAS
DAS
Fabric
CDP
3 Tier App
DB
CDR
Log
Database
Primary
App
Consistency Group
Business Logic
Modular
Single Image
Recovery
FalconStor Software Confidential
8
Future Proof Data Protection
Continuous Data
Fabric
Journaling






Any Vendor
TimeMark application consistency
Guaranteed write order fidelity
Point and Click DR roll reversal
Encrypted data
Data Reduction
Transparent Data Migration and Tech
refresh
Any Vendor
FalconStor Software Confidential
9
Recovery LifeCycle Management
FalconStor is the only company today that enables unified data protection and recovery during the entire lifecycle of data
Any Application
Single
Instance
Archive
X:1
Remote Sites
0110110
Continuous DR
Replication
Repository
Off-Frame
Copy
Any Storage
CDP journal
2:34:59
2:34:58 …
Seconds
VTL Backup
Consistent
off-frame
recovery
Consistent
DR recovery
Tape Export
Consistent
Virtual Tape
recovery
Consistent
Tape
recovery
2:00pm
2:00pm
Mon
Jan
3:00pm
3:00pm
Tues
Feb
4:00pm
4:00pm
Wed
Mar
5:00pm
5:00pm
Thurs
Apr
Weeks
Weeks
Months
FalconStor Software Confidential
Years
10
Information LifeCycle Management
FalconStor is the only company today that enables transparent data protection and recovery spanning the entire lifecycle of data
Tier 1
Tier 2
Tier 3
Tier 4
Production
Recovery
DR
Archive
Storage Class:
Enterprise
Storage Class:
Modular FC
Storage Class:
Modular SATA
Storage Class:
Bulk/Tape
Single
Instance
Archive
X:1
Repository
Unified Host Transparent Data Movement Via IPStor Engine
Primary
CDP journal
2:34:59
2:34:58 …
Seconds
Consistent
off-frame
recovery
Consistent
DR recovery
Consistent
Virtual Tape
recovery
Consistent
Tape
recovery
2:00pm
2:00pm
Mon
Jan
3:00pm
3:00pm
Tues
Feb
4:00pm
4:00pm
Wed
Mar
5:00pm
5:00pm
Thurs
Apr
Weeks
Weeks
Months
FalconStor Software Confidential
Years
11
TimeMark Storage Efficiency: Reducing Storage Costs
TimeMark snapshot is extremely efficient
 Standard block size is a function of the size of
the file system
•
•
They have different bitmap granularities
Measure in Kbytes (4K, 8K,64K,OCFS=128KB)
Appl
Server
KB
CDP
KB
KB
 “Microscan” turned on increases
granularity to a sector level
3
2
• Measured in 512 bytes
1
Full Volume
Snapshot
Resource Area
B
B
B
B
B
 Less storage required for each retained TimeMark
 This is also a bandwidth metric – Less data transferred
FalconStor Software Confidential
12
MicroScan Data Replication Efficiency
Minimum amount of data being sent over a WAN link for each write
FalconStor is:
64 times more efficient than EMC
32 time more efficient than HDS
35000
8 times better than NetApp or Kashya
30000
25000
20000
15000
10000
5000
0

EMC = 32KB

HDS = 16KB

NetApp = 4KB

Kashya = determined by file system

FalconStor = 512bytes
EM
C
H
DS
N
pp
A
et
Ka
ya
h
s
l
Fa
r
to
S
n
co
FalconStor dramatically reduces WAN bandwidth requirements
FalconStor Software Confidential
13
Improving WAN Efficiency
Peak: 49Mb/s
Peak: 4Mb/s
FTP 200MB file
Native
635 Seconds
45Mb Bandwidth
4,000 miles 1-way (NY to Sweden)
80 ms Round Trip Delay
.12% packet loss
RUDP
50 Seconds
RUDP Performance Test – 45Mb
FalconStor Software Confidential
14
Reduce WAN and Storage Costs via MicroScan
MicroScan Efficiency: Actual Case Study
FalconStor Software Confidential
15
Storage and Replication ROI
T3 connection = 5.5925 MB/s – 10% overhead = 5.03 MB/s,(18GBH) $7 500-$14k/month
OC1 connection = 6.48 MB/s – 10% overhead = 5.83 MB/s, $9k-$18k/month
OC3 connection = 19.44 MB/s – 10% overhead = 17.49 MB/s, $10k-$30k/month
OC12 connection = 77.76 MB/s – 10% overhead = 69.984 MB/s, $100k-$300k/month
OC48 connection = 306.104 MB/s – 10% overhead = 275.4936 MB/s, $300k-$500k/month
Data
1.2TB
WAN
link
Normal Replication
With
MicroScan
WAN needed without
MicroScan to replicate
in 10.7 hours
MicroScan Annual
WAN Cost Savings
Time
T3
68 hours
10.7 hours
2 x OC3
$600,000
Note: Assumes 84% MicroScan Reduction
FalconStor Software Confidential
16
DiskSafe and FileSafe Backup (Blocks or Files)
Windows Servers/Desktop/Notebook
FileSafe
Local
Disk P
DiskSafe
Days or weeks of on-disk recovery using dramatically
less storage than other backup solutions
Small
Office
Always a Logically Full Backup
User Enabled Self-service Restore
MicroScan™ RDE minimizes bandwidth
Data is encrypted on transport
Bare Metal Recovery (DiskSafe)
Local
Disk Q
WAN
LAN (iSCSI)
Central Site
1st Backup = Couple of Hours
From then on = Couple of Minutes
IPStor Server
Only Deltas are transmitted and stored
Always a Synthetic FULL Backup
Disk P
Files
Advanced data hashing/de-duplication
(Save WAN costs and Storage costs)
Can replace existing backup software
Disk Q
Blocks
FileSafe V1
Delta Snapshot -1
FileSafe V2
Delta Snapshot -2
FileSafe V..N
Delta Snapshot -N
Better functionality than Avamar, Kashya, Data Domain, Symantec PureDisk
Centralize protection for remote locations and desktop data
80% Less Storage
FalconStor Software Confidential
17
User Enabled Restore of any File Version
User enabled recovery from repository
No backup application required
Immediate access to multiple versions of data
Searchable index
IPStor Server
FalconStor Software Confidential
18
Remote Office Consolidation
Windows Servers/Desktop/Notebook
FileSafe
Local
Disk P
DiskSafe
Local
Disk Q
DiskSafe
Local
Disk R
WAN Throttling and Tuning
Auto-resume on WAN outage/recovery
Complete Write Order Fidelity
Integrated Redundant Data Elimination
Built-in Remote service/Callhome/SNMP
Bare Metal Recovery
LAN (iSCSI)
All Recovery Done Locally
Including BMR
All Data Replicated for DR
80% Less WAN
80% Less Storage
Encryption Included
RUDP WAN Optimization Included
Replicate to Central Site
with Encryption, Compression,
and MicroScan RDE
IPStor Server
Disk P
Files
Disk Q
Blocks
Disk R
Blocks
FileSafe V1
Delta Snapshot -1
Delta Snapshot -1
FileSafe V2
Delta Snapshot -2
Delta Snapshot -2
FileSafe V…N
Delta Snapshot -N
Delta Snapshot -N
Better functionality than Riverbed, Avamar or Data Domain
FalconStor Software Confidential
19
Example: Corporate Data Protection
Small
Office
Small
Office
Small
Office
Small
Office
Small
Office
r-hub
r-hub
r-hub
Site1
Site2
Site3
DR
Primary
e-hub
e-hub
r-hub
r-hub
Site4
Site5
Legend
512k Small Office Data Link
T1 Bi-Directional Data Link
OC-3 Bi-Directional
Active/Active Data link
Small
Office
Small
Office
Small
Office
Small
Office
Small
Office
FalconStor Software Confidential
20
Solution Example
Primary 1
Primary 2
FalconStor Software Confidential
21
Actual Savings
 95% better Recovery Time
• Tape was four to 12 hours
 Eliminated Backup Windows
• 18MB/s to >80MB/s per LUN (Approx 3.5TB per Hour)
 99% improvement in RPO
• Near zero data loss vs. 12-24 hours
• Use of Space Efficient Copies, (not full copies)
 Use of Microscan, (RDE), to save 85% of storage Space
• Total Tier II Disk 2.5 TB vs. 20 TB of Tier I storage
 85% saving on bandwidth required for DR
• 8 MB/sec, (100 mbps) vs. 60 MB/sec, (Full GigE)
 Use of Tier II Storage educed solution costs
 Eliminated backup windows
 Applied new DR capabilities for ALL applications
FalconStor Software Confidential
22
IPStor Directions
FalconStor Software Confidential
23
IPStor – 2006
 IPStor v5.1 “Constellation” Released – June
2006
• Continuous Data Protection Journal
– Allows users to select more granular points in time for recovery
• System CrossMirror
– High availability for appliances without requiring shared (FC) storage
• 4Gb Fibre Channel support
FalconStor Software Confidential
24
IPStor – 2007
 IPStor v5.x “Olympic” Release – Early 2007
• InfiniBand target support
– High-speed connectivity using iSER
• Centralized Management
– DiskSafe, FileSafe, DynaPath, Snapshot Agents
•
•
•
•
•
Support for LUNs larger than 2TB
Encryption at rest
Multipoint replication
Multi-hop replication (Local Sync to Remote Async)
Multi-Node IPStor N-WAY
FalconStor Software Confidential
25
Continuous Data Protection Journal
How It Works …

Continuous
•
•

Journal
•
•

Primary
Data

•
TimeMark #3
TimeMark #2
TimeMark #1

A full, independent copy of the primary data
Updated from journal as needed (based on time or when
journal fills)
TimeMarks
•
•
Replica
Journal tracks data changes before they are committed
TimeMarks are recorded in journal as special entries
Replica
•
•
Journal
Host writes to primary data disk
IPStor or DiskSafe duplicates write to CDP journal area
Used for long-term data protection
Snapshot Agents for point-in-time recovery of databases,
e-mail, file systems
LUN consistency groups
Recovery
•
•
TimeMark(s) can recover data to fixed times
Journal can recover data written after TimeMark(s)
FalconStor Software Confidential
26
CDP Recovery to last uSecond
FalconStor Software Confidential
27
N-Way Virtualization with CDP Detail
Each IPStor treated as a path
Each IPStor can have many 4Gbit Connection Paths
2PB Storage Supported
N-Way managed as a single instance
Host
A
•Up to 32 Paths Per LUN
•Host Transparent Failover
•Online Upgrades/Maintenance
•Dynamic Load Balancing
•Massive Scalability
B
CDP
IPStor
IPStor
IPStor
IPStor
IPStor
IPStor
CDR
IPStor
IPStor
P
R
P
S
FalconStor Software Confidential
30
N-Way with CDP Mirror Replica and TM
Host
Each IPStor configured
Identically. Service Enable the
same Physical LUN, assign to
Host, and Mirror to IPStor-CDP.
SAN
P
Supports DynaPath AND
PowerPath in Active-Active mode.
IPStor P1
IPStor P2
SED
M
FC Mirror
IPStor Pn
SED
M
FC Mirror
SED
M
FC Mirror
SAN
P
TM1
IPStor CDP
TM2
M
…
TMn
FalconStor Software Confidential
31
CDP Fast (Delta) Recovery
Primary Site
IPStor CDP
Nearline
Server
FS Mirror
1. Primary LUN P is also
assigned to IPStorCDP.
2. Establish Mirror from
R1 to P without full
Sync.
3. Perform TimeMark or
CDP Rollback to
repair R1 and P
4. Remove/Suspend
Mirror
Primary
TimeMarks
PP
Mirror
CDP Cache
FalconStor Software Confidential
32
Online Banking Example (East Coast)
IPStor Console
FalconStor Software Confidential
33
Enhanced DR and Archive Environment
Legato
Encrypted Tapes
CDR
CDP
HyperTrack
VTL
SATA
SATA
FalconStor Software Confidential
34
Oracle RAC Environment
RX4640 RAC
DL380 Apps
Recovery Server
RMAN
Active
Active
8FC
IPStor
Cluster
8FC
4FC
4FC
Consistent
recovery points
CDP Journal
2:00pm
CDP/CDR
3:00pm
4:00pm
5:00pm
EVA3000
FalconStor Software Confidential
35
Oracle RAC Disaster Recovery and Archive
RX4640 RAC
DL380 Apps
Tapes Encrypted on Export from VTL
Active
4GBFC
CDR
HyperTrack
IPStor
VTL
SATA
SATA
FalconStor Software Confidential
36
IPStor v5.x System CrossMirror
Configuration

2 matching IPStor appliances

DAS/internal storage (50% utilized)

Interlinked using iSCSI to share storage

Every drive is duplicated
Host
Switch
Normal operations

LUNs visible from target ports on one IPStor
appliance

Writes to LUN are copied to drive in partner
before returning to host
A
Failover procedure

System detects failures of partner and takes
over if needed

Survivor assumes operation for failed partner;
LUN access moved to survivor

Survivor tracks changes while partner is down
A’
Benefits

Benefits of mirroring and failover

No shared (FC) storage

Low Cost!
IPStor
Servers
O
C
FalconStor Software Confidential
37
Self Healing Compute and Storage
IBRIX
LUSTRE
PLATFORM
POLYSERVE
Oracle RAC
Etc….
iSER
iSER
Cross System Mirror
FalconStor Software Confidential
38
Example: State Government iSCSI stretched
cluster
City A
City B
Sync Mirror
Local Disk Access
iSCSI
Local Disk Access
Gigabit Ethernet
iSCSI
iSCSI presentation of FC disk to enterprise appliances across Gig-E link allows transparent failover between sites with NO SAN!
FalconStor Software Confidential
39
Microsoft Exchange Stretched Cluster
500GB
Host LUNS
500GB
Cluster Link
Site A
Site B
Bi-Directional Mirror
FC Distance
FalconStor Software Confidential
40
Polyserve and FalconStor Matrix GeoCluster
Active Production Site
Active Recovery Site
Continuous Data Replication
FalconStor Software Confidential
41
IPStor GRID Solutions
FalconStor Software Confidential
42
Why Infiniband?
FalconStor Software Confidential
43
Commodity iSER Target or Router
Voltaire/Topspin
InfiniBand Switch
Performance
Target
730
MB/s
Initiator
900
MB/s
400
MB/s
Initiator
FC
iSER
iSER
(1 Target)
(>1 Target)
Delivering unprecedented cost/performance,
leveraging on industry standard components
FalconStor Software Confidential
44
IHM Institute for Health Metrics:
“FC Free” Data Center
Data from
Hospitals
Voltaire Grid Director
ISR 9096
Native InfiniBand Storage
with FalconStor IPStor
WAN Router
Local Users
InfiniBand
VTL
Application
Servers
Oracle 10g RAC
Cluster
FalconStor Software Confidential
45
Virtual Tape
What is FalconStor VirtualTape Library?
Disaster recovery site with
 Disk
storage array
backup servers
emulates tape drive or
library
Application Servers with 3rd Party Backup Software
TSM
Emulates a
tape library
Backup
Media
Servers
Fibre Channel or iSCSI
VirtualTape
Library
Appliance
FC-attached
RAID Storage
(FC and/or
ATA)
RemoteReplication
Import
Export
 VTL’s HA architecture
guarantees the
backup/restore operation
won’t be interrupted
 Exported tapes can be injected
into a
2
non VTL infrastructure
3
3
Any Primary Storage
 Leverages FalconStor VTL
services to simplify tape
management
 Import/ Export from/to physical tape
without impact to servers and with no
backup window
1
1
2
 Provides high-speed data
transfer
 Tapes can be replicated and encrypted
Any Secondary Storage
FalconStor Software Confidential
47
VirtualTape Library Releases
 VTL 5 “Rockwell” Release – Q1 2007
• Multi-node group
• Single Instance Repository
– Backup data contains 80% typical redundancy between full backups
– Reduces VTL disk storage needs
– Reduction done outside backup window to avoid impact on application servers
• Tape Stacking
–
–
–
–
Export many virtual tapes to a single physical tape
Allows VTL to make most efficient use of available physical media
Preserves investment in older tape equipment
Allows users to transition to newer equipment gradually
• Tape Shredding
– Uses DoD 5220.22-M secure erase standard to expunge data
• 4 Gb QLogic HBA support (Active/Active
FalconStor Software Confidential
48
MultiNode Group
 Linear Scalability
• Up to 8 nodes (mixture of single nodes and HA pairs)
 Performance
• 8 * 800 MB/s = 6.4 GB/s = 23 TB/h throughput
 Capacity
• 8 * 64 = 512 tape libraries
• 8 * 512 = 4096 tape drives
• 8 * 32K = 256K virtual tape cartridges
 Unified Management
FalconStor Software Confidential
49
FalconStor Single Instance Repository
FalconStor Software Confidential
50
FalconStor VTL with Single Instance
Repository
Servers
Backup Software Agnostic
Data Coalescence
Time Based
Inter-Nodal
Intra-Nodal
Sub-Block
Client Enabled Restores
User Based Recovery
Multiple versions of
files can be viewed and
restored independent of
backup application
>80% Reduction
Backup Software Independent
500:1
FalconStor Software Confidential
51
Shadow Virtual Tape
 Single Instance scan:
• The file data is extracted and added to the repository.
• File data is replaced with links to the extracted data.
File Data
File
Metadata
File Data
File
Metadata
File
Metadata
Directory
Metadata
Session
Header
Volume
Header
Original Data:
File Data
File Data
File
Link
File
Metadata
File
Link
File
Metadata
File
Link
File
Metadata
Directory
Metadata
Session
Header
Volume
Header
After Scan Process:
File Data
File Data
FalconStor Software Confidential
52
Shadow Virtual Tape
 After Single Instance Scan:
File
Link
File
Metadata
File
Link
File
Metadata
File
Link
File
Metadata
Directory
Metadata
Session
Header
Volume
Header
• The resulting virtual tapes contain only the backup metadata with the
links to the repository file data entries.
• The links are the keys to retrieve the data when needed.
• These links are used by either the backup application or FileSafe
client to recover data from the repository
Links
File Data
File Data
File Data
Single Instance Repository
FalconStor Software Confidential
53
Existing D > D >T Backup
Retention = 1 year
Total Media = 300TB
240TB
20TB
20TB
20TB
Primary
D to D
Copy
Tape
Copy
Tape
Archives
(12 Monthly)
Note: At Zero Change rate for simplicity
FalconStor Software Confidential
54
VTL with SIR
Retention = 1 year
>400% Savings in year 1 media costs
Total Media = 72.4TB
20TB
20.4TB
24TB
Simplify:
D to T IS
D to D copy
Tape
Archives
Primary
Re-purpose
original D
copy as VTL
4TB
VTL
SIR
FalconStor Software Confidential
55
Example: Virtual Tape with SIR
Value: Leverage existing storage for automated data protection and archiving
Savings in this case: $500,000 less per year in media costs
FalconStor Software Confidential
$90,000 savings per month in WAN costs
56
Summary
The FalconStor value model
Decrease Operational Costs







Staff utilization
Storage utilization
Server utilization
Backup costs
Network costs
Media Costs
Storage Costs
FalconStor Software Confidential
58
Thank You!
Download