FalconStor: Simplifying Data Protection for the Enterprise 2006 Users Conference Christopher L Poelker VP Enterprise Solutions FalconStor Software FalconStor: Making the complex simple Common Information Technology Goals Institute a Services Oriented Architecture for compute, network and storage resources while leveraging standards and best practices (ITIL) to: Reduce overall IT costs (CAPEX/OPEX) Reduce risk Improve ROI Improve service quality Leverage more business value out of IT Enable greater business productivity and flexibility Improve business objectives for RTO and RPO at the lowest possible cost with the best possible return FalconStor Software Confidential 2 Common Customer Requirements Solution must integrate with currently installed SAN and backup solutions Solution must improve backup and recovery speed Reduce tape media requirements Eliminate tape shipping Reduce hardware costs Reduce footprint Integrate with existing policies and procedures Reduce storage requirements for retention Improve RTO and RPO objectives Provide centralized management FalconStor Software Confidential 3 FalconStor’s Portfolio of Enabling Solutions FalconStor Vision: Virtualized Data Services with Continuous Protection Heterogeneous Storage Virtualization (Gain Operational Efficiency) Multi-Protocol Storage Provisioning and Pooling (FC, IB, iSCSI, iSER, NAS) CDP services for all data (Unified Data Protection) CDR services for all data (Cost Effective Disaster Recovery) VTL services (Reduce Backup Cost and Complexity) Data reduction (Cost Effective Archive with User Based Recovery) Regulatory Compliance (SEC17a4, HIPPA, etc.. WORM compliance) Remote to Core services (Consolidate Backup, Protect all data) Desktop/Laptop services (Continuous Protection with Bare Metal Recovery) WAN optimization and Encryption (MicroScan+RUDP Reduces WAN Costs, Encryption Reduces Risk) PrimeVault DR Service FalconStor Software Confidential 4 FalconStor: Unified Data Services Complex Business Applications FalconStor Technology Heterogeneous Provisioning Virtual Data Services Heterogeneous Storage Pooling Unified under a single Platform Application SAN, Quality iSCSI, of Service, NAS, IB, Capacity Desktop, on Demand Remote Office Simplicity and Value iSCSI, FCP, IB, iSER, CIFS, NFS and GRID Storage IPStor Host Transparent Data Migration Data Encryption, Compression Core Data Protection Services Redundant Data Elimination Virtual Tape Backup WAN Services Continuous Data Protection and Replication Remote Office Data Protection Desktop, Laptop Data Protection (Bare Metal Restore) Off-Site Disaster Recovery and Hosting (PrimeVault) FalconStor Control of Resources FalconStor Software Confidential 5 Traditional SAN Infrastructure FalconStor Software Confidential 6 Future-Proof Datacenter Paradigm FalconStor Software Confidential 7 Application Focused Recovery DB Servers App Servers Web Servers DAS DAS DAS DAS DAS DAS Fabric CDP 3 Tier App DB CDR Log Database Primary App Consistency Group Business Logic Modular Single Image Recovery FalconStor Software Confidential 8 Future Proof Data Protection Continuous Data Fabric Journaling Any Vendor TimeMark application consistency Guaranteed write order fidelity Point and Click DR roll reversal Encrypted data Data Reduction Transparent Data Migration and Tech refresh Any Vendor FalconStor Software Confidential 9 Recovery LifeCycle Management FalconStor is the only company today that enables unified data protection and recovery during the entire lifecycle of data Any Application Single Instance Archive X:1 Remote Sites 0110110 Continuous DR Replication Repository Off-Frame Copy Any Storage CDP journal 2:34:59 2:34:58 … Seconds VTL Backup Consistent off-frame recovery Consistent DR recovery Tape Export Consistent Virtual Tape recovery Consistent Tape recovery 2:00pm 2:00pm Mon Jan 3:00pm 3:00pm Tues Feb 4:00pm 4:00pm Wed Mar 5:00pm 5:00pm Thurs Apr Weeks Weeks Months FalconStor Software Confidential Years 10 Information LifeCycle Management FalconStor is the only company today that enables transparent data protection and recovery spanning the entire lifecycle of data Tier 1 Tier 2 Tier 3 Tier 4 Production Recovery DR Archive Storage Class: Enterprise Storage Class: Modular FC Storage Class: Modular SATA Storage Class: Bulk/Tape Single Instance Archive X:1 Repository Unified Host Transparent Data Movement Via IPStor Engine Primary CDP journal 2:34:59 2:34:58 … Seconds Consistent off-frame recovery Consistent DR recovery Consistent Virtual Tape recovery Consistent Tape recovery 2:00pm 2:00pm Mon Jan 3:00pm 3:00pm Tues Feb 4:00pm 4:00pm Wed Mar 5:00pm 5:00pm Thurs Apr Weeks Weeks Months FalconStor Software Confidential Years 11 TimeMark Storage Efficiency: Reducing Storage Costs TimeMark snapshot is extremely efficient Standard block size is a function of the size of the file system • • They have different bitmap granularities Measure in Kbytes (4K, 8K,64K,OCFS=128KB) Appl Server KB CDP KB KB “Microscan” turned on increases granularity to a sector level 3 2 • Measured in 512 bytes 1 Full Volume Snapshot Resource Area B B B B B Less storage required for each retained TimeMark This is also a bandwidth metric – Less data transferred FalconStor Software Confidential 12 MicroScan Data Replication Efficiency Minimum amount of data being sent over a WAN link for each write FalconStor is: 64 times more efficient than EMC 32 time more efficient than HDS 35000 8 times better than NetApp or Kashya 30000 25000 20000 15000 10000 5000 0 EMC = 32KB HDS = 16KB NetApp = 4KB Kashya = determined by file system FalconStor = 512bytes EM C H DS N pp A et Ka ya h s l Fa r to S n co FalconStor dramatically reduces WAN bandwidth requirements FalconStor Software Confidential 13 Improving WAN Efficiency Peak: 49Mb/s Peak: 4Mb/s FTP 200MB file Native 635 Seconds 45Mb Bandwidth 4,000 miles 1-way (NY to Sweden) 80 ms Round Trip Delay .12% packet loss RUDP 50 Seconds RUDP Performance Test – 45Mb FalconStor Software Confidential 14 Reduce WAN and Storage Costs via MicroScan MicroScan Efficiency: Actual Case Study FalconStor Software Confidential 15 Storage and Replication ROI T3 connection = 5.5925 MB/s – 10% overhead = 5.03 MB/s,(18GBH) $7 500-$14k/month OC1 connection = 6.48 MB/s – 10% overhead = 5.83 MB/s, $9k-$18k/month OC3 connection = 19.44 MB/s – 10% overhead = 17.49 MB/s, $10k-$30k/month OC12 connection = 77.76 MB/s – 10% overhead = 69.984 MB/s, $100k-$300k/month OC48 connection = 306.104 MB/s – 10% overhead = 275.4936 MB/s, $300k-$500k/month Data 1.2TB WAN link Normal Replication With MicroScan WAN needed without MicroScan to replicate in 10.7 hours MicroScan Annual WAN Cost Savings Time T3 68 hours 10.7 hours 2 x OC3 $600,000 Note: Assumes 84% MicroScan Reduction FalconStor Software Confidential 16 DiskSafe and FileSafe Backup (Blocks or Files) Windows Servers/Desktop/Notebook FileSafe Local Disk P DiskSafe Days or weeks of on-disk recovery using dramatically less storage than other backup solutions Small Office Always a Logically Full Backup User Enabled Self-service Restore MicroScan™ RDE minimizes bandwidth Data is encrypted on transport Bare Metal Recovery (DiskSafe) Local Disk Q WAN LAN (iSCSI) Central Site 1st Backup = Couple of Hours From then on = Couple of Minutes IPStor Server Only Deltas are transmitted and stored Always a Synthetic FULL Backup Disk P Files Advanced data hashing/de-duplication (Save WAN costs and Storage costs) Can replace existing backup software Disk Q Blocks FileSafe V1 Delta Snapshot -1 FileSafe V2 Delta Snapshot -2 FileSafe V..N Delta Snapshot -N Better functionality than Avamar, Kashya, Data Domain, Symantec PureDisk Centralize protection for remote locations and desktop data 80% Less Storage FalconStor Software Confidential 17 User Enabled Restore of any File Version User enabled recovery from repository No backup application required Immediate access to multiple versions of data Searchable index IPStor Server FalconStor Software Confidential 18 Remote Office Consolidation Windows Servers/Desktop/Notebook FileSafe Local Disk P DiskSafe Local Disk Q DiskSafe Local Disk R WAN Throttling and Tuning Auto-resume on WAN outage/recovery Complete Write Order Fidelity Integrated Redundant Data Elimination Built-in Remote service/Callhome/SNMP Bare Metal Recovery LAN (iSCSI) All Recovery Done Locally Including BMR All Data Replicated for DR 80% Less WAN 80% Less Storage Encryption Included RUDP WAN Optimization Included Replicate to Central Site with Encryption, Compression, and MicroScan RDE IPStor Server Disk P Files Disk Q Blocks Disk R Blocks FileSafe V1 Delta Snapshot -1 Delta Snapshot -1 FileSafe V2 Delta Snapshot -2 Delta Snapshot -2 FileSafe V…N Delta Snapshot -N Delta Snapshot -N Better functionality than Riverbed, Avamar or Data Domain FalconStor Software Confidential 19 Example: Corporate Data Protection Small Office Small Office Small Office Small Office Small Office r-hub r-hub r-hub Site1 Site2 Site3 DR Primary e-hub e-hub r-hub r-hub Site4 Site5 Legend 512k Small Office Data Link T1 Bi-Directional Data Link OC-3 Bi-Directional Active/Active Data link Small Office Small Office Small Office Small Office Small Office FalconStor Software Confidential 20 Solution Example Primary 1 Primary 2 FalconStor Software Confidential 21 Actual Savings 95% better Recovery Time • Tape was four to 12 hours Eliminated Backup Windows • 18MB/s to >80MB/s per LUN (Approx 3.5TB per Hour) 99% improvement in RPO • Near zero data loss vs. 12-24 hours • Use of Space Efficient Copies, (not full copies) Use of Microscan, (RDE), to save 85% of storage Space • Total Tier II Disk 2.5 TB vs. 20 TB of Tier I storage 85% saving on bandwidth required for DR • 8 MB/sec, (100 mbps) vs. 60 MB/sec, (Full GigE) Use of Tier II Storage educed solution costs Eliminated backup windows Applied new DR capabilities for ALL applications FalconStor Software Confidential 22 IPStor Directions FalconStor Software Confidential 23 IPStor – 2006 IPStor v5.1 “Constellation” Released – June 2006 • Continuous Data Protection Journal – Allows users to select more granular points in time for recovery • System CrossMirror – High availability for appliances without requiring shared (FC) storage • 4Gb Fibre Channel support FalconStor Software Confidential 24 IPStor – 2007 IPStor v5.x “Olympic” Release – Early 2007 • InfiniBand target support – High-speed connectivity using iSER • Centralized Management – DiskSafe, FileSafe, DynaPath, Snapshot Agents • • • • • Support for LUNs larger than 2TB Encryption at rest Multipoint replication Multi-hop replication (Local Sync to Remote Async) Multi-Node IPStor N-WAY FalconStor Software Confidential 25 Continuous Data Protection Journal How It Works … Continuous • • Journal • • Primary Data • TimeMark #3 TimeMark #2 TimeMark #1 A full, independent copy of the primary data Updated from journal as needed (based on time or when journal fills) TimeMarks • • Replica Journal tracks data changes before they are committed TimeMarks are recorded in journal as special entries Replica • • Journal Host writes to primary data disk IPStor or DiskSafe duplicates write to CDP journal area Used for long-term data protection Snapshot Agents for point-in-time recovery of databases, e-mail, file systems LUN consistency groups Recovery • • TimeMark(s) can recover data to fixed times Journal can recover data written after TimeMark(s) FalconStor Software Confidential 26 CDP Recovery to last uSecond FalconStor Software Confidential 27 N-Way Virtualization with CDP Detail Each IPStor treated as a path Each IPStor can have many 4Gbit Connection Paths 2PB Storage Supported N-Way managed as a single instance Host A •Up to 32 Paths Per LUN •Host Transparent Failover •Online Upgrades/Maintenance •Dynamic Load Balancing •Massive Scalability B CDP IPStor IPStor IPStor IPStor IPStor IPStor CDR IPStor IPStor P R P S FalconStor Software Confidential 30 N-Way with CDP Mirror Replica and TM Host Each IPStor configured Identically. Service Enable the same Physical LUN, assign to Host, and Mirror to IPStor-CDP. SAN P Supports DynaPath AND PowerPath in Active-Active mode. IPStor P1 IPStor P2 SED M FC Mirror IPStor Pn SED M FC Mirror SED M FC Mirror SAN P TM1 IPStor CDP TM2 M … TMn FalconStor Software Confidential 31 CDP Fast (Delta) Recovery Primary Site IPStor CDP Nearline Server FS Mirror 1. Primary LUN P is also assigned to IPStorCDP. 2. Establish Mirror from R1 to P without full Sync. 3. Perform TimeMark or CDP Rollback to repair R1 and P 4. Remove/Suspend Mirror Primary TimeMarks PP Mirror CDP Cache FalconStor Software Confidential 32 Online Banking Example (East Coast) IPStor Console FalconStor Software Confidential 33 Enhanced DR and Archive Environment Legato Encrypted Tapes CDR CDP HyperTrack VTL SATA SATA FalconStor Software Confidential 34 Oracle RAC Environment RX4640 RAC DL380 Apps Recovery Server RMAN Active Active 8FC IPStor Cluster 8FC 4FC 4FC Consistent recovery points CDP Journal 2:00pm CDP/CDR 3:00pm 4:00pm 5:00pm EVA3000 FalconStor Software Confidential 35 Oracle RAC Disaster Recovery and Archive RX4640 RAC DL380 Apps Tapes Encrypted on Export from VTL Active 4GBFC CDR HyperTrack IPStor VTL SATA SATA FalconStor Software Confidential 36 IPStor v5.x System CrossMirror Configuration 2 matching IPStor appliances DAS/internal storage (50% utilized) Interlinked using iSCSI to share storage Every drive is duplicated Host Switch Normal operations LUNs visible from target ports on one IPStor appliance Writes to LUN are copied to drive in partner before returning to host A Failover procedure System detects failures of partner and takes over if needed Survivor assumes operation for failed partner; LUN access moved to survivor Survivor tracks changes while partner is down A’ Benefits Benefits of mirroring and failover No shared (FC) storage Low Cost! IPStor Servers O C FalconStor Software Confidential 37 Self Healing Compute and Storage IBRIX LUSTRE PLATFORM POLYSERVE Oracle RAC Etc…. iSER iSER Cross System Mirror FalconStor Software Confidential 38 Example: State Government iSCSI stretched cluster City A City B Sync Mirror Local Disk Access iSCSI Local Disk Access Gigabit Ethernet iSCSI iSCSI presentation of FC disk to enterprise appliances across Gig-E link allows transparent failover between sites with NO SAN! FalconStor Software Confidential 39 Microsoft Exchange Stretched Cluster 500GB Host LUNS 500GB Cluster Link Site A Site B Bi-Directional Mirror FC Distance FalconStor Software Confidential 40 Polyserve and FalconStor Matrix GeoCluster Active Production Site Active Recovery Site Continuous Data Replication FalconStor Software Confidential 41 IPStor GRID Solutions FalconStor Software Confidential 42 Why Infiniband? FalconStor Software Confidential 43 Commodity iSER Target or Router Voltaire/Topspin InfiniBand Switch Performance Target 730 MB/s Initiator 900 MB/s 400 MB/s Initiator FC iSER iSER (1 Target) (>1 Target) Delivering unprecedented cost/performance, leveraging on industry standard components FalconStor Software Confidential 44 IHM Institute for Health Metrics: “FC Free” Data Center Data from Hospitals Voltaire Grid Director ISR 9096 Native InfiniBand Storage with FalconStor IPStor WAN Router Local Users InfiniBand VTL Application Servers Oracle 10g RAC Cluster FalconStor Software Confidential 45 Virtual Tape What is FalconStor VirtualTape Library? Disaster recovery site with Disk storage array backup servers emulates tape drive or library Application Servers with 3rd Party Backup Software TSM Emulates a tape library Backup Media Servers Fibre Channel or iSCSI VirtualTape Library Appliance FC-attached RAID Storage (FC and/or ATA) RemoteReplication Import Export VTL’s HA architecture guarantees the backup/restore operation won’t be interrupted Exported tapes can be injected into a 2 non VTL infrastructure 3 3 Any Primary Storage Leverages FalconStor VTL services to simplify tape management Import/ Export from/to physical tape without impact to servers and with no backup window 1 1 2 Provides high-speed data transfer Tapes can be replicated and encrypted Any Secondary Storage FalconStor Software Confidential 47 VirtualTape Library Releases VTL 5 “Rockwell” Release – Q1 2007 • Multi-node group • Single Instance Repository – Backup data contains 80% typical redundancy between full backups – Reduces VTL disk storage needs – Reduction done outside backup window to avoid impact on application servers • Tape Stacking – – – – Export many virtual tapes to a single physical tape Allows VTL to make most efficient use of available physical media Preserves investment in older tape equipment Allows users to transition to newer equipment gradually • Tape Shredding – Uses DoD 5220.22-M secure erase standard to expunge data • 4 Gb QLogic HBA support (Active/Active FalconStor Software Confidential 48 MultiNode Group Linear Scalability • Up to 8 nodes (mixture of single nodes and HA pairs) Performance • 8 * 800 MB/s = 6.4 GB/s = 23 TB/h throughput Capacity • 8 * 64 = 512 tape libraries • 8 * 512 = 4096 tape drives • 8 * 32K = 256K virtual tape cartridges Unified Management FalconStor Software Confidential 49 FalconStor Single Instance Repository FalconStor Software Confidential 50 FalconStor VTL with Single Instance Repository Servers Backup Software Agnostic Data Coalescence Time Based Inter-Nodal Intra-Nodal Sub-Block Client Enabled Restores User Based Recovery Multiple versions of files can be viewed and restored independent of backup application >80% Reduction Backup Software Independent 500:1 FalconStor Software Confidential 51 Shadow Virtual Tape Single Instance scan: • The file data is extracted and added to the repository. • File data is replaced with links to the extracted data. File Data File Metadata File Data File Metadata File Metadata Directory Metadata Session Header Volume Header Original Data: File Data File Data File Link File Metadata File Link File Metadata File Link File Metadata Directory Metadata Session Header Volume Header After Scan Process: File Data File Data FalconStor Software Confidential 52 Shadow Virtual Tape After Single Instance Scan: File Link File Metadata File Link File Metadata File Link File Metadata Directory Metadata Session Header Volume Header • The resulting virtual tapes contain only the backup metadata with the links to the repository file data entries. • The links are the keys to retrieve the data when needed. • These links are used by either the backup application or FileSafe client to recover data from the repository Links File Data File Data File Data Single Instance Repository FalconStor Software Confidential 53 Existing D > D >T Backup Retention = 1 year Total Media = 300TB 240TB 20TB 20TB 20TB Primary D to D Copy Tape Copy Tape Archives (12 Monthly) Note: At Zero Change rate for simplicity FalconStor Software Confidential 54 VTL with SIR Retention = 1 year >400% Savings in year 1 media costs Total Media = 72.4TB 20TB 20.4TB 24TB Simplify: D to T IS D to D copy Tape Archives Primary Re-purpose original D copy as VTL 4TB VTL SIR FalconStor Software Confidential 55 Example: Virtual Tape with SIR Value: Leverage existing storage for automated data protection and archiving Savings in this case: $500,000 less per year in media costs FalconStor Software Confidential $90,000 savings per month in WAN costs 56 Summary The FalconStor value model Decrease Operational Costs Staff utilization Storage utilization Server utilization Backup costs Network costs Media Costs Storage Costs FalconStor Software Confidential 58 Thank You!