Actual trends in backup protection solution IBM Tivoli Storage Management Ondřej Bláha Tivoli Storage Community of Practise oblaha@cz.ibm.com IBM Forum 2012 – Estonia Tallinn, October 9, 2012 Market Share for Overall Storage Software IBM held its #3 share rank position in 2011, growing slightly faster Y/Y than the total market at 12%. EMC 2011 y/y growth Symantec IBM NetApp HP’s “true” growth is about 10.5%, factoring in Iron Mountain preacquisition revenue (lumped into “others” in the tracker). HP + Autonomy TOTAL MARKET -10.0% 0.0% 10.0% 20.0% 30.0% 40.0% 50.0% IDC estimates total Storage Software market for 2011 at $14.2B, with 11.3% growth year-to-year Overall Storage SW Market includes the following segments Data Protection and Recovery Archiving Software Storage Infrastructure Software Storage and Device Management Software Storage Replication Software File System Software, Market Share for Data Protection and Recovery IBM held its #2 share rank position, growing faster than EMC, Symantec and the overall market rate at 14.3%. IBM grew faster than HP, w/o Iron Mountain archiving revenue. CA is pushed out of the top 5 by CommVault growth and HP acquisition of Autonomy. Symantec 2011 y/y growth IBM EMC HP’s “true” growth is about 4%, factoring in Iron Mountain preacquisition revenue (lumped into “others” in the tracker). CommVault HP+Autonomy TOTAL MARKET 0.0% 10.0% 20.0% 30.0% 40.0% 50.0% 60.0% 70.0% Source: IDC Quarterly Storage Software Tracker; IBM Market Insights This segment includes Tivoli Storage Manager DfSMS XIV ProtecTier SW Gartner Magic Quadrant (2012) Current Situation: The Tidal Wave of Data Continues … The amount of digital information continues to grow at 40%-60% per year And we need to keep more of it, longer –Regulations and governance –Data mining and analytics (“Big Data”) –Don’t know what can/should be expired And the costs of losing data are increasingly unacceptable … –Lost revenues –Lost customer confidence –Embarrassment in the market –Fines from contracts, government agencies 2006 2008 2010 Source: Various external consultant reports We Need to do More with Less, and we need to do it smarter 2012 IBM Storage Management Portfolio Data Protection & Recovery Management Tivoli Storage Manager (TSM) family Enabling business continuity at all times while TSM FastBack aligning recovery costs based on business risk and TSM FastBack for Workstations (CDP) information value Flash Copy manager Storage Resource & Infrastructure Management SAN Volume Controller (SVC) and automated management Offering efficient utilization of Tivoli Storage Productivity Center(TPC) and SSPC all IT resources TPC for Replication Virtualizing storage for ease of administration, capacity data migration utilization Omegamonand XE transparent for Storage (z/OS) TSM HSM For Windows Information Retention & Lifecycle Management TSM For Space Management Retaining information automatically to enable future leverage, or Manager to comply with internal or external business System Storage Archive regulations Information Archive Manager Storewize7k With Fastback and easy tier Leading the Way in Data Protection and Recovery IBM Tivoli Storage Manager has been a leader in helping organizations protect, retain and assure availability of their most important asset, their data, for more than 19 years. Comprehensive Solution •Data Protection: Backup / Restore •Data Retention: Archive •Disaster Recovery •HSM / ILM •Application Protection •Database Protection •Continuous Data Protection (CDP) •Bare Machine Recovery •Robust Remote Office Recovery Proof Points •More than 20,000 loyal customers, including 60% of the Fortune 500 •1st disk-based backup solution •Unified recovery across: ─The broadest range of OS and HW platforms: from laptop to mainframe ─All storage tiers •Four consecutive years of growing faster than the market* * Source: IDC Leading the Way in Data Protection and Recovery IBM Tivoli Storage Manager has been a leader in helping organizations protect their data, for more than 19 years. * Source: IDC Mobile Office FastBack for Workstations TSM FastBack for Workstations: data protection for desktops & mobile users End to End Recovery Management Mobile Office Data Center Remote Office(s) Fastback Clients Applications File Servers VMware Servers Fastback Clients FastBack Server(s) FastBack Server(s) FastBack for Workstations WAN / LAN FastBack DR Server TSM FastBack for Workstations: data protection for desktops & mobile users TSM FastBack: Block Level Incremental Forever & CDP protection for critical servers End to End Recovery Management Mobile Office Data Center Remote Office(s) Fastback Clients Applications File Servers VMware Servers Fastback Clients FlashCopy Manager FastBack Server(s) FastBack Server(s) FastBack for Workstations FlashCopy Manager WAN / LAN FastBack DR Server TSM FastBack for Workstations: data protection for desktops & mobile users TSM FastBack: Block Level Incremental Forever & CDP protection for critical servers FlashCopy Manager: Robust application protection using hardware snapshot End to End Recovery Management Mobile Office Data Center Remote Office(s) Fastback Clients Applications File Servers VMware Servers Fastback Clients FastBack Server(s) TSM Clients FlashCopy Manager FastBack Server(s) TSM Clients ProtecTIER Tiers of Storage FastBack for Workstations FlashCopy Manager DR Operations Archive / Off Site WAN / LAN Information Archive TSM Server TSM FastBack for Workstations: data protection for desktops & mobile users TSM FastBack: Block Level Incremental Forever & CDP protection for critical servers End to End Recovery Management FlashCopy Manager: Robust application protection using hardware snapshot Tivoli Storage Manager: Industry leading scalability, performance, availability, deduplication Advanced tape and Disaster Recovery support Broad OS and HW platform support, application protection Mobile Office Data Center Remote Office(s) Fastback Clients Applications File Servers VMware Servers Fastback Clients FastBack Server(s) TSM Clients FlashCopy Manager FastBack Server(s) TSM Clients ProtecTIER Tiers of Storage FastBack for Workstations FlashCopy Manager DR Operations Archive / Off Site WAN / LAN Information Archive TSM Server TSM FastBack for Workstations: data protection for desktops & mobile users TSM FastBack: Block Level Incremental Forever & CDP protection for critical servers End to End Recovery Management FlashCopy Manager: Robust application protection using hardware snapshot Tivoli Storage Manager: Industry leading scalability, performance, availability, deduplication Advanced tape and Disaster Recovery support Broad OS and HW platform support, application protection Mobile Office Data Center Remote Office(s) Fastback Clients Applications File Servers VMware Servers Fastback Clients FastBack Server(s) DR Operations Archive / Off Site TSM Clients FlashCopy Manager TSM Clients FastBack Server(s) Tiers of Storage FastBack for Workstations FlashCopy Manager ProtecTIER WAN / LAN Information Archive TSM Server Tivoli Storage Manager Administration center End to End Recovery Management Implements a task-oriented WEB user interface. Provides a server status Health Monitor, which makes Tivoli Storage Manager server status easier to visualize. Has integrated management of policies between Tivoli Storage Manager FastBack and Tivoli Storage Manager. Makes learning Tivoli Storage Manager easier for the new users.. Mobile Office Data Center Remote Office(s) Fastback Clients Applications File Servers VMware Servers Fastback Clients FastBack Server(s) DR Operations Archive / Off Site TSM Clients FlashCopy Manager FastBack Server(s) ProtecTIER Tiers of Storage FastBack for Workstations FlashCopy Manager TSM Clients WAN / LAN Information Archive TSM Server Real-time monitoring leverage proven IBM components End to End Recovery Management Real-time monitoring of all TSM and FastBack servers Predefined dashboards with customization Agent builder tool for additional monitoring No additional licenses required Mobile Office Data Center Remote Office(s) Fastback Clients Applications File Servers VMware Servers Fastback Clients FastBack Server(s) DR Operations Archive / Off Site TSM Clients FlashCopy Manager TSM Clients FastBack Server(s) Tiers of Storage FastBack for Workstations FlashCopy Manager ProtecTIER WAN / LAN Information Archive TSM Server Historical customer reporting based on customer needs End to End Recovery Management Stores historical data obtained from TSM servers that are reported using IBM Tivoli Monitoring Leverages Cognos Business Intelligence Reporting to create custom reports Scheduler to export reports in various formats No additional licenses required TSM support from A to Z TSM supports from Apple to xSeries to pSeries, to zSeries TSM supports all major versions of critical applications TSM supports over 500 devices disk, tape or optical StorageWorks StorEdge TSM – Extensive Policy Management Enabling flexible policy management to meet challenging service level agreements and business requirements TSM Progressive Incremental Backup The unique TSM function from beginning Full + Incremental 320 GB Week two 510 GB Week one 20 GB Day 12 135 GB Week two 15 GB 20 GB Day 11 25 GB 20 GB Day 10 20 GB 22 GB Day 9 22 GB 18 GB Day 8 25 GB Day 7 200 GBDay 6 18 GB 25 GB 20 GB 18 GB Day 5 18 GB 22 GB 22 GB 25 GB Day 4 25 GB 25 GB Day 3 15 GB 20 GB 15 GB Day 2 Day 1 200 GB • • • • Progressive Incremental Day 13 200 GB 2 Week TOTAL 830 GB versus 20 GB 200 GB Progressive Incremental Backup 2 week TOTAL 445GB 310 GB Week one Only new or changed files are backed up No redundant or wasteful full backups Data tracked at file level Accurately restores files to a point in time Benefits Requires less storage space, less network bandwidth and less time Shorter backup windows Fast accurate restores Benefits of Upgrading to the latest version of TSM Improved Return on Investment Scalability increased by 800% – Support up to 4 Billion data objects per TSM Server Built-in Data Deduplication – no extra charge – Source and target deduplication – Combines with progressive incremental backup to reduce data by 95% or more Simplify Administration – Automated client software updates across all platforms – New reporting and monitoring across the family with custom report creation Improve service levels and availability – New client data/metadata replication for warm standby disaster recovery – Faster backups and restores reduces downtime Unified Recovery Management Seamless integration with other parts of the family – Advanced support for VMware, Windows, NAS – Integrated protection of remote offices, employee workstations Improved Performance and Reliability Tivoli Storage Manager for z/OS Media DB2 database ‘under the covers’ Enable z/OS clients to take advantage of latest TSM features while leveraging existing mainframe-attached storage resources Eliminates most database administration Benefits of Upgrading to the latest version of TSM Comparison of TSM Data Reduction Methods Comparison of TSM Data Reduction Methods Client compression Incremental forever Subfile backup Server-side deduplication Client-side deduplication Client and server eliminate redundant data chunks How data reduction is achieved Client compresses files Client only sends changed files Client only sends changed subfiles Server eliminates redundant data chunks Conserves network bandwidth? Yes Yes Yes No Yes Data supported Backup, archive, HSM, API Backup Backup (Windows only) Backup, archive, HSM, API Backup, archive, API Scope of data reduction Redundant data within same file on client node Files that do not change between backups Subfiles that do not change between backups Redundant data from any files in storage pool Redundant data from any files in storage pool Avoids storing identical files renamed, copied, or relocated on client node? No No No Yes Yes Removes redundant data for files from different client nodes? No No No Yes Yes Available 6.1 Available 6.2 Available prior to V5 All of these data reduction methods conserve storage pool space Deduplication in Tivoli Storage Manager Tivoli Storage Manager and TSM FastBack include target-side data deduplication – Improves recovery times and/or reduces capacity requirements – Uses data from any source including: API, backup, HSM, archive – Operates as a post-process; automatic space reclamation – Builds on automatic data compression & progressive-incremental – Applied to data replicated to an off-site TSM server for disaster recovery … all at no additional charge!! Tivoli Storage Manager includes client-side data deduplication – Reduces network traffic by determining if a chunk has already been backed up (maybe from a different client system) TSM FastBack includes data deduplication across the WAN – Reduces storage and bandwidth requirements by consolidating backups from multiple offices to a central TSM server File B 4 F E DeduplicationEnabled Disk Storage Pool 1. Client creates chunks 2. Client and server identify which chunks need to be sent TSM 6.x client File A 1 B C D F 3. Client sends chunks and hashes to server so that it can represent object in database E 4. Entire file is reconstructed during Backup Stgpool operation to nondeduplicated stg. pool Copy Storage Pool (non-deduplicated) File 1 File 4 File 2 File 3 hash Index File 4 TSM client data replication for FASTER Disaster Recovery TSM server replicates all data and metadata for specified client data sets to another server, ensuring completeness and consistency of data/metadata – – Incremental client data transfer with deduplication to minimize bandwidth consumption Many-to-1 transfer to target server Remote TSM server could be hot standby for primary server, for improved RTO Native TSM solution with no dependency on specific storage device – Supports dissimilar hardware and configuration at primary and remote sites Restore on a per-client basis without re-hydrating deduplicated data Automatic distribution and installation of client updates For AIX, Solaris, HP-UX, Linux, Mac OS X or Windows Automatically push updates for TSM b/a client v5.5, v6.1, v6.2 or v6.3 Reduce admin time for updates by 80%; improves accuracy – 50 minutes vs. 250 minutes to update 50 client systems – Huge benefit for cloud and backup-as-a-service providers Executed based on user-defined policies and schedules Introducing Tivoli Storage Manager for Virtual Environments • Utilizes VMware’s vStorage APIs for Data Protection, including block-level incremental backups based on VMware’s Change Block Tracking • Offloads the backup workload from virtual machines and production ESX hosts to vStorage backup servers • Provides flexible recovery options – file, volume or image – from a single-pass backup • Near-instant restore of Windows and Linux disk volumes Data is made available immediately while it is copied in the background • Simplifies day-to-day administration with the centralized Tivoli Storage Manager console TSM for VE is supported on TSM Server v5.5 and above • Automated discovery of new VMs; automatically applies backup policies Introducing Tivoli Storage Manager for Virtual Environments Full Virtual Machine Recovery (any supported Guest OS) Introducing Tivoli Storage Manager for Virtual Environments Near-Instant File and Volume Recovery (Windows and Linux Guest OS) TSM FastBack is advanced data protection Block-level, incremental-forever –Captures only new and changed blocks of data without requiring applications to be shut down –continuous or scheduled backup for Windows and Linux servers Advanced policy engine –Tune backup frequency to the importance of the data –Backup as often as needed, on a per-application basis –True Continuous Data Protection (CDP) for the most critical applications –Frequent or scheduled snapshots for less-critical data Selective replication –Provides disaster recovery and backup consolidation capabilities –WAN-efficient; sends only new & changed data; schedule for non-peak times Target-side data deduplication –Runs as a post-process to eliminate duplicate data from across protected servers TSM FastBack is easy to manage Wizard-based installation Familiar Windows-style GUI – Simple menu-based system for configuring backups – Simple drag-and-drop recovery Full set of configurable reports –View Server and Client status, activity and utilization –Leverages Tivoli Common Reporting Tight integration with Tivoli Storage Manager –Launch FastBack from TSM –Manage FastBack policies –View FastBack reports –Backup FastBack server for long-term retention TSM FastBack helps you restore your data - FAST FastBack Mount Recovers individual files and folders, from any point-in-time Opens an Explorer-like view into the FastBack repository Simple ‘drag-and-drop’ operation Virtual Recovery Mounts an entire volume to be recovered Select any previous point-in-time (Recovery Point) New volume becomes available within seconds Read-write requests serviced by FastBack Data is restored in the background to target disk TSM FastBack for Bare Machine Recovery Restore the Windows and Linux OS volume in less than 1 hour – Recover on a similar server, to a completely different server, or to a Virtual Machine Full access within minutes – With TSM FastBack’s Virtual Restore technology, data volumes are made available as soon as the data recovery process starts Great tool for cost-effective Business Continuity – “N-to-1” standby server ratio: one standby server can provide cover for many production servers Can be used to quickly perform server migrations FlashCopy Manager Solution Overview Online, near instant snapshot backups with minimal performance impact High performance, near instant restore capability Integrated with IBM Storage Hardware Simplified deployment *VSS Integration FlashCopy Manager Key functionality – Snapshot (FlashCopy) Backup Volume level Full Database or Storage Group backups Exploit Storage Copy Services features – Block level Incremental FlashCopy – Space Efficient FlashCopy – Auto provisioning of targets Enables Frequent Snapshot backups for near CDP operation – Reduce the amount of data at risk from 24hours to a few minutes Policy Managed – Maintain a number of backup versions – Adaptive to changing requirements FCM Considerations and dependencies VMware support in FlashCopy Manager Supports ESX / vSphere 4 and later Off-host (proxy based) hardware snapshot backups with VMFS datastore granularity – Scheduled or ad-hoc execution – No need to deploy OS specific agents to each VM Optional offloaded backup to TSM with VM granularity – Supporting block level incremental backups with VMware Changed Block Tracking Restore of individual VMs to original or alternative VMFS datastore under original name or new one – a) from a Hardware snapshot of a VMFS datastore – b) from oflloaded TSM backup Restore of individual files or virtual volumes – Mount of a backup to a guest VM for individual drive / files access User interface – vCenter client integration (plug-in web GUI) – Command Line Interface (on proxy node) Reporting and Monitoring – summary view with drill down for details – backup & restore stats – Managed capacity report Policy based management of local snapshot backups Unified Recovery Management Two Pricing models for TSM Processor Value Units - PVU’s Processor core type and quantity is base for pricing Licensing by functionality working on processor count TSM licenced by PVU count for protected servers (including TSM) TSM 6.3 includes a PVU counter tool for the TSM Clients Capacity Based Licence – TSM Suite for Unified Recovery (SUR) Licence is a “back-end” model for the TSM Server Based on the size of the Primary Storage Pool in TSM repository Includes all backup, HSM and archive data in the Primary Pool Does not include Copy Pools TSM Server dedupe (disk only) reduces licence costs * Calculated using predefined TSM Server scripts Products in the TSM Suite for Unified Recovery bundle Summary Tivoli Storage Management Helps customers address conflicting challenges: – Data growth and long term data retention – Management of increasingly complex and virtualized IT infrastructures – Escalating business service levels requirements – Constrained budgets Offers industry-leading levels of: – Scalability – Functionality – Data reduction – Resiliency – Performance – Reliability Provides simplified and unified recovery management in heterogeneous environments – Hardware platforms – Operating Systems – Applications – Data centers, DR sites, remote offices, mobile workers, Clouds Hindi Hebrew Simplified Chinese Russian Thank You English Arabic ačiū aitäh Grazie Italian Estonian Lithuanian paldies Korean Latvian Gracias Spanish Obrigado Brazilian Portuguese Da n k e German M erci French Japanese Tamil Traditional Chinese Thai BACKUP