Industry Trends and Perspectives:
What’s Hot For 2008
Greg Schulz, Founder & Sr. Analyst, The StorageIO Group
Author, Resilient Storage Networks (Elsevier)
The Green and Virtual Data Center (Auerbach) at Amazon.com
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Part I – Hot Storage Issues, Trends and
Technologies For Channel Pros
What’s the buzz out there?
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
What’s the buzz out there?
8 Gb Fibre Channel (8GFC), 10GbE, Agent-less, Authentication, Archiving,
Backup, Backup Service Provider (BSP), BC/DR, Benchmarking, Blade Servers,
Bulk Storage, CAS, Capacity Planning, Capacity Per Watt, Converged Enhanced
Ethernet (CEE), CIFS, Cloud Storage, Clustered Storage, CNA, Compliance,
Compression, Converged Networks, D2D2D, Data Management, Data Migration,
Deduplication, Dedupe Debates, DPM, e-Discovery, Environmental Health and
Safety (EHS), Encryption, Event Correlation, e-Waste, Fibre Channel over
Ethernet (FCoE), File Management, FLASH, Green, Grid, HA, I/O Virtualization
(IOV), InfiniBand, Infrastructure Resource Management (IRM), IOPS Per Watt,
IPM & MAID 2.0, iSCSI, Multi-Protocol Storage, Managed Service Provider
(MSP), NAS, NFS, NPVID, Partitions, Power Cooling Floor-space EHS (PCFE),
PCI SIG IOV, Performance, pNFS, Removable Hard Disk Drive (RHDD), RAID 6,
Replication, RoHS, Replication, CDP, SAN, SAS, SATA, Security, Snapshots,
SRM, SSD, Tape, Thin Provision, Tier 0, Unstructured Data, VCB, Virtualization,
Vmotion, VMware, VTL, WAAS, WADS, WAFS, WADM, Web 2.0 Storage
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Industry Trends – Information Security
Is more data being lost or stolen today than in the past?
Lost tapes are actually on the decline, however…
Lost Data Events
Encryption Data At Rest and In-Flight, FDE and Drive Trust, Host
Software and Storage Encrypt, Key Management, Secure Digital
Destruction Authorization, Authentication, Identity Management
Lost tapes make good news copy, however,
lost or stolen PDAs, USB devices, laptops
Growing
and HDDs removed from retired storage
Awareness!
systems are a growing threat
risk. Reported along with
unreported events are
on the rise!
A key question is, can you or your
business afford the risk of data being lost or stolen?
Time
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Industry Trends – Compute Continuum
We are in a consolidation phase (again!)
Cell Phones, PDAs, Pocket PCs
Converged Phones & Computers
Desktop PCs & Laptops
From Desktop to Laptop x86 and VMs
Midrange & Servers
From Proprietary to x86 & Hypervisors & Open
Mainframes
LPARs/VMs
Distribute
1950s
Consolidate
Distribute
Open Networking Native Linux
Consolidate
Distribute
1960s
1970s
1980s
1990s
2000s
2010s
SaaS Software or Storage as a Service
Service
Info
Bureau
Utilities
Managed Grid, Cloud,
Outsource & In-source xSPs
Service
Web 2.0
Client Server Providers
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Industry Trends – Increased Density
Rising demand, denser solutions, PCFE and complexity
• More processing power per footprint (sq. foot or meter, cabinet U)
• Performance density improvements and cost reductions continue
• Same floor space occupied to host more compute capabilities
• More processing cycles will be needed moving forward
• More processing cycles per watt of energy consumed
• Power, cooling, floor space and EHS improvements
128 Servers (Blade Centers)
Single Large Server
Same Footprint
Different Generations over Time
24 Servers
Eight Servers
Source: “The Green and Virtual Data Center” (Auerbach)
Four Servers
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Industry Trends – Shifting Landscapes
Common challenges and issues – old vs. new rules!
Legacy and Transactional Data
Data Goes Dormant
Data Created
Continued Access
Activity
Activity
Data Created
Web 2.0 and Online Data
8
8
Time
Profile: Data is created, worked with and then
goes dormant after some period of time with
probability of little to no future access or use
Examples: Database, email, transactional,
general file serving, project-oriented data
Solution: Ideal candidate for archiving off of
primary or online storage to off-line and
removable media or MAID-based storage
combined with purging or deletion of data no
longer needed to meet compliance or other
commitments
Time
Profile: Data is created, worked with and then
may go idle briefly, then accessed, then idle,
then active, then idle, then active…
Examples: Web, reference and lookup, fixed
content, Web 2.0 and social networking, media
and entertainment, some email, search,
seasonal or event and research-based data
Solution: Online storage with variable
performance to meet changing workload
demands, bulk and clustered storage, MAID 2.0
and IPM-enabled storage, caching
Source: “The Green and Virtual Data Center” (Auerbach)
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Hot Storage Topic – Clustered Storage
The many faces of clustered storage – not just for HPC!
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Industry Trends – Growing Green Gap
Confusion leading to inactivity and missed opportunity
The Green Gap
Messaging
Focus on green house gases (GHG)
Carbon credit offsets
Ecological sustainment
Power avoidance
Save money
Global
Issues
Concern with available power
Energy rebates and certificates
Economic sustainment
Energy efficiency
Cost to be green
Local
Limits on generate and transmission
Rising energy costs and availability
Aging and expensive infrastructure
Emerging eco and ETS regulations
Supply
Growing data footprint
More servers and storage
Increase density, reduce cost
EHS, RoHS, WEEE, E-Waste
Demand
Balancing Act
See report “Analysis of EPA report to Congress” at www.storageio.com/xreports.htm
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Hot Storage Topic – IT Virtualization
Requires real resources: server, network, storage, facilities
VolCD
\\SharedC1
Email
Messaging
VolCC
Video/Audio
File Serving
Billing, E-Tail
Database, DSS
CAD,EDA,
SW Dev
Spreadsheets
PPTs, PDFs
\\Shared
Web
Email
File
SQL
Linux
VM
Windows
VM
Windows
VM
Windows
VM
Vol002
Vol001
Networked
Volumes &
File Shares
Mainframes, Open
Systems
Virtual Server Environment
Blade Servers
Storage Switch Servers
FAN, LAN, SAN,
WAN, MAN
Replicate
Tape
Rotation
Vol001
Block LUNsVol002
(iSCSI & FC)
\\Shared
Local PIT
Snapshots
File Sharing
(NFS & CIFS)
FAN, LAN, SAN, MAN, WAN
Power, Cooling, Floor-space, Environmental (PCFE)
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Part II – Opportunities to Address Your
Customers’ Pressing Storage Issues
New and Emerging Technologies and Solutions
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Tiered Data Protection
Balance cost, data loss, availability and applicable threats
VolCD
\\SharedC1
VolCC
Relative Protection Cost
Video/Audio
File Serving
Billing, E-Tail
Database, DSS
RTO =
Email
Messaging
CAD,EDA,
SW Dev
Spreadsheets
PPTs, PDFs
Recovery Time Objective = When data
can be usable or available
Recovery Point Objective = What point
data is recovered to, how much data can
you afford to potentially lose
Synchronous
RPO =
data
mirroring,
replication,
continuous Asynchronous remote
data mirroring,
availability,
replication, snapshot Remote tape or disk-to-disk-tononstop
and copy. HA failover
tape backup, copies and
processing.
vaulting. Remote archiving.
RTO and RPO cluster. Longer RTO
and/or RPO.
Extended RTO and RPO.
near or at zero
Continuous Minutes Hours
Days
Weeks
RTO and RPO timeline and data lifecycle
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Months
Industry Trends – PCFE Issues
Rising demand, denser solutions, more PCFE supply issues
Relative Available IT Resources
IT Capacity Constrained
Business Growth Inhibited
Economic Penalties
Lost Opportunity
Compute Capacity
Storage Capacity
I/O Performance (IOPS & Bandwidth)
Time
Cooling/Distribution
Servers Storage
Networking
Other
PCFE Capacity Threshold Ceiling
Available IT Resources/Demand
Source: “The Green and Virtual Data Center” (Auerbach)
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Hot Storage Topic – PCFE aka “Green”
E-Waste Mask
EHS Or Move
RoHS Issues
HVAC
Alternative
Energy
Consolidation
Boost Energy
Efficiency
Reduce Data
Footprint
Energy
Tiered
Avoidance Servers
Storage
EHS = Environmental Health Safety
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Best Practices and Policies / Metrics
Financial Incentives and Rebates
PCFE = Power, Cooling, Floor space, EHS
Wheel of Opportunity: Economic and Ecological Sustainment
Source: “The Green and Virtual Data Center” (Auerbach)
Hot Storage Topic – Cross Domain IRM
IT Infrastructure Resource Management (IRM)
Infrastructure Resource Management
(IRM) Functions and Activities
Processes and Tools
• Namespace and virtualization
• Measurements and metrics
• Monitoring and reporting
• Modeling, analysis, planning
• Resource usage and allocation
• Performance and capacity planning
• Thin provisioning and purposing
• Diagnostic and resolution
• Change and configuration validation
• Data protection and footprint reduction
• Policy management and service levels
• Facilities and asset management
• Logical and physical security
• Procurement and disposition
Source: “The Green and Virtual Data Center” (Auerbach)
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Metrics and Measurements
Why, where, how and what to measure now and future
Categories &
Price Bands
Usage Cases
How Measured
Easy to Use
Reflective of
Diversity of Storage
Active & Idle, etc.
Needs to
Be Applicable
to Usage
Model
Best Practices
Source: “The Green and Virtual Data Center” (Auerbach)
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Industry Trends – I/O Performance Gap
Growing server processing to storage capacity and I/O gap
Performance
Processor to disk
storage capacity
Disk storage capacity
to I/O performance gap
Time
Server processor performance curve
Disk storage capacity curve
Disk storage performance curve (IOPS)
See “Addressing Data Center I/O Performance Gap” www.storageio.com/xreports.htm
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Tiered Storage and Tiered Access
Balance performance, availability, capacity, energy usage
VolCD
\\SharedC1
VolCC
Relative Comparison
Similar Capacities
Video/Audio
File Serving
Database, DSS
Accelerate Performance
“Time is Money”
RAM
FLASH
Performance
Fast HDD
CAD,EDA,
SW Dev
Consolidate
Space Capacity
Price
Power
Enterprise
Midrange
SMB
SOHO
© Copyright 2008 StorageIO Group All rights reserved.
Tier-1
Tier-2
Source: “The Green and Virtual Data Center” (Auerbach)
Reduce
Capacity
Tape & Costs
Optical
Tier-3
Different Price Bands and Categories
www.storageio.com
Spreadsheets
PPTs, PDFs
Balancing Act
PACE
Footprint
Cost PCFE
Service Level
FAT HDD
Tier-0
Price
Bands
Billing, E-Tail
Email
Messaging
Hot Storage Topic – I/O Virtualization
I/O virtualization – converged networks, IOV and FCoE
I/O, I/O, it’s off to virtual work we go…
Traditional Approaches
Evolving Approaches
Separate Networks & Interconnects
(Fibre Channel, GbE, IBA, Etc.)
Unified & Converged Interconnects
(Virtualized FC, GbE, FCoE, Etc.
Physical Data Center Ethernet or IBA)
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Many Faces of I/O Virtualization
I/O Virtualization and Consolidated I/O and Networking
• Sharing of physical adapters and unique addressing
– Fibre Channel N_Port Virtual IDs – Unique N_Port addresses
– Virtual Machine NICs and HBAs – E.g. VMware, Virtual Iron
• Virtual NICs and Virtual HBAs for virtual machines
• PCI bus extension, switching and sharing – very short distances
– PCI SIG SR-IOV and MR-IOV: Share PCI adapters
• Converged I/O and networking
– Virtual and converged adapters and NICs
• Transform physical adapter into virtual adapters and NICs
– Converged networks and fabrics
• InfiniBand and Converged Enhanced Ethernet and FCoE
Fibre Channel over Ethernet (FCoE); Single-Root IOV (SR-IOV); Multi-Root IOV (MR-IOV)
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Industry Trends – Data footprint growth
More data being stored, copied, backed up, protected
Sparse, Duplicate
Files and Content
Original Data Copies – Data proliferation and expanding data footprint
Primary Database,
DSS, Training, Test, Dev
Backup, BC, DR, HA,
Email, File serving
QA, Operational, Needs
Archive, Compliance
App-a
App-b
App-c
8 TB
2 TB
10 TB
RAID 1+0 RAID 1 RAID 5
In addition to storage space capacity, IOPS and
MBPS to move data needs to be considered.
10 TB
10 TB
10 TB
8 TB
8 TB
2 TB
Multiple data footprint by data protection factor
(e.g. RAID level and mirroring) along with spares
and free space to account for actual disk space
10 TB
10 TB
10 TB
10 TB
10 TB
10 TB
10 TB
10 TB
10 TB
8 TB
8 TB
8 TB
8 TB
8 TB
8 TB
8 TB
8 TB
8 TB
2 TB
2 TB
2 TB
2 TB
2 TB
2 TB
2 TB
2 TB
2 TB
Challenge: More data to back up, protect and manage
Solution: Reduce footprint impact: Archive, compress, dedupe, tiered storage
See “Business Benefits of Data Footprint Reduction” www.storageio.com
Source: “The Green and Virtual Data Center” (Auerbach)
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Hot Storage Topic – Data Footprint Reduction
Archiving, compress (on- and off-line), deduplication
• Develop an overall data footprint reduction strategy
– Address online primary, secondary and off-line data
– Combine archiving, compression and dedupe in strategy
• Archiving and pruning with data classification
– Database, email, unstructured block and file
– Big benefit, costly to deploy (people, hardware, software)
• Compression for online and off-line storage
– Can be applied to most any data type for some benefit
– Online real-time compression for active primary data
• Single Instance Storage (SIS) and deduplication
– Initially targeted at backup and archive
– Look into scaling capabilities and claims by vendors
See “Business Benefits of Data Footprint Reduction” www.storageio.com
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
The Many Faces of Virtualization
Consolidate, Abstract, Emulate, Migrate and Manage
Issues that inhibit consolidation:
• QoS and performance barriers
• Politics and financial constraints
• Competitive or legal purposes
• Security and compliance
Non-Consolidated
Servers or Storage
Only a fraction of all
servers or storage
Market and IT
consolidated!
Virtualization
Opportunity!
Consolidated Server
and Storage Using
Virtualization
Today
Tomorrow
Total Server
and Storage
Market Size
• Emulation
• Abstraction
• Aggregation
• Migration
Market and IT Opportunity = Life Beyond Consolidation
Using server virtualization for IT resource management
Enabling abstraction and transparency for massive scaling, BC
DR and routine infrastructure resource management (IRM)
operational functions
Source: “The Green and Virtual Data Center” (Auerbach)
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
The Many Faces of Virtualization
Consolidate, Abstract, Emulate, Migrate and Manage
Consolidation
Single Server
Consolidation with HA
Redundant Servers
Scaling Beyond a Server
Software Changes
Scaling Beyond a Server
Single Operating System
Source: “The Green and Virtual Data Center” (Auerbach)
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
The Many Faces of Server Virtualization
Leveraging Virtualization to Enable HA, BC and DR
Traditional BC/DR
1 to 1 Resource Allocation
Or Selective Recovery
PMs PMs PMs
VMs VMs VMs
PMs PMs PMs
PMs PMs PMs
Data Protection
Management
Network
Production
Primary Site
32 Physical Servers
Virtualized BC/DR
Initially Oversubscribed Add
Physical Resources As Needed
BC/DR
Site
32 Physical Servers
Snapshots and
Local
Remote
Shared Replication
Shared
Storage
Storage
Network
Production
Primary Site
32 Physical Servers
32 VMs 1:1 VM to PM
Local
Shared
Storage
PM = Physical Machine
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
VMs VMs VMs
PM
BC/DR
Site
8 Physical Servers
32 VMs 4:1 VM to PM
Snapshots and
Replication
Remote
Shared
Storage
Source: “The Green and Virtual Data Center” (Auerbach)
The Virtual Data Center
Different approaches and locations for virtualization
Wide Area, Internet and Cloud Networking
• Data movement and access between sites
• Remote-office/branch-office data access
• HA, BC, DR for business sustainment
• Leverage off-site managed services
• Remote data archiving
• Privately owned facilities
• Hosted or colocation
• BC/DR standby hot/cold site
• Cloud or SaaS and MSP Firewalls
Clustered and
non-clustered
servers
Internet
MAN & WAN
Remote
Storage
Data replicated for HA, BC, DR
Remote backup
and archives
Source: “The Green and Virtual Data Center” (Auerbach)
Managed Service Provider (MSP), Software or Storage as a Service (SaaS)
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
What You Can Do Today and Tomorrow
Boost energy efficiency – more work per energy used
Source: “The Green and Virtual Data Center” (Auerbach)
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Part III – Call to Action
What you can do now to address customer issues
How to stand out in the crowd!
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
What You Can Do Today!
Virtual environments need physical resources and IRM
• Gain control of virtual and physical resources
– More data to protect for longer periods of time
– Fill in the gaps and add plug-ins to virtualization frameworks
– Leverage new technologies and capabilities
•
•
•
•
•
•
•
•
Tiered servers, storage, networks, data protection and access
Data protection management including site recovery manager
High-availability virtual server and storage migration
Data footprint reduction: Archive, real-time compress, dedupe
Disk-based snapshots, backup, replication and archiving
Disk-based virtual tape libraries and removable media
Encryption of fixed and removable media
Virtualization and application aware data protection
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Different Facets of Server Virtualization
Consolidation or Aggregation, Emulation and Transparency
VolCD
\\SharedC1
VolCC
Video/Audio
File Serving
Billing, E-Tail
Database, DSS
Consolidation of Multiple Systems
Boost Utilization of Servers or Storage
WebApp
Linux
VM
Servers or
Blade Centers
Email
Messaging
Physical to Virtual (P2V),
Virtual to Virtual (V2V)
Requires: 3rd party Replication,
Backup, Snapshots, Data
Protection Management,
Shared Storage
File
Windows
VM
Migration
© Copyright 2008 StorageIO Group All rights reserved.
Spreadsheets
PPTs, PDFs
Enable:
Email
File
Apps
Windows Windows Windows
VM
VM
VM
Virtual Infrastructure
Disk Storage
DAS, SAN or NAS
CAD,EDA,
SW Dev
Apps
HA, BC, DR
Windows
Load Balancing
VM
Virtual Infrastructure
Migration
Replicate
www.storageio.com
Source: “The Green and Virtual Data Center” (Auerbach)
Hot Storage Topic – Data Protection
Opportunity to re-architect data protection practices
VCBs, Snapshots,
Replication, Application
Aware, HA vs. BC/DR
LAN, MAN or WAN
WebApp
Email
File
Linux
Windows
Linux
Pre/Post
VM
VM
VM
Processing Virtual Infrastructure
Data Movement
Over SAN or DAS
Apps
UNIX
VM
Migration
Backup
Server
VTL / Disk Library
Tape Devices
(Block or File)
Disk Storage
Snapshots
© Copyright 2008 StorageIO Group All rights reserved.
Data Protection
Management Tools
Managed Services
Vol-A
Vol-B
Vol-C
Vol-D
www.storageio.com
D2D, D2D2D, D2T,
D2D2T, VTLs, Encrypt,
Compress & Dedupe
What You Can Do Today
Addressing different issues – no single magic bullet!
 Mask

Outsource, MSP, Carbon Credits
 Consolidation

Virtualization and Aggregation, IOV
 Reduce

Archive, Compression, Dedupe

RAID Levels, SSD, HDDs, Optical, Tape
 Energy Avoidance

Power Down, MAID, IPM
 Boost

More Performance, Less Power, AVS

Hot/Cold Aisles, CRAC
or Move Issues
 Tiered
Data Footprint
Storage
Energy Efficiency
 HVAC, Alternate
Power
 E-Waste
and Hazmat

RoHS, Recycling, WEEE, EHS
 Financial
Incentives

Rebates and Efficiency Incentives
 Metrics/Measurements

Insight into Energy Effectiveness
 Best

Improve Usage of IT Resources
Practices/Policies
AVS = Adaptive Voltage Scaling IPM = Intelligent Power Management
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
General Comments
Basic premises – gain management insight and control
• Look beyond consolidation to enable and sustain growth
– Be in position to support future growth. It’s just a matter of time!
• You can’t go forward if you can’t go back!
– Time to re-architect data protection, BC and DR with new techniques.
• You can’t delete what you have not preserved
– Assuming customer data has some value, preserve before deletion.
• Archiving is for more than regulatory compliance purposes
– Implement tiered storage, boost performance, address PCFE.
• You can’t manage what you or your customer don’t know about
– Identify what data, files and objects you have: insight.
Lean more at www.storageio.com and www.thegreenandvirtualdatacenter.com
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Closing Comments
Basic premises – gain management insight and control
• Many approaches depending on your customers’ issues
– Help customers do more with what they have to sustain growth
– Help customers shift from energy avoidance to energy efficiency
• Avoid simply moving IT problems around
– Help your customers gain control of data and infrastructure issues
– Solve problems and issues to enable your customers to grow
• Instead of race to replace tape, revamp data protection architecture
• Instead of race to consolidate data centers, enable remote management
• Balance between future and what works today
– Leverage what works and what customers are buying
– Land sales and revenue on shipping products while selling the future
– Help your customers develop strategies for moving forward
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Closing Comments
Data protection, PCFE/green topics are here to stay!
•Where you can learn more:
– Feel free to call or email me with questions or comments
– See Resilient Storage Networks (Elsevier)
– www.storageio.com (see portfolio for articles etc.)
– www.thegreenandvirtualdatacenter.com
“The Green and Virtual Data Center” (Auerbach)
Order your advance copy now on Amazon.com
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com
Thank You!
Greg@storageio.com
www.storageio.com
© Copyright 2008 StorageIO Group All rights reserved.
www.storageio.com