© Copyright 2011 EMC Corporation. All rights reserved.
1
File-Based Data on Traditional Storage
COMPLEXITY AND COST!
OpEx
Storage Management -Staff
Tremendous Inefficiencies:
Increased storage
management
Poor system utilization
100’s of File Systems
1000’s of Mount Points
Limited Scalability
Limited Throughput
Over-provisioning of space,
energy and cooling
Licensing and re-licensing
software applications
Downtime for data
migrations and upgrades
CapEx
Over-provision acquisition
Application Licenses
© Copyright 2011 EMC Corporation. All rights reserved.
Managing downtime for
multiple business units
2
•Utilization rates
vary across
islands
•QOS headroom
•Performance
considerations
= Net Utilization
50% - 65%
© Copyright 2011 EMC Corporation. All rights reserved.
File System
Volume
Aggregate
(~ 16TB)
RAID
3
Traditional Performance
OneFS > Linear w Scale
Controller Performance
CAPACITY
PERFORMANCE
PERFORMANCE
N-Nodes
CAPACITY
“With traditional storage, my best day is always my first day…”
© Copyright 2011 EMC Corporation. All rights reserved.
4
Traditional Scale-Up
Scale
Capacity
Natural Bottlenecks
Controlle
r
Disk
Shelves
Controllers & trays of disk
Many systems or 2-way clusters
Many file systems/volumes
Many points of management
N-Storage Islands
© Copyright 2011 EMC Corporation. All rights reserved.
Power of Parallelism
ENTERPRISE
(Intra-cluster
Infiniband)
CLASS
ISILON IQ
NODES
Up to 144 nodes, 20+ PB
OneFS™ distributed file system
Single file system/namespace
Single point of management
N-Way Symmetrical Cluster
5
EMC Isilon Scale-Out Innovation
Massive Scalability
•
•
•
•
•
•
© Copyright 2011 EMC Corporation. All rights reserved.
6
Scale-Out vs. Scale-Up
File Systems
Volumes
Aggregates
RAID
Isilon OneFS
Traditional NAS
Management
• 1 volume, 1 file system
• Single volume up to 15 PB
• Multiple RAID, volumes, file systems
• Single volume up to 16 TB (100 TB in some
cases)
Economics
• 80%+ utilization, <1FTE
• Business agility
• Investment protection
• 57% utilization, Multiple FTE’s
• Silos, limitations
• Forklift upgrades
© Copyright 2011 EMC Corporation. All rights reserved.
7
What Makes Isilon Unique?
Scalability
Scale both capacity and performance together, or scale only capacity or performance
independently
Ease of Management
Install in less than 1 hour, capacity and/or performance in less than 5 minutes
never need to do any raid, volume management or performance tuning
Investment protection
You will never have to do a migration or forklift upgrade with Isilon - when you need
more capacity, just add it to the existing cluster
Utilization and Efficiency
Achieve 80+% storage utilization; eliminate hot spots and bottlenecks
Data Protection
Dynamically set and adjust data protection ( N+1, N+2, N+3 and N+4) at the directory
or file levels
Tiering
File system tiring that does not change file placement or disrupt data access
© Copyright 2011 EMC Corporation. All rights reserved.
8
© Copyright 2011 EMC Corporation. All rights reserved.
9
Modular, Node-Based Architecture
OneFS™ Distributed File System
Modular, self-contained nodes each include:
Standard GigE and 10 GigE front-end network
High-performance, low-latency back-end network
Hexa-core Intel processors
4-192 GB global read/write cache
Hot-swappable disks, power supplies, and fans; virtual spares
© Copyright 2011 EMC Corporation. All rights reserved.
10
Isilon Node Types
CREATE &
CAPTURE
PROCESS
ARCHIVE
NL-Series
High-transactional
and IO-intensive
applications
High-concurrent
and throughput
applications
Cost-effective,
long-term and high
capacity storage
Isilon IQ X200
Isilon IQ S200
Isilon IQ NL400
Isilon IQ X400
Isilon S-Series SAS
(16TB – 2PB)
© Copyright 2011 EMC Corporation. All rights reserved.
Isilon X-Series SATA
(18TB – 20PB)
Isilon NL-Series SATA
(108TB – 20PB)
12
Fast, Non-Disruptive Upgrades
OneFS™ scales from 15 TB to over 15 PB
in a in a single file system
•
•
© Copyright 2011 EMC Corporation. All rights reserved.
13
Using Software to Improve Storage Efficiency
AutoBalance
Automated data balancing across nodes reduces costs,
complexity and risks for scaling storage
BALANCED
EMPTY
FULL
BALANCED
• AutoBalance migrates content
to new nodes while system is
online and in production
EMPTY
FULL
BALANCED
EMPTY
FULL
BALANCED
EMPTY
• Requires NO manual
intervention, NO
reconfiguration,
NO server or client mount point
or application changes
FULL
BALANCED
• Eliminate “Hot Spots”
EMPTY
© Copyright 2011 EMC Corporation. All rights reserved.
14
No More Data Migrations to New Hardware
New Way
LAN
Old Way
© Copyright 2011 EMC Corporation. All rights reserved.
15
Useable Efficiency Grows with the Cluster
3 Node
Cluster
• N+1 Parity
6 Node
Cluster
• N+1 Parity
10 Node
Cluster
• N+1 Parity
66%
83
%
90%
33%
17%
10%
Addressable Capacity
© Copyright 2011 EMC Corporation. All rights reserved.
Addressable Capacity
Addressable Capacity
16
N+M File Striping and Protection
Flexible Data Protection
• Multi-parity, “software-based RAID” - not disk-based RAID
• File-based protection (defined at cluster, directory and/or file level)
• Files striped across N nodes, protected against M failures
OneFS
Industry
Simultaneous Protection
RAID5
Survive one drive/node failure
N/A
Survive two drives or one node
failure
RAID-DP
Survive two drive/node failures
N+3:1
N/A
Survive three drive or one node
failure
N+3
N/A
Survive three drive/node failures
N+4
N/A
Survive four drive/node failures
N+1
N+2:1
N+2
© Copyright 2011 EMC Corporation. All rights reserved.
17
Full Suite of Enterprise Software Options
• Combine multiple storage tiers into a single file system
• Simple, scalable and flexible data protection
• Policy-based client load balancing with NFS failover
• Quota management and thin provisioning
• Fast and flexible file-base asynchronous replication
• Analytics platform to maximize performance and resource utilization
• WORM functionality enforces file-level retention
© Copyright 2011 EMC Corporation. All rights reserved.
18
Single File System for Multiple Tiers
Automatic Data Movement
File-Level Granularity
Performance/Layout
Protection Settings
© Copyright 2011 EMC Corporation. All rights reserved.
Archive
Policy-Based Movement
Transparent Reallocation
NO application-changes
Infiniband Core Network
Single File System
Scale Any Application
Tiers of Performance
MB/s
Single Point of
Management
I/Ops
Technical Innovation
19
Load Balancing with Failover
it.omrf.com
Example Zoning
hpc.omrf.com
•10 GigE dedicated
•Accelerator X nodes
•NFS Failover required
Illumina GA2
•Full access,
maintenance interface
•Corporate DNS, no SC
•Static (well-known)
IPs required
10 GigE
VMware
Dynamic IPs
10.20.25.125
10.20.25.126
10.20.25.127
10.20.25.128
10.20.25.129
10.20.25.130
10.20.25.131 1 GigE
10.20.25.132
Hosts - iSCSI
10.30
File
Services
© Copyright 2011 EMC Corporation. All rights reserved.
20
Scale-Out Analytics Platform
Technical Insights
Rich Visualizations
Elaborate Drill-Downs
Historical and Real-Time
Virtual Appliance
Performance Analytics
CPU/Network Utilization
Cluster, Node, Interface, Client
Protocols, Operations, Disk
Per-File/Directory Performance
File System Analytics
Directory/File Visibility
© Copyright 2011 EMC Corporation. All rights reserved.
21
Summary
© Copyright 2011 EMC Corporation. All rights reserved.
22
What Makes Isilon Unique?
The Benefits of Isilon Storage
Scalability
HIGH CONCURRENCY ENVIRONMENTS
LARGE CAPACITY REQURIEMENTS
Ease of Management
MANAGING MORE STORAGE WITH LESS PEOPLE
Investment protection
NO NODE LEFT BEHIND – NO DOWNTIME TO SCALING
Utilization
GREATER ROI ON RAW to USABLE
Data Protection
RECOVERY AND STABILITY IN LARGE DATA ENVIRONMENTS
BETTER THAN DIY SYSTEMS
Tiering
LOWER COST TO KEEP DATA ONLINE while MEETING PERFORMANCE REQUIREMENTS
MEETING THE 80/20 RULE (INACTIVE/ACTIVE DATA)
© Copyright 2011 EMC Corporation. All rights reserved.
23
Thank You
© Copyright 2011 EMC Corporation. All rights reserved.
24