Zero to One Million IOPs In A Flash

FLASH NEXT:
Zero to One Million IOPs In A Flash
© Copyright 2013 EMC Corporation. All rights reserved.
1
Expectations Are Reset Forever
© Copyright 2013 EMC Corporation. All rights reserved.
2
DATA
IS GROWING
© Copyright 2013 EMC Corporation. All rights reserved.
3
While At The Same Time
Costs Must Be Contained
Information Must Become An Asset
Performance Must Be Delivered At Massive Scale
© Copyright 2013 EMC Corporation. All rights reserved.
4
ONLY FLASH CAN
MEET THESE EXPECTATIONS
© Copyright 2013 EMC Corporation. All rights reserved.
5
Flash: Redefining The Possible
2000 IOPS/GB
4000X
FASTER THAN
HARD DRIVES
0.5 IOPS/GB
Hard Disk
Drive
© Copyright 2013 EMC Corporation. All rights reserved.
PCIe
Flash
6
HOW DO WE BEST DEPLOY
FLASH?
© Copyright 2013 EMC Corporation. All rights reserved.
7
Performance
SERVER FLASH
Data Services
© Copyright 2013 EMC Corporation. All rights reserved.
8
XtremSF
Performance
Efficiency
Flexibility
© Copyright 2013 EMC Corporation. All rights reserved.
9
Introducing EMC XtremSF
Flexibility
Broad Range Of eMLC And SLC Capacities For Use As Local
Storage Or With VFCache
Performance
Dramatic Improvements In Application Latency And
Throughput—Up To 1.13 Million IOPS
Efficiency
Best TCO—Lowest Overhead, Highest Performance, Lowest
Power Consumption, Best Density
© Copyright 2013 EMC Corporation. All rights reserved.
10
The XtremSF Family
All Cards Are HHHL – Highest Density In The Industry
XtremSF 2200
XtremSF 1400
XtremSF 700
XtremSF 550
2.2 TB
1.4 TB
700 GB
550 GB
UP TO 1,130,000 IOPS
© Copyright 2013 EMC Corporation. All rights reserved.
11
HARDWARE
ACCELERATING APPLICATION PERFORMANCE
XtremSF
PCIe X8 Architecture For Superior Bandwidth
Advanced Garbage Collection Reduces Spikes
Optimized For Real World, 4K & 8K Workloads
Range Of Capacities in MLC & SLC Flash
Offload Engine Reduces CPU Consumption
© Copyright 2013 EMC Corporation. All rights reserved.
12
Real World Data, Real World Results
37% More IOPS With 27% Lower Latency Than Brand ‘F’
30% More IOPS With 23% Lower Latency Than Brand ‘F’
© Copyright 2013 EMC Corporation. All rights reserved.
Twice The IOPS With Half The Latency Of Brand ‘F’
132% More IOPS With 57% Less Latency Than Brand ‘F’
13
Performance
EMC XtremSF
add
Data Services
© Copyright 2013 EMC Corporation. All rights reserved.
14
EMC XtremSW Cache
Server Flash DAS Becomes Cache
Performance
Dramatic Improvements In
Latency And Throughput
Intelligence
Extends EMC FAST Architecture
Into The Server
Protection
Backed By Intelligent, Resilient,
Highly Available Storage
© Copyright 2013 EMC Corporation. All rights reserved.
15
EMC XtremSW Cache Application Testing Results
7.7X FASTER
PERFORMANCE
2.5X FASTER
© Copyright 2013 EMC Corporation. All rights reserved.
Latency
PERFORMANCE
1.0
1.0
RESPONSE TIME
3.1X BETTER
TPS
0.13
3.1
0.4
TPS
3.6X BETTER
3.6
Latency
RESPONSE TIME
1.0
1.0
16
XtremSW Cache Split Card Mode
The Best Of Both Worlds
Cache
DirectAttached
Storage
Data
1
© Copyright 2013 EMC Corporation. All rights reserved.
Data
2
Temp
DB
17
420% Faster Month-end Closure
385% Faster Annual Inventory
225% Faster Daily Processing
© Copyright 2013 EMC Corporation. All rights reserved.
18
SO WHERE
DO I DEPLOY
FLASH?
© Copyright 2013 EMC Corporation. All rights reserved.
19
WHAT’S COMING?
EMC Array Integration
Distributed Cache Coherency
Advanced VMware Support
Additional Environments
• AIX, SLES, 3rd Party PCIe
© Copyright 2013 EMC Corporation. All rights reserved.
20
Array Integration
VMAX
VNX
 Single Point Of Management
 Single Point Of Management
– LUN Selection Based On VMAX
Trending Analysis
– Call-home Support
– Integrated Performance
Statistics Reporting
– Performance And
Health Monitoring
– Discovery And Configuration
– LUN Selection Based On
VNX Trending Analysis
 Unmatched Performance Boost
– Cache Coordination:
Optimized Read Miss
– Prefetching Of Data To
XtremSW Cache
© Copyright 2013 EMC Corporation. All rights reserved.
21
XtremSW Cache Future Direction
Cache Coherency For Oracle RAC, Broad PCIe & OS Support
PCIe Card Support
Additional OS Support
© Copyright 2013 EMC Corporation. All rights reserved.
22
XtremSW Suite Future Direction
Data Services For Flash As Cache, DAS Or Memory
Caching
© Copyright 2013 EMC Corporation. All rights reserved.
Direct Attached Storage (DAS)
23
Performance
EMC XtremSF
ALL FLASH
ARRAY
Data Services
© Copyright 2013 EMC Corporation. All rights reserved.
24
XtremIO
RETHINKING CORE DESIGN CRITERIA
Software-Defined
Non-Proprietary Hardware
Inherently Balanced
Linear Scale-Out Architecture
Flash-Optimized
Sub-millisecond Data Services
© Copyright 2013 EMC Corporation. All rights reserved.
25
XtremIO
Scale-Out Architecture Delivers Unparalleled Functional IOPS
4K Random Read Performance
IOPS
750,000
2 X-Bricks
500,000
1 X-Brick
0
4 X-Bricks
400,000
4 X-Bricks
1,000,000
250,000
4K Random Write Performance
IOPS
1,250,000
300,000
2 X-Bricks
200,000
100,000
1 X-Brick
0
Sub-Millisecond Response Time With All Data Services Operating
© Copyright 2013 EMC Corporation. All rights reserved.
26
“Functional IOPS” vs. Hero Numbers
 Measured End-to-end At The Host
 100% Random
 All Flash Pages Non-zero
 Array Filled To 80% - Forcing Overwrites
 Any Size LUNs, Any LBA Range
 Mixed Read/Write I/O
ALL DATA
SERVICES
ACTIVE!
 Increasing Thread Counts
 Extended Time Periods
© Copyright 2013 EMC Corporation. All rights reserved.
27
XtremIO Rack Configurations
*IOPS
Measured With 4K Fully
Random, 50% Writes/50% Reads
^IOPS Measured With 4K Full
Random, 100% Reads
One X-Brick (6U)
150K IOPS*
250K IOPS^
© Copyright 2013 EMC Corporation. All rights reserved.
Two X-Bricks (12U)
300K IOPS*
500K IOPS^
Four X-Bricks (22U)
600K IOPS*
1M IOPS^
28
FLASH OPTIMIZED
DATA SERVICES
ALWAYS ON, ALWAYS PEFORM
© Copyright 2013 EMC Corporation. All rights reserved.
29
XtremIO Inline Data Reduction
Lowers Effective Cost While Increasing Performance And Reliability
 Always On, Inherent Function
 Scales-out
 Truly Inline, Global, Always On
 Improves Array Performance
 Lowers $/GB
 Extends Flash Endurance
© Copyright 2013 EMC Corporation. All rights reserved.
30
Thin Provisioning
Optimal 4KB Allocation - No Waste, Ever
 Always Thin Provisioned
 100% Performance
 Perfect 4KB Allocation Granularity
 No Fragmentation Or Reclamation Penalty
© Copyright 2013 EMC Corporation. All rights reserved.
31
XtremIO Data Protection (XDP)
 Optimized For Flash Overwrites
 No Configuration
 No Hot Spares
 SSDs May Fail In Place
 Adapts To Failures
 Distributed, Content-aware Rebuilds
© Copyright 2013 EMC Corporation. All rights reserved.
32
XtremIO Data Protection
XDP
RAID 1
RAID 5
RAID 6
RAID
5/RAID 6
Combo
Capacity
Overhead
8%
50%
25%
20%
30%
Superior Usable Capacity
Write I/O
Overhead
(Stripe
Update)
1.22
2
(64%)
2
(64%)
3
(146%)
5
(310%)
Up To 4x
Better Endurance
Read I/O
Overhead
(Stripe
Update)
1.22
0
2
(64%)
3
(146%)
5
(310%)
Up To 4x
Better Performance
© Copyright 2013 EMC Corporation. All rights reserved.
33
XtremIO Configuration
One Screen – Zero Planning, Zero Tuning
1
CREATE
VOLUMES
© Copyright 2013 EMC Corporation. All rights reserved.
3
MAP
VOLUMES
2
CREATE
INITIATOR
GROUPS
34
THE XTREMIO DIFFERENCE:
THE DATA IS THE ADDRESS
© Copyright 2013 EMC Corporation. All rights reserved.
35
4K
4K
4K
4K
4K
4K
4K
4K
0325F7A
963FE7B
F3AFBA3
AB45CB7
20147A8
Core
Engine
134F871
32K
CA38C90
Incoming Data Stream
963FE7B
XtremIO Content Engine
Uniform Distribution Of Fingerprint Values
Any Content Difference = Uncorrelated
Values
© Copyright 2013 EMC Corporation. All rights reserved.
36
4K
4K
4K
4K
4K
AB45CB7
20147A8
4K
F3AFBA3
4K
963FE7B
4K
0325F7A
Core
Engine
134F871
32K
CA38C90
Incoming Data Stream
963FE7B
XtremIO Content Engine
0 1 2 3 4 5 6 7 8 9 A B C D E F
X-Brick #1
X-Brick #2
0 4 8 C
2 6 A E
1 5 9 D
3 7 B F
© Copyright 2013 EMC Corporation. All rights reserved.
37
XtremIO Content Engine
4K
4K
4K
4K
4K
F3AFBA3
AB45CB7
20147A8
4K
963FE7B
4K
0325F7A
Only Unique Writes
Dedupe Aids Performance
Inherently Load Balanced!
Same Process Regardless
Of Cluster Size
4K
134F871
•
•
•
•
Core
Engine
CA38C90
32K
Deduplicate
963FE7B
Incoming Data Stream
0 4 8 C
4K 4K
4K 4K
2 6 A E
1 5 9 D
4K 4K
4K
3 7 B F
© Copyright 2013 EMC Corporation. All rights reserved.
38
XtremIO Content Engine
Physical Addressing
4K 4K 4K 4K 4K 4K 4K 4K 4K 4K P1 P2
LBA
Offset
Fingerprint
SSD
Offset
4K
0
20147A8
40
4K
4
AB45CB7
8
4K
8
F3AFBA3
88
4K
12
963FE7B
24
4K
16
0325F7A
64
4K
20
134F871
1024
128
4K
24
CA38C90
516
4K
28
963FE7B
4K 4K
4K 4K 4K 4K 4K 4K 4K 4K 4K 4K P1 P2
• Intelligent Real-time Data Placement
• Maintains Service Levels During SSD
‘Hiccups’ And Rebuilds
• Enables Scale-out Data Distribution
© Copyright 2013 EMC Corporation. All rights reserved.
39
XtremIO Architecture Benefits
 Extends Flash Endurance
 Always Maximum Performance
 No Setup Or Tuning
 Foundation For Advanced Array
Functionality
© Copyright 2013 EMC Corporation. All rights reserved.
40
XtremIO For Databases
• Production on flash
• Over 130TB usable
performance storage
• Full time administrator
• Massive storage footprint
• Can’t quickly scale or
respond
© Copyright 2013 EMC Corporation. All rights reserved.
41
XtremIO For Databases
10X
90%
80%
50%
20%
Better
Performance
Less
Floor Space
Less
Power Usage
Lower
Cost
Higher
Productivity
© Copyright 2013 EMC Corporation. All rights reserved.
42
CMA Customer Profile
Oracle RAC Data Warehouse
Challenge




Extreme Performance (6GB/S Large Block Random Workload)
High Oracle Licensing Costs
Storage OpEx
Complex Setup/Tuning
Solution
 XtremIO All-Flash Array
BRIAN DOUGHERTY
Chief Data Warehouse Architect
“Using XtremIO we are able to engineer our Oracle RAC
systems to be faster, more scalable, and handle more
concurrent users, while at the same time requiring only
20% of the previous footprint in our data center”
© Copyright 2013 EMC Corporation. All rights reserved.
Application
 Largest Medicaid Analytics
Database (Oracle RAC) In US
 High User Concurrency
 Fast Response Time Needed
Results




75% Reduction In Storage Configuration Time
Reduced Space/Power/Cooling Footprint
Reduction In Server Size/Processor Count & Oracle Licenses
~1.9GB/S Bandwidth Per X-Brick At <1ms Latency
43
Baillie Gifford Customer Profile
Oracle Performance and Flexibility
Challenges
 Query Response Times
 Business Processing Times
 Development/Test Database Footprint & Performance
Solution
 XtremIO All-Flash Array
 One X-Brick
SANDY BRYCE
Enterprise Platforms Strategy Team Leader
“The performance, ease of use, and deduplication make
XtremIO a compelling addition to your IT service
portfolio!”
© Copyright 2013 EMC Corporation. All rights reserved.
Application




Oracle 11G
High User Concurrency
Fast Response Time Needed
Large Dev/Test Environment
Results




Deduplication For Dev/Test Gives “Free” Database Copies!
30% Business Process Time Improvement
15-40% User Query Time Improvement
CPU Wait Time Reduced, Utilization Increased
44
Server Virtualization On XtremIO
 Flash Is Cost Effective Through Inline Data Reduction
 Virtualizing Any Workload Is Feasible
 Deployment Agility
© Copyright 2013 EMC Corporation. All rights reserved.
45
Redefine VMware
 Easy-to-manage Multi-TB
Volumes
 Accelerated Formatting
 Enhanced Copy Services (VAAI +
Inline Data Reduction + Inmemory Metadata)
© Copyright 2013 EMC Corporation. All rights reserved.
46
Full Copy
on
Free Lunch!
X-Copy
Command
Addr
+4k
+8k
+12k
+16k
+20k
New
Addr
+4k
+8k
+12k
+16k
+20k
Metadata In Memory
Ptr
Ptr
Ptr
Ptr
Ptr
Ptr
A B C D
© Copyright 2013 EMC Corporation. All rights reserved.
Ptr
Ptr
Ptr
Ptr
Ptr
Ptr
Data On SSD
47
EMC Hands-On-Labs
 Running Live Right Now!
 Creating And Destroying Thousands Of VMs Each Hour
 Massive I/O Intensive Workloads
 A Data Center Of VMs Running On A Rack Of XtremIO
© Copyright 2013 EMC Corporation. All rights reserved.
48
VDI Breakthroughs With XtremIO
 Simple Administration – Do Whatever You Want
 Dramatic Storage And Server Cost Reduction
 “Macbook Air”-like SSD User Experience
 Near Instant Desktop Rollouts
 Scale To Any Number Of Desktops & I/O Per Desktop
© Copyright 2013 EMC Corporation. All rights reserved.
49
XtremIO VDI Breakthroughs
 Deploy ‘Ready To Use’ Desktops In Seconds
 Minimal Flash Capacity For Each New Desktop
 Mix Linked And Full Clones As Needed
 Unparalleled Desktop User Experience
 Extremely Attractive $/Desktop
© Copyright 2013 EMC Corporation. All rights reserved.
50
Boston Scientific Customer Profile
Full Clone VDI With XtremIO
Challenge




Large-scale VDI Environment
Full Clone Persistent Desktops Mandatory
VDI User Experience Complaints
Storage Cost, Complexity
Solution
 XtremIO
 One X-Brick For Desktops
CRAIG ENGLUND / SEAN COLLIER
Principal Virtualization Architect/Sr. Administrator
“There are few things in history that have a significant
impact on advancing technology – I see XtremIO as one
of those technologies.”
© Copyright 2013 EMC Corporation. All rights reserved.
Application
 VMware Horizon View VDI
 VMware vSphere Hypervisor
Results




Incredible End User Desktop Experience
Lower $/Desktop Than Prior Storage Array
Rapid Desktop Rollouts During Production Hours
Complex VDI Made Simple And Successful
51
XtremIO
CURRENTLY IN
DIRECTED AVAILABILITY
© Copyright 2013 EMC Corporation. All rights reserved.
52
How It All Fits Together
Server Storage
Hybrid Arrays
Make The Hot Edge Hotter!
SAN
SAN
SAN
DEDUPE, THIN,
SNAPS, REPLICATION
SAN
XtremIO
DEDUPE, THIN,
SNAPS,XtremIO
REPLICATION
DEDUPE, THIN,
SNAPS,XtremIO
REPLICATION
DEDUPE, THIN,
SNAPS,XtremIO
REPLICATION
DAS Or Memory
XtremSF
XtremSF
Or
3rd
XtremSF
Or 3rd
Party
OrXtremSF
3rd
Party
Party
Or 3rd Party
DAS Or Memory
DAS Or Memory
DAS Or Memory
XtremSW
XtremSW
Suite
XtremSW
Suite
XtremSW
Suite
Suite
Hot Edge
SSD
FC
SATA
ViPR Controller
FAST
© Copyright 2013 EMC Corporation. All rights reserved.
53
How It All Fits Together
Server Storage
Make The Cold Core Cooler!
Cold Core
SAN
SAN
SAN
DEDUPE, THIN,
SNAPS, REPLICATION
SAN
XtremIO
DEDUPE, THIN,
SNAPS,XtremIO
REPLICATION
DEDUPE, THIN,
SNAPS,XtremIO
REPLICATION
DEDUPE, THIN,
SNAPS,XtremIO
REPLICATION
DAS Or Memory
XtremSF
XtremSF
Or
3rd
XtremSF
Or 3rd
Party
OrXtremSF
3rd
Party
Party
Or 3rd Party
DAS Or Memory
DAS Or Memory
DAS Or Memory
XtremSW
XtremSW
Suite
XtremSW
Suite
XtremSW
Suite
Suite
Hybrid Arrays
Hot Edge
SSD
FC
SATA
ViPR Controller
FAST
© Copyright 2013 EMC Corporation. All rights reserved.
54
Redefining The Possible
COMPLETE
• FLASH PORTFOLIO
• SET OF TOOLS
• DEPLOYMENT EXPERTISE
© Copyright 2013 EMC Corporation. All rights reserved.
55
EMC CAN HELP YOU
LEAD YOUR
TRANSFORMATION
© Copyright 2013 EMC Corporation. All rights reserved.
56