Thriving at Petabyte scale & beyond
+
Software-Defined Object Storage for the POSTRAID era
Legacy file storage technology is limiting the
ability for entities to thrive @ “scale”
Constrained
Expansion &
Extensibility
•
•
•
•
•
Max out at PB level
Data Silos
Tedious management
Service downtime for upgrades
Specialized staff
Rigid & Brittle
Durability
•
•
•
RAID rebuild times too long
Backup costs too high
Not all data should be
treated the same, anyway
Restricted
Accessibility
•
•
•
Web servers and load
balancers needed
SMB and NFS are not web
protocols
Limited query and analysis
The Need...
 Multi-protocol ingest support (http, file, S3, Swift, block)
 Internet accessible, web-scale
 Ability to run on standard commodity hardware
 Simple to deploy, manage, scale & evolve
 Ability to continuously protect any amount of data, natively
 Secure and Compliant
 Future-proof (durable & extensible)
The Solution – Caringo SWARM
Caringo’s Swarm object storage software:
• Aggregates the disk capacity across heterogeneous
clusters of commodity servers to…
• Create massively & dynamically scalable multitenant storage systems that are…
• Self-managing, self-healing, high-performance,
and durable through time, where
• Files and their descriptive metadata (i.e. objects) are
accessible whenever and wherever they are
needed by users, administrators and by data services
How We Do It – Efficient Software
Swarm
Runs from RAM
Boots from bare metal in minutes
on any x86 hardware with Linux
works on raw disk level
RAM
CPU
98%
available
NIC
Tune to any workload
No file system, no software install
leaves 98% drive capacity for data
HTTP
SNMP
How We Do It – Resource Virtualization
Swarm
RAM
CPU
NIC
Node 1
How We Do It – Resource Virtualization
Swarm
RAM
CPU
NIC
RAM
RAM
CPU
CPU
NIC
Node 1
How We Do It – Resource Virtualization
Swarm
RAM
CPU
Node 1
NIC
RAM
RAM
CPU
CPU
NIC
Node 2
How We Do It – Resource Virtualization
Swarm
Node 1
Node 2
Node 3
Node …
How We Do It – Emergent Behavior
 No single points
of failure
SWARM follows simple
rules to manage a
complex system
 Nodes cooperate
to perform
processes
 Improves with size!
How We Do It – Encapsulated Data
Metadata stored with data
data + metadata
No metadata databases
to manage
How We Do It – Encapsulated Data
Object is encapsulated
Includes all system, policy and
custom metadata
How We Do It – Encapsulated Data
Object is portable & dynamic
Decoupled from hardware, location and apps
Freeing data to be accessed in multiple ways
Swarm Adapts
Swarm lets you grow at the pace
you choose and adapts to your
requirements or workload
• Plug in new servers for more capacity &
performance - address needs in real time
• New resources available in minutes
site 2
site 1
Swarm
• Right resources to the right locations
• Local and geo-distribution
• Easily retire old hardware
site 3
Swarm Protects
Swarm automatically manages the
data protection you choose
• Protection per cluster, bucket or at the
object level
• Seamlessly move between replication
and erasure coding
• Store objects with different protection
levels on the same server
• Auto-managed through Lifepoints
• Protect data based on value
Erasure
encoding
Swarm Repairs
Swarm watches for issues and
repairs them automatically so
you don’t have to
• Health Processor proactively checks
integrity, availability and cardinality
• Fast Volume Recovery, content
aware, repairs only damaged objects
• Assurance of data quality for the
entire enterprise
• Provides business continuity
+
+
+
+
+
Portfolio Overview
Scalable storage software for unified object, file and block
Cloud
Big Data/Hadoop
Archive
Enterprise Apps
Select the interface and hardware for your workload and use case.
CloudScaler
FileScaler
BlockScaler
HTTP 1.1, Amazon S3
SMB, NFS
iSCSI (Beta)
Caringo
Swarm
Adaptable performance for unified
storage under a single namespace.
It’s Simple…Really!
•
•
Ethernet
Switches 1Gb
or 10Gb
Caringo
SWARM
Object
Storage
Cluster
•
Mix and Match HW w/ any drive size
Grow from one form factor to another, at
runtime, incrementally
Never forklift upgrade again
Small
Medium, Large
R420
R720xd or
+JBOD
Add Caringo Software Capacity Licenses, per
TB, and annual support/maintenance
Caringo
Cluster
Services
Node
Small, Medium, Large
(Physical or
Virtual)
Add Caringo CSN Software License and annual
support/maintenance
R420 or VM
Simple…But Powerful!
Hadoop Analytics
Add Storage
Services
Scale in any
increment @
runtime
Distribute,
Consolidate, Share
automatically
File
Gateway
S3
HTTP
Application
Multi-Tenant
STaaS
Ingest from many sources*
Search &
Discovery
Remote Sites
Automate Retention, Protection &
Durability down to the object level
Object storage - its all about use cases
DOD Medical Health
Systems (16 PBS)
PACS Archiving
Video Surveillance
(2.5 PBS) File
Retention
S3-like cloud storage services via
Swarm & CloudScaler
M2M and analytics
(4 PBS)
Consumer/enterprise backup-tocloud service
(2+ PBS)
Web content delivery
plus hundreds more…
Next Steps – Where/How to get Started?
• Identify your Target use case(s):
•
See Use Case Slide.
•
If in doubt: “Drain your Filer Swamps” – File System Optimization Tier!
• Contact your Dell Account Representative for pre-sales
support – All Caringo Software & Services are available through Dell
• OR, Contact brandon.canaday@caringo.com
Thank You
Software-Defined Object Storage for the POSTRAID era