HITACHI DATA INGESTOR
BOTTOMLESS, BACKUP-FREE
CLOUD ON-RAMP DELIVERS
IT SERVICES TO THE EDGE
PRESENTER NAME
DATE
AGENDA
 Market drivers and customer challenges
 Hitachi Data Ingestor solution overview
 Use cases
 Summary and benefits
INFORMATION TECHNOLOGY DEMANDS
Users
 Access all the time
 On-demand capacity
 Ability to restore and recover
 Fast response
Simplified IT
delivery models
Management
 Lower costs
 Simplified infrastructure
 Faster time to market
 Minimized risk
CUSTOMER CHALLENGES IN A
DISTRIBUTED WORLD
 Disparate islands of information and infrastructure
 Unruly OPEX and CAPEX costs for management and backup
 Lack of content control
SIMPLIFY, CONSOLIDATE AND REDUCE COSTS
 Eliminate backups at remote locations
 Reduce capital costs and management overhead
 Optimize utilization, scale and operations
AGENDA
 Market drivers and customer challenges
 Hitachi Data Ingestor solution overview
 Use cases
 Summary and benefits
EDGE-TO-CORE: HITACHI DATA INGESTOR
AND HITACHI CONTENT PLATFORM
 Integrated edge-to-core solution:
Greatly reduces the cost and
complexity of providing IT services
to distributed consumers
Edge
Hitachi Data Ingestor
Core
Hitachi Content
Platform
- Remote or branch offices
Data
- Cloud storage consumers
 Hitachi Data Ingestor:
Minimal- footprint or virtual appliance
that sends data from the edge to a
core infrastructure
Branch 1
Data
- Bottomless and backup-free
- Caching filer
Branch 2
Data
 Hitachi Content Platform:
Massively scalable, multitenant
distributed object store
Branch 3
- Delivers advanced storage and
data management capabilities
Data center
FROM THE EDGE: HITACHI DATA INGESTOR
 A bottomless and backup-free filer
-
Native read and write file system access (CIFS and NFS) to content in Hitachi Content Platform
-
Migrates data to Hitachi Content Platform and maintains a local link to the content
-
Fully integrated with AD and LDAP
-
Tightly integrated with Hitachi Content Platform to provide seamless access and a wide range of advanced
storage features
-
Provides a management API for tight integration with Hitachi Content Platform and 3rd party management UIs
-
Support for leading WAN acceleration solutions
Features
 All content migrated and backed up in
Hitachi Content Platform
 Advanced cache management supports
400 million files
 Supports hundreds of users per node
 Transparent NAS migration for existing
filers and servers
 File restore for user self-service
 Content sharing in a distributed
environment
Hitachi Data
Ingestor
Hitachi Content
Platform
TO THE CORE: HITACHI CONTENT PLATFORM
Features
 Up to 40PB of usable capacity in
a single physical cluster
- Multitenant
- Intelligent objects
- Chargeback
- Compression and
deduplication
 Security and compliance
- Encryption of data at rest
- Authentication
- WORM
- Compliance and retention
 Built-in protection, preservation
and replication
- High-availability architecture
- Continuous data integrity
checking
- Advanced replication and
disaster recovery
Hitachi Content Platform
Active archive
content depot
Data protection
backup reduction
Private cloud
Public cloud
Ultimate investment
protection
A number of discrete use cases from a single
platform with rich functionality, robust data
protection and a single point of management
HITACHI DATA INGESTOR CHOICES
 Hitachi Data Ingestor (HDI) offers 3 configuration options

HDI cluster

HDI single node

HDI VMware appliance
1. HDI cluster
2. HDI single node
3. HDI VMware appliance





Highly available cluster pair
SAN-attached to Hitachi storage
• Supports AMS, VSP,
USP V, USP VM

Non-redundant configuration
Internal direct attached
storage
Deploy in rack or by itself


Deploy on VMware vSphere
Hypervisor
Customer-defined hardware and
storage configuration
Available in HA architecture
HOW HITACHI DATA INGESTOR
MIGRATES FILES
 Application writes a file to Hitachi Data Ingestor (HDI)
 Hitachi Data Ingestor replicates the file to Hitachi Content Platform (HCP)
 Users can “pin” files of their choices to make them stay on HDI all the time
 When system capacity reaches 90%, HDI deletes “non-pinned” files in excess of
the threshold and creates 4KB link stubs to replace them
- Users access the files as they always have, since links are transparent to clients
 Reading a link recalls the file back into HDI
- Recalled files are deleted from HDI later and replaced by another link, based on HDI
system capacity and least-recently-used criteria
CIFS/NFS
Application
HDI
REST/HTTP(S)
HCP
WRITE
REPLICATE
READ
RECALL
HITACHI DATA INGESTOR:
INTELLIGENT CACHING
Features
 Intelligent cache management
- Identifies and retains newer and more
frequently accessed files
- Cache tuned to edge deployments
with WAN connectivity
 Advanced capacity management and
high performance
CAPABILITY
METHOD
Stubbing
frequency
Files are stubbed
every hour
LRU algorithm
Oldest files are
purged first, based
on atime and
mtime attributes;
newer files stay in
cache longer
Read cache
Recalled files stay
in cache until the
next capacitymanagement
process
Benefits
 Faster access to frequently used files
– active files stay on HDI all the time
 Enhanced replication performance
 Maximum capacity utilization
 Free up bandwidth over the WAN
HOW HITACHI DATA INGESTOR MAPS TO THE CORE


Clients
write
to assigned
fileto
systems
Each
namespace
can
be shared
multiple HDIs
file
system
is
mapped
itsby
designated
namespace
Content sharing enables edge dispersion
Client
Client
Branch A
FS 2
Client
Branch B
FS 1
FS 2
HDI
HDI
Tenant A
Tenant B
Namespace 1
Namespace 2
Client
Namespace 1
Client
Branch C
Read-only
FS 1
Client
Namespace 2
FS 1
FS 2
HDI
Tenant C
Namespace 1
Namespace 2
Hitachi Content Platform
Benefits
 Satisfy multiple applications, varying SLAs and workload types or organizations
 Determine utilization and chargeback per customer
 Edge dispersion: each HDI can access another when set up that way
 Enable advanced features at one branch or at more granular level
• Examples: replication, encryption, DPL levels (how many copies to keep),
compliance and retention, compression and versioning
COMPLIANCE AND GOVERNANCE
CAPABILITIES
Flexible retention support and WORM functionality using an
industry-standard atime-based interface and automated settings
 Retention is an optional setting
 Allows you to specify a file’s retention date; the file is then protected
by strict WORM restrictions
-
While under retention, WORM files cannot be deleted
WORM files are immutable, even after retention expires
WORM files cannot be renamed
Directories containing WORM files cannot be renamed
 Retention settings are transferred to Hitachi Content Platform as
files are migrated
 Retention can be tunable per file system
 Support for backup and restore of retention properties
CONTENT SHARING
 A Hitachi Data Ingestor system can map to a
Hitachi Content Platform (HCP) tenant to write
content and potentially read content from other
HCP tenants
 Sharing supports a single writer with many readers
SITE A
SITE C
SITE B
file system A
file system A
WAN
tenant A
file system B
file system C
Read
tenant B
namespace A
file system A
read/write access
tenant C
namespace B
Namespace C
read-only access
CONTENT SHARING USE CASE:
MEDICAL IMAGE FILE SHARING
 Hospital A stores medical files to file system A of Hitachi Data
Ingestor A
 The files are migrated to namespace A on Hitachi Content Platform
(HCP)
 Hospital B can read the files through file system A, which is mapped
to namespace A on Hitachi Content Platform
HOSPITAL A
HOSPITAL B
File system A
File system A
WAN
Tenant A
Read
Read and write access
Tenant B
Namespace A
File system B
Namespace B
Read-only access
CONTENT SHARING USE CASE:
RETAIL CATALOG UPDATES
 Headquarters stores updated pricing catalog files to file system A of
Hitachi Data Ingestor (HDI) A
 The files are migrated to namespace A on Hitachi Content Platform
 Stores HDI B-n read the updated catalog and implement new pricing
policies
Headquarters
STORE C
STORE B
File system A
File system A
File system A
STORE n
WAN
Tenant A
File system A
Namespace A
Read and write access
Read-only access
FILE RESTORE

Hitachi Data Ingestor (HDI) creates a snapshot directory for each migration

Snapshot are created under a history directory

User can access snapshot files for specified migrations under “.history/<date+time>/<original path>”
and can restore a snapshot file to the current working directory
Hitachi Data
Ingestor
FS0 (share)
READ ONLY
Hitachi
Content
Platform
.history
Dir0
Dir0
file3
20110317
…
20110301
current: 20110317
v1: 20110215
file1
File1
file2
Dir0 at
20110317
DIr0 at
20110301
File1
File1
at
20110317
at
20110301
current: 20110317
v2: 20110301
v1: 20110215
・・・
NAS MIGRATION
 Hitachi Data Ingestor (HDI) migrates data from a customer’s production
NAS to HDI file system and then to Hitachi Content Platform (HCP)
 NAS migration is an automated background task, designed to be
transparent to users of NAS system being migrated
 Supported platforms are NetApp and Windows storage servers
 CIFS only
CIFS Client
Migration source NAS
Migration source NAS
HDI
Migration source NAS
HCP
Both
Both execute
execute at
at the
the same
same time
time
DATA PROTECTION AND DISASTER RECOVERY
Features
Failover
-
No single point of failure
-
Active data protection, dataintegrity monitoring and self
healing
 Disaster Recovery
-
Both have replication and
failover capabilities
-
HDI can rebuild its entire view
from a local or remote HCP
Benefits
 Backups no longer required
 Data protected on multiple
levels
Authenticate
Failover
 Both Hitachi Data Ingestor
(HDI) and Hitachi Content
Platform (HCP) have
high-availability architectures
HDI Cluster
Passive
Active
Active
Tenant
Namespace 1
Namespace 2
HCP 1
Replication
Tenant
Namespace 1
Namespace 2
HCP 2
AGENDA
 Market drivers and customer challenges
 Hitachi Data Ingestor solution overview
 Use cases
 Summary and benefits
BOTTOMLESS AND BACKUP-FREE
EDGE-TO-CORE SOLUTION
For customers who
 Run distributed IT environments and
are looking for help in managing them
 Have remote office, branch office
storage with low-end Windows/NFS
servers
 Have legacy file systems that could
benefit from cloud storage
 Are looking to reduce their storage
footprint and administrative overhead
at the edge
Branch 1
Branch 3
Hitachi Data Ingestor
Hitachi Data Ingestor
Branch 2
Features
 Bottomless and backup-free storage
 Local cache for fast retrieval of
frequently accessed content
 Standard on-ramp connecting into a
Hitachi Content Platform-based cloud
 Supports multiple tenants and
namespaces
 AD and LDAP support
Hitachi Data Ingestor
Data center
Tenant 1
Tenant 2
Hitachi Content Platform
Tenant 3
CLOUD ON-RAMP
For customers who are
 Cloud service providers or telcos
looking to connect customers to their
cloud via a standards-based on-ramp
 New customers looking to deliver
more efficient and cost-effective
storage solutions to branch or
distributed users or as a private cloud
 Customers looking to burst to the
cloud for on-demand storage
consumption
Features
 Seamless and integrated connection
from users to cloud
 Fast-time-to-value, low-touch on-ramp
into the cloud
 Chargeback customers based on
consumption and utilization
 Secure partitioning of customer data
Acme Co.
Hitachi Data Ingestor
ABC Ltd.
Widget Inc.
Hitachi Data Ingestor
Hitachi Data Ingestor
Cloud service provider
ABC Ltd.
Acme Co.
Hitachi Content Platform
Widget Inc.
FILE SYSTEM GATEWAY TO
HITACHI CONTENT PLATFORM
For customers who





Require faster performance from Hitachi Content
Platform (HCP) than native CIFS and NFS
gateways deliver
Require HCP namespace support
Want to support AD for end users to access HCP
Have applications that need to modify data after
it is written
Are not planning to modify in-house applications
to integrate to HCP REST APIs immediately
Data Center
Hitachi Data
Ingestor
Features
 Provides read and write access to HCP
for applications using CIFS/NFS
 Supports full HCP features set
-
Multitenancy and namespace
-
Compliance and retention
-
Data protection and disaster recovery
 Provides native CIFS/NFS access speed
Data
Hitachi Content
Platform
AGENDA
 Market drivers and customer challenges
 Hitachi Data Ingestor solution overview
 Use cases
 Summary and benefits
HITACHI DATA INGESTOR SOLUTION BENEFITS
Reduces costs
 Eliminates backups with a bottomless edge device
 Improves efficiency and utilization
Simplifies IT
 Reduces islands of storage and infrastructure
 Standard connection into Hitachi Content Platform (HCP)
Reduces risk
 Supports compliance and governance capabilities
 Security with AD and LDAP
Streamlines cloud
 Multitenant, multiple namespaces
 Seamless connection into a central-core HCP
QUESTIONS AND
DISCUSSION
THANK YOU