Data Storage - GE Measurement & Control

Data Storage
Vendor Neutral Data Archiving
Shana Telesz
Imagination at work
GE Proprietary Information
Vendor Neutral Archiving
Storing data in a standard format with a standard
interface, such that it can be accessed in a vendorneutral manner by other systems
NDT ASTM Standard Format - DICONDE
2
Rhythm Enterprise Archive:
Data Management Solution
A DICONDE compliant solution for storing high volumes of
vendor neutral NDT inspection data on global IT networks
making all NDT information available to every Rhythm User
within a customer network.
•
•
•
•
•
•
Multi Modal Data Storage
Use of customers own IT infrastructure
Data Searching
Secure data management
Shadowing
Life Management Tools
DICONDE Compliant System Workflow
with Rhythm
Review Workstation 1
Review Workstation 2
Review Workstation 3
Space Efficiency with DICONDE
Using a DICONDE System,
when a Level II adds
annotations and saves….
A Presentation State or Layer
is created – very small
Storage
Requirements
Increase
Image Data Management
Data Life Span using Rhythm Enterprise Archive
Setup Rules based on
DICONDE tags to Remove
Images when their life
span expires
Enterprise Archive – Shadowing
Why Shadow?
 Centralized backup server
 Web access centralized – cost effective
 Data Analytics from one central Enterprise Archive Server
 Simplicity of Data Migrations as Technology changes
7
Rhythm EA Example Shadowing Configuration
Site 1
Review Workstation
Site 4
1
Review Workstation
Review Workstation
1
1
Site3
Review Workstation
1
Rhythm Enterprise
Archive
Customer
Network
TCP/IP
Offsite Backup Server
(Shadow)
Rhythm Enterprise
Archive/Web
Rhythm Web
Site 2
VA’s
Site 1 Site 2 Site 3
Rhythm Enterprise
Archive
•••
Data
Analytics
of
DATA
Tools
SAN
NDT
Cloud
Petabytes
DICONDE
Internet
Meta Data
Asset
Life
p
e
e
d
Networks
TERABYTES
CT Data S
Cost
Search
Vendor Neutral
Software
N
A
S
Technologies
CT Customer with Data Retention
Typical Scenario
 CT Data Size: 1 – 10 GB*
 Possible 35,000 scans per year
 Retention period: 5 yrs – Life of Asset
 Min 35 TB per year plus 5% growth year over year
* Full volumetric data
10
THERE’S HELP!
Storage that is:
RELIABLE
SCALABLE
SIMPLE TO
MANAGE
© Copyright 2015 EMC Corporation. All rights reserved.
11
RELIABILITY
ENSURING STORED RECORDS CAN BE RETRIEVED
Enterprise-class design, including processes for data integrity, fault
detection, and multipath networking
Utilize protection schema (such as RAID 6) to ensure data is
maintained in the event of a hard drive failure
Availability of world-wide support services
© Copyright 2015 EMC Corporation. All rights reserved.
12
SCALABILITY
SOLUTION THAT CAN BE EASILY EXPANDED OVER TIME
File Size
File Volume
Copies for Protection
Storage Solution
Growth
Retention Time
© Copyright 2015 EMC Corporation. All rights reserved.
13
VNXe 3150
The ideal choice for smaller archives
•
•
•
•
•
•
Quad core processor
Up to 100 drives
10TB-100TB configurations
Built in snapshots for local
protection
Expansion via disk packs
iSCSI (CIFS Share) or SAN
(Windows Volume) support
© Copyright 2015 EMC Corporation. All rights reserved.
14
Isilon
The Ultimate in Scalability
•
•
•
•
•
Each node adds storage + processing
for linear scaling of performance
3 to 144 nodes
21TB-10PB+ configurations
Expansion via additional nodes
Simultaneous CIFS/NFS/HDFS*
support
X-Series
Standard Archive
NL-Series
Dense Archive
*HDFS= Hadoop File System used in Big Data Analytics
© Copyright 2015 EMC Corporation. All rights reserved.
15
Isilon Simplicity and Ease of Use
Single volume and file system
SINGLE VOLUME
 Directories and files striped across
cluster nodes
Automation
 NO manual intervention
 NO reconfiguration
 NO server or client mount point or application
changes
 NO data migrations
 NO RAID (more efficient Reed-Solomon coding)
© Copyright 2015 EMC Corporation. All rights reserved.
16
Gain New Levels of Efficiency
Isilon AutoBalance
BALANCED
EMPTY
FULL
AUTOBALANCE
Automated data balancing across nodes reduces
costs, complexity, and risks for scaling storage
BALANCED
EMPTY
FULL
BALANCED
EMPTY
• AutoBalance automatically moves content
to new storage nodes
• Eliminates “hot spots”
FULL
BALANCED
EMPTY
• Enables unmatched storage capacity
utilization of more than 80%
FULL
BALANCED
EMPTY
© Copyright 2015 EMC Corporation. All rights reserved.
17
Rhythm Archive HW Options for Big Data Storage
CR 14”x17” @ 50µ = 118 Mb @ 100/day, 5 days/wk = 3 TB/yr, 3 years storage @ 10 TB
DXR500L = 15 MB @1000/day, 7 days/wk = 5 TB /yr , 2 years storage @ 10 TB
Server
Long-term
Storage
Appliance
HP Proliant DL360p G8
VNXe 10 or 48 TB
 2 CPU EA
 24 GB RAM
 Cache – 2.4 TB






GEHC Certified
High Availability
Unified Storage  Max 100 TB
RAID 6 Protection
WORM Available
Encryption Optional
Data Management
Software
18
Rhythm Archive HW Options for Big Data Storage
CR 14”x17” @ 50µ = 118 Mb @ 1000/day, 7 days/wk = 43 TB/yr , 1 year storage @ 65 TB
CT @ 1 GB Volumes @ 35,000/year = 35 TB/yr, 2 years storage @ 65 TB




2 CPU EA
24 GB RAM
Cache – 2.4 TB
3 yr CarePack
Long-term
Storage
Appliance







GEHC Certified
Scale-out Max 10+ PB
Simple add-in nodes
WORM Optional
Encryption Optional
Parity Protection
Rack Included
Data Management
Software
 99 Virtual Archives
 Web 15 Concurrent
 5 days Install & Training
HP Proliant DL360p G8
Server
EMC Isilon (65 TB)
 Additional 36 TB Nodes can be added to the Isilon
19
Rhythm Enterprise Archive SD
SW Deployment
Data Management
Software
 Customer IT Provides Server & Data Storage
 Rhythm Enterprise Archive SW
 1 Virtual Archive included
 Tech Support Installation and Training
20
Data
Analytics
of
DATA
Tools
SAN
NDT
Cloud
Petabytes
DICONDE
Internet
Meta Data
Asset
Life
p
e
e
d
Networks
TERABYTES
CT Data S
Cost
Search
Vendor Neutral
Software
N
A
S
Technologies
Questions
22