Data Storage Vendor Neutral Data Archiving Shana Telesz Imagination at work GE Proprietary Information Vendor Neutral Archiving Storing data in a standard format with a standard interface, such that it can be accessed in a vendorneutral manner by other systems NDT ASTM Standard Format - DICONDE 2 Rhythm Enterprise Archive: Data Management Solution A DICONDE compliant solution for storing high volumes of vendor neutral NDT inspection data on global IT networks making all NDT information available to every Rhythm User within a customer network. • • • • • • Multi Modal Data Storage Use of customers own IT infrastructure Data Searching Secure data management Shadowing Life Management Tools DICONDE Compliant System Workflow with Rhythm Review Workstation 1 Review Workstation 2 Review Workstation 3 Space Efficiency with DICONDE Using a DICONDE System, when a Level II adds annotations and saves…. A Presentation State or Layer is created – very small Storage Requirements Increase Image Data Management Data Life Span using Rhythm Enterprise Archive Setup Rules based on DICONDE tags to Remove Images when their life span expires Enterprise Archive – Shadowing Why Shadow? Centralized backup server Web access centralized – cost effective Data Analytics from one central Enterprise Archive Server Simplicity of Data Migrations as Technology changes 7 Rhythm EA Example Shadowing Configuration Site 1 Review Workstation Site 4 1 Review Workstation Review Workstation 1 1 Site3 Review Workstation 1 Rhythm Enterprise Archive Customer Network TCP/IP Offsite Backup Server (Shadow) Rhythm Enterprise Archive/Web Rhythm Web Site 2 VA’s Site 1 Site 2 Site 3 Rhythm Enterprise Archive ••• Data Analytics of DATA Tools SAN NDT Cloud Petabytes DICONDE Internet Meta Data Asset Life p e e d Networks TERABYTES CT Data S Cost Search Vendor Neutral Software N A S Technologies CT Customer with Data Retention Typical Scenario CT Data Size: 1 – 10 GB* Possible 35,000 scans per year Retention period: 5 yrs – Life of Asset Min 35 TB per year plus 5% growth year over year * Full volumetric data 10 THERE’S HELP! Storage that is: RELIABLE SCALABLE SIMPLE TO MANAGE © Copyright 2015 EMC Corporation. All rights reserved. 11 RELIABILITY ENSURING STORED RECORDS CAN BE RETRIEVED Enterprise-class design, including processes for data integrity, fault detection, and multipath networking Utilize protection schema (such as RAID 6) to ensure data is maintained in the event of a hard drive failure Availability of world-wide support services © Copyright 2015 EMC Corporation. All rights reserved. 12 SCALABILITY SOLUTION THAT CAN BE EASILY EXPANDED OVER TIME File Size File Volume Copies for Protection Storage Solution Growth Retention Time © Copyright 2015 EMC Corporation. All rights reserved. 13 VNXe 3150 The ideal choice for smaller archives • • • • • • Quad core processor Up to 100 drives 10TB-100TB configurations Built in snapshots for local protection Expansion via disk packs iSCSI (CIFS Share) or SAN (Windows Volume) support © Copyright 2015 EMC Corporation. All rights reserved. 14 Isilon The Ultimate in Scalability • • • • • Each node adds storage + processing for linear scaling of performance 3 to 144 nodes 21TB-10PB+ configurations Expansion via additional nodes Simultaneous CIFS/NFS/HDFS* support X-Series Standard Archive NL-Series Dense Archive *HDFS= Hadoop File System used in Big Data Analytics © Copyright 2015 EMC Corporation. All rights reserved. 15 Isilon Simplicity and Ease of Use Single volume and file system SINGLE VOLUME Directories and files striped across cluster nodes Automation NO manual intervention NO reconfiguration NO server or client mount point or application changes NO data migrations NO RAID (more efficient Reed-Solomon coding) © Copyright 2015 EMC Corporation. All rights reserved. 16 Gain New Levels of Efficiency Isilon AutoBalance BALANCED EMPTY FULL AUTOBALANCE Automated data balancing across nodes reduces costs, complexity, and risks for scaling storage BALANCED EMPTY FULL BALANCED EMPTY • AutoBalance automatically moves content to new storage nodes • Eliminates “hot spots” FULL BALANCED EMPTY • Enables unmatched storage capacity utilization of more than 80% FULL BALANCED EMPTY © Copyright 2015 EMC Corporation. All rights reserved. 17 Rhythm Archive HW Options for Big Data Storage CR 14”x17” @ 50µ = 118 Mb @ 100/day, 5 days/wk = 3 TB/yr, 3 years storage @ 10 TB DXR500L = 15 MB @1000/day, 7 days/wk = 5 TB /yr , 2 years storage @ 10 TB Server Long-term Storage Appliance HP Proliant DL360p G8 VNXe 10 or 48 TB 2 CPU EA 24 GB RAM Cache – 2.4 TB GEHC Certified High Availability Unified Storage Max 100 TB RAID 6 Protection WORM Available Encryption Optional Data Management Software 18 Rhythm Archive HW Options for Big Data Storage CR 14”x17” @ 50µ = 118 Mb @ 1000/day, 7 days/wk = 43 TB/yr , 1 year storage @ 65 TB CT @ 1 GB Volumes @ 35,000/year = 35 TB/yr, 2 years storage @ 65 TB 2 CPU EA 24 GB RAM Cache – 2.4 TB 3 yr CarePack Long-term Storage Appliance GEHC Certified Scale-out Max 10+ PB Simple add-in nodes WORM Optional Encryption Optional Parity Protection Rack Included Data Management Software 99 Virtual Archives Web 15 Concurrent 5 days Install & Training HP Proliant DL360p G8 Server EMC Isilon (65 TB) Additional 36 TB Nodes can be added to the Isilon 19 Rhythm Enterprise Archive SD SW Deployment Data Management Software Customer IT Provides Server & Data Storage Rhythm Enterprise Archive SW 1 Virtual Archive included Tech Support Installation and Training 20 Data Analytics of DATA Tools SAN NDT Cloud Petabytes DICONDE Internet Meta Data Asset Life p e e d Networks TERABYTES CT Data S Cost Search Vendor Neutral Software N A S Technologies Questions 22