LTFS EE
PGA2 Enhancements
Agenda
 LTFS EE Overview
 PGA1 Enhancements
 PGA2 Enhancements
 Demo
2
© 2014 IBM Corporation
What is LTFS
 File format
 File system
LTFS Index XML
Index Partition
Guard Wraps
File
B
O
T
3
File
File
Data Partition
File
E
O
T
© 2014 IBM Corporation
Creating Operational Storage Solutions
Goals:
 A single tiered storage system
Archive
Users & Applications
 A single namespace for all your file data
 Policy based placement of data
NFS, CIFS, FTP, …
 Scalable, low cost
 Open, non-proprietary, cross platform
interchange
Summary: Non-proprietary Policy based,
low cost scalable storage.
4
GPFS file system
LTFS EE
TS3500
© 2014 IBM Corporation
Use case: Long Term Data Retention (Archiving)
 Large amount of data, larger files
 Infrequently accessed
 Longer retention periods
LAN
Common name space
SAN
5
© 2014 IBM Corporation
Tape / Disk Cost Comparison
 A 12 Year TCO Archiving Study on Back-end storage costs including hardware,
maintenance, floor space and energy found disk storage is 15 times the cost of
tape
The cost of energy alone for the average disk-based solution exceeds the entire
TCO for the average tape-based solution
16
5000000
14
12
10
4000000
15X
Tape
Disk
8
6
4
3000000
238X
Tape
2000000
Disk
1000000
2
0
0
12 year TCO
Notes report “In Search of the Long-Term Archiving Solution - Tape Delivers
Significant TCO Advantage over Disk”,The Clipper Group, Dec.23, 2010. This was a
general TCO study and did not specifically focus on LTFS
6
Power usage
1Clipper
© 2014 IBM Corporation
GPFS- LTFS Tiered Operational Storage
G:/
Subdir 1
C:/user defined namespace
One.txt
Video1.mpg
Move files older than X
Database.db2
Dept0A
Memo.txt
Move
files named
*.mpg
Policy Based
Tier Migration
Movie1.mpg
Manuf
Never move files named *.db2
Inv02.txt
Repair.mpg
Move files opened for modification
Sales.db2
File Namespace
Single file system view
File Storage Tiers
LTFS
Pool 1
7
G:/
Subdir 1
One.txt
Video1.mpg
Database.db2
Dept0A
Memo.txt
Movie1.mpg
Manuf
Inv02.txt
Repair.mpg
Sales.db2
One.txt
Memo.txt
Inv02.txt
Memo.txt
LTFS
Pool 2
LTFS
LTFSLTFS
Video1.mpg
Movie1.mpg
Repair.mpg
© 2014 IBM Corporation
LTFS EE Export / Import
User / Application
Global Namespace
GPFS
LTFS EE
Disk Tier
8
Tape Tier
File
Migration
Cartridge
Export
File
Recall
Cartridge
Import
Tape
© 2014 IBM Corporation
LTFS EE Multi-Site
User / Application
NFS or CIFS
GPFS / LTFS EE cluster
Policy Based
Migration
TS3500
9
GPFS AFM
or
rsync
GPFS / LTFS EE cluster
Policy Based
Migration
TS3500
© 2014 IBM Corporation
LTFS EE Rapid Application Solution (Bundle)
© 2014 IBM Corporation
Agenda
 LTFS EE Overview
 PGA1 Enhancements
 PGA2 Enhancements
 Demo
11
© 2014 IBM Corporation
LTFS EE PGA1 enhancements
 Improved migration performance
 Premigration
 Tape optimized recalls
 Additional OS support
 Improved data resiliency
 New tape storage pool management
LTFS EE PGA1 GA-ed December 20, 2013
12
© 2014 IBM Corporation
Improved migration performance
13
© 2014 IBM Corporation
Migration performance improvement
LTFS EE Migration Performance
(1 LTO6 Drive)
140
120
MB/s
100
80
60
40
20
0
14
1GB
100 MB
10 MB
1 MB
32 KB
GA1 Migration (MB/s)
105.902
39.274
4.994
0.503
0.016
PGA1 Migration (MB/s)
121.784
103.937
90.910
14.815
0.736
© 2014 IBM Corporation
Premigration
• Pre-PGA1
Migration
Migration
• PGA1
or
Premigration
15
© 2014 IBM Corporation
Agenda
 LTFS EE Overview
 PGA1 Enhancements
 PGA2 Enhancements
 Demo
16
© 2014 IBM Corporation
LTFS EE PGA2 enhancements
 New OS Support
– Redhat Enterprise Linux (RHEL) Version 6.5
– SUSE Linux Enterprise Server 11 SP3
 New Tape Library Support
– TS4500
– TS3310
 Bulk File Recall
 Read Starts Recall (RSR) - Early trigger of recalling
migrated file
 Preserving File System Objects on Tape
 Rebuild GPFS from tape
LTFS EE PGA2 announced June 10, 2014
17
© 2014 IBM Corporation
Additional Operating System Support
Windows
CIFS
 RHEL 6.2
Linux
Etc.
NFS
 RHEL 6.4
 RHEL 6.5 New
Global name space
GPFS Node 2
GPFS Node 1
GPFS file systems (user data and metadata)
 SLES 11 SP1
LTFS EE
LTFS EE
 SLES 11 SP2
 SLES 11 SP3 New
TS3500 Tape Library
18
© 2014 IBM Corporation
New Tape Library Support
TS4500
TS3310
19
© 2014 IBM Corporation
TS4500 HD2 Base Frame
 Up to 3.3X the slot density of TS3500
 Up to 2.2 PB native capacity in a single frame
 Two I/O Stations
 Grow left or right of base frame
TS3500 Tape Library
TS4500 Tape Library
Model Lx3
Model Lx5
Up to 12 Drives
16 or 32 I/O
Up to 12 Drives
36 I/O - LTO
32 I/O - 3592
Licensed Slot Capacity
Licensed Slot Capacity
Entry
Interm
Full
LTO
64
129
219-287
3592
58
117
199-260
Entry
Base
HD
730
100
20
Interm
200
400
550
© 2014 IBM Corporation
TS4500 HD2 Drive Expansion frames
 Up to 2.4X slot density
 Up to 1.3X drive density
 New HD Capacity on Demand
option
 2 I/O Stations optional
 No capacity reduction for tape
drives
TS3500 Expansion
TS4500 Expansion
Model Dx3
Model Dx5
Up to 12 Drives
Up to 16 Drives
Licensed Slot Capacity
Licensed Slot Capacity
Base
21
LTO
396-440
3592
360-400
Base
500
HD w/
I/O
HD w/o
I/O
882
970
660
740
© 2014 IBM Corporation
TS4500 tape drive support
 LTO-5, LTO-6, and TS1140
 Up to 16 drives in each frame
 Support for drive migration from
TS3500 frames
22
© 2014 IBM Corporation
New option for customer-usable rack space
 10U of rack space above each
TS3500 or TS4500 library frame
 Opportunity for “zero footprint” rackmount components such as Fibre
Channel switches, Ethernet switches,
IBM FlashSystems, and/or tapeattached servers
23
© 2014 IBM Corporation
TS4500 control - Integrated management
Management
GUI/CLI
(improved)
Monitoring
Email (SMTP), syslog, SNMP,
mobile
(integrated, improved)
Reporting
Other
Tape System Reporter
(integrated, improved)
LDAP, DNS, NTP, SSL
(integrated, improved)
Admin and Service LANs
Support
Tape System Service Console
(TSSC) capabilities
Integrated
(integrated)
Management
Console (IMC)
24
© 2014 IBM Corporation
Transparent and selective bulk recall
 New ltfsee recall command
–Supports GPFS policy recall command
–Supports recall list file (1 full path filename per line)
–Supports stdin input
• ls <file spec> | ltfsee recall
• find . -type f | ltfsee recall
 Takes advantage of the “Tape Optimized Recall” feature
© 2014 IBM Corporation
Read Starts Recall (RSR) and Preview Size (PS)
• Pre-PGA2
Stub
(on disk)
Trigger recalls
• PGA2
Stub
(on disk)
Early trigger of recall
of migrated file called
Enhanced Normal RSR
PS
PS
Recall
enabled
(triggers (triggers
recalls) recalls)
Remaining file
(on(on
disk/tape)
tape)
Blocked
Remaining file
(on(on
disk/tape)
tape)
Blocked
© 2014 IBM Corporation
Preserving file system objects on tape
 Use GPFS policy with list rules: internal ltfseesave command
– Saves symlinks, empty file (file size 0), empty directories
(directories with no files or subdirectories) to tape
• Same as migrate/premigrate and allows up to 3 pools
© 2014 IBM Corporation
Rebuild GPFS from tape
 For DR scenarios (GPFS file system is lost), rebuilds a GPFS file
system into a specific directory from the specified tapes
–If multiple versions/generations of a file are found, the latest
version/generation is selected
–Includes entire file system structure: regular files, regular
directories, symlinks, empty files, empty directories
© 2014 IBM Corporation
References
 LTFS EE InfoCenter: http://pic.dhe.ibm.com/infocenter/ltfsee/cust/index.jsp
 GPFS InfoCenter: http://publib.boulder.ibm.com/infocenter/clresctr/vxrx/index.jsp
 LTFS EE Redbooks:
http://www.redbooks.ibm.com/redpieces/abstracts/sg248143.html
 LTFS EE Installation Demo:
http://www.youtube.com/watch?v=bF5tHAjp5xA&feature=youtu.be
29
© 2014 IBM Corporation
Questions?
30
© 2014 IBM Corporation
Agenda
 LTFS EE Overview
 PGA1 Enhancements
 PGA2 Enhancements
 Demo
31
© 2014 IBM Corporation
LTFS EE – Demo
Windows
Linux
CIFS
Etc.
NFS
Global name space
GPFS file system
LTFS EE
TS4500 Tape Library
32
© 2014 IBM Corporation
Disclaimers and Trademarks
 The performance data contained herein was obtained in a controlled environment based on the use of specific data. Actual results that may be
obtained in other operating environments may vary significantly. These values do not constitute a guarantee of performance.
 Product data is accurate as of initial publication and is subject to change without notice.
 No part of this presentation may be reproduced or transmitted in any form without written permission from IBM Corporation.
 References in this document to IBM products, programs, or services do not imply that IBM intends to make these available in all countries in which
IBM operates. Any reference to an IBM program product in this document is not intended to state or imply that only IBM's program product may be
used. Any functionally equivalent program may be used instead.
 The information provided in this document has not been submitted to any formal IBM test and is distributed "As Is" basis without any warranty either
express or implied. The use of this information or the implementation of any of these techniques is a customer responsibility and depends on the
customer's ability to evaluate and integrate them into their operating environment.

 While each item may have been reviewed by IBM for accuracy in a specific situation, there is no guarantee that the same or similar results will be
obtained elsewhere. Customers attempting to adapt these techniques to their own environments do so at their own risk.
 The following terms are trademarks or registered trademarks of the IBM Corporation in either the United States, other countries or both:
 IBM, S/390, ES/3090, ES/9000, AS/400, RS/6000, MVS/ESA, OS/390, VM/ESA, VSE, TPF, OS/2, OS/400, AIX, DFSMS/MVS, DFSMS/VM,
ADSTAR Distributed Storage Manager, DFSMSdfp, DFSMSdss, DFSMShsm, DFSMSrmm, FICON, ESCON, Magstar, Seascape, TotalStorage,
Tivoli, AIX, OS/400, TSM, BRMS
 Other company, product, and service names mentioned may be trademarks or registered trademarks of their respective companies.
 Linear Tape-Open, LTO, LTO Logo, Ultrium and Ultrium Logo are registered trademarks of HP, IBM and Quantum in the US and other countries.
33
© 2014 IBM Corporation