Hitachi Data Systems
Network Storage Systems
John Harker
Sr. Product Marketing Manager
Hitachi Data Systems
September 21, 2004
Storage Systems and the SAN Food Chain
 Computers connect to storage systems via Fibre Channel,
iSCSI, FICON, ESCON links
 Direct attach or through SAN
 Storage system firmware takes physical drives and presents
RAID-grouped logical devices out of which storage is allocated
 Example Switch Vendors: Brocade, McDATA, CNT, Cisco
 Example Array Vendors: HDS, EMC, IBM, HP, Sun, generic JBOD
Storage Area Network
Application
Application
Database
Server
File
System /
Volume
Switch
HBA
Switch
Port
Switch
Storage System
Switch
Port
Storage
Port
LDEV
RAID
Group
CHIP, CA,
CSW, DKA
2
Enterprise Storage
Hitachi Lightning 9900™ V Series
Hitachi Lightning 9900™ V Series
•Availability
• No single point of failure
• Non-disruptive everything
• 100% data availability
• Availability enhancing software
•Scalability
•8192 logical addresses
•18TB/148TB raw capacity
•146GB 10K drives
•73GB 10K & 15K drives
•36GB 15K drives
•Connectivity
• 48/64 host channel ports
• 8192 virtual ports
• Fibre Channel/ESCON/FICON
• Host Storage Domains
•Performance
• 15GB/s aggregate bandwidth
• Hi-Star™ Crossbar Switch Architecture
• End-to-end Fibre
• Performance Maximizer tools
4
Separate Front End / Back End cards
 Front-end – Channel Adapters
 64-bit processors
 One port, one processor
for all LUNs
 All ports are fast and share
no port resources
Connected via Silicon Switch
Architecture to:
 Backend – Array Control
Processors (ACP)
 64-bit processors
 1Gbps FC-AL to the
physical disks
 4 paths per ACP, 8 paths
per ACP Pair
 32 total physical disk loops
for a total of 32 GB/s
5
Hi-Star™ Crossbar Switch Architecture
6
Lightning 9900 V Series Hardware Summary
 Lightning 9970V™
 Lightning 9980V™
–
–
–
–
–
–
–
–
–
–
–
–
–
–
Up to 48 channels (16 w 2nd ACP)
8192 logical addresses
1 or 2 Array Control Processors (ACP)
Up to 3GB Control Memory
Up to 64GB cache
Up to 63 Array groups
128 HDD
 36GB/73GB/146GB
 18TB raw
 Raid 5
– 3+1, 7+1
 Raid 1+
– 2+2, 4+4
– 1-4 Spare disks
 Min one per rpm type
– Optional 2nd Service Processor (SVP)
Up to 64 channels
8192 logical addresses
1 std, 2,3 or 4 ACPs
Up to 6GB Control Memory
Up to 128GB cache
Up to 254 Array groups
1024 HDD
 36GB/73GB/146GB
 148TB raw
 Raid 5
– 3+1, 7+1
 Raid 1+
– 2+2, 4+4
– 1-16 Spare disks
 Min one per rpm type
– Optional 2nd Service Processor (SVP)
7
Firmware Assists
 Host Storage Domains (HSD)
– Allows sharing of physical ports
– Each HSD has its own logical (virtual) FC
port
– FC port “mode set” applies to logical FC port
in each HSD
– Each HSD has its own set of LUNs
– Hosts matched to their assigned HSD based
upon WWN
– Hosts can only “see” their own HSD
 Priority Access
– Allocates bandwidth based on QoS
requirements
– At physical port level, or Host Group level
within Port
– Enables consolidation of mixed workloads
 Disk-based Virtual WORM
 Storage System and Storage Area
Management Products
– CIM- and SMI-S-based strategy
 Business Continuity Products
– Local/Remote, mirrors or shadows, sync or
async
All of the items listed on this page, except priority access, and on
both Lighting and Thunder. Priority access is Lightning only
8
Midrange Storage
Hitachi Thunder 9500™ V Series
Hitachi Thunder 9500™ V Series
Tiered Storage “in a box”
1
Operational
Data
Data Characteristics
Fibre Channel highperformance, higher-cost
storage
(Dynamic online data, rich media, large data
bases, etc.)
•From 3U Rack
system to up to 107
Terabytes
•Dual controller, 2, 4
or 8 data-path
design
•Fully fault tolerant
and fault selfcorrecting
•Shares business
continuity and
management
products with
Lighting line
SATA-based high- capacity,
lower-cost storage
(Fixed content: Old e-mail, X-rays,
Regulatory data, etc.)
3
Backup
Data
• High-speed data access
• Data integrity a must
• Data retained “forever”
2
Fixed
Content
• High-speed transactions
• Redundancy desired
• Data integrity over long haul
• Response time in seconds
• Can employ WORM
• Examples: D2D2T
SATA-based high- capacity,
lower-cost storage
(Backup data: Any data that is going to get
backed up to tape.)
Tape
• Data stays until next backup –
provides rapid restore of
last backup. Restore
performance is key
Tape is not eliminated, but its
usage is confined to offsite
ARCHIVAL only
10
Hitachi Thunder 9500 V Series
Family Specifications
FEATURE
Thunder 9530V™
Thunder 9570V™
Thunder 9585V™
Raw capacity
2TB
32TB fibre, 54 TB SATA mix
64TB fibre, 107TB SATA mix
14 Fibre Channel
224 Fibre, 210 SATA
449 Fibre, 420 SATA
Dual Controller, bus
Dual Controller, bus
Dual Controller, bus
2.1/4.2GB/second
4.2GB/second
7.5GB/second
Front-end connectivity
2 FC @ 2Gb/s
4 FC @ 2Gb/s
8 FC @ 2Gb/s
Back-end connectivity
4 FC/AL @ 2Gb/s
4 FC/AL @ 2Gb/s
8 FC/AL @ 2Gb/s
1-4GB
2-4GB
2-8GB
256
512
1,024
36/72/146 fibre
36/72/146 fibre, 250 SATA
36/72/146 fibre, 250 SATA
512
512
2,048
7
45
90
Drives
Architecture
Bandwidth
Mirrored cache
Virtual Storage Ports
HDD Types ( GB )
MAX LUNs
RAID Groups
11
Summary of Major SATA ( PC ) and
Fibre Channel (Enterprise) Differences
Desktop
1
Major Differences
2
Performance
Spin rate RPM
Latency ms
3
Seek time ms
Command Queuing
RPS
Dual port
4
Max transfer MB/s
Future max transfer MB/s
Sustained transfer MB/s
Reliability
Typical MTBF
Duty cycle
Rotational vibration
Interactive error management
Internal data integrity checks
Price ratio
Notes
PATA
SATA
5400, becoming 7200
5.5
13
N
no
no
100/133
133
46
Fibre/SCSI
Fibre/SCSI
7,200
4
9.3
Y
no
no
150
300, then 600
59
10,000
3
5
Y
yes
yes
200
400, then 1000
69
15,000
2
4
Y
yes
yes
200
400, then 1000
75
300,000 - 600,000
600,000
8 by 5, not continual high 8 by 5, not continual high
access use
access use
5 rads / sec / sec
no
no
no
no
1,200,000
24 by 7 by 365 continual
high access
21 rads / sec / sec
yes
yes
1,200,000
24 by 7 by 365 continual
high access
21 rads / sec / sec
yes
yes
2 to 3
2 to 3
1
1.
2.
3.
4.
Enterprise
1.1
All figures in this table are typical numbers for the technology listed
PATA HDDs with 7200 RPM are beginning to appear. However, most vendors are using SATA instead of PATA
Seek times of 10 ms for PATA are beginning to appear. However, most vendors are using SATA instead of PATA
Theoretical max for PATA is 133. Only one PATA drive transferring at 133 was found. The rest were 100.
12
Thunder 9500 V Series
Serial ATA Data Protection Mechanisms
 #1 Read-after-write function
– Protect against progressive head misalignment
– Utilise existing compare circuits
– Overcome ATA-interface lack of Byte Check Command (Verify)
Fig. Write & Compare
④
③Read
①Write
②Seek
13
Thunder 9500 V Series
Serial ATA Data Protection Mechanisms
 #2 Recommend Increase Sparing
 Protect against potential higher failure rate of drives
– Dynamic Global Hot Sparing
– Fast Rich Correction Copy ( faster uCode )
– User can set rebuild priority, and change it “on the fly”
 Recommend user prioritise rebuild over Host I/O
– Automatically schedule maintenance call when 2xspares used (via Hi-Track®)
– Threshold for sparing uses S.M.A.R.T information
SMART ( Self-monitoring, Analysis and Reporting Technology ) is an open standard for monitoring and reporting the
health of the disk drive. It is intended to help detect problems with a drive before it has a hardfail. Direct copy sparing
will be performed if SMART information indicates softfail thresholds are exceeded. If the disk drive hard fails, parity
information will be used to rebuild the disk drive on a global hot spare
The disk drive softfail error threshold
has been exceeded. Disk is spared
out via copy function
I/O is accepted
Controller
A
B
C
D
E
C’
Global hot spare (can
be anywhere in
Thunder)
14
Thunder 9500 V Series
Serial ATA Data Protection Mechanisms
#3 To reduce SATA drives higher failure rate, the following functions are performed:
Unique microcode in Thunder 9500 V Series enhances HDD functionalities to
give superior reliability
• During periods of no I/O activity, idle seeks
are performed to prevent the heads from
remaining in one place. If I/O is constant,
every 10 minutes drive access momentarily
halts for 5 seconds and a disk sweep is
performed
• If a drive has been inactive for 2 hours, a
Head Unload operation is performed,
retracting heads from disk surface until the
drive is again accessed
• For every record, even on SATA HDDs, an 8
byte LA/LRC check is added. This ensures
data consistency
15
Thank You
TagmaStore Universal
Storage Platform
New HDS TagmaStore Universal Storage Platform –
System Characteristics
 Universal Star Network™ Architecture
– New generation “non blocking” switching architecture
 Faster switch components mean enhanced data
and control bandwidth
– 8x EMC real internal bandwidth
 Helps consolidations and fast transactions
applications
 Separate Control Memory region for increased
reliability and serviceability
– Expanded Cache Memory and flexible FrontEnd/Back-end configuration
 Faster and increased number of RISC
processors across the system
 Conform better to the applications needs
 Improved Fibre Channel and FICON design
 Additional reliability: reduces outages, increases
productivity
– Faster back-end design
 2Gbps disk interface
 Ease performance bottlenecks, helps with
applications consolidation and QoS
– Enhanced RAID-1+ and RAID-5
 Later release of RAID-6 for increased reliability,
recovery and security
18
Universal Storage Platform – Specifications
 64 switched data paths = 68GB/s
Cached Bandwidth
– a 541% Increase in Cached
Bandwidth
 Separate 64 control paths connect
to cache memory = 13GB/s
Control Bandwidth
– a 145% Increase in Control
Bandwidth
 300% more active paths in/out of
cache memory than EMC
Symmetrix DMX 3000-2
– a 50% Increase over the Industry
Dominating Hitachi Lightning
9980V™ and EMC DMX-2
 128 concurrent cache memory
operations
 Up to 192 FC connections
– Three times as many as our closest
competitor
 96 ESCON or 48 FICON ports
– 50% more than anyone else
 Over 2GB/s sequential throughput
– 400% improvement over DMX
 Almost 2Million IOPS cache hit
operations
– 4 times the competition
 Up to 64 Back-end FC loops
– All active-active, twice as many as
the competition
 RAID-1+ and RAID-5
– 4 disk or 8 disk groups beyond the
same Director
 128GB of Cache Memory plus
6GB of Control Memory
19
Universal Storage Platform – New Functionality
 Universal Volume Manager
– Externally (FC) connects different storage
systems
 Transparent use of different
technologies beyond a single point of
control
– Match applications with storage
characteristics
– Cost effective solutions for open systems
and S/390® and z/OS® environments
ERP
Email
Order System
File Service
Data Mining
FC/IP
SAN
Print Service
 External capacity
– Manages up to 32PB of total storage
 Up to 165TB/330TB internal storage
Universal
Storage
Platform
 Virtualizes/Simplifies management of
multiple tiers of storage
– Simplified configuration and management
– Advanced functions within multiple tiers of
storage (Hitachi and other OEM)
 DLM data movement engine
– Universal replication between unlike
storage vendors, simplify business
continuity management, lower costs
Physical Storage Pool
High Perf.
99.99%
Thunder
9500V
Lightning
9900
100%
General
Purpose
Lightning
9900V
Partners
Storage
Backup
Archive
Thunder
9500 SATA
Competitors
Storage
7700E
20
External Storage – Implementation
ELUN is a LUN which is
mapped to a LUN in an
external storage device
21
Universal Storage Platform – Virtual Partition
Manager
 Virtual Partition Manager
– Creates up to 32 different virtual
storage units
 Unique cache, channels, backend resources aggregation
 Host Storage Domains further
extend connectivity
– Allows to consolidate heterogeneous
environment
– Provide better QoS control
– Ease consolidation and assets
management
Virtual Private Storage
8 FC Storage Ports
Multiple LUN 0’s
16GB Cache
100GB HP Disk
20GB 100% Avail Disk
50GB Archive Disk
Virtual Private Storage
8 FC Storage Ports
Multiple LUN 0’s
32GB Cache
500GB HP Disk
60GB 100% Avail Disk
2TB Archive Disk
Virtual Private Storage
2 FC Storage Ports
Multiple LUN 0’s
24GB Cache
200GB HP Disk
80GB 100% Avail Disk
20GB Archive Disk
Virtual Private Storage
2 IP Storage Ports
Multiple LUN 0’s
8GB Cache
20GB HP Disk
20GB 100% Avail Disk
100GB Archive Disk
 Dynamically allocated, statically used
– Assign the resources between
partitions if not required or used
– Maintain separation and security
between partitions
FC/IP
SAN
 Benefits
– Better resource usage
– Users and applications aggregation
not possible before = lower
operational costs
Universal
Storage
Platform
Physical Storage Pool
High Perf. 99.99%
Thunder
9500V
100%
General
Purpose
Lightning
9900V
Backup
Archive
Thunder
9500 SATA
22