Chapter 2 Presented by: Anupam Mittal Storage Systems Environment: Components of a Storage System Environment Storage System Environment -2 Upon completion of this chapter, you will be able to: List components of storage system environment ◦ Host, connectivity and storage List physical and logical components of hosts Describe key connectivity options Describe the physical disk structure Discuss factors affecting disk drive performance Storage System Environment -3 Upon completion of this lesson, you will be able to: Describe the three components of storage system environment ◦ Host, Connectivity and Storage Detail Host physical and logical components Describe interface protocol ◦ PCI, IDE/ATA and SCSI Describe storage options ◦ Tape, optical and disk drives Storage System Environment -4 Applications runs on hosts Hosts can range from simple laptops to complex server clusters Physical components of host Server Laptop ◦ CPU ◦ Storage LAN Disk device and internal memory ◦ I/O device Group of Servers Host to host communications Network Interface Card (NIC) Host to storage device communications Host Bus Adapter (HBA) Mainframe Storage System Environment -5 Fast CPU registers L2 cache Speed Magnetic disk Tape L1 cache RAM Optical disk Slow Low High Cost Components of a Host -6 Human interface ◦ Keyboard ◦ Mouse ◦ Monitor Computer-computer interface ◦ Network Interface Card (NIC) Computer-peripheral interface ◦ USB (Universal Serial Bus) port ◦ Host Bus Adapter (HBA) Components of a Host -7 Host Apps Operating System Mgmt Utilities DBMS File System Volume Management Multi-pathing Software Device Drivers HBA HBA HBA Components of a Host -8 Application ◦ Interface between user and the host ◦ Three-tiered architecture Application UI, computing logic and underlying databases ◦ Application data access can be classifies as: Block-level access: Data stored and retrieved in blocks, specifying the LBA File-level access: Data stored and retrieved by specifying the name and path of files Operating system ◦ Resides between the applications and the hardware ◦ Controls the environment Storage System Environment -9 Responsible for creating and controlling host level logical storage Logical Storage ◦ Physical view of storage is converted to a logical view by mapping ◦ Logical data blocks are mapped to physical data blocks Usually offered as part of the operating system or as third party host software LVM Components: LVM ◦ Physical Volumes ◦ Volume Groups ◦ Logical Volumes Physical Storage Storage System Environment 10 One or more Physical Volumes form a Volume Group LVM manages Volume Groups as a single entity Physical Volumes can be added and removed from a Volume Group as necessary Physical Volumes are typically divided into contiguous equal-sized disk blocks A host will always have at least one disk group for the Operating System ◦ Application and Operating System data maintained in separate volume groups Logical Volume Logical Volume Physical Volume 1 Physical Volume 2 Volume Group Logical Disk Block Physical Volume 3 Physical Disk Block Storage System Environment 11 Servers Logical Volume Physical Volume Partitioning Concatenation Storage System Environment 12 Device Drivers ◦ Enables operating system to recognize the device ◦ Provides API to access and control devices ◦ Hardware dependent and operating system specific File System ◦ File is a collection of related records or data stored as a unit ◦ File system is hierarchical structure of files Examples: FAT 32, NTFS, UNIX FS and EXT2/3 Storage System Environment 13 UNIX (UFS) File type and permissions Number of links Owner and group IDs Number of bytes in the file Last file access Last file modification Windows (NTFS) Time stamp and link count File name Access rights File data Index information Volume information Components of a Host 14 Improves data integrity and system restart time over non-journaling file systems Uses a separate area called a log or journal ◦ May hold all data to be written ◦ May hold only metadata Disadvantage - slower than other file systems ◦ Each file system update requires at least 1 extra write – to the log Components of a Host 15 File System Blocks Teacher (User) Course File(s) File System Files 1 2 3 Configures/ Manages Reside in Mapped by a file system to Disk Physical Extents Disk Sectors Managed by disk storage subsystem LVM Logical Extents 6 5 Consisting of Mapped by LVM to 4 Residing in Storage System Environment 16 Key points covered in this module: Hosts typically have: ◦ Hardware: CPU, memory, buses, disks, ports, and interfaces ◦ Software: applications, operating systems, file systems, device drivers, volume managers Journaling enables: ◦ very fast file system checks in the event of system crash ◦ provides better integrity for file system structure HBAs are used to connect hosts to storage devices Components of a Host 17 Interconnection between hosts or between a host and any storage devices Physical Components of Connectivity are: ◦ Bus, port and cable CPU BUS HBA Cable Disk Port Storage System Environment 18 Serial Serial Bi-directional Parallel Connectivity 19 System Bus – connects CPU to Memory Local (I/O) Bus – carries data to/from peripheral devices Bus width measured in bits Bus speed measured in MHz Throughput measured in MB/S Connectivity 20 Protocol = a defined format for communication between sending and receiving devices Tightly Connected Entities Directly Attached Entities Network Connected Entities ◦ Tightly connected entities such as central processor to RAM, or storage buffers to controllers (example PCI) ◦ Directly attached entities connected at moderate distances such as host to storage (example IDE/ATA) ◦ Network connected entities such as networked hosts, NAS or SAN (example SCSI or FC) Storage System Environment 21 Host Apps Operating System PCI SCSI or IDE/ATA Device Drivers Connectivity 22 PCI is used for local bus system within a computer It is an interconnection between microprocessor and attached devices Has Plug and Play functionality PCI is 32/64 bit Throughput is 133 MB/sec PCI Express ◦ Enhanced version of PCI bus with higher throughput and clock speed V1: 250MB/s V2: 500 MB/s V3: 1 GB/s Storage System Environment 23 Integrated Device Electronics (IDE) / Advanced Technology Attachment (ATA) ◦ Most popular interface used with modern hard disks ◦ Good performance at low cost ◦ Inexpensive storage interconnect ◦ Used for internal connectivity Serial Advanced Technology Attachment (SATA) ◦ Serial version of the IDE /ATA specification ◦ Hot-pluggable ◦ Enhanced version of bus provides upto 6Gb/s (revision 3.0) Storage System Environment 24 Parallel SCSI (Small computer system interface) ◦ ◦ ◦ ◦ Most popular hard disk interface for servers Supports Plug and Play Higher cost than IDE/ATA Supports multiple simultaneous data access ◦ Used primarily in “higher end” environments ◦ SCSI Ultra provides data transfer speeds of 320 MB/s Serial SCSI ◦ Supports data transfer rate of 3 Gb/s (SAS 300) Storage System Environment 25 Most popular hard disk interface for servers Higher cost than IDE/ATA Supports multiple simultaneous data access Currently both parallel and serial forms Used primarily in “higher end” environments Connectivity 26 Target Initiator Connectivity 27 Target ID LUNs Initiator ID Connectivity 28 Initiator ID Target ID LUN Initiator ID - a number from 0 to 15 with the most common value being 7. Target ID - a number from 0 to 15 LUN - a number that specifies a device addressable through a target. Connectivity 29 Host Addressing c0 t0 d0 ◦ Controller ◦ Target ◦ LUN t0 Peripheral Controller LUNs d0 d1 d2 Target c0 – Controller/ Initiator/HBA Connectivity 30 Pros: ◦ Fast transfer speeds, up to 320 megabytes per second ◦ Reliable, durable components ◦ Can connect many devices with a single bus, more than just HDs ◦ SCSI host cards can be put in almost any system ◦ Full backwards compatibility Cons: ◦ Configuration and setup specific to one computer ◦ Unlike IDE, few BIOS support the standard ◦ Overwhelming number of variations in the standard, hardware, and connectors ◦ No common software interfaces and protocol Connectivity 31 Feature IDE/ATA SCSI Connectivity Market Internal Storage Internal and External Storage Speed (MB/sec) 100/133/150 320 Hot Pluggable No Yes Expandability Easier to set up Very good but very expensive to set up Cost/Performance Good High cost/Fast transfer speed Connectivity 32 Port Bus CPU Host HBA Cable Port Disk Connectivity 33 Host Apps DBMS Mgmt Utils File System LVM Multipathing Software Device Drivers HBA HBA HBA Fibre Channel Storage Arrays Connectivity 34 SCSI ◦ ◦ ◦ ◦ Limited distance Limited device count Usually limited to single initiator Single-ported drives Fibre Channel ◦ ◦ ◦ ◦ Greater distance High device count in SANs Multiple initiators Dual-ported drives Connectivity 35 iSCSI ◦ Transport is over an IP network ◦ SCSI Commands are exchanged over an IP network Fibre Channel over Ethernet ◦ Tunnels fibre channel commands over IP Connectivity 36 Hosts Switches Storage Connectivity 37 Magnetic Tape ◦ Low cost solution for long term data storage ◦ Limitations Sequential data access, Single application access at a time, Physical wear and tear and Storage/retrieval overheads Optical Disks ◦ Popularly used as distribution medium in small, single-user computing environments ◦ Write once and read many (WORM): CD-ROM, DVDROM ◦ Limited in capacity and speed Disk Drive ◦ Most popular storage medium with large storage capacity Storage System Environment 38 Key points covered in this lesson: Host components ◦ Physical and Logical Connectivity options ◦ PCI, IDE/ATA, SCSI Storage options ◦ Tape, optical and disk drive Storage System Environment 39 Disk drive components, Disk Drive Performance Storage System Environment 40 Upon completion of this lesson, you will be able to: List and discuss various disk drive components ◦ Platter, spindle, read/write head and actuator arm assembly Discuss disk drive geometry Describe CHS and LBA addressing scheme Disk drive performance ◦ Seek time, rotational latency and transfer rate Law’s governing disk drive performance Enterprise flash drive Storage System Environment 41 Controller HDA Interface Power Storage System Environment Connector 42 01010100111010101010 00110100111010101010 00110100111010101010 10110101011010101010 Physical Disks 43 Spindle Platters Physical Disks 44 Physical Disks 45 Spindle Actuator Physical Disks 46 R/W Head R/W Head Actuator Physical Disks 47 Controller Interface HDA Power Connector Bottom View of Disk Drive Physical Disks 48 Sector Track Platter Physical Disks 49 Sector Track Platter Without Zones Platter With Zones Physical Disks Cylinder Tracks, Cylinders and Sectors Physical Disks 51 Sector Cylinder Head Block 0 Block 8 (lower surface) Block 16 Block 32 Block 48 Physical Address = CHS Logical Block Address = Block # Physical Disks A A B C D Partitioning Multiple Logical Volumes Concatenation One Volume PhysicalLogical Disks 53 Key points covered in this lesson: Physical drives are made up of: ◦ HDA Platters connected via a spindle Read/write heads which are positioned by an actuator ◦ Controller Controls power, communication, positioning, and optimization Data is structured on a drive using tracks, sectors, and cylinders The geometry of a disk impacts how data is recorded on a platter Physical Disks 54 Disk Drive Performance Logical Components Storage System Environment 55 Upon completion of this lesson, you will be able to: Describe the factors that impact the performance of a drive Describe how drive reliability is measured Physical Disks 56 Seek time is the time for read/write heads to move between tracks Seek time specifications include: ◦ Full stroke ◦ Average ◦ Track-to-track Physical Disks 57 Physical Disks 58 Without Command Queuing Request 1 Request 2 4 3 2 2 1 1 Request 3 3 Request 4 4 With Command Queuing Request 1 Request 2 4 2 3 2 1 1 Request 3 Request 4 3 4 Physical Disks 59 External transfer rate measured here HBA Interface Internal transfer rate measured here Buffer Disk Drive Physical Disks 60 Mean Time Between Failure Amount of time that one can anticipate a device to work before an incapacitating malfunction occurs ◦ Based on averages ◦ Measured in hours Determined by artificially aging the product Physical Disks 61 Knee of curve: disks at about 70% utilization Low Queue Size 0% Utilization 70% 100% Consider a disk I/O system in which an I/O request arrives at a rate of 100 I/Os per second. The service time, RS, is 4 ms. ◦ Utilization of I/O controller (U=a × Rs) ◦ Total response time (R=Rs /1-U) Calculate the same with service time is doubled Storage System Environment 63 Conventional disk drive Mechanical Delay associated with conventional drive Enterprise flash drive Highest possible throughput per drive ◦ Seek time ◦ Rotational latency More power consumption due to mechanical operations Low Mean Time Between Failure ◦ No Spinning magnetic media ◦ No Mechanical movement which causes seek and latency ◦ Solid State enables consistent I/O performance Very low latency per I/O Energy efficient storage design ◦ Lower power requirement per GB of storage ◦ Lower power requirement per IOPS Storage System Environment 64 Drive is based on Flash Solid State memory technology ◦ High performance and low latency ◦ Non volatile memory ◦ Uses single layer cell (SLC) or Multi Level cell (MLC) to store data Enterprise Flash Drives use a 4Gb FC interface Storage System Environment 65 Faster performance ◦ Up to 30 times greater IOPS (benchmarked) ◦ Typical applications: 8 – 12X ◦ Less than 1 millisecond service time 10@15K Fibre Channel drives 30@15K Fibre Channel drives More energy efficient ◦ 38 percent less per terabyte ◦ 98 percent less per IO 1@15K Fibre Channel drive Response Time 1 Flash drive IO per second Better reliability ◦ No moving parts ◦ Faster RAID rebuilds Storage System Environment 66 Position Enterprise Flash Drives as the highperformance option in demanding environments ◦ Low latency applications, also known as “Tier0” applications Standard form-factor and capacity design allows for easier integration High performance, low power for a “Green” initiative Target Customer/Market Segments: ◦ High performance solutions coupled with low power ◦ Specifically target Oracle database customers initially ◦ Financial trading Storage System Environment 67 Key points covered in this lesson: Disk drive components and geometry Disk drive addressing scheme Disk drive performance Convention drive Vs Enterprise Flash Drives Enterprise Flash Drives for high performance and low power storage solution Storage System Environment 68 Key points covered in this chapter: Storage system environment components: ◦ Host, connectivity and storage Physical disk structure and addressing Factors affecting disk performance Flash drives benefits Storage System Environment 71 What are some examples of hosts? What are the physical and logical components of a host? What are the common connectivity protocols used in computing environments? What is the difference between seek time and rotational latency? What is the difference between internal and external data transfer rates? Storage System Environment 72