Section 1 : Storage System Intelligent Storage Systems Chapter 4 EMC Proven Professional The #1 Certification Program in the information storage and management industry © 2009 EMC Corporation. All rights reserved. Chapter Objectives After completing this module, you will be able to: o Describe components of intelligent storage system o List benefits of intelligent storage system o Explain intelligent cache algorithms and protection o Describe implementation of intelligent storage system o High-end storage array o Midrange storage array © 2009 EMC Corporation. All rights reserved. What is an Intelligent Storage System Intelligent Storage Systems are RAID arrays that are: o Highly optimized for I/O processing o Have large amounts of cache for improving I/O performance o Have operating environments that provide: o Intelligence for managing cache o Array resource allocation o Connectivity for heterogeneous hosts o Advanced array based local and remote replication options © 2009 EMC Corporation. All rights reserved. Benefits of an Intelligent Storage System Intelligent storage system provides several benefits over a collection of disks in an array (JBOD) or even a RAID arrays: o Increased capacity o Improved performance o Easier data management o Improved data availability and protection o Enhanced Business Continuity support o Improved security and access control © 2009 EMC Corporation. All rights reserved. Components of an Intelligent Storage System Intelligent Storage System Host Front End Back End Cache Connectivity FC SAN © 2009 EMC Corporation. All rights reserved. Physical Disks Intelligent Storage System: Front End Intelligent Storage System Host Front End Back End Cache Connectivity FC SAN Ports © 2009 EMC Corporation. All rights reserved. Controllers Physical Disks Front End Command Queuing A D C B A D I/O Requests C B A I/O Processing Order C D B Front-End Controller Cylinders Without Optimization (FIFO) A D C B A D I/O Requests B C A I/O Processing Order Front-End Controller With command queuing © 2009 EMC Corporation. All rights reserved. C B Cylinders D Intelligent Storage System: Cache Intelligent Storage System Front End Host Back End Cache Connectivity FC SAN © 2009 EMC Corporation. All rights reserved. Physical Disks Write Operation with Cache Write-through Cache Cache Write Request Acknowledgement Write-back Cache Write Request Acknowledgement © 2009 EMC Corporation. All rights reserved. Acknowledgement Read Operation with Cache: ‘Hits’ and ‘Misses’ Data found in cache = ‘Hit’ Read Request Cache No data found = ‘Miss’ Cache Read Request © 2009 EMC Corporation. All rights reserved. Cache Management: Algorithms New Data o Least Recently Used (LRU) o Discards least recently used data o Most Recently Used (MRU) o Discards most recently used data Oldest Data © 2009 EMC Corporation. All rights reserved. Cache Management: Watermarking o Manage peak I/O requests “bursts” through flushing/de-staging o Idle flushing, High Watermark flushing and Forced flushing o For maximum performance: o Provide headroom in write cache for I/O bursts 100 % HWM LWM Idle flushing © 2009 EMC Corporation. All rights reserved. High watermark flushing Forced flushing Cache Data Protection o Protecting cache data against failure: o Cache mirroring o Each write to the cache is held in two different memory locations on two independent memory cards o Cache vaulting o Cache is exposed to the risk of uncommitted data loss due to power failure © 2009 EMC Corporation. All rights reserved. Intelligent Storage System: Back End Intelligent Storage System Host Front End Back End Physical Disks Cache Connectivity FC SAN Controllers © 2009 EMC Corporation. All rights reserved. Ports Intelligent Storage System: Physical Disks Intelligent Storage System Host Front End Back End Cache Connectivity FC SAN © 2009 EMC Corporation. All rights reserved. Physical Disks What the Host Sees – RAID Sets and LUNs Host 1 Intelligent Storage System Front End LUN 0 Connectivity Back End Cache Physical Disks LUN 0 FC SAN LUN 1 LUN 1 Host 2 © 2009 EMC Corporation. All rights reserved. LUN Masking o LUN masking is access control mechanism o Process of masking LUNs from unauthorized access o Implemented on storage arrays o Storage group logical entity that contains one or more LUNs and one host © 2009 EMC Corporation. All rights reserved. ISS Implementation: High-end Storage Systems o Also referred as Active-active arrays o I/O’s are serviced through all the available path Active-Active Configuration o Huge cache to service host I/Os o Fault tolerance architecture o Multiple front-end ports and support to interface protocols o High scalability o Ability to handle large amounts of concurrent I/Os o Designed for large enterprises © 2009 EMC Corporation. All rights reserved. Active Active Host Port Port Controller B o Large storage capacity Controller A o Following are high-end array capabilities: LUN Storage Array Midrange Storage Systems o Midrange array have two controllers, each with cache, RAID controllers and disks drive interfaces o Designed for small and medium enterprises o Less scalable as compared to high-end array © 2009 EMC Corporation. All rights reserved. Active Port Port Passive Host Controller A o Host can perform I/Os to LUNs only through active paths o Other paths remain passive till active path fails Active-Passive Configuration Controller B o Also referred as Active-passive arrays LUN Storage Array Chapter Summary Key points covered in this chapter: o Intelligent Storage Systems features o Components of Intelligent Storage Systems o Cache management algorithms o Intelligent Storage System implementation o High-end storage array o Mid range storage array © 2009 EMC Corporation. All rights reserved. Concept in Practice: EMC CLARiiON o Support for UltraFlex technology o Scalable from up to 960 disks o Supports flash drives o Supports different types and sizes of drives, and RAID types (0, 1, 1+0, 3, 5, 6) o Supports up to 16 GB of available cache memory per controller (Storage Processor) o Enhances availability with non disruptive upgrade and failover o Ensures data protection through mirrored write cache and cache vaulting o Supports storage-based local and remote data replication o Through SnapView and MirrorView software © 2009 EMC Corporation. All rights reserved. 2009 CLARiiON Family © 2009 EMC Corporation. All rights reserved. CLARiiON CX4: The Proven Midrange Storage Solution © 2009 EMC Corporation. All rights reserved. CLARiiON CX-4 Architecture Storage Processor Storage Processor Multi-Core Processors FC Module CPU CPU CPU CPU FC Module CPU CPU CPU CPU Multi-Core Processors 4 Gb/s Fibre Channel Front-End CPU CPU CPU CPU FC Module CLARiiON Messaging Interface (CMI) CPU CPU CPU CPU FC Module Multi-Lane PCI-Express Bridge Link FC Module FC Module iSCSI Module Power Supply Memory Fan iSCSI Module I/O Complex CPU Module 4 Gb/s Fibre SPS 4 Gb/s LCC Fan Fan SPS FC Module Memory Fan Power Supply 4 Gb/s LCC 4 Gb/s LCC 4 Gb/s LCC 4 Gb/s LCC 4 Gb/s LCC 4 Gb/s LCC 4 Gb/s LCC iSCSI Module iSCSI Module CPU Module 4 Gb/s Fibre Channel Back-End Channel Back-End © 2009 EMC Corporation. All rights reserved. FC Module I/O Complex EMC Symmetrix o Incrementally scalable to 2,400 disks o Supports Flash-based solid-state drives o Dynamic global cache memory (16 GB–512 GB) o Advanced processing power (up to 130 PowerPC) o Direct matrix Architecture o High data processing bandwidth (up to 128 GB/s) o Data protection with RAID 1, 1+0 (also known as 10 for mainframe), 5, and 6 o Storage-based local and remote replication o Through TimeFinder and SRDF software © 2009 EMC Corporation. All rights reserved. Additional Task Research EMC Symmetrix V-Max Direct Matrix Architecture ESCON host attach Fibre Channel host attach FICON, GigE, iSCSI FICON, GigE, iSCSI FICON, GigE, iSCSI host attach host attach host attach ESCON Director FC Director Multi-Protocol CD Multi-Protocol CD Cntl Cntl Cntl Cntl Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix FICON, GigE, iSCSI host attach Fibre Channel host attach ESCON host attach Multi-Protocol CD Multi-Protocol CD FC Director ESCON Director Cntl Cntl Cntl Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Cntl Direct Matrix Direct Matrix Direct Matrix Control and communications Signals 64 GB Memory Environmental control and status signals 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory Direct Matrix Direct Matrix Direct Matrix Control and communications Signals Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Cntl Cntl Cntl Cntl Cntl Cntl Cntl Cntl FC (Back-End) FC (Back-End) FC (BE or FE) FC (BE or FE) FC (BE or FE) FC (BE or FE) FC (Back-End) FC (Back-End) A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B Symmetrix Fibre Channel disk devices Symmetrix Fibre Channel disk devices Fibre Channel back-end director * Power supplies Service Processor Modem UPS © 2009 EMC Corporation. All rights reserved. Fibre Channel back-end director * Fibre Channel back-end director * Fibre Channel back-end director * Battery backup Unit Modules Symmetrix Fibre Channel disk devices Cooling Symmetrix Fibre Channel disk devices Environmental control and status signals External Links o EMC Clariion Family o Combine midrange networked storage with innovative technology and robust software capabilities to manage and consolidate your data. o http://www.emc.com/products/family/celerra-family.htm o EMC Symmetrix Family o Featuring new EMC Symmetrix V-Max, which leverages the EMC Symmetrix Virtual Matrix Architecture to deliver unprecedented levels of scalability and efficiency. o http://www.emc.com/products/family/symmetrix-family.htm © 2009 EMC Corporation. All rights reserved. #1 IT company For more information visit © 2009 EMC Corporation. All rights reserved. http://education.EMC.com