STORAGE MANAGEMENT Introduction to Information Storage and Management -1 LECTURE 1 Introduction to Information Storage and Management -2 Intorduction to information storage technology: Review data creation and the amount of data being created and understand the value of data to a business Upon completion of this lecture, you will be able to: Describe the importance of information to individuals and to businesses Define data and information Discuss the categories of data Describe the storage architectures and their evolution Introduction to Information Storage and Management -4 “Digital universe – The Information Explosion” ◦ 21st Century is information era ◦ Information is being created at ever increasing rate ◦ Information has become critical for success We live in an on-command, on-demand world ◦ Example: Social networking sites, e-mails, video and photo sharing website, online shopping, search engines etc Information management is a big challenge ◦ Organization seek to Store Protect Leverage the information optimally Introduction to Information Storage and Management Optimize -5 “Collection of raw facts from which conclusions may be drawn” Most data is being converted into a digital format ◦ Driven by user demand ◦ Facilitated by Increase in data processing capabilities Photo Book New and cheaper peripherals Lower cost and increased speed of storage Affordable and faster networks Video Letter 01010101010 10101011010 00010101011 01010101010 10101010101 01010101010 Digital Data Who creates data? ◦ Individuals ◦ Businesses Introduction to Information Storage and Management -6 Data can be categorized as either structured or unstructured data ◦ Structured: Data Bases Spread Sheets E-Mail Attachments ◦ Unstructured Forms Images Audio Movies X-Rays Manuals Images Over 80% of enterprise Information is unstructured Check Forms Contracts PDFs Unstructured (80%) Instant Messages Documents Web Pages Rich Media Invoices Audio Video Structured (20%) Introduction to Information Storage Rows and Columns and Management -7 What do individuals/businesses do with the data they collect? ◦ They turn it into “information” ◦ “Information is the intelligence and knowledge derived from data” Businesses analyze raw data in order to identify meaningful trends ◦ For example: Buying habits and patterns of customers Health history of patients Virtuous cycle of information ◦ Information begets information Introduction to Information Storage and Management -8 Centralized information storage and processing Network Wired Network Wireless Wireless Wired Accessing Uploading information information Creators of Users of information Information Demand for more Information Virtuous cycle of information Introduction to Information Storage and Management -9 Creating a competitive advantage ◦ Identifying new business opportunities Buying/spending patterns Internet stores, retail stores, supermarkets Customer satisfaction/service Tracking shipments, and deliveries ◦ Identifying patterns that lead to changes in existing business Reduced cost Just-in-time inventory, eliminating over-stocking of products, optimizing shipment and delivery New services Security alerts for “stolen” credit card purchases Targeted marketing campaigns Communicate to bank customers with high account balances about a special savings plan Introduction to Information Storage and Management 10 Data created by individuals/businesses must be stored for further processing Type of storage used is based on the type of data and the rate at which it is created and used Examples: ◦ Individuals: Digital camera, Cell phone, DVD’s, Hard disk ◦ Businesses: Hard disk, external disk arrays, tape library Storage model: An evolution ◦ Centralized: mainframe computers ◦ Decentralized: Client – server model (Data spread across many servers) ◦ Centralized: Storage Networking (Hugh respositories) Introduction to Information Storage and Management 11 LAN FC SAN Multi Protocol Router IP SAN RAID Array SAN / NAS JBOD Internal DAS Time Introduction to Information Storage and Management 12 Key points covered in this lesson: Importance of information Data, information and storage Categories of data Storage architectures and their evolution Introduction to Information Storage and Management 13 Challenges in Data Storage and Management Introduction to Information Storage and Management 14 Upon completion of this lecture, you will be able to: List the five core elements of a data center infrastructure Describe the requirements of storage systems for optimally supporting business activities Explain the importance of Information Lifecycle Management List the activities in developing the ILM strategy Introduction to Information Storage and Management 15 Applications Databases – Database Management System (DBMS) and the physical and logical storage of data Servers/Operating systems Networks (LAN and SAN) Storage arrays Data Center Infrastructure 16 Server Storage Area Network Client Storage Array Local Area Network Application User Interface OS and DBMS Database Consider an order processing system consisting of: Application for order entry Database Management System (DBMS) to store customer and product information Server/Operating System (OS) on which the application and database programs are run Networks that provide ◦ Connectivity between Clients and the Application/Database Server (LAN) ◦ Connectivity between the Server and the Storage system (SAN) Storage Array – database is stored on physical disks in the storage array Data Center Infrastructure Server Client Storage Area Network Storage Array Local Area Network Application User Interface OS and DBMS Database A customer order is entered via the Application User Interface on a client Data Center Infrastructure 18 Storage Array Server Client Storage Area Network Local Area Network OS and DBMS Database A customer order is entered via the Application User Interface on a client The client accesses the server over a Local Area Network Data Center Infrastructure 19 Storage Array Server Client Storage Area Network Local Area Network O/S and DBMS Database A DBMS uses the operating system on the server to read and write this data to the physical location on a disk Data Center Infrastructure 20 Storage Array Server Client Storage Area Network Local Area Network O/S and DBMS Database A DBMS uses the operating system on the server to read and write this data to the physical location on disk A dedicated Storage Area Network provides the communication link between the server and the storage array, and transports the read/write commands and data between the server and the storage array Data Center Infrastructure 21 Storage Array Server Client Storage Area Network Local Area Network Database A DBMS uses the operating system on the server to read and write this data to the physical location on disk A Network provides the communication link between the client and the server, and transports the read/write commands and data between the server and the storage array A storage array receives the read/write commands and data from the server and performs the necessary operations to store the data on the physical disks Data Center Infrastructure 22 The application should be optimized for fast interaction with the DBMS The tables in the database should be constructed with care so the number of read/write operations can be minimized The server should have sufficient CPU and memory resources to satisfy application and DBMS needs The different networks should provide fast communication between client and server, as well as server and storage array The storage array should service the read/write requests from the server for optimal performance Data Center Infrastructure 23 When the DBMS receives a request from the application: It first searches the server memory; if data is found there, the operation takes about a millisecond If not, it uses the operating system to request the data from the storage array Dedicated high speed networks transport this request to the storage array Intelligent storage arrays can deliver the requested data within a few milliseconds, and are typically configured to protect data in the event of drive failures Data Center Infrastructure 24 Availability Security Data Integrity Manageability Capacity Performance Scalability Introduction to Information Storage and Management 25 Exploding digital universe ◦ Multifold increase of information growth Increasing dependency on information ◦ The strategic use of information plays Changing value of information ◦ Information that is valuable today may become less important tomorrow. Introduction to Information Storage and Management 26 Constraints include: Cost Physical environment Maintenance and support Compliance – regulatory and legal Hardware and software infrastructure Interoperability and compatibility Data Center Infrastructure 27 Data Center management activities include: Provisioning/Capacity/Resource Planning Monitoring Reporting Data Center Infrastructure 28 Data Storage Infrastructure Information Lifecycle Introduction to Information Storage and Management 29 Protect New order Process order Deliver order Warranty claim Time Value Fulfilled order Create Access Aged data Migrate Warranty Voided Archive Dispose A proactive strategy that enables an IT organization to effectively manage the data throughout its lifecycle Introduction to Information Storage and Management 30 Policy-based Alignment of Storage Infrastructure with Data Value AUTOMATED Classify data / applications based on business rules Implement policies with information management tools Integrated management of storage environment Organize storage resources to align with data classes FLEXIBLE Introduction to Information Storage and Management 31 Improved utilization ◦ Tiered storage platforms Simplified management ◦ Processes, tools and automation Simplified backup and recovery ◦ A wider range of options to balance the need for business continuity Maintaining compliance ◦ Knowledge of what data needs to be protected for what length of time Lower Total Cost of Ownership ◦ By aligning the infrastructure and management costs with information value Introduction to Information Storage and Management 32 Key points covered in this lesson: The five core elements of a Data Center infrastructure Key requirements of storage systems to support business activities, as well as some of the constraints ILM strategy ◦ ◦ ◦ ◦ ◦ Importance Characteristics Activities in developing ILM strategy IML implementation Benefits of ILM Introduction to Information Storage and Management 33 Key points covered in this Chapter: Importance of data, information, and storage infrastructure Types of data, its value, and key management requirements of a storage system Evolution of storage architectures Core elements of a data center Importance of the ILM strategy Introduction to Information Storage and Management 34