Automating Storage Management For Oracle Database 1Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 13 Program Agenda • Storage Challenges for Oracle DBAs • ZFS Storage Appliance: – Architecture – DTrace Analytics – Oracle Enterprise Manager Plugin – Snap Management Utility for Oracle Database • Q&A 2 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Challenges – Value – Capabilities VALUE CAPABILITIES • 24x7 DB availability • Keep business running • Meet performance SLA • Faster response times • High Availability/Performance Platform • Troubleshoot/Optimize • Faster issue resolution • DTrace Analytics • Copies for Test/Dev • Faster provisioning • Limited IT staff • Simplified management • Snap Management Utility for Oracle DB CHALLENGES • Plugin for Oracle Enterprise Manager 3 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Engineered for Extreme Performance 10x (80 CPU cores) 64x (2TB Main Cache) 11TB Read/Write Cache 40Gb IB,10Gb, 8Gb FC 600GB 15K SAS-2 4 Write SSDs per Tray (max) Most Horsepower Possible 4TB 2TB READ DRAM FLASH Source: 7420 vs. FAS3270 data sheets © 2013 Oracle Corporation – Proprietary and Confidential 4 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. SW, Dynamic Caching Storage Hybrid Storage Pool 2TB DRAM READ Flash 1.7PB Disk 3TB 7K SAS-2 600GB 15K SAS-2 WRITE Flash • Automated, real-time data migration from DRAM to multi-class flash, to multi-class disk storage. • Software engineered for multi-level flash and disk storage. 267,928 Engineered for Extreme Performance 5 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Most Powerful Analytics Tool Available • Automatic real-time visualization of application and storage workloads Database OLTP workload, 8kb block size, random I/O • Customer use examples of ZFS analytics: – System Utilization: Biotech company pinpoints disk bottlenecks (high utilization % or high IOPs) and under-use of disks – System Performance: Web Services company resolves client read performance issues by correlating with specific storage write operations – Tuning: Finances Services company pinpoints partialblock update issues – Load balancing: US bank visualizes and rebalances system resources for critical file systems 6 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. OLTP Operation/ Storage IO Example: Identify Change in the Business ENVIRONMENT: • 3 OLTP systems limited by read service time • SLA set on estimates for read service time and bandwidth at 30MB/s Business Running Fine Change in business New orders/minute: 700/system New orders/minute: 740/system New order service time: 1.4sec New order service time: 6.3sec • End user complains to DBA, who opens ticket against the storage group • Storage Admin uses Analytics to find out what is going on 7 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Example: Identify Change in the Business 28.0M 10.10.10.10 27.1M 10.9.168.99 26.1M 10.9.168.98 133M 10.10.10.10 10.1M 10.9.168.99 10.0M 10.9.168.98 8 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Example: Identify Change in the Business FINDINGS: • Storage Admin finds 10.10.10.10 increased to 133MBPS, breaking SLA • DBA logs into server and finds that RPS increased from 3200 to 14,000 – Someone ran a batch job that nobody expected RESULT: •Storage Admin and DBA present options to business owner: – Purchase more hardware to support “new requirement” – Run the “new requirement” off-hours and update SLAs – Get rid of “new requirement” that conflicts with existing business •Business owner makes best financial decision 9 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Example: Consolidation 10 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Example: Table Spaces 11 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Enterprise Manager Cloud Control 12c Monitoring Plug-in for the Sun ZFS Storage Appliance 12 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. CRISIS 13Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Enterprise Manager Integration Cloud Control Plug-ins for the Sun ZFS Storage Appliance and Oracle Databases No-charge plug-ins for the ZFS Storage Appliance and Oracle Databases Plug-ins provide monitoring and reporting – Space utilization, CPU, memory, share and disk performance, network interfaces – Metric monitoring and alerts – On-demand reports Databases and storage can be monitored with common dashboard and alert destinations using the EM Group function 14 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Enterprise Manager Integration Cloud Control Plug-ins for the Sun ZFS Storage Appliance and Oracle Databases No-charge plug-ins for the ZFS Storage Appliance and Oracle Databases Plug-ins provide monitoring and reporting – Space utilization, CPU, memory, share and disk performance, network interfaces – Metric monitoring and alerts – On-demand reports Databases and storage can be monitored with common dashboard and alert destinations using the EM Group function 15 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. ZFSSA and Oracle Database Monitoring Databases and their associated storage devices can be monitored on one dashboard providing a single point of focus for the DBA Alert thresholds can be set at an individual targets at a group level by using monitoring templates Alerts can be converted to Incidents based on thresholds Problems can be relayed to other software (Remedy, etc.) Corrective actions can be automatically triggered Notifications can be sent to interested parties via email, SMS, SNMP, pagers, or virtually any other notification pipeline 16 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Defining an EM Group For Monitoring Combining databases and storage into a single monitoring dashboard Define a group 1 Define metric and incident rules 2 3 Add targets 17 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 4 Customize dashboard Defining a Group in EM OCC From the main OCC menu: Targets->Groups, then Create->Group Before a ZFS Appliance or a database can be added to a group, it must be defined as a target to EM OCC Select all targets that can have an impact on your database: hosts, storage, switches, database systems and instances, for example Targets can exist in multiple groups Custom screen layouts can be built using the Dashboard, Charts and Columns tabs Contact, ownership and location information can be added when the group is created A default home page for the group is automatically generated 18 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Setting Thresholds and Alerts From target home page: Monitoring->Metric and Collection Settings Metrics such as Spare Disk status, Share and Project Space Utilization, and Cluster State can have custom thresholds for the generation of Warning or Critical alerts Values are entered to define Normal, Warning, or Critical Ranges When a Metric exceeds a defined Threshold, a Metric Event is triggered which appears on the Metrics Monitoring pages If corrective actions, email notifications or relays to other monitoring software are desired, then an Incident Rule must be defined to convert Metric Events to Incidents 19 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. EM OCC Metrics Thresholds Page 20 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. EM OCC Metrics Thresholds Page 21 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Defining Incidents and Incident Rules From OCC home page: Setup->Incidents->Incident Rules->Create Select the targets to which the Incident Rule will apply Rules can apply to specific targets or all targets of a certain type. Define a Metric Alert for which an Incident is to be generated. Define an action to be taken when the Incident is triggered. Email, SMS, SNMP, Remedy Ticket Generation are all examples of possible actions. Emails contain direct links into OCC. Be as descriptive as possible when defining the comments on the Incident definition so that the reason for the action is clear in the email, text message, or page. By default, Incidents will appear on the Group Dashboard 22 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. EM OCC Group Dashboard Page 23 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Incident Event Email 24 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. ZFS Appliance Reports in OCC From OCC home page: Enterprise->Reports->Information Publisher Reports can be done at an individual level for each ZFS appliance or “Federated” (Aggregate) reports can be generated. Database to Appliance Mapping Report Shows all databases that reside on a specific appliance. Capacity and Configuration Report A snapshot of all model numbers, firmware levels, pool utilization, and cluster status for all ZFS Appliances under OCC monitoring. Network Interface Information Report All network interface configuration and performance information for a single ZFS Appliance. 25 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. ZFSSA Federated Database to Appliance Report 26 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. ZFSSA Federated Capacity and Config Report 27 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. ZFSSA Network Interface Configuration Report 28 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. CRISIS 29Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Snap Management Utility (SMU) for Oracle Database 30 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Snap Management Utility DBA Challenges / Requirements 31 Efficient Data Protection DB Clone Creation - High availability - Fast backups - Consistent restores - Fast & up-todate DB copies for dev/test/ reporting Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Manage storage directly - Minimize storage admin support Snap Management Utility Snap Management Utility Overview Management software for DBA's to simplify storage related tasks 32 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Quick and efficient backup, restore and cloning of database instances using storage hw features “Application Aware” - Tightly integrated - Before and after application & storage side processing - Consistent restorable backups Snap Management Utility Terminology Snapshot – Point in time data copy, read-only, quick to create, space efficient, cheap to maintain Clone – 'Copy on Write', read/write Clones Snap Rollback Snapshots – Restore DB to 'point in time copy' Replication Rollback – Deep copy data between same/different Sun ZFSSA's (Split clone) 33 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Snap Management Utility Features Snapshot Types – Hot(online), Cold (offline) Snapshot Operations – CRUD (Create, Read, Update, Delete) – Restore database – Clone database (same or remote host, secondary Sun ZFSSA, mixed environments) – De-provision clone Scheduler/Policy Management – Periodic snapshots, retention policy 34 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Snap Management Utility Reference Architecture Files/Block Application Host (Database) Application/host protocol https ZFSSA interface Sun ZFSSA 35 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Ssh/winrs SMU Host (Can be also installed on Application host ) Snap Management Utility Architecture - Operations SMU 1 2 3 4 36 Database Query Database/ Locate Shares Quiesce Database Snapshot/Clone on Sun ZFSSA Release DB/ Postprocess Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Storage Snap Management Utility Use Cases Snapshot based backups/restore Thin database clones – Dev, Test, Reporting environments Heterogenous Environments Database Clone from RMAN export Split/Replicated database clones – Primary or secondary Sun ZFSSA Data Guard standby clone 37 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Snap Management Utility Interfaces Core Engine - Java (JRE 1.6 +) CLI - ssh based - batching/scripting BUI - Java + ADF - Browser access 38 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 39 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Snap Management Utility Value proposition Occupy a fraction of the space Large number of backups Fast backup and restores Fast database cloning for dev/test Improve SLA's Simplified management with GUI Direct control of storage 40 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Lower Storage Costs Increased Productivity SMU Maintain DB Availability, Data Protection Simplified Management To Learn More Visit www.oracle.com/storage to view: • Oracle Sun ZFS Storage Appliance Visit www.oracle.com/us/products/enterprise-manager to view: • Oracle Enterprise Manager 12c Cloud Control 41 41 Copyright © Oracle 2012, Oracle its affiliates. All reserved. rights reserved. Confidential – Oracle Highly Restricted Copyright © 2012, and/or and/or its affiliates. All rights Join the Conversation Like us on Facebook • Engage with Oracle Experts • Share knowledge and experiences • Keep up with hardware topics & trends • Access Oracle Hardware content easily, including events, webcasts, white papers and more Join the Oracle Hardware Hub today facebook.com/oraclehardware 42 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Learn More At OpenWorld Wednesday October 3rd, 2012 3:30 PM – 4:30 PM – CON-5101 - Integrating Oracle Database Appliance with Sun ZFS Appliance to Achieve HA Security - Moscone West – 3014 3:30 PM – 4:30 PM – Hybrid Columnar Compression with the Latest Generation of Database Technology- Moscone South – 300 Thursday October 4th, 2012 12:45 PM – 1:45 PM – Backup and Recovery of Oracle Exadata: Experiences and Best Practices– Moscone South 300 43 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Q&A 44 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 13 The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract.It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. 45 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 46Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 13 47Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 13