Oracle 8i or 9i to version 10g – Upgrading or Migrating with Eliminated Downtime GCOUG Meeting, October 17, 2007 Chuck Duncan, Sr. Solutions Consultant Challenges for Major Upgrade/Migration Projects Maintaining SLA during planned outage Revenue Impact Customer Expectations Interdependencies, Integration Data issues Synchronization issues Incremental data movement Source database impact Instantiating Terabytes/Petabytes Staging areas Change Management Special Handling Fail-back strategy System/Application verification Continued data growth Possible Technologies Evaluated for Oracle Migrations Export/Import Flat files/SQL*Loader Data Pump Synchronous replication Backup/Recovery Non Mission-Critical Systems Transportable tablespaces Cross-platform transportable tablespaces Standby databases Oracle Streams Transactional Data Management High Availability Systems Technology Choices for Oracle Migrations: Considerations Export/Import Flat files/SQL*Loader Data Pump Synchronous replication Backup/Recovery Non Mission-Critical Systems Assume a moderate to significant amount of planned downtime Significant overhead on the source database No ongoing management of transactions Complex, error prone, unmanageable Migration time dependent on size of data No manageable failback strategy No real-time data verification strategy Technology Choices for Oracle Migrations: Considerations Transportable Tablespaces No updates possible No incremental solution No failback solution No 9i-10g Cross Platform Standby Databases (logical) No rolling upgrade in 9i Cannot be used for heterogeneous migration/upgrade No real-time verification solution Streams No rolling upgrade in 9i Limited datatype support (e.g. no LONG support in 9i) No real-time verification solution Heterogeneity very complex Transportable tablespaces Cross-platform transportable tablespaces Standby databases Oracle Streams Transactional Data Management High Availability Systems Available Solutions/Techniques & Tradeoffs Scenario: Unload/ Load Export/ Import Backup/ Roll Forward Transportable TableSpaces 8i or 9i 10g Yes Yes No 8i or 9i 10g cross platform Yes Yes 8i 9i Yes 8i 9i cross platform Dataguard Streams GoldenGate TDM Yes No No Yes No No No No Yes Yes No Yes No No Yes Yes Yes No Yes No No Yes 9i 10g RAC/ ASM Yes Yes No No No No Yes Non-Oracle 10g Yes No No No No No Yes Downtime Weeks/Days Hours/Minutes Standby Databases Minutes/Seconds Transactional Data Management Real-time capture, routing, transformation, delivery, and verification of data transactions across heterogeneous environments with low impact. TDM is: Real time GoldenGate further differentiates on: Moves data with sub-second latency Heterogeneous Handles thousands of transactions per second with very low overhead Moves transactions across different databases and platforms Transactional Maintains transaction integrity Performance Extensibility & Flexibility Open architecture, modularity enables wide range of solutions Reliability Supports continuous operations and availability GoldenGate TDM for Oracle Database Capture Capture: Committed changes are captured (and can be filtered) as they occur by reading the transaction logs. Trail files: Universal data format enables heterogeneity. Route: No distance constraints via TCP/IP. Compression & encryption. Delivery: Applies transactional data with guaranteed integrity. redo log Capture Oracle Database Source Trail LAN / WAN / Internet Target Trail Target Trail Deliver Source Trail Deliver Capture Bi-directional Target Database Oracle 8i or 9i to 10g Upgrades/Migrations What TDM offers: Minimal impact and continuous availability during the project Technology solution for eliminating database downtime Improved capabilities for data integrity, accuracy Fail-back solution in the event of unexpected issues/downtime Proven – with customers in production No Downtime Migration: 9i 10g Cross-Platform 9i Clone 10g 2 9i Solaris 3,4 1 1. 2. 3. 4. Solaris Start GoldenGate TDM’s Capture process Set up Clone database, then Upgrade to 10g Cross platform transportable tablespaces metadata export Use a full database NOROWS export (Views, Packages, etc) No Downtime Migration: 9i 10g Cross-Platform 9i Clone 10g 2 9i Solaris Solaris 3,4 1 6,7 10g 5 1. 2. 3. 4. 5. Start GoldenGate TDM’s Capture process Set up Clone database, then Upgrade to 10g Cross platform transportable tablespaces metadata export Use a full database NOROWS export (Views, Packages, etc) Set up a new 10g vanilla target 6. 7. Linux Cross platform transportable tablespaces metadata import Full import with IGNORE option No Downtime Migration: 9i 10g Cross-Platform 9i Clone 10g 2 9i Solaris Solaris 3,4 1 8 6,7 10g 5 1. 2. 3. 4. 5. Start GoldenGate TDM’s Capture process Set up Clone database, then Upgrade to 10g Cross platform transportable tablespaces metadata export Use a full database NOROWS export (Views, Packages, etc) Set up a new 10g vanilla target 6. 7. 8. 9. Linux Cross platform transportable tablespaces metadata import Full import with IGNORE option Start GoldenGate TDM Apply process at target **SWITCHOVER** (not depicted) No Downtime Migration: 9i 10g Cross-Platform 9i Clone 10g 2 9i Solaris Solaris 3,4 1 8 6,7 11 Failback contingency 1. 2. 3. 4. 5. Start GoldenGate TDM’s Capture process Set up Clone database, then Upgrade to 10g Cross platform transportable tablespaces metadata export Use a full database NOROWS export (Views, Packages, etc) Set up a new 10g vanilla target 10g 10 6. 5 Linux Cross platform transportable tablespaces metadata import 7. Full import with IGNORE option 8. Start GoldenGate TDM Apply process at target 9. Verify data (optional) 10. **SWITCHOVER** (not depicted) 11. Start TDM Capture at target (new source) 12. Start TDM Apply at target (old source) TDM – in Summary Real Time Allows for highest application availability Heterogeneous Allows movement across platforms/databases Transactional Maintains transactional integrity Performance No impact on source database Downtime Only incurred during Application switchover Verification Real time (dual) verification after migration Failback With no data loss, in real time GoldenGate Major Customer Examples Database and/or Platform Migrations in all-Oracle environments: Overstock.com: Oracle 9i on Linux Oracle 10g on AIX HP internal testing: Oracle 9i on HP Tru64 Oracle 9i on HP UX Cerner’s Millennium Application: Oracle 9i on OpenVMS Oracle 10g on HP UX or AIX Migrations from non-Oracle to Oracle database environments: Sabre Holdings: HP Nonstop Oracle Siebel on Demand: IBM DB2 Oracle Integrating non-Oracle data into Oracle BI systems: Dell: OLTP on HP NonStop Oracle Data Warehouse AMD: IBM DB2 Oracle reporting database GoldenGate’s Partnership with Oracle: Highlights Oracle Certified Partner (worldwide) since fall 2006 Oracle Database 11g – beta test partner Oracle Modernization Alliance – member partner (July 2007) Siebel CRM - GoldenGate TDM has Validated Integration Oracle Data Integrator – Proven solutions for real-time data integration and warehousing Solution Focus Areas for Oracle Customers High Availability & Disaster Tolerance Real-Time Data Integration Unplanned Outages: Live (Hot) Standby Real-Time Data Warehousing (with transformation support) “Planned Outages”: Oracle database upgrades & migrations Offload Live “Real-Time” Reporting Data Consolidation – Oracle Data Hubs Application, platform migrations Non-Oracle to Oracle migrations Performance & Transaction Load Balancing: Active-Active GoldenGate TDM: Heterogeneity Supports Applications Running On… Databases Capture: Oracle DB2 UDB Microsoft SQL Server Sybase ASE Teradata Enscribe SQL/MP SQL/MX Delivery: All listed above Ingres, MySQL and any ODBC compatible databases O/S and Platforms Windows 2000, 2003, XP Linux Sun Solaris HP NonStop HP-UX HP TRU64 IBM AIX IBM z/OS OpenVMS TDM Key Architecture Features Log-based extraction Reads transaction logs directly, enabling advanced changed data capture with high performance and minimum impact to source systems. Routing, flexible topologies Enables users to support various topologies, such as one-to-one, many-toone, one-to-many, many-to-many, and bi-directional movement of data. Dynamic rollback and selective recovery Point-in-time and selective recovery. Data filtering and transformations Table and row filtering can be applied based on user-defined criteria. Users can map, enrich, translate, and transform transactional data in real time as it is captured or applied to target systems. Archival and Audit Capabilities Customization: User Exits, Stored Procedures and Queries, Macros Compression and Encryption GoldenGate Veridata™ “GoldenGate Veridata is a high-speed, low impact data comparison solution that identifies and reports data discrepancies between two databases, without interrupting those systems or the business processes they support.” Benefits: Reduce risk exposure and act on data discrepancies sooner Speed and simplify IT work in comparing data sources No disruption to business systems GoldenGate Veridata™ Key features: Support for large data volumes Comparisons ran while data sources are kept online Flexible reporting for discrepancy analysis Unparalleled speed and efficiency Selective comparison options Oracle to Oracle HP NonStop to NonStop - Enscribe & SQL/MP GoldenGate Veridata: How it Works The user chooses tables or files on the source and target databases The comparison is initiated from the GUI, command line or batch As the databases continue to change, GoldenGate Veridata reports: Persistent discrepancies In-flight data discrepancies (user configurable) GoldenGate Veridata: Architectural Advantages Initial read and local conversion to a digital signature: Maximum speed Minimal network load Optional unstructured read and server side sorting Two step comparison cycle allows for: Operation on replicated production system intelligent identification of “In flight” records Extremely fast! In testing on moderate hardware 25,000 rows/sec No interruption of service Thank you. cduncan@goldengate.com www.goldengate.com Case Study: Overstock.com Multiple Enterprise Solutions Drive Revenue, Enhanced BI Business Challenges: Minimize downtime for e-commerce systems during database & platform migration Improve Business Intelligence by reducing data latency for the data warehouse Gain a single view of the customer to better understand purchasing habits, refine marketing campaigns to be more targeted, and ultimately drive more business Implement a reliable, in-house disaster recovery solution GoldenGate Solution: Zero downtime during migration project for 3 business-critical e-commerce systems Enabled an operational Teradata EDW through real-time data integration from e-commerce systems High Availability for Teradata to balance transaction load and enable failover solution High Availability & Real-Time Data Warehousing Oracle 9i Oracle 10g Linux AIX Oracle 9i Oracle 10g Linux AIX Oracle 9i Oracle 10g Linux AIX Enterprise Data Warehouse “Accessing the data in real time using GoldenGate we can immediately see if we’re profitable and if our business processes are working.” - Sam Peterson, SVP Technology, Overstock.com Addressing Failback 9i Solaris 10g Linux Stop application at new Primary (10g) Real-time TDM synchronization ensures old primary is synchronized Switchover Application to old primary (9i) Start Primary database Our Business We enable real-time, continuous movement of transactional data across Operational and Analytical business systems. Real-Time Access to Real-Time Information Real-Time Information Real-Time Access Availability: the degree to which information can be instantly accessed. Mission-Critical Systems Integration: the process of combining data from different sources to provide a unified view. Key GoldenGate Customers… Banking and Finance Healthcare Telecommunications and Service Operators Retail and e-Business Manufacturing & Supply Chain Travel & Hospitality Government & Public Sector Oracle Database Support GoldenGate currently has GA support for real-time, continuous data capture from Oracle transaction logs: Oracle 8i, 9i, 10g RAC & ASM Oracle Database 11g – in progress GoldenGate is a beta tester Product roadmap and engineering underway Internal experts attending training Why GoldenGate over Oracle native replication? Heterogeneity Performance, volumes/scalability, and IT impact Implementation and manageability Solutions and features