Double-Take® SHARE 5.0 Technical Overview Multi-platform real-time change-data-capture Last updated: February 8th 2012 Leaders Have Vision™ GA October 2011 visionsolutions.com 1 Double-Take® SHARE 5.0 Real-time DBMS level replication with transformation Move data from where it is to where it needs to be… Change data capture (CDC) – data captured real-time Column level selection – granular data selection Data manipulation – flexible data transformation Heterogeneous – multiple source/target DBMS/OS support Semi-synchronous delivery – Fast and reliable delivery Point-to-point architecture – proven to be most flexible architecture Replication Schema Language (RSL) – flexible data management Director - graphical modeling console Enterprise Data Movement Model (EDMM) – replication schema MonCon – graphical monitoring console Request Scheduler - Automated data synchronization Non intrusive – does not impact existing business applications Source only licensing – affordable and flexible licensing model No programming – eliminates the need for expensive custom code Multiple Use – data integration, workload balancing, audit databases, offload query, data warehouse loads more.. Helps any DBA become a multi-DBMS expert DBMS = Database Management System Over 500 licenses sold to over 300 customers Leaders Have Vision™ visionsolutions.com 2 What Is Double-Take SHARE*(1) ? DATA WAREHOUSE LOAD PROJECT Examples of Double-Take Share Projects eCommerce (web site) Back Office ERP HP-UX Oracle IBM i, DB2/400 DTS DTS Customer Orders Payment Details Data Warehouse Windows, SQL Server Sales data (all regions) DTS Product Catalogue Price List APPLICATION INTEGRATION PROJECT OFFLOAD QUERY & REPORTING PROJECT Regional sales data Double-Take Share is an easy to use real-time, multi-platform change data replication tool. DTS DTS Double-Take Share replicates columns in changed rows in real time between MS SQL Server, DB2/400, DB2/UDB, DB2/zOS, Oracle, Informix and Teradata. Data columns can be easily mapped and transformed while replicated (no programming required). This tool is typically used by development to greatly simplify internal projects that require real-time movement of data. Reporting database Windows, SQL Server *(1) Formerly known as Vision Replicate1 Leaders Have Vision™ visionsolutions.com 3 How Does Change Data Capture Work? Administration & Monitoring (Director, MonCon & Console) Source Target Listener Listener (Agent) (Agent) LAN / WAN XML Metadata Kernel XML Metadata Kernel (Engine) (Engine) Data path Replication data path Source Metabase Copy data path (periodic & initial synch) Change Queue Target Metabase Change Selector (Log Based) (Triggers/journals /logs) Change Data Capture (CDC) Source Data Leaders Have Vision™ Target Data visionsolutions.com 4 Transforming Rows With Column Mappings Source Host - server connected to the TCP/IP network Target Host - server connected to the TCP/IP network Eg. IBM i server CUSTPF E.g. Windows server Database Server Database Server E.g. DB2/400 E.g. SQL Server File / table mapping Field Name CUNUM CUCLM CUNAM CUAD1 CUAD2 CUAD3 CUAD4 CUTEL customer_master (SQL table) (Physical file) Data Type Numeric (10) Numeric (10,2) Alpha-numeric (20) Alpha-numeric (25) Alpha-numeric (25) Alpha-numeric (25) Alpha-numeric (25) Numeric (10) Column Name Customer number Customer name Customer address line 1 Customer address line 2 Customer address line 3 Customer address line 4 Customer address line 5 Customer telephone Customer credit limit Data Type Numeric (10) Alpha-numeric (10) Alpha-numeric (25) Alpha-numeric (25) Alpha-numeric (25) Alpha-numeric (25) Alpha-numeric (25) Numeric (10) Numeric (10,2) Field / column mappings Leaders Have Vision™ visionsolutions.com 5 Manipulating Data Target Column Expressions Fast way to specify simple and medium complexity data manipulations Join Tables It’s possible to join tables together and build a new table on the target. Eg. Join the invoice header table with the customer master table to get address columns Replication Scripting Language (RSL) All data manipulations are stored in a easy to read scripting language, which can be exported, edited and imported for advanced manipulations by power users. Also a big time saver in sophisticated enterprise environments with lots of tables. Leaders Have Vision™ visionsolutions.com 6 Double-Take Share Components & Monitoring EDMM All data replication rules including data mappings and data manipulations are stored internally using a scripting language in an Enterprise Data Movement Model. MonCon The monitoring and control interface is one of several ways to monitor the status of replication in real time. MonCon lets you do this locally through a graphical monitor. There is also WebMonCon that allows monitoring through a web browser. Leaders Have Vision™ visionsolutions.com 7 Flexible Replication Topologies Rep1 Rep1 One Way Cascade Rep1 Rep1 Distribute Consolidate Rep1 Rep1 Two Way Leaders Have Vision™ Bi-Directional visionsolutions.com 8 Supports Most Databases and Operating Systems 8i – 11g 2000 - 2008 IBM i/OSV5R4 – V7R1 z/OS 1.8 – 1.11 12.5 – 15.x AIX 5.2 – 6.1 Solaris 2.8 – 2.10 Double-Take SHARE HPUX 11i – v3 64bit 5.0 DB2/IBM I V5R3 – V7R1 DB2/ zOS 8.1 - 9 DB2 UDB 9.1 – 9.5 2000 – 2008 (32 and 64 bit) V2R6.2bf – V13bf DS 9.x – DS 11.x Red Hat Rel 3 - 5 SuSe (x86) 9.2 - 10 Flat File target Leaders Have Vision™ visionsolutions.com 9 Double-Take SHARE 4.0.8 New Features Name change from ‘Vision Replicate1’ to ‘Double-Take Share’ New Platform Support Sybase 15.x UDB 9.1 and 9.5 UDB 9.7 as target only DB2 9 for z/OS Informix 10.x and 11.x Oracle Change Selector Performance Now uses memory to reduce I/O Change Selector rotating logs parameters New parameters to control log rotation GA August 16th 2010 Leaders Have Vision™ visionsolutions.com 10 Double-Take SHARE 5.0 New Features 1. Performance 1.1 Log Based Capture For MS SQL Server 2008 2. Packaging and Documentation 2.1 Rebranding to Double-Take SHARE 3. Data Transformation 3.1 Expressions Now Support Unicode Data Type 3.2 DB2/400 32K Character Length 3.3 Ten Character Flat File Delimiters 4. RDBMs & Java 4.1 Java 6 Support Four Areas Of Focus Six* New Features * Some of these can be broken down into more sub features GA October 2011 Leaders Have Vision™ visionsolutions.com 11 Double-Take Share Customer Story AGC Automotive BI-DIRECTIONAL APPLICATION INTEGRATION AGC Automotive is a global company which mainly produces and sells automotive glass for new vehicles and aftermarket replacement glass System i Enterprise Unit Shop Floor Unit Double-Take Share replicates data bidirectionally between the enterprise LPAR which runs Mapics and Future3 and the shop floor LPAR which runs in-house applications. This interface helps both business units know what the other is doing in real time Double-Take Share replicates data bidirectionally between the in-house applications on System i and two MS SQL Server databases in two Machinery Units (in different buildings). Any product defects detected result in updates to the MS SQL Server databases and this data is replicated back to the shop floor database Leaders Have Vision™ LPAR1 LPAR2 Machinery Unit 1 Machinery Unit 2 Windows SQL Server visionsolutions.com 12 Customer Story – Millennium BCP - Luxembourg APPLICATION INTEGRATION PROJECT Online Banking IBM System i DB2 Microsoft SQL Server 1 Customers enter new 1. banking transactions on line. They get captured in SQL Server 22. DoubleTake Share replicates the transactions in real time to DB2/400 Bi-directional replication 5. Customers view 5 processed transactions on-line 44. Double-Take Share replicates the processed transactions back to SQL Server in real time. Leaders Have Vision™ 3 3. A back-office batch application processes incoming transactions and updates data. visionsolutions.com 13 Customer Story – Duke Realty - USA DATA WAREHOUSE LOAD PROJECT Real Estate Production System Double-Take Share Data Warehouse System Real time CDC replication with transformation IBM System i DB2 MS SQL Server 2005 Tip: Customer migrated from Integrator 2.1 and was impressed with the extra performance and functionality of Replicate1 Business intelligence Leaders Have Vision™ visionsolutions.com 14 Customer Story – Pinnacle Entertainment Group - USA DATA WAREHOUSE LOAD PROJECT Gaming Casino 1 Casino 2 Casino 3 Casino 4 Casino 5 Casino 6 IBM System i DB2 IBM System i DB2 IBM System i DB2 IBM System i DB2 IBM System i DB2 IBM System i DB2 Double-Take Share Real time CDC replication with transformation Customer loyalty Amounts paid Amounts won Time at the table Time at the machine Single Data Warehouse Database Windows 2003 Cluster MS SQL Server 2005 Business intelligence Leaders Have Vision™ visionsolutions.com 15 Customer Story – Red Wing Shoe Company - USA OFFLOAD QUERY & REPORTING PROJECT Manufacturing Production System Double-Take Share Many cost effective tools available on MS SQL server platform for query reports Offload Query System Real time CDC replication with transformation Query reports Data Warehouse load IBM System i DB2 Lawson M3 (Movex) Reduce CPU and I/O overhead on production system improve user response times Leaders Have Vision™ MS SQL Server 2005 Data is already partially ‘scrubbed’ and available for loading data warehouses and data marts without performance impact on production system visionsolutions.com 16 More Business Uses • LOAD DATA WAREHOUSES - Extract data from different OLTP databases, scrub it and deliver it to the data warehouse platform, ready for loading. • MIGRATE ERP DATABASES – Map current ERP schema to new ERP version or new ERP on same or different platform and migrate data without downtime. • INTEGRATE APPLICATION COMPONENTS – Develop applications on different platforms and share data between them in real time. • OFFLOAD QUERY – Create a Query database on a different partition or server or platform. Avoid running Query over production data, improves performance • CREATE TEST DATA – Extract realistic test data from production to test environments. • CREATE LIVE AUDIT DATABASES – Extract log of changes to critical database tables and create a live audit database. Leaders Have Vision™ visionsolutions.com 17 Partial Customer List • • • • • • • • • • • • • • • • • • • • • • Dorel (Netherlands) Disney Corporation (USA) Milenium BCP (Luxembourg) Alabama DOT (USA) Anadigics (USA) Ethan Allen (USA) RCN Corporation (USA) JD Irving (USA) Reliant Insurance (USA) Koopman International (Netherlands) Compass Group (USA ) AIC Group of Funds (USA) Cooley Godward (USA) Georgia Pacific (USA) Old Mutual (South Africa) Johnson Matthey (UK) Allianz (UK) Leo Pharma (Denmark and Ireland) Enstar Insurance (UK) Red Fuel Cards (UK) Rexel Electrical Supplies (UK) Irish Dairy Board (Ireland) Leaders Have Vision™ • • • • • • • • • • • • • • • • • • • • • • • IBM Ecuador (Ecuador) Insight Communications (USA) JR Cigars (USA) Kingston Technology (USA) Mohawk Fine Paper (USA) Massimo Zanetti Berverage (USA) Northwest Natural Gas (USA) Ryerson Coil (USA) Parsons (USA) Vanda Group (USA) Vertex Business Systems (USA) Duke Realty (USA) EOG Resources (USA) Belgium Ministry of Defense (Belgium) Groupama Insurance (Spain) Ecclesiastical Insurance (UK) IFDS (UK) iForce (UK) La Repubblica (Italy) Wyeth Nutritionals-Pfizer (Ireland) MIO (Sweden) ESAB (DK, UK, SE) Tamro (Finland) visionsolutions.com 18 Thank you Leaders Have Vision™ visionsolutions.com 19