An Introduction to DBMoto 7:
Real-time, Heterogeneous Data
Replication and Change Data Capture
CONFIDENTIAL
1
© Copyright
2010 BackOffice
Associates,
LLC
© 2010, ©
HiT
Software,
Inc., a BackOffice
Associates,
LLC
Company.
All Rights
Reserved.
2010,
HiT Software,
Inc., a BackOffice
Associates,
LLC Company.
All
Rights
Reserved.
About HiT Software
Business:
Software
Data
Integration and Access
• Software that can access, integrate, migrate, transform,
and consolidate enterprise data across heterogeneous
systems.
• “Data integration and access software has grown more
rapidly than expected, not because of unexpected factors,
but because those factors have taken hold sooner than had
been expected, ....” (IDC, 2009)
• Founded 1994 in San Jose, CA
• Offices in San Jose (HQ), Europe, Latin America and Asia
• Thousands of users worldwide in all industries
• Acquired by BackOffice Associates, LLC in April 2010
CONFIDENTIAL
2
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
HiT Software Product
Family
•
DBMoto: Real-time, bidirectional database
replication (supports all
major relational databases)
•
IBM DB2 Connectivity: Top
performing middleware
(.NET, JDBC, ODBC, OLE DB)
•
Allora: Transformations
between XML data and
relational databases:
Mapper, Workflow Mgr. and
embeddable Engine
•
SafeConduct and HiT SSL
Server:
256-bit point-to-point SSL
data encryption
CONFIDENTIAL
3
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Business Drivers for
Change Data Capture
1. Supporting a Disaster Recovery or Backup / Restore Plan
2. Reducing stress on operational databases
3. Distributing data for Line of Business information
management
4. Supporting Applications that cannot run on certain
databases
5. Develop new applications with less concern on backend
business data synchronization
:
:
CONFIDENTIAL
4
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
DBMoto Business
Benefits
• Moves data closer to business users for quicker
decisions and more profitable business operations
• Provides fast data updates
• Exposes data from production databases with lower TCO
• Eliminates data bottlenecks
• Database-neutral: no database dependency
• Manageable with existing IT staff
• Does not require additional investment in systems for installation
• Delivers quick ROI
CONFIDENTIAL
55
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
DBMoto Top Features
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Ease of Use
Entire replication process can be configured and managed from friendly GUI
No programming required
Easy scripting enables full customization
Advanced and Adaptive Replication Technology
Performs real-time bi-directional mirroring (based on source log/journal)
Change Data Capture
Multi-Server Synchronization
Replication grouping, remote management, error handling and administration
optimizations
Automated replication: event-driven, transformations added via scripts
Minimally Intrusive to Systems
No programming needed on databases, no naming conventions or proprietary fields
needed on source database
Small Footprint
7th generation product, full maturity of features and functions
CONFIDENTIAL
6
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
DBMoto: Data Replication
and Change Data Capture
Powerful Cross-Platform
Replication Solution
ORACLE
SQL
SERVER
IBM i
Real-time, bi-directional
support for all major
databases
Platform Independent
User friendly monitoring &
configuration support
IBM z/OS
SYBASE
Lightweight, easy to
install
MySQL
Short ROI and Low TCO
FINANCE
Stock Exchange,
Banks, Insurance,
Mortgages
GOVERNMENT
Homeland Security,
INDUSTRY
Telco, Automotive,
Justice, Military, State,
Health
Retail, Utilities,
Manufacturing
BUSINESS
ERP, CRM, EIM,
Web, EAI, HR,
XML, EDI, SOA
CONFIDENTIAL
77
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
DBMoto Replication
Modes
Refresh
• Source and target databases can be any combination of the
databases supported
• All specified records in the source table are scanned and
replicated
Mirroring
• One-way or bi-directional, includes Change Data Capture
• Source and target databases can be any combination of the
databases supported
• Specified records are replicated only when changes are notified
(via log or triggers)
• Can be combined with Refresh replication
Synchronization
• Each database is both source and target, includes Change Data
Capture
• Multi-Server Synchronization available for three or more databases
• Applies to databases supported
• Specified records are synchronized based on changes notified via
log or triggers
• Can be combined with Refresh replication
CONFIDENTIAL
88
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Replication Modes
T1
Refresh
Mirroring/Synch
T2
T3 T4
T5
T6
T7
T8
T9
All Records
= Changed records only
CONFIDENTIAL
99
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
DBMoto - Supported
Databases
CONFIDENTIAL
10
© Copyright 2010, HiT Software, Inc. All rights reserved.
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
What’s New in DBMoto
7?
Key Features
• Setup
• Local (previous versions)
• Enterprise - Remote
• Management Center – Fresh
Look
• Management Center – New
Functionality
• Distributed Graphical Interface
• Extensive, Integrated Security
• DBMoto Verifier™
• DBMoto Service Monitor
• DBMoto Server Agent, DBMoto
Data Replicator
• Enterprise Considerations
• Multi-Server Synchronization
• Microsoft Cluster Support for
Failover
• DBMoto for MDM
CONFIDENTIAL
11
11
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Local Setup –
Source/Target
DBMoto Management Center
and Data Replicator installed on
Third System
Source
Target
Source
Target
Source
Target
DBMoto Management Center
and Data Replicator installed on
Source Database Server
DBMoto Management Center
and Data Replicator installed on
Target Database Server
CONFIDENTIAL
12
© Copyright 2010, HiT Software, Inc. All rights reserved.
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Remote Setup –
Extended Enterprise
192.168.1.120
Data Replicator
Management Center
192.168.1.121
Data Replicator
Data Replicator
192.168.1.111
CONFIDENTIAL
13
© Copyright 2010, HiT Software, Inc. All rights reserved.
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Management Center –
Fresh Look
Database Connection Wizards
•
Set source and target
databases
•
Choose tables for data to be
replicated
•
Set access to transactions
from log/journal
•
Create target tables as
needed
•
Set primary keys and
columns to create
CONFIDENTIAL
14
14
© Copyright 2010, HiT Software, Inc. All rights reserved.
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Management Center –
New Functionality
DBMoto 7 Start Page
- Easy access to Support,
Tips and Tricks,
Documentation, and “What’s
New in this Version”
Fully Customizable
Interface
- Setup customized views by
dragging and dropping
screens
Metadata Explorer
- Manage multiple replication
servers
- Manage replication
information
- Administrate roles and
licenses
CONFIDENTIAL
15
© Copyright 2010, HiT Software, Inc. All rights reserved.
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Distributed Graphical
Interface
• Multiple Replication wizard for
easy setup
CONFIDENTIAL
16
© Copyright 2010, HiT Software, Inc. All rights reserved.
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Extensive, Integrated
Security
•
Server- specific
authentication
with
preconfigured or
customized
groups
•
DBMoto
Authentication
or
Windows
Authentication
CONFIDENTIAL
17
© Copyright 2010, HiT Software, Inc. All rights reserved.
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
DBMoto Verifier™ Comparing Replication
Results
•
•
•
Verifies the
results of
replications
including
transformation
results from builtin functions
Helps to quickly
and easily locate
and resolve any
differences
Easily customize
your verifications
and export results
CONFIDENTIAL
18
© Copyright 2010, HiT Software, Inc. All rights reserved.
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
DBMoto Service Monitor
DBMoto Server Agent
•
Service to control Authentication and
Access to Replication Server.
DBMoto Management Center
•
Quick Launch Link.
DBMoto Data Replicator
•
Starts and stops the Data Replicator as a
service or application
DBMoto Service Agent
Icon
•
Illuminates to indicate Server Agent is
On
•
Red Light indicates Data Replicator
Engine is stopped, Green Light
indicates Engine is working.
CONFIDENTIAL
19
© Copyright 2010, HiT Software, Inc. All rights reserved.
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Multi-Server
Synchronization
Source
Target
Target
Target
Target
Target
Allows synchronization
among more than two
databases
Provides built-in conflict
resolution, based on
priority of connection
Can support any
“Synchronization”
database
CONFIDENTIAL
20
© Copyright 2010, HiT Software, Inc. All rights reserved.
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
DBMoto 7 in Windows
Cluster
Failover Installation of
DBMoto
During Failure
• DBMoto 7 must be installed on all nodes of
the cluster
• Create Data Replicator and Server Agent
Services as a Cluster Resource
• Set Cluster Resources Dependencies
• Create Metadata and Logs on a shared
external database server for nodes
• Replications run between source and target
• When ACTIVE node signals that services
have gone down, the cluster service will
automatically switch to second node
(PASSIVE) and make it ACTIVE.
• All services including DBMoto will resume
without loss of data
Active
Microsoft Windows Cluster
Source
Passive
Target
CONFIDENTIAL
21
© Copyright 2010, HiT Software, Inc. All rights reserved.
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Preparing for MDM/Data
Governance
JDE
Siebel
SAP
EBS
PeopleSoft
Mainframe
Custom
DB2
SQL
Server
Oracle
Oracle
Oracle
DB2
MySQL
CDC
Client
CDC
Client
CDC
Client
CDC
Client
CDC
Client
CDC
Client
CDC
Client
Product Offering
Violation
Data Standard Violations
delivered via workflow email
MDM
Server
MDMb
•
•
•
•
Governance Centric MDM
Data Quality metrics
Global Processes
While still on disparate
systems
CONFIDENTIAL
22
© Copyright 2010, HiT Software, Inc. All rights reserved.
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Data Integration
Example
CONFIDENTIAL
23
23
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Case Studies
Background
EPSON PRECISION (HONG KONG) LTD is one of the largest overseas
subsidiaries of the Japanese Seiko Epson Corporation. It is a
manufacturing company, with more than 30 years history in Hong Kong.
Epson Precision Hong Kong was formed in June 1986 through a merge of two
subsidiaries of Seiko Epson Corporation.
Platforms
iSeries/AS400, Windows 2000, and Solaris
Case Problem and HiT Software Solution
Epson needed to reliably replicate their iSeries/AS/400 data to their
Oracle subsystem databases for their Warehouse Management Project. This
project consists of front-end barcode data collection devices to cover
"receiving," "stock in," and "transfer" warehouse functions. This data
is uploaded to a middle tier Oracle database. Using DBMoto, the data is
then replicated to a backend iSeries/AS400 database.
CONFIDENTIAL
29
29
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Case Studies
Background
Before implementing DBMoto, ING Life was using a very complicated DB2
data replication tool to replicate data from i5/OS to SQL database. From
time to time, IT team had spent a lot of resource to maintain this DB2
replication tool on data replication and trouble shooting.
Following the end of support time of this DB2 replication tool, there
was no way to find product upgrade and relevant product replacement in
the market.
After consulting several vendors & doing market study, the DBMoto was
selected to evaluate. We defined a lot of condition and criteria during
the evaluation process, but all of them could be managed and overcame by
DBMoto with satisfaction result. The tool itself is designed in GUI,
thus easy to use and administrate. With its powerful features like
custom scripting, ING Life finally used DBMoto as a replication tool
between i5/OS and SQL server.
CONFIDENTIAL
30
30
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Case Studies
Background
Tupperware (china) company Limited is a US-China joint venture corporation
established since end 1995. where her core business is household applicants
manufacturing. Tupperware runs their business operation in J.D. Edward. Over the
years her business communication with partners are email and fax. With the business
growth and problem started surfaces. The existing operation is slow, error-prone
and hard to response to business changes.
Tupperware invited Shenzhen Kemai to deploy an Online Order System (OOS) to reengineer the overall ordering operation. Kemai’s OOS is a well-defined off-theshell solution runs on MS SQL database.
In order to streamline data integration without making much changes to OOS,
Tupperware approached HiT Software and evaluated DBMoto. The problem was resolved
almost instantly with DBMoto’s graphical Field Mapper and very handy “Define
Multiple Replications” function.
After the Tupperware project, Kemai deployed DBMoto at few more projects to reduce
their effort at backend ERP database synchronization.
CONFIDENTIAL
31
31
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Thank You
Thank you for watching
Introduction to DBMoto
If you have any questions, please contact us at
ap@hitsw.com or (852) 2544 3318
CONFIDENTIAL
32
32
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Supporting a Disaster Recovery
or Backup / Restore Plan
many disaster recovery and backup/restore solutions
are based on replacement of data in block-based
fashion, meaning that portions of data are replaced as
they are stored, not by their contextual meaning. With
DBMoto, businesses can have the best of both worlds—
they can keep a hot standby copy of their data, while
maintaining the most accurate (and freshest) version
of the data available in the standby copy, for
immediate access in the event of a catastrophe.
←
CONFIDENTIAL
33
33
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Reducing stress on
operational databases
•
Many organizations rely on one or
more critical database systems for
production activities, and in some
cases, these activities run 24x7.
• Any data request that requires a new
connection to that production system
will result in a performance hit on that
system.
•
When any number of users is
allowed access to that production
system, there is a high likelihood of
unanticipated downtime or poor
performance on the production
system.
←
CONFIDENTIAL
34
34
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Distributing Data for
Line of Business
HiT Software
DBMoto
Performs Seamless
Data Delivery
Reporting Servers
Applications
Sales / Parts Forms
MS SQL
Server 2005
Production Data
On DB2 for IBM iSeries
DB2 on
IBM iSeries
Scheduling Software
MS Access on
Windows 2003
Server
Reporting Server
←
CONFIDENTIAL
35
35
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Supporting applications
that cannot run
on certain databases Every business has its reasons for
•
selecting or developing its
particular choice of software
applications.
•
There are occasions when the
software selected for valid
business reasons is not designed
to be deployed on the
organization’s established
platforms or systems. system.
←
CONFIDENTIAL
36
36
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.
Develop new applications with less
concern on backend business data
synchronization
•
New Applications need to be
designed with database
structure matching those
running at backend systems
•
Any changes at backend
databases have catastrophic
effect to all applications.
←
CONFIDENTIAL
37
37
© Copyright
2010 BackOffice
Associates,All
LLC
© 2010, HiT Software, Inc., a BackOffice
Associates,
LLC Company.
Rights
Reserved.