DataMigrator
Data Analysis with WebFOCUS
DataMigrator
ETL check list
Metadata
Data Lineage
Data Profiling
Data Transformation
Administration
Connectivity
Portability
2
DataMigrator
Data Management Console and Web Console
3
DataMigrator
Staging data for analysis with WebFOCUS
 Graphical tool for designing
 Shares server technology and metadata with WebFOCUS.
 Access and join data across disparate systems
 Scalable parallel processing
 Data Movement
4
Change Data Capture (CDC)
 Large source databases, small batch window
 Want to only copy the changes
 Want near real-time updates
 Need some way to detect what has changed…
5
CDC
Major benefits
 Operational reporting
 Real-time query processing
 Increased system efficiency
 Availability of data by demand
 Predictive analytics
6
DataMigrator
CDC
Read the database log…
 Proprietary formats
 Every database is different
Data Adapter for database log tables
 No actual staging table required
 Synonym describes a view of database log for one table
7
DataMigrator CDC
Architecture
8
DataMigrator CDC
Metadata supported
Platforms and databases supported
 ORACLE on UNIX, Linux, Windows, and IBM zSeries
 DB2 UDB on UNIX, Linux, and Windows
 DB2 on IBM zSeries and iSeries
 VSAM on IBM zSeries
 MS SQL Server 2008 on Windows
9
DataMigrator CDC
Log records table
10
Data Management Console
Main menu
Workspace
Toolbars
Browser
Console
Log
11