IBM Software Agenda: ISUG 2013 13:00 - 13:05 Välkomna och agendaöversikt 13:05 - 13:50 Tony Curcio (produktchef för Information Server) - will talk about new features in IS 9.1. 13:50 - 14:00 Rast 14:00 - 14:45 Ian Baxter - from Data Assessments to Capital Assets 14:45 - 15:00 Kafferast 15:00 - 15:20 Folksam - delar med sig av sina erfarenheter av uppgradering av IS 15:20 - 16:10 Tony Curcio- IS roadmap and performance and tuning of IS + discussion topics/questions 16:10 - 16:20 Rast 16:20 - 17:00 Peter Bjelvert - CDC (live demo) 1 Discovering the Value of IBM InfoSphere Information Server © 2011 IBM Corporation An IBM Proof of Technology Value of IBM InfoSphere Information Server InfoSphere Change Data Capture © 2011 IBM Corporation IBM Software InfoSphere Change Data Capture Real-time changed data capture across database systems – Captures data from production systems without impacting performance – Applies data to target systems in real time Transforms database operations into Extensible Markup Language (XML) documents – Supports simple or composite XML transactions Creates audit trails for full data traceability Log-based Change Data Capture (CDC) technology Quick deployment through easy-to-use graphical interface 3 Discovering the Value of IBM InfoSphere Information Server Detects + Delivers Information Across Heterogeneous Data Stores in Real Time © 2011 IBM Corporation IBM Software Scope for today Identify and understand the benefits of using real-time data integration for: – Integrating data across a heterogeneous landscape – Reducing ETL batch cycles – Developing a near real-time business intelligence (BI) platform – Event enabling relational databases for service oriented architecture (SOA): enterprise application integration (EAI), enterprise service bus (ESB) Understand the basics of developing and operating InfoSphere Change Data Capture 4 © 2011 IBM Corporation IBM Software Flexible implementation Uni-directional Cascade Consolidation Local Bi-directional Two-way Distribution Multi-thread Remote capture © 2011 IBM Corporation IBM Software High level architecture Sources Java-based GUI for admin and monitoring Targets Oracle Database (Oracle, DB2, SQL Server, Teradata, etc.) SQL Server ETL (DataStage, others) TCP/IP DB2 JMS (MQ, others) Information Server Informix Journal Log Source Engine Redo/Archive Logs and Metadata Target Engine and Metadata (DataStage, QualityStage, etc.) Flat files Sybase Web Services © 2011 IBM Corporation IBM Software InfoSphere CDC DataStage/QualityStage integration Option 1: Database Staging • • • • InfoSphere CDC captures change made to source database InfoSphere CDC writes changes to a staging table. DataStage reads the changes from the staging table, transforms and cleans the data as needed Update target database and internal tracking with last bookmark processed Option 3: File-based Option 2: MQ-based integration • • • • InfoSphere CDC captures/collects changes made to remote database Captured changes written to MQ DataStage (via MQ connector) processes message and passes data off to downstream stages Updates written to target warehouse Option 4: Direct connect • • • • • InfoSphere CDC captures change made to source database InfoSphere CDC writes each transaction to a file DataStage reads the changes from the file Update target database with changes • • • InfoSphere CDC captures and collects changes made to source Captured changes passed to CDC for DataStage engine DataStage transaction aware stage processes transactions and passes data off to downstream stages Update target database with changed data © 2011 IBM Corporation IBM Software Modes of replication Continuous mirroring – Changes read from database log. – Apply change at the target as soon as it is generated at the source. – Replication job remains active waiting for next available log entry. Periodic mirroring – Changes read from database log. – Apply net changes on a scheduled basis. – Replication job ends when available log entries are processed. Refresh – File/table level operation. – Apply a snapshot version of source table. – Typically used to achieve initial synchronization of source and target table. © 2011 IBM Corporation IBM Software How do I … Continuously mirror between databases Summarize information using InfoSphere CDC DBA Integrate real time data feeds to an InfoSphere DataStage ETL process 9 Discovering the Value of IBM InfoSphere Information Server © 2011 IBM Corporation