BI Applications Integration with ODI and
GoldenGate
Narasimha Rao Madhuvarsu L V
Julian Troake
Sr. Principal Architect
Apps Associates LLC
Marketing Director
Apps Associates LLC
July 22, 2014
© Copyright 2014. Apps Associates LLC.
1
Confidentiality Statement
The content of this document is proprietary, confidential information pertaining to
Apps Associates’ products, services, solutions and methods. Information herein is
intended for use by the client or prospective client only and must not be shared
with any third party without consent from Apps Associates.
For any questions with this proposal, please contact
Julian Troake
Email: julian.troake@appsassociates.com
Phone: (978) 399-0230
© Copyright 2014. Apps Associates LLC.
2
Agenda
• Introduction
• Customer Benefits
–
–
–
–
–
Infrastructural
TCO
Productivity
Additional Content
Data Lineage
• BI Apps 7.9.x vs. 11g
• ODI BI Apps Architecture
• Oracle Data Integrator
• Licensing and Supported Platforms
• Migration Options from 7.9.x
Versions
• Real-Time Data Refresh Using
GoldenGate
• Demo
– Configuration Manager
– Functional Setup Manager
– Web-Based ODI Console
© Copyright 2014. Apps Associates LLC.
3
Introduction
•
•
•
•
Most significant BI Applications release
Completely re-architected solution
Expansion of content and new products
Released on the latest version of OBIEE 11.1.1.7
© Copyright 2014. Apps Associates LLC.
4
Customer Benefits
• Leverages the database tier power for ELT
• No need of separate ETL tier – significant cost reduction
• Number of new out-of-the-box tools to increase productivity and drive
down TCO
– Configuration Manager
– Functional Setup Manager
• Additional modules and content expansion
• Reduced functional configuration time
• Complete data lineage from source to analysis
© Copyright 2014. Apps Associates LLC.
5
Customer Benefits
• Integrated FMW security across components
• Easy near real time incremental refresh of data warehouse
© Copyright 2014. Apps Associates LLC.
6
BI Applications 11g Features Over 7.9.x
•
•
•
•
•
•
Significant release with multiple enhancements
Additional content and new products
New architecture leveraging the power of ODI
Content built on latest version of OBIEE
Tools to increase productivity and drive down TCO
Near real time option for customers that have significant ETL time pressures
© Copyright 2014. Apps Associates LLC.
7
New Features
© Copyright 2014. Apps Associates LLC.
8
New Content in BI Apps 11g Over 7.9.x
•
Financials
– Commitment Control & Public Sector Financial / Budget Analysis (EBS & PSFT)
– Fixed Assets (EBS & PSFT)
•
HR
– Time & Labor (EBS & PSFT)
– Global Payroll (PSFT)
– Transfers (EBS & PSFT)
•
Projects
–
–
–
–
Resource Management (EBS & PSFT)
Cross Charge (EBS & PSFT)
Forecasting Enhancements & Commitments (PSFT)
GL Reconciliation (EBS & PSFT)
© Copyright 2014. Apps Associates LLC.
9
New Content in BI Apps 11g Over 7.9.x
•
CRM
‒
‒
•
Procurement & Spend
‒
‒
•
Costing
Inventory Cycle Count and Other Enhancements
Student Information Analytics
‒
•
Sourcing Analytics
Enhancements to Change Orders and Agreements
Supply chain & Order Management
‒
‒
•
Service Analytics Enhancements (EBS)
Price Analytics (EBS)
Admissions, Recruiting, Records, partial Financials (PSFT)
Indirect Spend Planning
© Copyright 2014. Apps Associates LLC.
10
Extended Connectivity Over 7.9.x
• Application Adapters for SAP ERP and
SAP BW
• Application Adapters for Endeca,
Hadoop
• Oracle OLAP
• Hyperion Planning, Financial
Management and Essbase
• Real-Time CDC with GoldenGate
• Oracle DB multi-table insert
• Optimizations for IBM DB2, Microsoft
SQL Server, Teradata, Netezza
© Copyright 2014. Apps Associates LLC.
11
Bulk Data Processing & Data Transformation
BI Apps 11.1.1.7.1 supports more source systems over 7.9.6.4
© Copyright 2014. Apps Associates LLC.
12
ODI BI Apps Architecture
© Copyright 2014. Apps Associates LLC.
13
ETL
• BI Apps 7.9.6.4 with Informatica
• BI Applications 11.1.1.7.1 with Oracle Data Integrator and GoldenGate
© Copyright 2014. Apps Associates LLC.
14
Data Loading
The Key to Improved Performance and Reduced Costs
E-LT provides flexible architecture for
optimized performance
Benefits
•
Leverage set-based transformations
•
Improved performance for loading, no
network hop
•
Takes advantage of existing hardware
© Copyright 2014. Apps Associates LLC.
15
ETL Architecture
Informatica
•
•
•
•
•
Is an ETL tool (Extract, Transform, Load)
Has dedicated ETL engine
Transformation is the core part of ETL
Integration service handles the
transformation part, resulting in better
performance
File based transformation operations
© Copyright 2014. Apps Associates LLC.
16
ETL Architecture
ODI
•
•
•
•
Is an ELT tool (Extract, Load, Transform)
Does not have dedicated ETL engine
Relies on database capabilities of the source / target database i.e. first loads the data in
some staging tables in the target database and later inserts / updates the data into the
final target tables based on the data transformation has to perform
Performance is primarily based on Source and Target Tables and Database
© Copyright 2014. Apps Associates LLC.
17
ETL Architecture
•
•
•
•
•
•
In-database E-L-T Transformation vs. E-T-L.
Best in class performance, scalability, availability
Lightweight deployment for lower TCO
Faster time-to-value through declarative design
Heterogeneous, open and standards-based
Set based transformation
© Copyright 2014. Apps Associates LLC.
18
Components
Informatica
© Copyright 2014. Apps Associates LLC.
19
Components
ODI
© Copyright 2014. Apps Associates LLC.
20
GUI
7.9.6.4
11.1.1.7.1
Connecting to the ETL Repository
We need to have client tool installed in the
machine to access repository
Connecting to the ETL Repository
No separate Client tools is involved. We can
connect to repositories using ODI console
or by web based URL
ETL Repositories
It has only one repository, so we have one
set of connection entries
ETL Repositories
We have two Repositories. Master and
Work Repositories. So we need two
Independent connection entries
Cost
ODI is cost effective compared to
Informatica
© Copyright 2014. Apps Associates LLC.
21
GUI
Hardware
Informatica tool utilize its own engine to
implement the ETL process. So investment
in additional hardware to implement the
tool’s ETL engine.
Hardware
Utilizes existing hardware. ODI can run on
the same hardware as the database engine
underpinning the data warehouse, using
the existing hardware deployed.
© Copyright 2014. Apps Associates LLC.
22
Implementation
Domain Files
We need to configure manually
Domain Files
No need to configure Domain files. It is
automatically configured by using
Configuration Manager.
Time
It takes more time for configurations
Time
It takes less time for configurations
ETL Customization
In order to load data to custom column we
need to edit the Mapping
ETL Customization
In order to load data to custom column we
need to edit the interface
ETL Troubleshooting
Features like backtracking, dependencies
and debugger
ETL Troubleshooting
Features like Simulation to debug
© Copyright 2014. Apps Associates LLC.
23
Declarative Design
Improved Developer Productivity and Lower Maintenance Costs
Informatica ETL Design
• Developer must define every step of Complex ETL
Flow Logic
• And significant development and maintenance
efforts
ODI Declarative Design
• Simplifies the number of steps
• Automatically generates the Data Flow whatever
the sources and target DB
Benefits
• Reduces the learning curve
• Shorter implementation times
• Streamline access to non-IT pros
© Copyright 2014. Apps Associates LLC.
24
Benchmarking
© Copyright 2014. Apps Associates LLC.
25
Tools for Accelerating Deployment
BI Applications 7.9.6.4
•
DAC
– Another tool to install
BI Applications 11.1.1.7.1
•
Configuration Manager
– Administrative UI to manage system configuration for BI Applications
•
Functional Setup Manager
– Administrative UI to track and manage implementation projects and functional setup steps
© Copyright 2014. Apps Associates LLC.
26
BI Applications Configuration Manager
A centralized (thin client/web application)
console to
– Simplify configuration process
– Minimize manual setups and
configurations
– Generate list of necessary configurations
based on BI Application being configured
and user selections
– Provide check lists and validations of all
necessary tasks
– Reduce dependency on documentation
– Configuration migration capabilities
© Copyright 2014. Apps Associates LLC.
27
Edit Dialog
© Copyright 2014. Apps Associates LLC.
28
Functional Setup Manager
•
•
•
•
•
•
Domains ETL execution to extract
configuration data from source
Ability to track configuration progress
for project management
Enable / disable a functional area
from a module
Ability to create load plans with
extract only
Define, generate, execute and
monitor load plan
Scheduling for load plan for data
refresh
© Copyright 2014. Apps Associates LLC.
29
BI Applications OLTP Coverage
© Copyright 2014. Apps Associates LLC.
30
Migration Path
• No formal migration path from 7.9.x to 11g
• Ideal for implementations with minimal customizations
• Upon implementation of BI Apps 11g, manually migrate the customizations on a
case by case basis as needed
© Copyright 2014. Apps Associates LLC.
31
Enhanced ETL Architecture Using GoldenGate
Optional Feature for 11g
Challenge:
Customers with geographically distributed source systems are increasingly being challenged
by rapidly expanding data sizes and shorter ETL windows
Solution:
Optimize ETL load and reduce impact on OLTP system leveraging the strengths of GoldenGate
– Completely prepackaged solution
– Creation of Source Dependent Data Store (SDS)
– Ability to complete all extraction tasks while in source system availability window
© Copyright 2014. Apps Associates LLC.
32
Real-Time Data Refresh Using GoldenGate
•
•
•
•
•
•
•
Built in integration with GoldenGate
No need for batch load windows
ODS/SDS near real time refresh from distributed source databases
Ability to add/change indexes and views on SDS
Source for real time reporting needs
Recommended for customers with pressing ETL times
Suitable for 24 x 7 deployments
© Copyright 2014. Apps Associates LLC.
33
Demo
• Configuration Manager
• Functional Setup Manager
• ODI Console
© Copyright 2014. Apps Associates LLC.
34
Why ODI BI Apps?
Faster
– Fastest E-LT Bulk/Batch Performance
– Faster Real Time integration (sub-second) with CDC, Replication, and SOA
– Faster Project Setup, Design and Delivery
Simpler
–
–
–
–
Simpler Setup, Configuration, Management, and Monitoring
Simpler way to do Mapping using Declarative SQL Interfaces
Simpler Deployment with Fewer Hardware Devices
Simpler extensibility with Knowledge Module code templates
© Copyright 2014. Apps Associates LLC.
35
Why ODI BI Apps?
Saves Money (Lower TCO, Higher ROI)
– Less Hardware & Energy Costs with E-L-T Architecture
– Less Time spent on Unnecessary ETL Mappings, Scripting, and Training
– Less Integration Overhead Integrating with Applications, SOA, and Management
© Copyright 2014. Apps Associates LLC.
36
Connect with Us
Web: www.appsassociates.com
Email: narasimha.mlv@appsassociates.com | julian.troake@appsassociates.com
YouTube: www.youtube.com/user/AppsAssociates
LinkedIn: www.us.linkedin.com/company/Apps-Associates
Twitter: @AppsAssociates
Facebook: www.facebook.com/AppsAssociatesGlobal
Google+: www.plus.google.com/+AppsAssociatesGlobal/
© Copyright 2014. Apps Associates LLC.
38
Thank You!