OBIEE Architecture Prerequisites * • What is Business Intelligence? • What are BI needs and challenges? • What is Data Warehousing? • What are the traditional ways to organize Data? • What is the difference between Transactional and Analytical Systems? • What is a Dimension / Fact / Star Schema? • What are various available BI tools in the industry? • * Should have covered by E0 and E1 levels 14 March 2016 OBIEE - Unified Business Intelligence Infrastructure Interactive Reporting & Ad-hoc Dashboards Publishing Analysis Proactive Disconnected MS Office Plug-in Detection Analytics and Alerts Web Services Simplified Business Model and Abstraction Layer Oracle Intelligent Caching Services BI Server Multidimensional Calculation and Integration Engine Intelligent Request Generation and Optimized Data Access Services OLTP & ODS Data Warehouse SAP, Oracle Files Systems Data Mart PeopleSoft, Siebel, Excel Custom Apps XML Advantages: Consolidate and standardize BI tools Seamless user experience across products Unified metadata and shared services BusinessMulti-Dimensional Process Sources -3- 14 March 2016 Oracle BI EE Architecture Web Server SAW Bridge (J2EE/ISAPI) (IIS, Tomcat, Websphere, iPlanet) Oracle BI Web TCP/IP (SSL) Web Catalog Service SOAP Web Services, XML and URL Interface Oracle Interactive Dashboards Oracle Delivers Server Agent Execution Logic Device Adaptive Content Oracle Answers User Profiling, Security and Session Mngmt Scheduling/Event Services TCP/IP (SSL) XML, HTML, XLS, PDF, TXT over HTTP/HTTPS Cache Services (Web) & Connection Mngmt XML Framewor k Session Management Query Govern. Custom Authenticator Cache Services Logical Request Generation Navigator Multi-Pass / Sub-Request Logic Fragmentation Optimization Aggregate Navigator Optimized Query Rewrites Execution Engine System / Perf MonitoringMetadata Interchange Load Balancer Security Services DB Authentication External Applications and Portals Oracle BI Administration Logical SQL ODBC/JDBC (Logical Business Model) Intelligent Request Generation Externalized Authentication LDAP Javascript for Usability & Interactivity ODBC over TCP/IP (SSL) Oracle BI Server Oracle BI Cluster Controller HTML, SOAP over HTTP/HTTPS Web Browser Metadata Management Services Multi-User Development Services Metadata Documentation Services Server Management Services Data Source Adapters ODBC, CLI, OCI, XML, MDX Analytical and Operational Data Sources 14 March 2016 Oracle BI EE Architecture continued… Web Server SAW Bridge (J2EE/ISAPI) (IIS, Tomcat, Websphere, iPlanet) Oracle BI Web TCP/IP (SSL) Web Catalog Service SOAP Web Services, XML and URL Interface Oracle Interactive Dashboards Oracle Delivers Server Agent Execution Logic Device Adaptive Content Oracle Answers User Profiling, Security and Session Mngmt Scheduling/Event Services TCP/IP (SSL) XML, HTML, XLS, PDF, TXT over HTTP/HTTPS Cache Services (Web) & Connection Mngmt XML Framewor k Session Management Query Government Custom Authenticator Cache Services Logical Request Generation Navigator Multi-Pass / Sub-Request Logic Fragmentation Optimization Aggregate Navigator Optimized Query Rewrites Execution Engine System / Perf MonitoringMetadata Interchange Load Balancer Security Services DB Authentication External Applications and Portals Oracle BI Administration Logical SQL ODBC/JDBC (Logical Business Model) Intelligent Request Generation Externalized Authentication LDAP Javascript for Usability & Interactivity ODBC over TCP/IP (SSL) Oracle BI Server Oracle BI Cluster Controller HTML, SOAP over HTTP/HTTPS Web Browser Metadata Management Services Multi-User Development Services Metadata Documentation Services Server Management Services Data Source Adapters ODBC, CLI, OCI, XML, MDX Analytical and Operational Data Sources 14 March 2016 Oracle BI EE Architecture Web Server SAW Bridge (J2EE/ISAPI) (IIS, Tomcat, Websphere, iPlanet) Oracle BI Web TCP/IP (SSL) Web Catalog Service SOAP Web Services, XML and URL Interface Oracle Interactive Dashboards Oracle Delivers Server Agent Execution Logic Device Adaptive Content Oracle Answers User Profiling, Security and Session Mngmt Scheduling/Event Services TCP/IP (SSL) XML, HTML, XLS, PDF, TXT over HTTP/HTTPS Cache Services (Web) & Connection Mngmt XML Framewor k Session Management Query Govern. Custom Authenticator Cache Services Logical Request Generation Navigator Multi-Pass / Sub-Request Logic Fragmentation Optimization Aggregate Navigator Optimized Query Rewrites Execution Engine System / Perf MonitoringMetadata Interchange Load Balancer Security Services DB Authentication External Applications and Portals Oracle BI Administration Logical SQL ODBC/JDBC (Logical Business Model) Intelligent Request Generation Externalized Authentication LDAP Javascript for Usability & Interactivity ODBC over TCP/IP (SSL) Oracle BI Server Oracle BI Cluster Controller HTML, SOAP over HTTP/HTTPS Web Browser Metadata Management Services Multi-User Development Services Metadata Documentation Services Server Management Services Data Source Adapters ODBC, CLI, OCI, XML, MDX Analytical and Operational Data Sources 14 March 2016 Oracle BI Server Simplified Logical Model The Oracle BI server presents as a logically modeled database enabling the Common Enterprise Information Model. This provides powerful calculation, computation and federation capabilities to 3rd party tools as well as our own. 14 March 2016 Oracle BI EE Architecture Web Server (IIS, Tomcat, Websphere, iPlanet) TCP/IP (SSL) Oracle BI Web Intelligent Request Generation SOAP Web Services, XML and URL Interface Oracle Delivers Server Integration of Real time and Scheduling/Event Services warehouse Data Agent Execution Logic Device Adaptive Content TCP/IP (SSL) Oracle Interactive Dashboards Web Browser SAW Bridge (J2EE/ISAPI) Web Catalog Service Oracle Answers User Profiling, Security and Session Mngmt XML, HTML, XLS, PDF, TXT over HTTP/HTTPS XML Framework ODBC over TCP/IP (SSL) Oracle BI Server Query Govern. Security Services Authentication LDAP Function to use appropriate data DB Authentication sources/Compensation Custom Authenticator Cache Services Navigator Multi-Pass / Sub-Request Logic Fragmentation Optimization Aggregate Navigator Optimized Query Rewrites Execution Engine Metadata Interchange Session Management Intelligent Request Generation System / Perf Monitoring Load Balancer Logical Request Generation Regardless ofExternalized Schema Oracle BI Administration Logical SQL ODBC/JDBC (Logical Business Model) Multiple sources Optimized SQL generation External Applications and Portals Cache Services (Web) & Connection Mngmt Integration into Enterprise Portals Oracle BI Reads in system catalog Cluster Controller HTML, SOAP over HTTP/HTTPS Javascript for Usability & Interactivity Metadata Management Services Multi-User DevelopmentDB2 Services Supply Metadata Documentation Services Chain DM Server Management Services Teradata OLAP Oracle ERP. XML Data Source Excel SpreadSheets SQL Server Acxiom Data Source Adapters ODBC, CLI, OCI, XML, MDX Analytical and Operational Data Sources Siebel 14 March 2016 Operational Oracle BI Server Siebel Analytics Server Oracle BI Server Multi-source tuning and load balancing Parallel Clustering Services Execution Engine Intelligent Parallelmulti-level Query Execution Caching Engine High Intelligent Multi-Level Caching Services performance Siebel Server execution Scheduling Scheduling Services (Batch and/or Event-Driven) Services (Batch and/or Event-Driven) Seamless Data Mining Services aggregate and fragment navigation Common Enterprise Information Model Metadata Services Simplified business model view and Open Intelligent Interface Business calculation & analytic engine – Without managed data store Revolutionary request generation and optimized data source access Insight from largest data warehouses and across data sources, systems – Analytical, Operational, Transaction, External – Relational, MDX, Host, XML, Other Rapid implementation/customization and extensible architecture Market-leading scalability, availability, reliability, performance and TCO Multidimensional Calculation Engine Aggregation and Integration Services Intelligent Request Generation and Optimized Data Access Services 14 March 2016 Oracle BI Server Siebel Analytics Server Oracle BI Server Multi-source tuning and load balancing Parallel Clustering Services Execution Engine Intelligent Parallelmulti-level Query Execution Caching Engine High Intelligent Multi-Level Caching Services performance Siebel Server execution Scheduling Scheduling Services (Batch and/or Event-Driven) Services (Batch and/or Event-Driven) Seamless Data Mining Services aggregate and fragment navigation Common Metadata • Physical to logical business model • “Roadmap to data” Historical data Common Enterprise Information Model Metadata Services Real-time data Inventory data Multidimensional Calculation Engine Aggregation and Integration Services Intelligent Request Generation and Optimized Data Access Services 14 March 2016 Oracle BI Server Siebel Analytics Server Oracle BI Server Multi-source tuning and load balancing Parallel Clustering Services Execution Engine Intelligent Parallelmulti-level Query Execution Caching Engine High Intelligent Multi-Level Caching Services performance Siebel Server execution Scheduling Scheduling Services (Batch and/or Event-Driven) Services (Batch and/or Event-Driven) Seamless Data Mining Services aggregate and fragment navigation Calc & Integration Engine • Function ship to appropriate data sources/Compensation • Optimized performance • SQL < SQL + Oracle BI Server Common Enterprise Information Model Metadata Services • Time Series, Level based Measures Multidimensional Calculation Engine Aggregation and Integration Services Intelligent Request Generation and Optimized Data Access Services 14 March 2016 Oracle BI Server Siebel Analytics Server Oracle BI Server Multi-source tuning and load balancing Parallel Clustering Services Execution Engine Intelligent Parallelmulti-level Query Execution Caching Engine High Intelligent Multi-Level Caching Services performance Siebel Server execution Scheduling Scheduling Services (Batch and/or Event-Driven) Services (Batch and/or Event-Driven) Seamless Data Mining Services aggregate and fragment navigation Common Enterprise Information Model Metadata Services Intelligent Request Generation • Optimized SQL generation • e.g., “Show me sales through today for my highest value customer. Assure sufficient inventory.” DM/ DW Historical sales Multidimensional Calculation Engine Aggregation and Integration Services Intelligent Request Generation and Optimized Data Access Services ODS Today’s sales Rel. to available inventory Inv. System 14 March 2016 Sample Request Processing 1. 2. 3. 4. 5. 6. User views a dashboard or submits an Answers request The OBI Presentation Server makes a request to the OBI Server to retrieve the requested data The OBI Server using the .rpd file, optimizes functions to request the data from the data sources The OBI Server receives the data from the data sources and processes as necessary The OBI Server passes the data to the OBI Presentation Server The OBI Presentation Server formats the data and sends it to the client 1 Clients 6 OBI Presentation Server 2 3 OBI Server 5 Data Sources 4 14 March 2016 A Day in the Life of a Query 14 March 2016 A Day in the Life of a Query A logical request comes in asking for Brand, Closed Revenue (GL) Service Requests (Call Center) Share of Revenue (Derivation) 14 March 2016 A Day in the Life of a Query Oracle BI Server Cache The Server will check to see if this request can be fulfilled via a prior request using Server Cache. This is an on-demand intelligent shareable and secure cache that can support: Subsets, Aggregations and Derivations 14 March 2016 A Day in the Life of a Query Navigator If it is the request is cannot be fulfilled by cache then the server will intelligently process the request 14 March 2016 A Day in the Life of a Query Multi-Pass/Sub-Request Logic Does this analysis require sophisticated analysis such as an OLAP calculation? [Revenue Share] The Server will determine the best possible way to provide this calculation/computation 14 March 2016 A Day in the Life of a Query Fragmentation Optimization Does this request span across partitions or silos of data? [Closed Revenue and Service Requests] The server will determine based on the request if it should navigate to both or only one. It will automatically resolve fan traps. 14 March 2016 A Day in the Life of a Query Aggregate Navigator Is there an aggregate that can better satisfy this request versus hitting the detail? {Brand Summary Table} The Server will apply approprate summary redirection to provide the quickest response. 14 March 2016 A Day in the Life of a Query Optimized Query Rewrites What can be function-shipped down to the database versus performed /supplemented by the computation capabilities of the Server. The server will provide a consistent set of functionality to the user regardless of underlying datasource. 14 March 2016 A Day in the Life of a Query Cache Services The request once executed will now be available to other users as a cache entry. 14 March 2016 Oracle BI Server System Services System Services Clustering: Add stacks as needed in a share nothing clustered environment. Session Management and Governance: Query throttling via connection pools and authorization Security Services: Integration with OID, LDAP with sophisticated data driven personalization mechanisms. 14 March 2016 High Availability Deployment Replicated Repository Stack 1 Web Server Web Catalog Scheduler Process Oracle Analytics Web Load Balancer Application DW Web Server Cluster Controller Stack 2 Users Oracle BI Server Scheduler Database Single Sign-on Server LDAP Server Oracle Analytics Web OAW Replication Agent Web Catalog Oracle BI Server Other Mart/DW Master Repository Administration Tool 14 March 2016 OBIEE Clustering OBIEE Clustering Components • Cluster Controller – Primary Cluster Controller – Secondary Cluster Controller • Clustered BI Servers • Master BI Server • BI Scheduler • Cluster Manager Failover Mechanisms Cluster Aware Cache 14 March 2016 Webcat Replication • Scenario: – Instance 1 – Master Instance Sharing Application – Instance 2, Instance 3 – Secondary Clustered Instances exposed to Users • ‘Sawrepaj’ setup for the replication on both Windows and Unix environments for performing replication as below /shared: Instance1 to Instance2 /shared: Instance1 to Instance3 /users: Instance2 to Instance3 /users: Instance3 to Instance2 • Edit instanceconfig.xml to enable Replication • Maintain Log Files of Replication 14 March 2016