0 SAP NetWeaver 7.3 – What's new and how to upgrade Dr. Berg Comerit Inc. © 2011 Wellesley Information Services. All rights reserved. In This Session … This session explores the new features of SAP NetWeaver 7.3 and helps you gauge whether an upgrade makes sense for your organization. Learn how faster data loads can be accomplished through improved data activation, disabled delta consistency check for write-optimized DataStore objects and options to fetch only the last request View the new automated partitioning of InfoProviders using pre-delivered step-by-step Wizards, and learn how to monitor database usage and performance in the improved Administration Cockpit. Explore how SAP NetWeaver BW 7.3 improves hierarchy handling through integration into process flows, and allows for the loading of hierarchies from flat files using DataSources. Examine the new transformation options to support semantic groupings, along with the currency and unit conversions now available for DSOs and InfoSources. Gain insight into the technical and human resources required to upgrade to this new release, best practices for scoping, and potential challenges along the way. View a sample upgrade plan to reference during your own SAP NetWeaver BW 7.3 initiative. 2 What We’ll Cover … • • • • • • • • SAP BW 7.3 Overview New Administrative Cockpit Capabilities The new Semantic partition (SPO) Options Faster Data Load Options Front-end and Security Benefits New in-Memory Possibilities with BW 7.3 and BWA 7.2 Planning and Executing the Upgrade Wrap-up 3 HANA AND BW BO Explorer gggg 4 HANA AND BW BO Explorer gggg 5 HANA AND BW BO Explorer gggg 6 HANA AND BW BO Explorer gggg 7 Enterprise Data Warehousing - Performance & Scalability Semantic Partitioned Object (SPO) as a single point of entry for creation and easy administration of the semantic partitioned data model Wizard based partitioning of InfoCubes and DataStore objects along criteria such as calendar year or region to manage high volume data across different time zones. Easy set-up of multiple time-based partitions with a minimum of manual effort Reduces TCO to define and manage scalable data models also when it comes to re-model the partitions (because only the Reference structure needs to be changed) Automated generation of corresponding modeling objects like Data Transfer Processes (including respective filter criteria depending on the data target) and Transformations as well as a process chain. Good Query performance by leveraging SAP NetWeaver BW Accelerator as well as partition pruning when accessing partitioned InfoCubes Semantic Partitioned Object can be embedded into a MultiProvider Integration of Data Archiving /Near Line Storage to archive SPO Define partitions by customer coding (Business Add-Ins) e.g. flexibly apply rolling time window scenarios to partitions gggg 8 Accelerated data loads for DataStore Objects and master data • • • • • • • • • • • • • • • • • • • • DataStore objects Partitioning: Support database partitioning by time characteristics Remodeling for DataStore objects Performance enhancements: Activation is changed from single lookups to package fetch of active table Runtime option “Unique data records only” prevents look-ups during activation, e.g. in case of initial loads Performance gain for package fetch (lab results) Avg. 20 – 40% improvement, Max. improvement measured – 2.5x faster Varies by data profile (#inserts/updates/deletes) and database platform New rule-type for Transformations: ‘Read from DataStore’ for an optimized data look-up to DataStore objects in data bse and Near-Line Storage Master data Optimized delta load for master data due to package fetch instead of single look-ups Optimizes Init-load runtime option “insert only” prevents look-ups during activation Near-Line Storage (NLS) Integration into Data Mart Layer (Support of MultiProviders) Enable NLS in Query properties from BEx Query Designer (not necessary to do this in RSRT anymore) Selections on navigational attributes will be passed to NLS NLS can be attached to Semantic Partitioned Objects gggg 9 TeraData • • • • • • • • • • • • • • SAP NetWeaver BW running on the Teradata database Consolidates data on one database platform, while lowering cost of ownership Seamlessly integrate SAP content-rich applications, leveraging SAP NetWeaver BW and the performance of SAP NetWeaver BW Accelerator with the power and scalability of Teradata Integrate Teradata into SAP support infrastructure Simplify data integration strategy for SAP and non-SAP data Reduce complexity and time needed to integrate data for BW and Teradata Increase visibility to detailed data for richer business insight and faster decision making gggg 10 Graphical UI for Data Flow Modeling empowers best practice modeling Graphical Data Flow Modeling Easy design of complex data flows on a meta level End-to-end modeling from DataSources to Open Hub destinations and from InfoPackages to DTPs Supports application specific views via data flows as new meta object Top-down approach - from graphical objects to detailed technical settings Copy from existing or new data flow templates Fully integrated into the Data Warehousing Workbench Definition of customer template data flows enables standardized modeling of data flows lower Total Cost of Development (TCD) and subsequently lower Total Cost of Ownership (TCO) gggg 11 Graphical UI for Data Flow Modeling empowers best practice modeling Predefined Best practice Data Flow Templates for Ready-to-run scenarios Templates shipped by SAP that can be reused and/or adopted to apply best practice data flow designs and patterns (e.g. Templates for LSA reference architecture) • • • • • • • • • Data Flow Wizard Wizard based data flow modeling and generation of all related data flow objects incl. InfoObjects, if necessary Data Flow copy tool Copy an existing SAP NetWeaver BW 7.x data flow, i.e. DataSources, data targets, and Transformations leveraging a wizard-like user interface. Complete copy of an existing process chain (incl. related process variants and data flow objects) Possibility to copy a data flow to a source system which is only available in the productive system ggggsystem in the development environment. 12 landscape by assigning a dummy source Graphical UI for Data Flow Modeling empowers best practice modeling • • • • • Data Flow migration tool (BW 3.x BW 7.x) Migration of data flows with BW 3.x objects (InfoSource, DataSource, transfer rules, update rules) including adaption of InfoPackage, process variants, process chains, VirtualProviders (‘Remote Cubes‘) Workbench-like UI for selecting data flows and objects to be migrated Migration can be repeated/reversed as often as required gggg 13 Simplified system installation and setup via wizard based system configuration • • • • • • • • • • • • • • • • • Wizard-based system Configuration Ensuring a proper and smooth installation, and technical configuration for the set-up of a BW system to a major extent. Both ABAP and Java Stack configuration is possible for the new installation of NW 7.3 New Monitors in BW Administration Cockpit Database usage in SAP NetWeaver BW Display the usage of database space (e.g. in MB by InfoProviders). Enhanced Usability through Xcelsius Integration of monitors Further Enhancements of the technical content OLAP cache and SAP NetWeaver BW Accelerator usage Queries which display the OLAP usage, Cache memory and SAP NetWeaver BW Accelerator status. RDA Monitoring Display the status of usage and free capacity of RDA daemons in the system Integration of technical content into Solution Manager, thereby offering the BW monitoring solution through a central system monitoring solution Further enhancements: e.g. query usage, new data flow technical content for monitoring trend gggg 14 HANA AND BW BO Explorer gggg 15 Enterprise Data Warehousing Real-Time Business Intelligence • • • • • • • • • • • • • HybridProvider Consists of a DataStore object and a InfoCube with automatically generated data flow in between Combines mass data with latest delta information at query runtime DSO object can be connected to a realtime data acquisition DataSource/DTP If the DataSource can provide appropriate delta information in direct access mode a VirtualProvider can be used instead of the DSO Enhancements Real -Time Data Acquisition Possibility to load master data with RDA Enhanced error handling and scalability (daemon can handle more DataSources more efficiently) gggg 16 Data Extraction • • • • • • • • • • • Generic Delta functionalities for further types of DataSources The possibility to derive a generic delta is now available for additional types of DataSources like: DB Connect, UD Connect, flat file and web service Automatic switch of InfoPackage modes from Init- to Delta Load There is no need to define Init- and Delta InfoPackages anymore. If a delta enabled InfoPackage is started the first time, it is executed as an initial load. New DataSource Adapter Type ‘Web Service Pull’ A new type of web-service-based DataSource can be created which pulls data from a 3rd party source system into PSA. Available for transactional data and master data (except hierarchies) Initially available for pilot customers and partners only (i.e. the function is there and can be activated quickly) gggg 17 Additional flexibility within data flow modeling • • • • • • • • • • • • • • • • • • • • Hierarchies Integration of hierarchies into process flow (DTP, Transformation) Remote hierarchies for direct access to hierarchies in the source system Loading hierarchies from flat file using the new DataSource and Transformation technology Data Transfer Process (DTP) Data Transfer Process supports data extraction from MultiProviders Option to only load the last request from a given source (available for full load DTPs) Data Transfer Process supports referential integritiy checks tor navigational attributes of the target Enhanced load performance by possibility to Re-package small data packages within a request to bigger packages Open Hub Service SAP NetWeaver BW data can be exported in XML format Possibility to change the format and length of BW data for export even into a non-SAP specific format Hierarchy extraction supported by Open Hub Transformation Semantic grouping possible in Transformations (in addition to semantic grouping in DTPs) Possibility to select the InfoObjects (fields) the user wants to use in a Start- / Endroutine Currency and unit conversion for DataStore object and InfoSource as target of a Transformation. Navigation attributes of InfoCubes/DataStore objects can be used as source fields in the Transformation and as filter/select options in the DTP Automated generation of a proposal by mapping fields of the DataSource to InfoObjects gggg 18 Enhanced monitoring and administration support for process chains • • • • • • • • General enhancements in process chain handling ABAP program for controlled suspension and re-starting of all process chains and RDA daemons during restart of the application server. (Name of program: RS_SYSTEM_SHUTDOWN) Enhanced transaction RSPCM for better process chain monitoring: Option to refresh the status of all chains or only the status of the process chains currently running Saving the display configuration user dependently Deviation of start- and runtimes as new keyfigures with self-adopting thresholds. Overview of errors for failed process chain executions gggg 19 Enhanced functionalities for the Administrator • • • • • • • • • • • • • • • • • • Support of complex development landscapes Modeling of multi-target source system scenarios by: Creation of Dummy Source systems in development environment Developing all related source system dependent objects (DataSource, Infopackage etc.) Mapping of dummy source system to existing source systems in the target environment Multi source system InfoPackage transport Transporting a data staging scenario with automatic handling of InfoPackage assignment to more than one target source system like already available for DataSources, DTPs and Transformations Before Export Check Enhanced consistency check at the end of releasing the transport including checks on dependent objects which are not directly included in the transport request to prevent import errors in the target system (due to missing metadata objects) Data request archiving for DTP requests The table which holds all monitor entries for DTPs tends to grow very big over time. A new feature is available to archive this kind of data to speed up DTP monitor General search in Data Warehousing Workbench extended General search is extended to process chains, OpenHub destinations. Moreover TREX Search is leveraged for DataSources, Transformations, InfoSources and DTP‘s gggg 20 Enhanced functionalities for the Administrator Mass Change function for authorizations Option to select multiple analysis authorization objects and insert, copy, delete rows of value authorizations for all analysis authorizations in the worklist insert copy, delete hierarchy authorizations of all analysis authorizations in the worklist at the same time Adding users to multiple analysis authorizations Delete content of table holding warehouse management related statistics data The ABAP program RSDDSTAT_DATA_DELETE was enhanced to also be able to delete the content of table RSDDSTATWHM which is constantly growing over time (all entries up to a certain date) Version Management for Metadata objects Manage historic versions of metadata (display, create, restore, compare, delete) Supports modeling consistency, metadata model traceability and change management along the object lifecycle Integration of BW search into Enterprise Search Easy, realtime search with interactive navigations between object types (Both for backend and frontend BW object types). Actionable search with navigation to object in its corresponding transaction/application. gggg Embedded, TREX based search with multilingual support 21 New tool for structuring, testing and debugging of MDX Statements • • • • • • • • SAP BW offers with the query language MDX an open, generic interface for clients. Both query definition and its execution plan can become quite complex New tool (transaction: MDXTEST) with powerful debugging and editing functions to: Accelerate performance tuning and testing of MDX statements generated by SAP BusinessObjects BI clients Create MDX Statements independently with full access to the metadata objects of the underlying InfoCube Drag-and-Drop of MDX function snippets in editor gggg 22 Data load acceleration on IBM DB2 Optimized parallel activation of data in DSO objects for IBM DB2 using Database Partitioning Feature (DPF). Enhanced Multidimensional Clustering (MDC) Advisor in DBA Cockpit (with DB2 9.5.2 and higher) Generates proposals along time characteristics 0CALMONTH and 0FISCPER for better performance Evaluates broader range of MDC proposals (limited by maximum of 33% increase in table size) With DB2 9.5 and higher: InfoCube fact tables, DSO, PSA tables are created with compression switched on by default if DB2 storage optimization feature is used to reduce disk space for data needed. With DB2 9.7, indexes will also be compressed. With DB2 9.7: MDC switched on by default for PSA and PSA-like tables (e.g. DSO object tables). With MDC, deletion of requests in data targets is much faster gggg 23 nls • • • • • • • • • • • • • Near Line Storage Enhancements NLS Interface supported for write-optimized DataStore objects ADK Archiving supported Based on request ID Load date of request or creation date of request Semantic grouping NLS Interface extension for lookups A look up API supports access to NLS partitions of InfoProviders during Transformations. The API has to be called using ABAP routines. IBM DB2 for NLS DB2 Viper 9.5® - IBM certified for SAP BW 7.0 NLS Interface Takes full advantage of DB2 compression Fully exploits DB2‘s self managing capabilities gggg 24 admin Wizard based templates for system configuration to reduce TCO SAP NetWeaver BW initial Setup for the ABAP Stack Wizards for Business Suite 7 for faster Integration Enhanced Technical Content Installation reports for Initial Setup and XPRA. Automate configurations by providing CTC templates for BW Initial Setup, BW connectivity to other modules like SRM Flexible deletion of PSA/Change Log By using selection patterns Patterns support DataStore Object and InfoArea or DataSource and Source System Changed process types for flexible deletion of requests from PSA and Change Log by using selection patterns. Placeholders can be used for the fields DSOs, InfoArea, DataSource and source system. Disable delta consistency check for write-optimized DataStore objects Protects delta requests that have been already propagated per delta mode from deletion. Can be switched on/off – e.g. for write-optimized DataStore objects as gggg 25 initial staging layer Bwa 7.2 • Enhanced built-in analytical capabilities* • F4-Value help MultiProvider calculation handling Exception aggregation (min,max, avg, count distinct) Analytic indexes • Advanced features* • • • • • • • BWA based InfoCube Use DataStore Objects to create indexes Leverage SAP Business Suite data directly gggg 26 BWA • • • • • • • • • • • • • Optional persistency for InfoCube data in SAP NetWeaver BW Accelerator only Persists data of InfoCubes only in SAP NetWeaver BWA to: reduce data redundancy save disk space Increase data base performance by reducing system load E- and F- fact tables as well as dimension tables are indexed Master data will be persisted in both SAP NetWeaver BW and SAP NetWeaver BW Accelerator A normal Data Transfer Process can be used to load data directly into SAP NetWeaver BW Accelerator Data of a downstream DataStore object can be replicated into BWA w/o InfoCube database persistency gggg 27 Flexible modeling with APD & BWA in SAP NetWeaver BW • Introduction of Analytical Index and QueryProvider with SAP NetWeaver BW • Analytic Index (AI) Is a data container maintained in Analysis Process Designer whose data is stored in the BW Accelerator Analytic Index is exposed as InfoProvider to define Queries on it • • • • • QueryProvider Queries can be enabled as InfoProvider Supports mass data access from Queries in Analysis Process Designer scenarios gggg 28 Ad-hoc joins/unions of analytical indexes in SAP NetWeaver BWA • • • • • Composite Provider describes a union/join of analytical indices Lean Modeler tool is the Design-time environment to build Composite Providers Join/Union operation is processed on the fly by BWA For all other BI Clients CompositeProviders are exposed as standard SAP NetWeaver BW InfoProvider gggg 29 HANA AND BW BO Explorer gggg 30 HANA AND BW BO Explorer gggg 31 What We’ll Cover … • • • • • • • • SAP BW 7.3 Overview New Administrative Cockpit Capabilities The new Semantic partition (SPO) Options Faster Data Load Options Front-end and Security Benefits New in-Memory Possibilities with BW 7.3 and BWA 7.2 Planning and Executing the Upgrade Wrap-up 32 BO BO Explorer gggg 33 What We’ll Cover … • • • • • • • • SAP BW 7.3 Overview New Administrative Cockpit Capabilities The new Semantic partition (SPO) Options Faster Data Load Options Front-end and Security Benefits New in-Memory Possibilities with BW 7.3 and BWA 7.2 Planning and Executing the Upgrade Wrap-up 34 BO BO Explorer gggg 35 What We’ll Cover … • • • • • • • • SAP BW 7.3 Overview New Administrative Cockpit Capabilities The new Semantic partition (SPO) Options Faster Data Load Options Front-end and Security Benefits New in-Memory Possibilities with BW 7.3 and BWA 7.2 Planning and Executing the Upgrade Wrap-up 36 BO BO Explorer gggg 37 What We’ll Cover … • • • • • • • • SAP BW 7.3 Overview New Administrative Cockpit Capabilities The new Semantic partition (SPO) Options Faster Data Load Options Front-end and Security Benefits New in-Memory Possibilities with BW 7.3 and BWA 7.2 Planning and Executing the Upgrade Wrap-up 38 BO BO Explorer gggg 39 What We’ll Cover … • • • • • • • • SAP BW 7.3 Overview New Administrative Cockpit Capabilities The new Semantic partition (SPO) Options Faster Data Load Options Front-end and Security Benefits New in-Memory Possibilities with BW 7.3 and BWA 7.2 Planning and Executing the Upgrade Wrap-up 40 BO Explorer Overview BO Explorer (BOEx) has several ways in can connect to data sets: 1. External data may be indexed by the BO Data Services and stored on dedicated BW Accelerator (BWA) blades. 2. BW data may be indexed on BWA blades for fast in-memory processing 3. External data may also be accessed as 'nonaccelerated' via SQL universes and BOBJ XI 4. Excel spreadsheets may also be accessed Source: SAP Ag, 2010 Accelerated BOEx does not require BW. - You can accelerate all data sources 41 In Memory Processing - General Highlights - BWA 3. Queries are routed to BWA by the Analytical engine SAP BW BI Analytical Engine 2. Indexes copied in to RAM on blades InfoCubes 1. Indexing and compression stored on a file system DSOs 42 In Memory Processing - Creating Indexes from external data Using the Index Designer in Data Services, you can also index data from external data files and data bases. It is important to note that the BO indexes are on dedicated blades. 3. Queries are routed to BWA by the Analytical engine SAP BW BI Analytical Engine 2. Indexes copied in to RAM on blades InfoCubes For BWA you should always have one 'spare' blade for failover. If a blade fails, the system can reload the indexes from the BWA file system (i.e. IBM's GPFS). For BOEx blade, you can use only one blade. 1. Indexing and compression stored on a file system DSOs Business Object Data Services External data Data Integrator Index Designer Files Databases 43 BO BO Explorer gggg 44 What We’ll Cover … • • • • • • • • SAP BW 7.3 Overview New Administrative Cockpit Capabilities The new Semantic partition (SPO) Options Faster Data Load Options Front-end and Security Benefits New in-Memory Possibilities with BW 7.3 and BWA 7.2 Planning and Executing the Upgrade Wrap-up 45 BO BO Explorer gggg 46 What We’ll Cover … • • • • • • • • SAP BW 7.3 Overview New Administrative Cockpit Capabilities The new Semantic partition (SPO) Options Faster Data Load Options Front-end and Security Benefits New in-Memory Possibilities with BW 7.3 and BWA 7.2 Planning and Executing the Upgrade Wrap-up 47 BO BO Explorer gggg 48 Resources • BO Explorer Implementation Checklist by SAP http://tinyurl.com/32v5ycw • SAP BOEx Product Website http://www.sap.com/solutions/sapbusinessobjects/large/b usiness-intelligence/search-navigation/explorer/index.epx • SAP BOEx Collaboration Workspace https://cw.sdn.sap.com/cw/community/sap/sapbusinessob jectsexplorer • Inside SAP BusinessObjects Explorer - book SAP PRESS, ISBN:978-1-59229-340-7, Ingo Hilgefort, Hardcover, 315 pages 49 7 Key Points to Take Home • aa 50 Your Turn! How to contact me: Dr. Berg Bberg@ComeritInc.com 51 Disclaimer SAP, R/3, mySAP, mySAP.com, SAP NetWeaver®, Duet™®, PartnerEdge, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries all over the world. All other product and service names mentioned are the trademarks of their respective companies. Wellesley Information Services is neither owned nor controlled by SAP. 52