HANA Overview and Capabilities Dr. Bjarne Berg Why In-Memory Processing? Focus Technology 1990 2012 Improvement CPU 0.05 304.17 MIPS/$ MIPS/$ 6083x Memory 0.02 52.27 MB/$ MB/$ Addressable Memory 216 264 248x Network Speed 100 100 Mbps Gbps 1000 x Disk Data Transfer 5 620 MBPS MBPS 2614x 124x Source: 1990 numbers SAP AG, 2012 numbers, Dr. Berg Source: BI Survey of 534 BI professionals, InformationWeek, 2010 Disk speed is growing slower than all other hardware components, while the need for speed is increasing. 2 In Memory Processing — General Highlights — BWA 3. Queries are routed to BWA by the Analytical engine SAP BW BI Analytical Engine 2. Indexes copied in to RAM on blades InfoCubes 1. Indexing and compression stored on a file system DSOs BWA = SAP BW Accelerator SAP HANA — In Memory Options • SAP HANA is sold as an in-memory appliance. This means that both Software and Hardware are included from the vendors • Currently you can buy SAP HANA solutions from Cisco, Dell, Fujitsu, IBM, and Hewlett-Packard • SAP HANA currently indexes the data from a variety of sources, including ERP and BW and store the result on a dedicated server • The future of SAP HANA is to replace the databases of ERP and BW and run these on the in-memory platform Source SAP AG,2011 SAP HANA has the potential to radically change the way databases operate and make systems dramatically faster. The Different Editions of HANA Looking Inside SAP HANA — In-Memory Computing Engine (IMCE) AAAA Metadata Manager Authorization Transaction Manager Manager SQL Script SQL Parser Disk Storage Data Volumes Log Relational Engine -Row Store -Column Store Calculation Engine Session Manager MDX Volumes Load Controller BusinessObjects Data Services Replication Server Inside the Computing Engine of SAP HANA we have many different components that manage the access and storage of the data. This include MDX and SQL access, as well as Load Controller (LC) and the Replication Server. Row based index Row- vs. Column-Based Indexing (cont.) • As we can see, there are only 7 unique states and 3 unique customer classes in the data. This allows SAP HANA to compress this data set significantly • By including the Row ID in the column-based index in SAP HANA, the “ownership” of the values in the index can still be mapped back to the record Row ID Name 1 Jane Hansen 2 Olav Petersen 3 Peter Johnsen 4 Thomas Berg 5 John Beatty 6 Jim O'Brian 7 Jeff Pinolli 8 Carol VanZyck 9 Fredrick Davidson 10 Tone Leffler 11 Carol Hansen 12 Jim Petersen 13 Jeff Johnsen 14 Peter Berg 15 Thomas Beatty 16 John O'Brian 17 Olav Pinolli 18 Jane VanZyck 19 Tone Davidson 20 Fredrick Leffler State NC TX FL TX FL NC NY NY FL CA CA NY CA FL IN IN CA FL NC SC Class Gold Silver Platinum Gold Platinum Silver Platinum Platinum Gold Platinum Silver Gold Platinum Platinum Silver Gold Gold Platinum Silver Gold Birth date 8/7/1959 2/24/1963 1/1/1959 2/13/1981 12/26/1958 6/11/1977 5/9/1971 3/13/1969 9/8/1980 2/10/1955 9/9/1980 2/23/1974 3/10/1978 12/14/1981 10/25/1954 11/27/1970 10/1/1955 6/27/1960 11/19/1958 12/21/1973 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ Column-based indexes on fields with repeated values often leads to better compression ratios and thereby lower size of the indexes (as we can see, there are few values repeated in the rows). Income 71,927 35,633 144,077 85,087 123,456 76,506 73,503 68,987 100,600 105,943 112,096 41,080 118,481 50,900 78,304 38,809 157,105 151,067 63,169 65,628 SAP HANA — Virtual Marts and Applications • Virtual data marts and new applications were built that run on SAP NetWeaver BW, which is again enabled by SAP HANA in-memory processing Applications developed by SAP 1. Planning & consolidation 2. Customer revenue performance mgmt HANA (in-the works) ERP Database Virtual Data Marts Virtual Data Marts Virtual Data Marts Virtual Data Marts Applications Databases Files 3. Predictive segmentation & targeting 4. Trade promotion management 5. Merchandise & assortment planning 6. Sales & operations planning (SOP) 7. Demand signal repository 8. Profitability analysis 9. Dynamic cash management 10.Strategic workforce planning 11.Smart meter analytics (power companies) This provides much tighter integration with the source system (less data latency) and much faster query response time for high-volume analysis The Hardware – IBM Example Client Demo 11 SAP HANA — Loading the Application and Performance You can load the application based on the logs in the source system, ETLbased (Extract Transform and Load) loads, and SAP trigger-based replication Tool Purpose BusinessObjects Data Services 4.0 – ETL-based replication Sybase replication server & Load Controller – Log-based replication SAP Landscape Transformation (LT) – Trigger-based replication Log based replication is possible on IBM DB 2 LUW/UDB, MSFT SQL Server Enterprise Edition, Oracle Enterprise Edition, and Sybase ASE Some Reported SAP HANA Performance Achivements Compression Query speed improvements Project (data) Max Min Average Bank 1 : 6.3 521.6 258.8 369.5 HANA POC (SAP) 1 : 5.2 484.3 301.4 350.3 Opening HANA Admin Adding New System in HANA Adding New System in HANA Creating HANA system connection Setup HANA Security Authentication Changing a HANA password Creating HANA Security questions Creating HANA Security questions Your HANA System in the Navigator Searching for a table in HANA The table definition inside HANA All HANA tables Open a HANA table Browsing data in a HANA table Opening HANA Admin HANA memory usage Creating a New HANA Table Creating a New HANA Table Creating a New Products HANA Table Defining a new Sales HANA table Accessing Data Services to Load data to HANA Accessing Data Services to Load data to HANA Linking Data Services to HANA datastores Linking Data Services to HANA datastores Linking Data Services to HANA datastores Our new Data Services HANA repository Data Services HANA repository objects Importing HANA table definitions Importing HANA Customer table definition Importing HANA Sales table definition Linking data files to load to HANA Linking data files to load to HANA Defining file format for loading data to HANA Defining data file format for HANA data load Saving file formats Customer file for HANA data load Replicating Product file for HANA data load Replicated Product file for HANA dataload Replicating Sales file for HANA data load Replicated Sales file format loading data to HANA Create a Project for Data Services Create a Project for Data Services Create a Batch job for HANA data loads The new batch job for a HANA data load A new dataflow for HANA data load Making HANA tables the data target Creating data mapping to load data to HANA Creating data mapping to load data to HANA Detailed data mapping to load data to HANA Detailed data mapping to load data to HANA Execute a HANA data load Execute a HANA data load Execute a HANA data load HANA data load log Opening HANA Studio Opening HANA Studio Opening our Customer table in HANA Our Customer table in HANA What can you do with HANA and BO Explorer? The system looks at the data and formats it based on implied hierarchies (i.e., time, geography, customer) as well as measures. Users may navigate and change measures, graphs, and tables. New Calculations Any data panel can be sorted in many ways We can also add our own measures In our example we are adding the measure “Margin Per Unit” as total margin divided by “quantity sold” Measures used on any graph can be calculated “on-the-fly.” 72 HANA Optimized InfoCubes Data Store Objects (DSO) In HANA The DSO in HANA is a ‘closed’ object where you can do: • Index reads (snapshots) • Delta reads for updates • Activate data • Querying Read delta, between snapshot 1 and 2 Delta Index Index Read Main Index Activation PS! a table, an analytic or calculation view in a HANA schema can be accessed via a BW DataSource. This is based on ‘DB connect’ using a second DB connection to the underlying HANA DBMS. Insert Only Index History Index Source: T. Zurek, SAP AG Data Load 74 SAP HANA — Test Drive • You can see demos and do a test drive at: https://www.experiencesaphana.com This site contains a lot of great information and you can also try the Information Composer and see recorded demos. Register and Take a Free BI Test Drive with SAP HANA • You can register for a free test drive at: https://bi.ondemand.com/session/new You can also upload your own data and try the tool to see if it is something for your organization. There is even quick guides, videos, and wizards to get you started. 76 Questions and Answers Dr. Berg Bberg@Comerit.com