[DW] Power BI – Beyond the Basics Iman Eftekhari Sydney Business Intelligence User Group Nov 2014 Primary Sponsor www.varigence.com.au Varigence software provides clients with efficient methods for developing, managing, and using Microsoft business intelligence solutions. The software ecosystem rests on the foundation of Biml, or our home-grown Business Intelligence Markup Language. Sydney Business Intelligence User Group Business Intelligence Markup Language used to accelerate business intelligence development IDE for accelerated business intelligence solutions Excel addin that will make anyone using PowerPivot or cubes in Excel more productive Nov 2014 Sponsor(s) We just know Microsoft BI …and we know it well! www.agilebi.com.au Sydney Business Intelligence User Group Hilmax Solutions provides clients with easy to use business intelligence toolsets and solutions to extract critical and actionable insights from their business data. Our consultants are experts in business and technology solutions with focus on delivering business value. www.hilmax.com.au Nov 2014 Sponsor(s) SQL Tools is your source for Idera SQL Server tools sales & support in the APAC Region. Idera has SQL Server tools for: BI Monitoring Performance & Availability Backup & Maintenance Security, Auditing & Governance Administration Development Plus, Free Tools covering most functions. Email idera@sqltools.com.au for Special Trial Offers. Sydney Business Intelligence User Group Nov 2014 Abstract Power BI is a Microsoft's new self-service BI platform for both on-premise and cloud-based data. It enables business Power Users to make the most of their data by using the new data discovery, analysis and visualisation features in Excel and Office 365, in an easy to use environment that they are already familiar with. In this session we will go through the main features and capabilities of Power BI using an end-to-end scenario. We will also discuss best practices and tips along the way that will enable you to get the best out of this new Microsoft technology. Sydney Business Intelligence User Group Nov 2014 Sydney Business Intelligence User Group Power BI – Beyond the Basics Iman Eftekhari Agile BI Iman Eftekhari • • • • • BI Consultant and Agile Coach MCSE (BI), MCITP (BI), CSP, … Co-founder of Agile BI consulting Co-organiser of the SYBIS (Sydney BI Social) Group Worked on DW/BI projects with more than 20 clients including banks, health, and the public sector in VIC, NSW and QLD Email iman.eftekhari@agilebi.com.au Blog http://iman77.blogspot.com.au Twitter @PowerBIAU LinkedIn http://www.linkedin.com/in/ieftekhari Website www.agilebi.com.au Power BI overview Demo-1 End to end Demo-2 Case Study Where does it fit? Power BI vs. Competitors Power BI Licensing Data Management Gateway Power BI vs. SharePoint 3rd Party Tools The world of data is changing A powerful new way to work with data Self-service business intelligence and analytics with Excel and the power of the cloud Analyzing data with Excel Discover Analyze Visualize Explore Analyzing data with Excel Discover Analyze Visualize Explore Analyzing data with Excel Discover Analyze Visualize Explore Analyzing data with Excel Discover Analyze Visualize Explore A powerful new way to work with data Self-service business intelligence with familiar Excel and the power of the cloud Share & collaborate with Power BI for Office 365 BI Sites Shared Queries Data Refresh Data Search Mobile Access Natural Language Questions Share & collaborate with Power BI for Office 365 BI Sites Shared Queries Data Refresh Data Search Mobile Access Natural Language Questions Share & collaborate with Power BI for Office 365 BI Sites Shared Queries Data Refresh Data Search Mobile Access Natural Language Questions Power BI for Office 365 Workbook Cloud On Premise Data Management Gateway Installed on-premises Share & collaborate with Power BI for Office 365 BI Sites Shared Queries Data Refresh Data Search Mobile Access Natural Language Questions Search for: • Public Data • Corporate Data • Shared Queries Share & collaborate with Power BI for Office 365 BI Sites Shared Queries Data Refresh Data Search Mobile Access Natural Language Questions Share & collaborate with Power BI for Office 365 BI Sites Shared Queries Data Refresh Data Search Mobile Access Natural Language Questions A powerful new way to work with data Discover Analyze Visualize Search, access, and transform public and internal data sources with Power Query Easy data modeling and lightning fast in-memory analytics with Power Pivot Bold new interactive data visualizations with Power View and Power Map Share Question Q&A Mobility Share data views and workbooks refreshable from onpremises and cloud based data sources, with Power BI Sites Ask questions and get immediate answers with natural language query Mobile access through HTML5 and touch optimized apps Forrester - Microsoft as a Leader in Agile Business Intelligence Power BI – Conceptual Architecture Index Public Cloud Data Sources O365 Power BI Data Refresh Data Management SPO team sites, Power BI Corporate Data Catalog Admin Center Portal BI Sites, Q&A Import Data Public Data Catalog Cloud Data Sources Import Data Data Refresh Publish queries Data Management Gateway Configure Corporate Data Sources IT Admin Import Data Publish raw data sources or expose them as OData feeds Import data, Publish queries Manage Data Data Steward Publish reports & create featured questions, configure scheduled refresh IW (Author) Import Data Consume interactive reports, ask questions Power Query Power Pivot Power View Power Map Excel, Tablet/Mobile , IW Browser – (Consumer) Silverlight, HTML5 IT Infrastructure Services for Power BI • Govern usage, secure access and grant authority • Provides a single pane of glass to manage and monitor all services and servers • Enabling IT to expose and protect data sources and complex feeds • Respond to incidents - service KPIs, SLA metrics, audit logs Role of the IT Admin in Power BI • • • • Enabler of Self Service BI Varying levels of control across data sources, departments Oversight and monitoring of cloud data access Ability to make corporate data sources easier to discover, and easier to access Power BI Admin Center • Access via link in O365 admin portal • Configure Power BI roles • Install and monitor the Data Management Gateways for your organization • Configure access to cloud enabled data sources • Expose OData feeds to corporate data sources Where does this fit? Personal BI Team BI Organisational BI Where does this fit? Scenario 1 Personal BI Team BI Organisational BI • Data exploration tool • Consumes data from your enterprise DW for personal/team reporting requirements • Combine internal data with external data sources • Self-service ETL, data modelling and data visualisation Where does this fit? Scenario 2 Personal BI Team BI Organisational BI • Share datasets with the team • Share reports/files • Add governance and control around your data/reports Where does this fit? Scenario 3 Personal BI Team BI Organisational BI • Use powerful features with minimum end-user training • Utilise Power BI site to share and manage datasets and reports across the team/department or organisation. • Data Management Gateway, Scheduled Refresh Where does this fit? Personal BI Team BI Organisational BI • Give end-user a more powerful tool that requires minimum training • Add governance and control around your data/reports • Seamless transition of BI applications from Personal BI to Team BI to Organisational BI Power BI vs. Competitors Power BI vs. the other competitors Feature Power BI Tableau Qlikview Data Visualisation Power View is not as rich as competitors in dashboards and visual analytics. However, competitors do not have an equivalent tool to Power Map Very strong visual analytics and dashboards Similar level to tableau but not as easy to create dashboards but are regarded as better quality than tableau, may require scripting Data Modelling Strong data modelling and analytics/ easier to use than competitors Basic data modelling tools Does have a data modelling tool but may require an IT specialist and is known for taking time to perfect data model Combining data Ease of access to public/corporate data sources including tables from the web, merge and append Large list of data source support and feeds Ease of connection to proprietary data sources may struggle with others ETL Power Query is easy to use powerful ETL tool, Q&A unique to Power BI Does not have an ETL tool, ETL needs to be done in a database or via Excel Does have an ETL tool but may not be included in standard package Power BI and Tableau: Best Friends Forever! http://www.powerpivotpro.com/2014/11/power-bi-and-tableau-best-friends-forever/ Power BI Licensing Licensing • • • • Background: Telstra Open license. Easy to understand? Australia vs. US New Office 365 Plans Standard services Office applications Core details Office 365 Business plans Price Business $8.25 Seat Cap Business Essentials $5 Business Premium $12.5 300 (for each plan) Office desktop apps iPad, Windows RT & smartphone apps Office Online 1TB cloud storage (OneDrive for Business) Email, calendar (Exchange) Online meetings, IM (Lync) Team sites, internal portals (SharePoint) Enterprise social (Yammer) Full plan lineup Office Target customer Price Standard services Enterprise Business Business Essentials Business Premium ProPlus E1 E3 $8.25 $5 $12.5 $12 $8 $20 Seat Cap 24/7 phone support from Microsoft 300 (for each plan) Unlimited Critical issues All issues Word, PowerPoint, Excel, Outlook, OneNote, Publisher 2 2 iPad, Windows RT & smartphone apps Office Online Access 1TB cloud storage (OneDrive for Business) Email, calendar (Exchange) Online meetings, IM (Lync) Team sites, internal portals (SharePoint) Enterprise social (Yammer) Content discovery and search (Delve) 3 Licensed for hybrid deployment Support for shared computer activation Video content management Active Directory integration Advanced services Business Compliance – Archiving, eDiscovery, mailbox hold Information protection – message encryption, RMS, DLP Licensing FAQ Do I need any other products to use Power BI for Office 365? Yes. Power BI for Office 365 requires SharePoint Online Plan 2. It also is recommended but not required that Power BI for Office 365 customers have Office 365 Pro Plus or Office 2013 Professional Plus for additional Business Intelligence capabilities, including Power View, Power Query, Power Pivot and Power Map Preview. SharePoint Online Plan 2 and Office 365 Pro Plus are both included in Office 365 Enterprise Plans E3 and E4 as well as Office 365 Education Plans A3 and A4. SharePoint Online Plan 2A (Academic) also satisfies the SharePoint requirement. SharePoint Online Plan 2 is also included in Power BI for Office 365 Standalone offers but not in Power BI for Office 365 Add-on offers. Licensing FAQ Are Government and Academic pricing available for Power BI for Office 365? Yes. Government and Academic pricing are offered through the MOSP/Direct, EA and Open licensing programs. Government pricing is also available in Syndication, but Academic pricing is not. Licensing FAQ Can Power BI for Office 365 be purchased as an add-on to Office 365 Small or Medium Business plans? No. Power BI for Office 365 requires SharePoint Online Plan 2 which is only available in Office 365 Enterprise E3 and E4 or as a separate subscription. Data Management Gateway Data Management Gateway Data Management Gateway Power BI Admin Center capabilities Enabling Corporate OData Feeds Enabling Discovery in Power Query Enabling Excel Workbook Data Refresh using SharePoint Online Data Management Gateway - Conceptual Data Management Gateway Connects to corporate data sources and sends data to Microsoft cloud services through a secure channel (Service Bus). Secure Credential Store All credentials used by the gateway are stored onpremises. Encrypted backup of credentials can also be stored in the cloud to enable business continuity scenarios. Power BI Admin Center Allows IT to configure, manage and monitor access to corporate data sources. Corporate Data Sources The Gateway can connect to a variety of data sources. Extend with Hybrid Cloud Solutions Extend with Hybrid Cloud Solutions Extend with Hybrid Cloud Solutions Current Limitations Cloud: Windows Azure SQL Database, SQL Server (in Azure VM), OData On-Prem: SQL Server (2005+), Oracle (10g, 11g, and 11gR2) New: Power Query support Cloud: Embedded in workbook, or read from SharePoint Secure Store On-Prem: Configure through the Power BI Admin Center Data Management Gateway - OData Requires a primary key or unique index Automatically registered in the Data Catalogue Currently only used for discovery and authentication Actual OData results are served from connection to Gateway Org ID authentication, and redirection from cloud to on-premises Gateway Configuration Details Requires outgoing ports (9350-9354) Falls back to 443/80 if the other ports aren’t open No incoming ports from the internet (messages received via Service Bus) Requires incoming port default: 8050 (and 8051 if HTTP is used) Recommended to use HTTPS with signed certificate Data Sources Users and groups configured through the portal Static credentials used for refresh More data sources coming soon Expose SSIS data flow as SQL view Corporate OData Feeds Power BI Cloud Services Power Query 58 Data Management Gateway Data Refresh from Power BI Sites Excel Workbook in SharePoint Online (2) Connects to Gateway Cloud Service (8) Returns data to Excel Workbook (3) Checks whether user is authorized to perform a refresh (4) Sends command (SQL statement, connection string) to on-premise Gateway (5) Sends SQL to SQL Server Gateway Cloud Service (7) Compress, chunk and return the data Data Management Gateway (6) Return Results rd 3 Party Tools Saasabi for Power BI • Delivers enhanced data security, data integrity, usability and scalability • Cloud-based MOLAP engine for the analytical processing of data into multi-dimensional models • Natively available via Windows Azure and offered as software as a service (SaaS) • Seamless integration with Power BI www.saasabi.com 62 Saasabi for Power BI Features Implement a full security model for Power BI with granular user access control that is secure down to the database member level. Build a centralised data model to ensue the entire organisation is working with a consistent and reliable data set for analysis. Consolidate data models to an average of 1/10th their original size, handle data sets that are tens or even hundreds of gigabytes in size. All of the data resides in the cloud and processing takes place on cloud-based servers for high-performance queries. Clean and tag incoming data to make it more usable for everyone. Create “views” into the data ensuring users are guided to the data that meets their needs. Typical situation today Data Sources Number crunching Computer with Excel and Power BI With Saasabi for Power BI Data Sources Number crunching Computer with Excel and Power BI Power BI vs. SharePoint Scenarios & Features by BI product Excel in Office 365 ProPlus/E3 BI content creation Power Query, Power Pivot, Power View, & Power Map SharePoint Online P2 Power BI for Office 365 BI sharing & viewing Viewing (HTML5): <10MB Viewing (HTML5): <250MB BI Sites (organized report homepage) Query Sharing & Enterprise Data Search Data Management & Mobility Data Stewardship & Scheduled Refresh Q&A (Natural Language Query) Power BI for Windows & iPad (Mobile BI) Power BI in Office 365 vs. SharePoint Feature Power BI for Office 365 SharePoint On Premise (Power User) SharePoint On Premise (IT Pro) In memory Yes Yes Yes Data size 250MB Configurable up to SharePoint limit (2gb) Unlimited (or limited by RAM) Data Refresh Yes, using Gateway Yes, Power Pivot Gallery Yes Direct access to on premise data No Yes Yes Refresh from Power Query Yes No No Support for Power View in PowerPoint No Yes Yes Render Power Map in browser No No No Create Power View reports No Yes Yes Render Power View Sheets in browser Yes Yes (SP 2013), No (SP 2010) Yes (SP 2013), No (SP 2010) HTML5 support / Mobile Access Yes No No Natural Language (Q&A) query Yes No No Synonyms in Power Pivot model Yes No No Yes Yes Windows Authentication (corporate Yes (DirSync) domain) Power BI in Office 365 vs. SharePoint Max Workbook Size Power BI: the maximum workbook size currently is 250MB. Nearly all of the data needs to be in the Power Pivot model because only 10MB is permitted outside of the model. SharePoint: the maximum workbook size is 2GB. … if you are still awake, say YES! Evolving Product • Example: Custom Map Power BI Portal www.powerbi365.com.au Resources Getting Stated with Power BI for Office 365 preview http://office.microsoft.com/en-us/excel/power-bi-downloadadd-in-FX104087144.aspx Power BI blog http://blogs.msdn.com/b/powerbi/ Introduction to Power BI Admin Center Power BI Admin Center Help Restore a Data Management Gateway Monitor System Health using the System Health OData Feed Publish SSIS Packages as OData Feed Sources Supported Data Sources and Data Types Need a copy of the slides? • Download the slides from here: • http://www.agilebi.com.au/download • Or scan this: Sponsors Sydney Business Intelligence User Group Nov 2014