Information Integration & Governance Overview (no Roadmap) Guenter Sauter Program Director, Offering Management Information Integration & Governance © 2015 IBM Corporation Information Governance Catalog Information Server InfoSphere Information Server Integrating and transforming data and content to deliver accurate, consistent, timely and complete information on a single platform unified by a common metadata layer Data Integration Data Quality Information Governance Catalog Data Quality Data Integration Understand & Collaborate Cleanse & Monitor Transform & Deliver • Catalog technical metadata & align w/ business language • Mange data lineage • Manage information governance policies • Analyze, classify & validate • Cleanse & standardize • Define, manage & monitor data rules + exceptions • Massive scalability • Power for any complexity • Deliver in batch and/or realtime with change capture • common connectivity • shared metadata • common execution engine with flexible deployments 2 © 2015 International Business Machines Corporation Information Server – Release History 2012 9.1 2013 FP 9.1.2 Business Driven Governance • Information Governance policy and rules • Integrated metadata mgmt enhancements Business Driven Governance • IDA 8.5 • Additional Workflow Roles • Data Rules Metadata • Bulk metadata import Sustainable Quality • Data Quality Console • Standardization Rules Designer • Data Rules Advancements Sustainable Quality • Profiling Big Data • Exception Stage • New QS standardization rulesets Agile integration • InfoSphere Data Click • Enhanced Workload Mgmt • ODM Integration • Hadoop Balanced Optimization • HDFS Extensions Agile Integration • Big Data Features * JSON support * JDBC connector • DB2 on z/OS load optimization • Data Click new data sources/targets 3 2014 11.3 Business Driven Governance • Info Governance Catalog • Shop for Data • Smart Hover • Collect & Share • Lineage@Scale Sustainable Quality • Governance Dashboard integration • Performance Optimizations • Productivity Enhancements • Global Geocoding Agile Integration • Self-service Data integration • Cloud Connectors • MDM Integration • Sort compress • Hadoop currency • Greenplum Connector FP 11.3.1 Business Driven Governance • Stewardship Center (w/BPM) • Subscription Manager • Term Custom Attributes • Customizable attribute display • Lineage Admin Console • Prebuilt Governance Content Sustainable Quality • Data Quality Exception Management Updates • Exception SQL Views • Stewardship Center Data Remediation Workflow Agile Integration • Cognos TM1 Connector and Metadata Import • Hadoop File Secure Connector © 2015 International Business Machines Corporation Data Integration Improvements Operational Visibility Self-service Integration Browser-based project/job monitoring to view and analyze run-time environment self-service data integration on-demand through a simple web-based interface for any user Workload Management Big Data Integration Provide prioritization of mission critical tasks or specific project of job workloads 4 Leverage the same designer UI to read/wrtie to Hadoop and automatically generate MapReduce © 2015 International Business Machines Corporation Self-Service Data Provisioning Balancing the need for speed of knowledge workers & governance controls by IT Collect & Share (Info Gov Catalog) selected data collection selected data Shop for Data Act on Data (Info Gov Catalog) (Data Click) find the right data • simply: intuitive navigation, smart hover, … • trusted: business terms linked to trusted source & stewardship 5 Organize data assets into “collections”, add context, and share enriched metadata (lineage, new data) Capture & Control (Info Gov Catalog) execution & new data Provision the data in just a few clicks rather than complicated design with built-in governance capture metadata & graphical lineage for self-service (and other processes) © 2015 International Business Machines Corporation Subscription Manager • Engage users proactively when data integration, quality and governance activities discover items of interest • Speed up responsiveness to data quality issues • Increase organizational trust in information through increased level of collaboration 6 © 2015 International Business Machines Corporation Subscription Manager – Flow Governance Catalog (Policy) Steward, analyst, … Policies Notify Information Analyzer Exceptions Exception Manager Subscription Manager DS/QS Exception Stage Governance Dashboard (Monitoring) Exceptions DB 7 © 2015 International Business Machines Corporation Stewardship Center • A single collaborative environment for the data steward business team to manage data governance initiatives. • Leverages prebuilt and customizable workflows via IBM BPM for data issue and governance process tasks. • Provides specific data remediation tooling to act on and correct data quality issues. 8 © 2015 International Business Machines Corporation Stewardship Center – Flow Governance Catalog (Policy) Steward, analyst, … Policies Notify Information Analyzer Take action Exceptions Exception Manager Stewardship Center (BPM) Subscription Manager Remediation Tool Open task DS/QS Exception Stage Governance Dashboard (Monitoring) Exceptions DB 9 Data Source © 2015 International Business Machines Corporation Stewardship Center – Data Remediation • Provides details of exceptions captured during data integration, data cleansing and data profiling activities. • Drill into rule details in IGC to understand how this exception set relates to business objectives. • Edit values that were incorrect or use the Export / Import buttons to download / upload a CSV file with the records and associated fixes. • Prebuilt workflow includes review and approval steps for multiple organizational roles (Data Steward, Data Steward Manager, Data Source Owner) • 10 Prebuilt workflow can be extended/customized to allow approved edits to be submitted to any REST service for automated cleanup. © 2015 International Business Machines Corporation © Copyright IBM Corporation 2015. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others. 11 © 2015 International Business Machines Corporation 1 12 © 2015 International Business Machines Corporation Companies Represented 1 13 © 2015 International Business Machines Corporation Speakers Beth Smith IBM Analytics - IBM USA General Manager, Analytics Platform, IBM Analytics Guenter Sauter IBM Analytics, Platform - IBM USA Program Director, Product Management, Data Integration & Lifecycle Management 1 14 © 2015 International Business Machines Corporation Announcements KC Governance User Group • For those involved with developing and sustaining a Governance program • Meets separately from this KC InfoServer User Group • See Steve Boyd – seboyd@us.ibm.com KC Big Data Summit • September 13-17 • http://bigdatasummitkc.org/ • Multiple industry sponsored Big Data Conference in downtown Kansas City, MO at Union Station Insight Conference (formerly IOD) – register now! • • • • • October 25-29, 2015 Mandalay Bay in Las Vegas www.ibm.com/software/events/insight/ Early Bird discount--save $300--ends September 18 See your Sales Rep! Proofs of Technology (hands-on technical) • • • • • • • • 1 Information Server Big Data tools Databases Cognos Cloud Data Services WebSphere Process Server Many more! See your ACA (Analytics Client Architect; a.k.a. Tech Sales) 15 © 2015 International Business Machines Corporation LinkedIn Our “lunch bunch” has a LinkedIn Group! Started and administered by InfoServer customers This group will be used to communicate news, events, ideas, promotions, etc. Sign up at: http://www.linkedin.co m/groups?gid=43162 77 Make our jobs easier! 1 16 © 2015 International Business Machines Corporation IBMBrian https://ibmbrian.wordpress.com/ Website launched this year by Brian Features: • IBM News • Calendar • KC User Group events • IBM events • Helpful links • Support • Resources • Education • IBM Software • New version features • Product information • Software Cycle • Hints and Tips • DataStage • Other software Easy Search button! Immediately find a relevant post Renders beautifully on: • Desktop/Laptop • Tablet • Phone 1 17 © 2015 International Business Machines Corporation Links to bookmark Online information center – most current information: https://www01.ibm.com/support/knowledgecenter/SSZJPZ_11.3.0/com.ibm.swg.im.iis.productiz ation.iisinfsv.home.doc/topics/kc_homepage_IS.html What’s new in v11.3 Fix Pack 1: http://www01.ibm.com/support/docview.wss?uid=swg27043028 PDF publications page – where to download individual PDFs: http://www.ibm.com/support/docview.wss?uid=swg27022092 Tony Curcio’s blog: https://www304.ibm.com/connections/blogs/infosphere/?lang=en_us Ernie Ostic’s blog: https://dsrealtime.wordpress.com/ 1 18 © 2015 International Business Machines Corporation Your Reminders Pester your managers so you can attend the IBM Insight conference Sign up for the LinkedIn group at: http://www.linkedin.com/groups?gid=4316277 Post future user group topic ideas on the LinkedIn page Visit the IBMBrian website for other helpful information Tell your friends! Let Tyler or me know if you would like: • • • • 1 19 To schedule a Proof Of Technology Information about forums, conferences, sessions Any additional information about any topic or links To schedule an onsite visit with your Rep and Tech © 2015 International Business Machines Corporation PICTURES 20 © 2015 International Business Machines Corporation 21 © 2015 International Business Machines Corporation 22 © 2015 International Business Machines Corporation 23 © 2015 International Business Machines Corporation