1 Metadata Information Systems and Operations Management Wayne Enterprises Information Systems and Operations Management EDW Management Job Scheduling Monitoring Business Intelligance and Advanced Analytics Relational Source Systems Data Access Staging SQL Server Oracle Error Handling Multi-dimensional Relational Warehouse XML Source Systems Cubes Web Service Transformation Excel ESB Flat File MySQL Mainframe Midframe Reporting Tools Non-Relational NoSQL CRM SaaS SharePoint Access Other DBs ... Self Service BI Views Apache Hadoop Ecosystem Hadoop MetaData/ MetaData Management Security Data Stewards/ Governance Information Systems and Operations Management Hive Pig Predictive Analytics/ Data Mining Questions 4 Are there predefined queries I can look at? What data elements are available in the data warehouse? Where did the data in the data warehouse come from? What are the business rules when merging systems? How old is the data in the data warehouse? When was the last update time? Are aggregations available? Information Systems and Operations Management Metadata 5 Metadata Often defined as “Data about Data” Data dictionary is part of the metadata Categories of Metadata Operational Metadata: Information about source systems, where the data is coming from, details of fields used, etc. ETL Metadata: Extraction methods, business rules for transformation, when was data last loaded, percentage errors, … End-User Metadata: Navigational map for end-users. What information is located where, what does it mean, what is the measurement unit, etc. Information Systems and Operations Management Data Dictionary 6 Enterprise Definition Aliases Source Business Rules Load Frequency Other Information Information Systems and Operations Management Example 7 Entity Name: Customer Aliases: Account, Client Create Date: 1/15/2015 Last Update Date: 3/2/2015 2:13AM EST Fequency: Daily Data Steward: Jane Brown Business rules: If Customer exists in Salesforce, use that. Otherwise, use the Oracle Financials customer. For third-party, use the customer data that are FTP’ed monthly Information Systems and Operations Management Who Needs Metadata? 8 Data warehouse administrators ETL developers Report developers Power Users Casual Users Business Analysts Managers IT Support Personnel Everyone Information Systems and Operations Management Business Analysts 9 Are unit sales or amounts stored by individual transactions or summary totals? What currency are the amounts in? USD? Can sales be analyzed by product, promotion, store, and month? Can current month sales be compared to last years? Rolling 6 months? Can sales be compared to targets? How is profit margin calculated? What are the business rules? What is the definition of sales region? Where did the sales numbers come from? How old are they? Information Systems and Operations Management Types of Metadata 10 Business Technical Information Systems and Operations Management Metadata Repository 11 System that stores and provides the metadata Information Systems and Operations Management