Uploaded by U. Mirza

Metadata Upload

advertisement
1
Metadata
Information Systems and Operations Management
Wayne Enterprises
Information Systems and Operations Management
EDW Management
Job
Scheduling
Monitoring
Business
Intelligance and
Advanced Analytics
Relational
Source Systems
Data Access
Staging
SQL Server
Oracle
Error
Handling
Multi-dimensional Relational
Warehouse
XML
Source Systems
Cubes
Web Service
Transformation
Excel
ESB
Flat File
MySQL
Mainframe
Midframe
Reporting Tools
Non-Relational
NoSQL
CRM
SaaS
SharePoint
Access
Other DBs
...
Self Service BI
Views
Apache Hadoop
Ecosystem
Hadoop
MetaData/ MetaData Management
Security
Data Stewards/ Governance
Information Systems and Operations Management
Hive
Pig
Predictive
Analytics/
Data
Mining
Questions
4
Are there predefined queries I can look at?
 What data elements are available in the data warehouse?
 Where did the data in the data warehouse come from?
 What are the business rules when merging systems?
 How old is the data in the data warehouse?
 When was the last update time?
 Are aggregations available?

Information Systems and Operations Management
Metadata
5

Metadata
 Often defined as “Data about Data”
 Data dictionary is part of the metadata

Categories of Metadata
 Operational Metadata:
 Information about source systems, where the data is coming from, details of
fields used, etc.
 ETL Metadata:
 Extraction methods, business rules for transformation, when was data last
loaded, percentage errors, …
 End-User Metadata:
 Navigational map for end-users. What information is located where, what
does it mean, what is the measurement unit, etc.
Information Systems and Operations Management
Data Dictionary
6
Enterprise Definition
 Aliases
 Source
 Business Rules
 Load Frequency
 Other Information

Information Systems and Operations Management
Example
7
Entity Name: Customer
 Aliases: Account, Client
 Create Date: 1/15/2015
 Last Update Date: 3/2/2015 2:13AM EST
 Fequency: Daily
 Data Steward: Jane Brown
 Business rules: If Customer exists in Salesforce, use that.
Otherwise, use the Oracle Financials customer. For third-party,
use the customer data that are FTP’ed monthly
Information Systems and Operations Management
Who Needs Metadata?
8
Data warehouse administrators
 ETL developers
 Report developers
 Power Users
 Casual Users
 Business Analysts
 Managers
 IT Support Personnel


Everyone
Information Systems and Operations Management
Business Analysts
9
Are unit sales or amounts stored by individual transactions or
summary totals? What currency are the amounts in? USD?
 Can sales be analyzed by product, promotion, store, and
month?
 Can current month sales be compared to last years? Rolling 6
months?
 Can sales be compared to targets?
 How is profit margin calculated? What are the business rules?
 What is the definition of sales region?
 Where did the sales numbers come from? How old are they?

Information Systems and Operations Management
Types of Metadata
10
Business
 Technical

Information Systems and Operations Management
Metadata Repository
11

System that stores and provides the metadata
Information Systems and Operations Management
Download