Successfully implement
Master Data Services
(MDS)
Johan Machielse
BI Consultant
2012-04-21
© Copyright 2010 Avanade Inc. All Rights Reserved.
The Avanade name and logo are registered trademarks in the US and other countries.
1
Agenda
•
•
•
•
•
•
•
Case Description
Master Data Management (MDM)
Master Data Services (MDS)
Data Quality Services (DQS)
MDS meets DQS
References
Q&A
© Copyright 2010 Avanade Inc. All Rights Reserved.
2
Case Description
The Beer Company
© Copyright 2010 Avanade Inc. All Rights Reserved.
3
Case Description
The Beer Company
© Copyright 2010 Avanade Inc. All Rights Reserved.
4
Master Data Management
Processes, tools, and master data
© Copyright 2010 Avanade Inc. All Rights Reserved.
5
Processes & tools
Master Data Management (MDM) comprises a set of processes and tools that
consistently defines and manages the master data of an organization.
•
Single version of the truth
Store master version of customers and products in one location.
•
Processes
- Maintain customers and products in one location
- Validate and improve the quality continuously
- Designate people to own master data (accountable)
- Ensure data integrity/validity (business rules and workflows)
- Ensure that security is in place
•
Tools
Use the proper tools to support the processes as efficient and effectively as possible.
© Copyright 2010 Avanade Inc. All Rights Reserved.
6
Master data
•
Transactional data
- Supports business applications that automate key
processes.
- Numbers, dates, times, etc.
•
Analytical data
- Supports decision-making
- Aggregations, ad hoc queries, data mining, forecasting
•
Master data
- Critical nouns of a business (Business objects / dimensions)
- People, things, places, concepts
- Four types
> Reference data
> Master data
> Enterprise master data
> Market master data
© Copyright 2010 Avanade Inc. All Rights Reserved.
7
The Beer Company: updated
© Copyright 2010 Avanade Inc. All Rights Reserved.
8
Master Data Services (MDS)
Overview, architecture, modeling, and a lot of demos
© Copyright 2010 Avanade Inc. All Rights Reserved.
9
Overview
Master Data Services (MDS) enables an organization to centrally manage master data from
a central master data hub.
•
•
•
•
•
•
•
•
•
Maintain master data
Modeling
Hierarchies
Business rules
Workflows
Security
Auditing
Versioning
Integration
© Copyright 2010 Avanade Inc. All Rights Reserved.
10
Architecture
Ships only with the 64 bits Enterprise and Datacenter (Business Intelligence) editions of
SQL Server (starting from SS2008 R2).
A Master Data Services application is created via the Master Data Services Configuration
Manager, which creates a web application and database.
© Copyright 2010 Avanade Inc. All Rights Reserved.
11
The Beer Company models
© Copyright 2010 Avanade Inc. All Rights Reserved.
Demo
The Beer Company models
© Copyright 2010 Avanade Inc. All Rights Reserved.
The Avanade name and logo are registered trademarks in the US and other countries.
13
The staging process
SQL Server 2012 introduces entity-based staging and preserves backwards
compatibility by also supporting staging as it is done in SQL Server 2008 R2.
Every entity now has its own staging table called “stg.<EntityName>_Leaf” and
stored procedure called “stg.udp_<EntityName>_Leaf” which processes the batch
of staging data.
© Copyright 2010 Avanade Inc. All Rights Reserved.
Demo
The staging process
© Copyright 2010 Avanade Inc. All Rights Reserved.
The Avanade name and logo are registered trademarks in the US and other countries.
15
Business rules
With business rules you can enforce data integrity, completeness, and accuracy.
A business rule is defined as an “if-then” structure:
• if (condition = true) then action
- condition: “is equal to”, “contains”, “is between”, etc.
- action: “validation”, “set value”, “start workflow”
and applied when validating the data.
© Copyright 2010 Avanade Inc. All Rights Reserved.
Custom Workflow
•
•
Service is not default installed
Configure the service
© Copyright 2010 Avanade Inc. All Rights Reserved.
Shared entities
There’s not out-of-the-box functionality to share
entities across models.
© Copyright 2010 Avanade Inc. All Rights Reserved.
Demo
Business rules, custom workflows,
shared entities
© Copyright 2010 Avanade Inc. All Rights Reserved.
The Avanade name and logo are registered trademarks in the US and other countries.
19
Excel add-in
A familiar Excel interface to maintain master data (batch-wise).
•
•
Shipped with SS2012
Can also be used with SS2008R2 by installing MDS SS2012.
© Copyright 2010 Avanade Inc. All Rights Reserved.
Demo
Excel add-in
© Copyright 2010 Avanade Inc. All Rights Reserved.
The Avanade name and logo are registered trademarks in the US and other countries.
21
Data Quality Services (DQS)
Overview
© Copyright 2010 Avanade Inc. All Rights Reserved.
22
What is data quality?
•
Data Quality represents the degree to which the data is suitable for
business usages.
•
Data Quality is built through People + Technology + Processes.
•
Bad Bata  Bad Business
© Copyright 2010 Avanade Inc. All Rights Reserved.
Common data quality issues
Data Quality
Issue
Sample Data Problem
Standard
Are data elements consistently defined
and understood ?
Gender code = M, F, U in one system and Gender code =
0, 1, 2 in another system
Complete
Is all necessary data present ?
20% of customers’ last name is blank,
50% of zip-codes are 99999
Accurate
Does the data accurately represent reality
or a verifiable source?
A Supplier is listed as ‘Active’ but went out of business six
years ago
Valid
Do data values fall within acceptable
ranges?
Salary values should be between
60,000-120,000
Unique
Data appears several times
Both John Ryan and Jack Ryan appear in the system –
are they the same person?
© Copyright 2010 Avanade Inc. All Rights Reserved.
Requirements for data quality solutions
Monitoring
Cleansing
Profiling
Matching
© Copyright 2010 Avanade Inc. All Rights Reserved.
Data Quality Services
You know how to correct data if you have the knowledge about the data!
Data Quality Services (DQS) is a Knowledge-Driven data quality solution,
enabling IT Pros and data stewards to easily improve the quality of their data.
© Copyright 2010 Avanade Inc. All Rights Reserved.
Demo
Exploring Data Quality Services
© Copyright 2010 Avanade Inc. All Rights Reserved.
The Avanade name and logo are registered trademarks in the US and other countries.
27
MDS meets DQS
Integration of MDS and DQS using SSIS
© Copyright 2010 Avanade Inc. All Rights Reserved.
28
Solving The Beer Company challenges
Customer data has to be managed centrally, but the data quality is very poor and
not usable for the business.
© Copyright 2010 Avanade Inc. All Rights Reserved.
SSIS solution
© Copyright 2010 Avanade Inc. All Rights Reserved.
Demo
Integration of MDS and DQS
© Copyright 2010 Avanade Inc. All Rights Reserved.
The Avanade name and logo are registered trademarks in the US and other countries.
31
References
© Copyright 2010 Avanade Inc. All Rights Reserved.
32
References
•
My blog
- http://johanmachielse.blogspot.com
•
Master Data Services
- http://www.msdev.com/Directory/SearchResults.aspx?keyword=MDS#0,1 (SS2008R2 training videos)
- http://blogs.msdn.com/b/microsoft_press/archive/2010/04/14/free-ebook-introducing-microsoft-sql-server-2008-r2.aspx
(free SS2008R2 e-book)
- http://blogs.msdn.com/b/mds/ (Microsoft blog)
- http://www.microsoft.com/sqlserver/en/us/solutions-technologies/data-warehousing/master-data-services.aspx (Microsoft)
- http://msdn.microsoft.com/en-us/library/ee633763(v=sql.110).aspx (MSDN)
- http://download.microsoft.com/download/C/2/D/C2DF91A1-3C7C-4965-BB16
CAB02F8262B9/Microsoft_Press_ebook_Introducing_SQL_Server_2012_Preview_II.pdf (SS2012 e-book)
- http://channel9.msdn.com/Events/TechEd/NorthAmerica/2011/DBI204 (TechEd 2011)
•
Data Quality Services
- http://msdn.microsoft.com/en-us/library/gg524800(v=sql.110).aspx (MSDN)
- http://channel9.msdn.com/Events/TechEd/NorthAmerica/2011/DBI207 (TechEd 2011)
- http://download.microsoft.com/download/C/2/D/C2DF91A1-3C7C-4965-BB16
CAB02F8262B9/Microsoft_Press_ebook_Introducing_SQL_Server_2012_Preview_II.pdf (SS2012 e-book)
- http://blogs.msdn.com/b/dqs/ (Microsoft blog)
- http://technet.microsoft.com/en-us/sqlserver/hh830422 (training videos)
© Copyright 2010 Avanade Inc. All Rights Reserved.
Questions?
© Copyright 2010 Avanade Inc. All Rights Reserved.
34