Beyond the TLAs to Data Quality
Neil Hambly – Northdoor PLC
SQL Server Technology Evangelist
April 10-12 | Chicago, IL
SQL Server Technology Evangelist for Northdoor PLC
• Neil.Hambly@northdoor.co.uk
• DBA – 15+ Years, SQL Server 6.5 - 2014
Held # of DB roles @ many leading organizations
Regular International PASS Presenter @
SQL Conferences, User-Groups & Webinars
SQL London PASS Chapter Leader,
SQL Relay UK Events Organizer
PASS Professional Development VC Leader
Twitter: @Neil_Hambly Contributing Author
Blog: http://dataidol.com/neilhambly/
2
MDS and DQS - Beyond the TLAs to Data Quality
• Knowledge Bases, Industry Reference Data
• DQS Tools
EIM Solution {SSIS, DQS, MDS}
• MDS Excel Add-in
3
4
5
6
7
8
9
Below are the comparative DQS performance numbers between the SQL Server 2012 RTM and CU1 releases :
Data
Size
Discovery Cleansing SSIS Cleansing Matching
RTM CU1 RTM CU1 RTM CU1 RTM CU1
10K records
1 minute <1 minute 1 minute <1 minute
2-5 minutes
<1 minutes
1 minute <1 minute
100K records
5-10 minutes
2-4 minutes
2-7 minutes
1.5-5 minutes
40-75 minutes
10-20 minutes
5-10 minutes
1-2 minutes
1M records
1.5-3 hours
30-75 minutes
0.5-1.5 hours
25-75 minutes
1-4 hours
15-60 minutes
10
This chart helps to show which product updates require schema upgrades as well as Upgrade Dlls when schema upgrades are not required.
Release
KB article +
Download link DQSInstaller -Upgrade required
SQL Server 2012 RTM NA
SQL Server 2012 RTM CU1 2679368
SQL Server 2012 RTM CU2
2703275
SQL Server 2012 RTM CU3 2723749
SQL Server 2012 RTM CU4 2758687
SQL Server 2012 Service
Pack 1
2674319
SQL Server 2012 SP1 CU1 2674319
.Net Framework Updates or Windows Updates
NA
Not Applicable
Yes
Yes
Yes (when upgrading from RTM or CU1)
No (when upgrading from CU2)
Pending Research
Yes
Pending Research
No
DQSInstaller -UpgradeDlls required
Not Applicable
No
No
No (when upgrading from RTM or CU1)
Yes (when upgrading from CU2)
Pending Research
No
Pending Research
Sometimes
(depends on which assemblies are patched)
11
Diamond Sponsor
April 10-12 | Chicago, IL
Some new self-paced training is now available on the Microsoft Download Center.
To take advantage of this training, you should have a working installation of MDS with sample data already loaded.
01 Introduction http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/01 Introduction.pdf
This lesson provides an overview of MDS.
02 MDS Environment http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/02 MDS Environment.pdf
This lesson provides an overview of MDS terminology and features of the Master Data Manager web application.
03 Managing Entities http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/03 Managing Entities.pdf
In this lesson, MDS terminology is explored in more depth. You start working with data and learn how to use the Master Data Manager web application to do common tasks.
04 Managing Hierarchies http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/04 Managing Hierarchies.pdf
This lesson provides information about all of the available hierarchy types in MDS. You practice adding, removing, and moving members in hierarchies.
05 Creating Collections http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/05 Creating Collections.pdf
This lesson shows you how to create collections, and how to add and remove items from a collection.
06 Version Management http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/06 Version Management.pdf
This lesson explains version management and shows you how to view and reverse transactions.
07 Modeling Guidelines http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/07 Modeling Guidelines.pdf
This lesson gives you ideas for how to use MDS to model your organization's data. It prepares you for the next lesson, where you will use the knowledge you've gained to start creating your model.
08 Model Building http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/08 Model Building.pdf
In this lesson, you will use the knowledge from Lesson 07 to begin creating a model for your data.
13