Neil Hambly - MDS and DQS

advertisement

MDS and DQS

Beyond the TLAs to Data Quality

Neil Hambly – Northdoor PLC

SQL Server Technology Evangelist

April 10-12 | Chicago, IL

Who Am I ?

SQL Server Technology Evangelist for Northdoor PLC

• Neil.Hambly@northdoor.co.uk

• DBA – 15+ Years, SQL Server 6.5 - 2014

Held # of DB roles @ many leading organizations

Regular International PASS Presenter @

SQL Conferences, User-Groups & Webinars

SQL London PASS Chapter Leader,

SQL Relay UK Events Organizer

PASS Professional Development VC Leader

Twitter: @Neil_Hambly Contributing Author

Blog: http://dataidol.com/neilhambly/

2

Session Agenda

MDS and DQS - Beyond the TLAs to Data Quality

“Data Quality”

DQS Overview

• Knowledge Bases, Industry Reference Data

• DQS Tools

EIM Solution {SSIS, DQS, MDS}

MDS Overview

• MDS Excel Add-in

3

DQS Overview

4

MDS Overview

5

MDS Overview

6

SSIS - MDS Process

7

MDS Requirements

8

MDS Configuration Manager – Defining your MDS environment

9

SQL Server CU1 Improvements

Below are the comparative DQS performance numbers between the SQL Server 2012 RTM and CU1 releases :

Data

Size

Discovery Cleansing SSIS Cleansing Matching

RTM CU1 RTM CU1 RTM CU1 RTM CU1

10K records

1 minute <1 minute 1 minute <1 minute

2-5 minutes

<1 minutes

1 minute <1 minute

100K records

5-10 minutes

2-4 minutes

2-7 minutes

1.5-5 minutes

40-75 minutes

10-20 minutes

5-10 minutes

1-2 minutes

1M records

1.5-3 hours

30-75 minutes

0.5-1.5 hours

25-75 minutes

1-4 hours

15-60 minutes

10

To upgrade a previously configured DQS server instance

This chart helps to show which product updates require schema upgrades as well as Upgrade Dlls when schema upgrades are not required.

Release

KB article +

Download link DQSInstaller -Upgrade required

SQL Server 2012 RTM NA

SQL Server 2012 RTM CU1 2679368

SQL Server 2012 RTM CU2

2703275

SQL Server 2012 RTM CU3 2723749

SQL Server 2012 RTM CU4 2758687

SQL Server 2012 Service

Pack 1

2674319

SQL Server 2012 SP1 CU1 2674319

.Net Framework Updates or Windows Updates

NA

Not Applicable

Yes

Yes

Yes (when upgrading from RTM or CU1)

No (when upgrading from CU2)

Pending Research

Yes

Pending Research

No

DQSInstaller -UpgradeDlls required

Not Applicable

No

No

No (when upgrading from RTM or CU1)

Yes (when upgrading from CU2)

Pending Research

No

Pending Research

Sometimes

(depends on which assemblies are patched)

11

Diamond Sponsor

Thank you!

April 10-12 | Chicago, IL

MDS Training {links}

Some new self-paced training is now available on the Microsoft Download Center.

To take advantage of this training, you should have a working installation of MDS with sample data already loaded.

01 Introduction http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/01 Introduction.pdf

This lesson provides an overview of MDS.

02 MDS Environment http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/02 MDS Environment.pdf

This lesson provides an overview of MDS terminology and features of the Master Data Manager web application.

03 Managing Entities http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/03 Managing Entities.pdf

In this lesson, MDS terminology is explored in more depth. You start working with data and learn how to use the Master Data Manager web application to do common tasks.

04 Managing Hierarchies http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/04 Managing Hierarchies.pdf

This lesson provides information about all of the available hierarchy types in MDS. You practice adding, removing, and moving members in hierarchies.

05 Creating Collections http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/05 Creating Collections.pdf

This lesson shows you how to create collections, and how to add and remove items from a collection.

06 Version Management http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/06 Version Management.pdf

This lesson explains version management and shows you how to view and reverse transactions.

07 Modeling Guidelines http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/07 Modeling Guidelines.pdf

This lesson gives you ideas for how to use MDS to model your organization's data. It prepares you for the next lesson, where you will use the knowledge you've gained to start creating your model.

08 Model Building http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/08 Model Building.pdf

In this lesson, you will use the knowledge from Lesson 07 to begin creating a model for your data.

13

Download