Metadata Use Cases You Can Use

advertisement
Metadata Use Cases
You Can Use
For
DAMA Chicago
Bob Dein
Metadata Solutions Architect
Allen Systems Group
bob.dein@asg.com
August 15, 2012
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
About ASG Software Solutions
• Founded in 1986 by Arthur L. Allen,
President & CEO
• 1,300 employees in over 80 offices
worldwide
• More than 3,400 customers worldwide
• $400 million in revenue annually
• Solutions to meet metadata,
infrastructure/ops management and
cloud challenges
• Expertise in implementing metadata and
data governance solutions
• 85% of Fortune 500 companies
rely on ASG products
www.asg.com
www.asg.com
Copyright®
2011 Allen Allen
Systems
Group, Inc.
Copyright®2012
Systems
Group,
Inc.
Top Rochade Customers
Banking
Insurance
Financial
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Top Rochade Customers (cont.)
Auctions
Pharmaceutical
Oil and Gasoline
Retail
Health Care
Market Research
Hotels
Professional
Services
Software
Telecommunications
Airlines
Market Research
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Top Rochade Customers (Government)
Defense Finance and Accounting
Service (DFAS)
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Data Governance and Information Management Challenges
Problems Governing & Managing Data
• Lack of standards– no global codes,
definitions or data format exists
• Application specific definitions – term
definitions differ across divisions and LOB
• No single source of truth – unless vetted
its not trusted.
• No ownership / governance for the
?
problem – system and process “workarounds” are created.
• Difficult to find and understand data
reliance on key knowledge workers.
• Root Cause Analysis-data quality issues
are time consuming to understand and
verify.
Cost of Misunderstanding
• Expensive missteps - Action is taken only to find out later that information
was wrong or incomplete
• Higher costs – unclear change impact
and creation of redundant processes
and information
• Slow response – lack of information
clarity slows decision process and
agility for mergers and regulatory
initiatives (HIPAA, Sarbanes Oxley,
Basel II)
• Productivity loss – those who don’t
understand data burden the few that
do
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Solving the Problem of Information
Metadata is
the
Makes information usable:
DNA
of information
technology
•
Supports consistent use of terminology
•
Describes how information can be used, combined, and shared
Optimizes value of existing IT investment:
•
Enables broad re-use of information
•
Establishes knowledge base of information and assets
Protects corporate reputation:
Who?
What?
How?
When?
Where?
Why?
•
Prevents inappropriate exposure and use of information
•
Provides “evidence” for governance and compliance purposes
Minimizes cost of information usage:
•
Reduces need for users to question information
•
Minimizes time spent reconciling “inconsistent” information
•
Reduces storage costs due to creation and maintenance of redundant data
and complexity
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
DMBOK Metadata Management Framework
Data Quality
Management
Meta Data
Management
Document
&
Content
Management
Data
Architecture
Management
Data
Governance
Data
Warehousing
&
Business
Intelligence
Management
Data
Development
Database
Operations
Management
Data
Security
Management
Reference
&
Master Data
Management
© DAMA International 2010
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
DMBOK Metadata Management 101
Definition: Planning, implementation, and control activities to enable easy access to high quality,
Goals:
integrated meta-data.
1. Provide organizational understanding of terms, and usage
2. Integrate meta-data from diverse source
3. Provide easy, integrated access to meta-data
4. Ensure meta-data quality and security
Inputs:
• Meta-data Requirements
• Meta-data Issues
• Data Architecture
• Business Meta-data
• Technical Meta-data
• Process Meta-data
• Operational Meta-data
• Data Stewardship Metadata
Suppliers:
• Data Stewards
• Data Architects
• Data Modelers
• Database
Administrators
• Other Data
Professionals
• Data Brokers
• Government and
Industry Regulators
Activities:
1. Understand Meta-data Requirements (P)
2. Define the Meta-data Architecture (P)
3. Develop and Maintain Meta-data Standards (P)
4. Implement a Managed Meta-data Environment (D)
5. Create and Maintain Meta-data (O)
6. Integrate Meta-data (C)
7. Manage Meta-data Repositories (C)
8. Distribute and Deliver Meta-data (C)
9. Query, Report, and Analyze Meta-data (O)
Participants:
• Meta-data Specialist
• Data Integration Architects
• Data Stewards
• Data Architects and
Modelers
• Database Administrators
• Other DM Professionals
• Other IT Professionals
• DM Executive
• Business Users
© DAMA International 2010
Primary Deliverables:
• Meta-data Repositories
• Quality Meta-data
• Meta-data Models and Architecture
• Meta-data Management Operational
Analysis
• Meta-data Analysis
• Data Lineage
• Change Impact Analysis
• Meta-data Control Procedures
Tools:
Consumers:
• Meta-data Repositories
• Data Stewards
• Data Modeling Tools
• Data Professionals
• Database Management Systems • Other IT Professionals
• Data Integration Tools
• Knowledge Workers
• Business Intelligence Tools
• Managers and
• System Management Tools
Executives
• Object Modeling Tools
• Customers and
• Process Modeling Tools
Collaborators
• Report Generating Tools
• Business Users
• Data Quality Tools
• Data Development and Administration Tools
• Reference and Master Data Management Tools
Metrics:
• Meta Data Quality
• Master Data Service Data
Compliance
• Meta-data Repository Contribution
• Meta-data Documentation Quality
• Steward Representation/Coverage
• Meta-data Usage/Reference
• Meta-data Management Maturity
• Meta-data Repository Availability
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
10 Reasons Why Metadata Solutions Fall Short
1.
Lack of Commitment – “Tell me again why we need this?..”
2.
Poorly Defined Scope – “Rome wasn’t built in a day..”
3.
Poorly Defined Requirements – “What does it do for me?..”
4.
Poor Communication – “meta what?..”
5.
Reorgs & Personnel Changes - “It’s who, not what you know..”
6.
Lack of Business Relevance – “It’s like Google right?..”
7.
Lack of IT Relevance – “Our new ETL tool does that..”
8.
DIY Mentality – “Don’t buy one, I can build that..”
9.
High Level of Complexity – “I don’t get it..”
10. Poor User Experience – “Where’s the app?..”
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
How Use Cases Can Make a Difference
1.
Lack of Commitment – “Now that’s a compelling business case..”
2.
Poorly Defined Scope – “That’s all it needs to do for now..”
3.
Poorly Defined Requirements – “That’s what it needs to do for us..”
4.
Poor Communication – “A picture is worth a thousand words..”
5.
Reorganization & Personnel Changes – “Great story, now I get it!..”
6.
Lack of Business Relevance – “I’ll use this every day!..”
7.
Lack of IT Relevance – “This will make us better, faster, cheaper..”
8.
DIY Mentality – “OK, maybe we shouldn’t build that..”
9.
High Level of Complexity – “Now I get it..”
10. Poor User Experience – “That was easy..”
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Use Cases 101
Use Case - defines a goal-oriented set of interactions between external actors
and the system under consideration (e.g. DMBOK Goals & Activities).
• initiated by a user with a particular goal in mind
• describes the sequence of interactions between actors and the system
• captures who (actor) does what (interaction) with the system, for what purpose (goal)
System – a mechanism that an actor interacts with in order to achieve a goal
(e.g. DMBOK Tools)
Actor - party outside the system that interacts with the system (e.g. DMBOK
Suppliers, Participants and Consumers)
Input/Output – description/illustration of what actors contribute/receive from
the system (e.g. DMBOK Inputs & Deliverables)
Scenario - an instance of a use case representing a single path through the use
case. Use Cases usually have many scenarios.
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Example Metadata Use Case: Reporting/Analytics
Scenario
An authorized business user accesses the Business Metadata Repository. The system validates the user credentials and provides
access. Business user searches the Repository for particular business terms or keywords. In addition simple and effective reporting
and analytical tools are also available. The results of the search or a requested report should be displayed with an option to print or to
export to a recognized output format (e.g. CSV).
Use Case: Reporting/Analytics
INPUT
ACTOR
Authorized user submits a
search to the Business
Metadata Repository
Login screen
SYSTEM
Validates search parameters,
conducts the search and
displays results
Sample data
The following table suggests a possible data
that can be used as part of this Use Case:
1
OUTPUT
Search results
Authorized user submits a
request for report to the
Business Metadata
Repository
OUTPUT
Requested report
Validates report parameters
and generates the report
#
1
Data element
Search
keyword
Value
“Revenue”
2
Report
parameters
3
Export
parameters
All business terms
within a category,
e.g. Finance
Management
CSV file
Comments
The system should display
all business terms that
contain the requested
keyword
The system should display
all business terms with the
requested category in a list
format
The system should
generates a CSV file that
contains the contents of
the report
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case Contexts
Corporate
Finance
Sales
Line of
Business Mgr
Conceptual /
Logical
Physical /
Deployed
Business
Revenue
IT Dept
App Dev
Business
Analyst
DBA
Note: Automated discovery, relationship
mapping, and lineage of the physical context.
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Business Metadata Context
Contextual
Domain(s)/Group(s)
Corporate
Definition /
Description /
Value Domain
Compliance
Standards /
Measures
Line of
Business Mgr
Conceptual /
Logical
Physical /
Deployed
Finance
Sales
Business
Models
Revenue
IT Dept
App Dev
Business
Analyst
DBA
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Technical Metadata Context
Contextual
Domain(s)/Group(s)
Corporate
Definition /
Description /
Value Domain
Compliance
Standards /
Measures
Line of
Business Mgr
Conceptual /
Logical
Physical /
Deployed
Finance
Sales
Business
Models
Revenue
IT Dept
Report
Process
(Appl / ETL / etc)
Database /
Table / View /
Column
App Dev
Business
Analyst
DBA
Note: Automated discovery, relationship
mapping, and lineage of the physical context.
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Full Contextual Representation = Governance
Definition /
Description /
Value Domain
Compliance
Standards /
Measures
Line of
Business Mgr
Conceptual /
Logical
Physical /
Deployed
Finance
Contextual
Domain(s)/Group(s)
Corporate
Sales
Business
Models
Revenue
IT Dept
Report
Process
(Appl / ETL / etc)
Database /
Table / View /
Column
App Dev
DBA
Business
Analyst
Note: Automated discovery, relationship
mapping, and lineage of the physical context.
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Desktop Metadata Accessibility
Scenario
An authorized user highlights some text (a single word or a combination of words) while on a Windows desktop or in any of the
applications (e.g. Microsoft Word, PowerPoint, browser, etc.) and uses a combination of function keys to retrieve and view the
Business Term definition from the Business Metadata Repository. The Business Term definition is displayed in a pop-up window (as
in IBM’s BG Anywhere).
Use Case: Desktop Accessibility
INPUT
ACTOR
Authorized business user
highlights text and presses
combination of function keys
Highlighted text and
combination of keys
SYSTEM
Validates user and retrieves
Business Term definition
Sample data
1
OUTPUT
Business Term definition is
displayed in a pop-up
window
The following table suggests a possible data
that can be used as part of this Use Case:
#
1
Data element
Business Term
name
2
Business Term
definition
Value
Highlighted
word on a
desktop, e.g.
“Revenue”
Business
Term
definition,
name and
short
description
Comments
Additional attributes may be
retrieved from a pop-up window
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Desktop Metadata Accessibility
Corporate
Finance
Sales
Line of
Business Mgr
App Dev
Business
Analyst
Custom
App
DBA
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Desktop Metadata Accessibility
Highlight the business term
“Revenue”
Corporate
Finance
Sales
Line of
Business Mgr
App Dev
Business
Analyst
Custom
App
DBA
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Desktop Metadata Accessibility
Pop-up Glossary Terms With
Name Containing “Revenue”
Corporate
Finance
Sales
Line of
Business Mgr
App Dev
Business
Analyst
Custom
App
DBA
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
All Information Available Via Intuitive Search
Get quick
definitions
and related
business
concepts…
…drill down for
availability of
detailed
context, metrics, and
implementations
…link directly to the
metaGlossary
For full details
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Governance Workflow
Scenario
An authorized user (in a role of Author), say Data Steward, enters a Business Term in the Business Metadata Repository. The system validates Author’s identity
and saves the Business Term definition in “CREATED” status. Author submits the new Business Term definition for approval. The status is changed from
“CREATED” to “SUBMITTED.” A notification of the new submitted term is sent to all users granted the Approver role. An approver receives a notification vie
email, enters Business Metadata Repository and reviews and approves the new Business Term. The system creates a production version of the term with
status “APPROVED”. Other users of the Business Metadata Repository can view only those Business Terms that have “APPROVED” status.
Use Case: Workflow Support
INPUT
ACTOR
Business term
definition
1
Authorized business user
(Author) creates Business
Term in Repository
2
Author submits new
Business Term for approval
3
Notification message to
Approvers
4
Approver enters Repository
and approves new
BusinessTerm
5
Authorized users can view
new Business Term
SYSTEM
Validates and saves new
working version of Business
Term definition with CREATED
status
System updates status of
working version of term to
SUBMITTED
Sample data
System creates production
version of term and sets status
to APPROVED
The following table suggests a possible data that can be used as
part of this Use Case:
#
1
2
Data element
Business Term
definition
Business Term
status
Value
Attributes of Business
Term
CREATED
SUBMITTED 
APPROVED
Comments
See Use Case steps for status changes
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Governance Workflow
Dir of
Acctg /
Compliance
VP of
Finance
Financial
Controller
IT
Architect
Quality
Mgr
Governance
Mgr
Membership
Business
Analyst
IT
Architect
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Governance Workflow
Dir of
Acctg /
Compliance
VP of
Finance
Financial
Controller
IT
Architect
Quality
Mgr
Governance
Mgr
Membership
Business
Analyst
IT
Architect
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Governance Workflow
Financial
Controller
IT
Architect
Quality
Mgr
Governance
Mgr
Membership
Business
Analyst
IT
Architect
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Governance Workflow
Dir of
Acctg /
Compliance
VP of
Finance
Financial
Controller
IT
Architect
Quality
Mgr
Governance
Mgr
Membership
Business
Analyst
IT
Architect
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Business/Technical
Metadata Integration
Scenario
Business and technical metadata resides in the Business Metadata Repository. An authorized user (in a role of Author), say Data Architect, edits a Business
Term in the Business Metadata Repository and links it to a technical metadata object (e.g. Table or Column). The system creates a working version of the
Business Term change with “MODIFIED” status. Author submits the Business Term alignment change for approval. The status is changed from “MODIFIED” to
“SUBMITTED.” A notification of the submitted term change is sent to all users granted the Approver role. An approver receives a notification vie email, enters
Business Metadata Repository and reviews and approves the Business Term alignment change. The system creates a production version of the term with
status “APPROVED”. Other users of the Business Metadata Repository can view only those Business Terms that have “APPROVED” status.
Use Case: Business/Technical Metadata Integration
INPUT
ACTOR
Business term
definition
1
Authorized business user
(Author) looks up and links a
Business Term to a
Technical Metadata Object
stored in the Metadata
Repository
2
Author submits change to
Business Term for approval
3
Notification message to
Approvers
4
Approver enters Repository
and approves Business Term
change
5
Authorized users can view
Business Term lineage
change
SYSTEM
Validates and saves new
working version of Business
Term definition with MODIFIED
status
Sample data
The following table suggests a possible data that can
be used as part of this Use Case:
System updates status of
working version of term to
SUBMITTED
System updates production
version of term and sets status
to APPROVED
#
1
Data element
Business Term definition
2
Technical Metadata
definitions
3
Business Term Status
Value
Business Term attributes, such as
Name, Short Description, Long
Description, etc.
Technical metadata elements, such as
entities, attributes, tables, columns,
records, fields, etc.
MODIFIED SUBMITTED 
APPROVED
Comments
See Use Case
steps for status
changes
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Business/Technical
Metadata Integration
Dir of
Acctg /
Compliance
VP of
Finance
Financial
Controller
IT
Architect
Quality
Mgr
Governance
Mgr
Membership
Ext Docs,
URLs, etc.
Business
Analyst
Models
Applications
DW
BI Reports
Databases
ETL
Metadata Repository
IT
Architect
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Business/Technical
Metadata Integration
Dir of
Acctg /
Compliance
VP of
Finance
Financial
Controller
IT
Architect
Quality
Mgr
Governance
Mgr
Membership
Ext Docs,
URLs, etc.
Business
Analyst
Models
Applications
DW
BI Reports
Databases
ETL
Metadata Repository
IT
Architect
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Business/Technical
Metadata Integration
Dir of
Acctg /
Compliance
VP of
Finance
Financial
Controller
IT
Architect
Quality
Mgr
Governance
Mgr
Membership
Ext Docs,
URLs, etc.
Business
Analyst
Models
Applications
DW
BI Reports
Databases
ETL
Metadata Repository
IT
Architect
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Business/Technical
Metadata Integration
Dir of
Acctg /
Compliance
VP of
Finance
Financial
Controller
IT
Architect
Quality
Mgr
Governance
Mgr
Membership
Ext Docs,
URLs, etc.
Business
Analyst
Models
Applications
DW
BI Reports
Databases
ETL
Metadata Repository
IT
Architect
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Business/Technical
Metadata Integration
Global Business Definition
Valid Values
Code DESC
3
Haz of Lead Coverage: exp only
7
Lead Law/Lead Liability
9
Cover for Haz, Full Policy Limits
Physical Deployment: the where and how is it used in our IT Systems
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Metadata Use Case: Integration With Technical Metadata
Business Term
definitions, stewards
and where this
certified term is used
in the IT environment
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Conclusions
Good Use Cases are Crucial to Metadata Projects:
• Pre-Requisite for trial and evaluation of metadata solutions
• An efficient means of capturing functional metadata requirements
(Requirements & Relevance)
• Promotes user involvement (Commitment)
• User and goal oriented (Commitment & Relevance)
• Specifies all the different ways to use the metadata solution (Scope)
• Written in an easy-to-understand structured narrative (Simplicity &
Communication)
• Help close the gap between functional requirements and testing
(Quality)
• Represent the solution benefits supporting a metadata business case
(Commitment, Communication & Relevance)
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Use Case
Demonstration
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Documentation
Client Success Cases +
Examples
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Why ASG ?
25+ Years of Data
Management experience
Recognized leader in the
management of
metadata for data,
process, and technology
The Data Warehousing Institute’s Best
Practice Award in the category of
“Data Governance”
Hundreds of the world’s
largest organizations
trust ASG for solutions to
help manage their data
www.asg.com
Copyright®2012 Allen Systems Group, Inc.
Download