4. March 2013 - Root Cause Analysis

advertisement
Root Cause Analysis
Institute of Internal Audits
(IIA)
March 20, 2013
Introduction

Terry Upshur- Director of Support Services with
the Inspector General of the U.S. House of
Representatives

Lean Six Sigma - Master Black Belt

Certified Government Auditing Professional
(CGAP)

Over 25 Years of Experience in Quality Assurance
Root Cause Analysis
2
Super-Bowl Champions

Teams with better organizations

Teams with better players

Teams with better statistics

Teams with better records
Super-Bowl Championships are based on:

Teams with the best execution in the playoffs

Baltimore Ravens
Root Cause Analysis
3
Overview

Performance Improvement Principles

Root Cause Analysis

Tools and Techniques

Closing Remarks
Root Cause Analysis
4
Exercise Introduction
Scenario # 1 (Answer at the end of the training session)
The Plant Manager walked into the plant and found oil
on the floor. He called the Foreman over and told him
to have maintenance clean up the oil. The next day
while the Plant Manager was in the same area of the
plant he found oil on the floor again and he
subsequentially raked the Foreman over the coals for not
following his directions from the day before. His parting
words were to either get the oil cleaned up or he’d find
someone who would.
Copyright © 2004 Gene Bellinger
5
Process Improvement
Process Improvement Using the
Principles of Lean Six Sigma
Root Cause Analysis
6
Lean Six Sigma Is the Integration of Two
Powerful Business Improvement Approaches...
Lean
Six Sigma
Speed + Waste Elimination
Quality, Cost

Goal – Improve performance on
items Critical to Customer Quality
(CTQs)
Focus – Implementing Waste
reduction tools

Focus – Use DMAIC with (TQM)
tools to eliminate variation
Method – Improvement events
Value Stream Mapping

Method – Management
engagement, dedicated team effort

Goal – Reduce waste and increase
process speed


Lean Speed Enables
Six Sigma Quality
(Faster Cycles of
Experimentation/learning)
Six Sigma Quality Enables
Lean Speed
(Fewer Defects Means
Less Time Spent on Rework)
Efficiency
Root Cause Analysis
Effectiveness
7
What is Six Sigma?

Six Sigma is defined as a method to discover
customer requirements and meet them with
minimal variation.

Supported by a suite of quality/statistical analysis
tools

Concept of Y = f(x1,x2,…) introduced to drive focus
on improving critical process inputs rather than just
outputs (reports, services, deliveries, sales etc.)
Root Cause Analysis
8
Determine Critical X’s
(x)
Y=f(x)
Inputs
(Factors)
Outputs
(Responses)
Operating Budget
Training Budget
System Requirements
Number of People
Operating Hours
Functional Requirements
Process:
Info
Systems
Release
Customer Interface
Skills Selection
Root Cause Analysis
9
Y
Delivery Time
What is Lean?

Lean is defined as a process strategy that uses less
of everything compared with the traditional
process:

Less: human effort, space, investment in tools or
information.

Reduces the number of steps (.90*.90*.90=.72)

Removes waste and non-value added processes
and complexity

Drives speed and increases capacity
Root Cause Analysis
10
Lean Focuses on Eliminating Waste
Defects
Control
Process
Waste
Over Processing
Inventory
Motion
Waiting
Root Cause Analysis
Transportation
11
Over Production
TIMWOOD: An Acronym for WASTE


Transportation:
Inventory:
Transporting something farther than necessary
Excess stock of anything

Motion: Motion unnecessary to successfully completion the task

Waiting: Waiting for anything

Over-processing:
Processing what the customer doesn’t want.

Over-production:
Making to much

Defects:
Root Cause Analysis
Work that needs to be redone
12
DMAIC Problem Solving Methodology
Define
Define the opportunity from both
business and customer
perspectives
Measure
Understand the process
and its performance
Analyze
Search for the key factors (critical X’s)
that have the biggest impact on process
performance and determine the root
causes
Improve
Develop improvement
solutions for the
critical X’s
Control
Root Cause Analysis
13
Implement the
solution and control
plan
Value Add – From the Customer
Perspective
Customer Value Add
(CVA) Questions




Does the task add form, feature,
or function to the process or
service?
Does the task enable a
competitive advantage (reduced
price, faster delivery, fewer
defects)?
Would the customer be willing
to pay extra or prefer us over
the competition if he or she
knew we were doing this task?
Example CVA Activities:
Improved Safety
 Shorter Deliver Times
 Fewer Errors
 Accurate Reporting

Business Value Add
(BVA) Questions
Does this task reduce owner
financial risk?
 Does this task support financial
reporting requirements?
 Would the process of
producing/selling the service break
down if this task were removed?
 Is this task required by law or
regulation?
 Typical BVA Activities:



Reconciliations
Internal Audits
Invoice Processing
 IRS/OSHA/EPA Reporting
 Internal Financial Reporting

Root Cause Analysis
14
Non-Value Add (NVA)
Questions




If the customer knew we were
doing this, would they request
that we eliminate the activity so
we could lower our prices?
Does the task fit into either of
the other two categories?
Can I eliminate or reduce this
activity?
Typical NVA Activities:

Over Inspecting
Transporting/Moving
Stocking/Storing
Rework Loops
Multiple Signoffs

Document Handling




Question
How does all of this relate to audit?
Root Cause Analysis
15
Function of a Finding
A finding allows us to understand what occurred,
how significant the occurrence was, and how we
may be able to reasonably protect against its
reoccurrence.
Root Cause Analysis
16
Root Cause Analysis and Findings
Root cause analysis the elements of a audit findings

Criteria – What should be

Condition - What does exist

Effect – The impact of the difference

Cause – Why the difference exist

Recommendation – What is a possible remedy?
Root Cause Analysis
17
Definition of Root Cause Analysis
A process of determining the causes that led to a
nonconformance, event or undesirable condition and
identifying corrective actions to prevent recurrence
which (when solved) restores the status quo or
establishes a desired effect.
Root Cause Analysis
18
Purpose

Root Cause Analysis helps to identify what, how, and
why something happened, thus preventing recurrence.

Root causes are underlying, are reasonably
identifiable, can be controlled by management and
allow for the generation of recommendations.

The process involves data collection, cause charting,
root cause identification, recommendation generation
and implementation.

Only when you are able to determine why an event or
failure occurred will you be able to specify workable
corrective measures.
Root Cause Analysis
19
Understanding Root Causes

To fix a problem it must be clearly defined. In a lot of
cases the symptom is identified and not the
underlying problem.

For example, buying expired milk is not an inspection
failure its a recall system failure.

Questions to ask are:




What is the scope of the problem?
What else is affected by the problem?
How often does it occur?
What impact will this have on the larger population?
Root Cause Analysis
20
Determining Root Causes
Four steps you can use to identify the Root Cause

Data Collection & Prioritization


Pareto Analysis
Cause Charting

Cause and Effect Diagram (Fishbone)

Root Cause Identification

Recommendation Generation and Implementation
Root Cause Analysis
21
Exercise

All who are active IIA members (Stand)

All that are members of the IIA DC chapter

All who have at least two IIA certifications

All who have volunteered with the chapter in the
last two years

All who would like to volunteer with the chapter
Root Cause Analysis
22
Data Collection

Data collection provides information and an
understanding of causal factors.

Good data collection techniques involve:

Data Types – Attribute or Discrete

Good/Bad, Counts or Percentages

Planning – When, Who, How, Stratification

Check Sheets - Consistency of Data Collection

Measurement System Analysis

Root Cause Analysis
Ensure the data collection process is
“Repeatable and Reproduceable”
23
Pareto Chart

A Pareto chart is a graphical tool to prioritize multiple
problems in a process so you can focus on areas where
the largest opportunities exist.

Pareto charts are a type of bar chart in which the
horizontal axis represents categories of interest.

By ordering the bars from largest to smallest, a Pareto
chart can help you determine which of the defects
comprise the “vital few”, and which are the “trivial many.”

The Pareto principle states that 80% of the effect is
generated by 20% of the causes. We want to focus on the
20%.
Root Cause Analysis
24
Sample Pareto Chart:
Processing Errors
Pareto Chart of Processing Errors
140
100
120
80
80
60
60
40
40
20
20
0
Exception
Count
Percent
Cum %
HHG
73
58.9
58.9
TQ/TA
18
14.5
73.4
GHS
13
10.5
83.9
25
AT
8
6.5
90.3
New Res
7
5.6
96.0
Other
5
4.0
100.0
0
Percent
Count
100
Cause Charting

Provides a structure for analyzing the information
and identifying gaps and deficiencies in
knowledge.

Cause Charting can also take the form of process
mapping. The process map is simply an
illustration that depicts the steps or events
leading up to an occurrence.
Root Cause Analysis
26
Cause and Effect Diagram
(Also Called Fishbone)

What


When


A tool to represent the relationship between an effect
(problem) and its potential causes by category type.
Carried out when a root cause needs to be determined.
Why

To help ensure that a balanced list of ideas have been
generated during brainstorming.

To determine the real cause of
the problem versus a symptom.

To refine brainstormed ideas into
more detailed causes.
Root Cause Analysis
27
Example: Fishbone Diagram
Material
Machine
Discovery of different
discount rates occurs too
late in process
Methods
Computer screens
Updates
Product
Shortages
Power Failures
Master customer discount
table not up-to-date
Management Policies
Incomplete Training on
common complaints
Marketing metrics
counterproductive
Mother Nature
Billing process not
accurate
Too many “jumps”
Measurements
Manpower
Root Cause Analysis
28
Effect: Too many
price adjustments at
check-out
Not enough staffing during
peak times
Unfamiliarity with procedures
For vacation
notification
Notification of
absence
Root Cause Identification

Use the Cause Charts and subject matter experts
(SMEs) to gain a proper understanding of the
event.

Asking the right questions will help address the
actual problem and not the symptoms.

Types of questions to ask:




What is the scope of the problem?
How many problems are there?
What is affected by the problem?
How often does the problem occur?
Root Cause Analysis
29
Root Cause Identification
Tools used to assist with Root Cause Identification:

Data Analysis

Pareto Charts

Fishbone Diagrams

5 Why Technique

Brainstorming

Affinity Diagrams
Root Cause Analysis
30
Root Cause Identification

Reduce the list of potential root causes

Rank root causes using Pareto Analysis
(Statistical)

Rank the items in order of significance
(Organizational)

Identify the items with the most significant
impact
 Time
 Cost
 Manpower
Root Cause Analysis
31
Root Cause Identification

Confirm potential root causes relate to the overall
problem

Validate/Verify that root causes identified have
a causal relationship with the desired output

Ensure the legitimacy of the measurement
system

Ensure results are repeatable and reproducible
Note: If you cannot state the problem simply,
you do not fully understand the problem.
Root Cause Analysis
32
Addressing the Root Cause(s)

Conduct Value Add Analysis

Ensure that items identified will add value to
the organization or customer

Ensure that the items are required by
regulation or policy

Confirm that the item does not add value and
is not needed or required
Root Cause Analysis
33
Recommendation Implementation

Things to consider prior to implementation:

Determine the impact the root causes will have
on critical inputs (X)

Estimate impact of the root cause on over-all
output (Y)
Root Cause Analysis
34
Recommendation Implementation
(Management)


Implement recommendations based on:

Significance to organizational goals and
objectives

Availability of personnel, finances or other
essential resources

Complexity of the implementation
Evaluate controls required to maintain corrective
actions after implementation.
Root Cause Analysis
35
Jefferson Memorial

See Jefferson Memorial Handout
Root Cause Analysis
36
Jefferson Memorial
A few years ago National Parks managers noticed the Jefferson Memorial was crumbling at an alarming rate.
When they asked why, they found out it was being washed far more often than other memorials. For most
organizations, the analysis would stop here. The solution is clear, right? Adjust the cleaning schedule to match
those of the other memorials.
Unfortunately, that solution would have only led to a very dirty Jefferson Memorial. Because when Parks
managers asked about the reason for the frequent washings, they found it had an exceptionally large amount of
bird droppings deposited on it every day (no, this isn't a metaphor -- it really happened). What's the solution
now? Erect scarecrows? Declare open season on pigeons?
Luckily, National Parks managers kept inquiring. And when they asked why the birds seemed to soil Jefferson at
rates higher than they did so to Kennedy or Lincoln, they discovered the Virginian's memorial harbored an
incredibly large population of spiders upon which the birds were feeding. And the population of spiders had
exploded because of an abundance of midges (tiny aquatic insects) in and around the Memorial.
By now, you have the routine down. When Parks managers asked why so many midges congregated on the
Jefferson memorial, they learned what any fly-fisherman finds out his first day on the river: Midges are stimulated
to emerge and mate by a unique quality of light (for the rivers of my home state of Utah, it usually falls between
11 a.m. and 1 p.m. on a cloudy day).
It just so happens park managers were inadvertently creating this unique quality of brightness by turning the
lights on the memorial just before dusk. This one variable caused the whole chain of events -- lots of midges, lots
of spiders, lots of bird droppings, lots of effort on the part of the cleaning crews, and finally, the crumbling of the
statue.
The solution ended up being pretty simple, and actually saved the Parks Department money: Just wait until dark
to turn on the lights.
Businessweek March 14, 2006 , Keith McFarland
37
Definition of the 5 Whys

The 5 Whys is an iterative question-asking
technique used to explore the cause-and-effect
relationships underlying a particular problem.

The primary goal of the technique is to determine
the root cause of a defect or problem. (The "5" in
the name derives from an empirical observation
on the number of iterations typically required to
resolve the problem.)
Root Cause Analysis
38
Benefits of the 5 Whys

Help identify the root cause of a problem.

Determine if there is a relationship between
different root causes of a problem.

Simplicity; easy to complete without statistical
analysis.

Effective when problems involve human factors or
interactions.
Root Cause Analysis
39
Root Cause Analysis
Ask "Why?" 5 Times
Effect
Computer Storage Costs Too High
1. Why? Users keep too many large files as email
attachments
2. Why? Users don’t know that this results in
an extra charge to the company
3. Why? Email policy not communicated
4. Why? Official email policy not
defined
______________
1. Why?
2. Why?
3. Why?
4. Why?
5. Why?
Root Cause Analysis
5. Etc….
40
5 Why Example
Refer Back to Scenario #1
How would you suggest the Plant Manager address
the oil on to the floor?
Do you see an opportunity to use any of the tools
we discussed?
See Scenario #2
Root Cause Analysis
41
5 Why Example (Scenario #2)
The Plant Manager walked into the plant and found oil on the floor. He called the Foreman
over and asked him why there was oil on the floor. The Foreman indicated that it was due
to a leaky gasket in the pipe joint above. The Plant Manager then asked when the gasket
had been replaced and the Foreman responded that Maintenance had installed 4 gaskets
over the past few weeks and that each one seemed to leak. The Foreman also indicated that
Maintenance had been talking to Purchasing about the gaskets because it seemed they were
all bad. The Plant Manager then went to talk with Purchasing about the situation with the
gaskets. The Purchasing Manager indicated that they had in fact received a bad batch of
gaskets from the supplier. The Purchasing Manager also indicated that they had been trying
for the past 2 months to try to get the supplier to make good on the last order of 5,000
gaskets that all seemed to be bad. The Plant Manager then asked the Purchasing Manager
why they had purchased from this supplier if they were so disreputable and the Purchasing
Manager said because they were the lowest bidder when quotes were received from various
suppliers. The Plant Manager then asked the Purchasing Manager why they went with the
lowest bidder and he indicated that was the direction he had received from the VP of
Finance. The Plant Manager then went to talk to the VP of Finance about the situation.
When the Plant Manager asked the VP of Finance why Purchasing had been directed to
always take the lowest bidder the VP of Finance said, "Because you indicated that we had to
be as cost conscious as possible!" and purchasing from the lowest bidder saves us lots of
money. The Plant Manger was horrified when he realized that he was the reason there was
oil on the plant floor. Bingo!
Copyright © 2004 Gene Bellinger
42
Table Top Exercise

Problem Statement 1: You have to spend more and
more money on your utility bills.

Problem Statement 2: Your boss is unhappy because he
has received work-papers that don’t meet this
expectations.

Problem Statement 3: You frequently arrive to work late
in the mornings and you are faced with disciplinary
action if you don’t correct it immediately.

Problem Statement 4: You do not have enough money
to retire comfortably.
Root Cause Analysis
43
Table Top Reporting

Each group take 5 minutes to report on 5 Why
Exercise

What were your questions

What were some potential root causes?
Root Cause Analysis
44
Closing Remarks

Appreciate that Process Improvement is a proven
and established methodology that has been
successfully implemented by corporate, academic,
and government agencies.

You have gained an appreciation for the value of
Root Cause Analysis and the part it plays in
responding to recommendations

You have become familiar with the 5 why process
and find it useful.
Closing Remarks
45
Questions?
 Terry
Upshur
terry.upshur@mail.house.gov
Closing Remarks
46
Download