“Understanding future effects of today’s decisions.”
The
Technical Risk Identification
and Mitigation System
(TRIMS)
September, 2009
WILLCOR, Inc ● 4321 Hartwick Rd, Suite 310 ● College Park, MD 20740 ● 240.465.1555
Proudly supporting:
Courtesy of WILLCOR
Applications Development Group
www.willcor.com
Understanding Future Effects of Today’s Decisions
0
The Beginning of Process-Based Risk Management
1960-1980
Many programs failing or suffering cost/schedule overruns
1983-1984
Defense Science Board studies the problem; publishes findings in
DOD 4245.7-M (The “Willoughby Templates”)
1985
Best Manufacturing Practices Program established to help the U.S. Defense
Industrial Base - BMP conducts first Survey (Texas Instruments)
1986
BMP publishes NAVSO P-6071 (Best Practices Book)
1987
BMP contracts with Bell Labs to write more detail on each Template
1991
First version of PMWS is created
1993
BMP Center of Excellence established in College Park, MD
2000
BMP conducts 100th Survey (Northrop Grumman)
Understanding Future Effects of Today’s Decisions
1
The Beginning of Process-Based Risk Management
1960-1980
Many programs failing or suffering cost/schedule overruns
1983-1984
Defense Science Board
studies the problem; publishes
findings in
Processed-based
risk management
DOD 4245.7-M (The “Willoughby Templates”)
1985
came about as
a Program
result of
the acquisition
Best Manufacturing Practices
established
to help the U.S. Defense
problems
occurred
Industrial Base - BMP conducts
first Surveythat
(Texas
Instruments)
in the ’60s and ’70s.
1986
BMP publishes NAVSO P-6071 (Best Practices Book)
1987
BMP contracts with Bell Labs to write more detail on each Template
1991
First version of PMWS is created
1993
BMP Center of Excellence established in College Park, MD
2000
BMP conducts 100th Survey (Northrop Grumman)
Understanding Future Effects of Today’s Decisions
2
The Beginning of Process-Based Risk Management
1960-1980
Many programs failing or suffering cost/schedule overruns
1983-1984
Defense Science Board studies the problem; publishes findings in
DOD 4245.7-M (The “Willoughby Templates”)
1985
Best Manufacturing Practices Program established to help the U.S. Defense
Industrial Base - BMP conducts
first Survey
(Texas Instruments)
In 1983,
the Defense
Science
1986
BMP publishes NAVSO P-6071 (Best Practices Book)
1987
Board convened a group of
academics, government experts,
members
ofonindustry
BMP contracts with Bell Labsand
to write
more detail
each Template
to study the issue.
1991
First version of PMWS is created
1993
BMP Center of Excellence established in College Park, MD
2000
BMP conducts 100th Survey (Northrop Grumman)
Understanding Future Effects of Today’s Decisions
3
Problem Areas Identified by DSB
They discovered that most programs failed
because of basic engineering process issues,
rather than high-technology issues.
Money Phasing
Failure Reporting System
Transition Plan
Design Reference Mission Profile
Uniform Test Report
Modernization
Design Requirements
Software Test
Factory Improvements
Trade Studies
Design Limit
Productivity Center
Design Policy
Life
Logistics Support Analysis
Design Process
Test, Analyze & Fix (TAAF)
Manpower & Personnel
Design Analysis
Field Feedback
Support & Test Equipment
Parts & Material Selection
Manufacturing Plan
Training Materials & Equipment
Software Design
Qualify Manufacturing Process
Spares
Computer-Aided Design (CAD)
Piece Part Control
Technical Manuals
Design for Testing
Subcontractor Control
Manufacturing Strategy
Built-In Test (BIT)
Defect Control
Personnel Requirements
Configuration Control
Tool Planning
Data Requirements
Design Reviews
Special Test Equipment (STE)
Technical Risk Assessment
Design Release
Computer-Aided Manufacturing (CAM)
Production Breaks
Integrated Test
Manufacturing Screening
Understanding Future Effects of Today’s Decisions
4
Problem Areas Identified by DSB
They also established that most program
failures were the result of one or more of the
47 issues shown here.
Money Phasing
Failure Reporting System
Transition Plan
Design Reference Mission Profile
Uniform Test Report
Modernization
Design Requirements
Software Test
Factory Improvements
Trade Studies
Design Limit
Productivity Center
Design Policy
Life
Logistics Support Analysis
Design Process
Test, Analyze & Fix (TAAF)
Manpower & Personnel
Design Analysis
Field Feedback
Support & Test Equipment
Parts & Material Selection
Manufacturing Plan
Training Materials & Equipment
Software Design
Qualify Manufacturing Process
Spares
Computer-Aided Design (CAD)
Piece Part Control
Technical Manuals
Design for Testing
Subcontractor Control
Manufacturing Strategy
Built-In Test (BIT)
Defect Control
Personnel Requirements
Configuration Control
Tool Planning
Data Requirements
Design Reviews
Special Test Equipment (STE)
Technical Risk Assessment
Design Release
Computer-Aided Manufacturing (CAM)
Production Breaks
Integrated Test
Manufacturing Screening
Understanding Future Effects of Today’s Decisions
5
Problem Areas Identified by DSB
These 47 areas were then
organized into 8 categories…
TEST:
Integrated Test
Money Phasing
DESIGN:
Transition Plan
Failure Reporting System
Uniform Test Report
FUNDING:
TRANSITION:
FACILITIES:
Software Test
Modernization
Design Limit
Factory Improvements
Life
Productivity Center
Test, Analyze & Fix (TAAF)
Design Reference Mission Profile
Field Feedback
Design Requirements
LOGISTICS:
Logistics Support Analysis
Trade Studies
PRODUCTION:
Manpower & Personnel
Design Policy
Manufacturing Plan
Support & Test Equipment
Design Process
Qualify Manufacturing Process
Training Materials & Equipment
Design Analysis
Piece Part Control
Spares
Parts & Material Selection
Subcontractor Control
Technical Manuals
Software Design
Defect Control
Computer-Aided Design (CAD)
Tool Planning
Design for Testing
Special Test Equipment (STE)
Manufacturing Strategy
Built-In Test (BIT)
Computer-Aided Manufacturing (CAM)
Personnel Requirements
Configuration Control
Manufacturing Screening
Data Requirements
MANAGEMENT:
Design Reviews
Technical Risk Assessment
Design Release
Production Breaks
Understanding Future Effects of Today’s Decisions
6
DoD 4245.7-M
…and the results were published
in DoD 4245.7-M, where they
came to be known as
“The Willoughby Templates”.
Understanding Future Effects of Today’s Decisions
7
NAVSO P-6071
In 1986, the Best Manufacturing
Practices (BMP) Program published
NAVSO P-6071, also known as
“The Best Practices Book”
Understanding Future Effects of Today’s Decisions
8
NAVSO P-6071 (Best Practices Book)
Design Reference Mission Profile
TRAPS: 1. Military Specification environments are used
2.
3.
4.
The contractor interprets system performance requirements
Mission profile emphasizes tactical mission
Operational requirements define the mission profile
Understanding Future Effects of Today’s Decisions
9
NAVSO P-6071 (Best Practices Book)
Design Reference Mission Profile
TRAPS: 1. Military Specification environments are used
2.
3.
4.
The contractor interprets system performance requirements
Mission profile emphasizes tactical mission
Operational requirements define the mission profile
This book takes each
of the 47 Template
areas described in
DoD 4245.7-M,
and identifies the 4
major traps that
programs are likely to
encounter.
Understanding Future Effects of Today’s Decisions
10
NAVSO P-6071 (Best Practices Book)
Design Reference Mission Profile
TRAPS: 1. Military Specification environments are used
2.
3.
4.
The contractor interprets system performance requirements
Mission profile emphasizes tactical mission
Operational requirements define the mission profile
This book takes each
of the 47 Template
areas described in
DoD 4245.7-M,
and identifies the 4
major traps that
programs are likely to
encounter.
Understanding Future Effects of Today’s Decisions
11
NAVSO P-6071 (Best Practices Book)
Design Reference Mission Profile
TRAPS: 1. Military Specification environments are used
2.
3.
4.
The contractor interprets system performance requirements
Mission profile emphasizes tactical mission
Operational requirements define the mission profile
It identifies the
consequences of falling
into each trap, and
alarms that indicate that
this might be
happening.
Understanding Future Effects of Today’s Decisions
12
NAVSO P-6071 (Best Practices Book)
Design Reference Mission Profile
TRAPS: 1. Military Specification environments are used
2.
3.
4.
The contractor interprets system performance requirements
Mission profile emphasizes tactical mission
Operational requirements define the mission profile
It also identifies the
best practices for
(and the benefits of)
avoiding each trap.
Understanding Future Effects of Today’s Decisions
13
NAVSO P-6071 (Best Practices Book)
Design Reference Mission Profile
TRAPS: 1. Military Specification environments are used
2.
3.
4.
The contractor interprets system performance requirements
Mission profile emphasizes tactical mission
Operational requirements define the mission profile
It also identifies the
best practices for
(and the benefits of)
avoiding each trap.
Understanding Future Effects of Today’s Decisions
14
NAVSO P-6071 (Best Practices Book)
Design Reference Mission Profile
The book then includes checklist questions covering
the best practices for each Template.
Checklist
►
Questions
CHECKLIST

Have mission functional and environmental profiles been prepared by the government and
included in the request for proposals?

Has the contractor used detailed mission functional and environmental profiles to establish
requirements and design margins for the system and its component parts?

Are mission functional and environmental profiles updated as test data warrants?

Have design life cycle system profiles been developed by the contractor and agreed to by the
government?
Understanding Future Effects of Today’s Decisions
15
Some Things To Consider
•
Defense Science Board Studies Determined that 80% of all Programs that Fail,
Fail for Engineering not Technology Reasons
•
Example: N43 Reports that Over 65% of all Fleet Reliability Problems are
Due to Inadequate Design
•
February 1998 GAO Report to the Subcommittee on Acquisition & Technology,
Committee on Armed Services, U. S. Senate
•
•
•
March 2005 GAO Report:
•
•
•
Since 1975 Schedule Overruns Average 24%
Weapon Systems Overruns Cost 20% - 40%
Average Cost Increase Will be 28.5% in Only 4 Years
Reason: “Armed services order hardware with unproven technology,
with too little time allowed for perfecting that technology before contractors attempt to
insert it into weapons systems...”
With Acquisition Reform and Performance Specifications, We Must Monitor the
Engineering Process to Understand Program Risks
Do Not Get Technology Tunnel Vision
Understanding Future Effects of Today’s Decisions
16
Some Things To Consider
•
Defense Science Board Studies Determined that 80% of all Programs that Fail,
Fail for Engineering not Technology Reasons
•
Example: N43 Reports that Over 65% of all Fleet Reliability Problems are
Due to Inadequate Design
•
February 1998 GAO Report to the Subcommittee on Acquisition & Technology,
Committee on Armed Services, U. S. Senate
•
•
•
March 2005 GAO Report:
•
•
•
Since 1975 Schedule Overruns Average 24%
Weapon Systems Overruns Cost 20% - 40%
Unfortunately, too many
programs are still having the
same problems today!
Average Cost Increase Will be 28.5% in Only 4 Years
Reason: “Armed services order hardware with unproven technology,
with too little time allowed for perfecting that technology before contractors attempt to
insert it into weapons systems...”
With Acquisition Reform and Performance Specifications, We Must Monitor the
Engineering Process to Understand Program Risks
Do Not Get Technology Tunnel Vision
Understanding Future Effects of Today’s Decisions
17
So what is the answer?
Understanding Future Effects of Today’s Decisions
18
TRIMS
Technical Risk Identification
& Mitigation System
Understanding Future Effects of Today’s Decisions
19
What Is TRIMS?
• TRIMS (Technical Risk Identification & Mitigation System):
A Methodology for Doing Knowledge-Based,
Process-Oriented Risk Management
• Part of the Program Manager’s WorkStation (PMWS) Tool suite
(Navy Owned, Fixed Revision Cycle)
• Outgrowth of DoD 4245.7-M and NAVSO P-6071 Templates
• Fully Compatible with BMPCOE Combined Government / Industry
Systems Engineering Model
• Fully Supported: Training Classes, Computer-Based Training,
On-line Help, 24-hour Help Desk
Process Based and Predictive
Understanding Future Effects of Today’s Decisions
20
What Is TRIMS?
• TRIMS (Technical Risk Identification & Mitigation System):
TRIMS is a process-based risk management tool, that
A Methodology for Doing Knowledge-Based,
grew out of the checklist questions in NAVSO P-6071.
Process-Oriented Risk Management
• Part of the Program Manager’s WorkStation (PMWS) Tool suite
(Navy Owned, Fixed Revision Cycle)
• Outgrowth of DoD 4245.7-M and NAVSO P-6071 Templates
• Fully Compatible with BMPCOE Combined Government / Industry
Systems Engineering Model
• Fully Supported: Training Classes, Computer-Based Training,
On-line Help, 24-hour Help Desk
Process Based and Predictive
Understanding Future Effects of Today’s Decisions
21
TRIMS Proactive Methodology
Risk Assessment
Guidance
Documents
Engineering
Process Model
Statistics
Probability
Past
Experience
Effect
Planning &
Tracking
System
Architecture
Mission Profile
Schedule
Quality
Cost
Risk Management
Milestone
Dates
Personnel
Assignments
Question
Weighting
Due Dates
Compliance
Status
References
Risks
TRIMS
• Risk Management
Next Actions
• Snapshot Assessments
Responsibilities
• Multiple Program Rollups
Action Item
Tracking
• Automatic Updates
Understanding The Future Effects Of Today's Decisions
Understanding Future Effects of Today’s Decisions
22
TRIMS Proactive Methodology
“Risk” is a function of
probability and effect.
Determining these for
Guidance
your program
is
Documents
Engineering
“Risk Assessment”.
Process Model
Statistics
Risk Assessment
Probability
Past
Experience
Effect
Planning &
Tracking
System
Architecture
Mission Profile
Schedule
Quality
Cost
Risk Management
Milestone
Dates
Personnel
Assignments
Question
Weighting
Due Dates
Compliance
Status
References
Risks
TRIMS
• Risk Management
Next Actions
• Snapshot Assessments
Responsibilities
• Multiple Program Rollups
Action Item
Tracking
• Automatic Updates
Understanding The Future Effects Of Today's Decisions
Understanding Future Effects of Today’s Decisions
23
TRIMS Proactive Methodology
Risk Assessment
Guidance
Documents
Engineering
Process Model
Statistics
Probability
Past
Experience
Effect
Planning &
Tracking
System
Architecture
Mission Profile
Schedule
Quality
Cost
Risk Management
To do “Risk Milestone
Management” you
Dates
also have to do planning and
Personnel
tracking:Assignments
establish a plan to
Question
mitigate your
risks, and then •
Weighting
track it to ensure that the plan is•
Due Dates
being followed,
and that it is •
Compliance
Status effect!
having the desired
•
References
Risks
TRIMS
Risk Management
Next Actions
Snapshot Assessments
Responsibilities
Multiple Program Rollups
Action Item
Tracking
Automatic Updates
Understanding The Future Effects Of Today's Decisions
Understanding Future Effects of Today’s Decisions
24
TRIMS Proactive Methodology
Risk Assessment
Guidance
Documents
Engineering
Process Model
Statistics
Probability
Past
Experience
Effect
Planning &
Tracking
Mission Profile
Schedule
System
Qualityall of these
Architecture
TRIMS provides
Cost
capabilities, plus analysis, reporting, and
workload-reduction features!
Risk Management
Milestone
Dates
Personnel
Assignments
Question
Weighting
Due Dates
Compliance
Status
References
Risks
TRIMS
• Risk Management
Next Actions
• Snapshot Assessments
Responsibilities
• Multiple Program Rollups
Action Item
Tracking
• Automatic Updates
Understanding The Future Effects Of Today's Decisions
Understanding Future Effects of Today’s Decisions
25
Proactive vs. Reactive
The TRIMS philosophy
recognizes that before you
have schedule slippages and
cost overruns, you have
technical issues.
Schedule Slippage
Cost Overruns
TRIMS Identifies the Root Causes of Cost & Schedule Problems
Understanding Future Effects of Today’s Decisions
26
Proactive vs. Reactive
Technical Issues
The TRIMS philosophy
recognizes that before you
have schedule slippages and
cost overruns, you have
technical issues.
Schedule Slippage
Cost Overruns
TRIMS Identifies the Root Causes of Cost & Schedule Problems
Understanding Future Effects of Today’s Decisions
27
Proactive vs. Reactive
And before you have technical
issues, you have failures in
your engineering processes.
Process Risks
Technical Issues
Schedule Slippage
Cost Overruns
TRIMS Identifies the Root Causes of Cost & Schedule Problems
Understanding Future Effects of Today’s Decisions
28
Proactive vs. Reactive
Proactive
Analyzing your processes
can provide early indication
of potential problems.
Process Risks
Technical Issues
Schedule Slippage
Reactive
Cost Overruns
TRIMS Identifies the Root Causes of Cost & Schedule Problems
Understanding Future Effects of Today’s Decisions
29
Evolution of Risks
T1
T2
T3
T4
T5
T6
Another way to look
at this...
Process
Risks
“A ‘Problem’ Is A Risk Whose Time Has Come”
Understanding Future Effects of Today’s Decisions
30
Evolution of Risks
T1
T2
T3
T4
T5
T6
A Process issue that
is left unchecked can
lead to one or more
Product issues.
Process
Risks
“A ‘Problem’ Is A Risk Whose Time Has Come”
Understanding Future Effects of Today’s Decisions
31
Evolution of Risks
T1
T2
T3
T4
T5
T6
A Process issue that
is left unchecked can
lead to one or more
Product issues.
Process
Risks
Product
Risks
“A ‘Problem’ Is A Risk Whose Time Has Come”
Understanding Future Effects of Today’s Decisions
32
Evolution of Risks
T1
T2
T3
T4
T5
T6
And Product issues that
are left unchecked
can lead to Problems.
Process
Risks
Product
Risks
“A ‘Problem’ Is A Risk Whose Time Has Come”
Understanding Future Effects of Today’s Decisions
33
Evolution of Risks
T1
T2
T3
T4
T5
T6
And Product issues that
are left unchecked
can lead to Problems.
Process
Risks
Product
Risks
Problems
“A ‘Problem’ Is A Risk Whose Time Has Come”
Understanding Future Effects of Today’s Decisions
34
Evolution of Risks
T1
T2
Process
Risks
By
focusing on
good
T3
T4
T5
engineering processes, it
becomes possible to avoid
many typical problems that
programs encounter.
Product
Risks
T6
Problems
“A ‘Problem’ Is A Risk Whose Time Has Come”
Understanding Future Effects of Today’s Decisions
35
Evolution of Risks
T1
T2
Process
Risks
By
focusing on
good
T3
T4
T5
engineering processes, it
becomes possible to avoid
many typical problems that
programs encounter.
Product
Risks
T6
Problems
“A ‘Problem’ Is A Risk Whose Time Has Come”
Understanding Future Effects of Today’s Decisions
36
Cost To Mitigate Increases Exponentially
Design
Test
Production
Cost to Mitigate
$100
$10
$1
We also know that
the cost of resolving
issues tends to
increase by [roughly]
an order of magnitude
from one phase to
the next.
Time
Understanding Future Effects of Today’s Decisions
37
Cost To Mitigate Increases Exponentially
Design
Test
Production
Cost to Mitigate
Problems
Product Risks
Process Risks
So, focusing on
process risks just
makes good
economic sense.
Time
Risk Management or Damage Control?
Understanding Future Effects of Today’s Decisions
38
TRIMS Baseline Templates
DESIGN
TEST
PRODUCT
TQM
FUNDING
Money
Phasing
PRODUCTION
• Design Refer. Mission Profile • Integrated Test
FACILITIES
• Manufacturing Plan
• Modernization
• Failure Reporting
System
• Qualify Manufacturing
Process
• Factory
Improvements
• Design Policy
• Uniform Test
Report
• Piece Part Control
• Productivity
Center
• Design Process
• Software Test
• Design Analysis
• Design Limit
• Parts & Mater. Selection
• Life
• Software Design
• Test, Analyze &
Fix (TAAF)
• Design Requirements
• Trade Studies
•
Computer-Aided Design (CAD)
• Design for Testing
• Built-In Test (BIT)
• Field Feedback
• Subcontractor Control
• Defect Control
• Tool Planning
• Special Test
Equipment (STE)
Shown here are the original
“Willoughby Templates”,
from DoD 4245.7-M.
LOGISTICS
• Logistics Support
Analysis
• Manpower &
Personnel
MANAGEMENT
• Manufacturing Strategy
• Personnel Requirements
• Data Requirements
• Support & Test
Equipment
• Technical Risk
Assessment
• Training Materials
& Equipment
• Production Breaks
• Spares
• Technical Manuals
• CAM
• Manufacturing
Screening
• Configuration Control
• Design Reviews
• Design Release
TRANSITION PLAN
Understanding Future Effects of Today’s Decisions
39
TRIMS Baseline Templates
DESIGN
TEST
PRODUCT
TQM
FUNDING
Money
Phasing
PRODUCTION
• Design Refer. Mission Profile • Integrated Test
FACILITIES
• Manufacturing Plan
• Modernization
• Failure Reporting
System
• Qualify Manufacturing
Process
• Factory
Improvements
• Design Policy
• Uniform Test
Report
• Piece Part Control
• Productivity
Center
• Design Process
• Software Test
• Design Analysis
• Design Limit
• Parts & Mater. Selection
• Life
• Software Design
• Test, Analyze &
Fix (TAAF)
• Design Requirements
• Trade Studies
•
Computer-Aided Design (CAD)
• Design for Testing
• Built-In Test (BIT)
• Configuration Control
• Design Reviews
• Design Release
• Field Feedback
• Subcontractor Control
• Defect Control
• Tool Planning
• Special Test
Equipment (STE)
Shown here are the original
“Willoughby Templates”,
from DoD 4245.7-M.
LOGISTICS
• Logistics Support
Analysis
• Manpower &
Personnel
MANAGEMENT
• Manufacturing Strategy
• Personnel Requirements
• Data Requirements
• Support & Test
Equipment
• Technical Risk
Assessment
• Training Materials
& Equipment
• Production Breaks
• Spares
• Technical Manuals
• CAM
• Manufacturing
Screening
CAM
•Manufacturing
Screening
TRANSITION PLAN
Understanding Future Effects of Today’s Decisions
40
TRIMS Baseline Templates
The TRIMS SE Model includes the
original 47 Templates, plus another
21 templates that BMPCOE has
added over the years – the principles
have been around for 20 years, but
the model is up-to-date!
DESIGN
TEST
PRODUCT
TQM
FUNDING
Money
Phasing
PRODUCTION
• Design Refer. Mission Profile • Integrated Test
FACILITIES
• Manufacturing Plan
• Modernization
• Failure Reporting
System
• Qualify Manufacturing
Process
• Factory
Improvements
• Design Policy
• Uniform Test
Report
• Piece Part Control
• Productivity
Center
• Design Process
• Software Test
• Design Analysis
• Design Limit
• Parts & Mater. Selection
• Life
• Software Design
• Test, Analyze &
Fix (TAAF)
• Design Requirements
• Trade Studies
•
Computer-Aided Design (CAD)
• Design for Testing
• Field Feedback
• Built-In Test (BIT)
• TEMP
Development/
Execution
• Configuration Control
• Design Reviews
• Design Release
• Concept Studies & Analysis
• Bread Board Development
• Brass Board Development
• Specification Dev/Allocation/
Validation
• Design for Assembly
• Prototype Development &
Review
• Software
Simulator
• Subcontractor Control
• Defect Control
• Tool Planning
• Field Visits/Site
Surveys
Cost
Assessment
LOGISTICS
• Logistics Support
Analysis
• Manpower &
Personnel
• Manufacturing Strategy
• Personnel Requirements
• Data Requirements
• Support & Test
Equipment
• Technical Risk
Assessment
• Training Materials
& Equipment
• Production Breaks
• Special Test
Equipment (STE)
• Spares
• CAM
• Logistics Analysis
Documentation
• Manufacturing
Screening
MANAGEMENT
• Technical Manuals
• Determining Defining
Need for System
• Prepare Requirement
Documents
• Quality Assurance
• Design/Milestone
Review Planning
CAM
•Manufacturing
Screening
•Production Fabrication
•Environmental Issues
• Production Fabrication
• Make or Buy Decisions
• Environmental Issues
• Technology Base
Analysis
• Schedule & Planning
• Dim. Manuf. Sources &
Mat. Shortage (DMSMS)
New PMWS
Templates
TRANSITION PLAN
Understanding Future Effects of Today’s Decisions
41
TRIMS Tailoring
TRIMS Hierarchy
Funding
Design
Test
Production
Facilities
Management
Logistics
Transition
Plan
3 Tiers: Category
The TRIMS approach to risk is
based on “Process Templates”,
that contain smart questions.
Template
Knowledge
Base
Question
Understanding Future Effects of Today’s Decisions
4.0 Design
4.6 Design Analysis
4.6.1 Do the contractor's corporate
standards identify design analysis as
an integral part of the design
process?
42
TRIMS Tailoring
TRIMS Hierarchy
Funding
Design
Test
Production
Facilities
Management
Logistics
Transition
Plan
3 Tiers: Category
Template
These questions help determine
your risk exposure in each
process-risk area.
Knowledge
Base
Question
Understanding Future Effects of Today’s Decisions
4.0 Design
4.6 Design Analysis
4.6.1 Do the contractor's corporate
standards identify design analysis as
an integral part of the design
process?
43
TRIMS Tailoring
TRIMS Hierarchy
Funding
Design
Test
Production
Facilities
Management
Logistics
Transition
Plan
TRIMS is flexible…
You can add your own
Questions to any Template.
3 Tiers: Category
User
Added
Questions
Template
Knowledge
Base
Question
Understanding Future Effects of Today’s Decisions
4.0 Design
4.6 Design Analysis
4.6.1 Do the contractor's corporate
standards identify design analysis as
an integral part of the design
process?
44
TRIMS Tailoring
TRIMS Hierarchy
Funding
Design
Test
Production
Facilities
Management
Logistics
Transition
Plan
You can add your own
Templates...
User
Added
Templates
3 Tiers: Category
User
Added
Questions
Template
Knowledge
Base
Question
Understanding Future Effects of Today’s Decisions
4.0 Design
4.6 Design Analysis
4.6.1 Do the contractor's corporate
standards identify design analysis as
an integral part of the design
process?
45
TRIMS Tailoring
TRIMS Hierarchy
Funding
Design
Test
Production
Facilities
Management
Logistics
User
Added
Categories
Transition
Plan
…or even add entire
Categories!
User
Added
Templates
3 Tiers: Category
User
Added
Questions
Template
Knowledge
Base
Question
Understanding Future Effects of Today’s Decisions
4.0 Design
4.6 Design Analysis
4.6.1 Do the contractor's corporate
standards identify design analysis as
an integral part of the design
process?
46
TRIMS Tailoring
You can even start with
a blank sheet of paper,
and build an entire
model from scratch!
3 Tiers: Category
Template
Knowledge
Base
Question
Understanding Future Effects of Today’s Decisions
4.0 Design
4.6 Design Analysis
4.6.1 Do the contractor's corporate
standards identify design analysis as
an integral part of the design
process?
47
Tailoring TRIMS To Your Needs
• Identify Risks Before they Become Problems
Some of the benefits of
TRIMS’ flexibility.
• Build YOUR Knowledge into TRIMS
– Use the Systems Engineering Knowledge Base as a Starting Point for
A Good Engineering Process
• Create a Concrete, Repeatable Process for Evaluating &
Comparing Programs & Contractors
• Ease the Learning Curve for New Employees
• Retain Knowledge of Lost Employees
• Share Knowledge
• To Maximize Benefits of Using TRIMS
– Apply as Early as Possible in Program Life
– Apply to All Subcontractors, Divisions & Vendors Involved
– Use Tool Regularly to Prioritize Resources & Make Decisions
Understanding Future Effects of Today’s Decisions
48
TRIMS Knowledge Models
• Existing (Released) Models
•
•
•
•
Systems Engineering
Software Risk Engineering (Carnegie Mellon)
Circuit Card Testability
Interoperability and Integration
TRIMS can be used to
track any process-based
risk model… and it
comes with a variety of
knowledge models.
• Existing (Beta) Models
• Human Factors Engineering
• Development (Prototype) Models
• Management
• Port Security/Force Protection
• SBIR ◄ ◄ ◄
TRIMS Has Many Applications
Understanding Future Effects of Today’s Decisions
49
A Quick Look At TRIMS
A high level view gives
an instant “snapshot”
of your program.
Understanding Future Effects of Today’s Decisions
50
A Quick Look At TRIMS
Answering the “Smart Questions”
helps determine risk levels;
“Next Actions” help mitigate
process risks.
Understanding Future Effects of Today’s Decisions
51
A Quick Look At TRIMS
A variety of filtering
options make it easy
to review and
analyze risk data.
Understanding Future Effects of Today’s Decisions
52
A Quick Look At TRIMS
APM Missile Body [Process Risks]
Likelihood
Performance
A-14
5
A-29
You can print reports at
4
both the summary level...
A-10
A-51
A-02
3
A-35
A-15
A-13
A-04
A-07
A-06
A-49
A-11
A-23
A-31
A-50
A-18
A-43
2
A-36
A-05
A-17
A-01
1
A-48
1
A-08
2
3
4
Impact (Cf) - Performance
A-12
A-03
2
1
5
4
3
4
4
5
4
4
5
4
4
4
3
4
4
4
4
4
3
3
1
4
4
4
A-01 Money Phasing [A-1.0]
A-02 Cost Assessment [A-1.0]
A-03 Design Reference Mission Profile [A-2.0]
A-04 Design Requirements [A-2.0]
A-05 Trade Studies [A-2.0]
A-06 Design Policy [A-2.0]
A-07 Design Process [A-2.0]
A-08 Design Analysis [A-2.0]
A-10 Software Design [A-2.0]
A-11 Computer-Aided Design (CAD) [A-2.0]
A-12 Design for Testing [A-2.0]
A-13 Built-In Test (BIT) [A-2.0]
A-14 Configuration Control [A-2.0]
A-15 Design Reviews [A-2.0]
A-17 Concept Studies and Analysis [A-2.0]
A-18 Bread Board Development [A-2.0]
A-23 Integrated Test [A-3.0]
A-29 Test, Analyze, And Fix (TAAF) [A-3.0]
A-31 TEMP Development/Execution [A-3.0]
A-35 Piece Part Control [A-4.0]
A-36 Subcontractor Control [A-4.0]
A-43 Environmental Issues [A-4.0]
A-48 Field Visits/Site Surveys [A-6.0]
A-49 Logistics Support Analysis [A-7.0]
A-50 Manpower and Personnel [A-7.0]
A-51 Support and Test Equipment [A-7.0]
5
Impact/Risk Profile
Page: 2
Printed: 23 Sep 2009
Understanding Future Effects of Today’s Decisions
53
A Quick Look At TRIMS
APM Missile Body [Product Risks]
B-1.1.2 SRB Fuel
Performance Risk:
B-03 Fuel Components Mixing
Impacts: 4 5 4 4
P | Sa| C | Sc
Last Updated:
Performer:
09/21/2009
Derek Designer
Additional Data:
Priority
Watch List
New
External
UDF (E)
Status:
Resolution:
High Risk
Risk ID:
Risk Level: 4
Description: Fuel components mixing in present facility may not be possible without safety upgrade.
Active
Pending
Likelihood
5
Notes:
(Note: facility is due for OSHA inspection within the next year!)
Action
Due Date
i
-- -- --
1
(Initial Risk Level)
?, ? (High)
26 Sep 2009
Look up current safety regulations
4, 4 (High)
2
7 Oct 2009
Identify necessary upgrades
4, 4 (High)
3
16 Oct 2009
Conduct Safety Training
4
27 Nov 2009
Install new equipment
4
i
3
New Risk
Lik, Imp (Lvl)
Mitigation Actions
1
2
3, 4 (Med)detail!
…and in more
3, 2 (Low)
3
4
2
1
1
2
3
4
5
Impact Factor (Cf)
Page: 1
Printed: 23 Sep 2009
Understanding Future Effects of Today’s Decisions
54
TRIMS - Total Risk Management
3
P RM
Problem, Product & Process
Risk Management,
in a Single Tool!
Understanding Future Effects of Today’s Decisions
55
How To Get Help Using TRIMS
• Use the Help menus
• Use the Computer-Based Training (CBT) Videos
• Available on PMWS CD and on BMP’s Website (www.bmpcoe.org)
• These are Animated & Narrated Tours Showing Each Step of
Using TRIMS
• Call our 24 Hour Helpdesk 301-405-9963
• E-Mail WILLCOR at helpdesk@willcor.com
• Arrange a Training Session
Help Is Available!
Understanding Future Effects of Today’s Decisions
56
3 Things To Remember…
• DoD 4245.7-M / NAVSO P-6071
• The Transition from Development to Production
• The Best Practices Book
• TRIMS
• Free Tool – Download from www.bmpcoe.org
• P3RM – Supports Problem, Product, and Process Risk Tracking!
• BMP Center of Excellence
• An Available Resource
• Call our 24 Hour Helpdesk 301-405-9963
Understanding Future Effects of Today’s Decisions
57