Be America's Best…War-Winning Capabilities on Time, on Cost

advertisement
Headquarters U.S. Air Force
Integrity - Service - Excellence
SOURCE SELECTION TRAINING
(ACQUISITION PLANNING)
<acquisition title>
<Trainer’s name>
<Trainer’s
Organization>
Be America’s Best…War-Winning Capabilities on Time, on Cost
1
Introductions
 Facilities Orientation
 Ground Rules
 Start/Stop Times
 Blackberry’s/PDA’s – turned off
 Encourage Interaction
Be America’s Best…War-Winning Capabilities on Time, on Cost
2
Overview
 Market Research
 Acquisition Planning
 4 W’s
 Requirements Documents
 Risk Assessment
 Acquisition Considerations
 Contract Type Selection
 Performance-Based
Acquisition
 Source Selection Planning
 SS Plan and Content
 SS Evaluation Approaches
 Tradeoff
 LPTA






Evaluation Criteria
SS Technique
Team Members R&R
SS Tools
Pre-Solicitation & RFP release
Governance/Oversight and
Clearance
 MIRT and PEER Reviews
 Ethics
 Summary
Be America’s Best…War-Winning Capabilities on Time, on Cost
3
Objectives
 Ensure Market Research is conducted throughout
acquisition process
 Recognize importance of Acquisition Planning for a
successful Source Selection
 Understand Key Elements of Source Selection
Process
 Know consequences of behaviors and actions as
they relate to Ethics and Procurement Integrity
Be America’s Best…War-Winning Capabilities on Time, on Cost
4
Objectives (cont.)
 Prepare team to successfully develop and support
Acquisition Strategy/Plan and Source Selection Plan
 Recognize how Contracting Process relates to
Acquisition Strategy and Planning Process
Output: Evaluation criteria for inclusion in Source Selection
Plan and RFP Section M (or equivalent commercial provision)
Be America’s Best…War-Winning Capabilities on Time, on Cost
5
Source Selection Process Roadmap
Start
END
Source Selection Process
Pre-RFP Release
Integrity - Service - Excellence
MARKET RESEARCH
Market Research Training Module
Useful Market Research Sources
GAO/COFC Protest Decisions: Lack of Competition and Market Research
Be America’s Best…War-Winning Capabilities on Time, on Cost
8
Engaging with Industry…
Article from “The Source”
Be America’s Best…War-Winning Capabilities on Time, on Cost
9
Why Conduct Market
Research?
 Identify commercial sources for gov’t requirements
 Obtain business intelligence for informed decisions
impacting:
 Acquisition Strategy & Planning
 Source Selection Planning
 Contract Type Selection
 Reduce business risks
 Identify opportunities, industry trends, technological
developments
Improves Chances for Success
Be America’s Best…War-Winning Capabilities on Time, on Cost
10
Benefits of Market Research
 Identifies:
 Sellers & Buyers
 Our leverage in the market
 Industry trends
 Technology changes/advancements
 New commercial items
 Business/financial arrangements
 Factors influencing doing business with Government
Be America’s Best…War-Winning Capabilities on Time, on Cost
11
Benefits of Market Research
(cont.)
 Reveals key information about sources:
 Capability
 Technological improvements
 Alliances and joint ventures (relationships and type of
agreements with their suppliers)
 Business/contract type preferences (cost type, fixed price, etc.)
 Financial strength and growth potential
 Contractor incentives
Be America’s Best…War-Winning Capabilities on Time, on Cost
12
Market Research Activities
 Activities include:
 Industry Days
 Requests for Information
 Survey of market-sector - Sources Sought Synopsis
 Internet Search of commercial marketplace
 Networking with trade associations in specific market
sectors
 One-on-one meetings with potential offerors
 Draft Request For Proposals
Be America’s Best…War-Winning Capabilities on Time, on Cost
13
Market Research Toolkit
 Synopsis
 Internet Search
 Virtual Networks
 Report Template
 Market Research Report Database
 Market Research Product/Service
 Training and References
 GSA Schedules, Yellow Pages, Catalogs, etc.
Be America’s Best…War-Winning Capabilities on Time, on Cost
14
Document Your Actions
 If you have not documented it - you have not done it!
 Determine your documentation methodology during
the planning phase
 Document contemporaneously – after the fact
documentation is seldom accurate
 GAO and COFC place great emphasis on
documentation at all phases of acquisition including
GAO/COFC Decision Summaries
Importance of Documentation in Source Selections
Be America’s Best…War-Winning Capabilities on Time, on Cost
15
ACQUISITION PLANNING
Be America’s Best…War-Winning Capabilities on Time, on Cost
16
Acquisition Planning – 4 W’s
 Who
 Acquisition team, led by program / requirements manager
 What
 Acquisition of commercial items or non-developmental items
 Full and Open Competition
 Formalize Acquisition Strategy Panel (ASP)
 Why
 Satisfy government needs in most effective, efficient,
economical, and timely manner
 When
 As soon as requirement is identified
Be America’s Best…War-Winning Capabilities on Time, on Cost
17
Contents of Acquisition Plans
(a) Acquisition Background and Objectives
(1)
(2)
(3)
(4)
(5)
Statement of Need
Applicable conditions
Cost
Capability or Performance
Delivery or Performance-Period
Requirements
(6) Trade-offs
(7) Risks
(8) Acquisition Streamlining
(b) Plan of Action
(1)
(2)
(3)
(4)
(5)
(6)
(7)
Sources
Competition
Contract Type Selection
Source-Selection Procedures
Acquisition Considerations
Budgeting and Funding
Product or Service Descriptions
(b) Plan of Action (cont.)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)
(22)
Priorities, Allocations, and Allotments
Contractor Versus Government
Performance
Inherently Governmental Functions
Management Information Requirements
Make or Buy
Test and Evaluation
Logistics Considerations
Government-Furnished Property
Government-Furnished Information
Environmental and Energy
Conservation Objectives
Security Considerations
Contract Administration
Other Considerations
Milestones for the Acquisition Cycle
Identification of Participants in
Acquisition Plan Preparation
Be America’s Best…War-Winning Capabilities on Time, on Cost
18
Acquisition Planning
Key Activities
(b) Plan of Action (cont.)
Statement
of Need - Requirements Documents
(a) Acquisition Background and Objectives
(1)
(2)
(3)
(4)
(5)
Statement of Need
Applicable conditions
Cost
Capability or Performance
Delivery or Performance-Period
Requirements
(6) Trade-offs
(7) Risks
(8) Acquisition Streamlining
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
Sources
Competition
Contract Type Selection
Source-Selection Procedures
Acquisition Considerations
Budgeting and Funding
Product or Service Descriptions
Priorities, Allocations, and Allotments
Contractor Versus Government
Performance
Inherently Governmental Functions
Management Information Requirements
Make or Buy
Test and Evaluation
Logistics Considerations
Government-Furnished Property
Government-Furnished Information
Environmental and Energy
Conservation Objectives
Security Considerations
Contract Administration
Other Considerations
Milestones for the Acquisition Cycle
Identification of Participants in
Acquisition Plan Preparation
Tradeoffs
Risks
(b) Plan of Action
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(18)
(19)
(20)
(21)
(22)
Source Selection ‘Procedures’ Planning
Acquisition Considerations
Be America’s Best…War-Winning Capabilities on Time, on Cost
19
Requirements Documents
Be America’s Best…War-Winning Capabilities on Time, on Cost
20
Performance Work
Statement (PWS)
Statement of
Work (SOW)
Requirements
Documents
Describe
Agency Needs
Purchase
Descriptions
Be America’s Best…War-Winning Capabilities on Time, on Cost
21
Requirements Documents
Typical Content
 Descriptions, specifications, and criteria that define
minimum needs of agency for supplies or services
 Requirements may be expressed as:
 Minimum value or level of performance (threshold
performance requirement)
 Desired goal (objective performance requirement)
Be America’s Best…War-Winning Capabilities on Time, on Cost
22
Requirements Documents
Commonalities
 Based on Market Research, describe Government
needs in terms of:
 Functions to be performed
 Performance level required
 Essential physical characteristics
 These documents are basis for:
 Risk assessment
 Development of evaluation criteria
 Preparation of solicitation and proposal
 Contract type selection, formation and execution
Be America’s Best…War-Winning Capabilities on Time, on Cost
23
Requirements Documents
“Connecting the Links”
 Basis for Independent Government Estimate (IGE)
 Establish connection from Requirement Document to
IGE, Schedule, Prices/Costs, Evaluation Criteria,
Proposal Preparation Instructions
Requirements Document
Schedule of Prices or
Costs
Evaluation Criteria
Independent Government
Estimate
Proposal Preparation Instructions
Be America’s Best…War-Winning Capabilities on Time, on Cost
24
Risk Assessment
Risk Assessment Briefing
Be America’s Best…War-Winning Capabilities on Time, on Cost
25
Purpose of Risk Assessment
 Identifies:
 High-risk areas for both Government and contractors
 Impact and probability
 Discriminators for Source Selections
 Incentive areas
 Foundation for evaluation criteria
Be America’s Best…War-Winning Capabilities on Time, on Cost
26
Risk Management Process
Risk
Identification
Risk Tracking
Risk Analysis
Risk Mitigation
Planning &
Implementation
Conducting Risk Assessment
 Link risks to requirements clearly
 If high risk, ensure:
 RFP requires offerors to address risk and provide mitigation
strategies in proposal
 Evaluation criteria includes evaluation of risks and
mitigation strategies
 Oversight of mitigation strategies in post award/incentives
 Obtain Industry input on Risk Assessment
Be America’s Best…War-Winning Capabilities on Time, on Cost
28
Acquisition Considerations
Contract Type Selection
Be America’s Best…War-Winning Capabilities on Time, on Cost
29
Spectrum Contract Type and Risk
Cost Risk
LOW
HIGH
Requirements POORLY
DEFINED
Definition
Acquisition
Phase
Contract
Type
WELL
DEFINED
RESEARCH
CR
SUSTAINMENT
CPFF
CPIF or
FPIF
CPIF,
FPIF, or
FFP
FFP,
FPIF, or
FPEPA
FFP, FPIF,
or FPEPA
Be America’s Best…War-Winning Capabilities on Time, on Cost
30
Selecting the “Right”
Contract Type
 Consider what Market Research indicates
 Understand your potential offerors
 Technical capability
 Financial responsibility
 Adequacy of accounting/business systems
 Extent and nature of anticipated subcontracting
 Discuss your Program
 Type, complexity, urgency
 Acquisition history – competitive/sole source
 Period of performance/length of production run
Be America’s Best…War-Winning Capabilities on Time, on Cost
31
Selecting “Right”
Contract Type (cont.)
 Consider political and fiscal environment in which
you operate
 May effect current program requirements, acquisition
plan/strategy and overall business deal
 Be aware of key stakeholders and possible impact(s)
 SECDEF, AT&L, DPAP, AQ, PEO, CC, PM, etc.
 Be cognizant of leadership’s current guidance & preferences
 Policy & info memos/guidance issued by Agency or DoD
Be America’s Best…War-Winning Capabilities on Time, on Cost
32
Acquisition Considerations (cont.)
Performance-Based Acquisitions
Be America’s Best…War-Winning Capabilities on Time, on Cost
33
Performance-Based
Acquisitions
DoD Directive 5000.01, para E.1.1.16
Performance-Based Acquisition
 Use performance-based strategies & contractual
language to:
 Maximize competition, innovation, & interoperability
 Enable flexibility
 Reduce cost
 Improve life-cycle support
 Task contractor in clear and concise language
Resource:
Performance Based Payments – Guide Book and Analysis Tool
Be America’s Best…War-Winning Capabilities on Time, on Cost
34
Performance-Based
Services Acquisition
 All service acquisitions > Simplified Acquisition
Threshold (few exceptions) should be performance-based
 Include identifiable and measurable cost, schedule, and
performance outcomes
 Consider customer requirements (ensure consistency)
 Ensure adequate planning and management to achieve
desired outcome
 Performance Work Statement (PWS)
 Conveys “what” we want -- not “how” to do it!
 Cite required directives and standards by specific
process/procedure ( paragraph or chapter vs. wholesale inclusion
of AFI)
Be America’s Best…War-Winning Capabilities on Time, on Cost
35
Source Selection Planning
Be America’s Best…War-Winning Capabilities on Time, on Cost
36
Source Selection Plan (SSP)
 Required for all best-value, negotiated competitive
acquisitions under FAR Part 15 (exceeding SAT - $150K)
 Name all individuals involved in source selection, and
clearly define their roles in SSP
 Ensure SSP is approved by SSA prior to solicitation
release
 Cover all required areas/topics
Be America’s Best…War-Winning Capabilities on Time, on Cost
37
Source Selection Plan Contents
 As a minimum include:
 Background and Objectives
 Acquisition Strategy
 Source Selection Team (names and roles)
 Communications
 Evaluation Factors and Subfactors
 Documentation
 Schedule of Events
 Non-governmental personnel (by name)
 Source Selection materials management
Be America’s Best…War-Winning Capabilities on Time, on Cost
38
SS Evaluation Approaches
Tradeoff
and
Lowest Price Technically Acceptable
(LPTA)
GAO & COFC Summaries on Best Value Tradeoff Decision
Be America’s Best…War-Winning Capabilities on Time, on Cost
39
Tradeoff
 Tradeoff is normally used for more complex
acquisitions
 Evaluation process requires more in-depth review of
proposals than LPTA
 Level of detail depends on:
 Complexity of acquisition
 Degree of competition
 Contract type
Be America’s Best…War-Winning Capabilities on Time, on Cost
40
Tradeoff (cont.)
 Used when in best interest of Gov’t to Award to:
 Other than lowest-priced proposal
 Other than highest technically rated proposal
 Process is more flexible - permits:
 Tradeoffs among cost/price and non-cost factors
 Best combination of technically superior, low risk proposals
that also have a history of favorable past performance
 Best value decision is based on comparative
assessment of proposals
Be America’s Best…War-Winning Capabilities on Time, on Cost
41
Tradeoff Considerations
 What are expected consequences of tradeoffs among
following elements?
 Cost/Price
 Capability
 Performance and Schedule
 Does your Requirements Document reflect user’s
expectations?
Be America’s Best…War-Winning Capabilities on Time, on Cost
42
Lowest Price Technically
Acceptable (LPTA)
 LPTA process is used when:
 “Best Value” is expected from lowest-priced, technically
acceptable proposal
 Procuring commercial, non-complex supplies or services
 Requirements are firm, clear and definitive
 No benefit is expected from proposals exceeding minimum
technical or performance requirements
Excellent Article on LPTA
Be America’s Best…War-Winning Capabilities on Time, on Cost
43
LPTA (cont.)
 When using LPTA:
 Evaluate proposals against minimum technical requirements
(Acceptable/Unacceptable)
 Past Performance may be an evaluation factor
(Acceptable/Unacceptable)
 Tradeoffs are not permitted
 Proposals cannot be ranked on non-cost/price factors
 Exchanges may occur
 Comparative Analysis is not required
Be America’s Best…War-Winning Capabilities on Time, on Cost
44
LPTA (cont.)
 Technical
 Critical to define what constitutes “Acceptable”
 Clearly state minimum requirements
 Past Performance
 May be waived by PCO
 If evaluated, ‘Unknown’ rating is considered acceptable
 “Acceptable” rating required in all non-price
factors/subfactors
Be America’s Best…War-Winning Capabilities on Time, on Cost
45
Evaluation Criteria Factors &
Subfactors
 Methodical process incorporates knowledge from:
 Market Research
 Acquisition planning activities
 Evaluation factors:
 Must be critical areas of importance and emphasis
 Identify “key discriminators”
 Provide meaningful comparison and discrimination between
competing proposals
 Factors must address:
 Price/Cost
 Quality of Product or Service
 Non-cost factors
Be America’s Best…War-Winning Capabilities on Time, on Cost
46
Developing Evaluation Criteria
Factors & Subfactors
BRAINSTORM ideas to develop your evaluation criteria
 Assumptions:
 Knowledge of market and requirements
 Potential offerors
 Discuss:
 KEY discriminators
 Your confidence in offerors’ ability to meet requirement
 Uniqueness or clarity of specifications
 Identify high or moderate risks
 Small Business Participation
Be America’s Best…War-Winning Capabilities on Time, on Cost
47
Determining Source Selection
Approach/Technique
 Determine factor rating methodology and relative
importance based on brainstorming
 Factor: Cost/Price
 Factor: Past Performance (unless PCO waives)
 Acceptable/Unacceptable
 Performance Confidence Assessment
 Factor: Technical
 Subfactors
 Acceptable/Unacceptable (no “tradeoff”)
 Combined technical/risk or separate ratings (range of
colors/adjectival ratings)
 Combination (can vary by subfactor)
Ratings
Be America’s Best…War-Winning Capabilities on Time, on Cost
48
Source Selection Team
Be America’s Best…War-Winning Capabilities on Time, on Cost
49
Source Selection Team –
Example
SSA
SSAC or Advisors
SSEB
Technical Team
Advisors
PCO
Past
Performance
Team
Cost/Price Team
Contracting
Team
SSA Roles and Responsibilities
RESPONSIBLE FOR PROPER AND EFFICIENT CONDUCT OF SOURCE SELECTION PROCESS
- Approves Source Selection Plan
- Appoints SSEB and SSAC Chairs
- Appoints and approves PCO, if ACAT I
- Establishes realistic schedule
- Limits Senior Leader Roles (major acquisitions)
- Ensures all SST members properly trained and experienced
- Responsible for execution of Non-disclosure agreements and COI
statements
- Determines whether to award with or without discussions
- Selects the Best Value source
- Documents the SS decision
Be America’s Best…War-Winning Capabilities on Time, on Cost
51
PCO Roles and
Responsibilities
PRIMARY BUSINESS ADVISOR AND PRINCIPAL GUIDANCE SOURCE
FOR ENTIRE SOURCE SELECTION
- Establishes plan/procedures to protect Source Selection information,
and manages SS documents
- Releases the RFP
- Single point of control for all Source Selection information
- Obtains all required approvals for Non-government advisors
- Ensures SSEB evaluation is consistent with RFP
- Controls exchanges with offerors
- Establishes competitive range after SSA approval
- Awards Contract
- Submits SS participants worksheet to SAF/AQC
52
SSAC Roles and Responsibilities
PROVIDES FUNCTIONAL EXPERTISE AND SUPPORT TO SSA
- Oversees SSEB
- Reviews SSEB evaluation results to ensure consistency with RFP
- Provides written comparative analysis & recommendation to SSA
Be America’s Best…War-Winning Capabilities on Time, on Cost
53
SSEB Chairperson Roles and
Responsibilities
MANAGES EVALUATION TEAM
- Appoints SSEB members
- Establishes functional evaluation teams
- Ensures SSEB members know HOW to evaluate proposals BEFORE they
review
- Staffs Source Selection Team with proper skill and experience
- Schedules adequate time to successfully complete Source Selection
- Ensures adequate resources are available
- Provides consolidated results
- Documents SSEB evaluation results (PAR, briefing slides, etc)
- Does not perform comparative analysis of proposals or make Source
Selection recommendation unless requested by SSA
- Supports post Source Selection activities
54
SSEB Evaluators - Roles and
Responsibilities
NORMALLY ORGANIZED INTO FUNCTIONAL AREAS
- Source Selection responsibilities take priority over other work i.e. primary
duty responsibility
- Conduct comprehensive review and evaluation of proposals against
solicitation evaluation criteria
- Document contemporaneously evaluation results
- Support post-award activities
Be America’s Best…War-Winning Capabilities on Time, on Cost
55
Advisors Roles and
Responsibilities
TWO DISTINCT TYPES OF ADVISORS: GOVERNMENT AND
NON-GOVERNMENT
Government advisors:
- Assist SSA if no SSAC used
- Assist the SSEB as subject matter experts
Non-Government advisors:
- Used on a limited basis – only advisory
- Must be approved in writing (except FFRDC, FAR 37.203/37.204)
- Sign a Non-Disclosure Agreement (NDA), COI statement, AND provide
documentation regarding stocks owned
- May not rate or rank any offeror’s proposal
- May not see or evaluate past performance information
56
Source Selection Tools
Be America’s Best…War-Winning Capabilities on Time, on Cost
57
EZ Source Tool
 Mandatory Use for Competitive Acquisitions
 Value $50M or greater
 Hi-Vis Programs
 Consolidation of individual contracts
 Re-competition as a result of sustained protest (corrective
action)
 Political sensitivity
 PEO or CC deems high-risk program regardless of $ value or
ACAT level
 EZ Source Deployment - two spirals over 18 months
(Jun
2013 - Oct 2014)
 Spiral I locations meeting mandatory criteria use EZ Source if
solicitation is issued on/after location’s effective date
 Spiral II - all remaining locations
Policy Memo 13-C-02
Be America’s Best…War-Winning Capabilities on Time, on Cost
58
Source Selection Tools POCs
 EZ Source tool (AFMC)
 POC: Kerry Estes, DSN 785-5471, kerry.estes@wpafb.af.mil
EZ Source Templates
 Electronic Source Selection (ESS) tool (SMC)
 POC: Mr. Ted Nguyen, DSN 633-5072, ted.nguyen@losangeles.af.mil
 Decision Point
 See www.acqcenter.com for more information
 Fed Select
 See www.caci.com
 POC: Steve Ford, (703) 486-3266 ext 1031, sford@caci.com
Be America’s Best…War-Winning Capabilities on Time, on Cost
59
Pre-Solicitation
and
RFP Release Activities
Be America’s Best…War-Winning Capabilities on Time, on Cost
60
Source Selection Process Roadmap
Start
END
Be America’s Best…War-Winning Capabilities on Time, on Cost
Developing Sections L & M
 Section L - Proposal Instructions to Offerors
 Section M - Evaluation Factors and Criteria
 Must be developed by entire team!
 All stakeholders must be involved
 L & M are tailored to each source selection
 Consider program risks
 Leverage L & M templates and language when appropriate
 Link L & M and requirements
 Cross Reference Matrix helps
Be America’s Best…War-Winning Capabilities on Time, on Cost
Cross Reference Matrix
Sample 1
Be America’s Best…War-Winning Capabilities on Time, on Cost
Cross Reference Matrix
Sample 2
Cross Reference
PWS Para
Transition Phase-in
Element 1a – GFE Usage Plan
1.2.2
Element 1b – Repair Process
Demonstrations
Element 1c – Hire/Retain Qualified
Personnel
Element 1d – Facilities Plan
1.2.1
Element 1e – Data Reporting
1.11
1.2.3
1.2.4
1.9, 1.5.4
1.3, 1.8, and 1.9
Element 3c – Small Business
Requirements
CDRL
SF1
0001
A00F
L: 4.1a
M: 2.2.1a
L: 4.1b
M: 2.2.1b
L: 4.1c
M: 2.2.1c
L: 4.1d
M: 2.2.1d
L: 4.1e
M: 2.2.1e
0001
N/A
0001
N/A
0001
N/A
0001
N/A
0003
A00A-A0AD
Imbedded in overhaul /
repair prices
Imbedded in overhaul /
repair prices
Imbedded in overhaul /
repair prices
Imbedded in overhaul /
repair prices
Imbedded in overhaul /
repair prices, 0005
A00C-A00E,
A00G-H, A00N
N/A
0002
N/A
Imbedded in overhaul /
repair prices
A00R
L: 4.2a
M: 2.2.2a
L: 4.2b
M: 2.2.2b
SF3
Program Management
Element 3a – Schedule / Produce
Requirements, Surge Responsiveness,
and O&A
Element 3b – Transition Phase-Out
CLIN
SF2
Supply Chain / Material Management
Element 2a – Parts Forecasting and
documentation of approved sources
Element 2b – Material Storage, Packaging /
Transportation
RFP Section L&M
1.4.1.a, 1.15, and
1.16
L: 4.3a
M: 2.2.3a
1.17
L: 4.3b
M: 2.2.3b
L: 4.3c
M: 2.2.3c
PWS: N/A
Clause H002
Proposal (Vol & Para)
A00D, A00E,
A00G, A00H
A00C, A00E,
A00R
A00C, A00E
Be America’s Best…War-Winning Capabilities on Time, on Cost
64
Draft Request For Proposal
(DRFP)
 Highly recommended for ALL acquisitions
 Must be consistent with acquisition strategy and SSP
 Specific content determined by PCO – consider:
 Detailed description of Government’s requirements, e.g.
Requirements Document, PWS, SOO, etc.
 Price/Cost Schedule
 Evaluation Criteria, Proposal Contents e.g. Sections L&M
 Benefits - Input from Industry on:
 Realism and clarity of government requirements
 Contract type contemplated
 Schedule realism
Note: Maintain record of comments and adjudication
Be America’s Best…War-Winning Capabilities on Time, on Cost
65
Review Draft RFP
Requirements
 SSEB and SSAC (if used) review requirements as a standard for
evaluation
 SOO or SOW must clearly describe work objectives or work to be
performed
 Is SOO/SOW performance-based?
 Specification must clearly delineate key technical characteristics
of product or service
 Schedule B CLIN structure must be complete and clear
 Requirements must be achievable and not overly restrictive
 Review Acquisition Strategy, unique special clauses and critical
technical requirements
 Gov’t estimate must be consistent with requirements and
available funding
Be America’s Best…War-Winning Capabilities on Time, on Cost
66
Request for Proposal
 Government’s formal tool to:
 Communicate technical and contractual rqm’ts to industry
 Solicit proposals from industry to satisfy its requirements
 Must be consistent w/ requirement docs, AP and SSP
 Final solicitation cannot be released until:
 AP or LCMP is approved
 SSP is approved
 Business Clearance has been obtained
 Notification required concurrent w/ issuance of RFP
RFP becomes the Binding Contract
Be America’s Best…War-Winning Capabilities on Time, on Cost
67
Clearance
and
Governance Oversight
Be America’s Best…War-Winning Capabilities on Time, on Cost
68
Clearance
 Objectives:
 Implement approved acquisition strategies
 Ensure fair and reasonable business arrangements
 Follow laws, regulations, and policies
 Perform independent review and assessment of action
 Clearance Approval Authority:
ACAT I:
> $500M
DAS(C) & ADAS(C) for Business Clearance Only
> $50M
Senior Center Contracting Official (SCCO)
$25M-$50M
One Level Below SCCO
$5M-<$25M
Two Levels Below SCCO
-----------------------------------------------------------------------------------------------------------------------------OPERATIONAL:
> $2M
SCCO
$1M - $2M
$500K - $1M
Squadron Commander
At Least One Level Above PCO
Be America’s Best…War-Winning Capabilities on Time, on Cost
69
Business & Contract
Clearance
Business
Competitive
Business
Clearance
Issue Solicitation
Contract
Competitive
70
Contract
Clearance
Award w/o discuss
or FPR & SSA Decision
Be America’s Best…War-Winning Capabilities on Time, on Cost
Multi-Functional Independent
Review Team (MIRT)
 Required for competitive actions >$50M
 Provides independent assessment to CAA on acquisition,
source selection or procurement
 Five Critical Decision Points (CDP)
 Pre-Business Clearance CDPs (simultaneously w/Clearance)
 CDP #1 – ASP/Acq Plan
 CDP #2 – Sections L&M of RFP
 Pre-Contract Clearance CDPs (simultaneously w/Clearance)
 CDP #3 – Competitive Range Briefing or Award w/o Discussions
 CDP #4 – Final Proposal Revision Request
 CDP #5 – Source Selection Decision Briefing
Be America’s Best…War-Winning Capabilities on Time, on Cost
71
OSD Peer Reviews
 OSD Peer Reviews (DFARS 201.170)
 Competitive solicitations > $1B (including options)
 Sole Source and IT solicitations > $500M
 Comprised of senior contracting officials and attorneys from
DoD, (civilian or military) external to the department, agency,
or component
 Pre-award Peer Reviews - conducted in 3 phases:
 Prior to issuance of solicitation
 Prior to request for final proposal revisions (if applicable)
 Prior to contract award
 Post-award Peer Reviews may be conducted for all
contracts for services valued > $1B (including options)
Be America’s Best…War-Winning Capabilities on Time, on Cost
72
72
Common Findings in MIRTs
and Peer Reviews
 Inconsistent language in acquisition documents between
Sections L&M and requirements
 Develop matrix showing crosswalk between performance
specification, SOW and Sections L&M of RFP
 Evaluation criteria in RFP did not address key areas of
importance and emphasis
 Focus must be on “key discriminators”
 Define “discriminators” as evaluation factors/subfactors
 Assess feedback during pre-solicitation exchanges
 Keep factors/subfactors to a minimum (3-5) to simplify RFP
 If too many, then importance of each is diluted
 Consider using an "acceptable/not acceptable" approach to
some evaluation criteria
Be America’s Best…War-Winning Capabilities on Time, on Cost
73
Common Findings in MIRTs
and Peer Reviews (cont.)
 ENs not written in a clear, concise and consistent way
 Be clear, complete, and direct when you write your EN
 Ensure SSEB Chair, PCO and Legal review all ENs
 LPTA approach did not make clear in Sections L&M
what constituted “technical acceptability”
 Describe technical factors/subfactors in RFP in enough depth
to communicate what will be evaluated on A/U basis and
 Satisfy Government minimum requirements when assessing
offeror’s proposal
 Pressure on SS teams to meet unrealistic schedules
 “Need dates” drive teams to meet deadlines w/o regard to
team experience, complexity of acquisition, or limited
resources
 SSA should validate “need dates” and advise SST on ways to ease
schedule risks
Be America’s Best…War-Winning Capabilities on Time, on Cost
74
Uniform Contract Format
Representations, Certifications, and other Statements of Offerors or
Respondents
Instructions, Conditions, and Notices to Offerors or Respondents
Evaluation Factors for Award
Commercial Contract Format
Use the following format to the maximum extent possible:
(a) Standard Form (SF) 1449;
(b) Continuation of any block from SF 1449, such as-(1) Block 10 if a price evaluation adjustment for small disadvantaged business concerns is applicable
(the contracting officer shall indicate the percentage(s) and applicable line item(s)), or if set aside
for emerging small businesses;
(2) Block 18B for remittance address;
(3) Block 19 for contract line item numbers;
(4) Block 20 for schedule of supplies/services; or
(5) Block 25 for accounting data;
(c) Contract clauses–
(1) 52.212-4, Contract Terms and Conditions-- Commercial Items, by reference (see SF 1449 block
27a); (2) Any addendum to 52.212-4; and (3) 52.212-5, Contract Terms and Conditions Required to
Implement Statutes and Executive orders;
(d) Any contract documents, exhibits or attachments; and
(e) Solicitation provisions(1) 52.212-1, Instructions to Offerors--Commercial Items, by reference (see SF 1449, Block 27a); (2)
Any addendum to 52.212-1; (3) 52.212-2, Evaluation--Commercial Items, or other description of
evaluation factors for award, if used; and (4) 52.212-3, Offeror Representations and Certifications-Commercial Items.
76
References
 DoD Source Selection Procedures
 Effective 1 Jul 2011 and mandatory for all competitive
acquisitions utilizing FAR Part 15 procedures
 Source Selection Trainer’s Reference/Resource Material
 Assists trainers in presenting SS Phase I & II training modules
 Types of Contracts - FAR Part 16.103 & 104, DFARS 216.1
 Contracting by Negotiation - FAR Part 15, DFARS 215
 Acquisition of Commercial Items - FAR Part 12.303
 Describing Agency Needs (Rqmts) - FAR Part 11.101, DFARS 211.1
 Market Research - FAR Part 10, DFARS 210
 Acquisition Planning - FAR Part 7.1, DFARSS 207.1
 Conflicts of Interest - FAR Part 3.104, DFARSS 203.104
Be America’s Best…War-Winning Capabilities on Time, on Cost
77
Summary
 Each Acquisition or Source Selection is unique
 Source Selection process is both objective and
subjective
 Professional judgment, and critical thinking is
required at every step
Goal: Ensure quality, timely products and services are delivered
to the war-fighter and the nation. Obtain best value for the
taxpayer
Be America’s Best…War-Winning Capabilities on Time, on Cost
78
Feedback and Certificate

For acquisitions $10M and above:
 Attendees names will be provided to designated Source
Selection Trainers
 Certificates (Phase I or Phase II) will be provided to attendees by
SS Trainers

Continuous Learning (CL) points
 6 CL points for each full day of instruction;
 3 CL points for any half day of instruction, and
 1 CL point for 2 hours or less of instruction
Your Feedback is Very Important . . . Please Take The Time To
Complete The Survey
Be America’s Best…War-Winning Capabilities on Time, on Cost
79
ETHICS AND PROCUREMENT
INTEGRITY
SS Ethics Training
GAO/COFC Summaries-Organizational Conflicts of Interest
Be America’s Best…War-Winning Capabilities on Time, on Cost
80
Summary of Changes
for
Phase I Acquisition Planning
Be America’s Best…War-Winning Capabilities on Time, on Cost
81
LINKED CHARTS
Be America’s Best…War-Winning Capabilities on Time, on Cost
82
Technical Rating Evaluation
(Methodology 1)
Table 1. Combined Technical/Risk Ratings
Color
Rating
Description
Blue
Outstanding
Proposal meets requirements and indicates an exceptional approach and
understanding of the requirements. Strengths far outweigh any
weaknesses. Risk of unsuccessful performance is very low.
Purple
Good
Proposal meets requirements and indicates a thorough approach and
understanding of the requirements. Proposal contains strengths which
outweigh any weaknesses. Risk of unsuccessful performance is low.
Green
Acceptable
Proposal meets requirements and indicates an adequate approach and
understanding of the requirements. Strengths and weaknesses are
offsetting or will have little or no impact on contract performance. Risk
of unsuccessful performance is no worse than moderate.
Yellow
Marginal
Proposal does not clearly meet requirements and has not demonstrated
an adequate approach and understanding of the requirements. The
proposal has one or more weaknesses which are not offset by strengths.
Risk of unsuccessful performance is high.
Red
Unacceptable
Proposal does not meet requirements and contains one or more
deficiencies. Proposal is unawardable.
83
Technical Rating Evaluation
(Methodology 2)
Table 2. Technical Ratings
Color
Rating
Description
Blue
Outstanding
Proposal meets requirements and indicates an exceptional
approach and understanding of the requirements. The
proposal contains multiple strengths and no deficiencies.
Purple
Good
Proposal meets requirements and indicates a thorough
approach and understanding of the requirements. Proposal
contains at least one strength and no deficiencies.
Green
Acceptable
Yellow
Marginal
Proposal meets requirements and indicates an adequate
approach and understanding of the requirements. Proposal
has no strengths or deficiencies.
Proposal does not clearly meet requirements and has not
demonstrated an adequate approach and understanding of the
requirements.
Red
Unacceptable
Proposal does not meet requirements and contains one or
more deficiencies and is unawardable.
84
Technical Risk Rating
(Methodology 2)
Table 3. Technical Risk Ratings
Rating
Description
Low
Has little potential to cause disruption of schedule,
increased cost or degradation of performance. Normal
contractor effort and normal Government monitoring will
likely be able to overcome any difficulties.
Moderate
Can potentially cause disruption of schedule, increased
cost or degradation of performance. Special contractor
emphasis and close Government monitoring will likely be
able to overcome difficulties.
Is likely to cause significant disruption of schedule,
increased cost or degradation of performance. Is unlikely to
overcome any difficulties, even with special contractor
emphasis and close Government monitoring.
High
85
Technical Ratings
Table A-1. Technical Acceptable/Unacceptable Ratings
Rating
Description
Acceptable
Proposal clearly meets the minimum requirements of
the solicitation.
Unacceptable
Proposal does not clearly meet the minimum requirements
of the solicitation.
86
Past Performance Evaluation
Table 4. Past Performance Relevancy Ratings
Rating
Definition
Very Relevant
Present/past performance effort involved essentially
the same scope and magnitude of effort and
complexities this solicitation requires.
Relevant
Present/past performance effort involved similar
scope and magnitude of effort and complexities this
solicitation requires.
Present/past performance effort involved some of
the scope and magnitude of effort and complexities
this solicitation requires.
Somewhat Relevant
Not Relevant
Present/past performance effort involved little or
none of the scope and magnitude of effort and
complexities this solicitation requires.
May use, as a minimum, “Relevant” & “Not Relevant” ratings for source selections
requiring less discrimination in past performance evaluation.
87
Past Performance Evaluation
Table 5. Performance Confidence Assessments
Rating
Description
Substantial Confidence
Based on the offeror’s recent/relevant performance record,
the Government has a high expectation that the offeror will
successfully perform the required effort.
Satisfactory Confidence
Based on the offeror’s recent/relevant performance record,
the Government has a reasonable expectation that the offeror
will successfully perform the required effort.
Limited Confidence
Based on the offeror’s recent/relevant performance record,
the Government has a low expectation that the offeror will
successfully perform the required effort.
No Confidence
Based on the offeror’s recent/relevant performance record,
the Government has no expectation that the offeror will be
able to successfully perform the required effort.
Unknown Confidence
(Neutral)
No recent/relevant performance record is available or the
offeror’s performance record is so sparse that no meaningful
confidence assessment rating can be reasonably assigned.
88
Past Performance Evaluation
Table A-2. Past Performance Evaluation Ratings
Rating
Description
Acceptable
Based on the offeror’s performance record, the
Government has a reasonable expectation that the
offeror will successfully perform the required effort,
or the offeror’s performance record is unknown. (See
note below.)
Based on the offeror’s performance record, the Government
has no reasonable expectation that the offeror will be able
to successfully perform the required effort
Unacceptable
Note: In the case of an offeror without a record of relevant past performance or for whom
information on past performance is not available or so sparse that no meaningful past
performance rating can be reasonably assigned , the offeror may not be evaluated
favorably or unfavorably on past performance (see FAR 15.305(a)(2)(iv)). Therefore, the
offeror shall be determined to have unknown past performance. In the context of
acceptability/unacceptability, “unknown” shall be considered “acceptable”.
89
The Best-Value Continuum
Source Selection Techniques
Greater
Relative Importance of Cost or Price
Lesser
Lesser
Importance of Non-Cost Factors
Greater
FAR Part 15.101, FAR Subpart 15.3, as supplemented
Trade-Off Process
Source
Lowest Price
Tradeoff Source Selection
Procedures
Technically Acceptable described in DoD Source Selection
Selection
(LPTA) Source
Process
Oh! The possibilities!
Selection Process
described in
DoD
Technical
described in DoD Source
Selection Procedures,
Appendix A
Technical Risk
Source Selection
Past Performance
Procedures
Mix-n-match tradeoffs:
Cost or Price
Cost or Price
Non-Cost
Non–Cost
Factors
Factors
Low Price
Be America’s Best…War-Winning Capabilities on Time, on Cost 90
Download