APPENDIX C Table Of Contents

Lowest Price d Technically Acceptable

Source Selection Process

C-1 Purpose

The purpose of this Appendix is to assist acquisition professionals in making sound decisions for determining whether to use a Tradeoff or LPTA source selection process to obtain best value. LPTA is an available source selection approach. However, a lack of understanding of when it is an appropriate choice may result in misapplication of this process. This Appendix includes “side-by-side” comparisons of LPTA vs. Tradeoff characteristics, methodologies, common concerns associated with each, tips and best practices.

C-2 References

1. Federal Acquisition Regulation Part 15 https://www.acquisition.gov/browsefar

2. Defense Federal Acquisition Regulation Supplement Part 215 http://www.acq.osd.mil/dpCap/dars/dfarspgi/current/index.html

3. Army Federal Acquisition Regulation Supplement Part 5115 https://spcs3.kc.army.mil/asaalt/procurement/AFARS/Home.aspx

4. Department of Defense Source Selection Procedures http://www.acq.osd.mil/dpCap/policy/policyvault/USA007183-10-DPCAP.pdf

5. Better Buying Power http://bbp.dau.mil/

6. Under Secretary of Defense (Acquisition, Technology, And Logistics) (USD(ATL)) memorandum, subject: Appropriate Use of Lowest Price Technically Acceptable Source Selection Process and Associated Contract Type (March 04, 2015) http://bbp.dau.mil/docs/Appropriate_Use_of_Lowest_Priced_Technically_Ac…

7. ASA (ALT) memorandum, subject: Use of Lowest Price Technically Acceptable Source Selection Process (April 20, 2015), issued as Policy Alert #15-73: Use of Lowest Price Technically Acceptable Source Selection Process (April 21, 2015) https://spcs3.kc.army.mil/asaalt/procurement/PARC/PARC.aspx

8. Government Accountability Office Cases - Various

C-3 Purpose

Policy Perspective on Use of LPTA. The DOD Source Selection Procedures includes a separate Appendix C devoted to the LPTA Source Selection Process (reference 4). The use of LPTA has increased but not necessarily successfully in all cases, causing concern by both the Government and Industry Partners. Some specific concerns include:

Government officials are not able to adequately define the requirement, and therefore not able to adequately define technical acceptability.

Awarded prices are unrealistically low.

Incumbent contractors underbid at unreasonable or unrealistic prices.

Winning contractors cannot attract qualified employees.

Contractors are unable to perform at acceptable quality levels.

Endangering the security of government resources, to include information systems and networks, and personnel.

To provide greater fidelity on the appropriate use of LPTA, Better Buying Power (BBP) 2.0 (reference 5) set basic guidance for use of LPTA. Subsequent memorandum issued by the Under Secretary of Defense (Acquisition, Technology and Logistics) (reference 6) and reinforced by the Assistant Secretary of the Army (Acquisition, Logistics and Technology) (reference 7), stress that:

LPTA has a clear, but limited place in the source selection “best value” continuum. Used in appropriate circumstances and combined with effective competition and proper contract type, LPTA can drive down costs and provide the best value solution. LPTA offers a streamlined and simplified source selection approach to rapidly procure the commercial and non-complex services we need to support the Warfighter. If not applied appropriately, however, the Department can miss an opportunity to secure an innovative, cost-effective solution to meet Warfighter needs to help maintain our technological advantage.

C-4 What is Risk?

No matter whether using Tradeoff or LPTA, the focus should always be on identifying the key discriminators based upon market research and the assessment of risk. Risk, as it pertains to source selection, is the potential for unsuccessful contract performance. Increased risk comes with numerous possible complicating factors including:

Disruption of Schedule

Funding/Budget Availability

Increased Cost or Degradation of Performance

Contract Type – Pricing Arrangement

Need for Increased Government Oversight

Dependencies on Other Projects/Systems

The Likelihood of Unsuccessful Contract Performance

Possible Effect on Other Simultaneous Projects

Technical Feasibility

Operational Risk

While it is impossible to eliminate all risk, the objective is to reduce or mitigate risks by selecting the best value offeror through a sound source selection evaluation process.

The Government’s risk is increased where the criteria (standards) are set too low. The source selection team must work together to ensure the PWS/SOW/Specification is complete and reflects the Government’s needs at the right quality level.

Identifying key discriminators that are linked to the critical requirements where key risks lie is one of the most important steps in the process of determining the right process to achieve best value.

Key Risk Areas = Discriminators = Possible Evaluation Criteria

Crystal Clear, Non-Debatable Evaluation Criteria

+ Evaluation on Basis of Technical Acceptability

+ Objective Standard of Proof for Each Criteria

= Candidate for LPTA Source Selection Process

If the evaluation criteria cannot be objectively defined strictly on the basis of acceptable/unacceptable, and a clear “standard of proof” be determined for each, the procurement is not a candidate for the LPTA process.

NOTE: If some, but not all, evaluation criteria fit the LPTA requirements a combination approach may be a consideration.

Caution If the customer/requiring activity is concerned about improving performance, LPTA is not an appropriate source selection approach.

C-5 Quick Comparison of Best Value Basics

The FAR on Trade off vs LPTA Source Selection Processes

FAR 15.101-1 Tradeoff Process

FAR 15.101-2 LPTA Process

Permits tradeoffs among cost or price and non-cost factors and allows the Government to accept other than the lowest price proposal.

Does not permit tradeoff among cost or price and non-cost factors.

Used in competitive negotiated contracting.

Used in competitive negotiated contracting.

Select the most advantageous offer.

Select the lowest price proposal that meets/exceeds minimum requirements.

Evaluate and compare factors in addition to cost or price.

Proposals may be ranked.

No ranking of proposals.

Exchanges may occur.

Exchanges may occur.

IF

THEN

IF

THEN

- Generally considered complex items or services

- Less definitive

- Developmental or developmental work is required

- Non-price factors play a dominant role in the source selection decision

Use the Tradeo ff Process

- Commercial/non-complex items or services

- Clear and well-defined requirements

- Stable requirements

- Items or services are readily and consistently available in the marketplace

- Risk of unsuccessful performance is minimal

- There is neither value, need or willingness to pay for higher performance

- Cost/price plays a dominant role in the source selection decision

Consider using the LPTA Process

C-6 Comparing Key Characteristics

Tradeoff vs LPTA Methods of Source Selection

TRADE OFF

LPTA

SUMMARY OVERVIEW

SUMMARY OVERVIEW

A Tradeoff process is appropriate when it may be in the best interest of the Government to:

a) consider award to other than the lowest-priced Offeror or:

b) other than the highest technically rated Offeror.

Therefore, if the ability to distinguish between the quality of non-cost/price factors and cost/price factors within Offerors’ proposals and give credit (assign strengths) for aspects which provide a benefit to the Government and for which it might be willing to pay more for (premium), then the tradeoff process is the best approach.

Less definitive

More complex and time consuming development work

Greater performance risk/integration risk

Technical and past performance considerations more important than price

Price based on performance-based approach

Past performance is critical in reducing risk

An LPTA process is appropriate when best value is expected to result from selection of the technically acceptable proposal with the lowest price.

Award is made to the responsible contractor who is technically acceptable and has the lowest evaluated price.

Government design or stable requirements, clearly definable

Risk of unsuccessful performance is minimal

No mission-related reason to pay a premium for quality or performance exceeding the acceptable level

Only use LPTA when able to clearly define and strictly evaluate Offerors’ proposals based on technical acceptability

Technical evaluation lends itself to acceptable/unacceptable basis

When requirement is easy to price

When past performance is not critical to reducing risk

When a “standard of proof” is identifiable for each evaluation criteria

Tradeoff vs LPTA Methods of Source Selection

TRADEO FF

LPTA

Encourages Innovation

Innovation Not Needed, Encouraged,nor Rewarded

Proposals can offer various technical approaches that may be of benefit to the Government and the competitive environment should encourage this depending upon what the solicitation places the most value/importance upon.

LPTA inherently places the most value on the technical acceptability to provide known, stable requirements for the lowest price and the Government will not benefit from/is not willing to pay for above threshold performance.

Maximum Flexibility

Minimum Flexibility

The tradeoff process provides the most discretion/flexibility when it comes to the award decision.

The Source Selection Evaluation Board (SSEB) can identify strengths within proposals that may benefit the Government and increase the value of the proposal.

The Source Selection Authority can give consideration to the benefit/value of non-cost/price factor differences between Offerors to determine if those differences justify paying the cost/price differential between them.

Tradeoffs not permitted – intended to be a simple selection process based upon technical acceptability/lowest price.

Use a Checklist or Form to document the Technical Evaluation (1) to ensure the requirements/criteria/standards are suitable for this process; and (2) enable the Offeror to provide the standard of proof and determine whether the Offeror should be rated as acceptable or unacceptable for that item.

- You must be able to evaluate everything included in your “checklist” using an objective standard of proof.

- By associating minimum standards with relative risks for execution of each task, risk of unsuccessful performance can be mitigated or decreased.

-The Offeror is required to provide clear proof that they meet the requirement (and the Government determines what the standard of proof is, and announces it in the RFP).

No additional “credit” can be given for exceeding established standards.

Tradeoff vs LPTA Methods of Source Selection

TRADEOFF

LPTA

Competitive Range and Discussions

Competitive Range and Discussions

52.215-1, Instructions to Offerors – Competitive Acquisition enables the Government to provide notice to prospective Offerors of the intent to make award without discussions as well as limit the number of proposals in the competitive range to the number at which an efficient competition can be conducted.

Contracting officer can provide the opportunity for offerors to eliminate weaknesses and deficiencies through the discussion process.

If few or no acceptable offers are received or proposals indicate that the requirements are misunderstood, the Contracting officer may set a competitive range and conduct discussions with technically unacceptable Offerors and provide them the opportunity to eliminate deficiencies.

A proposal rated technically acceptable cannot be further improved through the discussion process. However, all Offerors in the competitive range must be afforded the opportunity to submit a revised proposal after discussions have concluded. See Commercial Design Group, Inc., B-400923.4, August 6, 2009, CPD ¶ 157.

Enables Meaningful Comparisons

No Comparisons Permitted

Tradeoff allows for meaningful comparisons and discrimination between and among competing proposals.

If some, but not all, evaluation criteria fit the LPTA requirements, a combination approach may be a consideration. If a combination approach is used, comparison is allowable only for those factors based on tradeoff.

Evaluation is More Complex But Can Be Simplified Using a Hybrid Approach When Appropriate

Evaluation is Straightforward

By using a combination approach, the Government can simplify some aspects of the evaluation where criteria are clear, can be evaluated on an acceptable/unacceptable basis, and a clear standard of proof can be linked to each one.

Examples of may include professional qualifications, special certifications, licensing.

Well-written evaluation criteria and “standard of proof” that the Offeror must provide to satisfy each, should enable the evaluation to be conducted in an efficient and straightforward manner.

If not all evaluation criteria are clear and objective with an objective standard of proof for evaluation, a combination approach may be appropriate.

Tradeoff vs LPTA Methods of Source Selection

TRADEOFF

LPTA

Performance Risk and Past Performance Assessment

Past Performance Rated Acceptable or Unacceptable

In the case of an offeror without a record of recent/relevant past performance, or for whom information on past performance is not available, or so sparse that no meaningful past performance rating can be assigned, you must evaluate the offeror’s lack of past performance as “Neutral Confidence”, having no favorable or unfavorable impact on the evaluation.

Past performance shall be evaluated unless waived. However, a comparative assessment is not allowed. When using LPTA, unknown past performance shall be considered acceptable.

- You may utilize a combination approach where past performance is evaluated as part of the tradeoff and technical approach is assessed on acceptable/unacceptable basis.

Planning Considerations

Planning Considerations

The tradeoff methodology generally involves in-depth planning and more time and resources.

Tradeoffs must be clearly documented and supported.

The LPTA process is not necessarily faster.

Requires significant up-front time investment to clearly identify the critical technical requirements (standards) for evaluation and the standard of proof (evidence of the offeror’s compliance with the requirement) to determine whether each one is met (technical acceptability).

The time investment is key to establishing whether the requirement is suitable for LPTA, and if so, setting up the procurement for success.

C-7 Rating Methodologies

Rating Methodologies. Tradeoff and LPTA each have a unique rating methodology as summarized below.

COMPARING HOW OFFERORS ARE RATED FOR EACH APPROACH

TRADE OFF

LPTA

Technical Performance

Technical Performance

Subjective evaluation in accordance with DoD Source Selection Procedures and the Army Source Selection Supplement

Allows the Government to:

a) consider award to other than the lowest-priced Offeror, or;

b) other than the highest technically rated Offeror

Objective evaluation of minimum requirements in accordance with DoD Source Selection Procedures and the Army Source Selection Supplement

Evaluated as acceptable or unacceptable

Past Performance

Past Performance

Confidence Assessment

Comparative analysis permitted

Acceptable or Unacceptable

No comparative analysis permitted

Small Business Participation

Small Business Participation

Factor or Subfactor

Exempt from evaluation (DFARS 215.304(c)(i)).

However, if desired as an evaluation factor, it should be considered one of the technical factors/subfactors and evaluated accordingly.

Price

Price

Not rated adjectively

Evaluated in accordance with the Source Selection Plan and Sections L and M of the RFP

Not rated adjectively

Of the acceptable proposals, lowest evaluated price wins

Tradeo ffs

T radeo ffs

In accordance with the Source Selection Plan and Sections L and M of the RFP

Tradeoff not permitted

No additional credit for exceeding standards

C-8 Common Concerns For Each Methodology

It is important to understand and consider the benefits and possible down-sides of each approach in order to ensure you select the one that will help you achieve best value for the customer/program. Below are some of the common concerns.

COMPARING COMMON CONCERNS

TRADEOFF

LPTA

Will the Government Get What

It Is Paying More For?

Will the Government Get What It

Needs At the Price Proposed?

The Government shall incorporate evaluated strengths as a contractually binding requirement to the greatest extent possible (particularly when offeror was selected under VATEP).

Post-award management must follow through to ensure receipt of the anticipated benefits.

The Government sometimes has difficulty identifying with enough clarity and specificity what its requirements are (even when we think we’ve done a good job).

If this occurs, the contract may require modifications to ensure the Government’s needs are met, which may increase the price over time.

Thorough, upfront analysis is essential. Careful post-award management is equally as important.

Apply lessons learned to appropriately determine the source selection methodology for follow-on contracts.

Ensure the Tradeoff Decision Is Sound

Low Acceptability Standards/Evaluation Criteria Increase Performance Risk

Does the order of importance of factors and subfactors reflect the goals of the program, and what is most important to the customer and the end user/warfighter?

Was the order of importance adequately described in the RFP?

Did the evaluation follow the Source Selection Plan and RFP?

Acceptability standards that are set too low can result in low prices that are also too low, resulting in award to the wrong Offeror at increased performance risk.

LPTA should not mean buying cheaper goods or services. Minimum requirements does not mean “bare bones”.

No additional credit for exceeding standards

C-9 Tips And Best Practices For Using LPTA

Below are some general tips and agreed-upon best practices to guide application of LPTA techniques.

Tips and Best Practices for Using LPTA

Establishing Technical Factors For Evaluation

When establishing technical factors for evaluation, each must link to specific critical technical requirements in the PWS.

Using a Technical Information Questionnaire (TIQ), which includes the requirement (and PWS/SOW reference), the criteria, and the “standard of proof” will make the job of the evaluator far easier.

Also, providing a technical information questionnaire to the Offeror to complete which includes the requirement (and PWS/SOW reference), the criteria, and the “standard of proof” required, will ensure consistency throughout the process. See Attachment C-1, Technical Information Questionnaire.

“Buy-In” and Performance Risk Can be Mitigated

In LPTA –a very low price is often the result of acceptability standards (criteria) that are set too low or are ill-defined.

Rigorous Definition and Evaluation of “Technical Acceptability ” is key to success.By associating minimum standards with relative risks for execution of each task, the overall performance risk can be mitigated or decreased.

Source Selection Evaluation Training

Train the SSEB on the specific process of evaluating the proposal against the standard of proof relative to each evaluation criteria and documentation.

Brand Name or Equal RFPs

Ensure the salient characteristics are included in the solicitation. If a firm is offering an equal product, the proposal must demonstrate that the product conforms to the salient characteristics listed in the solicitation. If the firm fails to comply, its product is properly rejected as technically unacceptable. Nas /Corp-Telmah Inc., B-405893, Jan.10, 2012, 2012 CPD ¶ 88 at 2.

C-10 LPTA Requirement and Standard of Proof Samples

LPTA REQUIREMENT/STANDARD OF PROOF SAMPLES

SUPPLIES

PROFESSIONAL SERVICES

Corporate

SIMPLE SERVICES

Criteria: All illumination must be provided by LED lights drawing a maximum of 5 amps (C.13.1)

Question on Technical Information Questionnaire (TIQ): Are all the lights of the Light Emitting Diode (LED) type and a maximum combined draw of 5 amps?

Standard of Proof: Manufacturer’s spec sheets showing LED characteristics.

Criteria: Five program analysts with a Bachelor’s Degree in a business discipline with a minimum of 10 years of program analyst experience or a post-graduate degree in a business discipline (Master’s or Doctorate) with a minimum of 5 years of program analyst experience.

Question on Technical Information Questionnaire (TIQ ):Do all of the program analyst executives possess either a Bachelor’s Degree in a business discipline with a minimum of 10 years of program analyst experience or a post-graduate degree in a business discipline (Master’s or Doctorate) with a minimum of 5 years of program analyst experience?

Standard of proof: Resume showing degree and years of experience as specified.

Criteria: Contractor shall possess storage facility to store all equipment listed in attachment X within 15 miles of Arsenal (15 radial miles from geographic center of Arsenal).

Question on Technical Information Questionnaire (TIQ): Does the Offeror possess storage facility that meets 15 mile requirement listed in Section C.4.4?

Standard of proof: Provide evidence of ownership or lease of facility that meets requirements listed in Section C.4.4.

Criteria: The vehicle must be transportable by C-17, C-5, and military sea and rail IAW ATPD XXXX Section 3.1.X and 3.1.X

Question on Technical Information Questionnaire (TIQ): Does the width of the vehicle exceed 96”?

Standard of Proof: CAD drawing with all outside dimensions noted.

Criteria: Five Communications Personnel with minimum of 4 years of experience with military tactical or satellite communications system.

Question on Technical Information Questionnaire (TIQ): Do all of the candidates have a minimum of 4 years of experience with military tactical or satellite communications system?

Standard of Proof: Resumes showing years of experience as specified.

Criteria: Offerors must possess the equipment required to refinish a 3,500 sq. ft. wood floor.

Question on Technical Information Questionnaire (TIQ): Does the Offeror own or lease equipment that will be used to refinish a 3,500 sq. ft. wood floor IAW C.4.5?

Standard of Proof: Specify list of equipment and certificates of ownership for equipment or lease agreements.

Requirement: Engine must be able to be operated with JP-8 (C.1.3)

Question on TIQ: Does the vehicle run on JP-8 IAW ATPD- XXXX Section 3.3.5.1?

Standard of Proof: Manufacturer’s spec sheet for engine.

C-11 Flow Chart For Selection of Best Value Methodology

C-12 LPTA – Sample Evaluator Write-Up

Describe the Evaluation Process in the Source Selection Plan – Then Fully Document the Evaluation In Accordance With the SSP

Use a checklist or evaluation form such as the one below:

FACTOR 3:

Usability

SUBFACTOR 3.2: Setup and Breakdown

OFFEROR:

RFP No:

Instruction to Offeror

Evaluation Criteria

The Offeror shall setup its radar system for test to the point of data recording. After completion of the test, the Offeror shall breakdown its system and return the system to its pre-setup state.

The Government will evaluate the Offeror’s radar system setup and breakdown.

To receive an acceptable rating, the Offeror must demonstrate all of the below items:

a. The system must be transportable by a two person carry.

b. The system must be setup, broken down and operated by one person.

c. The Offeror must set up its radar system within a time not to exceed one hour using one person, and break down its radar system within a time not to exceed one hour using one person.

d. Cable connectors connect and disconnect using no more than one turn, or other quick-disconnect system.

e. When the radar system antenna is mounted on the tripod, the range of motion must be +90 degrees to -10 degrees in elevation (horizontal is 0 degrees) and 360 degrees azimuth, without antenna removal.

Acceptable

* The system is transportable by a two person carry; and is setup, broken down and operated by one person.

* The Offeror sets up its radar system within a time not to exceed one (1) hour using one person, and breaks down its radar system within a time not to exceed one (1) hour using one person.

* Cable connectors are quick to connect and disconnect using no more than one turn, or other quick-disconnect system.

* When the radar system antenna is mounted on the tripod, the range of motion is +90 degrees to -10 degrees in elevation (horizontal is 0 degrees) and 360 degrees azimuth, without antenna removal.

Unacceptable

Not clearly meeting the requirements required to be acceptable.

Acceptable

Unacceptable

SETUP/ BREAKDOWN

NARRATIVE:

TEAM MEMBER:

DATE:

Evaluation Criteria: The Government will evaluate the offeror?s radar system setup and breakdown.

To receive an acceptable rating, the offeror must demonstrate all of the below items:

a. The system must be transportable by a two person carry.

b. The system must be setup, broken down and operated by one person.

c. The Offeror must set up its radar system within a time not to exceed one hour using one person, and break down its radar system within a time not to exceed one hour using one person.

d. Cable connectors connect and disconnect using no more than one turn, or other quick-disconnect system.

e. When the radar system antenna is mounted on the tripod, the range of motion must be +90 degrees to -10 degrees in elevation (horizontal is 0 degrees) and 360 degrees azimuth, without antenna removal

Evaluation narrative write-up below provides an example of both ‘Acceptable” and “Unacceptable” proposal responses:

Acceptable: The offeror proposed a system that can be transported by two people (page 12); can be setup, broken down, and operated by one person (page 13) ; and can be assembled and disassembled in less than one hour (45 minutes) (page 14). The offeror?s approach uses cable connectors that connect and disconnect using only one turn and the range of motion of the radar system antenna is +90 degrees to -10 degrees in elevation and 360 degrees azimuth (page 22).

Unacceptable: The offeror proposed a system that can be transported by two people (page 12); can be setup, broken down, and operated by one person (page 13); however, the system cannot be assembled and disassembled in less than one hour (90 minutes, as stated in the offeror?s proposal in Volume 1, page 16). Based on the evaluation criteria, this is unacceptable and results in the entire factor being unacceptable. The offeror?s approach uses cable connectors that connect and disconnect using only one turn and the range of motion of the radar system antenna is +90 degrees to -10 degrees in elevation and 360 degrees azimuth (page 22).

ATTACHMENT C-1

TECHNICAL INFORMATION QUESTIONNAIRE/EVALUATION MATRIX

OFFEROR NAME:_ ________________________________________

RFP NUMBER:_ ___________________________________________

Factors

RFP Requirement Reference

Proposal Reference

Standard of Proof

Acceptable/

Unacceptable

Evaluators Comments

1.0 TECHNICAL EXECUTION

1.1. Key Personnel Professional Qualifications

1.2 Technical Certifications

1.3 Onsite Courseware Acceptance

1.4 Onsite Training Course

1.5 Electronic Classroom Upgrade

2.0 PROGRAM MANAGEMENT

2.1 Integrated Master Schedule (IMS)

2.2 Computer-Based Training Development Schedule/Plan

2.3 Electronic Classroom Upgrade Schedule / Plan

3.0 ON-SITE PERSONNEL AND CERTIFICATIONS

3.1 Manning Chart Provided

3.2 Labor categories to perform courseware and electronic classroom requirements. Minimum labor categories include Instructional Systems Specialists, Graphic Artists, Programmers, Computer Specialists and/or Engineers and Subject Matter Experts..

4.0 SECURITY

4.1 Classified Information Security Requirements

5.0 PAST PERFORANCE