Int. J. Sustainable Real Estate and Construction Economics, Vol. 1, No. 3, 2019 The solicitation, evaluation, and selection of construction contractors: a case study of US Army Corps of Engineers Bjorn Hale and Salman Azhar McWhorter School of Building Science, Auburn University, 118 M. Miller Gorrie Center, Auburn, AL, 36849, USA Email: sza0001@auburn.edu Email: salman@auburn.edu Muhammad Ali Noor Institute of Management Studies, University of Peshawar, Pakistan Email: m.ali.noor@hotmail.com Malik M.A. Khalfan* School of Property, Construction and Project Management, RMIT University, Melbourne, Australia Email: malik.khalfan@gmail.com *Corresponding author Abstract: The goal of this research was to provide recommendations and highlight areas for improvements during the solicitation, evaluation and selection process of prime contractors by US Army Corps of Engineers. To achieve this goal, the research team conducted the literature review on evaluation of construction contractors, both from a pre-award and post-award stand point followed by interviews using structured questionnaires. This research has concluded that the US Army Corps of Engineers should make strides to better define the evaluation factors that are being utilised, while providing a detailed description of the project being constructed, in order to ensure that potential contractors submit project specific information. By requesting the interested contractors for more project specific information via their management plan, schedules, organisational chart, and other potential evaluation factors, the Corps can gain better insight and understanding of each potential contractor, resulting in the selection of the best contractor for project completion. Keywords: contractor selection; construction contractors evaluation; US Army Corps of Engineers. Reference to this paper should be made as follows: Hale, B., Azhar, S., Noor, M.A. and Khalfan, M.M.A. (2019) ‘The solicitation, evaluation, and selection of construction contractors: a case study of US Army Corps of Engineers’, Int. J. Sustainable Real Estate and Construction Economics, Vol. 1, No. 3, pp.215–231. Copyright © 2019 Inderscience Enterprises Ltd. 215 216 B. Hale et al. Biographical notes: Bjorn Hale earned his Master’s degree in Building Construction from the McWhorter School of Building Science, Auburn University, Auburn, Alabama. His graduate research was focused on the solicitation, evaluation, and selection of construction contractors. Salman Azhar is a J.E. Wilborn Endowed Professor and Graduate Program Chair in the McWhorter School of Building Science at Auburn University, Auburn, Alabama. He has more than 20 years of research, teaching and construction industry experience by working in USA, Hong Kong, Thailand and Pakistan. He has conducted research on high performance buildings, sustainable construction, building information modelling, construction safety and construction education. He has published more than 100 papers in refereed journals and conferences. He also received the Outstanding Researcher Award from the Associated Schools of Construction (ASC) in 2015. Muhammad Ali Noor is an Assistant Professor at University of Peshawar. He is a national expert in public private partnership, construction procurement and project management. Malik M.A. Khalfan is an Associate Professor at RMIT University, Australia. He has more than 20 years of research, teaching, consultancy and construction industry experience by working in the UK, Hong Kong, Pakistan, Australia, Singapore, Vietnam, Malaysia and the UAE. He has published more than 150 papers in refereed journals and conference proceedings. 1 Introduction The right choice of a prime contractor for a construction project is crucial to the project’s success (Rahmani et al., 2018). However, the process for selecting prime contractors for new construction and maintenance/repair work varies widely among the various US Army Corps of Engineer districts this is all due to the fact that they all have interpreted the prescribed process differently. The goal of this research was to analyse the US Army Corps of Engineers practice of evaluating and selecting prime contractors for construction and maintenance/repair work and determining the effectiveness of their existing standard operating procedure (SOP). Six US Army Corps of Engineer districts processes were compared with each other as well as with the current best practices of the private sector with the aim to provide a detailed analysis of the areas where the Corps of Engineers were utilising successful evaluation and selection processes, as well as the areas the Corps of Engineers had room for improvements. The above was achieved through an in-depth review of the current US Army Corps of Engineers process for the evaluation and selection of prime contractors for new construction and maintenance/repair work. Reviews of the current Corps of Engineers process at primarily the Louisville district in the US and European districts as well as districts in Detroit, Buffalo, New York, and Savannah in the USA were conducted to see what areas of the selection process were uniform and identify the areas that were not uniform among the selected districts. The research also focused on a comparative analysis of how the US Army Corps of Engineers evaluates and selects prime contractors. The three objectives of this research were as follows: The solicitation, evaluation, and selection of construction contractors 217 1 Investigate the US Army Corps of Engineers approach of evaluating and selecting prime contractors for construction and maintenance/repair work across the individual Districts as directed by the federal guidelines; specifically the federal acquisition regulation (FAR), the Department of Defence FAR supplement, the army source selection plan, and the US Army Corps of Engineers acquisition instruction, utilising information gathered from the Louisville District, Europe District, Buffalo District, New York District, Savannah District and the Detroit District as the sample group. 2 Investigate the private sectors approaches of evaluating and selecting prime contractors for construction and maintenance/repair work in the above mentioned region. 3 Investigate and highlight the differences between the approaches of the various US Army Corps of Engineers Districts from both the other sample group districts as well as the private sector. Figure 1 Phases of the solicitation, evaluation, and selection process (see online version for colours) Source: USACE (2014) 1.1 The current practice The current approach in vogue used by the US Army Corps of Engineers for the selection of construction contractors can be broken down into five phases; which include the planning phase, solicitation phase, evaluation phase, award phase, and post award phase (see Figure 1). The planning phase is the first phase of the process when a US Army Corps of Engineers District initially receives a request from a client for the construction of a project. The clients on whose behalf the US Army Corps of Engineers completes projects includes US Federal agencies, such as the US Air Force, US Army, Veterans Affairs, etc. The US Army Corps of Engineers primary source of funding for these projects comes from these agencies as they receive requests to solicit, award, and oversee their projects. Once received, the project is assigned to an internal project manager who initiates the acquisition process along with the assigned internal contract specialist and internal project engineer. The process includes the defining of the project requirements, conducting market research, overall acquisition planning and the completion of the source selection plan that will outline the evaluation factors and identify the selection criteria that will be utilised for the project (USACE, 2014). The solicitation phase is the part of the process in which the solicitation is created and posted on the Federal Business Opportunities website for review. The project manager, 218 B. Hale et al. project engineer, contract specialist along with other stakeholders begins the process of posting a synopsis of the project as the solicitation is being developed. Once the solicitation is completed, it is issued on the Federal Business Opportunities website for review by any interested contractors. The solicitation for most standard construction projects usually has a proposal due date of thirty days from issue of the solicitation, during this period the project manager, project engineer, and the contract specialist will answer/address any requests for information that may be submitted. If the requests for information require an amendment to the solicitation, it is addressed during this phase. The solicitation phase ends upon the receipt of proposals from interested parties. The Evaluation Phase consists of the preliminary review of the submitted proposals by the Contract Specialist to ensure all the required documents and information were correctly submitted prior to beginning the Source Selection Evaluation Board (SSEB). Once the preliminary review is completed, the SSEB is scheduled for the review of the proposal submissions. During the SSEB, the members review each submitted proposal as a standalone submission, without comparing them to the other submittals. Once the proposal review is completed, the SSEB provides their source selection evaluation report to the contracting officer for final review and the selection of the contractor who provides the best value to the Government. Once the selection has been made, the Award Phase begins with the formal award and notification of a contract to the contractor that provides the overall best value to the government. Simultaneously with the notification of award to the successful contractor, the unsuccessful contractors are notified that they have not been selected for award and are being afforded the opportunity for a de-briefing on how the Corps of Engineers evaluated their proposal which is a grievance redressal mechanism. An awarded contract is issued to the successful contract upon notification and begins the final phase of the process. The post-award phase is the portion of the process that consists of the implementation and oversight of the contract award. The oversight generally falls to the administrative contracting officer and the contracting officer representative that are predominately on site; however, the project manager and contracting officer are both still involved with the project up till the point of contract close out (USACE, 2014). 2 Literature review Selecting a capable contractor is an underpinning of every successful construction project and is instrumental for thwarting project issues and requires the individual or company or in this case the US Army Corps of Engineers to put in the necessary effort to thoroughly review all the potential contractors for the project. Construction project success or any project for that matter has to view in terms of cost, time and quality which make it imperative to select the best contractor for the project being proposed. In 1979, the institute of building was among the first to point out the shortcomings that occurred in both the public and private sectors which resulted into clients having difficulty achieving best value for the money. Most of these shortcomings originated before the contractor was appointed and many were made worse because the wrong contractor, or the wrong method for employing the contractor, was chosen (Holt et al., 1995). The method of selection should be based on three criteria; time, cost, and quality but in a research conducted by Holt et al. (1995), it was documented that mostly, any The solicitation, evaluation, and selection of construction contractors 219 combination of the two (out of three) can be achieved, but rarely all three. There will always be a trade-off between time, cost, and quality as the customer tries to balance these variables. But it was also argued that contrary to popular belief, good quality can be achieved at a reasonable cost and in good time (Holt et al., 1995). To maximise the potential of selecting a capable contractor who in the end would provide a timely project that falls within the allowable cost range and quality standards of the customer, the customer needs to identify suitable and relevant selection criteria for their project. Numerous criteria for selecting construction contractors have been utilised over the years, including financial stability, past performance, experience, key personnel availability, contractors current workload, contractors management resources, the size and complexity of the project, etc. (Rahmani et al., 2017; Khalfan et al., 2014; Oyegoke et al., 2009; Kumaraswamy, 1995). According to Noor and Khalfan (2017) evolution of procurement in project management in the construction industry has arisen from a number of factors which has resulted in forcing the construction industry into a position where it has to change to survive (Walker and Rowlinson, 2008). As Tookey et al. (2001) state that there are a number of different types of procurement routes available to choose from. Noor and Khalfan (2017) states that each different type of procurement [traditional approach, design and build (D and B), build-operate-transfer (BOT), management contracting, PPP, etc., has its own proponents and inherent strengths and weaknesses but the underlying question that arises is which one is the best choice? The selection of optimal procurement systems has been found to be difficult, because even experienced clients cannot know all the potential benefits and risks for each system. Procurement is, therefore, a succession of calculated risks (Tookey et al., 2001). Walker and Rowlinson (2008) suggest that the project procurement choice can be guided by the project typology and the degree of collaboration and integration between the supply chain parties and their relationships. The current process of procurement selection tends to be carried out in a rather unstructured and cursory manner, and this may give rise to the adoption of procurement system beyond the deliberate choice (Masterman, 1992; Luu et al., 2003). The result of employing an imprudently selected procurement method could be an impediment to the realisation of certain anticipated benefits associated, and might eventually lead to project failure (Naoum, 1994; Sharif and Morledge, 1994; Ambrose and Tucker, 1999; Luu et al., 2003). Inappropriate procurement strategies may lead to cost and time overruns claims and disputes on projects (Masterman, 1992; Abdel-Meguid and Davidson, 1996). Conversely, appropriate procurement strategies are needed to help achieve optimal solutions in terms of cost, time and quality (Oyegoke et al., 2009; Noor et al., 2011; Khalfan et al., 2014; Rahmani et al., 2017; Noor and Khalfan, 2017). 2.1 Evaluation factors The dependence on organisations to rely too heavily on cost is a high risk and extremely short sighted in regards to the overall success of a project. As stated by Holt et al. (1995), it is unwise to pay too much but it is worse to pay too little. The author also stated that during poor economic climates, contractors will submit an extremely low price for the project to keep their staff employed during the leaner times. This attempt to buy work with proposals that have little to no profit included within the submitted proposal, increases the risk of the project failing. This was evident in many of the proposals 220 B. Hale et al. received by the US Army Corps of Engineers during the period between 2008 and 2012, when the construction industry had a severe cooling off period after the sudden economic downturn during those years. Most public sector and some private sector clients still find it difficult to accept any evaluation factors other than the lowest price. Noor and Khalfan (2017) observed that the need for efficiency and finances were the main issues for choosing a certain procurement method in organisations. According to them Project characteristics especially technical complexity and cost of project have been found to be deciding factors. According to Luu et al. (2003) and Morledge et al. (2006), project characteristics are important factors effecting procurement. Morledge et al. (2006) suggests that the size, complexity and the location of the project should be carefully considered. As Morledge et al. (2006) suggest they can have a bigger risk of cost or time overruns. Nahapiet and Nahapiet (1985) found that it was useful to characterise projects in terms of their relative complexity, believing that this was likely to be at least one important determinant of the need for flexibility. Many researchers argue that ‘project size’, ‘project type’ could in turn affect the ultimate performance of a project, and which reflect the project’s physical characteristics should therefore be carefully selected and used (Skitmore and Marsden, 1988; Turner, 1990; Love et al., 1998; Luu et al., 2003). Noor and Khaldan (2017) states that Understanding a client’s implicit and explicit objectives for construction is a complex issue (Tookey et al., 2001). They further suggest that client role has been the source of much research over the years. Fundamentally, client objectives focus on three factors i.e., quality, cost and time (Walker and Rowlinson, 2008). Tookey et al. (2001) summarises core client objectives as highest realistic quality with lowest realistic cost done in minimum realistic time and having minimum conflict during the process. Noor and Khalfan (2017) found that clients’ objectives have also been found to be an important factor in procurement selection in including the clarity of clients’ needs. They also state observed that transparency and competition are important in public sector procurement. Principles of procurement as defined by Raymond (2008) i.e., transparency, accountability, competition, value for money (VFM) and ethics are important factors in public procurement competitive tendering is the means by which most goods and services are procured. Noor and Khalfan (2017) further states that competitive tendering involves processing of bids and a technical evaluation committee evaluates whether bids are in accordance with requirements as stipulated in tender conditions. They suggest in this process competition occurs as the credibility of the bidder in carrying out previous contracts of similar nature, the price are compared across the bidders and the most competitive bidder is awarded the tender. Erridge et al. (1999) referring to the quality of the tender document and advertisement states that provision of inaccurate data and information often result in misunderstandings and increased costs the better the quality of information provided the less likely that it results in an unsatisfactory purchase. Raymond (2008) and Erridge et al. (1999) believe that competitive tendering avoids accusations of favouritism and fraud and that the openness of the system encourage more suppliers to participate and that increased competition help reduce prices, improve quality and lead to greater competitiveness among bidders. However Noor and Khalfan (2017) observed that over competitiveness had resulted in development of adversarial relationship between clients and contractors and among contractors as well which seems to be universal across the construction industry throughout the world. The function of transparency is also important in procurement and it refers to openness (Raymond, 2008). Transparency therefore is an essential aspect of ensuring The solicitation, evaluation, and selection of construction contractors 221 accountability and minimising corruption, and is particularly associated with the rise of the governance agenda as transparency is a core governance value (Smith-Deighton, 2004). Transparency in construction procurement both public and private sector provides an assurance for both domestic and foreign investors that contracts will be awarded in a fair and equitable manner (Raymond, 2008). These rules also ensure that goods and services are obtained at the most economic prices and thus lead to a reduction in costs (Raymond, 2008). According to Rege (2001), the most important benefit of transparent and open procedures is the impact which their adoption may have on the level of corruption in countries where it is widespread. Therefore, transparency promotes trust by allowing stakeholders to see and judge the quality of government actions and decisions (Smith-Deighton, 2004). VFM is the most important principle of procurement (Raymond, 2008). VFM in the public sector entails consideration of the contribution to be made to advancing government policies and priorities while achieving the best return and performance for the money being spent (Bauld and McGuinness, 2006). VFM is not taken to be least cost (Pitt et al., 2006). 2.2 Pre-qualification of contractors The process of pre-selecting qualified contractors to submit proposals has been around for many years. The process has evolved over the years and many organisations have set out, to eliminate the burden of time, expense, and effort on the industry; to limit the number of firms allowed to submit on a solicitation to a small number of pre-qualified firms that can perform the work to standard. As the efforts and costs involved in proposal preparation and proposal evaluation are enormous, the number of pre-qualified, short listed contractors for projects is limited and the preferred range is between three to five (Palaneeswaran and Kumaraswamy, 2000). Short listing in general has proven advantages and can be completed by creating a register of contractors classified by previously evaluated capabilities. Public sector clients are most often constrained to select the lowest proposer, which makes short listing even more important (Kumaraswamy, 1996). Short listing allows the organisation limit the firms submitting on a project to the most qualified contractors in a specific area of expertise or location. On the other hand, there are also disadvantages to the public sector clients. Once the pre-selected contractors are on board, there might be situations when the clients end up paying more than the market price or deal with the budget and time overrun. Rahmani et al. (2017) have provided greater details on various procurement methods being used for contractors pre-qualification. 2.3 Streamlining the evaluation factors Past performance, experience, key personnel availability, and construction management resources dominate most construction solicitation factors but they are not the only factors that can be used by an organisation during the selection process. Evaluation factors should be selected based on the requirements of the project and reflect the overall expectations of the organisation soliciting the project. Streamlining the evaluation factors to best reflect the proposed project is an opportunity for the selecting organisation to tailor the factors to the areas that are most important to them when selecting a contractor (Rahmani et al., 2017, 2018). Now the predominant factors previously listed would most 222 B. Hale et al. likely still be a part of the solicitation but the addition of various alternate factors and sub-factors could be added to the package based on the type of project being proposed. Factors would be added or removed from a solicitation based on various elements of the project, which include but are not limited to, overall cost of the project, size of the project, complexity of the project, and the proposed timeline of the project. These listed elements play a part in the predominant factors as well but lend themselves to including other evaluation factors. The two significant knowledge gaps that seemed to bubble up throughout the literature review revolved around the ability to adequately streamline the evaluation factors to a solicitation for construction work, as well as how to review a potential contractor’s financial stability. As discussed previously, streamlining the evaluation factors will help the organisation soliciting the project more adequately evaluate a contractor for the specific project being solicited. The ability to gauge a construction contractor’s financial stability and current workload will allow the selecting organisation to better identify a contractor who will not default on their obligations as a prime contractor or be stretched too thin to adequately perform the project. 3 Research methodology This research study was based on the qualitative research method. The qualitative research approach was selected based on the scope of the research and the reliance on individual feedback via the interview/questionnaire process. The idea was to gain an understanding of the underlying basis for certain evaluation factors/selection criteria that go into the construction solicitation process by canvassing as many individuals involved with the solicitation, evaluation, and selection process within the US Army Corps of Engineers as well as an in-depth literature review on the subject. The initial data collection was done by reviewing the case studies, journal articles and other forms of research regarding the source selection process and procedures. This initial literature reviews highlighted practices in both the public and private sector regarding the source selection process when planning for a new construction project. During the canvassing stage of the research, numerous individuals involved with the solicitation, evaluation, and selection process as conducted by the US Army Corps of Engineers were sent a questionnaire. The questionnaire document requested standard information regarding their current position and experience with the overall process in selecting a prime contractor for a construction project. Individuals were selected for the interview questionnaire based on their level of experience with the solicitation, evaluation, and selection process currently being utilised by the US Army Corps of Engineers. This includes contract specialist, contracting officer and administrative contract officer, project engineer and project manager, and contracting officer representative. The US Army Corps of Engineers currently has nine divisions and 43 district offices spread out through the United States, Germany, Japan, South Korea, Middle East, and Afghanistan. The interview questionnaires were sent to the Louisville, Detroit, Buffalo, New York, Savannah, and Europe Districts. These districts fall under the Great Lakes and Ohio River Division (Louisville, Detroit, and Buffalo), North Atlantic Division (New The solicitation, evaluation, and selection of construction contractors 223 York and Europe), and the South Atlantic Division (Savannah District). The decision to utilise the following Districts versus one of the other 37 districts was based on specific district missions; which can vary significantly (Nashville District primarily handles civil works and very little construction or the Afghanistan/Middle East District missions operate outside the SOP for construction projects, so they were not contacted). Time constraints also limited the number of districts contacted to complete the questionnaires that contains interview style questions; which made it necessary to contact the districts with the most significant construction workload to get enough quality responses to the interview questionnaire. 4 Data analysis The data collection phase was conducted over a two-week period, providing for the individuals who were requested to complete a written questionnaire that was design using interview questions to gather qualitative written data. They were given ample time to review the document and submit a detailed response. The time constraints restricted the number of divisions and districts within the US Army Corps of Engineers who were contacted to complete the interview questionnaire. In future research, it would be beneficial to receive at least one response from each of the nine divisions for a total of at least 50 responses. The time constraints limited the research to the distribution of thirty questionnaires to individuals representing three divisions and six districts and nominated by their commanders. 18 questionnaire responses were received out of the 30 interview questionnaires that were distributed. The submitted responses to the questionnaires provided insight on how the selected US Army Corps of Engineers Districts of Louisville, Detroit, Savannah, New York, Europe, and Buffalo were going about the process of soliciting, evaluating and eventually selecting prime contractors. The first three questions on the questionnaire were utilised to provide a small census of the individuals that had submitted responses. This information from the initial three questions was utilised to gauge the experience, job position, and to provide insight to the stances and responses everyone submitted on questions four through nine. To clarify, members of the post-award construction contract administration staff, i.e., the contracting officer’s representative and the administrative contracting officer could bring a different point of view to what they consider the most or least important evaluation factors in comparison to the pre-award staff, i.e., the contract specialist, project engineer, or the project manager. The responses provided to questions four through nine were reviewed to find out the current evaluation factors being used by the US Army Corps of Engineers and which were the most useful and least useful. The responses also provided a basis for everyone’s selections and in which direction they would like to see the evaluation criteria selected and applied on future projects. This information was compiled and analysed to see which evaluation factors were mentioned on a consistent basis for either category and if that individual factor should be included or removed from future solicitations. A total of 30 interview questionnaires were sent out to members of the US Army Corps of Engineers representing the Louisville, Europe, Detroit, New York, Buffalo, and Savannah Districts. 18 responses were received in total to the questionnaire representing 224 B. Hale et al. all six Districts. The responses as indicated by the chart above included four contracting officers, two contract specialists, six project managers, two project engineers, three administrative contracting officers, and one contracting officer representative for a total of 18 interview questionnaire responses. Figure 2 Questionnaire responses by position (see online version for colours) The first three questions of the questionnaire were utilised to identify the individual’s current position, level of experience with the solicitation, evaluation, and selection of construction contractors, and the types of construction projects that they have been involved in as a member of the US Army Corps of Engineers. Questions four through nine were an opportunity for everyone to relay their personal experiences while working through the process of issuing a solicitation, evaluating proposals, and eventually selecting a construction contractor. The idea behind the questionnaire was to find out what evaluation factors were used on previous construction project awards, what factors were considered the most useful in regards to selecting a contractor, and which evaluation factors were the least useful during the selection process. The questionnaire was also used to see what evaluation factors that each individual thought would be beneficial on future projects that the US Army Corps of Engineers will be hoping to complete in the future. Question number four, “What are some of the primary evaluation factors that were utilised in the solicitation, evaluation, and selection process that you were involved in?” resulted in a list of seven different evaluation factors. Those factors included past performance and experience, key personnel, management plan (the following responses of technical approach, organisational chart, design capability were all rolled into the management plan factor based on similarity in application), schedule, sub-contractor experience, safety, and price. Question number five, “Which evaluation factors did you feel were the most useful in determining the best contractor for the particular project and why?” resulted in a list of four evaluation factors. Those factors as depicted in the below chart included past performance and experience (83%), management plan (22%), key personnel (11%), and schedule (6%). The solicitation, evaluation, and selection of construction contractors Figure 3 225 Questionnaire responses – most useful evaluation factors (see online version for colours) Question number six, “Which evaluation factors do you feel were the least useful in determining the best contractor for a particular project and why?” resulted in a list of five evaluation factors. These factors as depicted in the below chart included key personnel (33%), management plan (28%), past performance and experience (17%), schedule (17%), and price (17%). Question number seven, “What evaluation factors would you like to see added for future solicitations, evaluations, and selections that have not previously been utilised on projects that you have been involved in and why?” resulted in a few responses which included bar chart schedules, project specific scheduling, sub-contractor management plans, and innovative approaches. The evaluation of innovative approaches was the most frequently suggested. Some interviewees added that the elimination of some evaluation factors would be most beneficial to the process. Figure 4 Questionnaire responses – least useful evaluation factors (see online version for colours) Question number eight, “Are there any evaluation factors that are dependent on project type or project delivery system?” resulted in responses that were mostly affirmative to the fact that there are some evaluation factors that could be utilised based on project specific 226 B. Hale et al. requirements. However, there were minimal suggestions of actual evaluation factors that could be utilised in certain scenarios. Question number nine, “Do you think the right positions/individuals were involved in the solicitation, evaluation, and selection process? If not, what positions/individuals do you believe should be involved but were not represented in previous solicitation, evaluation, and selection processes?” resulted in responses that were mostly affirmative in the fact that the right individuals were involved in the solicitation, evaluation, and selection process. 18 of the interview questionnaires were returned for assessment out of the thirty interview questionnaires that were distributed to various US Army Corps of Engineers personnel. The individuals that responded overwhelmingly stated that past performance and experience was the most useful evaluation factor currently being utilised by the US Army Corps of Engineers. Past performance and experience was mentioned in 15 of the 18 (83%) responses. The past performance and experience evaluation factor was the predominately selected evaluation factor because of the powerful insight it provides to a given contractors technical capabilities and previous performance on construction projects. If the solicitation along with the enclosed evaluation and selection criteria include significant project details and expectations for the project, then the likelihood of receiving proposals from contractors that are qualified for the project will increase drastically. It will also allow for potentially unqualified contractors to make an educated decision on if they would like to expend the time and resources to submit for a project that they have a low probability of being awarded. The significant benefit of the past performance and experience evaluation factor is the insight it provides to a contractors previously completed construction projects and if there are any significant similarities to that of the proposed project. If a contractor has done his or her due diligence and submitted projects that are like the proposed project, it will increase the likelihood of being selected for award and the potential for pairing a successful contractor with the firm advertising the project. Figure 5 Most useful evaluation factors (see online version for colours) The solicitation, evaluation, and selection of construction contractors Figure 6 227 Least useful evaluation factors (see online version for colours) There were five factors listed in the questionnaire responses that were the least useful factors, those factors were key personnel, management plan, past performance and experience, schedule, and price. Price as a factor along with small business participation is required for all construction acquisitions, so both factors will not be discussed any further. Both were mentioned as not being helpful to the overall evaluation and selection process within numerous questionnaires, specifically the small business participation requirement. The factors that were mentioned, key personnel, management plan, past performance and experience, and schedule; all had a common core of comments associated with their selection as one of the least useful evaluation factors. All the questionnaire responses continually stated that the lack of project specific details associated with each of the evaluation factors were the contributing basis for their selection as a least useful evaluation factor. The management plan, schedule, and the past performance and experience factors could be improved drastically if the information requested and criteria for selection were geared toward the actual project being constructed. The predominant issue listed for key personnel was relatively simple in that the individuals that were submitted as the contractor’s key personnel for evaluation were not always the individuals that would end up filling these positions once the work on the project began. The submitted questionnaires included varying responses that the individuals involved in the evaluation process would like to see included in future solicitations. Some of the evaluation factors that were mentioned for potential use moving forward were bar chart and project specific schedules, sub-contractor management plans, and innovative approaches. With project specific scheduling and sub-contractor management plans being information that could be compiled in more project specific management plans, it will be better to concentrate on the evaluation factor that was mentioned the most in the submitted questionnaires. Innovative approaches were mentioned quiet frequently but it is one of the more difficult factors to implement for a federal agency like the US Army Corp of Engineers. The reason being that when evaluating submitted proposals is pricing 228 B. Hale et al. is withheld until after all the evaluations have been completed. Not knowing if the innovation is going to save money or cost more money can make it difficult to decide if the innovation adds value to a project. This comes into play even more when the proposed projects are already on a tight budget. 5 Conclusions and recommendations The literature revealed that there has been extensive research on the solicitation, evaluation, and selection of construction contractors, much of it focused on the importance of shifting away from relying heavily on cost alone to an evaluation of multiple factors to determine the contractor that provides the best value to the soliciting organisation. A large amount of the research completed focused on the pre-qualification of contractors to limit the overall burden on both the contractors in the form of proposal costs and the soliciting organisation in the form of evaluation of submittal costs. The literature harped on the creation of evaluation factors that would help gauge the ability of a contractor to complete the project. Despite the extensive research that has been conducted, there is still room for further improvement. Specifically, the area of streamlining the evaluation criteria to a certain project. This research sought, through the consultation with US Army Corps of Engineers personnel directly involved in the solicitation, evaluation, and selection of construction contractors; determine the best practice for streaming the evaluation criteria to ensure that the contractor that provides the best value is selected for the project. The research has confirmed that the sample US Army Corps of Engineer Districts are in lock step with much of the construction industry as it moves away from basing the selection process on lowest price to a best value approach. Despite, some minor differences in the overall method, the districts surveyed approached the solicitation, evaluation, and selection process with almost identical tactics. This is primarily a direct result of district adhering to the federal guidelines that are outlined in the FAR, the Department of Defence FAR Supplement, the army source selection plan, and the US Army Corps of Engineers acquisition instruction; however, there is a level of flexibility afforded to each district during the acquisition process that could result in significant differences in one districts approach over another. Outside of a few outlier projects, the US Army Corps of Engineers utilises a best value approach when selecting a prime contractor for any of their numerous construction projects. The private sector along with the public sector is making the shift away from a selection process based solely on price for a best value approach, based on a variety of evaluation factors; which includes price. The private sector has a distinct advantage over the public sector by not being bound by the various federal and state regulations like the US Army Corps of Engineers. That gives a private sector organisation a significant amount of leeway during the solicitation, evaluation, and selection process. However, outside of limiting the number of proposals they are willing to accept (federal agencies must maximise competition at all times) the private and public sector generally follow the same overarching approach during the process. An area the private sector has begun to pursue is the pre-qualification or pre-selection of capable contractors to submit pricing proposals for their projects. The process involves the creation of a list of capable and qualified contractors, then when a need arises, selecting three to five of the most highly The solicitation, evaluation, and selection of construction contractors 229 qualified construction contractors based on the requirements of the project to submit a pricing proposal. 6 Recommendations The US Army Corps of Engineers should continue to pursue the best value approach; however, the agency should continue to modify and evolve the methodology for the solicitation, evaluation, and selection of construction contractors to continually adapt to the changing construction landscape. The current approach involves a standard set of evaluation factors and minimum threshold requirements for satisfactory compliance to be considered for selection. The Corps of Engineers should begin to adapt their procedures to be more project specific and begin utilising evaluation and selection criteria that might not always be necessary for every project although could provide valuable insight into a contractor’s capabilities for projects that require more unique proficiencies. The US Army Corps of Engineers should also be willing to eliminate or revise evaluation factors that are either problematic or add no clear value to the solicitation, evaluation, and selection process. A few clear examples, as mentioned in several of the interview questionnaires, are the Schedule, Key Personnel, and Management Plan. The Schedule as an evaluation factor could easily be eliminated since the projects are solicited with a set number of days allowed to complete the project. However, the schedule factor is also unique in that it could be modified to help provide insight into a contractors overall sequencing approach which would highlight their grasp of the project requirements. Based on the interview questionnaire responses, it might be more efficient to set some minimum personnel experience requirements for certain positions and eliminate the need for the key personnel evaluation factor. The contractor if selected for the award would then have to submit the personnel that will hold key positions for approval based on the minimum requirements of the solicitation/awarded contract, prior to beginning work. The management plan is also an excellent candidate for significant revision as an evaluation factor. Though some responders to the interview questionnaire would prefer its elimination from future selection criteria, there is enough evidence to conclude that if the Management Plan evaluation factor was based on project specific requirements, it could be a significant factor in determining a contractor’s competency to complete a project. 7 Research significance The in-depth research conducted in this paper has revealed that cost alone is a high-risk approach and that organisations should base their selections on a value of money basis with proper weighting of selection criteria for skill, experience and previous performance, rather than excepting the lowest price (Kumaraswamy, 1995). The US Army Corps of Engineers slow transition from cost being the most important evaluation factor to more of a best value approach that factors in multiple criteria for the selection of prime contractors is a dramatic improvement over the once prominent sealed bidding/lowest price solicitation process. The initial cost increases of a longer and more time intensive solicitation, evaluation, and selection process greatly outweighs the 230 B. Hale et al. potential cost overruns that have historically plagued projects that were awarded based on the lowest priced proposal. Another significant revelation of this research is that the US Army Corps of Engineers SOP for the solicitation, evaluation, and selection of prime contractors for new construction and maintenance/repair work will benefit significantly by streamlining their evaluation and selection criteria to be more project specific. The added project specific detail inserted into a given solicitation with corresponding project specific evaluation and selection criteria will improve the chances of receiving proposals from qualified contractors with a history of successful performance on similar projects; which will result in an increase of projects successfully completed within budget, time, and an increase in overall quality of the product. A significant knowledge gap that this research uncovered was the inability for organisations to evaluate a construction contractor’s financial stability. A leading cause of project failure is the inability of a contractor to appropriately manage its cash flow throughout the life cycle of the project. Research in construction contractor’s financial stability might highlight possible evaluation factors and selection criteria that could minimise the risk of failure for a given construction project. References Abdel-Meguid, T.A. and Davidson, C.H. (1996) ‘Managed claims procurement strategy (MCPS): a preventive approach’, in Taylor, R.G. (Ed.): CIB W92 ‘North meets South’ Procurement Systems Symposium Proceedings, Durban, South Africa, p.1120. Ambrose, M.D. and Tucker, S.N. (1999) ‘Matching a procurement system to client and project needs: a procurement system evaluator’, in Bowen, P.A. and Hindle, R.D. (Eds.): CIB W92 Proceedings: Customer satisfaction: A Focus for Research and Practice in Construction, Procurement Systems Symposium, University of Cape Town, pp.280–288. Bauld, S. and McGuinness, K. (2006) ‘Value for money’, Summit, Vol. 9, No. 1, pp.20–21, cited in Raymond, J. (2008) ‘Benchmarking in public procurement’, Benchmarking: An International Journal, Vol. 15, No. 6, pp.782–793. Erridge, A., Fee, R. and Mcllroy, J. (1999) ‘An assessment of competitive tendering using transaction cost analysis’, Public Money and Management, Vol. 19, No. 3, pp.37–42. Holt, G., Olomolaiye, P. and Harris, F. (1995) ‘A review of contractor selection practice in the U.K. construction industry’, Building and Environment, Vol. 30, No. 4, pp.553–561. Khalfan, M.M.A., Maqsood, T. and Noor, M.A. (2014) ‘Relationships among supply chain participants: the case of Australia and Malaysia’, International Journal of Procurement Management (IJPM), Vol. 7, No. 4, pp.376–390, Inderscience Publishers, UK. Kumaraswamy, M. (1995) ‘Contractor evaluation and selection: a Hong Kong perspective’, Building and Environment, Vol. 31, No. 3, pp.273–282. Love, P.E.D., Skitmore, M. and Earl, G. (1998) ‘Selecting a suitable procurement method for a building project’, Construction Management and Economics, Vol. 16, No. 2, pp.221–233. Luu, D.T., Ng, S.T. and Chen, S.E. (2003) ‘Parameters governing the selection of procurement system – an empirical survey’, Engineering, Construction and Architectural Management, Vol. 10, No. 3, pp.209–218. Masterman, J.W.E. (1992) An Introduction to Building Procurement Systems, E & FN Spon, London. Morledge, R., Smith, A. and Kashiwagi, D.T. (2006) Building Procurement, RICS Research, Blackwell Publishing, Oxford. Nahapiet, H. and Nahapiet, J. (1985) ‘A comparison of contractual arrangements for building projects’, Construction Management and Economics, Vol. 3, No. 3, pp.217–231. The solicitation, evaluation, and selection of construction contractors 231 Naoum, S.G. (1994) ‘Critical analysis of time and cost of management and traditional contracts’, Journal of Construction Engineering and Management, Vol. 20, No. 4, pp.687–705. Noor, M.A. and Khalfan, M.M.A (2017) ‘Public private partnership in transport sector projects in Pakistan’, Int. J. Critical Infrastructures, Vol. 13, No. 1, pp.70–92. Noor, M.A., Maqsood, T. and Khalfan, M. (2011) ‘Infrastructure procurement in Pakistan’, Proceeding of Sixth International Conference on Construction in the 21st Century (CITC-VI), ‘Construction Challenges in the New Decade’, Kuala Lumpur, Malaysia, 5–7 July. Oyegoke, A.S., Dickinson, M., Khalfan M.M.A., McDermott, P. and Rowlinson, S. (2009) ‘Construction project procurement routes: an in-depth critique’, International Journal of Managing Projects in Business, Vol. 2, No. 3, pp.338–354. Palaneeswaran, E. and Kumaraswamy, M. (2000) ‘Contractor selection for design/build projects’, Journal of Construction Engineering and Management, September/October, pp.331–339. Pitt, M., Collins, N. and Walls, A. (2006) ‘Practice briefing: the private finance initiative and value for money’, Journal of Property Investment and Finance, Vol. 24, No. 4, pp.363–373. Rahmani, F., Khalfan, M. and Maqsood, T. (2018) ‘A comparative study of early contractor involvement (ECI) and project alliancing’, International Journal of Project Organization and Management, Vol. 10, No. 2, pp.93–108. Rahmani, F., Maqsood, T. and Khalfan, M. (2017) ‘An overview of construction procurement methods in Australia’, Engineering, Construction and Architectural Management, Vol. 24, No. 4, pp.593–609. Raymond, J. (2008) ‘Benchmarking in public procurement’, Benchmarking: An International Journal, Vol. 15, No. 6, pp.782–793. Rege, V. (2001) ‘Transparency in government procurement: issues of concern and interest to developing countries’, Journal of World Trade, Vol. 35 No. 4, pp.485–515. Sharif, A. and Morledge, R. (1994) ‘A functional approach to modelling procurement systems internationally and the identification of necessary support frameworks’, ‘East Meets West’ CIB W92 Conference, Hong Kong, CIB Publication 175, p.295305. Skitmore, R.M. and Marsden, D.E. (1988) ‘Which procurement system? Towards a universal procurement selection technique’, Construction Management and Economics, Vol. 6, No. 1, pp.71–89. Smith-Deighton, R. (2004) ‘Regulatory transparency in OECD countries: overview, trends and challenges’, Australian Journal of Public Administration, Vol. 63, No. 1, pp.66–73. Tookey, J.E., Murray, M., Hardcastle, C. and Langford, D. (2001) ‘Construction procurement routes: re-defining the contours of construction procurement’, Engineering, Construction and Architectural Management, Vol. 8, No. 1, pp.20–30. Turner, A. (1990) Building Procurement, MacMillan, London. US Army Corps of Engineers (USACE) (2014) USACE Acquisition Instruction (UAI). Walker, D.H.T. and Rowlinson, S. (2008) ‘Project types and their procurement needs’, in Walker, D.H.T. and Rowlinson, S. (Eds.): Procurement Systems: A Cross-industry Project Management Perspective, Taylor and Francis, New York.