Emergent Cross-Case and Cross-Sectoral Themes from the MEGAPROJECT Portfolio: An Interim Review A document produced for The MEGAPROJECT COST Action: TU10003 Naomi Brookes January 2013 Emergent Cross-Case and Cross-Sectoral Themes from the MEGAPROJECT Portfolio Introduction and Aim The aim of this monograph is to bring together the diverse work streams that have been undertaken within the MEGAPROJECT COST Action. Its aim is to identify cross-case themes that emerge from the behaviour of the megaprojects in the MEGAPROJECT case portfolio. These themes are then triangulated to establish meta-themes that relate to the whole of the MEGAPROJECT portfolio across sectoral boundaries. This paper follows the initial work published in “MEGAPROJECT Cross- Case Themes: An Initial Examination” produced in April 2012. Existing Work Streams The following represent the work streams carried out under the auspices of the MEGAPROJECT COST Action to establish cross-case themes: The Cross-Sectoral Working Group’s Activities The Transport Working Group’s Activities The Energy Working Group Activities o Initial Review o Inductive and Deductive Approaches o Semantic Analysis o Non-Parametric Statistical Analysis Approach to verification The Transport Working Group Activities The non-parametric statistical analysis of the whole MEGAPROJECT portfolio The MEGAPROJECT Training School and Think Tank held on 30/11/12 – 2/11/12 A Short-Term Scientific Mission undertaken between Robert Hickey and Professor Mauro Mancini at the Politecnico di Milano All of these work streams have produced individual reports that are available from the MEGAPROJECT Project Executive, Sarah King, at info@mega-project.eu. This monograph has used these reports in its construction. The Cross-Sectoral Working Group Activities These activities have been coordinated through two working group meetings: one held at the last Whole Action Workshop in Bratislava and one held in Edinburgh in September. Emergent cross-case themes and potential hypotheses were identified through a brainstorming process and the results of this are presented in the table below. Origin of Thematic Finding Cross-Sectoral Working Group Thematic Finding EMERGING THEMES Designing megaprojects – the differences depending on the starting points, with some of them renewals of former projects, some running for years and changing and some with purely new start Designing megaprojects – the difference related with the type of investments and Page 2 of 15 management, some fully private, some fully public and those most difficult with a combination of public and private money and/or management of the process Defining the project value and the different incentives to it The relation between the complexity, predictability, goals and objectives in a megaproject The accessibility of data on the a megaproject Regulations and limitations when a megaproject is financed under a EU funds (programmes like Jessica and the ERDF projects) Contractual agreements in the megaprojects and their specifics in the time and decision making Clear definition of a business model, influencing the final outcomes (products) of it Risk management challenges with megaprojects Identifying the performance “gap” between the majour projects and the mega projects – possible implications on the EU terminology Evaluation tools application to mega projects – the specifics of the Cost Benefit Analysis The models of technology parks design and development – comparative analysis between Scandinavian and South-East European practices POTENTIAL HYPOTHESES(not proven) ‘Heavy’ Front End: Sound planning leads to successful megaproject performance A clear definition of the business model of the megaproject leads to successful megaproject performance Early involvement of the supplier network leads to successful project performance A correct balance between strong leadership and participative leadership leads to successful megaproject performance. Dealing with Uncertainty: Project management can not avoid uncertainty Complex Multi-Programs: Business models of products have impact on project performance Institutional Impact: Hypothesis Good balancing of strong leadership and stakeholder participation has a high impact on project success Table 1: The Cross-Sectoral Working Group’s Thematic Findings The Transport Working Group’s Activities These activities have been coordinated through two working group meetings: one held at the last Whole Action Workshop in Bratislava and one held in Brussels in November. The Transport Working Group has used the work of the Energy Working Group as a ‘seed’ to brainstorm further hypotheses that relate megaproject performance to its characteristics. The working group aims to adopt a ‘fuzzy logic’ approach to ratifying these hypotheses and is, to this end, devising a range of granulations and scaled linguistic variables to describe each of these granulations. These are provided in Annex A of this monograph. As of yet, these hypotheses have not been empirically tested. The Energy Working Group’s Activities The Energy Working Group began the initial construction of a set of cross-case themes in its Working Group meetings in the first Year of MEGAPROJECT’s operation. This work has Page 3 of 15 been further developed and coordinated through two working group meetings: one held at the last Whole Action Workshop in Bratislava and one held in Milano in July 2012. Three processes were investigated to generate cross-case themes: An inductive process inspired by Eisenhardt’s work(Eisenhardt 1989) A deductive approach based on operationalising hypotheses (generated by a brainstorming process) and verifying these through the case portfolio A semantic based rule elicitation and validation process The processes used for the first two of these approaches are illustrated in the figures below : Figure 1: ‘Operationalising Brainstormed Hypotheses’ Approach Figure 2 Inductive Approach to Hypothesis Generation Page 4 of 15 The relative advantages of deductive and inductive approaches are discussed in the MEGAPROJECT Monograph entitled “Inductive and Deductive Theory Generation from Case Studies: The Experience of the MEGAPROJECT COST Action” produced in August 2012. The inductive approach did produce additional propositions to those generated through the deductive approach. These propositions were then operationalised into a series of formal hypotheses which were tested using the Fisher Exact test to examine if they were (or were not) supported by the MEGAPROJECT Energy Portofolio. This process was then replicated for the whole of the MEGAPROJECT portfolio and is described in this context in more detail elsewhere in this monograph. A semantic based rule elicitation and validation process was carried out using the following phases : Semantic clustering of individual brainstormed propositions to derive from these a set of clusters, with attached concise statements (typically of a maximum of twenty words) reflecting most of the ideas in each cluster. This was done manually for the purposes of MEGAPROJECT but would normally be performed by automated linguistic analysis tools. These semantic aggregated clusters become hypothesis, Hypothesis validation where each case was assessed by each author checking whether each case satisfied either in binary terms (i.e. Yes/No) or insome form of percentage evaluation/in. (In this phase It wasmandatory that all completed cases were included.) Then an average (with spread) hypothesis validity (from the case sample base ) was computed for each hypothesis across the case sample. (In this phase hypotheses with over 50 % validation are frozen and become rules; those with less than typically 50 % validation are normally discarded, or the hypothesis is refined, and the process starts over again untill convergence on a stable small set of revised hypotheses with all >50 % validity.) Group rule validation was performed at the end, to avoid that the accepted rules are not just "motherhood statements" . (This is normally achieved by sending back the set of rules to all case authors asking them if that *set of rules* has jointly covered eg. at least 75 % of the general and specific issues in each case.) This approach produced two semantic based ‘rules’ for MEGAPROJECTS which are contained in Table 2 below. (Successive refinements and increments could have been continued.) Table 2 also contains summaries of the propositions generated by the other Energy Working Group activities. Activity Initial Milano Meeting Thematic Finding The more unemployment in the megaproject’s local environments, the less resistance to it from local residents. (H, M) The more local residents perceive property values to increase/decrease, the less/more resistance to the megaproject. ( D, H) The more spending by the megaproject on the local community, the less the resistance to the megaproject ( A, H, M) The more trust the general population has in regulators, the less opposition to megaprojects ( F, H) The successful completion of a megaproject requires a specific articulation of national government support ( M, H, G) The more ‘mega’ the megaproject, the more difficult to identify the stakeholders and the more likely for the stakeholders and their needs to change during the lifecycle of the megaproject (M,H,A,M,G,F) The more innovative the megaproject, the more likely to fail to meet iron triangle success criteria (supporting proposition G, F not supporting proposition A) Page 5 of 15 SIMILARITIES IN MEGAPROJECTS Formation of project based organisations (H,G, A, M?) There is frequently a joint venture organisation ( often an equity joint venture) formed between organisations to be the client/owner for the megaproject. The degree to which this is a ‘real’ organisation ( staffed with people and with project management responsibility) or a ‘ghost’ organisation ( not staffed with the project activities still being undertaken by the owners varies. Financing of Megaprojects ( H,G,A, M) Most megaprojects are financed by consortia of organisations and not by a single organisation. Similar Patterns of Actors (H,G,A,F,M,D) Energy Megaprojects in Europe have a similar pattern of stakeholder actors and those actors are often act in the same capacity across a number of cases: Owners (either directly or of temporary project organisation): TransEuropean Energy Companies with a substantive state ownership, e.g. E-ON, RWE, EDF, ENEL Prime contractors: Turbo-machinery ( Siemens, Rolls-Royce, Alstom); Nuclear Steam Systems (Arreva); EPC ( Aker, Fluor, AMEC, Saipem Optimism Bias (G, H, F, A?) Energy Megaprojects do demonstrate optimism bias in the forecasts of leadtime and costs for completion but the reason for this is not clear. (It does not seem to be for reasons of misrepresentation to create a business case c.f. Flyvbjerg) Lack of Scope Changes (G,H, A,F,D?) Energy megaprojects don’t seem subject to scope creep (e.g. target for MWe seems to remain the same throughout the project) Semantic Based Rule Elicitation Similarities in Scale (G,H,A,F) Energy megaprojects in Europe seem to be of a similar scale. They take about 10 years from the first project idea to full operation. They involve a peak of 3000-5000 in construction. The y cosy €2bn-€7bn Good management and good outcomes on projects are correlated. Links and incentives must be created for success for the different categories of Users and Builders Table 2: The Energy Working Group’s Thematic Findings The MEGAPROJECT Training School and Think-Tank The first MEGAPROJECT Training School and ‘Think-Tank’ was held in Leeds on November 30th – December 2nd 2012. This event had dual aims: To develop the skills in cross-case analysis of Early-Stage Researchers(ESRs) involved in the project To use these skills to review the whole of the MEGAPROJECT portfolio to identify emergent themes. To this end, the ESR’s were divided into four groups and each tasked with giving their view on emergent themes in the MEGAPROJECT portfolio. Each team produced an individual report summarizing their perspective on emergent themes and the process that they used to Page 6 of 15 establish these. Individual reports are available from the Project Executive, Sarah King, at info@mega-project.eu. The emergent findings of each group are summarized in the table below along with additional comments. It is to be noted that all groups found the construct of ‘project success’ as difficult to operationalise in a unitary fashion. Group Group A Thematic Finding the presence of only one major stakeholder is related to a delay in construction and project and costs the megaproject having national public acceptability (no protest at the national) is associated with the project being on budget the mega-project fitting into the long-term plan of the country’s government is associated with no delay in construction and the project no going over budget. Comments Difficulty of success/failure as a construct Need for a ‘mediating factor’ to explain the results (see diagram below But evidence is not conclusive Group B Group C Group D Increasing prices of equipment/technology impact upon cost Environmentalist groups delay projects and have impact on cost Additional requirements of authorities increase costs Good stakeholder management has a positive impact on performance Congruency between needs (e.g. needs of community) and project goals improves performance Congruency between political goals (e.g. change in environmental law) and project goals improves performance The typology of contract doesn’t affect the project acceptance. Stakeholder network complexity always occurs (megaprojects are complex by definition), but seems to have no so much impact on project acceptance. Project output performance (understood as Time, Cost , Quality) seems to be always weak but have no so significant impact on project acceptance Environment conditions (understood as legal, political as economic) have not much impact on project acceptance. Project ‘success’ is a problematic construct therefore derived a new performance characteristic , ‘project acceptance’ Tentative links surrounding local stakeholder involvement Table 3 The Training School’s Thematic Findings Short Term Scientific Mission(STSM) hosted by Professor Mauro Mancini at the Politecnico di Milano. The Short-Term Scientific Mission (STSM) was undertaken by Robert Hickey of the International Business School in Bulgaria in June 2012 Its aim was to develop the work of the Energy Working Group in a cross-case analysis for the MEGAPROJECT portfolio and to understand the implications for using it more widely in the MEGAPROJECT Action. This included: Page 7 of 15 Laying the groundwork for testing the hypotheses and questions posed during the Energy Working Group brainstorming session, by identifying related project characteristic information that is needed to test the validity of the hypotheses for the megaprojects in the energy and cross-sectoral case studies. It also included adding hypothesis, questions and potential lines of analysis for determining success factors for megaprojects. Reflecting on the implications of the energy theme methodology to the cross-sectoral case studies. Identifying methodologies that would help identify cross-case themes in the Megaprojects case studies through the development of a bibliography. The findings of the STSM are contained in a separate report produced by Robert Hickey and are summarised in Table 4. A table was designed to capture if a relationship between a postulated construct and megaproject performance could be viewed as positive or negative, weak or strong, or unconfirmed. The process was based on approaches to capturing MEGAPROJECT performance derived by Merrow (2011). Constructing the table highlighted the need to return to the original cases and to supplement them. Thematic Finding Off-site construction is associated with cost overruns Highly innovative projects are associated with cost over-runs Less spending on the local community is associated with slips in schedule The passage of unforeseen regulations is associated with schedule slippage Changes in ownership structure are associated with schedule slippage Decreases in local property values as a result of a megaproject are associated with schedule slippage. Table 4: Thematic Findings of the STSM The non-parametric statistical analysis of the whole MEGAPROJECT portfolio As a development of the work of the Energy Working Group, Giorgio Locatelli assisted by Naomi Brookes and Sarah King, undertook an analysis to ascertain statistically significant relationships between megaproject characteristics and megaproject performance. An overview of this activity is contained in a power-point presentation and is obtainable from the Project Executive, Sarah King, at info@mega-project.eu. The operationalised MEGAPROJECT characteristics derived by the Energy Working Group were used to code the remainder of cases from the MEGAPROJECT portfolio. These characteristics were operationalised in a binary fashion (i.e. either present or not present). These characteristics are shown in Table 5. Brainstormed Megaproject Characteristics Project has a foreign EPC company Siemens is involved as a contractor in the project There is a presence of one major stakeholder The EPC has a clear goal The project is mono Cultural Page 8 of 15 More than 50% share of the client is under government control An experienced project director is present Green Peace or other international environmental activists have been involved in the project The project has national public acceptability (no protest at national level) The project has local public acceptability (no protest at local levels) Environmental activists and regulators have been engaged ex-ante, not ex post Local communities had a conservative attitude to development Investment on external communication was above 0,01% of the total budget The project has a strong regulation system as evidenced by: a) The authority stopped the project or similar projects in the same country b) The authority give fine to the EPC (main contractor) or one of the internal stakeholders in the project c) The project start has been delayed by the authority The project fit in the long term plan of the country's government There is planned a long term stability in usage and value The project enjoys political support as evidence by: a) Support of the central government b) Support of the local government The megaproject is decomposed in many sub-projects which can use the learnings from other project Heavy usage of planning by milestones Heavy usage of Formal project management tool and technique Usage of performance metrics Client and Owner are different Turn key contract between Client and EPC (main contractor) There is a formal litigation procedure (e.g. international chamber of commerce) between Client and EPC Project has a high quality feasibility study Project has a well developed FEED Modular project - consider only the related sentences below a) The project is modular - dependent modules b) The project is modular - independent modules High level of technical innovation FOAK (First Of A Kind) or unique Project (like Venezia mose) Tough environmental condition (dangerous local situation) Tough physical or environmental conditions Financial Support from the European Union Financial Support from the national government National Public Acceptability Local Public Acceptability Local residents were involved in the project Previous national similar project was successful Unemployment in the area above national average The population trusts the regulatory authority. The Compensation of local community above 0,1% of the total budget The density of population of the province is below the national average The project is nuclear Table 5: Brainstormed Characteristics that Affect Megaproject Performance Page 9 of 15 An attempt was then made to relate the presence (or absence) of these characteristics (independent variables) with the performance of the megaproject (dependant variables). Initially megaproject performance was viewed as either being a ‘success’ or a ‘failure’ but this was found to be an opaque and too simplistic characterization. Instead performance was characterized in terms of cost compared to the original budget, delays in the planning stage and delays in the construction phase. Again these were considered as ‘binary’ characteristics that were either present or not present in the case. Through this mechanism, 2x2 contingency tables for each characteristic and each performance element were created. The resulting dataset was therefore amenable for analysis using the Fisher Exact Test. (More information on this can be obtained from the texts in the bibliography at the end of this monograph) This test was used to ascertain if any relationship existed between any of the characteristics of a megaproject case and the performance of that megaproject. This test was implemented using the HYPGEOMDIST function in Excel which is used to compute probabilities under a hypergeometric distribution. The completed Excel spreadsheet used to undertake this analysis is available from the Project Executive at info@mega-project.eu. Given the nature of the relationship being sought, a very much higher p-value (0.25) was used to judge if a relationship between independent and dependant variables was statistically significant. This was justified on the basis that practitioners and researchers alike would be interested in strong indications of the presence of relationships rather than requiring ‘certainty.’ On this basis, megaproject characteristics that have been demonstrated to have a statistically significant relationship with mega-project performance are given in the table below: Impact on Project Performance Megaproject Characteristics WILL CAUSE DELAYS IN THE PLANNING PHASE - WILL CAUSE DELAYS IN THE CONSTRUCTION PHASE - WILL ENABLE THE CONSTRUCTION PHASE TO BE ON TIME WILL CAUSE PROJECT TO BE OVERBUDGET WILL ENABLE THE PROJECT TO BE ON BUDGET - Large-scale use of formal PM techniques Project has a well-developed FEED Density of the population in below national average Project has a foreign EPC company Involvement of Environmental Activists The project is a Nuclear New Build Project has a well-developed FEED Large-scale use of formal PM techniques Support of central government Presence of one major stakeholder The project is mono-cultural Financial support from the EU Financial support from central government Table 6: Statistically Significant Relationships between Megaproject Characteristics and Megaproject Performance It is to be noted that a substantial majority of brainstormed characteristics displayed no statistically significant relationship at all. Furthermore, these findings should be treated with caution. Performance was not measured absolutely but in terms of achievement to forecast. In other words, a project that marginally fails to meet a tight timescale would be considered to have performed more badly than a project that meets a very lax timescale. Page 10 of 15 Identifying Emergent Cross-Sectoral Themes This monograph has shown twelve approaches to developing cross-case themes. Five of these have been concerned with looking at cross-case themes within a particular sector of the portfolio and seven approaches have been concerned with identifying cross-sectoral themes. (This calculation has identified four distinct approaches adopted by the groups at the Training School). In order to use these findings to make a tentative and initial identification of cross-sectoral themes, a process of triangulation has been used. Triangulation, in social science research methodological terms, allows for verification of postulated relationships through several different approaches performed by different researchers at different points in time arriving at the same conclusions (Gill and Johnson 2010) The findings of each of the distinct workstreams have therefore been compared and used to identify common thematic grouping of issues that have been considered to have an effect on megaproject performance. (The hypothesised fuzzy relationships of the transport Group were not used as these had not yet been tested empirically). These are summarised in Table 7 below: Fisher Exact Test Analysis Group D Group C Group B X X X X X X Financial and contractual structure Business models Joint venture structures Social networks Internal stakeholder structures Regulatory include: and Political Environment Support of Central Government Support of EU Unexpected Regulatory Changes Use of FEED and other planning initiatives Early supply network involvement Use of formal PM Techniques to X Project Management Approaches to include: Technological include: X X X X X X Local community characteristics (wealth, degree of unemployment, property values etc.) Expenditure on external stakeholder management Difficulty of stakeholder identification Incentives for stakeholder users Governance and Structure to include: X Group A X Training School/Thi nk Tank SSTM Semantic Analysis External stakeholder management to include: Energy WG Initial Investigation Cross-Sectoral WG Megaproject Characteristic Grouping novelty and complexity X X X X to X X X X X Technological complexity and its interactions with project objectives Table 7: Emergent Thematic Groupings that Influence Megaproject Performance Page 11 of 15 It is interesting to note that the same issue is perceived as having different results by different workstreams. For example, the Fischer Exact test indicates that the use of formal project management tools is inimical to megaproject performance whereas the CrossSectoral group’s work indicates that they postulate that formal project management tools improve the success of megaprojects. References Eisenhardt, K. M. (1989). "Building theories from case study research." Academy of Management review: 532-550. Merrow E. (2011) "Industrial Megaprojects: Concepts, Strategies, and Practices for Success" Wiley, NY Gill J. and Johnson P. (2010) "Research Methods for Managers" Sage Bibilography Chris Leach: "Introduction to Statistics: A Nonparametric Approach for the Social Sciences" ISBN-13: 978-0471997436 Jenny V Freeman and Michael J Campbell "The analysis of Categorical data:Fisher’s exact test" http://www.sheffield.ac.uk/polopoly_fs/1.43998!/file/tutorial-9-fishers.pdf Annex A: Transport Working Group's Fuzzy Propositions Themes External Stakeholders Themes statements Qualitative scale Involvement of environmental groups/activists None - no involvement at all (1) - total - involved in project stage(5) Was the involvement generally supporting the project or against it? no(0)-yes(1) The project has national public acceptability (no protest at national level) none (1) - total support (5) The project has regional public acceptability (in the region or regions where the project is located) none (1) - total support (5) Exposure in the media Easiness of access to relevant information for stakeholders Perceived impact at the local communities Is there a professional public relation initiatives in the project Was there any public mood change during the project implementation phase (from planning, design to construction) Page 12 of 15 mainly negative (1) - mainly positive (5) none (1) - complete availability of documents and studies (5) Totally negative (1) - totally positive (5) none (1) - extremely comprehensive public relations initiaves (5) from positive to negative (1) from negative to positive(5) Internal stakeholders After the project started operation the public mood about it changed? from positive to negative (1) from negative to positive(5) The Project has a foreign EPC consortium totally local (1) - totally foreign image and perception (5) There is a presence of one major stakeholder (contractor) no(0)-yes(1) Is there a clear scope throughout the project to all concerned No clear scope and changeable (1) - completely clear and stable scope(5) The project is mono Cultural (business culture) no(0)-yes(1) Is there an identifiable project culture More than 50% share of the client is under goverment control An experienced project director is present no(0)-yes(1) Is there a cooperative relation between the client and contractor(s) Is there any political support/agreement about the project level of priority Where there changes in scope due to political action? Political pressure related with milestones deadlines Political Project Environment Legal Project environment no(0)-yes(1) no(0)-yes(1) No(1)- All main parties are completely supportive (5) no(0)-yes(1) no(0)-yes(1) Positive political support depending on degree of external funding no(0)-yes(1) The project is on the TEN-T no(0)-yes(1) Evidences of polititians being too sensitive to pressure groups no(1)- clear evidences of changed decisions due to pressure (5) Are there evidences that "democratic" process is resulting in project delays (appeals)? no(0)-yes(1) Stable legal environment (withouth any major changes in the legislation during the process time) no(0)-yes(1) Changes in legislation relative to tendering processes Changes in legislation relative to environmental law There was a stable economic environment during the project implementation phase Changes in the economic impact during the operational phase Changes in energy prices Economic Project Environment no(0)-yes(1) New operators/modes (competetitors) entering in the market during the implementation phase New operators/modes (competetitors) entering in the market during the operation phase Operators/modes (competitors) leaving the market (or extremely reduce their operation) during the operation phase Page 13 of 15 n0(1) - extreme changes which completely overturned the previous process(5) n0(1) - extreme changes which completely overturned the previous process(5) absolute stability(1)-extreme changes(5) absolute stability(1)-extreme changes(5) absolute stability(1)-extreme changes(5) no(0)-yes(1) no(0)-yes(1) no(0)-yes(1) Financial Support from the European Union Financial Support from the national governament no(0)-yes(1) no(0)-yes(1) Valid CBA considered or not no(0)-yes(1) LCC was considered or not Is there any evidence of a general "optimistic bias" in the project The procurement processes are transparent? Risk analysis related with schedules and costs Risk analysis related with project results (demand forecasts) Existence of sensitivity analysis Apointment of a dedicated project manager in the team Project Management Level of competenced of the project management team Are cost deviations analyzed and documented The megaproject is decomposed in many subprojects There was an effective learning process from other projects and(or) tasks in the same project Project Impacts no(0)-yes(1) no(0)-yes(1) no(0)-yes(1) low, only technical background(1) -high, internationally proven compentence in PM(5) no(0)-yes(1) no(0)-yes(1) no/feeble(1)- important lessons learned and applied(5) Heavy usage of planning by milestones no(0)-yes(1) Heavy usage of Formal project management tool and technique no(0)-yes(1) Usage of performance metrics no(0)-yes(1) Client and Owner are different Turn key contract between Client and EPC (main contractor) There is a formal litigation procedure (e.g. international chamber of commerce) between Client and EPC no(0)-yes(1) High level of technical innovation Technology no(1) - consider all LCCosts in all the project aspects/domains(5) no(1) - there is strong evidence of optimistic bias in all the forecasts made for the project(5) no(0)-yes(1) no(0)-yes(1) Using untried technology or materials (not previously used) Appearence of relevant new technologyes during the project implementation (planning, design, and construction) no(0)-yes(1) no(0)-yes(1) no (0), incremental Innovation(1), disruptive innovation (5)- see OECD definitions no(0)-yes(1) no(0)-yes(1) Appearence of relevant (for competitors) new technologyes during the project implementation (planning, design, and construction) no(0)-yes(1) Tendering process favouring innovation no(0)-yes(1) Where there relevant unforeseen impacts? no(0)-yes(1) Page 14 of 15 Regional/national strategy (coherence) Not Classified Whas initially a coherence with a regional/national strategy as shown by official documents? no(1) - absolute coherence between objectives(5) Did changes in scope during the project implementation put in jeopardy this scoherence? no(1)- resulted totally incoherent(5) Did changes in the national/regional strategy put in jeopardy this coherence? no(1)- resulted totally incoherent(5) Tough physical or environmental conditions no(0)-yes(1) Page 15 of 15