Ex post evaluation 2007-2014 of ERDF and CF: State of play DG Regional and Urban Policy Brussels, 15 January 2015 1 Regional Cohesion Policy Policy Overview of work packages No. Work package 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Responsible in REGIO evaluation unit Data collection and quality assessment Daniele Vidoni Synthesis Kai Stryczynski Support to SMEs – Increasing Research and Innovation in SMEs Marielle Riché and SME development Financial instruments for enterprise support Daniel Mouqué Support to Large Enterprises Daniel Mouqué Transport Jan-Marek Ziolkowski Environment Anette Holtmann Modelling the effects of transport projects Postponed Energy efficiency Patty Simou Culture and Tourism Samuele Dossi Urban development and Social Infrastructures Samuele Dossi European Territorial Cooperation David Alba Delivery system (covers also the ESF) Ivanka Lakova Geography of expenditure Alida Staicu Effect on GDP etc Modelling: QUEST, Rhomolo, Daniel Mouqué Regional Discontinuity Design, Daniele Vidoni Propensity Score Matching Kai Stryczynski Communication 2015 Regional Policy WP 1: Synthesis • Two interim deliverables: • - Macroeconomic situation • - Regional developments • Ultimate use for synthesis report in 2016 3 Regional Policy WP 2: Support to SME: research & Innovation and SME development • Started July 2014, inception report accepted by Steering group last September • Consultant: CSIL (IT), CSES (UK), ZEW (DE) • First intermediate report to be examined on 23 January: - Establish the main instruments funded in 50 programmes: context, funding, logic of intervention, beneficiary SMEs, effectiveness Pilot case study: Puglia + proposal for 7 other case studies Proposal for 7 policy instruments (in view of 3 theorie-based evaluations) In parallel: literature review (rationale for public support, evidence) 4 Regional Policy WP 2: Support to SME: research & Innovation and SME development Next steps: • April: seminar on case studies' findings (MA, SMEs & external experts) • May: 8 case studies • October: 3 theory-based impact evaluations on 3 policy instruments • January 2016: final report Contact: Marielle Riché 5 Regional Policy WP 3: Financial instruments • Equity, loan and guarantee instruments – support to enterprise only • First draft stocktaking report being finalised. Covers 12 MSs which account for 92% of support (BE, CZ, DK, DE, ES, FR, HU, IT, LT, PL, PO, UK) • Will select 9 representative case study OPs to examine initial performance, using theory of change evaluation. • Seminar in July, final report in November. 6 Regional Policy WP 4: Support to large enterprises • Large enterprises as defined in EU law • First draft stocktaking report being finalised. Covers 8 MSs which account for 75% of support (PO, DE, PT, ES, HU, IT, CZ, AT) • Will select 8 representative case study OPs to examine initial performance, using theory of change evaluation • Seminar in July, final report in November. 7 Regional Policy WP 5: Transport Consultant – AECOM + KPMG Italy • Kick-off in December 2014 • 1st Interim report – April 2015 (cohesion policy contribution + review of financial analysis) • 2nd Interim report – August 2015 (10 major project case studies + 6 MS case studies + draft catalogue of challenges) • Seminar – October 2015 (to discuss and develop findings from the case studies) • Final report – December, 2015 (draft in November 2015) 8 Regional Policy WP 6: Environment Analysis of Cohesion Policy contribution in 2007-2013 for environmental infrastructure projects (drinking water, wastewater and waste). Consultant – COWI • Kick-off in December 2014 and list of 40 major projects provided by the Commission • Inception report: 28 January 2015 (detailed methodology, selection of 20 projects for task 2) • Interim report by mid-March (cohesion policy contribution, review of financial analysis for 20 major projects, verifying the correctness of assumptions for operational projects and proposal for 2 pilot case studies) • All ten case studies by mid-August and catalogue of challenges by midSeptember • Seminar (to discuss and verify findings) in October 2015 • Final Report in December 2015 9 Regional Policy WP 8: Energy Efficiency Consultant – Ramboll / Institute for European Environmental Policy • • • • • • Kick-off : 13 November 2014 Inception report: 09.01.2015 (detailed methodology, proposal for case study pilot) Interim report (Literature review / Review of ERDF/CF measures, finalised pilot case study) by mid April 2015 Remaining case studies to be submitted as they are completed, the latest by mid June 2015 Seminar (to discuss and verify findings) in June 2015 Final Report by the end of August 2015 10 Regional Policy WP 9: Culture and Tourism Consultant – IRS, CSIL BOP Consulting • • • • • • • Kick-off : 21 August 2014 Inception report: December 2014 (detailed methodology, proposal for Survey to Managing Authorities) Interim report (Literature review / Data analysis and sampling / survey of selected programmes) by January 2015 Pilot Case study (Regional Strategy) and 2 min—case studies (project level) by February 2015 Six case studies and 12 mini-case studies, by May 2015 Seminar (to discuss and verify findings) in September 2015 Final Report by the end of October 2015 11 Regional Policy WP 10: Urban Development and Social Infrastructures Consultant – METIS • • • • • Kick-off : November 2014 Inception report: December 2014 (detailed methodology, proposal for Survey to projects Implementation Bodies) Interim report (Distribution of Investments and reported outputs / Analysis of OPs and AIRs) by April 2015 Survey to project Implementation Bodies Final Report by the end of September 2015 12 Regional Policy WP 11: ETC Consultant – ADE • • • • • Kick-off : 8 January 2014 Inception report: 12 February 2015 (detailed methodology, proposal for case study pilot) Interim report (Completion of Task 1 and case study selection) by mid May 2015 2nd Interim report (Completion of Task 2-4) by mid November 2015 Seminar (to discuss and verify findings) in mid December 2015 Final Report mid March 2016 • Contact: David Alba • 13 Regional Policy WP 12: Delivery Systems (1/2) • Delivery System is defined as: programming, project selection, compliance with EU & national law, financial man't & control, monitoring, evaluation, reporting • Main focus : the OP level, how well (i) it translates strategic guidelines into results delivered by the policy and (ii) in terms of: accountability, regularity, results, timeliness, responsiveness, cost • TA's performance for reinforcing administrative capacity is assessed • Data and evidence collection through: structured interviews, websurvey, case studies. 14 Regional Policy WP 12: Delivery Systems (2/2) Consultant – KPMG (DE) / Prognos • • • • • • • • A 16-months contract Kick-off on 18 November 2014 Inception report submitted 18 December 2014 (in progress) 1st Interim report 4 March 2015 2nd Interim report by June 2015 3rd and 4th Interim reports by mid-September and mid-October 2015, respectively Draft final report by January 2016 Final Report by the end March 2016 • Contact: Ivanka Lakova 15 Regional Policy WP 13: Geography of expenditure Consultant – The Vienna Institute for International Economic Studies & Ismeri Europa • • • • • • • 8 months contract Kick-off on 21 January 2015 Inception report by the end of January 2015 (detailed methodology for each task) 1st Interim report (Database & proposed methodology for estimates) by the end of April 2015 2nd Interim report (Database & maps & user's manual) by the end of June 2015 Draft final report by the end of July 2015 (2nd Interim Report + additional sections on tasks 5&6) Final Report by the end of August 2015 16 Regional Policy WP 14c / 14d: Effect on GDP etc • Two low value contracts with econometric approaches signed • - regression discontinuity design (G Pellegrini) • - Propensity score matching (D Bondonio) • Questions: • - Effect of SF on GDP and other variables on a regional level • - Attempt to capture effect of different aid intensity on regions Regional Policy Gentle reminder: Have you finished new evaluations? • - Finished in 2013 or 2014, • - Please send them to us: regio-eval@ec.europa.eu • - Title and weblink is enough! • Use: • - for ex post evaluation 2007 – 2013 • - library of evaluations on INFOREGIO 18 Regional Policy