Supporting the Needs of Older and Vulnerable Employees (SNOVE) Final Evaluation Content Page 2: Introduction Page Project 3: Description and Purpose of Project Page : Evaluation & Analysis of Original Materials Page 5: Work Package 1 Page 6: Work Package 2 Page 7: Work Package 3 Page 8: Work Package 4 Page 9: Work Package 5 Page 11: Work Package 6 Page 12: Work Package 7 Page 15: Work Package 8 Page 17: Work Package 9 Page 19: Work Package 10 Page Evaluation of Complimentary Materials and Innovations Page 31: Conclusion 1 Introduction The primary purpose of this evaluation is to establish if the project has met its key aims and objectives of making a transnational transfer of educational innovation as required by the Leonardo Da Vinci TOI Programme. This Final Evaluation will cover all key aspects of the SNOVE project including; suitability for transfer of the original materials, research, transfer methodology, effectiveness of transfer, project management, cooperation and coordination between Partners, dissemination, and development of complimentary innovations. Key points are drawn through Evaluation of the original GFTU materials and Project Work Packages with an emphasis on Packages 8, 9 & 10, concerning the transfer, adaptation and accreditation of the innovation to the vocational education and training (VET) system in each country/system with a partner effecting full transfer. New materials and innovations generated as a result of the project will also be examined to establish if they add value to and reinforce project aims. The report concludes with a clarification of key evaluation points and concluding remarks. 2 Project Description and Purpose SNOVE was a transnational Transfer of Innovation project funded by the European Union Directorate of Education and Culture through the Leonardo Da Vinci Programme. The Project had five participating organisations (Core Partners) in five EU countries. The Partners are listed below; Bulgaria: Balkan Institute of Labour and Social Studies (BILSP), Partner 4 Finland: The Workers Academy (TA), Partner 1 France: Toulouse Business School (TBS), Partner 2 Netherlands: United Nations Staff Union – International Criminal Tribunal for the former Yugoslavia (UN – ICTY), Partner 3 United kingdom: General Federation of Trade Unions (GFTU), Lead Partner The Applicant Organisation was the GFTU which had legal responsibility for management of the Project and the successful delivery of Project outcomes. The Project was conceived as a means to effect international transfer of educational materials which can assist older and vulnerable employees dealing with problems in the modern employment market during a period of economic downturn including; precarious/vulnerable employment, redundancy/unemployment and financial instability. The purpose of the materials is to provide a means which will enable members of the target group to develop competencies in job search techniques, assess their vocational skills and academic qualifications, build their confidence, and to plan for financial security in retirement. The aim of the project was to draw upon the experience and expertise of the GFTU which provides an innovative programme of training relevant to the needs of vulnerable employees and adapt for transfer a package of such training which can be delivered on a transnational basis by trade unions, academic institutions and employer’s organisations. Three of the Project Partners, BILSP, TA, TBS, were chosen for their expertise in delivering fully accredited educational programmes for working people and employers. These organisations also have a solid track record of innovative research in the field of employment relations policy and practice relevant to the stated aims of the Project. Partner three, UN-ICTY, is the union for members of staff at the International Criminal Tribunal for the former Yugoslavia. The Project is of particular relevance to this organisation because all of its members are engaged in 3 precarious employment and will face redundancy as the Tribunal is wound down over the next three years. The key outcome is the adaptation and transfer of the GFTU materials to be delivered in a variety of context and within the Vocational Employment Training (VET) system of each country/system in which Project partners are based. Partners should have worked with a range of employers and workers organisations to enable them to embed the materials into their training and education programmes. Project Methodology The SNOVE had a two year time-line from commencement to completion. To ensure effective project management key tasks were broken down into ten Work Packages. Each work package was allocated to core Partners which had primary responsibility for the successful delivery of the Package allocated to them. As lead Partner the GFTU had responsibility to ensure all Work Packages were completed satisfactorily and to assist all Partners in meeting their obligations in regard to their allocated Packages. All Work Packages had allocated time frames for completion with some key packages concerning overall project management, quality assurance and evaluation continuing throughout the lifetime of the Project. It should also be noted that there was considerable overlap of key themes and issues e.g. research and development, evaluation, VET accreditation, and piloting, between the Work Packages. 4 Description and evaluation of original materials Introduction The GFTU Dealing with Life Changes and Introduction to Pensions materials have been successfully delivered to members of affiliated unions within the UK for the nine years prior to the commencement of the SNOVE project. The materials are delivered over a two day period, usually to students attending residential weekend courses, although this is not a requirement and the materials can and have been delivered in a variety of formats and venues including workplace training facilities. The delivery method of both sets of materials accords with the standard pedagogy used in the UK trade union and adult education system. It is student centred with an emphasis on praxis combined with tutor presentations and guidance, and student led group learning. This requires a combination of individual work with collective pooling, and/or group research tasks in small peer groups to discus relevant topics and agree key findings and learning outcomes. These are reported back to the wider learning group in tutor guided plenary sessions during which key learning outcomes are emphasised and any misunderstandings corrected. However due to the technical nature of the pensions materials there is a much greater use of tutor presentation and question and answer sessions (Q&A) than is normal for most courses delivered by the GFTU. Both courses are accredited within the UK VET system through the Open College Network (OCN 4 Learning). Learners can achieve two OCN credits at level 2 or 3 depending on evidence of achievement generated in classroom activities and workbooks which are assessed by the tutor according to the criteria set out by the awarding body. However the key purpose of the materials is to help the target group by imparting vital information to assist them in planning for life changes and understanding their pension arrangements. In this respect accreditation gives added value to the learning experience and is not the primary purpose of the materials. Dealing with Life Changes Unlike most GFTU educational materials these materials are for all members of affiliated unions and not just reps and activists; particularly those facing redundancy or in precarious patterns of employment. Course aims and specific learning outcomes are clearly stated in the workbook. These are summarised below. 5 On completion of the course learners should; Gain a thorough understanding of where to find employment opportunities and related information Understand how finishing employment is a life changing experience impacting upon health, self esteem, etc Understand the importance of effective planning Review current skills and personal profile for transferable skills analysis Develop ideas and solutions to assist in re-entering the employment market Prepare a personal action plan Be better equipped to pass on information and skills on how to find employment to other union members Prepare a detailed personal and skills profile to match against existing employment opportunities Plan and prepare for an interview Identify best practice in the employment application process The course itself is divided into ten specific activities including an introductory activity. This activity includes a reflective element in which participants are asked to consider why they have chosen this course. The other activities cover the following topics; Identifying employment opportunities Understanding the advantages and disadvantages of key job search techniques Considering appropriate future employment opportunities (what kind of job do I want) Understanding job advertisements Understanding job specifications Using positive language and profile writing Application forms; best practice CV content; best practice Preparing for interviews Each activity requires the learning group to carry out individual and collective tasks e.g.; complete questionnaires & application forms, analyse information, practice interview questions, etc. Detailed accompanying information is contained within the learning pack to assists the learner in completing the relevant activities. Participants are guided by the tutor to key pieces of information relevant to each topic before commencement of the activity. 6 The Dealing with Life Changes materials are primarily a ‘how to’ guidance on how to improve employability in a precarious employment market by improving job search, application, and interview techniques. Introduction to Pensions This course is also aimed at the general membership of affiliated unions with a focus on the needs of members approaching retirement. Course aims and learning outcomes are clearly stated in the workbook. These are summarised below. To help learners understand how the UK pensions system works To help learners understand their own scheme: the benefits it provides and how the scheme is run To explain what information is available from different sources, and how to interpret it To help learners think about how they can improve their own income in retirement The course is divided into six specific sections covering key topics including an introductory activity. This activity includes a reflective element in which participants are asked to consider their own pension arrangements. The other sections are; Thinking about your retirement – it’s never too soon! What you might get from the State pension Non-state pensions Options for increasing your income in retirement Course evaluation and action planning Each section comprises tutor presentations with Q&A and some individual tasks, with collective pooling and discussion where appropriate. Tasks include, analysing relevant information, calculating qualifying social security payment periods, calculating expected pension incomes against current costs of living, and an action planning activity. The learning pack contains very detailed information about the UK pensions system including; a glossary of terms, types of pensions, value of pensions, 7 qualifications for entitlements, and payment methods. The Pack also has a comprehensive list of additional sources of information with full contact details. Evaluation Comments The GFTU materials are well designed and cover all of the main issues relating to the topics which are relevant to the target groups within the UK context. Differentiation in terms of the varied educational ability of learner groups is factored in by a mixture of delivery methods including; lecture, research, Q&A, and individual and practical activities. Adapted written materials and additional tutor support is provided to participants with sense (sight or hearing) impairment or/and learning disability. The materials themselves are designed to be a practical aid to participants which can, and should, be referred back to after the course to reinforce learning and for reference purposes. Both sets of materials have been designed to be suitable for all levels of employees from unskilled to post-graduate professionals. This reflects the membership of GFTU affiliated unions, which ranges across the UK workforce skills base from unskilled bakery workers, semi-skilled steelworks operatives, pottery craftspeople, broadcast engineers, probation (parole) officers, and educational psychologists. The pedagogic methods used in the delivery of the materials are suitable for both the target groups and academic level for which they were designed. The courses have the correct balance of presentations, Q&A, tutor support, and individual and group work as appropriate to ensure effective transmission of the key information contained in the materials. Both courses have been well received by participants in the UK and feedback through evaluation forms completed by learners and interview has been overwhelmingly positive. Whilst it can reasonably judged that the materials have been a success in the context of the UK VET system, were they suitable for transfer to the national adult and vocational educational systems of SNOVE partners? To achieve this Leonardo Da Vinci guidelines state that the Project should successfully address the following questions in order to affect a successful transfer. Is the innovation current; i.e. not out of date? 8 Is transfer feasible; i.e. can it be adapted to the employment market, legislative framework, training system, language and culture of the host country/system? Is this a genuine transfer of innovation; i.e. have the original materials been fully transferred, with appropriate adaptations, as opposed to the creation of completely new ones? Will this be a benefit; i.e. can it help a wide range of employees and/or are there specific group within the labour market, e.g. immigrants, for whom the materials are specifically suitable? The success, or otherwise, of the Project is therefore dependent upon the possibility of the above questions been properly addressed by the materials without having to completely rewrite them. Even if this is the case, key adaptations have to be made to ensure success. These adaptations include translations (where necessary) and replacing information about the pensions, employment, and benefits systems from the UK context to that in each Partner country, where the framework of such systems can be very different. As a result it is likely that some adaptation to the pedagogic methods will be necessary to factor in these differences between systems and (in some cases) learning groups. Adaptation to Pedagogy/delivery methods could include; rewriting or replacing presentations and replacing or adapting some activities in order to make the materials relevant to the national context. However, producing completely new materials serving the same purpose as the original materials cannot be classed as a transfer of innovation. Sections 8, 9, & 10 of this evaluation concerning the transfer of the innovation to partner countries/systems will consider if this has been successfully achieved based upon the criteria outlined above. 9 Package 1: Management of the Consortium including Financial and Activity Monitoring Arrangements Package Leader: GFTU Description This Work Package was central to the delivery of the project providing financial and primary project management throughout its lifetime. Primary functions included; co-ordination of project activity between consortium members, financial management, liaison with external evaluators and the UK funding agency, and convening steering group meetings and teleconferences. In addition the WP included the organisation of developmental workshops which were held in each partner country carrying out a full transfer of materials. This aspect was facilitated by each relevant Project partner and embedded the transfer process. The other activities/functions in this WP included; Provision of a single co-ordinating point for project activity Production of financial reports Sustaining dissemination and exploitation activity Production of interim and final Evaluation reports Coordination and testing of Work Packages Ensuring effective communications between Project Partners Development of the web component of the Project In addition the GFTU updated the original materials and resources to reflect learning outcomes required by the European Qualifications Framework (EQF) and the criteria for an LDV transfer of innovation. Evaluation Comments This element of the Project has been managed in a generally efficient and effective manner which ensured good coordination between consortium members, effective financial management and activity monitoring arrangements of work packages. However some issues and problems concerning communications and web development were raised by the UK National Funding Agency (UKNA) after their interim inspection of the Project 10 and the GFTU were advised to improve communications and monitoring arrangements. On the basis of this advice and feedback from Partners the GFTU implemented the following measures, External evaluator to attend all future steering group meetings Provision of tele- conferences between steering groups with participation by the external evaluator Monthly progress reports to be submitted on a pro-forma by Project partners Establishment of a central collection point for information in the form of a dropbox account administered by Toulouse Business School Additional support provided to Partner with responsibility for developing website (UN-ICTY) These measures were implemented almost immediately after the interim inspection. From an external evaluation perspective attendance of the external evaluator at all steering groups and the provision of interim tele-conferences were particularly useful measures. This enabled an external perspective at meetings and gave project Partners greater access to the external evaluator. The Tele-conferences were particularly useful as forums to discuss issues, share information and innovations, seek collective advice, and set out agendas for steering group meetings. Ensuring issues of greatest concern to Partners could be prioritised in subsequent steering groups. The use of monthly progress reports did help to give some clarity to Partner activity and had some utility for the Project management team in terms of tracking progress. Some Partners were more diligent in sending reports than others but this issue did not impact upon the effective management of the project in any noticeable way. 11 Work Package 2: Research and Needs Analysis Package Leader: GFTU Description The purpose of this WP to was to conduct analysis of the scope for transfer of the materials in the context of the labour market, adult educational/training and VET systems in each member country. Analysis and research was conducted by each partner under the coordination of the GFTU. Project Partners were assisted in this process by the attendance of key personnel as participant observers at three taught sessions of GFTU material delivery in the UK. In addition a host development workshop was included in the Project Launch event held in November 2011. Evaluation Comments Effective use of research, participant observation, and literature review conducted by key partners established the possibility of product transfer in three Partner countries/systems. However within the first year of the project the French partner established the need to refocus the target group and ran into considerable difficulties in transferring the original materials without considerable rewriting to the point where the ‘adapted’ materials would effectively be an original document. These issues led to a request from the Partner to the Funding Agency for a reorientation of their project activities from making a direct transfer to producing an extensive workplace mapping exercise and literature review. The request was granted (see Evaluation of Work Package 7). In addition the Finnish Partner (TA) encountered similar difficulties as the Project progressed. It was felt that there would be little scope for a transfer of the Pensions materials because of the major differences between the two systems and despite initial optimism that transferring the Dealing with Life Changes materials through adaptation would be straight forward it became apparent this would be problematical. TA carried out extensive research within the Finnish employment system and trailed the materials in sample sessions with a number of social partner organisations. These activities suggested a full transfer could be more difficult than originally envisaged 12 however a way forward was eventually found which would enable a transfer through targeting groups which could benefit (see Evaluation of Work Package 8) The use of a development workshop and participant observation of original materials delivery sessions has been particularly good practice enabling core partners to gain first hand practical knowledge of the original materials and pedagogy, and to gauge learner feedback. Work Package 3: Preparation/Adaptation and Transfer of Educational Activities and Products Package Leader: Workers Academy Description This WP had two distinct phases; phase one (October 2011 - January 2012), analysis of scope of transfer, phase two; (January 2012 – July 2012) testing and piloting of materials by all partners with selected participants. The later informed the adaptation of materials and transfer process. GFTU materials were reviewed to generate research evidence of value to the research process, e.g. learner evaluation feedback. The other activities/functions in this WP were; 1. Setting up of a framework of Accreditation with the support of the UK accrediting agency OCN Credit4Learning 2. Partners sought assistance from national VET agencies to gain VET accreditation of materials 3. Partners funded and managed VET accreditation where applicable 4. Partners funded and managed process of translating materials from English into the language of partners countries where applicable The GFTU assisted partners in completing activities 1, 2, and 3. Evaluation Comments VET accreditation for the adapted materials was secured in Bulgaria and Finland and appropriate translations made. The Bulgarian Partner did encounter initial difficulty in gaining accreditation but this was overcome through an agreement with national VET accreditation agency NAVEAT 13 which enables related training to be classed as life skills modules. Materials for the Dutch partner were delivered on a trial basis in English and French as these are the two languages used in UN agencies. Further and significant adaptations and changes by UN-ICTY are described in the evaluation of Work Package 9. Work Package 4: Piloting and Testing the Products Package Leader: Toulouse Business School Description This WP primarily concerned the piloting and testing of teaching materials for transfer including a seminar session in the UK. In addition evaluation feedback was provided to enable Partners to further adapt and refine the transferred product. Feedback gauged responses around the following; 1. The applicability and relevance of the products to the target group 2. The scope and process for VET accreditation 3. Measures considered appropriate for dissemination and exploitation of the product 4. Further adaptations required Other key activities/functions in this WP included; Organising and hosting seminar sessions in each partner country for key transferred products Assessment of evaluation feedback to create a report on findings Reporting findings at second steering group meeting Provide assistance to support the process of piloting testing materials Evaluation Comments The expertise in academic research of the WP lead Partner was effectively utilised to meet the key objectives of this WP. Through the literature review/analysis and mapping exercise TBS has carried out extensive research into the socio economic and employment issues affecting the target groups in all partner countries. This has informed adaptations of materials and 14 related products, e.g. handbooks and website content and aided wider dissemination. In addition TBS used their extensive knowledge of employment issues in the Francophone world to organise materials testing focus group meetings for Francophone members of the UN-ICTY Staff Union. This Partner reported that the input from TBS had been particularly useful and valuable for their Francophone members. Work Package 5: Quality Assurance and Evaluation Package Leader: GFTU Description This Package provided the structure for quality assurance and evaluation mechanisms to ensure effective project management through the provision of evaluation data and reflective practice. Key facets of this package included steering group meetings, development workshops and periodic comprehensive reports covering Project activities. Evaluation Comments The purpose of this Package was to ensure all Project activities progressed as intended and that research, products and pilots were relevant and of a good standard. An interim evaluation was produced as a key component of the Quality Assurance and Evaluation Work Package strategy. Evaluation activities have been focussed upon key project activities and detailed evaluation reports were produced for the following; project launch event, participant observer session in UK (February 2012), Workers Academy pilot course in Helsinki (May 15 2012). In addition the external evaluator attended and contributed to three steering group meetings (including the first and final) and participated in teleconferences. The first report is focused upon critical feedback from and interviews with representatives of Partner organisations conducted during the launch event. The purpose was to ensure clarity about the purpose and relevance of the Project. This feedback and event activities illustrated the key issues affecting the target groups in each Partner country and gave added clarity to Project methodology. The second report focused on both positive and critical feedback from the participant observers, representing the Finnish and Dutch Partners, in order to assess suitability of the materials for transfer. Generally this feedback was very positive. The Finnish Partner representative assessed the materials suitable for direct transfer with adaptations to the Finnish situation. However in the event this proved to be more problematical (see evaluation of Work Package 8) The representative from UN-ICTY expressed the view that whilst transfer was possible some of the content was not directly relevant to the Partner target group and would need considerable adaptation with the inclusion of additional activities and innovations. The third report describes the pedagogic methodology, style and content of the pilot session. In addition the report assesses suitability of materials, student response and the relevance to Project aims and objectives. The evaluator was satisfied this is the case. All steering group meetings were held as scheduled. Feedback from partners regarding the usefulness and effectiveness of these meeting has generally been positive although some have commented that they have not been long enough to resolve all issues or discuss materials and innovations. This was noted in the UKNA report and GFTU extended subsequent meetings during the second year of the Project to facilitate this. 16 Work Package 6: Dissemination and Exploitation including Promotion and Awareness-Raising Package Leader: Staff Union UN-ICTY Description This package of work continued throughout the lifetime of the Project and involved all consortium members, partner organisations and other interested parties. Key activities include; Organising the Project launch event in association with the GFTU and Organising the Project close event in association with the GFTU and Finnish partner Developing and maintain the project website Producing periodic dissemination reports Producing project publicity material as required Development and maintenance of the website and inclusion of RSS feeds promoted the project, provided publicity for events and improved communications between members. Evaluation Comments Dissemination, promotion and awareness raising activities were conducted throughout the lifetime of the project by all partners although some initial difficulties were experienced particularly the web-site development. This was due to changes in key personnel within the relevant partner organisation and did not have an adverse affect on the final result; the website went live early within the second year of the project. The website itself is widely advertised and promoted through the contact networks of all consortium partners (see full review in Evaluation of Complimentary Materials and Innovations section). Other dissemination and awareness raising activities have included, Diplomatic briefing Circulation of materials via trainers networks Circulation of materials via trade unions and union federation networks Provision of publicity on Partners websites and publications 17 Links to the SNOVE website provided on Partners websites and publications Postings on UN Global intranet iSeek Contacts with UN Headquarters Department of Management Close collaboration with ICTY HR department Meetings with other international organizations Emails and outreach information ICTY Press and Information office / Weekly press updates Information Circular to staff representatives from CCISUA, the UN Federation of staff Unions Presentation of the ICTY SNOVE activities at the Conference on Vulnerable Workers and Precarious Work hosted by Toulouse Business School on 12 September 2013. It should also be noted that both the opening and closing events were used as opportunities to publicise the Project, adapted materials and innovations. Both events were attended by leading academic, trade unionists and diplomatic representatives from all countries with consortium members. Work Package 7: Transfer, adaptation, accreditation and Testing of Products in France Package Leader: Toulouse Business School Description Originally to affect a full transfer the GFTU materials to the French employment and VET system as per Leonardo Da Vinci TOI project guidelines. Post reorientation request; to produce research including literature review and analysis, and a mapping document, The matrix of Vulnerable Groups, to assist dissemination of the project. Evaluation Comments 18 The significant change of focus for this WP described above came at the behest of the Partner. Through extensive research and literature reviews carried out by TBS Employment Research Group, significant factors related to the specific conditions within the French employment system have emerged which indicated a change of focus regarding the target group is required if the Project is to have a significant and positive impact in France. The TBS SNOVE research team took the view that the key issues addressed by the Project, precarious/vulnerable employment, unemployment and financial instability, have a far greater impact upon young employees and is less of an issue for older employees within the French employment system than is the case in other partner countries. The stated reason for this is because France has a very highly regulated labour market system with very strong employment protection for those with permanent contracts of employment. This ensures pension protection and very high thresholds which employers must meet when dismissing such employees for reasons of redundancy, discipline or capability. Most older employees, the key target group, are engaged on the basis of permanent contracts and so do not have to cope with the pressures of precarious and vulnerable employment. Therefore they are less likely to gain benefit from adapted versions of the materials. Although some older employees are not protected by permanent employment contracts the research illustrates that that the majority of such employees are young (under the age of 30) and/or from immigrant communities. The latter group also faces the additional challenge of racism and discrimination within the job market. 19 Work Package 8: Transfer, adaptation, accreditation and Testing of Products in Finland Package Leader: Workers Academy Description Workers Academy worked with two in-country partners, federation of professionals and scientists unions JSL and the Finnish Workers Education Association (TSL), to adapt transfer the UK training Package into the Finnish employment context and VET framework. Other key activities included; Development of a curriculum, training materials and training handbook Ensure accreditation of package within the Finnish NQF and VET framework Embed within the package activities focused upon the psychological aspect of employment vulnerability e.g. poor self-esteem, lack of confidence and assertiveness Undertake formal testing of the training package Contribute to overall Project monitoring and evaluation and dissemination activity Evaluation Comments As disclosed in other sections of this report the lead Partner for this WP has encountered difficulties in achieving a full transfer despite initial optimism that adapted GFTU materials would be suitable for widespread dissemination and impact. Feedback from this Partner suggests a full transfer of the Dealing 20 With Life Changes materials has been made but in ways not initially anticipated and this has been difficult to achieve. In addition although the Pensions materials were initially deemed to be inappropriate for full transfer, impending changes to the Finnish pension system present the opportunity for these materials to be utilised by trade unions in a manner which could represent a partial transfer. Key difficulties encountered included, Major differences between the UK and Finnish pensions systems rendered most of the Pensions materials irrelevant to the current situation in Finland Strength of existing provision within the Finnish VET system ensures topics covered by the Life Changes materials are already covered by existing materials Perception that the materials did not cover specific needs of skilled and highly educated workers e.g. scientists Despite these difficulties fully adapted and translated versions of the Life Changes materials have been produced, tested and disseminated via various organisations TA commenced initial promotion of the materials by showing original copies to a large number of educators within the Finnish employment system representing, trade unions, employee’s organisations, and academic institutions. Initial response was good with immediate requests for translation, and widespread dissemination. Once this had been achieved various groups were requested to trial and develop the materials with input from both teachers and learner groups. Initial responses were not encouraging for the reasons listed above. However the testing of materials and related research did establish there were specific needs and gaps in the employment system which could be met by the materials and related innovations. As a result TA and the two in-country partners, devised a strategy of pursuing two separate development strands. Strand one: the adaption and development of the original Life Change materials in conjunction with TSL for use with immigrant groups and specific groups of unskilled workers. Strand two: the development and refinement of original and existing materials targeted at professional and post-graduate level workers. These materials deal with advanced job search techniques and such as, how to 21 deal with selection centres and searching for opportunities overseas. These packages will utilise an adapted version of UN-ICTY relocation guide. Key outcomes of Work Package Full transfer of adapted Dealing With Life Changes materials achieved Adapted materials targeted at and will be delivered to vulnerable groups which will fill gaps in existing provision within the Finnish system Wide dissemination achieved including possible transfer to actors in Germany and Austria Provision by TSL of on-line version of materials Sections of Dealing with Life Changes materials to be blended into established Finnish courses New training materials developed specifically for post-graduate level workers as a result of TA participation in the SNOVE project Finnish version of UN-ICTY relocation guide produced and disseminated Possible use of Pensions materials as guideline templates for academic teams rewriting materials dealing with forthcoming changes in the Finnish system With regard to product testing and dissemination TA fully utilised their networks and worked directly with twenty separate academic, employees and labour movement organisations from within Finland and abroad on SNOVE related activities. These activities included, taster sessions, seminars, presentations, and full delivery of materials. As a result TA reports that at least twelve organisation within Finland have expressed an interest in using the materials and concepts in their training provision and teacher development In addition interest has been shown by the Sustainable Change University in Germany and it is intended to use the materials in future joint activities between this organisation and TA. The adapted materials have also been disseminated to the Vienna Chamber of Labour. To conclude, the Workers Academy Finland is to be congratulated for their hard work in overcoming the difficulties encountered in effecting the transfer of innovation required and adding real value to overall Project outcomes. 22 Work Package 9: Transfer, adaptation, accreditation and Testing of Products in the Netherlands Package Leader: Staff Union UN-ICTY Description To systematically transfer the UK training Package into the Dutch employment VET context and ensure cooperation with the UN employer in transferring the 23 materials within the context of the tribunal. This included provision of a programme of training initially focused on 250 staff affected by issues arising from the rundown of the tribunal. Other key activities are listed below; Development of a curriculum, training materials, and training handbook Ensure accreditation of package within the Dutch NQF and VET framework Embed within the package activities focused upon financial planning matters e.g. the UN pensions system and its status within the Dutch social security system Undertake formal testing of the training package Contribute to overall Project monitoring and evaluation and dissemination activity Evaluation Comments In terms of achieving a straight forward transfer of innovation this partner encountered the greatest difficulties but has in many ways gained a great deal from their involvement in the project including the creation of new innovations. These include an International Relocation Guide and the adaptation of the pension’s materials into a staff Retirement Guide (see Evaluation of Complimentary Materials and Innovations section). Both publications have benefited UN-ICTY staff and have also been widely disseminated throughout the UN system and via other Project partners. The Relocation Guide is a transnational transfer of innovation in itself having been transferred to Finland via the Finnish Partner TA. These innovations are a direct result of this partner’s involvement in the SNOVE project and have given significant added value to overall project outcomes. As the staff union for the United Nations International Criminal Tribunal for the Former Yugoslavia this Partner represents and serves members who work in a very unique institution and this has significantly shaped the way in which the Partner has delivered its expected project outcomes. The Tribunal was established in 1993 and from its inception was intended to be a temporary organisation of the UN which would cease to operate once all major war crimes suspects from the Balkan conflicts had been captured and tried. It is estimated that full closure of the Tribunal will occur in 2015 when the vast majority of existing staff will face redundancy. The Tribunal currently employs 760 staff, down from a peak of 1.200, and this is being constantly reduced with a major downsizing initiative commencing in December 2013. All staff are employed on fixed term contracts which range 24 from periods of 3 to 24 months. UN-ICTY staff comprises 80 different nationalities and there are 220 different functions/specialism’s within the organisation. Most employees are highly educated, many at post-graduate level, and internationally mobile. However due to the precarious nature of their employment and that most non-EU citizens will have to leave the EU area on termination of their contracts, they fit the description of vulnerable employee and therefore provision of bespoke training around life changes, employability, relocation and pension’s arrangements became a priority for the staff union. At the early stages of the project the Staff Union sent participant observers to delivery sessions of both sets of materials in the UK and set up five focus groups to assess the needs of members. Two of these groups were facilitated by other Project Partners. As described above, Toulouse Business School ran focus groups for francophone staff and the group for BCS (Bosnian/Croatian/Serbian) language staff was hosted by the Balkan Institute for Labour & Social Policy. Feedback from the participant observer sessions and focus groups suggested the original GFTU materials would not meet the specific needs of many UNICTY staff without substantial rewriting and adaptation. The key issues identified included, Life Changes materials perceived as being at an introductory level and therefore unsuitable for many highly educated and already ‘mobile’ employees used to operating within transnational and flexible labour markets Huge differences between UK pensions system and UN pensions scheme Most staff will already have some pension entitlement in the systems of other countries Highly specific and unique needs of many members not addressed by the original materials In addition serious difficulties were encountered in achieving VET accreditation for adapted and additional materials because only courses with a minimum of 800 hours are eligible for accreditation in the Dutch VET system and unfortunately there is no VET accreditation body within the UN system. These difficulties prompted the partner to take a new and innovative approach in which a suite of courses, training sessions, and new materials were developed as constituent parts of a wider Dealing with Life Changes programme marketed to members under the SNOVE title. This programme is 25 a varied, flexible, and comprehensive suite of training designed to meet the needs of members and which included the following courses and events, Identifying transferable skills and achievements Networking and job search techniques Working in the Netherlands Writing cover letters How do I prepare myself for change How to manage the separation stress of others CV training Dutch Business writing (led and accredited by Erasmus University Rotterdam) Starting your own business (presentation by a representative from the Chamber of Commerce) Presentation skills Interview skills Raiser’s Edge (fundraising software used by NGOs) European Personnel Selection Office (EPSO) - preparation to entry exam to European institutions Individual career coaching (mock interview and job hunting in the Netherlands) Academic and vocational qualification transfer (by representatives from the Dutch Foundation for Cooperation on Vocational Education, Training and the Labour Market) Courses and activities provided by the programme range from accredited academic programmes of study (Dutch Business Writing) to, day of half day long courses & training sessions. Elements of the GFTU Dealing with Life Changes materials have been blended into the relevant courses/sessions such as job search techniques, interview skills etc. In addition to the above initiatives lunchtime workshops and support groups have been provided to assist members and it is intended to roll out training based around the Retirement Guide. Despite all of the innovations made by this Partner under a strict interpretation of Leonardo TOI guidelines the outcome could be classed as only a partial transfer of innovation because the original GFTU Life Changes materials have not been adapted as standalone materials and VET accreditation was not achieved. Partial transfer of the innovation has certainly been achieved through the blending of sections of the Dealing with Life Changes materials into new materials and use of significantly adapted sections of the original Pensions materials in the UN-ICTY retirement guide. However the Ldv TOI criteria that the transfer should be a benefit which helps a wide range of employees and a specific group within the labour market, and UN-ICTY staff can be classed as such, has been fully met. In addition the participation of the UN-ICTY Staff Union in the SNOVE project has provided 26 significant added value to overall project outcomes and facilitated the creation of a comprehensive programme of learning opportunities for a vulnerable and unique workforce. Coupled with the publication of the International relocation guide and subsequent transfer of that innovation to Finland the UN-ICTY Staff Union should be congratulated for its valuable contributions to the SNOVE project. For the purpose of this evaluation these contributions coupled with the uniqueness of this Partner, the system it works in, and the situation faced by its members has fully justified the change in direction taken. For these reasons the outcome for this Work Package should be classed as a full transfer of innovation. Work Package 10: Transfer, adaptation, accreditation and Testing of Products in Bulgaria Package Leader: BILSP Description BILSP worked to systematically transfer the UK training Packages into the Bulgarian employment context and VET framework. Working in collaboration 27 with the Bulgarian trade union federation, CITUB, an initial150 trade union representative were trained and supported to act as advocates for the transferred materials and to ensure the needs of older workers are met through collective bargaining. In the pilot phase the materials were delivered to 500 members of CITUB affiliated unions drawn from a wide variety of workplaces. Other key activities included; Development of a curriculum, training materials, and training handbook in partnership with CITUB Achieving accreditation of the package within the Bulgarian VET framework Embedding activities which explain the Bulgarian adult and vocational education system Piloting and formal testing of the training package Contributions to overall Project monitoring, evaluation and dissemination activity Evaluation Comments The Bulgarian Partner in collaboration with CITUB has achieved the most straightforward transfer of innovation within the Project. Both sets of GFTU materials, Dealing with Life Changes and Introduction to Pensions, have been adapted for the Bulgarian situation, accredited within the national VET system and disseminated widely via CITUB. Throughout the lifetime of the Project courses based on the adapted materials have been delivered to a wide cross section of union members by CITUB in 43 municipalities in all 28 regions of Bulgaria. Participants are employed in a variety of industrial sectors with particularly high take up in the healthcare and private enterprise sectors. There is a particularly high level of job insecurity in the later. As in the UK the courses are delivered by professional trade union educators as short courses either at trade union centres or in workplaces. The comparative ease in achieving the transfer of innovation was aided by four key factors, Similarities between the UK and Bulgarian employment situation Similarities between the UK and Bulgarian state and occupational pensions systems Effective collaboration and coordination between BILSP and CITUB Effective piloting and targeting of materials 28 As the leading Labour movement academic research organisation in Bulgaria, BILSP has long standing and extensive links with the national trade union movement which were utilised to great effect. The Partner was aware that there was a strong demand for this kind of training, which was reinforced by learner feedback from the pilot sessions. BILSP and CITUB have worked hard to provide it via the SNOVE project and to date 1100 union members have benefited. The training and utilisation of 150 trade union representatives to act as advocates for the materials and associated training sessions has been particularly good practice which has effectively aided dissemination. The materials have also been disseminated via the regional councils of CITUB and trainers networks and are now an established feature of the national trade union education curriculum in Bulgaria. In terms of cooperating with other Project Partners and contributing to overall Project activities, evaluation, BILSP has been proactive. Activities have included; Contributing to the Matrix of Vulnerable Groups created by Toulouse Business School Using their expertise of the situation in the wider Balkans to Lead the BCS speaking focus group of UN-ICTY staff Contributing to the website To conclude, BILSP and CITUB have worked hard and efficiently to achieve a very successful transfer of the original GFTU materials to the situation in Bulgaria. It should be reiterated that the transferred innovation is now firmly embedded in the Bulgarian trade union education system and this is a major achievement which will benefit many older and vulnerable workers. 29 30 Evaluation of Complimentary Materials and Innovation This section will examine two key innovations which have been produced as part of the SNOVE project. These are the UN-ICTY retirement guide, UN-ICTY international relocation guide. ICTY Staff Retirement Guide This publication is in English comes in an easy to read and attractively designed format based on the Q&A style. It consists of three sections and is ten pages long. The sections are, How to retire from the UN Retiring in the Netherlands After Service issues The first section is very brief and is actually publicity for pre-retirement information provided on-line for its staff coupled with some basic information on how payments from the fund are facilitated. The second section is essentially a how to guide of the UN joint Staff Pension Fund. The first part of this section is for those who will retire in Netherlands and deals with issues related to how the UN pension fits in with the tax and pensions system of that country. The rest of this section is adapted from of sections from the original GFTU pensions materials and includes a pension calculator and additional information about the UN pension fund. The third section provides relevant information about the Dutch health & social security system and covers issues related to benefits available, eligibility, obligation and types of insurance available. The Retirement guide will be disseminated to other UN and international organisations which are part of the UN pension fund based in the Netherlands via the UN confederation of UN staff unions. A shorter version based on the adapted materials can also be disseminated across the whole UN system. UN-ICTY Staff Separation and Relocation Guide This guide has been published in English and French and can be used as a stand-alone source of information for union members and a teaching resource. The topics have direct relevance to the needs of members and include; what to do when leaving or staying in the Netherlands, and relocating to your home country. 31 Published in the same format as the Retirement guide the publication has three main sections, What to do When Leaving Staying in the Netherlands Relocating to Your Home Country The first section is broken into five sub-sections including; leaving the ICTY, Leaving the UN, Leaving The Hague, Leaving the Netherlands, and leaving the EU. The section deals with topics of concern to staff in any of the above categories including; severance procedures, leave to stay in EU & Netherlands, social security, health insurance, tax issues etc. The second section is for former employees with leave to stay in the Netherlands and provides information about; social security, health insurance, work permits, and tax issues etc. The final section is an international relocation guide primarily for employees who will be relocating to their home country after leaving the organisation. The section covers 15 key countries of which significant numbers of UN-ICTY staff are citizens. Key information covering; employment issues, social security, incomes, and taxation are provided for each country. It is this section which has been adapted as a standalone International Relocation Guide by the Finnish Partner. In this transferred version some of the countries have been changed in order to reflect the patterns of migration by Finnish citizens. 32 Concluding Remarks Throughout the lifetime if the SNOVE Project it has been well managed and has achieved its aims and objectives as amended by the reorientation of the French Partner’s participation. A transfer of educational innovation using adapted materials has been achieved in Bulgaria, Finland and the Netherlands, and a high quality literature review and mapping document has been produced by TBS. Problems have been dealt with promptly and effectively with strong evidence of good cooperation between project partners. Added value has been provided with the publication of in-depth research and high quality additional materials by Project Partners, particularly the International Relocation Guide. Many problems were encountered and as demonstrated in other sections of this evaluation considerable work. In two cases it proved very difficult to effect transfers of the original materials and considerable innovation was required by the Partners concerned. This has resulted in very different approaches and methods of transfer appropriate to the situation of each Consortium Partner. The Bulgarian Partner which has achieved the most comprehensive transfer of the original materials in terms of reach and scope. In doing so BILSP, in conjunction with CITUB, has provided a comprehensive programme of training which is very similar to the GFTU educational model and is also delivered to the same demographic via trade union education courses. In contrast the Finnish Partner has achieved a very innovative transfer of the Dealing with Life Changes materials which will be targeted at a specific and vulnerable group (immigrants) via the Finnish Worker Education Association. In addition the Workers Academy will be using the Pensions materialise as a source of information when designing new pedagogic materials dealing with planned changes within the Finnish pensions system. The situation with the UN-ICTY staff union was the most complex and problematical in terms of a straight forward transfer of innovation as described by Ldv guidelines. Under a strict interpretation of these the result could only be described as a partial transfer. However it is the view of this evaluation that extremely unique circumstances of the tribunal and its very vulnerable staff should be taken into account. Particularly considering the immense benefits which involvement in the SNOVE project has provided for staff at the ICTY coupled with the significant contributions by this Partner to the Project overall. 33 The GFTU has managed the Project in a generally efficient and responsive manner. Once identified problems were dealt with promptly as demonstrated by the swift implementation of the recommendations made by the UKNA after their interim inspection report. However there were some negative issues related to the management of the project and the key ones are highlighted below, 1. Initial focus on older employees initially restricted the scope of the project and required a change of focus for the French Partner 2. Steering Group meetings in the first year were too short to address all problems and review innovations 3. Delays in meeting some deadlines 4. Participants of pilot sessions not always clearly identified 5. No initial clear mechanism for centrally collating reports, additional and adapted materials, innovations and feedback 6. Delay in setting up website Point 1 was a particular problem for the French Partners TBS due to the specifics of the French Employment system and was addressed by a successful application to the funding agency to reorient their project activities. Points 2 and 3 were effectively addressed after they were highlighted in the UKNA interim Inspection. Point 2 was resolved by extending steering group meetings and point 3 through additional interventions from the GFTU Project management manager. Point 5 was resolved by the instigation of monthly reports from all Partners and the setting up of a central information collation point managed by TBS via a dropbox account. Point 6 was the result of circumstances beyond the relevant Partners control. The site became live in early 2013 and has proved to be an invaluable resource for all Project Partners and interested parties. For purpose of this evaluation it should be stated that despite the problems encountered during the lifetime of the Project in general the positives have massively outweighed the negative. To illustrate this key positive outcomes of the SNOVE Project are summarised below, Transfer of innovations achieved in Bulgaria, Finland and the UN system in the Netherland Transferred materials are of increasing relevance in the current European labour market situation Additional transfer of innovation (International Relocation Guide) facilitated as a direct result of the project Effective and competent Project management demonstrated throughout project lifetime 34 Project management team responded quickly and effectively to issues and criticisms made in the interim report of the funding agency Good levels of cooperation between project partners were sustained throughout the Project lifetime Project activities generally proceeded as planned without major delays High quality research produced by project Partners, e.g. the Matrix of Vulnerable Groups Partners produced high quality additional educational resources and innovations Effective and innovative dissemination activities were deployed Excellent cooperation with in-country/system partners demonstrated To conclude, this evaluation is satisfied that the SNOVE has succeeded in achieving transfers of educational innovation from the UK to Bulgaria, Finland and the Netherlands and that the French Partner has produced a comprehensive review of related literature and a Matrix of Vulnerable Groups as per the terms of the reorientation request. In addition the Project has initiated a number of useful and relevant innovations which have provided significant added value. Evaluation Ends External Evaluator: James Sorah 35