The ELT INSETT PROJECT British Council Azerbaijan Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 1 British Council ELT INSETT PROJECT Azerbaijan A consultative review of progress and policy Report prepared by: Commissioned by: Submitted: Dr C Tribble Brian Maguire, English Language Projects Manager British Council Azerbaijan 10 February 2006 Executive summary A consultative review of the British Council ELT INSETT project has been concluded following a document review process carried out in January 2006 and three day visit to Baku in the period February 6-8. The overall assessment of progress to date is positive, with a strong team of INSETT trainers now established, an appropriate and highly appreciated INSETT course developed and piloted, and two cohorts of English language teachers (with the potential for delivering local support to colleagues, having completed or in process of completing the course. (see the discussion on under Findings Section 4 on pages 6 - 9). The primary concern of the project team is the extent to which it will be possible to consolidate the positive outcomes of the first part of the project. Such consolidation will, ideally, require cooperation with an existing official ELT INSETT structure which is able to deploy a network of existing trainers able to learn from the INSETT Project Team and to deliver the ELT INSETT programme through local or central institutional frameworks. However, it is far from clear that such a network exists or is operationally effective in the case that it does appear to have official existence. Under these circumstances, the report concludes that it will be necessary to investigate two possible approaches to ensuring that the ELT INSETT project closes with the maximum possible impact and sustainability. The first will involve identifying and assessing the capacity of official ELT INSETT institutions. If it proves impossible to find such a partner, the second approach will depend on the strengthening of the capacity of NGO sector organisations to reach as many practicing teachers as possible. Main recommendations from this report, focus on the completion of the evaluation progress and achievements in Phase 2, and the preparation for a possible Phase 3. These are given below: Recommendation 1 PHASE 2 EVALUATION The ELT INSETT Project Manager should work closely with the ELT INSETT team to finalise and implement an evaluation plan for Phase 2 of the project. Results of this evaluation process should be available at the end of the funding period for Phase 2 and should inform the final design of Phase 3 (including the ELT INSETT training programme design) Recommendation 2 POLICY The British Council and the Project Board should seek immediate clarification from the Ministry of Education on the issue of which organisations have the authority and responsibility to provide ELT INSETT in the regions. Recommendation 3 POLICY The British Council should seek to ensure that any initiatives within Phase 3 harmonise with processes funded through the World Bank Education Reform project Recommendation 4 CAPACITY The British Council, in cooperation with the Ministry of Education and the Azerbaijan English Teachers Association, should take immediate steps to assess the extent to which national and local state structures in Azerbaijan are actually delivering ELT INSETT courses to teachers in the regions, and who is delivering this training. This may involve parallel surveys one carried out by AzINSETT, the other conducted by AzETA. This triangulation of data would be valuable. Recommendation 5 PROJECT DESIGN If it is possible to clarify these issues, a project design for Phase 3 should be established along the lines set out in the main recommendations (Section 7) Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 2 Table of contents PREPARATION ...................................................................................................................................... 4 1. 2. 3. Comment on the Terms of Reference ........................................................................ 4 Approach ................................................................................................................... 4 Main activities during the consultancy ....................................................................... 5 3.1 Document review ................................................................................................... 5 3.2 Stakeholder interviews........................................................................................... 5 3.3 Evaluation workshop.............................................................................................. 5 FINDINGS ............................................................................................................................................... 6 4. 4.1 4.2 4.3 4.4 4.5 The ELT INSETT PROJECT: Phases 1 and 2 ........................................................... 6 Progress to date .................................................................................................... 6 A re-statement of the ELT INSETT Project structure ............................................. 6 Outcomes and outputs........................................................................................... 7 Stakeholder relations ............................................................................................. 8 Comments on the present project structure ........................................................... 9 4.5.1 4.5.2 4.5.3 5. A Phase 3 for the ELT INSETT Project? .................................................................... 9 5.1 Azerbaijan Teachers' Institute AzINSETT (060206a AzINSETT.doc) .................. 9 5.1.1 5.1.2 5.1.3 5.1.4 5.2 5.3 Capacity to support an ELT INSETT mini-baseline .................................................... 12 Interim conclusion ....................................................................................................... 12 Ministry of Education ........................................................................................... 12 5.4.1 5.4.2 5.5 Current provision ......................................................................................................... 10 Capacity to support ELT INSETT................................................................................ 11 Assessment of potential and risks .............................................................................. 11 Interim conclusion ....................................................................................................... 11 Azerbaijan English Teachers' Association ........................................................... 11 5.3.1 5.3.2 5.4 Current provision ........................................................................................................... 9 Capacity to support ELT INSETT................................................................................ 10 Assessment of potential and risks .............................................................................. 10 Interim conclusion ....................................................................................................... 10 University of Languages (UoL) ............................................................................ 10 5.2.1 5.2.2 5.2.3 5.2.4 6. 7. Present status of the ELT INSETT training team .......................................................... 9 ELT INSETT Provision delivered through state structures ........................................... 9 Delivering a cascade. .................................................................................................... 9 Current policy on ELT INSETT ................................................................................... 12 Interim conclusion ....................................................................................................... 13 A possible way forward ........................................................................................ 13 Acknowledgements ................................................................................................. 15 Conclusions and recommendations (draft!) ............................................................. 16 APPENDICES ....................................................................................................................................... 17 1. 2. 3. 4. 5. Azerbaijan ELT INSETT PROJECT - Documents.doc ............................................. 17 _INSETT Project Evaluation NOTES.doc ................................................................ 17 ELT INSETT Evaluation Schedule + outcomes.doc ................................................. 17 List of meeting notes: .............................................................................................. 17 ELT INSETT Evaluation Workshop Notes.doc ......................................................... 17 Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 3 PREPARATION 1. Comment on the Terms of Reference The initial terms of reference for this consultancy focused on two major purposes: the overall evaluation of the ELT INSETT project, and the pressing need to ensure clarity around the nature and feasibility of a proposed Phase 3. Following discussions with Brian Maguire, the EL Projects Manager for Azerbaijan and evaluation commissioner, we agreed that the primary focus of the evaluation would be on the feasibility of a possible Phase 3, and that a formal evaluation of the outcomes of Phase 2 would be best undertaken by the present ELT INSETT project team with the support of the British Council. This would ensure that the evaluation would be stakeholder driven, maximise learning, and provide a professional development for this group. It would also make best use of the time I had in Baku to work with the project managers on a review of policy for ELT INSETT. The finalised terms of reference specified that the desired outcomes of the review process would be: an evaluative comment on progress to date (Phases 1 and 2) based on stakeholder assessments and an earlier documentary review an assessment of the risks implicit in the current approach to Phase 3 a set of recommendations for a way forward for the coming 18 months which will maximise the sustainability of the outcomes achieved to date through the ELT INSETT project. 2. Approach Informed by these terms of reference, the following approach to the consultancy was agreed. 1. The commission would be seen as a consultative review process. 2. This process would have the following major components - a review of project documents in advance of the visit to Azerbaijan - a specification of stakeholders to be included in an interview process - a specification of interview focus and hoped for outcomes for each stakeholder category - an interview schedule - a set of detailed notes for each meeting undertaken in the consultancy (these are appended to this report) - a training workshop for INSETT team members focusing on principles of evaluation in ELT projects - an outline evaluation plan for Phase 2 of the project - a report summarising progress to date and making recommendations for an approach to the elaboration of the proposed Phase 3 In general terms such an approach to the evaluation harmonises with the Realist Evaluation framework developed by Pawson and Tilley1 a framework which has become mainstream in contemporary programme evaluation designs in recent years. In such an approach the main concern in a retrospective evaluation is to answer the question "What has worked, for whom, in what circumstances"? In prospective policy development, the same question becomes: "What might work, for whom, in what circumstances?". This report attempts to address both questions. 1 Pawson, R. and N.Tilley, (1997) Realistic Evaluation, London: Sage Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 4 3. Main activities during the consultancy 3.1 Document review The Project Manager provided an extensive set of background and policy documents (see Appendices). Following the review of these documents a set of questions and issues was identified. These are summarised in Appendix 2 _INSETT Project Evaluation NOTES.doc, and formed the basis for the Stakeholder interviews. 3.2 Stakeholder interviews Outline interview protocols were agreed with the project manager in advance of the consultancy visit. The protocol structure for these interviews can be found in Appendix 3 ELT INSETT Evaluation Schedule + outcomes.doc A series of interviews was held with the following major stakeholders: Monday 6 February 14.30 - 15.30 16:00 – 17:00 Wednesday 8 February 10:00 - 11:00 14:30 - 15.30 16:00 - 17:00 17:00 - 18:00 Aqiya Nakhchivanli rector AzINSETT and Rena Atayeva head of International department, venue AzINSETT Rafiqa Aliyeva Baku INSETT head of ELT department venue BakINSETT Elmar Qasimov, vice minister ME, venue ME Majid Aliyev, head of teacher training and re-training department, venue University of Languages School visit Jale Mammadova, successful participant from Phase 1, venue school # 134 Ragsana Mammadova President of Teachers' Association AzETA), venue AzETA office. Detailed notes for all these meetings are listed in the Appendices (4) and are attached to this report. They constitute a primary evidence basis for whatever conclusions and recommendations arise from this review process. A set of publication quality portrait photographs of all interviewees was also prepared. These are available to the British Council on CD to use in its public communication work The school visit was included in the consultancy as an opportunity for me to have a first hand feel for what is happening in EL classrooms in Azerbaijan, and also to develop a small photographic documentation of classroom practice. This documentation has been completed and a set of web and print ready images has been provided on CD to the British Council, with the understanding that the school will also received a set. Examples from this documentation have been used to illustrate this report. I will not comment in detail on the meeting at BakINSETT. This was mainly of value in confirming the positive outcomes of Phase 1. A note of this meeting can be found in the appended document 060206b BakINSETT.doc 3.3 Evaluation workshop The other main activity for this review process was an Evaluation Workshop for the ELT INSETT team. The overall purpose of this one day workshop was to provide participants with an update on contemporary approaches to evaluation in education projects, and to prepare a plan for the summative evaluation of Phase 2. This plan can be found in the Appendices (Phase 2 Draft Evaluation Plan.doc). Detailed meeting notes for the day can also be found in the Appendices (5 ELT INSETT Evaluation Workshop Notes.doc). Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 5 FINDINGS In the following sections I will summarise progress to date in the ELT INSETT Project and outline issues that have emerged in the course of the review. 4. The ELT INSETT PROJECT: Phases 1 and 2 4.1 Progress to date In partnership with the Ministry of Education, the British Council Azerbaijan has been supporting the development of In-Service Education and Teacher Training (INSETT) since 2003. Phase One of this project completed in January 2005 with the following major outputs: a baseline study on ELT in Azerbaijan the recruitment and training of a team of 8 potential INSETT trainers the development of a locally appropriate ELT INSETT curriculum and training programme for ELT teachers in state secondary schools across Azerbaijan the delivery of this new INSETT programme to 25 EL teachers from the Baku region Phase 2 has been under way since January 2005 and has focused on the consolidation of the capacity of the group of INSETT trainers through the delivery of a second round of training to and the preparation for a possible Phase 3 in which it is envisaged that the INSETT team will be involved in the training of existing or potential English Language INSETT Trainers. Major outputs to date in Phase 2 have included the identification and recruitment of a cohort of 25 teachers from the 11 regions of Azerbaijan, and the successful delivery of a training programme to English language teachers from regions outside Baku. As a result of the project, the INSETT team has gained recognition (both from their peers and, officially, from the Ministry) as a valuable INSETT training resource, and the school teachers who were trained in Phase 1 have started to deliver local professional updating workshops for teachers in Baku and other regions in Azerbaijan. The activities in the project have included international training, in-country training courses, conference participation and other professional development opportunities for the INSETT trainers themselves, as well as for participating teachers. The overall assessment of the project by key stakeholders is positive. The Ministry of Education has given the INSETT team the official status of Trainer of Trainers, the INSETT team members are confident, very well informed on the needs of their trainees, and have the training skills they need to deliver the programme they have developed. Teachers who have gone through Phase 1 training are now able to deliver their own training workshops to colleagues and peers. These are valuable achievements. 4.2 A re-statement of the ELT INSETT Project structure During discussions with the project manager, the project coordinator, and the INSETT team, it was possible to clarify the outcomes and outputs of the ELT INSETT project. These outcomes (what we hope to achieve through the project) and outputs (what we can promise to deliver) were not transparent in earlier project documentation, and this in itself has created the possibility of policy confusion. In the following sections we will consider these recast outcomes and outputs and make suggestions for a way of achieving the desired project outcomes through a third phase. During the workshop with the INSETT team we clarified the project theory of ELT INSETT in the following terms: Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 6 If we improve INSETT provision for English Language Teachers we will: 1. help English language teachers to use new text books more effectively, 2. prepare their own materials, 3. implement these materials in classroom teaching in Secondary Schools in Azerbaijan, and 4. enable these trained teachers to support colleagues who have not shared their training experience We also agreed that such a project theory has to be set within the overall framework of education reform processes in Azerbaijan and the factors which constrain this reform (notably local financial and human resource capacity to deliver adequate ELT INSETT) if it is to produce sustainable outcomes. 4.3 Outcomes and outputs In such a context we identified the following major project outcomes and outputs for the first TWO phases of the project: OUTCOME 1 - EL INSETT Trainers have the capacity to strengthen existing secondary school teachers' ability to provide a better educational experience for school students in Secondary Schools in Azerbaijan - EVIDENCE Observation of training (peer / managerial) Learner self reports Portfolios of work produced and teachers' projects by trainees outputs - A group of 8 trained and confident trainers with a broad range of appropriate skills in EL teacher training / trainer training - An EL Teacher Training Programme (content / methodology) appropriate to the needs of EL teachers in state schools in Azerbaijan - EVIDENCE Its existence Quality review by peer / external specialist observation / reporting OUTCOME 2 Teachers who have been trained by the INSETT Team are able to 1) use new text books more effectively, 2) prepare their own materials, 3) implement these materials in classroom teaching in Secondary Schools in Azerbaijan, and 4) enable these trained teachers to support colleagues who have not shared their training experience - outputs Teachers' Projects (work done by participants) A trained group of 50 teachers (Baku + Regions) An EL Teacher Training Programme (content / methodology) A management system to enable participation Agreement and financial contribution from national authorities Both of these outcomes are professionally desirable and accord with the interests of major project stakeholders in particular the Ministry of Education. They have also, to a very large extent, been achieved. However, as presently configured, such a project design cannot achieve national impact, as the number of teachers who can be trained by the INSETT team is necessarily very small. To overcome this limitation, a Phase 3 in the project is envisaged. During this phase, a national team of INSETT trainers will receive professional development from the INSETT Project Team, and will be prepared to deliver the INSETT programme which has been elaborated through the project. The extent to which such a Phase 3 is feasible will be the focus of the following major sections of this report. Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 7 4.4 Stakeholder relations During the evaluation workshop with the ELT INSETT team we clarified the major stakeholders in the project as being: - PRIMARY (immediate beneficiaries) English language teachers in Baku and the 11 regions of Azerbaijan The BC INSETT team of English language trainers SECONDARY (those funding, authorising, cooperating or implementing the project - MoE (Authorising + Funding) Heads of Regional Education Departments School Directors - British Council Azerbaijan (Funding + Implementing)) - British Council Russia (Implementing) - Consultants (Implementing) - BC Russia INSETT Team (Implementing) - Warwick University (Implementing) - University of Languages (Cooperating) - AzETA (Cooperating) EXTERNAL (none of the above but interested can be friendly or hostile) - American Embassy - AzINSETT - BakINSETT - British Council (Uzbekistan / Ukraine / Georgia) - Methodologists in Regional Departments - OSI - Parents - Qafqas University - University of Languages - World Bank Education Reform Project managers These stakeholders interact in a structure of relationships which is summarised in the organogram below. The organogram makes clear how the project has developed to date and a number of possible contradictions which will have to be reconciled before any Phase 3 can be embarked on safely. ELT INSETT PROJECT Brian Maguire (project manager) Gulshan Huseynova Warwick University and other training and consultancy suppliers MOE Department of Personnel & Management of Extra Curricula Education BakINSETT (Phase 1 partner) Azerbaijan Teachers' Institute (AzINSETT) Phase 2 partner Possible Phase 3 partner 11 Regional Education Authorities EL Teachers in the 11 regions of Azerbaijan INSETT Project Team 25 PHASE 1 TRAINEES 25 PHASE 2 TRAINEES University of Languages (INSETT courses mainly people who are re-training) Possible Phase 3 partner Azerbaijan English Teachers Association AzETA Figure 1: ELT INSETT Project Structure Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 8 4.5 Comments on the present project structure 4.5.1 Present status of the ELT INSETT training team At the moment, although the members of the ELT INSETT have a formal recognition as Trainer Trainers from the Ministry of Education, this does not translate into any institutional, salaried positions as in-service Teacher Trainers or in-service Trainer Trainers. For all practical purposes, the team members remain English language teachers in secondary schools or English language instructors in the University of Languages. The teacher or trainer training they undertake within the ELT INSETT Project occurs outside the official Azerbaijan structures for INSETT. 4.5.2 ELT INSETT Provision delivered through state structures Officially, English language teachers should receive a minimum 4 week INSETT training course once every 5 years. However, during the consultancy, a very confused picture has emerged regarding what training is actually delivered through state INSETT structures, what the quality and kind of this provision actually is, and which institution has the primary responsibility for delivering ELT INSETT. 4.5.3 Delivering a cascade. Within the present structure, the ELT INSET Project Team have no direct formal access to teachers in schools in the 11 regions. Of course, they can reach teachers through their own personal networks, through the good offices of the Azerbaijan Teachers' Institute, and through the Azerbaijan English Teachers' Association. However, such informal contacts are neither a sufficient basis for the delivery of a formal training cascade, nor a platform for ensuring maximum impact and sustainability of project outcomes. In order for a training cascade to work, a number of major pre-conditions will have to be met. First amongst these is that the ELT INSETT team and the programme they have devised are accepted as a useful basis for the strengthening of the national ELT INSETT training system. Whether this can be achieved is an open question at present. Secondly, and of even greater importance, any Phase 3 will depend on the ELT INSETT project having a partner organisation capable of: identifying a cohort of existing or potential Teacher Trainers able to benefit from training ensuring that these Teacher Trainers actually participate in the ELT INSETT training programme ensuring that these Teacher Trainers are provided with the conditions which will make it possible for them to participate in training (release from teaching duties for sufficient time, funding to cover travel to a training centre and cost of living allowances) and providing appropriate financial and infrastructural support to this cascade process. The remaining sections of this report will be devoted to a review of these issues. 5. A Phase 3 for the ELT INSETT Project? In the first four sections of this part of the report I summarise the results of discussions with four key stakeholders. The major purpose of the stakeholder interviews was to clarify the potential for a Phase 3 within the ELT INSETT Project. Interim conclusions are given at the end of each of these subsections. Following this, I outline a possible way forward for a Phase 3 which takes into account the potentials, risks and interim conclusions presented in the preceding discussions. 5.1 Azerbaijan Teachers' Institute AzINSETT (060206a AzINSETT.doc) 5.1.1 Current provision According to Ms Aqiya Nakhchivanli, Rector of AzINSETT, the Institute has overall responsibility for four major areas of teacher training: - pre-service Teacher Education INSETT Training Teacher retraining Teacher education and improvement Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 9 INSETT is delivered through Affiliate Institutes in the 11 regions of Azerbaijan outside Baku, and new INSETT coordinator posts have recently been confirmed in these Affiliates. ELT INSETT should be delivered either through a full time specialist English language methodologist, or through a small group of highly experienced local teachers who are paid to do this work by the Affiliate Institute. The policy is still to provide INSETT once every 5 years, and local authorities and school directors are expected to encourage teachers to achieve this. 5.1.2 Capacity to support ELT INSETT The Rector is keen that any future ELT INSETT cascade should be implemented through AzINSETT. She feels that her organisation has the remit to carry out this task, and would be enthusiastic in her support to such an initiative. 5.1.3 Assessment of potential and risks potential If it is correct that the majority of official ELT INSETT in the 11 Regions is being provided through school base ELT teachers, there is a strong argument for cooperating with AzINSETT in the professional development of this group of multipliers. In terms of cascade development, it would be an ideal solution as there would be no need for the creation of new structures. risks There are several risks to such an approach. Capacity: it may be that there is no effective ELT INSETT being delivered through official structures at regional level. We don't know at the moment. Capacity: the methodologists and teachers who are currently involved in training may not have either the English language skills or the training skills so that they cannot be developed in the short or medium term to a level where they can deliver the ELT INSETT programme Funding: the Rector admits that AzINSETT itself, the Regional Education Authorities, and the Affiliate Institutes are desperately short of funds. This may limit or prohibit the delivery of ELT INSETT through AzINSETT structures. - - 5.1.4 Interim conclusion Before any firm decision is made about moving ahead with AzINSETT as a partner in a Phase 3 cascade, it will be essential to establish a new baseline in relation to its current capacity and activities in ELT INSETT. The British Council Baseline Survey of English Language Teaching in Azerbaijan, 2003-20052 provides a detailed review of the legal framework for INSETT and the ELT curriculum and approach to training at AzINSETT. However, the report gives no detailed information on: the number and qualification of INSETT trainers for English language the number and location of ELT courses run through official INSETT structures during the last five years the number of English teachers who have participated in ELT INSETT. The British Council would need to seek clarity on the status quo, as well as receiving firm financial commitments both from AzINSETT, its Affiliate Institutes, and from the sponsoring departments in the Ministry of Education and at local level before moving ahead with a Phase 3. 5.2 University of Languages (UoL) (meeting note 060208b UoL.doc) 5.2.1 Current provision Current provision exists mainly in theory at this institution. Until recently the University had no INSETT remit (being primarily involved in PRESETT and re-qualification). According to the Dr Majid Aliyev, up until very recently the Head of the Training and Re-qualification department, 50 teachers were trained in UoL in 2004, but a shortage of funds made it impossible to provide any INSETT training to teachers during 2005. 2 Rahimova et al., (2005) A baseline survey of English language teaching in Azerbaijan 2003-2005, Baku: British Council Azerbaijan Page 10 Azerbaijan ELT INSETT Project Review www.ctribble.co.uk 5.2.2 Capacity to support ELT INSETT According to Dr Aliyev, UoL is the only institution now authorised to deliver ELT INSETT in Azerbaijan. This position contradicts that of the Rector of AzINSETT and also the view of the Vice Minister of Education. There will be an urgent need to clarify this position before any final view can be taken on the future of a Phase 3 in the ELT INSETT project. Apart from the question of status, Dr Aliyev is confident that his organisation is best placed to implement a cascade. He would be happy to draw on the ELT INSETT team (at least five of whom work as language instructors in UoL), and would be interested in drawing on the best of the project's curriculum to create a new programme which would draw on the organisation's existing professional resources in methodology and theoretical linguistics to complement the British Council ELT INSETT programme. 5.2.3 Assessment of potential and risks potential Clearly, if UoL does emerge as the only authorised ELT INSETT provider, it will also be the only logical partner for a Phase 3 cascade. It does have the advantage of already being the employer of four team members and appears to be willing to re-deploy them to participate in this kind of training. Dr Aliyev also appears to be willing to adjust the UoL programme to accommodate the kinds of innovations that have been introduced through the INSETT project. risks The primary risk in working with UoL as the sole partner in a Phase 3 is that it seems highly unlikely that a cascade based on the central delivery of INSETT to a scattered teaching force is workable. If there it is already the case that there are insufficient funds to support locally delivered INSETT, it is unclear how local authorities would fund the travel and subsistence expenses inherent in the delivery of a programme which is only offered in Baku. A second risk may be more easily surmounted this relates to the status of the current ELT INSETT team members to deliver a university based INSETT programme in what would, effectively, be competition with established and more traditional methodology specialists. If there is full institutional support for the INSETT team and the ELT INSETT programme, along with adequate funding to provide them with teacher training positions in the university, there is no reason why they should not be more than capable of delivering their course through this institution. 5.2.4 Interim conclusion Several questions arise: Q 1. Q 2. Q 3. What is the status of UoL as an ELT INSETT provider (especially in relation to AzINSETT)? What funding will be available to ensure the recruitment and training of sufficient numbers of teachers through a centralised INSETT programme that is only delivered in Baku. To what extent will existing specialists in UoL be willing to give space for the new ELT INSETT project curriculum and training approach? Until we have clear answers to these questions and in particular to Question 2, the risks of making any commitment to working with UoL in a Phase 3 cascade appear to be very high. 5.3 Azerbaijan English Teachers' Association (meeting note 060208c TA.doc) We met with the President of AzETA, Ms Ragsana Mammadova, with the primary purpose of assessing their capacity to support a new ELT INSETT mini-baseline. Although AzETA has a long term interest in continuing to support professional development amongst English Language teachers, and has a growing membership both in Baku and in the regions, it is not, for the moment, able to provide official INSETT programmes. Ms Mammadova did, however, comment that very little official ELT INSETT appears to be happening, and that what little is offered is often not relevant to the needs of her association's members. Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 11 5.3.1 Capacity to support an ELT INSETT mini-baseline As a means of answering some of the questions raised in the preceding sections, we discussed the possibility of AzETA cooperating with the British Council and the Ministry of Education in attempting to find answers to the following questions: How many English Language Teachers are there in the regions outside Baku? How many official ELT INSETT courses have happened in the last three years in the regions? How many teachers have been trained through these courses? Who provided the training (name / contact information)? Such a survey would not be concerned with an assessment of quality; it would be a fact-finding exercise only. Ms Mammadova expressed a willingness on behalf of AzETA to assist in carrying out such a survey, although they may be a need for some financial support if large numbers of forms need to be duplicated and circulated. With the appropriate support she was confident that this process could be completed before the end of May 2006. 5.3.2 Interim conclusion AzETA's support and cooperation in the administration of a large scale survey of official ELT INSETT provision will be essential. If the British Council does decide to go ahead with this survey, it will need to begin discussions with AzETA as soon as possible. 5.4 Ministry of Education (meeting note 060208a MoE.doc) Our discussions at the Ministry of Education were with the Vice Minister, Mr Elmar Qasimov. Mr Qasimov has been well briefed for our meeting and was fulsome in his praise for what the project had achieved so far. 5.4.1 Current policy on ELT INSETT According to Mr Qasimov, the Ministry's position is that both AzINSETT and UoL have the authority to provide ELT INSETT. As our meeting took place before we saw Dr Aliyev, there is an urgent need for a follow-up meeting to obtain clarification. Mr Qasimov also stated that there was full support for the ELT INSETT project, commenting in particular that: - MoE hopes that there will be a Phase 3 because schools in the regions outside Baku have a great need for such training. MoE's priority in ELT INSETT will be to deliver training to teachers in the regions. Phase 1 and 2 INSET Trainers will receive certificates which state that they should give this training in other regions and the MoE accepts these certificates as giving this status. During our meeting we also discussed the status of the 5 year official INSETT programme, and questions of funding and responsibility. Mr Qasimov's comments are summarised below: Structure of INSETT programmes INSETT is mainly a 5 year cycle, but for some subjects it is delivered every three years. Typically this training lasts for different periods of time a minimum would be one month, but it can be as long as 6 months. After the first 5 years of service there is supposed to be a 6 month re-training programme. Most courses last around 2 months. Authorised agencies INSETT is delivered through the Azerbaijan Teachers' Institute + 12 Affiliations + Training and retraining departments of some universities with pedagogical status. Training is paid for through the local Ed Department. Funding Local funding comes from regional education departments. MoE recognise that more funding is needed, because there has to be a sufficient amount for subsistence and travel. However, local Educational Authorities should provide this. Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 12 Roles of AzINSETT / UoL According to the Vice Minster they have equal status. The MoE gives the certificate and does not differentiate between the training institution. The MoE understands that they are both interested in delivery. Future directions Before any Phase 3 can start, the Ministry must be clear about what is meant by the title of Methodogist and how this official status can be given to the ELT INSETT trainers. So far as partner organisations are concerned, it will be better if the British Council chooses partner institutions. The MoE fully agrees that it is best to focus on EL methodologists. They should be trained to provide INSETT to other teachers. 5.4.2 Interim conclusion I have two main concerns as a result of this discussion. The first is the apparent confusion at a policy level as to which organisation has the remit to deliver ELT INSETT. This will require clarification at the earliest possible occasion. My second concern is that there appears to be a very large gap between the official declarations and policies of government on INSETT and the reality on the ground. If there is no realistic funding and policy framework for the delivery of official ELT INSETT, it is unlikely that a British Council initiative in this area will succeed. 5.5 A possible way forward After each of the interviews summarised above, I was able to review where we had got to with the English Language Projects Manager, Brian Maguire and the English Language Projects Coordinator Gulshan Huseynova. During these discussions we began to map out a possible approach to the elaboration of a Phase 3 for the project. This way possible way forward is presented schematically below, and will be returned to in the conclusions and recommendations which follow. The critical issues which inform Figure 2 include: the extent to which there is a match between policy priorities, funding, and capacity to implement ELT INSETT at national and local levels the capacity of National Government INSETT (AzINSETT / UoL) structures to deliver ELT INSETT in the regions the capacity of NGO structures to deliver ELT INSETT in the regions the nature of other reform processes in INSETT funded through the World Bank Project. Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 13 Clarify current policy on ELT INSETT provision Route A number of If clear courses delivered number of trainers If NOTclear BC cooperates with national INSET structures (AzINSETT / UoL) Select possible trainers to participate in an update / selection summer course number of teachers trained Route B BC cooperates with NGO structures (AzETA) involved BC and MoE / AzETA assess the capacity of the official providers of ELT INSETT in the regions of Azerbaijan 2003-2005 BC in discussions with MoE and World Bank representatives ensures that any actions taken in Phase 3 harmonise with World Bank funded reforms If possible, develop implementation strategy in cooperation with Official ELT INSETT providers Deliver ELT INSETT Trainer Training programme to the most effective INSETT trainers available. funding available If sufficient Select possible trainers to participate in an update / selection summer course Develop implementation strategy with Official ELT INSETT providers Figure 2: Phase 3 - a possible structure Route A is premised on the following actions and results: a policy review which will ensure that there is clarity and agreement on which agencies have the responsibility for official ELT INSETT this could take the form of a round table meeting of key stakeholders (MoE, BC, AzINSETT, UoL, AzETA) a focused baseline study of ELT INSETT capacity in Azerbaijan (to be completed by May 2006). The primary purpose of this study will be to assess the capacity of official ELT INSETT capacity in Azerbaijan (courses delivered / teachers trained / trainers / funding), and should also ensure that whatever action is taken harmonises as much as possible with other activities being undertaken within the framework of World Bank funded education reforms in the event of a positive outcome from this study, a Summer course / Selection process for potential participants in Phase 3 (Summer 2006) a trainer training programme delivered to this group by June 2007 Route B will be a fallback in the event that it is impossible to establish an appropriate partner in the government sector. In this scenario, the British Council would cooperate with AzETA to establish as large a cohort as possible of ELT professionals with the capacity to deliver informal ELT INSETT training to classroom teachers in the regions. This approach will have low institutional sustainability, but will, at least, ensure that a wide group of active professionals have enhanced skills, knowledge and resources, and that there is scope for some impact beyond this trained group of "barefoot" trainers. Clearly, "Route A" is the preferred scenario in terms of long term sustainability of project outcomes. This, however is dependent on it being possible to identify a national government structure with which to engage, and which will be able to benefit from a cooperative investment between the British Council and the Government of Azerbaijan to strengthen capacity in a key area of the education system. Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 14 6. Acknowledgements I would like to thank the EL Projects Manager Brian Maguire for his energetic and enormously helpful professional briefing and advice throughout this consultancy process. Brian is clearly highly respected by the INSETT team and his colleagues, and his thorough preparation for this review has made it possible to achieve significant results in a short period of time he cooks a mean sausage and egg fry-up too! I would also like to thank the EL Projects Coordinator Gulshan Huseynova for her valuable insights, tireless and expert translation skills, and her very warm welcome to Azerbaijan. Thanks also to Paul Hilder for his insights and support, and to British Council Director Andy Williams for hosting a reception for those involved in the review process. This was a great help in getting to know people in a less formal setting. Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 15 7. Conclusions and recommendations (draft!) Recommendation 1 PHASE 2 EVALUATION The ELT INSETT Project Manager should work closely with the ELT INSETT team to finalise and implement an evaluation plan for Phase 2 of the project. Results of this evaluation process should be available at the end of the funding period for Phase 2 and should inform the final design of Phase 3 (including the ELT INSETT training programme design) Recommendation 2 POLICY The British Council and the Project Board should seek immediate clarification from the Ministry of Education on the issue of which organisations have the authority and responsibility to provide ELT INSETT in the regions. Recommendation 3 POLICY The British Council should seek to ensure that any initiatives within Phase 3 harmonise with processes funded through the World Bank Education Reform project Recommendation 4 CAPACITY The British Council, in cooperation with the Ministry of Education and the Azerbaijan English Teachers Association, should take immediate steps to assess the extent to which national and local state structures in Azerbaijan are actually delivering ELT INSETT courses to teachers in the regions, and who is delivering this training. This may involve parallel surveys one carried out by AzINSETT, the other conducted by AzETA. This triangulation of data would be valuable. Recommendation 5 PROJECT DESIGN If it is possible to clarify these issues, a project design for Phase 3 should be established. This should have the following core structure: Outcome Teachers in Secondary Schools the regions of Azerbaijan are better able to able to 1/ use new text books more effectively, 2/ prepare their own materials, 3/ implement these materials in classroom teaching, and 4/ enable these trained teachers to support colleagues who have not shared their training experience Outputs An official EL Teacher Training Programme (content / methodology) is agreed and being implemented by September 2007 Existing ELT INSETT Trainers have been identified by September 2006 This group has completed an INSETT Trainer Training programme by August 2007 A management system to enable participation of all ELT teachers in ELT INSETT in the regions is in place by end 2006 Agreement and financial contribution for ELT INSETT Teacher Training and ELT INSETT Trainer Training from national authorities is confirmed by September 2006 with a commitment to fund national ELT INSETT Teacher Training to at least June 2009. Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 16 APPENDICES 1. Azerbaijan ELT INSETT PROJECT - Documents.doc 2. _INSETT Project Evaluation NOTES.doc 3. ELT INSETT Evaluation Schedule + outcomes.doc 4. List of meeting notes: - 5. 060206 Gulshan.doc 060206a AzINSETT.doc 060206b BakINSETT.doc 060206c BC_AZ.doc 060208a MoE.doc 060208b UoL.doc 060208c TA.doc ELT INSETT Evaluation Workshop Notes.doc Azerbaijan ELT INSETT Project Review www.ctribble.co.uk Page 17