An Coiste Feabhais Acadúil The Committee on Academic Quality Improvement The Academic Quality Assurance Programme 2007-2008 Report to Údarás na hOllscoile Review of BA in Public & Social Policy Self-Assessment Review Group Visit Follow Up Meeting November-December 2008 31st January – 1st February 2008 26th June 2008 This Report was compiled for members of Údarás na hOllscoile, NUI Galway and its committees as a readily accessible but comprehensive source of information on the above review, its context and its outcomes. Quality Office, November 2008 Report to Údarás – Review of BA in Public & Social Policy 2007–2008 1. Overview of the Programme 1.1 Aims and Objectives of the Programme Aims & Objectives To provide students with a thorough understanding of the multi-faceted discipline of policy studies. To provide students with a detailed level of understanding of how policy is formulated, evaluated and implemented. To prepare students for the complex, intricate process of policy making, within governmental organisations, private sector organisations, or within the ever expanding sphere of the voluntary and community sector. The multidisciplinary nature of the degree, encompassing Sociology, Politics, Law and Economics, illustrates the compound nature of policy-making and the increasing need for professional ability in this field. Within Sociology and Politics, students learn about key concepts pertinent to Ireland, including Poverty, Equality, Environmentalism, Local and Regional Government, National Administration, Health and Education. Within Economics, students gain an appreciation of the strong link between implementing policy and fiscal considerations. In times of budgetary constraints difficult choices need to be made. Within Law, students acquire a comprehensive knowledge of the Irish and European legal systems, within which policy makers must now operate. Programme Priorities Benchmarking of the curriculum as well as the definition of Learning Outcomes for the programme in combination with a review of the curriculum. Evaluation of student examination performance in comparison to the BA Omnibus Programme as well as an investigation of the level of Repeat Students in the 2BA6. The appointment of an External Examiner to the programme Allocation of a dedicated budget for the programme The creation of established roles and responsibilities for the Co-ordinator(s) of the programme. The establishment of a Curriculum Board for the programme to facilitate on-going revision and evaluation of the programme. The allocation of dedicated administrative support to the Programme. 1.2 Background The B.A in Public & Social Policy programme began in September 1998. The overall responsibility for the direction of the degree is the Head of the sponsor Department or School. This rotates every three years between the three Departments, The School of Political Science and Sociology, The Law Department & the Department of Economics. 2 Report to Údarás – Review of BA in Public & Social Policy 2007–2008 3 Within this programme each Department/School uses its own organisational structures and management practices to facilitate implementation of the course. Some courses on the B.A. Public and Social Policy programme are also constituent courses within the B.A. omnibus programme, to which all three departments contribute. Such a situation allows for dovetailing of many management and administration issues. The programme does not have a budget or specific administrative support. Nor does the programme have an External Examiner. Instead courses are examined by the External Examiners within each department this has meant that no one Examiner considers the cumulative results of students or the overall coherence of the programme 1.3 Accommodation and Facilities As the Programme is run by three different departments its core facilities are spread around the NUI Galway Campus. The academic departments of the School of Political Science and Sociology are located in the Áras Moyola Building, the Faculty of Law is located in the Arts & Sciences Building and the Economics Department is located in the Cairnes Building Students currently feel that because the programme is run by three different departments, they are not ‘owned’ by any department and that consequently their needs are not adequately catered for. In meetings with staff, students have expressed the view that the university should have a policy unit or centre to which the students might belong. 2. Review Group Visit and Report This report arises from a visit by a review group to the BA in Public and Social Policy from 31 January to 1 February 2008. The Programme Board had already prepared and submitted a ‘Self Assessment Report’ that, with other documentation, was made available to the Group in advance of the visit. The Review Group consisted of; Professor Tim Blackman, Director, Wolfson Research Institute, Durham University (Chair); Dr Brid Quinn, Department of Politics and Public Administration, University of Limerick; Dr Rachel Cave, Department of Earth & Ocean Sciences, NUI Galway (Cognate); Dr Andrew Flaus, Department of Biochemistry, NUI Galway (Rapporteur). 2.1 Summary, and Main Recommendations from Report Summary The BA PSP was launched with the aim of providing trained graduates in public and social policy for a rapidly evolving Ireland. This continues to fit well with current strategic priorities 1 and 4 of NUI Galway to provide attractive courses for high quality students, and to maximize contribution at national and regional levels. A clear opportunity exists for the BA in Public and Social Policy. Despite continuing difficulties with achievement, coherence, and organisational structures, the original vision of the programme’s founders remains both alive and appealing for many students. The fundamental challenge to be faced by those responsible is whether the will exists to implement its multidisciplinary nature effectively, perhaps in a radically revised format. Report to Údarás – Review of BA in Public & Social Policy 2007–2008 4 It is crucial that the lack of a formal and effective coordination structure across contributing disciplines is redressed. It will then be possible to implement standard practices for which there is ample expertise from other multi-disciplinary programmes within the university. Within a solid organisational foundation, a coherent programme of study can finally be assembled to target the aims and objectives of the degree. These must nevertheless be based on a realistic assessment of the needs of both students and employers. The need for immediate and fundamental reform of the BA in Public and Social Policy is without question. The programme cannot continue to trade on laudable intent, goodwill of students, and the enthusiasm of a handful of motivated staff. Main Recommendations Organisation and Management 1. The Head of the Department of Political Science and Sociology should take permanent leadership of the BA PSP. This is an Arts degree programme with ultimate responsibility held by the Dean of Arts, Social Sciences and Celtic Studies. 2. The heads of the three contributing departments should each nominate a Departmental Coordinator from within their department. Except in extreme circumstances, changes in nomination should only occur immediately after the summer exams to facilitate preparation for the start of the next academic year. 3. The Head of Political Science and Sociology should appoint one of the departmental coordinators as Programme Director, responsible for a smooth and consistent experience for all students and staff involved with the programme on a day-to-day basis. There is no a priori need for this assignment to be rotated. The role definition of this position should also specify the limits of involvement where they interface with responsibilities specific to departmental coordinators and module teachers. 4. The Programme Director should take on specific responsibility for 1st year students because this is the crucial year for many students. The other two departmental coordinators should take on visible and effective overall coordination roles for 2nd and 3rd year respectively. 5. The Head of Political Science and Sociology should chair a Programme Board to take direct responsibility for the success of the BA PSP. The Programme Board should include the heads of the contributing departments, the departmental coordinators, and other contributors where pertinent. It should oversee curriculum and statutory requirements, monitor standards, ensure teaching quality, and oversee coordination of the programme. The Programme Director should ensure that the Programme Board meets at least twice a year, with minutes reported to the Dean of Arts, Social Sciences and Celtic Studies. 6. The Programme Director should convene a Teaching Committee of relevant staff across all disciplines that contribute to the programme. The Programme Director should ensure that the Teaching Committee meets at the start of each semester and also specifically to review exam results of all BA PSP students in advance of the Faculty exam board meetings. The minutes of these meetings should be reported to the Programme Board. 7. A single comprehensive handbook covering all three years of the programme should be created before the end of the current academic year (07/08) and provided to all students in orientation sessions at the start of the next academic year (08/09). This handbook should be created together by the three year group coordinators under the leadership of the Programme Director, with input from the class reps. Report to Údarás – Review of BA in Public & Social Policy 2007–2008 5 8. A dedicated notice board for programme-specific information should be set up in an appropriate location accessible to students, and maintained by the departmental coordinators. All timetables and other relevant programme-wide information should be displayed there. Blackboard should be used for module-specific information. 9. The content and design of the BA PSP presentation in the Faculty of Arts brochure could be readily adapted to a small programme-specific brochure, with the small costs involved being shared between the two Faculties benefiting from the degree. 10. The appointment of an External Examiner would provide useful overview of the programme’s content, efficacy and student achievement. University management told the Review Group that they were unaware of any formal request for an external examiner but saw no reason why funds would not be available for this. Programmes and Instruction 11. The Programme Board and Teaching Committee must act decisively to achieve programme coherence, greater balance between the subject streams, continuity within the curriculum, and connectivity between modules. 12. Immediate priority must be given to monitoring the failure rate among first years and the ongoing increase in repeat students in second year. Attention should also be given the low proportion of 2.1 and first class awards in 3rd year. These are causes for serious concern. 13. Monitoring of the career paths of graduates is also recommended, as there seems to be a disconnection between the programme’s stated aims and employment patterns. 14. The Programme Board should also consider radical restructuring of the programme to facilitate a stronger policy focus. Consideration should also be given to reorganising the programme content in a manner that retains core elements but allows for disciplineoriented routes through the BA PSP. This is the model in place for comparable programmes at the University of Michigan, the University of Limerick and University College Cork. 15. In reviewing the programme content, the Programme Board should consider including: a. More training in applied research and evaluation. b. Greater focus on preparation for evidence-based decision-making. c. The opportunity to engage in self-directed learning/research in the form of a final year project/dissertation. d. The inclusion of an experiential learning component to enhance the policyoriented programme. e. Articulation and development of the generic skills. f. The appropriate level of microeconomics for this programme. g. The provision of extra tutorials. The Review Group noted worthy attempts to address subject specific difficulties in Economics, and such measures may also be necessary for other modules. 16. The Teaching Committee should bring all programme contributors together to: a. Agree learning outcomes, assessment and feedback strategies. The expertise of CELT could be drawn upon in this respect. Report to Údarás – Review of BA in Public & Social Policy 2007–2008 6 b. Encourage regular revision and updating of the contents of all modules to reflect policy developments and new publications. c. Address the attendance problems referred to by some of those interviewed. This needs to be tackled at both programme and module levels and a culture of responsibility for their learning fostered among students. Scholarship and Research 17. Stronger links should be developed between this programme and research being carried out by contributing faculty. The opportunity for linkages with local research centres and institutes should be actively explored and exploited, including potential contributions to the University’s ambition for expansion of postgraduate programmes. Leadership for this should be taken by the Programme Board. The Wider Context 18. Careful consideration should be given by the Programme Board to how the programme is positioned and branded in its market. Consultation with employers would be useful and a change in the name of the programme may be advisable. 19. The Programme Board, in consultation with the Faculties of Arts and Law, should undertake a formal analysis of options for re-orienting the curriculum. The Review Group considered three possible scenarios in the time available to it: a. Retention of the BA PSP as a tripartite interdisciplinary programme combining substantive components of politics and sociology, economics, and law within the current format. The programme itself would nevertheless be subject to significant improvements in curriculum and organisation. This retains the original vision of the programme but does not directly address the problem of low entry standards to a challenging academic programme. b. Redesign of BA PSP to retain the broad tripartite thematic core, but with specialisation on one or two components beginning in 2nd year and emphasised in the 3rd year. This maintains disciplinary depth in the specialisations and assures overall academic standards, whilst respecting the realistic ability and career prospects of the students entering the programme. c. Assimilation into the 4 year BA Connect initiative, with necessary adaptation of components. This simplifies the Arts Faculty offerings and provides the necessary organisational framework for the programme. The experience of those involved with BA PSP may benefit BA Connect. This option requires extensive adaptation of the curriculum and may reduce access to the course for mature students and those with poorer Leaving Certificate scores. Report to Údarás – Review of BA in Public & Social Policy 2007–2008 7 3. Action Plans Follow Up Meeting, Thursday 26th June 2008 in Room 333, Aras Moyola Present: Professor Jim Gosling (Chair), Dr Seamus MacMathuna (representing The Registrar), Dr Andrew Flaus (Review Group), Dr Rachel Cave (Review Group), Dr Brid Quinn (Review Group), Dr Sharon Flynn (CELT), Professor Kevin Barry (Dean of Arts, Social Sciences and Celtic Studies), Ms Yvonne O’Connor (Arts, Social Sciencs and Celtic Studies), Professor Michael Keane (Dean of Commerce), Mr Keith Warnock (VP for Physical Resources), Mr Brendan Kennelly, Professor Chris Curtin, Dr Michelle Millar, Mr Liam Coen, Dr Mary Silles, Ms Maureen O’Sullivan (representing Dean of Law), Ms Maureen Linnane (in attendance) Apologies: Mr Chris McNairney. Action Plan for the Programme Director and Board: 1. The Programme Director and the Heads of the contributing Schools will take every action and precaution possible to enable the Dean of Arts Social Sciences and Celtic Studies (the Dean), the Council of Deans and the Registrar to put in place policies and other measures that will ensure that the study programme leading to the BA in Public and Social Policy is fully supported by contributing schools and has continuity of effective management. 2. The Programme Board (The Board) will establish a Teaching Committee that includes relevant staff across all contributing disciplines, and that will meet frequently initially and, subsequently, at least at the start of each semester. 3. Supported by the Dean (and if necessary by the Council of Deans and the Registrar), The BA-PSP Programme Board will meet at least twice per year and work with the Programme Director to revise all aspects of the Programme. 4. As an immediate and primary objective, the Board and Teaching Committee will act decisively to achieve greater programme coherence, balance between the subject streams, continuity within the curriculum, and connectivity between modules. 5. As an objective for implementation in 2009–10, the Board (in consultation with the Dean and the contributing Schools) will undertake a formal analysis of options for re-orienting the Programme. Three possible scenarios were suggested by the Review Group, briefly: a. Retention of the BA PSP as a tripartite interdisciplinary programme. b. Redesign of BA PSP to retain the broad tripartite thematic core, but with specialisation on one or two components beginning in 2nd year and emphasised in the 3rd year. c. Assimilation into the 4 year BA Connect panel of programmes, with necessary adaptation of components. 6. The Teaching Committee will bring all programme contributors together to: o Agree learning outcomes, assessment and feedback strategies. The expertise of CELT will be drawn upon in this respect. o Encourage regular revision and updating of the contents of all modules to reflect policy developments and new publications. Report to Údarás – Review of BA in Public & Social Policy 2007–2008 8 o Address attendance problems with the objective of supporting among students a culture of responsibility for their own learning. o Plan the provision of extra tutorials. The Review Group noted worthy attempts to address subject specific difficulties in Economics, and such measures may also be necessary for other modules. 7. In reviewing the Programme content, the Teaching Committee and Board will consider: o A work plan aimed meeting the Marks and Standards deadline for changes affecting the academic year 2009-10. o The career paths of current graduates with inputs from the Career’s Office. The objective will be to improve the connections between the programme’s (revised) aims and probable employment patterns. o More training in applied research and evaluation. o Greater focus on preparation for evidence-based decision-making. o The opportunity to engage in self-directed learning/research in the form of a final year project/dissertation. o The inclusion of an experiential learning component to enhance the policyoriented programme. o Articulation and development of the generic skills. o The appropriate level of microeconomics for this programme. o Strengthening links to the three Research Centres within the Units contributing to the Programme i.e. The Child and Family Research Centre, The Irish Centre for Social Gerontology and The Centre for Disability Law and Policy. 8. The Programme Coordinator will take specific responsibility for 1st year students with the two other departmental coordinators having overall coordination roles for 2nd and 3rd year respectively; with effect from the academic year 2008-09. 9. Coherence within student cohorts and communications with students will be enhanced and supported: o Blackboard will be used fully, including for module-specific information. o A single comprehensive handbook covering all three years of the programme will be created and provided to all students in orientation sessions at the start of the next academic year (08/09). o A dedicated notice board for programme-specific information will be set up in an appropriate location accessible to students, and all timetables and other relevant programme-wide information will be displayed there. 10. The Board and Teaching Committee will review examination procedures, including: o A request to the University for the appointment of a specific external examiner. o Inclusion of a coordinated review of examination results for all BA-PSP students in advance of the Faculty examination board meetings. o As a priority, the monitoring of failure rates among first years and the ongoing increase in repeat students in second year. Attention will also be given to the low proportions of final 2.1 and first class awards. 11. In the context of the rolling reforms envisaged, the Board will consider how the Programme is positioned and branded in its market. Employers and the Director of Marketing will be consulted. 9 Report to Údarás – Review of BA in Public & Social Policy 2007–2008 Action Plan for the University (including Registrar, Council of Deans, Dean of Arts SS & CS and heads of contributing schools): 1. The Dean and College of Arts SS and CS recognise their responsibility for and ownership of the multi-disciplinary study programme leading to the BA in Public and Social Policy. 2. The Dean will propose that the Council of Deans decide policies and other measures that will ensure that the BA in Public and Social Policy is fully supported by contributing schools and has continuity of effective management. In particular, all relevant academic and administrative staff in contributing schools will understand that BA-PSP is an integral part of their school’s mission and that it is their duty to support the local coordinator and the Programme Director as appropriate. 3. The Dean and the College of Arts SS and CS will establish a governance structure for the BA-PSP, including: o A Programme Board with specific responsibility for the BS-PSP. All meetings will have minutes, as will all meetings of sub committees. o A coordinator from each of the three main contributing Schools who will devote a significant amount of time to the Programme. One coordinator will be appointed by the Dean as Programme Director for a fixed term and act as convenor of the Board. 4. The Quality Office will support an Away Day for the Programme Board and all staff involved with this programme, to discuss and solve the problems of leadership of this programme. Approved by: Approved by: Approved by: Approved by: Registrar, Professor Jim Ward, 2 October 2008 Dean of Arts SS & CS, Professor Kevin Barry, 29 September 2008 Programme Director, Dr Michelle Millar, 26 August 2008 Head of School of Political Science and Sociology, Professor Chris Curtin, 27 August 2008 Approved by: Head of School of Law, Ms Maureen O’Sullivan, 3 November 2008 Approved by: Head of Economics, Professor Eamon O’Shea, 14 October 2008 Approved by: Director of CELT, Dr. Iain MacLabhrainn, 18 September 2008 Approved by: Director of Human Resources, Mr Chris McNairney, 1 October 2008 Director of Quality, Finalised: 3 November 2008