An Coiste Feabhais Acadúil The Committee on Academic Quality Improvement The Academic Quality Assurance Programme 2007-2008 Report to Údarás na hOllscoile Review of Higher Diploma in Systems Analysis Self-Assessment Review Group Visit Follow Up Meeting December 2007 28 -29th January 2008 26th June 2008 th This Report was compiled for members of Údarás na hOllscoile, NUI Galway and its committees as a readily accessible but comprehensive source of information on the above review, its context and its outcomes. Quality Office, September 2008 Report to Údarás – Review of Higher Diploma in Systems Analysis 2007–2008 1. Overview of Programme 1.1 Aims and Objectives of the Programme To give students skills in the design and development of information systems within a general business and computing context. Impart to students specific knowledge of programming and database languages; systems analysis and design; computer systems, networks and operating systems; business information systems; new Internet and multimedia issues and development; and the business context of systems development practice. Specialised aspects of systems development are also covered, such as: software quality assurance, human-computer interaction and e-commerce. The programme has been equally suited to those who wish to further develop their particular computing background and to those looking for a conversion course to move into the field of information systems development. The programme has intentionally tried to harness the energy of students who come from different academic and professional backgrounds. There has been a distinct teaching philosophy over most of the programme’s life. The diploma, while remaining a conversion course, has ambitiously sought to develop in students applied and useful skills in business information systems development. It has purposefully emphasised the critical importance of the business and organisational imperative rather than a technological concentration. In deliberately steering students away from a heavy technology or IT focus, the programme reflects the world view of that of the staff of the Business Information Systems Group. This esprit de corps has been an enduring viewpoint that reflects the fact that almost all of the earlier appointments in the group held primary business degrees. The business “wrap-around” of the information systems and technology course elements has produced more ‘balanced’ graduates than similar software / computing diplomas elsewhere. 1.2 Background The Diploma in Systems Analysis (DSA) was introduced in 1979 and was intended as an applied skills programme for employees who required exposure to business computing. In 1990, the diploma was significantly modified to account for changes in development practice and theoretical progress. It became a one year full-time and two-year part-time programme. From that time the programme was ATS-funded (from the European Social Fund) for 4 years during which period it developed a strong and successful reputation, attracting large numbers of applicants and achieving “real” placement levels in excess of 90%. In early 1996, a response to the Higher Education Authority’s request for additional Postgraduate software places was successful. The programme then became the Higher Diploma in Systems Analysis (Business Systems Development) and significant syllabus changes were made. In 2000, the diploma was changed significantly again to meet distinct needs of the fields of business systems development and internet and multimedia application development. Two streams, the Higher Diploma in Systems Analysis (Business Systems Development) and Higher Diploma in Systems Analysis (Internet and Multimedia Studies), were introduced and numbers increased to 80. 2 Report to Údarás – Review of Higher Diploma in Systems Analysis 2007–2008 3 The programme was last substantially modified in 2003 to re-introduce a part-time two year mode and to remove the streams and instead offer specialisation in the second semester. The programme reverted back to the Higher Diploma in Systems Analysis. The numbers on the programme are now at about the same level they were 20 years ago. 1.3 Student numbers The number of fulltime equivalent (FTE) students in the programme was 25 in the year 2006/07, representing a decrease of 19.4% in the three years since 2003-04 and a decrease of 67.5% since 2000-2001. 1.4 Accommodation and Facilities The core facilities of the Higher Diploma in Systems Analysis Programme are located in the Cairnes Building at NUI Galway. A dedicated computer laboratory (the “Menlo Suite”) with 19 PCs is available to students within this building and lectures take place in the newly constructed extension of the Cairnes Building. 2. Review Group Visit and Report The report arises from a visit by a review group to the Higher Diploma in Systems Analysis on 28th/29th January 2008. The Programme Board had already prepared and submitted a ‘Self Assessment Report’ that, with other documentation, was made available to the Group in advance of the visit. The Review Group consisted of: Dr. Roger Blake, College of Management, University of Massachusetts (Chair); Dr. Chris Coughlan, Hewlett Packard, Galway; Mr. Sean Duignan, Department of Maths & Computing, GMIT; Ms Mary Dempsey, University Teacher, Department of Industrial Engineering, NUI Galway (Cognate); Dr. Dagmar Stengel, Lecturer, Department of Botany, NUI Galway (Rapporteur). 2.1 Summary and Main Recommendations from Report Summary The BIS Group has successfully managed the Higher Diploma in Systems Analysis for almost 30 years, covering several generations of technological change, and is appropriately considering the Programme’s direction. The BIS Group has kept the curriculum current, although in the process it has broadened. Formulating overall objectives for the programme and learning outcomes for each course will help redefine the curriculum’s direction. It will also help articulate the unique selling points the Programme has to offer, its competitive advantage, the type of students it wishes to attract, and by what means the Programme can continue to evolve to meet the needs of industry. The review group consistently heard that the skills taught in the Programme’s curriculum were in demand by industry. We also heard that local industry believes in the value of the Programme and expresses willingness to help shape it, which should be formally pursued. Both current students and recent graduates expressed satisfaction with the Programme and the curriculum. They were particularly satisfied with the BIS Group staff and its willingness to hear feedback. As constructive criticism, they asked for more staff supervision and involvement in coordinating content between lecture and lab. As did the external examiner and this review group, students viewed project work to be more beneficial than exams especially for several specific topics and courses. Report to Údarás – Review of Higher Diploma in Systems Analysis 2007–2008 4 The review group concurs with the view of BIS Group staff that the level 8 degree should be retained and a taught level 9 degree developed with appropriate additional content to warrant the award. There are many options to be considered for a new level 9 degree, such as a nine-month level 8 program to be followed by a 3 month research component. The review group is not in a position to make specific recommendations for how a new level 9 degree programme should be structured or the relationship it may have to the existing level 8 Diploma. The review group is confident that the BIS group is well prepared and well aware of the complexities they face in order to determine the best path for the Higher Diploma in Systems Analysis, and wish them well in their efforts. Recommendations The following is a summary of the recommendations offered by the review group. 1. Programme Structure – Reassessment The Programme’s direction, overall objectives, and position as a Higher Diploma or Masters Level need reassessment. The review group concurs with the BIS Group and recommends the retention of the level 8 degree and the development of a taught level 9 degree with appropriate additional content to warrant the award. A prospective restructuring of the Programme needs to consider Unique Selling Points (USPs), its position and support within the Cairnes Graduate School, and alignment with the School’s and Faculty’s objectives. 2. Programme Position – Closer to Industry Although skills taught in the Programme are in demand by industry, closer links need to be forged with relevant industries. A formal process of regular curriculum and course content review and revision should be instituted and reflect industry needs by incorporating regular feedback from employers and graduates. Industry support with Academic Alliances, advertising, and additional funding opportunities should be explored. 3. Programme Learning Objectives - Reformulation The BIS Group has kept the curriculum current, although over time the content and learning objectives have broadened. The Programmes’ learning objectives need reformulation in concert with industry involvement. The overall objectives of the Programme and learning outcomes for individual modules should be identified and formulated. Curriculum changes should be made to match current industry needs, facilitate generic and specific competencies, and could be developed in liaison with the University’s Community Knowledge Initiative (CKI). 4. Programme Delivery – Better linkage of lecture and lab The organisation of teaching in the laboratory/practical sessions should be formalised and the materials covered in those sessions better integrated into overall course structure. The laboratory/practical sessions should be more closely supervised and possibly taught by academic teaching staff. CELT training for postgraduate teachers should be explored. 5. Student Evaluation – Increased project work A reduction in emphasis on exams in favour of more project work should be made, as recommended by the External Examiner and as was the case earlier in the Programme. Report to Údarás – Review of Higher Diploma in Systems Analysis 2007–2008 5 Project work can arise from the increased industry involvement for curriculum development and from the establishment and renewal of links to other faculties. The assessment methods of group project work (e.g. percentage of marks given) and the methods used for project and group assignments should be reviewed to ensure fair assessment procedures. 3. Action Plans Follow up Meeting; Thursday 26th June 2008 at 9.30am in the Deans Meeting Room, Cairnes Building Present: Professor Jim Gosling (Chair), Professor Jim Ward (Registrar), Dr Kelly Coate (CELT), Ms Mary Dempsey (Review Group), Professor Michael Keane (Dean of Commerce), Dr Anatoli Nachev, Ms Orla McHugh, Mr Chris Barry, Dr Michael Lang, Mr Keith Warnock, Ms Maureen Linnane (in attendance) Apologies: Mr Sean Duignan (Review Group), Ms Mairead Hogan, Ms Laura Regan Action Plan for the Programme Board: 1. Programme Strategy and Market Positioning: a. A sub-committee of the Business Information Systems (BIS) Group is devising a strategic plan for the study programmes it oversees, including the Higher Diploma in Systems Analysis (HDSA). A separate sub-committee is working on curriculum evaluation, including module content, learning outcomes, and assessment approaches. The Strategic Plan and detailed changes for a revised HDSA programme will be in place by January 2009. b. The present consensus is that the HDSA will be retained as a Level 8 Higher Diploma with an add-on component (e.g. a dissertation or major project) to give a Level 9 Masters degree. A Level 7 Professional Diploma for which credits might be accumulated on a modular basis will also be considered. It is planned to have students enrolled on the new programmes in September 2009. c. The part-time mode of the HDSA programme will be reviewed in consultation with industry representatives. d. Possibilities for enhancing the “internationalisation” of the programme will be explored. 2. Learning Outcomes and Linkages with Industry: a. The HDSA will have explicitly defined learning outcomes in place for all modules by September 2009. b. The HDSA programme will continue to be reviewed comprehensively at least every 2-3 years, with feedback from graduates and students taken into consideration. c. The possibility of introducing a service-learning component into the programme under the auspices of CKI is currently being considered, with a view to matching current industry needs with facilitating generic and specific competencies. d. Possibilities for greater engagement and collaboration with industry partners will be explored. Report to Údarás – Review of Higher Diploma in Systems Analysis 2007–2008 6 3. Teaching and Assessment: a. The Programme Board are presently investigating the introduction of crossmodule projects and a major applied project (perhaps with a service learning element). This will be completed by September 2009 (see also 1a above). b. Commencing in the academic year 2008/2009, the Board will examine more equitable and transparent approaches to the assessment of team project work, including peer assessment. c. The Programme Board have no difficulty referring to “The hands-on application in labs of the concepts learned during lectures” sessions as ‘practicals’ or ‘laboratories’. d. In relation to the provision of tutorials/practicals/laboratories, the Programme Board will endeavour to continue to employ the services of first class honours graduates from previous years. Attention will continue to be paid to student feedback in relation to practicals, and where appropriate the relevant course lecturer will seek immediately to rectify any problems identified. Action Plan for the University: 1. Development and Promotion: a. The scope of the University and College officers and bodies now available to support the marketing and promotion of the HDSA is considerable, including the: New Director for Marketing & Communications New Committee for Development and Promotion in the Cairnes Graduate School, as well as the Postgraduate Admissions Office and the International Affairs Office Where appropriate and agreed, actions can therefore be undertaken easily on a combined basis with other IS/IT programmes offered by the University. b. The Dean of Commerce commends the above proposed developments of the HDSA within the Cairnes Graduate School, and will ensure the continued support of the Faculty/School via the new Vice Dean & Chair of the Faculty/School Committee for Teaching and Learning. 2. Curriculum Reform: a. CELT has advertised for an Education Officer to support the formulation learning outcomes for all study programmes and modules across the University and the implementation of consequential changes in teaching and assessment methods. It is hoped that this position will be filled by October 2008. Approved by: Approved by: Approved by: Approved by: Programme Director, Dr Michael Lang, 21 July 2008 Head of Department, Professor Seamus Collins, 12 August 2008 Registrar, Professor Jim Ward, 24 July 2008 Interim Head of School of Business and Economics, Professor Michael Keane, 18 September 2008 Approved by: Vice President for Physical Resources, Mr Keith Warnock, 24 July 2008 Approved by: Director of CELT, Dr. Iain MacLabhrainn, 24 July 2008 Approved by: Director of Human Resources, Mr Chris McNairney, 24 July 2008 Director of Quality Finalised: 22 September 2008