Quality Assurance at UCT Report to Senate by the Quality Assurance Working Group November 2001 Quality -- you know what it is, yet you don't know what it is. But that's self-contradictory. But some things are better than others, that is, they have more quality. But when you try to say what the quality is, apart from the things that have it, it all goes poof! There's nothing to talk about. But if you can't say what Quality is, how do you know what it is, or how do you know that it even exists? If no one knows what it is, then for all practical purposes it doesn't exist at all. But for all practical purposes it really does exist. What else are the grades based on? Why else would people pay fortunes for some things and throw others in the trash pile? Obviously some things are better than others -- but what's the ``betterness''? -- So round and round you go, spinning mental wheels and nowhere finding anyplace to get traction. What the hell is Quality? What is it?1 1. Introduction 1.1. This Report This report – and the recommendations that follow from it – is based on a review of aspects of quality assurance at UCT by the Quality Assurance Working Group (QAWG).2 In turn, QAWG’s work was prompted by the statutory requirements for quality assurance in higher education institutions that have come into force with the launch of the Council on Higher Education’s Higher Education Quality Committee (HEQC). QAWG’s review was founded in a series of focus group meetings, involving a wide range of academic and support staff from across the University. Earlier drafts of the report were considered by the Quality Assurance Working Group, and a final draft was presented to the Senate Executive Committee in September 2001. Following this SEC meeting, the draft report was sent to the Faculties and to the Centre for Higher Education Development for comment, and was made available to the University community via the Centre for Higher Education Development’s Web page. The report was also sent to the Higher Education Quality Committee for informal comment, and to the Admissions Committee, the Examinations and Assessment Committee, the 1 Robert Pirsig, Zen and the Art of Motorcycle Maintenance: An Inquiry into Values This report was prepared by Martin Hall, with Carol Cornielse, Rob Moore and Suellen Shay. Further assistance was provided by Colette February. 2 Quality Assurance at UCT/ 2 Distinguished Teacher Award Committee and the Doctoral Degrees Board for comment. Individual members of the University community were invited (via an announcement in the Monday Paper) to comment and these comments, as well as Faculty responses, are available in full at www.ched.uct.ac.za/qa. Responses to this process of consultation were considered by the Senate Executive Committee on 12 November 2001, and amended recommendations were approved for consideration by Senate. The final report was reviewed again by the Quality Assurance Working Group on 19 November 2001. QAWG shares responsibility for quality assurance with other bodies in the university. These include the University Research Committee (URC), which is responsible for quality assurance in the key area of research, and a current Project Group of the University Strategy Committee (USC), which is considering UCT’s relationship with its local and regional communities. The recommendations at the end of this report propose a system of co-ordination that will synchronise the work of these bodies, as well as others that need to be drawn into the quality assurance net. The sections that follow first set out the context for quality assurance in South African higher education at the present time. This is followed by a consideration of quality assurance in teaching and learning, and a consideration of the role of Senate – the key custodian of the University’s reputation as a leader in teaching, learning, community service and research. The recommendations at the end of this document together constitute a policy framework for quality assurance at UCT. By clarifying the roles of the Executive, Deans and existing committees and processes, and by creating additional committees and processes where these are required, the policy framework will provide the basis for internal processes of quality assurance and review, external accreditation when this is required, and formal reporting to the Higher Education Quality Committee in terms of current legislation. 1.2. Why quality assurance? Although the review of quality assurance at UCT has been prompted by statutory requirements, the primary purpose of taking stock of the present situation – and of proposing new measures – should not be compliance with legislation or regulations. Quality assurance should be understood as the measure of the value of what we do, and the system of benchmarks that we use to make sure that we maintain and improve standards on a continual basis. It is also important to set the imperatives of quality assurance in a more general context. Although South African Higher Education has particular characteristics, it is also the case that we are part of wider trends, and that UCT’s international standing is a key part of its reputation. As John Brennan and Tarla Shah have pointed out, quality assurance is, increasingly, central in this regard: “The public feature of the greatest concern to most higher education institutions is their reputation, their public standing … Reputation breeds off itself. A good reputation is an excellent basis for future success. A good reputation can exist for many years after the factors responsible for it have largely disappeared. But reputation can also be damaged and a Quality Assurance at UCT/ 3 critical external assessment is something which has the potential to inflict major damage”.3 Brennan and Shah note that universities have always had forms of quality assurance: “Traditionally, universities have emphasised self- and collegial-accountability and self-improvement. They have trusted their staff, relying on the professionalism of academics to ensure their quality and standing in society. Some of the ways in which they have done this … are through the processes of recruitment of teachers, selection of students, peer review of research and scholarship, and periodic scrutiny of curriculum and teaching. The quality of teachers was ensured through rigorous recruitment, appointment and promotion policies. Admission policies were intended to ensure that only the best, most able students were selected for entry by the institution. Regular assessment and examination enabled close monitoring of the performance and progress of individual students. Departmental and individual quality was judged on the basis of research and scholarly achievement over a long timespan. In the past, these judgements have mainly been based on a peer review process and have included success in gaining research grants, publication and review in refereed academic journals. Reviews of the curriculum by departments and other basic units have ensured that the currency of the curriculum is maintained on an ongoing basis. More recently, the quality of teaching has commonly been ensured through student questionnaire evaluations and staff development activities specifically aimed at improving the performance of the teachers in the classroom”.4 In recent years, there has been a strong trend towards the formalisation of such traditional systems (although US colleges and universities have had systems of formal accreditation in place for over a century). This formalisation has been driven by the establishment of national quality assurance agencies. In 1990, only France, the Netherlands and the UK possessed such national agencies. However, many more were set up in Western Europe through the 1990s, with active promotion by the European Union, and national agencies were adopted by most countries in Eastern Europe following the collapse of communist governments (under which there had been direct control of higher education). Similar developments have taken place in Australia and New Zealand, and in some Latin American counties, such as Mexico. Many of these approaches follow a “general model” which was developed for the European Commission in the early 1990s. This comprises four elements: a national coordinating body, institutional self-evaluation, external evaluation by academic peers, and published reports.5 However, quality assurance has also come at a time of declining state funding for higher education. This has made quality assurance inherently controversial, since national agencies are seen as indirect means of distributing resources. In addition, in those countries where there has been a strong tradition of university autonomy, national quality assurance agencies have been seen as a means of interference by the state. Conversely, in those countries where there was formerly strong central John Brennan and Tarla Shah, “Managing Quality in Higher Education: An international perspective on institutional assessment and change”. Open University Press, Buckingham, 2000: 36. 4 Brennan and Shah 2000:71. See also Martin Trow, “Academic Reviews and the Culture of Excellence”, Council for Studies in Higher Education, Stockholm, 1994. 5 F Van Vught and D.F. Westerheijden, “Quality Management and Quality Assurance in European Higher Education: Methods and Mechanisms”. European Commission, Luxembourg, 1993 3 Quality Assurance at UCT/ 4 regulation of universities – such as in Eastern Europe – national quality assurance agencies are the harbingers of greater institutional autonomy.6 Consequently, there are varied and often conflicting views of quality assurance in universities, some evangelical and others dismissive. One strong theme that emerges from international experience is that quality assurance systems that rely overly on compliance to externally-imposed regulation may work against the interests of quality development in universities. This is partly because academics are intrinsically motivated, accustomed to autonomy and oriented towards a tradition of collegial peer-evaluation. It is also because of the drain that compliance systems place on participating institutions; it has been argued that these sorts of quality assurance regimes require an unacceptable sacrifice of time by academic staff who would otherwise be conducting the primary functions of teaching and research. The best documented critiques of a compliance-driven approach are those of the United Kingdom’s Quality Assurance Agency (QAA). In one of many studies, an analysis of teaching quality assessment between 1995 and 2001 established that each of the 1 300 university departments inspected in this period spent between £20 000 and £200 000 (R200 000 and R2m) in direct costs preparing for inspections and in staff time. There was little evidence of any systematic benefit, but rather strong indications of grade inflation. Over these six years, the proportion of departments achieving “excellent” ratings increased from 25% to 60%, a trend attributed to “institutional learning” (or gamesmanship); the ability of departments to anticipate what inspectors want to find, supported in some cases by consultants hired for this purpose. In an inversion of the system that universities use to mark the achievements of their students, only 0.1% of the departments inspected were failed.7 John Randall, former chief executive of the QAA, argues that, while the ultimate aim of Britain’s teaching quality assessments is to gain sufficient acceptance for the process to be automatic and uncontested, in the meanwhile the degree of criticism from universities is proportional to the success of the exercise, since it serves as an index of the degree of change that is being prompted.8 It is certainly the case that the QAA’s approach lacks the confidence of British universities and their academic staff, as a running list of Times Higher Education Supplement headlines over the past twenty months shows: “Quality plan stalls as QAA faces dissent”; “The QAA is running into more trouble”; V-cs submit to quality blueprint”; “Over 80% vetoed blueprint”; “Draft rules set to complete QAA’s code of practice”; “QAA publishes ‘tick boxes’”; “Quality system open to abuse, critics claim”; “V-c’s ‘plea for firsts’ fuels quality fears”; “Millions go down the drain in audit fiasco”; “Overhaul decreed for a wasteful system”; “QAA told to 6 This is the case for part of the South African Higher Education sector, where the introduction of the Certification Council for Technikon Education (SERTEC) in 1986 was a welcome relief from the direct regulation of technikons by the (then) Department of National Education. See D.J.Jacobs, “Quantum leads in quality assurance in higher education”. Bulletin: News for the Human Sciences, March 1999. Pretoria: Centre for Science Development. 7 “Worthy project or just a game”, Times Higher Education Supplement, March 30 2001. 8 Randall was speaking at the launch of the Higher Education Quality Committee, Johannesburg, May 2001. Quality Assurance at UCT/ 5 rethink its award ratings”; “QAA revises framework”; “QAA takes a tough line on top-ups”; “QAA rules tally climbs to 168”; “TQA devalued by grade rises”; “LSE leads revolt against QAA”; “QAA faces boycott by 66 000 lecturers”; “Gang of five plans to escape QAA’s grip”; “Elite joins rebel cry for revised quality system”; “There is quality assurance, then there is the QAA”. Philosophy has had the most recent word (although perhaps not the last laugh). In June this year it was alleged that Philosophy Departments had managed to organise a successful cartel of mutual affirmation, with ten out of thirteen departments achieving a score of 100%. As one quality assurance inspector commented, “I suspect the philosophers are poking fun at the entire methodology”.9 Developments in quality assurance in South Africa have followed general trends while avoiding – for the most part – the excesses of a compliance regime. Responsibility for accreditation and quality assurance in the technikon sector rests (until August 2001), with the Certification Council for Technikon Education (SERTEC). SERTEC was set up in 1986 to replace direct regulation by the then Department of National Education, and adopted a system of quality assurance based on the recommendations of visiting evaluation committees, incorporating selfevaluation. Each committee comprises a convenor (who is a representative from another technikon), representatives of professional organisations, employers and students.10 In 1996, the university sector followed suit with SAUVCA’s Quality Promotion Unit. When the QPU was disbanded in 1999 (in anticipation of the establishment of the HEQC), SAUVCA sent out a questionnaire to which eighteen universities responded.11 This provides a good baseline for understanding current quality assurance practices across the South African University sector, and shows that: Quality assurance, while unevenly developed, ranges from “traditional, collegial and unsystematic procedures” to “strategically managed, policydriven, centrally co-ordinated systems”. Institutions have established a variety of structures to carry out quality assurance. These include dedicated Quality Assurance Units, and the integration of quality assurance functions into the responsibilities of larger units. For some universities, quality assurance is seen as part of new approach to strategic management, is supported by senior management, and is closely linked with strategic planning. Other universities are planning to take a strategic management approach, but currently rely on traditional approaches such as external examination and departmental reviews. It is widely accepted that self-evaluation should form the basis of institutional and national approaches to quality assurance, and that self-evaluation should be complemented by external validation. “Philosophy scores add to QAA criticism”, Times Higher Education Supplement, June 22 2001. D.J.Jacobs, “Quantum leads in quality assurance in higher education”. Bulletin: News for the Human Sciences, March 1999. Pretoria: Centre for Science Development. 11 Kathy Luckett and Piyushi Kotecha, “An analysis of institutional profiles: implications for building a national quality assurance system”. SAUVCA Occasional Publications and Reports 1. Pretoria, South African Universities’ Vice-Chancellors’ Association, 2000. 9 10 Quality Assurance at UCT/ 6 The primary focus of quality assurance is on teaching and learning, and is aimed at promoting the enhancement of student learning. In this approach, the main emphasis is on improvement and development, rather than on compliance. Three examples serve to illustrate the quality assurance processes that were in place at the time of the SAUVCA survey: University of Natal: Quality Assurance is part of the portfolio of the Senior Deputy Vice Chancellor, and quality assurance is supported and promoted at Executive level. The SDVC is supported by a Quality Promotion Unit, comprising a Manager, curriculum specialist, senior researcher, two evaluators and research and administrative assistants. Implementation is the responsibility of Deans, Heads of School and Heads of Division. University of Pretoria: Quality Assurance is run from the Vice-Chancellor’s Office, and rests on a system of departmental self-evaluation that began in 1993, and which was revised in 1999 (when all departments were required to undergo self-evaluation). Each Faculty has a committee for teaching, learning and quality assurance, and each department has an academic staff member who carries responsibility for quality assurance. Quality assurance is also extended to support departments. Rhodes: an extensive revision of quality assurance processes began in 1996, and led to joint Council and Senate committee for quality assurance in 1997, and the establishment of a Teaching and Learning Committee in the same year. Quality Assurance is the responsibility of the Vice-Principal. All academic departments are required to report their quality assurance processes to the Academic Planning Office Working from these local and international experiences of quality assurance, the approach we have taken in framing the recommendations that follow in this report is, firstly, to build on well established systems of accountability while, secondly, avoiding recourse to inspection regimes. This requires a tightrope act, particularly given the urgency of the Minister of Education for accountability by South African higher education institutions. It does, however, allow us to recognise that UCT has long had a range of quality assurance mechanisms in place that have the potential to work effectively. Rather than sweeping these aside, we should seek integration and co-ordination, identifying deficiencies and updating review mechanisms and developmental facilities to match the changing context in which the University operates. 1.3. The Policy Framework The foundation for current policy is the 1997 White Paper which gives quality as one of the fundamental principles that should guide the process of transforming higher education provision in South Africa. The Higher Education Act formalises this principle by making provision for quality assurance via the establishment of a Higher Education Quality Committee (HEQC) which will accredit programmes, audit institutions’ quality assurance mechanisms and promote quality.12 In turn, the HEQC 12 Education White Paper 3: A Programme for the Transformation of Higher Education; Higher Education Act. Quality Assurance at UCT/ 7 is an Education and Training Quality Assurance agency (ETQA) in terms of the South African Qualifications Authority legislation. The framework for the HEQC’s operations is envisaged as the formulation of criteria and procedures in consultation with higher education institutions, a formative notion of quality assurance, focused on improvement and development rather than punitive sanction, and a mix of institutional self-evaluation and external independent assessment. Pursuing these principles “means maintaining and applying academic and educational standards, both in the sense of specific expectations and requirements that should be complied with, and in the sense of ideals of excellence that should be aimed at. … Applying the principle of quality entails evaluating services and products against set standards, with a view to improvement, renewal or progress”.13 In keeping with the principle of institutional autonomy, the White Paper makes higher education institutions responsible for quality assurance. The HEQC, however, anticipates that it “will work in a consultative and co-operative mode … in the attempt to develop a principled consensual or negotiated approach to quality and quality development”. The HEQC notes that little attention has been given to teaching and learning, research, and community service in debates and discussions on higher education transformation. Thus its quality assurance framework will focus explicitly on “the quality of teaching and learning activities, research and community service”. 14 In pursuit of these goals, the HEQC will develop a quality assurance “framework [which] will include a developmental approach to the quality requirements of mission achievement where appropriate and affordable”. In accordance with the White Paper’s stipulation that primary responsibility for quality assurance rests with institutions, the HEQC will follow a ‘light-touch’ approach that relies strongly on self-evaluation within institutions. The HEQC will, however, be looking for the evidence of systematic and rigorous self-evaluation in order to accredit higher education providers. In the meantime, the HEQC envisages a developmental phase during which institutions should build the capacity of their internal quality assurance systems.15 In the light of this policy framework, the Quality Assurance Working Group has taken its lead from the HEQC’s Founding Document and its emphasis on “the quality of teaching and learning activities, research and community service”, to be understood through a methodology of critical self-evaluation. This is understood as a starting point – a founding emphasis on core activities which can evolve into a wider understanding quality assurance in a comprehensive sense. 13 Higher Education Quality Committee Founding Document, January 2001. Higher Education Quality Committee Founding Document, January 2001. 15 Higher Education Quality Committee Founding Document, January 2001. At the same time, a number of Sectoral Education and Training Authorities (SETAs), established by the South African Qualifications Authority (SAQA), have declared an interest in aspects of quality assurance in universities, and it is still to be established whether or not the HEQC will be the primary ETQA for Higher Education, or whether UCT will need to manage multiple, and sometimes simultaneous, quality assurance exercises by different agencies using varying criteria. 14 Quality Assurance at UCT/ 8 1.4. This Report In its review, the Quality Assurance Working Group focussed on two of the HEQC’s primary emphases, leaving the important area of quality assurance in research to the University Research Committee to develop in a parallel reporting process. The focus group that met to consider community service identified key parameters, but also recognised that UCT’s reconceptualization of its role in the local and regional community is still at an early stage. The finalisation of quality assurance indicators in this area must therefore wait on the work of the University Strategy Committee’s Project Group that is considering “outreach” in general. Consequently, this report focuses on teaching and learning activities, and closely related aspects of the University’s activities that are considered essential to the success of teaching and learning. In organising its enquiry into teaching and learning, the Working Group decided to focus on the “student career”. We reasoned that the most important indicators of quality would be those that related to the way in which undergraduate students are selected, criteria for the way they are taught, and benchmarks for the quality of their “learning environment”. Similar criteria can be established for postgraduate studies. A major emphasis – in common with approaches to quality assurance in other university systems – is on the necessary enabling conditions in which good teaching and learning can prosper. Discussions and decisions about the content of courses falls within the domain of professional accreditation agencies (where this is appropriate), Academic Programme Committees, academic departments, course convenors and individual lecturers.16 Considering the “student career” in this way led the Working Group to identify additional key areas which, in its view, are necessary conditions for the advancement of quality in teaching and learning. The first of these areas is assessment and evaluation, central to the certification of academic results and qualifications and to the accreditation of academic programmes. In an analogy likely to be unpopular because of its overtones, assessment and evaluation is quality control of the University’s products. The second area is the ongoing enhancement of academic staff. The centrality of academic staff enhancement to quality assurance follows logically from a developmental approach, and recognises the need to move beyond superficial indicators. The third area is the attainment of equity – a key consideration for UCT at this time in its history. 2. Selection and Education 2.1. Recruitment and Enrolment UCT is a selective university that enrols students on the basis of an evaluation of their potential to succeed in their studies. Because more than 90% of undergraduate students entering the university for the first time do so directly from high school – or after a brief interlude between school and university – the key indicator of this potential to succeed is the matriculation examination. Because South Africa still has a markedly uneven schooling system that bears the imprint of apartheid education This approach is consistent with the “whole course” philosophy to programmes design and accreditation, now established as legitimate within South Africa’s SAQA framework. 16 Quality Assurance at UCT/ 9 policies, UCT employs a range of techniques designed to identify a potential that has not been fully demonstrated in matriculation results as a consequence of educational disadvantage. Consequently, a key element in UCT’s system of quality assurance for teaching and learning will be our approach to undergraduate recruitment and enrolment. Sub-optimal performance in this area will have the consequence of enrolling students who do not have the potential to succeed, with deleterious consequences for them, and for the classes in which they enrol. In terms of current policy, UCT is committed to increasing its enrolment of international students, and to forging lasting international partnerships with other higher education institutions. The success of this policy will depend on effective quality assurance, particularly as international students have an increasing range of institutions from which to choose for study abroad programmes. Student recruitment is the responsibility of the Recruitment and Enrolment Management Office (REMO), which is in turn part of the Student Development and Services Department (SDSD) and, for international student enrolments, with the International Academic Programmes Office (IAPO). REMO works closely with other units in SDSD, namely the Undergraduate Funding Office (UFO) and the Student Housing Office (SHO). Once applications have been processed within REMO they are passed on to the relevant faculty, which makes the formal offer of an academic place. Throughout the process there is on going interaction between REMO, faculties, the UFO and SHO. This ensures that there is co-ordination with respect to an integrated offer: financial aid (for eligible students), a residence place as well as an academic place. In this way UCT attempts to balance equity and excellence by offering accommodation and financial aid to deserving students as well as to high achievers. In addition, the Alternative Admissions Research Project (AARP) has over many years developed tests which allow UCT to assess prospective applicants’ potential for successful university study in cases where the matriculation result is an unreliable predictor of success.17 The tests are voluntary, but students who feel that their Grade 11 and 12 results do not accurately reflect their abilities are strongly encouraged to take them. Longitudinal studies have demonstrated the validity of this approach, and it is now UCT policy that faculties offer an academic place to a student on the basis of AARP scores.18 There are good indications that UCT’s recruitment policies, coupled with placement testing, continue to result in the enrolment of appropriate annual cohorts of undergraduate students. Although the number of applications to UCT has dropped in recent years, for the most, enrolment targets have been met and, in some faculties, 17 The three tests are the Placement Test in English for Educational Purposes (PTEEP), the Mathematics Achievement Test and the Mathematics Comprehension Test. UCT’s policy in this regard is presented as follows to potential applicants for places: “if you score in the top 20% of all candidates of a similar school background, on either the Placement Test in English (for applicants to Humanities or Law) or all three tests (for applicants to all other Faculties) we will offer you a place to study in the Faculty concerned, excepting in the case of the Faculty of Health Sciences’ MBChB Programme, where this will be a strong recommendation. This offer will be subject to your achieving an exemption in your Senior Certificate examinations, and meeting the minimum requirements for admission for the particular programme. Please note that the offer of a place on the basis of your Alternative Admissions test results may be in an extended curriculum programme”. 18 Quality Assurance at UCT/ 10 exceeded. This is as a result of pro-active strategies to maintain enrolments. These strategies include professional marketing, increasing the number of financial aid packages and entrance merit scholarships, providing more residence places at entrylevel, improving security in the residences and other systems for student support, and greater co-ordination between REMO and faculties. An analysis of the 2001 admissions cycle conducted by the Institutional Information Unit has revealed that UCT continues to attract students mainly because of its academic reputation, geographic location, and the range of degrees and academic programmes on offer. Nevertheless, the Quality Assurance Working Group has identified a set of key issues which warrant attention, either because they present a risk to the maintenance of standards in recruitment and enrolment, or because there is the potential for increasing performance. These are: Unstable recruitment and enrolment policies: There is a sense that the goals as currently articulated in the Strategic Planning Framework are not clear. Faculties find it difficult to balance equity with excellence in their enrolment strategies, particularly in the face of the ongoing crisis in the schools. Uneven implementation of existing UCT policy. It is Senate policy (Principal’s Circular 10/2000) that applicants’ performance on the AARP tests should be taken into account in the admissions process. This policy is not adhered to in all faculties. Non-adherence to the policy might impact negatively on a faculty’s ability to meet its equity goals. The relationship between faculty admission criteria and departmental/programme sub-minima and sometimes confused. As with noncompliance with Senate’s policy on AARP results, entrance criteria for individual courses can be a barrier for students from a disadvantaged school background and can undermine UCT’s equity goals. Co-ordination between the SHO, UFO, faculties and REMO needs to be improved. This has been identified as a strategic priority but has not yet been realised in practice. Articulation between faculties and the various units which constitute the recruitment and enrolment strategy needs to be strengthened. Marketing UCT. There is no overall, institutional marketing plan, making a co-ordinated approach difficult Programme mix within faculties needs to be finalised timeously: REMO needs to know “what it is recruiting for”, and it is important for faculties to finalise their programmes before the second half of the academic year to allow sufficient time for advertising. Inadequate documentation: Faculties sometimes provide poor documentation for recruiters who visit schools, making effective recruitment difficult. Information for prospective students. While the new undergraduate prospectus is attractive and user-friendly, there is still information that is not available to prospective students in a form that is easy to understand (for example, UCT’s fee structure). In summary, undergraduate recruitment and enrolment – the first stage in the “student career” – benefits from a strong organisational structure. There is potential for improvement in the provision of information, the application of agreed policy and the co-ordination of different agencies within the university. These improvements will strengthen quality assurance in this area, and will allow for firmer benchmarks in our Quality Assurance at UCT/ 11 approach to selecting undergraduate students who have the potential to succeed at UCT. 2.2. Undergraduate Education 2.2.1. Dimensions of quality assurance in undergraduate education The current framework for quality assurance in undergraduate education is the Academic Planning Framework (APF), as adopted by Senate in March 1996. Among other things, the APF required the organisation of the curriculum as a set of academic programmes, each of which is under the aegis of an Academic Programme Committee. This policy was complemented by a “Framework Policy for Programme Convenors and Programme Committees” which provided for the review of student performance across programmes as well as on-going review of the programmes themselves. Subsequently, the implementation of the APF has been reviewed and modified at faculty level, and the role of Programme Convenors and Committees has recently been reviewed. Quality assurance in this area can usefully be considered as four dimensions: the “enabling environment” in which undergraduate education is situated the evaluation of academic programmes the review of students’ academic performance the evaluation of undergraduate teaching 2.2.2. The Enabling Environment The “enabling environment” can be understood as the full range of services, support activities and practices that facilitate good teaching and learning. Such provision encompasses the university residences, tutorial rooms and classrooms, information technology, other teaching technology, laboratories and studios, and library services. Effective teaching and learning also depends on fair and timeous decisions on student financial aid, the provision of health and counselling services for students, catering services and transport to and from – and between - campuses. The quality of this wide range of provisions is becoming more important as the difference between “residential” and “virtual” education sharpens, and as the government’s policy for a differentiated Higher Education system in South Africa takes effect: students (and staff) will expect, with justification, that UCT’s claim to be a leading residential university is matched by the qualities of its environment. Some approaches to quality assurance in higher education integrate indicators of such environmental factors along with indicators of academic performance.19 A notable example of this approach is the UK’s Teaching Quality Assessment, which includes ratings for the condition of classrooms and other features of the environment in a 2419 Total Quality Management (TQM) approaches have rarely been adopted in universities, and Brennan and Shah (2000:13) comment that “TQM may have had more impact on management rhetoric than it has had on academic practice”. There is more enthusiasm for TQM in the South African technikon sector and in SAQA, although it remains to be seen whether this can be translated into a code of practice that has any realistic prospect of meetings its goals. Quality Assurance at UCT/ 12 point system for reviews of teaching departments. This has proved controversial, and there is good evidence that such a method encourages superficial compliance. Applied in the UCT context, we would predict that this would become an exercise in frustration. It is widely acknowledged that UCT has fallen behind in the maintenance of buildings and the upgrading of teaching equipment, and it is common cause that the University Library has inadequate funds.20. An alternative approach to establishing acceptable quality standards for supporting teaching and learning is to rely on Service Level Agreements. Service Level Agreements were recommended by UCT’s AIMS project, and have been adopted as policy by Senate and Council. Such agreements, when fully instituted, will define the key support services that are required by the six faculties, establish the level at which these services should be provided, and allocate appropriate budgets. Policy for SLAs is set by a central Management Services Committee, which also deals with failures in service provision. In effect, this means that the Management Services Committee is a quality assurance agency charged with maintaining agreed standards for support services for teaching and learning. Using Service Level Agreements for quality assurance in this area – rather than simple performance indicators – should allow an approach in which the “enabling environment” is consistently approved with a sense of common purpose.21 In addition to such specific services and support activities are those less tangible aspects of institutional culture. In this regard, studies like that undertaken by Steyn and van Zyl into students’ perceptions sound an important warning. This report notes that culturally inflected and gendered assumptions operate in an unmarked, largely invisible manner to control the institutional culture. This does not necessarily reflect the intention to be exclusionary. Nevertheless, the power of the norm has the effect of creating deep-seated discomfort and alienation among students who do not fit the norm. While they may not always be able to articulate exactly what it is they experience, many black students have a general sense that the system does not really work for them … The discrepancy between the worlds which white and black students inhabit as they move through the university system was quite apparent. For some—mostly white—students ‘world class’ meant perpetuating European values. Many black students, by contrast, are critical of UCT’s whiteness and Eurocentricity, and see it as an institution caught in a time warp. Our provisions for quality assurance must take account of how issues of race, language, gender, sexual orientation, religion, or other dimensions of difference are 20 Maintenance failures and shortfalls in equipment renewal can largely be attributed to a combination of government underfunding and the prioritisation of student financial aid. The challenges of renewing library stock and maintaining periodical subscriptions are largely due to continuing problems in currency exchange. 21 Service Level Agreements are unlikely to address the problems of library provision, since these are driven by factors outside the University’s control. Quality Assurance in this area should remain a direct concern of the Executive Director of University Libraries, reporting on a regular basis to plenary Senate. Quality Assurance at UCT/ 13 reflected in, and impact on, our teaching and learning processes. These aspects of institutional culture are the appropriate area of responsibility for the Institutional Forum. 2.2.3. Programme evaluation UCT’s Academic Planning Framework makes provision for a range of controls over the quality of the Academic Programmes which, together, constitute the University’s curriculum. These controls include: Initial approval of academic programmes via Faculty Boards and Senate Regular re-accreditation of programmes by Faculty-level accreditation committees or their equivalent.22 Continual oversight of programme structure and content by Academic Programme Committees Where appropriate, interaction with, and accreditation by, professional bodies and councils Formal responsibility for academic programmes rests with Programme Convenors, who report to the Dean of the Faculty in which the programme is located.23 In addition, the South African Qualifications Authority (SAQA) will set programme review requirements as a condition of continuing accreditation of qualifications. Course components – the building blocks of academic programmes – are offered by UCT’s sixty-two academic departments. Each course is the responsibility of a Course Convenor, who reports to the Head of Department. Control of the quality of the curriculum at the course level is achieved by: Department-level consideration of course design and content, through regular departmental meetings Motivation for new courses, or for major changes in course content, via Dean’s Circulars (with Faculty debate and decision where called for) Review and moderation of course curricula, examination papers and examination results by external examiners, who report directly to the Dean of the Faculty, and to the Senior Deputy Vice Chancellor The formal consideration of examination results by Faculty Examination Committees Consideration of issues of policy by the Senate’s Examinations and Assessment Committee and, where appropriate, by plenary Senate. This system rests on the concept of checks and balances that diagnose problems and pass them – as necessary – upwards through a hierarchical system of responsibilities (Programme Convenors/Heads of Department --- Deans/Faculty Boards --- Senior Deputy Vice-Chancellor/Senate). 22 Faculties have varying systems of programme accreditation. In this report, references to accreditation committees are generic, allowing for Faculty-level variations. 23 The system of Academic Programme Committees has recently been reviewed, with the conclusion that the system specified in the Academic Planning Framework is in operation, although in a minimalist fashion in some cases. Quality Assurance at UCT/ 14 In considering the extent to which UCT’s system of programme evaluation can meet the requirements of an integrated quality assurance system, some areas for improvement and synchronization can be flagged: There is a need for a system of systematic review of Academic Programmes (this is discussed further in a later section of this report). Each Faculty Board should submit to Senate an annual consolidated report on the work of its programme accreditation committee (or equivalent committee). There should be a cycle of review of academic departments – also discussed later in this report The Examinations and Assessment Committee should review the effectiveness of the system of external examination, while maintaining the principle that external examination is central to UCT’s system of quality assurance. In addition to these formal mechanisms for academic programme and course review, Academic Programme Committees need to take account of more qualitative information that indicates programme quality. Here, student evaluations are of particular importance. There is a tendency for student evaluations to focus on in-class performance of lecturers and the evaluation of tutorials, assignments and reading materials is often not included in the evaluation. In addition, student evaluations are the responsibility of course convenors and the heads of academic departments, and summaries and analyses may not be passed regularly to programme convenors for the consideration of programme committees. In addition, the tradition of curriculum planning at the course level has had the inadvertent consequence of creating a fragmented learning experience for students. Programme committees need to plan and evaluate curricula more broadly—across whole programmes or majors—so as to ensure greater levels of coherence. A further dimension of the graduate output that is now receiving attention is that addressed by what is called the “co-curriculum” – the experiences and values that tend to be less planned, but which play a significant part in shaping the identity, motivation and orientation of students. In this regard, a key element of a quality undergraduate experience is the extent to which students are exposed to senior, experienced academic staff and their enthusiastic engagement with their disciplines and specialisms. Where large classes are a feature of a programme, these need to be complemented by small-group opportunities so as to ameliorate the alienation experienced by many (especially first-year) undergraduates. Motivation is critical to successful learning, and that such motivation is nurtured in sustained interaction between students and staff. Further, wherever possible, students at senior postgraduate levels should have the opportunity of engaging with practical and community-based issues as an integral part of the curriculum in ways that bring them into fruitful interaction with constituencies outside the university. These aspects of quality, although less tangible, are as important as formal performance indicators. Before the introduction of the Academic Planning Framework they were addressed (although not necessarily consistently) at the level of the academic department, and within a framework of strong disciplinary identity. The “double grid” of departmental and programmatic accountability which was introduced with the APF in 1998 renders responsibility for “on the ground” quality assurance Quality Assurance at UCT/ 15 more complex, and clear definition is necessary if we are to achieve the integrated system envisaged by the Higher Education Quality Committee. 2.2.4. Student academic performance The way in which the academic performance of students is monitored and certified has always been central to universities’ practices. More recently, increased concern with teaching at research universities such as UCT has directed attention to proactive measures that anticipate students’ developmental needs. This approach is endorsed in the Department of Education’s National Plan for Higher Education (NPHE), which seeks the mainstream integration of academic development in South African Higher Education, and which proposes a funding formula that will reward improvements in student progression and retention in academic programmes. The key agencies for student academic performance are the University’s Academic Programme Committees and academic departments. In a university that admits more than 3 500 new undergraduate students annually, there is an ever-present danger that student performance will be aggregated to the extent that individual needs are invisible, and that quality control will revert to generalised, retrospective, performance indicators that identify problems when it is too late to remedy them, and successes when the opportunity of generalisation has been lost. Although there is always likely to be a tension between ideal provisions and the consequence of large classes at first year undergraduate level, the Academic Planning Framework was designed to ensure that Academic Programme Committees can “see” the current performance of manageable groups of students, organised by their total curricula, course components and academic year. This process of continual oversight of student performance is a key element in UCT’s quality assurance system. Although the current review of Academic Programme Committees has concluded that the system envisaged in the APF is in operation, there is clearly an opportunity for improvement. One problem seems to be the lack of an organisational mechanism that ensures the “upward reporting” principle that is central to UCT’s existing quality assurance mechanisms. Although Academic Programme Committees are obliged to report regularly to Faculty-level accreditation committees, there is no routine procedure in place that requires Faculties, in their turn, to report upwards to the Senate level. This means that it is difficult for Senate to ensure, on an ongoing basis, that Academic Programme Committees are doing more than reporting formally, and there is a danger that the key developmental aspect of monitoring student academic performance will be lost, or degraded into narrow performance indicators. Consequently, it is proposed that each Dean of a Faculty should report annually to the Senate Executive Committee on the work of Academic Programme Committees in his or her Faculty. These reports should be staggered, to allow the Senate Executive Committee to reflect on, and debate, the report. In addition, the Dean of Higher Education Development (who has a representative on each Academic Programme Committee) should report annually to the Senate Executive Committee on crosscutting issues. As with programme evaluation, the monitoring of student academic performance rests on a double-grid defined by the University’s academic departments - which contribute Quality Assurance at UCT/ 16 courses for the curriculum - and Academic Programmes, which organise these courses into coherent curricula. In this system, academic departments play a key role in the area of student academic performance through assessing coursework, setting and marking examinations and recommending consolidated results to Faculty Examination Committees. Here, the principal means of quality assurance is UCT’s system of external examination. In its design, this is a comprehensive mechanism of checks and balances. External examiners are – rather obviously – external to UCT and, until recently, were usually drawn from universities outside the Western Cape. External Examiners are required to evaluate the curriculum as a whole, making an important contribution to programme evaluation (as noted in an earlier section of this report), and to moderate students’ academic performance by looking at at least 50% of work submitted.24 In practice, however, there are a number of difficulties with the system of external examination that need to be addressed. These include: The difficulty – largely as a result of budget reduction – in recruiting external examiners from outside the Western Cape The practice in some academic departments in using former UCT staff as external examiners, resulting in potential problems of objectivity A tendency to use the same external examiner for too long a period, again bringing objectivity into question The uneven quality of external examiners’ reports, some of which do little more than certify examination results The perception that some external examiners focus entirely on examination moderation, rather than looking at the quality of the course as a whole. These factors need to be taken into account in the review of the external examination system by the Examinations and Assessment Committee, proposed earlier in this report. It needs also to be noted that SAQA legislation requires the formal training and accreditation of assessors which (if it is not taken as meaning all academic staff) could propel a legislative requirement for a review of the external examination system. It is clearly a daunting task to implement a quality assurance system for student performance that is more than compliance-driven and retrospective in a university of UCT’s size and complexity. In each academic year, there are more than 50 000 individual assessments of student work – data that have the potential to reveal clear trends in student performance that allow effective interventions that can add to the quality of student learning.25 If implemented effectively, the double-grid of Academic Programme Committees and academic departments should allow for these large data sets to be handled in appropriately sized units. The need to disaggregate data on student performance to ensure effective quality assurance is particularly acute for the processes of readmission review. In recent years, UCT has carried out successful reforms to the readmission review system, moving from a single, central system to Faculty-based readmission review 24 On a sample basis for larger courses The current ISIS project, and consideration of appropriate data systems for managing coursework and examination results across the university, will make a key contribution to future quality assurance provisions. 25 Quality Assurance at UCT/ 17 committees. This decentralisation has allowed those closer to student performance in disciplinary areas to make judgements as to whether or not those students who have failed to meet minimum course and programme requirements have the potential to correct this situation, and to gain the qualifications for which they are registered. However, it is apparent that these reforms have yet to be completed. In particular, there is good evidence that potential readmission problems can be identified ahead of the crisis if data on student performance are “read” effectively by Academic Programme Committees. Yet, and as far as we can tell, few Academic Programme Committees work in partnership with Readmission Review Committees in a consistent, developmental manner. It is also clear that a student’s financial status has a key bearing on academic performance, and that there is insufficient articulation between the student financial aid system, Academic Programme Committees and Readmission Review Committees. In our view, the articulation of the readmission review system with the work of programme committees – and between Faculties – needs further attention to ensure effective quality assurance in this area. This will particularly be the case if a new funding formula for universities is introduced, since slow throughput and poor retention will be penalised. Considerations such as these all speak to the obligation of the University to provide an education that meets students’ legitimate expectations in the light of their abilities. However, a university is not a supermarket, stamping products with quality guarantees for consumer protection. Effective learning depends on a partnership between student and teacher, in which the student undertakes to meet – to the best of his or her abilities – the study requirements of a course or programme, and to participate fully in coursework, debates and discussions, fieldtrips, projects, examinations and other aspects of the curriculum. This partnership requirement is not self-evident in South African education, where the legacy of authoritarian instruction – what Paulo Frere would have called a “banking” approach – is still strong.26 The requirement for a partnered approach to student learning is recognised formally in the Academic Planning Framework, which notes that “students to varying degrees need teaching in order to learn, but progressively should learn to learn for themselves”. We believe that students’ responsibilities in this regard should be made explicit by means of a Student Charter, to which students subscribe as a condition of acceptance by the University. Such a Student Charter would give students the opportunity to design a code of conduct which spells out their role in the learning process. This proposal should be developed in conjunction with representative student A recent study has explored the attitudes of parents, teachers and learners in South Africa’s high school system. The report noted that teachers often dislike children in their classes asking questions. They believe that questions undermine order and authority in the classroom and distract from the task of teaching pupils the facts that they must learn. In focus group discussions, teachers could not remember the last time that a pupil had asked a question in class. “Values, Education and Democracy: Interim Research Report”. Commissioned by the Department of Education. Research consortium led by the WITS Education Policy Unit. 2001. 26 Quality Assurance at UCT/ 18 bodies, supported and co-ordinated by the Dean of Students, and should be brought to the Institutional Forum for discussion and recommendations to Council for decision.27 2.2.5. Undergraduate teaching The fourth dimension of quality assurance in undergraduate education is that of teaching. Again, this is a field in transition. Unlike other parts of the educational system, for which teachers are required to be professionally qualified (and in some cases registered) academic staff in universities do not have to have teaching qualifications (and few do). In earlier years, this was not considered important. Students were admitted to university in small numbers and from elite schools, and were expected to learn as much from their proximity to established scholars as from any pedagogic technique. The foundations of this osmosis approach to education have cracked with increased participation and the diversification of student enrolment, and with governmental concern (shared by a wide sector of civil society) for efficiency: a Higher Education system that focuses on the small sub-set of students who will pursue careers in academic research, and disregards the career needs of the majority that will leave the education system with a first qualification, cannot easily be seen as spending public money in a responsible way. As a consequence, considerable attention has been given to the professionalisation of educators in universities. One approach has been to argue for a formal qualification as an employment requirement in Higher Education, as in other levels of the education system. A counter argument is that the essence of good teaching in a research university such as UCT cannot be reduced to the curriculum of a postgraduate diploma. The position taken here is pragmatic. It would be impractical and counter-productive to require the re-qualification of UCT’s academic staff for the purposes of quality assurance. There also needs to be very careful consideration of any requirement that those entering university teaching as a career be required to gain a teaching qualification. Junior academic staff are often completing higher degrees, and face immense pressures to launch successful research programmes while teaching at the same time; it would be difficult for them to study successfully for a credible postgraduate qualification in higher education at the same time. However, in making a case against formal qualification as a quality assurance mechanism, we are mindful of the particular onus this places on us to maintain effective quality control measures that ensure a high standard in undergraduate teaching at UCT. This is particularly the case in the formally-differentiated Higher Education system that has now been signalled in the National Plan for Higher Education. UCT claims to be among the best universities in South Africa. Consequently, UCT must demonstrate this to the satisfaction of both government, and of society in general. The urgency of the need for secure and transparent quality assurance measures in teaching does not, however, mean that we should adopt a compliance-based approach in which attempts are made to enforce good teaching through inspections and check- Such a Student Charter will also allow a formal undertaking by students with regard to plagiarism – a growing problem in quality assurance systems for education, given the prevalence of digitally available information. 27 Quality Assurance at UCT/ 19 lists. There is good evidence from international practice that this does not work.28 It is preferable to find ways to reaffirm the primary task of lecturers by promoting and supporting good practice through opportunities for professional development and by strengthening the ways in which we acknowledge sound and innovative teaching practices. This developmental approach underpins our recommendations for quality assurance measures in this area. The foundation for quality assurance in teaching at UCT is the processes for academic staff recruitment and selection. UCT has a well-functioning system of recruitment, which requires external advertisement in all but exceptional cases, and of selection, which requires that all selection committees follow approved guidelines in their composition, and that membership is approved by the Senior Deputy Vice Chancellor. We have, though, been less consistent in the execution of current policy for promoting equity in academic staff appointments. All selection committees are required to consider ways in which candidates from “designated groups” can be found, and encouraged to apply, before a position is advertised. In practice, some selection committees only consider equity after they have short-listed candidates for appointment, and for the purposes of formal reporting. It is widely recognised (and acknowledged in UCT’s own tradition of research and practice in the field of equity) that such pro forma approaches can perpetuate the status quo by drawing candidates only from traditional recruitment pools. This aspect of quality assurance requires attention by the Equal Opportunity Office.29 Following recruitment and selection, continuing quality assurance for academic staff rests on the system of performance planning and review, set out in the Staff Manual. This is an explicitly developmental approach: “UCT seeks to provide academic staff with optimal opportunities for professional development and career advancement. To this end, opportunities are afforded annually to each member of the academic staff for planning and reviewing his/her performance with his/her Head of Department (HOD) and for discussing development issues.” 30 In summary, this system requires that: Each academic staff member plans his or her activities with the Head of Department, preferably on an annual basis for more junior members of staff, and at least every three years for established staff members. The Head of Department reviews each year a work portfolio or its equivalent, comparing this with the normal expectations of the department and the generic job description for the Faculty. The performance of all Heads of academic departments is reviewed annually by the Dean of the Faculty, and the performance of all Deans is reviewed annually by the Senior Deputy ViceChancellor. Again, the best evidence of failure is the United Kingdom’s system of teaching assessment, which has low credibility and high costs, and which has generated a lucrative consulting industry of avoidance techniques. 29 “Designated Groups” are specified in the Employment Equity Act, and UCT is required to specify its equity targets in its Employment Equity Plan. Under the provisional proposals for restructuring the Human Resources Management Department, the Equal Opportunity Office will report directly to the Office of the Vice-Chancellor. 30 “Performance Management Processes for Academic Staff”. http://www.uct.ac.za/depts/hrm/staffman/2-5-1.htm. 28 Quality Assurance at UCT/ 20 This review should cover the fields of research, administration and other activities – and also teaching. Areas of weakness should be identified and developmental strategies to address these weaknesses should be adopted. The outcomes of this review should be recorded so that expectations are clear both to the Head of Department and to the academic staff member. It should be noted that, although this performance review can be used in subsequent consideration of promotion, the periodic review is important in its own right, and applies to all academic staff, whether or not they wish to be considered for promotion. In its design, this represents a strong basis for quality assurance. However – and as with other aspects of quality assurance in this area – the system of performance review lacks an “upward reporting” mechanism to ensure that reviews are completed in the spirit of the policy. This weakness will present problems in reporting to the Higher Education Quality Committee, which can be expected to require evidence that our quality assurance system is working effectively. But it also reduces our capacity to respond to staff development needs in an effective way across the university as a whole. Without a facility to assemble a general view of academic staff strengths, aspirations and needs, it is difficult to put in place appropriate policies, or to allocate resources where they are needed. Teaching modes vary enormously across UCT, and include studio teaching in the creative and performing arts, large class lectures in the humanities and commerce, small tutorial groups in many fields, laboratory work in the sciences, construction projects in Engineering, the immersive experience of architecture, intensive fieldwork projects away from the campus and clinical work and internship in the Health Sciences. Academic staff in these areas have both professional development requirements and a broad pool of experience and creative ideas for the continual improvement in the quality of teaching. The lack of “upward reporting” of the outcomes of periodic reviews of acacdemic staff makes it difficult to translate such rich experiences into effective policies to promote improved practice.31 In effect then, and despite the provisions of the Staff Manual, our teaching practices (both good and bad) tend to be invisible for the purposes of our own reflective conversation within the institution. Our goal should be to make the creative and critical engagement with teaching and learning more visible in the institution, and to acknowledge and reward such work more effectively. In addition to the information that should come from the effective implementation of periodic reviews of academic staff are those requirements which, together, constitute the benchmark of basic acceptable practice. This benchmark is second nature to good teachers in UCT. Nevertheless, it is important that such basic acceptable practices are acknowledged and codified as part of our quality assurance system. They would include the following: The provision of clearly written course guides, setting out what is expected of students for the complete course, and available well in advance of the beginning of the course, to allow students adequate time to prepare. Lists of required and recommended reading for courses, in advance of the beginning of the course, and the provision of this material either in the The same arguments, of course, apply to the other outcomes of academic performance reviews – administrative work, extension work, research and other key activities. 31 Quality Assurance at UCT/ 21 University Library (in adequate numbers of copies) or in local bookshops (by timeous submission of reading lists). A clear and well designed system of assessment for the course, which sets out what is expected of a student, and the relative value of different coursework, test and examination components. Clear and consistent DP requirements for courses, consistently enforced. A fair and consist approach to hearing requests for concessions and remarking of assignments, and for leave of absence from lectures, tutorials and other class sessions. Adherence to an agreed and published timetable for lectures, tutorials and other teaching sessions, that respects the need of students to plan their class attendance and study time. Adherence to the scheduled times of classes, including prompt arrival, finishing on time, and cancelling a scheduled class only as a last resort The availability of lecturers and other teaching staff to meet with students, with advertised office hours. Return of work submitted for assessment within a reasonable period of time, and with adequate and appropriate comments and other forms of evaluation. Consistent marking of examination papers and, for large classes, effective moderation of examination marking by the lecturer concerned. As they stand, each of these basic acceptable practices require further definition and amplification. In line with the formative approach adopted throughout this report, this amplification is best carried out by educators themselves, rather than through an inspection-and-compliance regime. We recommend that this is accomplished by means of a Teaching Charter, drawn up by representatives of the Faculties and of the Academics’ Association. Any system of quality assurance that attempts to be developmental requires incentives and rewards. As Brennan and Shah note, “staff engage in quality assessment because they have to, whatever the enthusiasm or enthusiasm they may bring to the tasks or acquire in the process of carrying them out”.32 Such incentives and rewards are diverse. They include, of course, appropriate remuneration. But they also include recognition in a disciplinary field (leading to complex allegiances beyond the university), the respect of both students and peers, responsiveness of the institution to good practice and innovative ideas, the opportunity of contributing to societal goals, and the satisfaction that is gained from students’ successes. Such incentives and rewards constitute the motor of an effective quality assurance system, and the protection from decline into a set of superficial compliances. Again, the foundation of UCT’s system of recognition and reward for academic staff is defined in the Staff Manual. Performance assessment is based on – but is distinct from – the system of periodic reviews of academic staff described earlier. Staff members who consider themselves to be “high achievers” complete a self-assessment against a rating system: “Each Faculty has a framework for a rating system against which staff are ranked. These rating systems consist of a list of attributes in the areas of teaching, research and University contributions (including administration, professional contributions and extension work) by which levels of performance and 32 Brennan and Shah 2000: 88. Quality Assurance at UCT/ 22 achievement can be recognised. The list of attributes has been adapted by each Faculty to be appropriate to serve its particular needs. The rating system attempts to provide an objective set of criteria against which candidates are ranked and scored.”33 These self-assessments, along with the recommendations of Heads of Department and referees reports, are considered by a Faculty Merit Committee, which recommends ad hominem promotion or merit awards. In essence, then, this system is a combination of self-review and peer-review and part of the broad tradition of academic selfgovernance that defines the modern university. It is difficult to imagine a recognition system being based on anything other than peer review in a university. However, it also needs to be acknowledged that such systems tend to be seeped in strong concepts of an established order, and tend to be inherently conservative. A manifestation of this tendency has been a reluctance on the part of merit committees in research universities such as UCT to recognise the value of quality in teaching unless good teaching is matched or exceeded by a strong research record. It is lore in academic corridors that junior staff who concentrate on innovative teaching and neglect traditional measures of research will jeopardise their careers: whether this is true or not, such beliefs act as a brake on advances in educational approaches in higher education. Consequently, parallel incentives that valorise quality in teaching are important. Such parallel incentives are weakly developed at UCT. Senate confers six Distinguished Teacher Awards each year. However, this is a competitive system, rather than one that is criterion-determined. As a consequence, the DTA system “punishes” excellent teachers by means of a process that requires a very comprehensive review for all nominated candidates, and then declines to recognise the majority even if they meet criteria for recognition of merit.34 There have been various suggestions for modifying the recognition of high achievement in teaching, including Faculty-level awards, increasing the number of awards, and introducing new categories of recognition. It would seem appropriate for the Distinguished Teacher Award Committee to consider this issue,, and to bring recommendations for a revised system of recognising merit in teaching to Senate for consideration.35 2.3. Beyond graduation In addition to the proximate measures of quality in student recruitment and undergraduate education, many of which have been mentioned in earlier sections of this report, there are longer term factors which, together, constitute the key domain of the University’s general quality-by-reputation. Central to these is the employability and career success of our graduates. “Performance Assessment”. http://www.uct.ac.za/depts/hrm/staffman/2-5-1.htm. Most candidates for Distinguished Teacher Awards are nominated, although some applications are received. 35 One suggestion is that the number of Distinguished Teacher Awards should be restricted to one or two per year – maintaining a competitive element – and that additional, criterion-based awards for merit should be made, with no restriction on number. The value of this model is that it would provide a university-wide standard for the recognition of outstanding teaching that could then be used by Faculty Merit Committees in rewarding achievement in teaching via the remuneration system. 33 34 Quality Assurance at UCT/ 23 In this regard, systematic and regular destination studies are important for collecting information about graduate careers, and for feeding back intelligence about graduate requirements to those at the “chalk-face”. UCT currently conducts regular surveys at the point of graduation. But (and as acknowledged by the authors of these reports) these tell us comparatively little about what happens to our graduates. We have some systematic information from professional fields (where professional bodies collect the views of their members), but very little systematic knowledge of graduate destinations in the formative disciplines in the sciences and humanities. In addition, work in this field has shown that it is important to track graduate careers some years after graduation, since the “deep value” an educational qualification might only become fully apparent some time after leaving the university.36 Destination studies can be expensive to administer, because of the difficulty in attaining acceptable response rates. However, the results are likely to be worthwhile, and UCT has considerable potential capacity in this area through the newly constituted department of alumnae relations. 2.4. Postgraduate Education 2.4.1. Reviewing postgraduate studies A well-functioning postgraduate sector is central to UCT’s vision of being “an outstanding research and teaching university”. It is now recognised that more attention – and resources – needs to be given to this sector if this vision is to be met. For, although UCT has continued to attract excellent students at the postgraduate level, there are indications that this record will not automatically be retained. These concerns have been heightened by the National Plan for Higher Education, which has set targets for increasing postgraduate numbers in the sector as well as improving throughput. In recognition of these needs, the University Strategy Committee has convened a Project Group for Postgraduate Study. This Project Group has established several sub-groups to address each of the following areas: Planning and delivery of postgraduate programmes; Marketing and recruitment; Governance and Organization; Quality of life; Performance measure and evaluation. We anticipate that this work will lead to the URC introducing new quality assurance measures in the postgraduate area. The paragraphs that follow should be read in this light. 36 It is widely recognised that the baseline for effective destination studies should be patterns of employment five years after final graduation. Quality Assurance at UCT/ 24 2.4.2. Postgraduate recruitment and enrolment The Quality Assurance Working Group’s focus group that discussed issues in postgraduate studies concluded that there is a need for an institutionally co-ordinated approach to recruitment and enrolment in this area. This will increase as a need as UCT moves away from being a relatively closed postgraduate community, in which research students were mostly selected from undergraduate cohorts, and towards an open, international university, in which postgraduate students are actively recruited from all parts of the world. This will result in a number of issues of importance in postgraduate recruitment and enrolment, including: The recognition of previous educational qualifications from a more diverse range of educational institutions, and the evaluation of prospective students’ potential to succeed Responding to the needs of increasing numbers of foreign students who experience difficulty studying in English. The need to promote equity at the postgraduate level, working towards a representative demographic profile from which well qualified professionals – and future academic staff – can be appointed As with undergraduate admissions, there is a need for clarity about the roles of the various players in postgraduate recruitment and enrolment – of departments, Faculties, REMO, the Department of Research Development and the Postgraduate Scholarships Office, Student Housing, and the International Academic Programmes Office. 2.4.3. Postgraduate learning UCT has an enviable reputation for research, and many academic staff have won recognition for the quality of postgraduate supervision. But there are also indications that the quality of supervision is uneven. The Postgraduate Students’ Association reports that some students are unhappy with the guidance that they receive, and there have been cases where students, although registered, have not been allocated a supervisor, and other cases where a supervisor has left UCT without being replaced in this role. The Writing Centre has reported cases in which students have visited repeatedly in expectation of the support and guidance that would normally be expected in an academic department. There is also a growing recognition, at UCT and at universities in general, that effective guidance at the academic level requires more than just intellectual input. As the backgrounds of postgraduate students become more diverse, increased levels of support are necessary in the “life skills” of successful research activity. Taken together, this indicates the need for a focus on mentorship in general, and the enhancement of the ability of academic staff to provide such mentorship. In addition to supporting and strengthening thesis work – the traditional core of postgraduate study – account needs to be taken of the steady increase in postgraduate coursework. Although this has always been a component of the curriculum at UCT, Masters-level coursework programmes have proliferated in recent years, and there is some suggestion of doctoral degrees by coursework (a suggestion that attracts nearviolent responses in some cases). Postgraduate coursework requires broadly similar quality assurance measures as undergraduate programmes, although there will tend to Quality Assurance at UCT/ 25 be differences in forms of assessment and a greater need for integration across programmes of study as a whole. Care will also need to be taken that there are adequate resources available, as postgraduate coursework is usually more expensive than research by dissertation, and budget structures may not allow adequately for this. Finally, close attention needs to be given to the quality of life of postgraduate students. These provisions need to include adequate financial aid (where appropriate), suitable housing and social and recreational facilities that allow a community of scholarship to prosper. Such provisions are standard at the international institutions that UCT claims as its equivalence in quality. Given these concerns, it is proposed that UCT move to a system of formal agreements between postgraduate students and their supervisors. Such agreements have already been adopted at a number of South African universities, and set out expectations both of the supervisor (frequency of meetings, return time for draft work, levels of practical and financial support, intellectual property rights, etc), and of the research student (commitment to the research topic, participation in the life of the academic department, ethics and the avoidance of plagiarism, acquisition of additional skills, etc.). Such agreements serve to limit the general liability of a supervisor and of the university. Under present arrangements, the University has contractual obligations to students via their enrolment, and academic staff have contractual obligations to the University through their employment. Memoranda of understanding between postgraduate students and their supervisors “complete the triangle”, to the benefit of all parties. 2.4.4. Postgraduate Examination and Assessment UCT currently has a mixed system of examination and assessment for postgraduate studies. Postgraduate diplomas, Honours qualifications and Masters degrees are administered at the Faculty level, through appropriate committees and Faculty Examination Committees. Doctoral degrees (although not all doctorates) are administered centrally, and validated by the Doctoral Degrees Board, on which all Deans or their representatives sit. Financial support for postgraduate students is administered centrally, through the Postgraduate Scholarships Committee. It is clearly appropriate for the weight of postgraduate examination and assessment to rest with the Faculties. This is particularly the case given UCT’s Academic Planning Framework, which emphasises the connection between undergraduate and postgraduate study, requiring that undergraduate programmes provide well-signposted routes into postgraduate study. However, given the increasing concern with postgraduate retention and throughput across the university, there also seems a case for stronger, central, steering of policy in postgraduate study. In this regard, it is recommended that a new Senate-level committee be established – the University Board of Graduate Studies (UBGS). This new committee will be custodian of the quality of postgraduate study in the University as a whole, bringing reports and recommendations for Senate’s consideration. The Doctoral Degrees Board will continue as constituted, and will be accountable to the University Board of Graduate Studies. The Doctoral Degrees Board should be charged with drawing up terms of reference for the UBGS and bringing these to the Senate Executive Committee for consideration and recommendation to Senate and Council. Quality Assurance at UCT/ 26 3. A Quality Assurance System for UCT 3.1. A systemic approach This section of the report considers how these key aspects of quality assurance can be integrated into a Quality Assurance System that will meet both UCT’s internal requirements, and the requirements of the Higher Education Quality Committee. There are many examples of such systems, each of them coloured by the combination of institutional history, regulatory requirements and specific preferences. Three examples can serve to illustrate the range of possibilities. The University of Wales Cardiff (which is about the same size as UCT, and similarly structured) has a formal “Academic Quality System” which is derived from the institution’s strategic plan, and which applies to all academic departments. Full details of the system are specified in an Academic Quality System Manual. The system relies on the role of Senate, and of a number of key committees: the Standing Committee of Senate, the Graduate Research Board, the Research Committee, the Teaching and Learning Committee, Departmental Boards and the Board of Studies. The quality assurance role of these key committees is co-ordinated by an Academic Quality Assurance Committee. The system is given life by means of internal quality reviews, which are based on departmental self-evaluations and peer assessments. Internal quality reviews are conducted by panels that include external advisors, and which are appointed by the Vice-Chancellor on the advice of the Academic Quality Assurance Committee.37 Mexico has a long tradition of institutional autonomy, and this is reflected in quality assurance measures for its university system. The Universidad Autónoma Metropolitana (UAM) in Mexico City, a new university with some 40 000 students, undertakes internal quality assessment in an agreement with Mexico’s national quality assurance agency (Comisión Nacional de Evaluación de Educación Superior, or CONAEVA). Programme evaluation is a key element, and these evaluations are conducted by inter-institutional committees comprising academics and representatives of employers, professional associations and government. Reviews focus on the curriculum, and include direct interactions with those teaching on the programme, and with students. The review committees report on measures that will improve programme performance.38 Quality Assurance at Harvard is primarily the responsibility of the Board of Overseers, one leg of this university’s unique system of governance. The Board of Overseers comprises thirty members who are elected by Harvard’s graduates. One of its functions is to appoint visiting committees for every school and department in the university. Visiting committees are made up of members of the Board and academics from other institutions, look at all aspects of a department’s work (research, graduate and undergraduate teaching, science equipment, libraries and forward plans), and talk Christine Daniels, “Quality Assessment: Cardiff University of Wales, United Kingdom”. http://www.oecd.org/els/pdfs/EDSIMHEDOCA024.pdf 38 G Valenti and G Valera, “ Case study of Universidad Autónoma Metropolitana, Mexico”. http://www.oecd.org/els/edu/imhe 37 Quality Assurance at UCT/ 27 to academic staff and to students. Visits take place every two years, and reports are sent to the Dean and to the Board.39 3.2. The central role of reviews A feature of these examples of systemic approaches, and of all internal quality assurance systems at universities of a standard which UCT would consider an appropriate benchmark, is the regular review of all major units involved in teaching and learning. This is particularly the case when institutions are concerned about the invasiveness of reviews by national quality assurance agencies, and the danger of a culture of compliance which reduces quality assurance to a set of superficial indicators. Although this may at first appear to be a contradiction in terms, a consideration of the general principles and politics of quality assurance shows why this is the case. Without regular reviews driven from within universities, institutional self-appraisal will lack public credibility, forcing national quality assurance agencies, which are publicly accountable, to adopt more invasive approaches. Consequently, it is notable that, in challenging the role of Britain’s Quality Assurance Agency, University College London, the London School of Economics, and the Universities of Oxford, Cambridge, Edinburgh and Birmingham have not proposed abandoning quality assurance. They are rather proposing to establish a consortium within which quality assurance measures would be harmonised, and institutions within the consortium would validate one another’s academic programmes. In addition, the proposed consortium would work with international organisations to ensure an international standard.40 Similarly, although Neil Rudenstine, outgoing President of Harvard, can assert that any accreditation agency declining to accredit Harvard would itself lose credibility, it is notable that Harvard takes quality assurance through regular departmental review seriously. Given these considerations, what review system is appropriate to UCT’s specific needs – for its organisational structure, existing policy frameworks and institutional objectives? In seeking to address this question – perhaps the most important in this consideration of quality assurance at UCT – it is first important to be clear about the intended purposes of a review system.41 Brennan and Shah observe that there is often confusion here, even in well-established national and institutional systems. They note that intentions are often confused with outcomes, and that organisational actions (such as establishing committees for quality assurance) are often mistaken for educational consequences. This is compounded by the prevalent assumption that “improvement” Times Higher Education Supplement, May 4 2001; “The Harvard Guide”, www.news.harvard.edu/guide. For an example of a Board of Overseers visit to the University Library, see http://hul.harvard.edu/publications/library_notes/1296/articles/committee.html. 40 “Gang of five plans to escape QAA grip”. Times Higher Education Supplement, April 6 2001. 41 Brennan and Shah identify for sorts of “quality values” that structure approaches to quality assurance. These are traditional academic values (disciplinary focus, and the assumption that quality will follow from strong academic control), managerial values (procedures and structures, and the assumption that quality will follow from good management), pedagogic values(teaching skills and practices, and the assumption that quality will follow from effective delivery) and outcomes values (the assumption that quality will follow from a focus on the desired characteristics of graduates). 39 Quality Assurance at UCT/ 28 is a given, rather than a construct related to policies, politics and ideological positions.42 Firstly, it is apparent that the “double grid” of the Academic Planning Framework requires two sets of reviews: reviews of academic programmes, and reviews of academic departments. 43 Both sets of reviews require appropriate “organisational actions” that will ensure that processes are efficient and well supported, and do not impose additional burdens on academic staff or on support departments that are already fully committed. The intended educational consequences will be the attainment and maintenance of appropriate management systems for teaching and learning, and the promotion of an effective environment in which teaching and learning can prosper. The unifying objective will be to support and enhance the creative drive of academics as teachers, and to recognise and reward the commitment made by students as learners. The bottom line is quality interpreted through critical self-appraisal. In Finch’s words, “the whole of the academic enterprise depends on there being a reasonably clear collective understanding between academics in a given discipline that a particular piece of work counts as good and something else as less good. Without that collective understanding, academic disciplines really do not exist. Were that to disappear, the resulting intellectual anarchy would bring down the whole edifice, since there would be no reason at all why taxpayers should pay us to educate the young, nor why sponsors should pay us to conduct research”.44 Both acacdemic departments and Academic Programmes should be reviewed in five year cycles, organised so that reviews are staggered, and distributed between Faculties to ensure that indivisual work loads are appropriately spread. In many cases, Academic Programmes and Academic Departments are sufficiently distinct to require independent review cycles. But in other cases a substantial majority of courses and options constituting an Academic Programme are offered by a single academic department. In some cases again (particularly in the Faculties of Law, Engineering and the Built Environment and Health Sciences and Commerce) Academic Programmes are subject to periodic review by external professional bodies (which will be registered ETQAs in terms of the SAQA legislation). In theses cases, it is proposed that the Dean of the faculty concerned should have the discretion to combine departmental and programme reviews and, where appropriate, to amalgamate internal and external ETQA reviews. The intention in determining review cycles should be to achieve maximum efficiency and effectiveness, minimising administrative work, but adhering to the benchmark that every Academic Programme and Department should be subject to internal review in some form at least every five years. Brennan and Shah, 2000. The assumption that “improvement” is a given, rather than a concept that needs dissection and analysis, is certainly a feature of the rhetoric of quality assurance in South Africa, where “improvement” is usually taken as a synonym for “development”. 43 Periodic reviews of academic programmes are specified in the Academic Planning Framework, and are therefore part of current policy at UCT. Regular reviews of academic departments were conducted under the auspices of the former Academic Planning Committee, but have now fallen into abeyance. 44 J. Finch, “Power, legitimacy and academic standards”. In J. Brennan, P. de Vries, and R. Williams (eds), “Standards and Quality in Higher Education”, London, Jessica Kingsley, 1997: 152. 42 Quality Assurance at UCT/ 29 In contributing to this “clear collective understanding”, reviews of academic programmes will concentrate on the management of the curriculum. Among other things, academic programme review committees could be expected to explore: The ways in which a programme’s curriculum is managed, and whether its structure meets the generic requirements of the Academic Planning Framework Measures in place to ensure that student throughput and retention are not hampered by inappropriate bureaucracy The calibre of programme handbooks and information for students Whether the educational objectives of the programme are met The nature of the “enabling environment” (library resources, laboratory facilities, studio facilities, computer facilities etc); Programme governance, and whether the Academic Programme Committee is appropriately constituted, meets regularly and manages the programme in a consistent and effective manner The details of admission requirements, internal placement processes (where appropriate) and readmission review processes The nature of integrated assessment methods The articulation of undergraduate programmes with postgraduate courses of study Attention given to academic development requirements through extended curricula and other methods Career development for students within the programme, and the extent to which the professional requirements of graduates from the programme are met. Academic Programme Review Committees would include a member of the Academic Programme under review, a student who has experience of the programme, a member of UCT’s staff from another Faculty, a member from the Centre for Higher Education Development, and an academic from another university. Reviews of academic departments, while necessarily overlapping to some extent with academic programme reviews, will tend to have as their focus of attention the learning and teaching environment – the day-by-day quality of intellectual life in a department, and the ways in which this environment constitutes the quality of courses offered by the department, of research, and of community service. Here, the “desired outcomes” of a review could include: Ensuring that course descriptions and requirements are clearly specified, comprehensive, and available before the course begins Ensuring that course assessment is fair and appropriate, and clearly specified Ensuring that DP rules are unambiguous and consistently applied Ensuring that courses are fully taught by appropriately qualified staff who have been appointed via agreed selection procedures, and whose performance is reviewed annually Ensuring that student work is appropriately graded and returned timeously, and that examinations are consistently administered and appropriately moderated Ensuring that processes of external examination are appropriate, and that they are consistently applied Quality Assurance at UCT/ 30 Ensuring that each course has a student survey, that student surveys are appropriately reviewed within the department, and that issues raised are discussed and acted upon Similar intended outcomes of departmental reviews would be specified for research and for community service. Departmental review committees should include a member of the department under review, a Deputy Dean from the Faculty, a representative from another Faculty, and at least two academics from the same disciplinary field in other universities. There are many examples of the ways in which such programme and departmental reviews could be conducted: as already noted, universities of a standard at which UCT would expect to be placed have regular systems of reviews in place. For instance, Dutch universities collaborate with each other through the Association of Dutch Universities (VSNU) in an arrangement that is the equivalent of SAUVCA’s former Quality Promotion Unit. Each university’s academic programmes are regularly reviewed by means of:45 A self-analysis that covers the basic philosophy and purposes of the academic programme, the curriculum, student enrolments and completion rates, examples of student work, facilities and infrastructure, academic and support staff, and programme level methods of quality assurance. A review committee of four experts in the disciplinary area of the programme, an educational expert, and a student representative. Each member of the review committee evaluates the self-analysis documentation. A two-day visit by the review committee, which holds discussions with those responsible for the programme, students, and members of the Faculty Board under which the programme falls. At the end of the visit, the review committee presents an oral report to those with whom it has met. This is followed by a written report, to which those involved with the programme are invited to respond. The report, and the responses, is a public document. Departmental and academic programme reviews at UCT will be underpinned by the established system of external examination. It has been suggested earlier that the Examination and Assessment Committee should conduct a review of the role of external examiners. A prima facie impression is that this role is variable. Some external examiners look at the full range of courses that a department offers, all coursework requirements for the courses they are concerned with, the formal examination system, and other examples of student work. They write exemplary reports which constitute much of what a formal departmental review could be expected to achieve. Others do little more than moderate examination results, and write cursory reports that confirm internal examination processes, with minor adjustments. Other than in those cases where the curriculum of an academic programme is contained within a single academic department, external examiners to not review academic programmes, and do not have oversight of the student’s whole educational experience. It will be important that the external examination process be strengthened in order to ensure appropriate annual benchmarking activities for quality assurance across the university. 45 Brennan and Shah 2000: 62-63. Quality Assurance at UCT/ 31 There is always a danger that departmental and programme reviews degrade to compliance exercises, either honoured in a cursory manner or else geared for advocacy in a resource-hungry environment. This tendency can be avoided – to an extent – by appropriate guidelines: Reports should include both the conclusions of the review team, and also the responses to these conclusions from the academic department or programme under review Reviews should not be used as a means for determining basic resourcing of academic departments and programmes. Decisions as to appropriate staff/student ratios, the provision of teaching and research equipment and the size of departmental grants can be made using operational guidelines that are independent of periodic reviews. Decisions about minimum course and programme registrations are strategic and operational decisions that, in any case, need to be evaluated on a continual basis. Although departmental and programme reviews will obviously have an impact on resource allocation decisions, comparative experience has shown that, where “rewards” are narrowly linked to resource allocations, critical self-review is, rather understandably, diminished.46 Primary reporting should be to Faculty Boards. UCT’s governance system rests on the concept of collegiality. The composition of Faculties organises UCT’s range of disciplinary teaching and enquiry into broadly cognate clusters, which also serves to assemble the most appropriate groupings of expertise to discuss the outcomes and recommendations of reviews. Secondary reporting should be to the Senate Executive Committee, via the Dean of the Faculty. It will not be appropriate for the Senate Executive Committee to debate in detail each departmental or programme review. However, Deans should highlight principle points for consideration. Review reports should be generally available to the university community, via the Principal’s Circular and the intranet (following the principle of open governance adopted by Senate and Council). In addition, reviews of Academic Programmes and departments can be used to advantage, as opportunities for the unrealised potential of a department – or programme – to be demonstrated. The collegial nature of reviews, with academic staff from cognate disciplines and departments, allows strong departments to explore new areas of development, while upward reporting mechanisms allow departments and Academic Programme Committees to make the case for expanded enrolments, beneficial curriculum developments, increased resources and other assets. Quality assurance must continually create opportunities for change. It should represent a dynamic process in which new changes within teaching are expected, respected and allowed to develop, in the context of thorough evaluation and dissemination. It will be important that there are appropriate opportunities for staff development to support these processes. 3.3. Quality Assurance at UCT The combination of academic self-appraisal, regular reviews and internal quality assurance measures means that accountability for quality assurance in credible 46 Brennan and Shah 2000. Quality Assurance at UCT/ 32 systems will rest with a university’s principal academic body. Although a quality assurance committee may be responsible for co-ordinating the processes of quality assurance, it is difficult to see how such committees can have full accountability delegated to them (or to managerial quality promotion units) without the risk of either marginalizing quality assurance, or resorting to inspection regimes. In universities organised like UCT, this means that accountability for quality assurance must rest with Senate and with its Faculty Boards. Structures such as UCT’s Centre for Higher Education Development, Quality Assurance Working Group, Institutional Information Unit and Department of Research Development will provide expertise and assistance but they cannot, without risk, assume primary responsibility for the quality of teaching, learning and research in the university. This central role of Senate and the Faculty Boards is encapsulated in UCT’s enabling legislation. While the power to govern is vested in Council, Senate plays the key role in the academic affairs of the University: “the senate organises and controls the teaching, curricula, syllabuses, examinations and research of the University”. The Institutional Statute outlines the functions of a Faculty Board, including the provision that “The Faculty Board a) is responsible to the Senate for organising and controlling the teaching, curricula, syllabuses, examinations and research of the Faculty; b) must make proposals to the Senate for rules prescribing the requirements for each degree, diploma and certificate offered in the Faculty, including the requirements for admission and readmission”. 47 In turn, responsibility for giving effect to Senate policy, including quality assurance, rests with the University’s Executive. While the allocation of DVC portfolios is at the discretion of the Vice-Chancellor, it is probable that the primary responsibility for the day-by-day implementation of quality assurance will rest with the Senior Deputy Vice Chancellor, as the SDVC is accountable for teaching and learning in the university, and is the primary point of liaison between the Deans and the Office of the Vice Chancellor. Recognising the central role of Senate and the Faculty Boards in quality assurance allows, in turn, the identification of the key committees that can constitute a quality assurance system appropriate for UCT. From this, we can identify a cascade of key committees that, together with the role of individuals with executive responsibilities, constitute a Quality Assurance System appropriate for UCT. This system is set out in the table below. Accountability Council Domain General governance Agencies Senate Senate Academic sector Senate Executive Committee Senate Executive Committee Academic sector Quality Assurance Working Group 47 Activities Receives, and comments on, reports from Senate Acts on reports and recommendations from Senate Executive Committee Receives reports on quality assurance from the Quality Education White Paper 3, 1997;University of Cape Town (Private) Act, 1999; Institutional Statute Quality Assurance at UCT/ 33 Admissions Committee University Research Committee Executive Director of University Libraries Examination and Assessment Committee Distinguished Teacher Award Committee University Board of Graduate Studies Institutional Information Unit (Planning Department) Quality Assurance Working Group Academic sector Admissions Committee Faculty Boards Management Services Committee Institutional Forum Assurance Working Group, Admissions Committee, Examination and Assessment Committee, Distinguished Teacher Award Committee, University Board of Graduate Studies and Libraries. Makes recommendations for actions by Faculties (via Deans), and by Senate (via PC or plenary Senate). Receives summary reports of departmental and programme reviews from Deans Integrates, and works interactively with, Admissions Committee, Faculty Boards, Management Services Committee and Institutional Forum Brings recommendations to, and prepares reports for, Senate Executive Committee Senior Deputy Vice Chancellor Quality Assurance Senate Deans Dean of Higher Education Development Quality Assurance Executive Director, University Libraries Library services Quality Assurance Coordinator Quality Assurance Working Group University Libraries Working Group Director of Institutional Planning External reporting Planning Department Admissions Committee Recruitment and Enrolment Examinations and Assessment Committee Examinations and assessment systems Recruitment and Enrolment Management Office Department of Communication Marketing Undergraduate Financial Aid Student Housing Assessment and Evaluation Unit (CHED) Faculty Offices Faculty Examination Committees Faculty Boards Academic programmes Academic departments Academic Programme Committees Heads of Academic Accountable for overall design and implementation of quality assurance policies Responsible for bringing integrated quality assurance reports to Senate Executive Committee and Senate Reports directly to the Senate Executive Committee and Senate on quality assurance in University Libraries Responsible for external reporting to Department of Education and HEQC Annual admissions reviews Financial aid reports Longitudinal studies of placement test results Annual report to Senate Executive Committee Occasional reports Annual report to Senate Executive Committee Performance Reviews for Quality Assurance at UCT/ 34 Departments Faculty accreditation committees (or equivalent) Faculty Readmission Review Committees Faculty Merit Committees Review committees of academic departments and academic programmes Doctoral degrees office Postgraduate Scholarships Committee Faculty postgraduate committees academic staff Ad hominem promotion and recognition of merit Consideration of review committee reports on academic departments and academic programmes University Board of Graduate Studies Postgraduate studies Institutional Forum Institutional culture Basic acceptable practices for teaching Principles of student responsibilities Enabling environment, All support departments Service Level Agreements Academic staff recruitment and selection Equal Opportunity Office Staff Recruitment Office Recruit and select appropriately qualified academic staff Promote UCT’s employment equity plan Recognition of individual merit Annual awards Annual report to Senate Executive Committee Self evaluations of Research Units Management Services Committee Selection Committees for academic staff Distinguished Teacher Award Committee Teaching and learning University Research Committee Research Annual report to Senate Executive Committee Occasional reports Occasional reports Teaching Charter Students Charter Department of Research Development Three examples, related to different stages in the “student career”, illustrate how this system will work. In reviewing quality assurance in the domain of undergraduate recruitment and enrolment Senate, through the Senate Executive Committee, will consider an annual report from the Admissions Committee. In fulfilling this responsibility, the Admissions Committee will depend on information and an evaluation of admission trends from the Director of the Recruitment and Enrolment Management Office, reports from Faculties, and evaluations of the financial aid position from the Undergraduate Financial Aid Office and of student housing from the Student Development and Services Department. The Admissions Committee may also want to take into account reports from CHED’s Assessment and Evaluation Unit on admissions to extended curricula, and on the success in enrolling students through alternative admission routes, and from the Executive Director of Communication, on co-ordinated marketing strategies in support of recruitment and enrolment. In reviewing quality assurance in the domain of undergraduate education Senate, again through the intermediary stage of the Senate Executive, will be concerned with reviews of academic programmes and academic departments (and reports from Faculty accreditation committees or their equivalents), the Quality Assurance at UCT/ 35 validity and reliability of assessment (with reports from the Examination and Assessment Committee) the quality of teaching (with reports from the Distinguished Teacher Award Committee and Faculty Merit Committees), the processes of selecting academic staff (with reports from the Equal Opportunity Office) and the general enabling environment in which teaching and learning takes place (with reports from the Institutional Forum, the Management Services Committee and the Executive Director of University Libraries). In reviewing quality assurance in postgraduate studies, Senate will receive inputs from the University Board of Graduate Studies, the Postgraduate Scholarships Committee, Faculty postgraduate committees and the University Research Committee. These examples also highlight the role of the Quality Assurance Working Group (QAWG). In common with other working groups (as established by the Organisational Design and Governance proposals adopted by Senate in 2000), QAWG is not a committee with formally delegated authority and responsibilities. It rather serves to add value to the work of such committees – in this case, the Senate Executive Committee and the key committees working in the area of quality assurance, listed above. It will readily be apparent that the Senate Executive Committee will not have the capacity to pull together the many strands of information that together constitute Senate-level reports of the kind given in the examples above. This co-ordinating function is performed by QAWG, which has the following responsibilities: To pull together information from different parts of the quality assurance system, preparing consolidated reports and appropriate recommendations for consideration by Senate, via the Senate Executive Committee. To respond to issues that arise from Senate’s consideration of quality assurance reports, adding value on its own account, and bringing matters to the attention of appropriate committees when this is necessary. Advising the Senate Executive Committee on the effectiveness of UCT’s quality assurance system as a whole, taking into account both UCT’s internal developmental need, and the University’s external reporting obligations. Providing the Director of Institutional Planning with information to include in UCT’s reports to the Higher Education Quality Committee. This quality assurance system is illustrated in the diagram below. Quality Assurance at UCT/ 36 Admissions Committee Examinations and Assessment Committee Institutional Forum University Research Committee University Board of Graduate Studies Senate/ Senate Executive Committee Faculty Boards Management Services Committee Distinguished Teacher Award Committee A Quality Assurance System for UCT 4. Recommendations As set out at the beginning of this report, our intention in designing an effective Quality Assurance System for UCT has been to meet the requirements that we anticipate from the Higher Education Quality Committee through strengthening and streamlining our existing practices. The following recommendations set out those actions that we believe will be necessary in achieving these goals. Organisational measures One. Senate should be asked to adopt a defined Quality Assurance System for UCT. Responsibility for the effective operation of the Quality Assurance System should rest with the Senate Executive Committee, supported by the Quality Assurance Working Group. Responsibility for complying with the reporting requirements of the Higher Education Quality Committee should rest with the Director of Institutional Planning. The Centre for Higher Education Development, though the Quality Assurance Co-ordinator, should be responsible for producing, and periodically updating, a Quality Assurance System Manual, which will be available to the university community via the UCT web page. Overall accountability for the effective implementation of quality assurance should rest with the Senior Deputy Vice Chancellor. Two. Student government, in consultation with (and with the support of) the Dean of Students, should draw up a Student Charter for consideration by the Institutional Forum and recommendation to Council. Three. A Project Group comprising representatives of the Faculties and the Academics Association should draw up a Teaching Charter which sets out basic acceptable standards as a benchmark for teaching practices, and Quality Assurance at UCT/ 37 Four. Five. Six. Seven. Eight. which replaces the existing “standard minimum expectations” in the Generic Job Description for academic staff. Academic Programmes and academic departments should be reviewed every five years, and the terms of reference for reviews should be agreed by the Senate Executive Committee. Where the substantive part of an Academic Programme is offered by a single Academic Programme, the Dean of the Faculty in which the department is located should have the discretion of combining the departmental and programme reviews as a single review. Where Academic Programmes are also subject to external accreditation by recognized ETQAs, internal reviews should be coordinated with external reviews to avoid duplication of processes. The guiding principle in coordinating review processes in the interests of efficiency should be that all UCT Academic Programmes should be internally reviewed (whether independently or as part of combined reviews) in a five year cycle. Reviews should by asynchronous in order to achieve equitable workloads for academic and administrative staff involved. A new committee of Senate – the University Board of Graduate Studies – should be established, with responsibility for university-wide policies and practices in postgraduate education. The present Doctoral Degrees Board should continue, and should be accountable to the University Board of Graduate Studies. The DDB should draft terms of reference for the University Board of Graduate Studies, for consideration by the Senate Executive Committee for recommendation to Senate and Council. The Distinguished Teacher Award Committee should be asked to develop a two-tier system of recognising merit in teaching – retaining and strengthening the present system of Distinguished Teacher Awards – and to bring forward recommendations for consideration by Senate. The Planning Department should conduct regular destination studies of UCT graduates across all faculties, reporting to Deans and to the Senate Executive Committee, and working in conjunction with the Career Development Programme. There should be a statement of the respective rights of graduate students and their supervisors, and the relationship between them.. The form of such a statement should be flexible to accommodate the varying needs of disciplines, and should be approved by the University Board of Graduate Studies. New reporting responsibilities Nine. Each Faculty should report annually to Senate, via the Senate Executive Committee, a report on the activities and decisions of its Faculty acceditation committee (or equivalent committee). Ten. Each Faculty should report annually to Senate, via the Senate Executive Committee, a report on the work of its Academic Programme Committees. Eleven. The Dean of Higher Education Development should report annually to Senate, via the Senate Executive Committee, on general educational issues related to academic programmes. Twelve. Deans should report annually to the Senate Executive Committee on the outcomes of reviews for all academic staff in their faculties, and on the work and decisions of Merit Committees in their faculties. Quality Assurance at UCT/ 38 Revisions of existing policies and practices Thirteen. The Examination and Assessment Committee should review the present system of external examination, within a policy the recognises external examination as a key element of the university’s system of quality assurance. Fourteen. The Admissions Committee should review UCT’s admissions policies, and bring recommendations to the Senate Executive Committee that will stabilise admissions policies within current policy guidelines. Fifteen. Faculty admissions staff should be required by Deans to follow current admissions policy consistently, including agreed Senate policy for alternative admissions. Adherence to admissions policies should be monitored by the Recruitment and Enrolment Management Office (REMO), reporting to the Senate Executive Committee via the Admissions Committee. Sixteen. The Director the Recruitment and Enrolment Management Office should draw up guidelines for Faculty admission staff that set benchmarks for programme documentation and the specification of programme admission requirements and sub-minima requirements, and give deadlines for the finalisation of changes to academic programmes, allowing recruitment to proceed with accurate information. Seventeen. The Dean of Students should give attention to the co-ordination of the activities of the Recruitment and Enrolment Management Office, the Undergraduate Financial Aid Office and Student Housing Eighteen. The Executive Director of Communication and Marketing, in conjunction with the Director of REMO and Faculty Officers, should draw up a coordinated marketing strategy to support student recruitment and enrolment at both the undergraduate and the postgraduate levels. Nineteen. The Equal Opportunity Office should establish the extent to which agreed employment equity policies are being put into practice by staff selection committees, and should report to the Vice-Chancellor. So what is “quality” , and can the dilemma of mental cogs that find no traction be resolved? We have suggested in this report that quality assurance in higher education should be the measure of what we do, and the extent to which our practices in teaching and learning, research, and community service meet the expectations that we set for ourselves.