College of Humanities and Social Sciences

advertisement
CHSS Quality Report for 2005-6
College of Humanities and Social Sciences
College Quality Assurance and Enhancement Committee (CQAEC)
Report to Senatus Quality Assurance and Enhancement Committee
(SQAEC) for 2005-06
1. Summary
The report details the Quality Assurance and Enhancement procedures employed
within the College and how they have been implemented in 2005-06. This covers
monitoring by Schools of about 1290 UG courses and over 200 UG programmes, and
about 100 PGT programmes, as well as programmes and courses in the Office of
Lifelong Learning (OLL) (see below). The report also covers the QAE monitoring
arrangements of Edinburgh College of Art (eca). The report is based on CQAEC’s
review of the annual QAE reports submitted to the College by the Schools within the
College, by OLL, and by eca. The report also takes account of External Examiners’
reports, external reviews and accreditations of programmes including Teaching
Programmes Reviews. It provides the opportunity to share information and good
practice, and thereby to enhance the quality of learning and teaching in the College.
In general it is clear that Schools have broadly appropriate QAE procedures in place
in line with College QAE requirements. There is evidence of improvements over the
past year in relation to some Schools’ QAE procedures, though there are some areas
where Schools need to make further progress (for example, in relation to the
monitoring of postgraduate taught provision). The majority of the issues raised by
Schools in their reports have been raised in previous years, and the College has been
addressing them. Several new issues have emerged (for example, issues regarding the
introduction of the Extended Common Marking Scheme).
2. Aims and Objectives
This report indicates the extent to which Schools within the College have Quality
Assurance and Enhancement procedures that can be said to be appropriate,
comprehensive and effective, and the extent to which the relevant material and
statistics have been returned.
It also provides the opportunity to acknowledge and share good practice, and to aid
the College in its review of quality assurance and enhancement procedures. It
identifies any issues and trends arising from School QAE reports, especially those that
might have wider bearing for teaching across the College as well as within any
particular School. The report also aims to identify any generic problems with
undergraduate or postgraduate teaching, so that the College can consider how best to
support the Schools in addressing them.
Page 1 of 60
CHSS Quality Report for 2005-6
3. College Quality Assurance and Enhancement Procedures
Responsibility for the implementation of Quality Assurance and Enhancement is
devolved to Schools and is overseen by the College Quality Assurance and
Enhancement Committee (CQAEC) through the Schools’ annual QAE reports.
Each year the College sets out the requirements for Schools’ QAE reports in a
guidance document, which is agreed with CQAEC and published on the College
intranet. In summer 2006 the College, in consultation with School representatives,
reviewed its guidelines to Schools. CQAEC agreed the revised guidance at its meeting
on 13 November 2006. In most respects the draft guidance is similar to that which
applied for reporting on 2004-05. The main change is that the College has revised the
aspects of guidance that relate to course and programme monitoring, and the
production of statistics, and provided guidance regarding the length of reports. Full
details of the College procedures are available at:
http://www.intra.hss.ed.ac.uk/Academic/QA/index.html
3.1 Procedures for reviewing School QAE reports
Each annual QAE report is reviewed by the CQAEC, both through focussed subgroup
meetings and through a main meeting of CQAEC. As part of this process, a member
of CQAEC is allocated as lead reviewer for each School report, as well as for the
reports of OLL and eca. The lead reviewer identifies areas of good practice for
dissemination within the College and any concerns arising out of the report. CQAEC
then discusses these issues, and sets out specific and general issues arising from
School reports in this report.
To date, the Committee has allocated each School a different lead reviewer to the one
allocated the previous year. The Committee has identified the benefit of enabling lead
reviewers to develop a greater awareness of how the Schools they are reviewing have
developed their QAE reporting process over previous years. The College will
therefore, where possible, allocate the same lead reviewer to a School for two
consecutive years. The College will also provide lead reviewers with a note setting
out the main points from the previous year’s review of the School.
3.2 Location of responsibility for QAE within Schools
The majority of Schools in CHSS now have well-established structures of
responsibility for QAE issues, and do not have immediate plans to make substantial
changes. However, it is clear from their QAE reports that four Schools (ACE, Health
in Social Science, Education, and, to a lesser extent, History and Classics) are still
reflecting on how best to organise their QAE structures. For several of the Schools,
one of the key issues is whether to integrate QAE responsibilities more fully with
wider responsibilities for the management of teaching (for example, by reporting on
QAE issues through a Teaching Committee rather than a separate QAE Committee).
For three of these Schools (ACE, Health, and History and Classics), the question of
QAE arrangements is directly related to the intention of increasing the integration of
teaching across diverse subject areas.
Page 2 of 60
CHSS Quality Report for 2005-6
In the current session there were some issues regarding some Schools achieving
continuity of representation on the CQAEC Committee in 2006-07 as a result of staff
sabbaticals. It is important for Schools to have continuity of representation, in order
that their representatives can participate fully in the process of peer reviewing of
School QAE reports and in the activities of the Committee more generally. Whilst the
School representatives have performed admirably under the circumstances, the
College will encourage Schools to as far as possible nominate the same QAE
representative for the full year, and over a number of years.
3.3 Course and Programme Monitoring
The College has well established procedures for course monitoring based on standard
templates. eca and OLL have not yet wholly aligned themselves with CHSS’s course
monitoring procedures (see sections 4 and 5 below).
From School QAE reports, it is clear that a high proportion of CMFs have been
completed and returned to Schools, with half of Schools obtaining CMFs for all
courses. In general Schools have obtained a higher proportion of CMFs than they did
in 2004-05, with notable improvements in several Schools. Health in Social Science
has successfully incorporated new subject areas into the College’s course monitoring
procedures, though they did not manage to obtain all CMFs in one subject area.
History and Classics has improved its CMF collection rates in History as a result of
appointing QAE representatives for the subject area. Where Schools have not
achieved full returns, reasons include difficulties associated with the AUT industrial
action, and requests for CMFs not being issued sufficiently early in the year. Schools
which have not achieved full CMF return rates have provided evidence that they have
plans to improve the situation. In some Schools course monitoring procedures are not
yet running as systematically for PGT courses as they are for UG courses, though
several Schools have improved their course monitoring systems for PGT courses over
the past year. The Committee will closely monitor progress on this, particularly given
the College’s plans to further expand PGT student numbers.
Two Schools (Law, and PPLS) use course audit files to collate and collect the
information required for QAE purposes, and to systematically monitor progress from
year to year. This is an excellent practice, and the Committee encourages other
Schools to adopt it.
In 2005-06 the College for the first time asked Schools to extend course monitoring to
include the taught element of postgraduate research degrees. One School (Social and
Political Studies) has made good progress in relation to this. The Committee will
continue to reinforce the need for monitoring the taught elements of PGR degrees.
The College asks Schools to conduct annual programme monitoring for all their UG
and PGT programmes. In addition to reflecting on statistics at programme level (see
below), there is evidence of particularly good practices in some Schools regarding the
use of questionnaires, focus groups and open forums as mechanisms for reviewing
learning and teaching at programme level. However, there are further opportunities
for Schools to monitor their provision at programme level, and the Committee
encourages Schools to extend their programme monitoring activities.
Page 3 of 60
CHSS Quality Report for 2005-6
3.4 Presentation and analysis of statistics
As part of the 2004-05 QAE review process, some School QAE representatives
sought clarification regarding what statistics should be presented in School QAE
reports, how these statistics should be presented to aid analysis, and what questions
School representatives should be asking in relation to the statistics. In response to this,
for the 2005-06 review process the College substantially revised the aspects of
guidance that relate to course and programme monitoring, and the production of
statistics.
The majority of Schools have taken into account this guidance and improved the
coverage and presentation of statistics in their reports and the level of reflection on the
statistics, though there remains room for further improvement, particularly in relation
to several Schools. The Committee will closely review Schools’ progress in this area,
and provide further guidance and examples of good practices where this will assist
Schools.
This year the College worked with Registry to provide Schools with standard
information on joint degree outcomes, since some Schools have found it difficult to
collate this information in relation to joint degrees for which they are not the lead
School. This has assisted Schools in presenting this information in their QAE reports.
There are considerable advantages to Schools taking a standardised approach to
statistics on course and programme outcomes more generally, and College plans to
explore with Registry whether it can provide statistics to Schools to meet all their
requirements for the annual quality reporting process. This will however require the
Committee to agree more precisely the statistics it would require, since Registry is
unlikely to be able to take a different approach for each School. Several Schools have
had difficulties producing statistics in line with the Extended Common Marking
Scheme, since DACS reports on course results do not break the A grade into
A1/A2/A3. As part of discussions regarding the provision of statistics, the College
will explore with Registry whether it can provide data fully in line with the ECMS.
The Committee anticipates that the EUCLID system, when implemented, will assist in
providing data for QAE monitoring purposes.
3.5 Student feedback questionnaires
The majority of School QAE reports reflect on alternative approaches to student
feedback questionnaires, with some Schools experimenting with online questionnaires
or machine-readable paper questionnaires. It is clear from School reports, and
discussion with School QAE representatives, that Schools would welcome the
opportunity to debate at College level the objectives of using student questionnaires
and the advantages and disadvantages of different approaches. CQAEC had an initial
discussion of this issue at its meeting in March 2007, as a first stage of its plans for
wider debate regarding student engagement with QAE processes in the College. This
discussion helped to clarify some important issues regarding student feedback
questionnaires, and identified some good practices in Schools. The Committee plans
to discuss the issue further at a future meeting.
Page 4 of 60
CHSS Quality Report for 2005-6
4.
eca
The Memorandum of Agreement (MoA) between the University of Edinburgh and
eca for the accreditation of eca awards by the University came into force in 2004-05.
The eca/ University Accreditation Committee monitors the operation of the
Memorandum of Agreement (MoA). In its second report (July 2006), it found that eca
has mature and effective processes for assuring the quality of its academic provision
and maintaining appropriate standards for degree programmes, that eca appears
committed to taking a systematic approach to quality enhancement, and that overall
the eca and the University of Edinburgh have so far managed the accreditation
arrangement effectively. The Accreditation Committee next meets in June 2007.
Under the Memorandum of Agreement (MoA), eca is required to provide CHSS with
an annual QAE report which as far as practicable is aligned to the University’s and
CHSS’s QAE procedures. This is the second year that eca has provided CHSS with an
annual QAE report under the Memorandum. As reported in CQAEC’s last report, in
many respects eca’s quality reporting format is already aligned with CHSS’s quality
reporting guidelines. The main area of current divergence is that CHSS expects
monitoring to occur at the level of the course as well as the programme, whereas eca
monitors solely at programme level (through its Annual Programme Monitoring and
Review, APMR, processes). The Accreditation Committee has discussed the
possibility that over time eca will become more closely aligned with CHSS’s
requirements. In particular, eca could plan to pilot monitoring at individual module /
course level (whilst retaining monitoring at programme level) within one School in
2007-08, with a view to introducing this across all of eca. The Accreditation
Committee will discuss this at its next meeting. eca has signalled that it will confirm
at that meeting that monitoring down to module level is inappropriate for a nonmodular studio based structure.
5.
Office of Lifelong Learning
OLL became part of CHSS during 2004-05 and as a result became subject to CHSS’s
quality procedures. The nature of OLL’s work differentiates it from other CHSS
Schools but many of its procedures echo those currently employed by CHSS. It does
not currently use Course Monitoring Forms, though it has other processes in place for
monitoring at course level, and does not apply student questionnaires for all courses
every year, though there are mechanisms for student feedback. CHSS is encouraging
OLL to move towards closer alignment with these aspects of CHSS requirements and
OLL is developing appropriate procedures for 2006-07, on which it has been asked to
report in 2007-08.
6.
QAE arrangements for Continuing Professional Development provision
The College offers a considerable amount of Continuing Professional Development
(CPD) provision. OLL is responsible for coordinating and marketing some of this, and
the School of Education is also a major provider of CPD. Appropriate QAE
arrangements should be in place for monitoring CPD courses, in particular where they
are for-credit. The College raised this issue at the SQAEC meeting in February 2007,
and plans to work with relevant areas of the College to develop appropriate QAE
arrangements, where they are not already in place.
Page 5 of 60
CHSS Quality Report for 2005-6
7.
Programme Review
Teaching Programme Reviews
The CQAEC report on 2005-06 indicated that Schools had not yet submitted formal
responses for the following TPRs that took place in 2004-05: Nursing; Asian Studies;
European Languages and Cultures (including Celtic); and Islamic and Middle Eastern
Studies. The Schools have now provided formal responses to all these TPRs.
The following TPRs took place in 2005-06 in CHSS:





Community Education
English Language
English Literature
Social Anthropology
Sociology
Schools have provided formal responses in relation to all these TPRs except English
Language. This represents a substantial improvement on the previous year in terms of
the time involved in closing this part of the quality loop. These formal responses are
attached as appendices. We have encouraged PPLS to submit a formal response to the
English Language TPR.
The following specific issues arose from the 2005-06 TPRs: research links and
research training; student feedback on courses and programmes; and postgraduate
tutors and demonstrators. The themes of research links and research training are
important elements of the CHSS L&T Strategy (see below). CQAEC has addressed
student feedback in 3.5 above. School QAE reports identify some good practice in
relation to support and development for postgraduate tutors and demonstrators. For
example, SPS produces a Tutor’s Manual, and provides induction and on-going
feedback and training. LLC and History and Classics also identify good practices.
CQAEC considered the outcomes of the 2005-06 TPRs at its meeting on 6 March
2007. In line with the arrangements following the review of the TPR process, which
recommended that the College UG Studies Committee also consider TPR reports,
CUGSC will be considering the outcomes at its meeting on 26 April 2007.
Quinquennial Reviews
The CQAEC report on 2005-06 indicated that the College had not yet received formal
responses for the QQRs of Divinity (2004-05) and Law (2003-04). The Schools have
now submitted these reports.
The following Quinquennial Reviews of postgraduate programmes were held in 200506:


Arts, Culture and Environment
Management School and Economics
Page 6 of 60
CHSS Quality Report for 2005-6
MSE has submitted a formal response to the QQR. ACE has not yet done so yet.
Professional and Statutory Body Reviews
The following external bodies accredited programmes in the College in 2005-06:

Architects Registration Board (ARB) and the Royal Institute of British
Architects (RIBA) reviewed the MA (Hons) in Architectural Design and the
Master of Architecture (Design).
The College has informed CQAEC of the positive outcome of each of these
accreditations, and of the schedule of Professional and Statutory Body reviews in
2006-07 and later.
8.
External Examiners
The procedures for dealing with undergraduate external examiners’ reports are as
follows:






External Examiners send their reports directly to the Head of College.
The Associate Dean (QAE) reads and acknowledges reports on behalf of the Head
of College.
The Associate Dean (QAE) marks up the reports with starred points requiring
responses or actions, and forwards them to the relevant Head of School.
Schools respond directly to the External Examiner with copies to the Associate
Dean (QAE). (Heads of Schools may delegate this task to a member of staff with
an appropriate remit within the School.)
The Associate Dean (QAE) provides Heads of Schools with more detailed
analyses of the External Examiners Reports, and produces a College report on
External Examiners Reports for the Head of College and University Director of
Quality Assurance and Enhancement. This report identifies themes and issues
within the College which may require actions. The element of the report that
identify themes and issues is attached as Appendix 3.
Through the annual QAE reporting process, Schools indicate any relevant Schoolwide issues arising out of the external examining process, and confirm that
appropriate action is being taken in response to all external examiners’ reports.
These issues are covered in section 9 below.
In its report on 2004-05, CQAEC reported that it had not obtained reports from eight
external examiners. The College had liaised with the Schools of Law and Education
and ensured that they took all reasonable steps to obtain these reports, but the Schools
did not manage to obtain further reports. The College has improved its system for
tracking receipt of QAE reports, particularly in relation to Education. The College has
managed to obtain almost all external examiner reports for 2005-06. In 2005-06 there
were 140 External Examiners in the College at Undergraduate level (excluding ECA)
and we have obtained reports from all with the exception of two external examiners in
the School of Education. The School of Education does not expect to obtain the report
from one of these external examiners, due to the long-term illness of the examiner.
The School has taken steps to obtain the other external examiner’s report, and the
College understands that its submission is imminent.
Page 7 of 60
CHSS Quality Report for 2005-6
The College Postgraduate Office conducts a broadly similar process for postgraduate
external examiners’ reports, with the difference that the College PG Dean does not
routinely provide Schools with an analysis of their external examiner reports. This
year the Postgraduate Office will for the first time produce a report summarising
themes in postgraduate external examiners’ reports. Due to the timescales of PGT
examination board arrangements, it is not possible for the College to produce the PG
report as early as the UG equivalent. However, the PG Office has now made good
progress with the report, and expects it to be completed in May 2007.
The College also receives copies of external examiner reports for eca’s undergraduate
and postgraduate provision. Since eca’s external examiner reports are subject to
scrutiny in eca by the Academic Registrar as well as the Head of School / Department,
CHSS would not routinely raise issues regarding eca external examiner reports,
though it has the option to do so where appropriate. The Associate Dean (QAE),
having reviewed the external examiner reports and eca responses for 2005-06, is
satisfied that eca’s procedures and proposed actions are appropriate.
9.
Issues identified from review of School QAE reports
9.1 Peer Observation of Teaching
CQAEC indicated last year that peer observation of teaching (POT) was taking place
across the College with varying degrees of effectiveness. CQAEC has encouraged
Schools to further develop the use of POT, and has also kept Schools informed of
progress on SQAEC’s discussion of the issue over the past year. Since last year, three
Schools (History and Classics, MSE, and PPLS) have taken steps to increase POT
activities. Two further Schools (SPS and Education) have plans to increase POT
activities, and OLL is also considering how best to respond to this agenda within its
particular context.
CQAEC is aware that some staff in Schools can have reservations regarding the
benefits of peer observation of teaching, particularly in relation to more experienced
staff. However, CQAEC is of the view that POT can be a helpful and developmental
practice both for the observer and observed, and should be a significant part of
Schools’ learning and teaching strategies. It will therefore continue to encourage
Schools to extend these practices. CQAEC will encourage Schools to implement
systems for POT which would involve annual observation for staff early in their
careers at the University, and the potential for a lesser frequency of observation for
staff later in their careers at the University. CQAEC will take into account any further
guidance from SQAEC on this matter.
9.2. Impact of AUT industrial action on assessment and exam board process
During 2006 the Association of University Teachers (AUT) called on its members to
take industrial action short of a strike, as part of a national dispute. All Schools refer
to the industrial action in their reports, though OLL and eca do not.
Most Schools report that the industrial action created challenges in terms of their
teaching and assessment. Whilst only a very small number of examinations were
Page 8 of 60
CHSS Quality Report for 2005-6
cancelled, Schools reported difficulties relating to links with placement supervisors,
feedback to students on assessment, late submission of examination scripts to external
examiners, external examiners being unable to attend examination boards, and
difficulties with the completion of course monitoring forms. Whilst the vast majority
of external examiners did not comment on the impact of the industrial action, most of
those that did were positive regarding how Schools minimised the disruption on
students. Neither School QAE reports nor external examiner reports give any grounds
to believe that the industrial action affected academic standards. In some cases the
combination of the introduction of the ECMS (see 9.3 below) and the industrial action
will have made it difficult for Schools to compare trends in grade profiles.
9.3 Introduction of Extended Common Marking Scheme
Most Schools comment on the introduction of the ECMS. From Schools’ comments,
it appears that in general the ECMS has as yet only had limited effect on marking
habits, though practice is variable across the College. Whilst several Schools point to
some changes in patterns in marking in the B and A bands, in general there is little
evidence of increased use of the full 30 point range of the A grade. The College held a
workshop for Schools on 21 March 2007 to enable Schools to raise issues regarding
the operation of the ECMS. The College will continue to encourage Schools to further
implement the ECMS, through discussion in College Committees, and through
encouraging Schools to take forward discussion in their own forums. OLL (which had
an exemption that allowed it to introduce the Scheme one year later, in 2006-07) is to
be commended for having organised tutor development for the introduction of the
scheme, and three Schools are planning to proactively discuss the ECMS during the
latter part of 2006-07, for example through discussion at an away day (Classics). The
University’s plans to standardise examination board practices should assist in
implementing the ECMS consistently across the College.
9.4 Impact of increases in student numbers
As was the case last year, almost half of Schools refer to the impact on staff workload
of increases in student numbers, largely in relation to increases in taught postgraduate
student numbers. It is clear that some Schools are beginning to develop strategies for
coping with the challenges involved in PGT expansion by introducing greater
efficiencies in teaching methods, for example by reviewing the viability of courses
with low student numbers, and developing cross-School courses. The College has
developed an academic staff workload allocation model, which is intended to assist
Schools to take a fair way to assessing existing staff workload arrangements and to
allocating additional work. Where Schools utilise this model, it should assist them to
manage the workload involved in teaching of increased student numbers.
9.5 Plagiarism
This issue is more pronounced in this year’s report. It is clear that some Schools are
becoming increasingly proactive in detecting plagiarism (two Schools report that they
have started to use the Turnitin plagiarism detection software), raising student
awareness of University policy regarding academic misconduct, and developing
students’ referencing skills. For example, MSE has run sessions for students on good
Page 9 of 60
CHSS Quality Report for 2005-6
citation practice, in response to plagiarism cases. eca has introduced staff
development sessions on academic misconduct, and student workshops.
9.6 Library resources
As in the last two years, some Schools have reported concerns about the provision of
Library resources and the implications for teaching. These comments have been
passed on to the College Library Committee.
9.7 Teaching accommodation
Teaching accommodation continues to be a common issue in School reports. Half of
Schools raise concerns regarding difficulties with the operation of the central room
booking services. In particular staff have experienced difficulties in booking rooms of
the appropriate capacity and with adequate equipment. Some Schools also report
frequent negative student feedback regarding the appropriateness and quality of
teaching accommodation. The College and individual Schools are working with the
University’s Learning & Teaching Spaces Study Project to help the University
develop its long-term vision regarding its future learning, teaching and study spaces.
However, it appears from School QAE reports that many Schools are preoccupied by
practical issues regarding current demands on space, and the College recommends
that the relevant stakeholders (MALTS and Estates and Buildings) take steps to
address these practical issues.
9.8 English Language Skills
Last year one School raised concern at the poor English language abilities of a
number of postgraduate students whose first language is not English. Two different
Schools raised similar issues in their reports this year, and it is likely that other
Schools are facing similar issues. In response to these issues, on behalf of the College
the Institute for Applied Language Studies (IALS) has introduced for-credit courses in
Academic English for International Students with effect from 2007-08, to help raise
the participants’ English language and study skills to enable them to participate fully
in undergraduate programmes. These courses will initially be compulsory for students
on the Japanese Exchange programme, and will be available for other students on
undergraduate exchange programmes. IALS has an established English Language
Testing and Tuition (ELTT) programme for postgraduate students, and Schools
should liaise with IALS regarding the needs of their PG students.
9.9 Provision of feedback to students on examinations
There has been ongoing discussion of the issue of feedback to students at the College
Undergraduate Studies Committee over the past year. In addition, CQAEC discussed
the issue at its meeting on 13 November 2006, in the context of the findings of the
National Student Survey. The majority of formative assessment is provided by staff in
relation to on-course assessment and tutorial participation. However, the extensive
discussions at CUGSC and CQAEC have led to an increased awareness within the
College of the importance and benefits of providing student feedback in relation to
examinations in particular. Whilst Schools have raised some practical concerns
regarding the provision of feedback on examinations (for example, logistical
Page 10 of 60
CHSS Quality Report for 2005-6
difficulties in providing students access to examination scripts) they have also
suggested positive solutions such as providing group feedback through producing
model answers and electronic feedback.
In line with Academic Policy Committee’s position, the College has encouraged
Schools to introduce a ‘staged approach’ to feedback to students on level 7 and 8
examination performance. In addition, four Schools have agreed to participate in pilot
examination feedback activities. School QAE provide further evidence that Schools
are reflecting on these issues. For example, Education and MSE plan to formally
review their assessment feedback activity during 2006-07.
10.
Enhancement and Good Practice
During 2005-06 the College continued to emphasise the importance of quality
enhancement as well as quality assurance. To assist it in promoting quality
enhancement, in 2005-06 it created a new post of Associate Dean (Learning and
Teaching Innovation). The College’s most significant quality enhancement activity
during 2005-06 was to develop a formal Learning and Teaching Strategy, which its
Planning and Resources Committee approved in December 2006. The College held an
event in March 2007 to formally launch the Strategy, and has now begun to
implement it (see Forward Look section). In addition, in 2005-06 the College
supported and facilitated enhancement activities in three areas:

Teachability. The College has continued to encourage Schools to undertake
Teachability reviews, and has provided advice and support to individual Schools
in relation to this. The College has achieved good progress in relation to
Teachability in 2005-06. Prior to 2005-06, one School (Law) and a number of
individual subject areas had completed Teachability reviews. In 2005-06 four
further Schools (Health in Social Science, SPS, PPLS, and Divinity) completed
reviews (though Divinity plans to do some additional work on its review). The
majority of other Schools have indicated that they are making good progress with
their reviews, and expect to complete them in 2006-07.

Employability and Personal Development Planning. The College has explored
practices across Schools in CHSS in relation to promoting employability through
learning and teaching, and has identified examples of good practices, some of
which it documented and circulated within the College. In December 2005 the
College ran a workshop to highlight these good practices and to stimulate thinking
in the College on the issue. Introducing Personal Development Planning is an
important element of the College’s L&T Strategy. The College held a wellattended workshop in December 2006 to initiate a College-wide debate regarding
the form that PDP should take in the College and how it could be implemented
and supported on an ongoing basis, in parallel with the introduction of e-portfolio
software. The College has established a steering group to coordinate its work on
PDP. It anticipates that activities supported by the Scottish Funding Council’s
employability funding will assist it to take forward PDP, as well as employability
in a wider sense.

E-learning. During 2005-06 the College e-learning consultant continued to assist
the College to enhance its use of e-learning. The consultant has focussed on
Page 11 of 60
CHSS Quality Report for 2005-6
assisting Schools and individual members of staff to develop projects and bids for
funding. He has also taken the lead on developing a College e-learning Strategy,
which is now in an advanced draft form. School QAE reports provide evidence of
increasing use of WebCT and other forms of e-learning, including some very
positive and innovative practices. It would however be helpful for Schools to
provide some reflection on student and staff feedback on these developments, in
order that the Committee can better understand how these are enhancing learning
and teaching at UG and PG level.
In addition, the College has identified and shared good practices on specific issues
such as assessment.
From Schools QAE reports, and the reports of OLL and eca, it is clear that there is
great variety of Learning and Teaching practices within Schools. Identified examples
of good practices include:

Introduction of an internship in the History of Art’s Masters Programme, which
has proved highly successful in recruiting students.

Audio essays in Scottish Ethnology, which enable students to make use of the
Scottish Studies sound archive resource and to develop new transferable skills in
the field of editing, scripting and oral delivery.

Innovative peer-assisted approaches to student learning support in the
Management School and Economics, in particular the ‘Maths Base’ for
undergraduate Economics students, and the MSc Economics Help Desk.
11. A Forward Look
During the remainder of 2006-07, the College will focus its QE activities on
implementing its L&T Strategy. The Strategy identifies the following activities for
action by the College in the course of 2006-07:






Exploring ways to connect students more closely to the research culture of the
College, and suggesting specific areas for action.
Reviewing student induction and study skills support arrangements and
identifying areas for improvement, with a view to working with relevant
stakeholders to introduce changes in the short to medium term.
Continuing to engage with the employability agenda, including taking forward
work on Personal Development Planning and working with the Transkills Unit to
improve transferable skills provision for postgraduate students.
Working with Human Resources to review the current appraisal process
(including frequency), ensuring that it is fit for purpose; agreeing with Schools
how to measure the implementation of appraisal; and setting realistic targets that
Schools/College Office are able to work towards.
Conducting a review of current practices in team-teaching in the College, and
reflecting on pedagogical research and practices at other institutions, in order to
identify where there would be benefits in extending the use of team-teaching.
Working with Schools to clarify their current and anticipated future learning and
teaching space requirements.
Page 12 of 60
CHSS Quality Report for 2005-6



By early 2007 agreeing an e-learning strategy which will be fully integrated with
the Learning and Teaching Strategy.
Monitoring how the College intends to implement the CUGSC report on
Assessment, and considering ways in which innovations in assessment might be
introduced in line with the current Enhancement theme.
Continuing to liaise closely with the Library over the redevelopment of the Main
Library building and seeking to ensure insofar as possible that this work meets the
needs of staff and students, that it is in line with relevant aims within the Strategy
as well as with College’s other priorities, such as research.
The College will also encourage Schools to implement the Strategy in ways most
compatible with their particular disciplines and contexts, and will ask Schools to
report on their progress in their annual QAE reports. It is clear from School QAE
reports on 2005-06 that some Schools are already reflecting on and addressing issues
central to the Strategy, for example, issues of team teaching and teaching-research
linkages.
The College has in 2006-07 continued to encourage and support Schools to complete
Teachability reviews, where they have not already done so. It will consider holding an
event later in 2006-07, or early in 2007-08, to highlight the findings from School
Teachability reviews. The College has continued to encourage Schools to engage with
the QAA Enhancement themes, particularly where the themes meet the specific needs
of the College and its Schools.
From Schools’ QAE reports, and the reports of eca and OLL, it is clear that they plan
many positive developments, including:

eca’s plans to further develop its induction programme for External Examiners.

Plans for Classics to introduce annual Teaching Away Days, the first of which
will focus on implementing the Extended Common Marking Scheme.

Divinity’s plans to better support students with disabilities by piloting the
recording of classes and placing lecture material on the web, once the relevant
software is available.
The College plans to continue to work with OLL to align their QAE procedures with
CHSS’s requirements.
In 2006-07 the University introduced arrangements whereby students that study
abroad in year three are classified solely on the basis of their year four work. In 200708 the Committee will carefully review the impact of this major development in terms
of programme outcomes.
Page 13 of 60
CHSS Quality Report for 2005-6
Appendices
Appendix 1
Appendix 2
Appendix 3
Appendix 4
Appendix 5
Appendix 6
Appendix 7
Remit and Membership of the Committee
Review of School Quality Assurance and Enhancement reports
Associate Dean (QAE) report on Undergraduate External Examiners’
Reports
Formal response to Community Education Teaching Programme
Review
Formal response to English Literature Teaching Programme Review
Formal response to Social Anthropology Teaching Programme Review
Formal response to Sociology Teaching Programme Review
Page 14 of 60
CHSS Quality Report for 2005-6
Appendix 1
Remit and Membership of College Quality Assurance and Enhancement
Committee
Convener
- CHSS Associate Dean (QAE)
Secretary
- Senior Administrative Officer (Academic)
Membership - 10 School QA Directors; representative from the Office of
Lifelong Learning; representative from eca; representative
from College of Science and Engineering; ex officio Dean
(PG); ex officio Dean of UG studies, ex officio Associate
Dean(UG); ex officio Associate Dean (Learning and
Teaching Innovation); Deputy College Registrar; 2 student
representatives
Remit
-


to oversee the implementation across the College of the
University's strategy for quality assurance of teaching,
including procedures to ensure that: a. all awardbearing courses and programmes have in place staffstudent liaison committees which meet regularly and
report action taken in response to issues addressed. b.
all award-bearing courses and programmes of study are
subject to periodic monitoring and review in
accordance with College and University requirements.
c. arrangements for external examining are securely in
place, and appropriate action is promptly taken where
necessary to address issues raised in external
examiners' reports.
to receive reports from the School QA&E Committees
and to act as a College Quality Audit Committee
to take a proactive role in promoting Quality
Enhancement and to monitor changes and innovation in
Teaching and Learning within the College.
- Alan Ducklin; (Convener); Tom Ward (Secretary); Dr Martin
Current
membership: Hammer (ACE); Dr Marcella Althaus-Reid (Divinity); Brian
Martin (Education); Dr Graeme Smith (Health); Dr Trevor
Griffiths (H&C); Dr Paul du Plessis (Law); Dr Bill Webster
(LLC); Dr Tina Harrison (MSE); Dr Jeffrey Ketland (PPLS); Dr
Luke March (SPS); Irene Bruce (eca); Graham Venters (OLL);
James Bourton (student rep); Guy Bromley (student rep); Dr
Andrew Coulson (CSE); Professor Jake Ansell; Dr Chris Clark;
Janet Rennie; Donald Rutherford; Stephen Tierney
Page 15 of 60
CHSS Quality Report for 2005-6
Appendix 2: Review of School QAE Reports
School: Arts, Culture and Environment
Checklist
The School had a Quinquennial Review of Postgraduate provision in March 2006. At
the time the report was written the School had not submitted a formal response.
Good Practice








Interesting report, demonstrating a depth of reflection on the findings of the 200506 QAE process.
Introduction of feedback sheets for History of Art students that had undertaken
independent project work in 3rd and 4th years.
Increased use of WebCT.
Introduction of an internship in the History of Art’s Masters Programme.
Actively seeking the views of part-time tutorial staff as part of the process of
evaluating pre-honours courses.
Introduction of an ACE academic staff workload model that may generate more
transparency regarding the allocation of teaching and other responsibilities.
History of Art lunchtime meetings to assist students with writing skills and more
general matters concerning dissertations, placements, and other forms of
independent project work – this model may have wider applicability in the School
and College.
Positive outcome to professional body reviews of Architecture.
Areas for further consideration








Further improve the presentation of statistics, in order to allow for easy reflection
on trends and to present figures on A grade marks in line with the ECMS.
Explore alternative approaches to managing QAE processes in the School,
including considering the benefits of standardising approaches to subject level
review, and reflecting on the appropriate School Committee arrangements.
Continue to look at ways to enhance uptake of Peer Observation in Teaching,
including introducing this practice in Music.
Review assignment turnaround times in the School and seek ways to minimise
delays in returning assessments to students.
Consider the possibilities for inter-disciplinary teaching across the School.
Determine optimum seminar group sizes for effective teaching and learning.
Consider ways to use the Library reserve collection and WebCT to improve
Teaching Support Materials.
Review whether courses with low intakes represent an efficient use of teaching
resources.
Page 16 of 60
CHSS Quality Report for 2005-6
School: Divinity
Checklist
The School had a Quinquennial Review of Postgraduate Provision in August 2005. It
has submitted a formal response to this review.
Good Practice






The further development of e-learning initiatives at all levels.
Introduction of an IT skills course for first year undergraduate students.
Positive response to issues of Teachability.
Plans to pilot the recording of classes and placing lecture material on the web,
once the relevant software is available.
Development of more transparent moderating processes for team-taught courses at
pre-honours level.
Effective response to external examiners’ reports.
Areas for further consideration


Provide the full range of statistics in relation to course and degree outcomes, and
provide more reflection on the statistics particularly in relation to courses with
high proportions of marks in lower grades.
Continue to encourage staff to participate in Peer Observation of Teaching.
Page 17 of 60
CHSS Quality Report for 2005-6
School: Education
Checklist
The School has not managed to obtain Course Monitoring Forms for all courses,
though it has provided an explanation for this.
All other elements of the checklist are ticked positively.
Good Practice







Clear evidence that the School is reflecting on the findings of the annual QAE
process, and that there is willingness among staff to make developments where
necessary.
Plans to carry out a School audit of mechanisms for providing feedback to
students on assessment.
Efforts to close the QAE reporting cycle earlier in the academic cycle.
Introduction of monitoring of programme data, such as withdrawal rates, by
gender.
Positive statements of external examiners regarding the student-centred nature of
PG programmes and level of student support for PG students.
Re-organisation of taught Masters programmes and development of new
postgraduate programmes.
Preparation of a discussion paper in order to stimulate discussion regarding ways
to improve the marketing of the School’s postgraduate programmes.
Areas for further consideration










Improve rates of submission of course monitoring forms.
Report on plans to formally review the School’s QAE procedures in summer
2007, and as part of this develop a more systematic approach to QAE for
postgraduate programmes.
Clarify the role of the Director of QAE in the School, and how it relates to the
main School Committees, in order that QAE is more explicitly taken into account
within the School.
Greater analysis of statistics, including reflecting in the QAE report on those
programmes and courses which have significantly high failure rates.
Consider whether a standard questionnaire for obtaining feedback on programmes
might be beneficial.
Clarify the position of the Centre for Teaching, Learning and Assessment for
QAE purposes.
Report back on what is being done to address the issue of dissertation supervisors
and the student expectations of this relationship.
Review and report on the appropriateness of criteria used to award Merits and
Distinctions in PGDE Primary and Secondary programmes.
Report back on how the School plans to enhance the student experience at PG
level.
Continue to make progress on Teachability, in order that the review is completed
in the current session.
Page 18 of 60
CHSS Quality Report for 2005-6

Report on how the School plans to manage and renew its staffing profile in order
to maintain and enhance teaching quality, particularly in the context of projected
retirements in the next few years.
Page 19 of 60
CHSS Quality Report for 2005-6
School: Health in Social Science
Checklist
The School obtained all Course Monitoring Forms for Nursing and Counselling
Studies, but did not manage to obtain all CMFs for Clinical Psychology.
Good Practice





Progress in developing a School-wide approach to QAE, including the
establishment of a School QAE Committee.
Collection of CMFs across all three subject areas (even though they did not obtain
all for one of the subject areas), a significant development compared to the
previous year.
Completion of a Teachability review – it would be useful to report next year about
progress on implementing the report.
Positive responses to suggestions from external examiners.
Staff Student Liaison Committees, which appear to be operating effectively as
open forums, and also helping student develop valuable skills such as confidence
and knowledge of responsible participation in evaluative exercises.
Areas for further consideration





Present the full range of statistics in a standardised form as a consolidated annex
at the end of the report.
Build on progress by producing a QAE report that more fully integrates the
activities of the three subject areas, as well as reporting for the first time on the
Centre for International Public Health Policy
Consider further ways to standardise QAE procedures across the School, where
this is appropriate to the particularities and differences of each subject area.
Seek to extend the use of Peer Observation of Teaching across all subject areas in
the School.
Monitor the rate of applications for the MSc/Dip in Nursing and pursue activities
to increase recruitment rates.
Page 20 of 60
CHSS Quality Report for 2005-6
School: History and Classics
Checklist
The School did not manage to obtain CMFs for all courses, though it did achieve a
higher proportion than the previous year in History, as a result of appointing a QAE
representative for this subject area. The School is still developing its CMF processes
for PGT courses.
Good Practice









Provision of an admirably clear and wide-ranging report.
The integration of QAE issues into the business of the School Undergraduate and
Postgraduate Studies Committees.
Generally increased use of WebCT as a teaching resource.
Plans for Classics to enhance teaching review and mentoring for postgraduate
tutors, and to inaugurate an annual Teaching Away Day.
Recent actions to embed peer observation of teaching more securely.
The positive attitude towards increasing taught Masters programme provision, and
the awareness of the impact this might have on undergraduate teaching and staff
workloads.
Constructive and creative moves in the direction of a closer integration of the
offerings of the different Histories, including the establishment of an Integration
Working Group and the consideration given to generic school courses.
The establishment of the postgraduate resource centre.
Recognition of the potential synergies from the forthcoming integration of
Archaeology into the school.
Areas for further consideration







Reflect on the reasons for the low proportion of A grades in pre-Honours and
some Honours History courses.
Consider ways to encourage staff to use the full range of the Extended Common
Marking Scheme.
Consider reducing the use of double marking for examinations, and introducing
alternatives (such as moderation) which would assist the School to use staff
workload more efficiently.
Develop more systematic quality monitoring procedures for PGT programmes.
Build on the School’s positive approach to Teachability, by completing the
Teachability review in the current session.
Consider bringing forward the deadlines for submission and review of CMFs, in
order that outcomes can more quickly be taken into account.
Consider the appropriateness of introducing a greater standardisation across the
School in terms of the use of continuous assessment.
Page 21 of 60
CHSS Quality Report for 2005-6
School: Law
Checklist
The School managed to obtain completed Course Monitoring Forms for all courses,
though it did not manage to complete course audit files in a small number of cases.
Good Practice







Evidence of a robust and comprehensive approach to the auditing of compliance
with QAE requirements.
Systematic and thorough approach to the creation and maintenance of course audit
files and to ensuring ‘audit continuity’.
Commitment to full engagement of students with monitoring and review and
comprehensive provision for student representation at all levels of the School’s
operations.
Continued work on Teachability (the “teachability in permanence” project),
including training updates for staff.
Reported high level of reflection in the reports on the Commercial Law and
Criminology courses.
The reported innovations in a number of Honours courses, including innovations
in seminar teaching such as the use of student presentations, small-group work,
sample problems as well as the use of film and multimedia, institutional visits and
guest speakers.
The plan to encourage those internal examiners who do not already do so to
provide brief model answers to examination questions to aid external examiners.
These model answers may also assist in providing feedback to students.
Areas for further consideration






Consider appropriate actions to enable the School to complete all course audit
files next year. The School’s intention to set a date before the end of the relevant
academic session for completion of course audit files should help ensure this.
Continue to explore new ways to manage student questionnaires in order to secure
a higher return rate, and report on progress.
Continue to encourage staff to use the full range of the Extended Common
Marking Scheme, particularly in the light of the absence of any fails for Honours
courses.
Consider how to more fully align the QAE procedures for the Legal Practice Unit
with those for the rest of the School. Since the unitary nature of the Diploma in
Legal Practice might indicate a programme-wide rather than course-specific
approach, the School may wish to take into account future discussion at College
level regarding the appropriate balance between course and programme
monitoring.
Although CQAEC has noted the reservations in the School regarding peer
observation of teaching, the School should seek to give positive messages to staff
regarding the benefits of POT.
Conclude and report on its review of supervision and assessment of the LLB
dissertation.
Page 22 of 60
CHSS Quality Report for 2005-6
School: Literatures, Languages and Cultures
Checklist
The School did not manage to obtain Course Monitoring Forms for a small number of
pre-Honours courses, though it did slightly improve its return rates compared to the
previous year. The School does provide an explanation for the missing forms. During
the review process, the College has identified a need for the School to take a more
systematic approach to course monitoring at Honours and PGT level.
The School has submitted formal responses to the Teaching Programme Review that
took place in 2005-06 in English Literature. It has also since last year submitted
formal responses to the TPRs that were held in 2004-05: Asian Studies; European
Languages and Cultures (including Celtic); Islamic and Middle Eastern Studies.
Good Practice





Autonomous Learning Groups in English Literature.
Increased use of WebCT in Scottish Ethnology.
Audio essays in Scottish Ethnology, which enable students to make use of the
Scottish Studies sound archive resource and to develop new transferable skills in
the field of editing, scripting and oral delivery.
Induction and mentoring arrangements for Teaching Assistants in English
Literature.
Thorough analysis of the findings of the National Student Survey, and the
commitment to exploring efficient ways of providing feedback to students on
assessment, which the NSS identified as an issue.
Areas for further consideration








Provide greater depth of analysis and detail in the report.
Provide more reflection on statistics in relation to course and degree outcomes.
Set out the steps the School has taken to develop its processes for course
monitoring at Honours and PGT level in order to more effectively identify and
address issues in relation to individual courses.
Consider appropriate actions to increase the proportion of completed CMFs
received.
Monitor at programme level on an annual basis.
Seek to extend the use of Peer Observation of Teaching, for instance by utilising
cross-School mechanisms to support the operation of POT in small subject areas.
Seek new ways for synergy and connectivity across the School in terms of
learning and teaching.
Build on the School’s work on Teachability by completing the audit during 200607.
Page 23 of 60
CHSS Quality Report for 2005-6
School: Management School and Economics
Checklist
All ticked positively.
Good Practice






A thorough and robust report that provided a full range of statistics and showed
evidence of systematic reflection on them.
The use of a formal Issues Management System to allow MBA students to log
issues and to allow staff to record how they have responded.
Innovative peer-assisted approaches to student learning support, in particular the
‘Maths Base’ for undergraduate Economics students, and the creation of an MSc
Economics Help Desk.
Innovative strategies for addressing academic misconduct, through training for
students and web-based plagiarism detection software.
The award of the 2005 Scottish Financial Enterprise Innovators’ Award to the
MSc in Finance & Investment.
Plans for the School’s Assessment Working Party to review mechanisms for
feedback to students on assessment.
Areas for further consideration




Explore the reasons for low response rate to WebCT course questionnaires for
postgraduate courses, seeking to learn from experiences of using WebCT for
course questionnaires elsewhere in the School and College.
Continue to review the achievement and failure rates for the Industrial
Management course, in order to evaluate the impact of the changes to this course.
Continue to review whether higher entry requirements lead to improved
achievement rates for the MSc in Economics and MSc in Economics (Finance).
Review whether there are ways to provide greater emphasis on transferable skills
within the MSc in International Business and Emerging Markets.
Page 24 of 60
CHSS Quality Report for 2005-6
School: Philosophy, Psychology and Language Sciences
Checklist
The School has not yet produced a formal response to the TPR of English Language,
which was held in 2005-06.
Good Practice





The School’s procedures seem to be appropriate, comprehensive and effective,
and the report is remarkably integrated given the diversity of the School.
The introduction of a mechanism to give feedback to students on QAE procedures
in the subject area of Linguistics and English Language, in order to enable
students to see the results of responses to their course feedback and discussions at
SSLC meetings.
Introduction of course and programme monitoring for all PGT provision.
Provision of the full range of statistics, and evidence of valuable reflection on
trends.
Useful reflection on trends in student outcomes in Logic 1.
Areas for further consideration





Continue to experiment with approaches to student questionnaire design and
management, taking account of discussion at College level.
Encourage staff to use the full range of the Extended Common Marking Scheme,
particularly in the context of the low proportion of A grades in some Philosophy
and Philosophy of Sciences courses.
Review the pre-Honours provision in Linguistics and English Language in the
light of comments from students regarding overlap between courses in these areas.
Clarify the arrangements for QAE for the courses run by the Institute of Applied
Language Studies.
Provide a formal response to the English Language TPR.
Page 25 of 60
CHSS Quality Report for 2005-6
School: School of Social and Political Studies
Checklist
All ticked positively.
Good Practice





Increasingly widespread use of WebCT “as standard across the School”.
Completion of a School Teachability review.
Support for postgraduate tutors, including production of a Tutor’s Manual, the
provision of induction, and on-going feedback and training.
Proactive work on detecting plagiarism, through piloting the use of the web-based
‘Turnitin’ software, which the School plans to roll-out more widely.
The introduction of programme monitoring in Sociology.
Areas for further consideration




Present statistics on PGT degree outcomes in a format that allows for easier
analysis of trends across years.
Monitor the operation of the use of WebCT, in the light of the concerns of some
staff that it might lead to “spoon-feeding” of students. WebCT also provides a
potential avenue for providing feedback to students.
Report on progress on the School’s plans to re-launch Peer Observation of
Teaching.
Give further attention to the provision of feedback to students on assessment.
Page 26 of 60
CHSS Quality Report for 2005-6
Office of Lifelong Learning
Checklist
OLL does not currently use Course Monitoring Forms, though it has other processes
in place for monitoring its Continuing Personal Education and Continuing
Professional Development provision. Not all courses have questionnaires every year.
Good Practice





Clear evidence that OLL is seeking to embed QAE more firmly within its CPE
provision, and to align with CHSS requirements where possible. This will
continue to pose challenges for QAE personnel given the nature of its provision,
and the diversity of student and staff engagement.
Proactive approach to tutor development for the introduction of the Extended
Common Marking Scheme, through running a seminar and providing guidance.
Consideration of new ways to enable student feedback, such as the consideration
of web-based electronic mechanisms for providing feedback on courses.
Consideration of new ways to support student involvement in OLL QAE
procedures.
Further developments to the ‘Moving On’ course, which seeks to enhance
preparation for University study for students from non-traditional backgrounds.
Areas for further consideration







Devise mechanisms for course tutors / organisers to annually feed back on their
CPE courses, by developing an equivalent mechanism to CMFs.
Continue to devise mechanisms for systematic student feedback on CPE courses,
including annual student questionnaires.
Continue to seek ways to better represent the student perspective within QAE
procedures, in ways appropriate to OLL’s context.
Provide a full three-year set of data on course outcomes.
Clarify what the appropriate arrangements should be for QAE monitoring and
reporting of OLL’s CPD provision.
Establish a formal examination board and external examiner for the Scottish
Tourists Guide Association programme, and clarify the examination board and
external examiner arrangements for its for-credit course in Forensic Medicine.
Complete the Teachability review by the end of 2006-07.
Page 27 of 60
CHSS Quality Report for 2005-6
Edinburgh College of Art
Checklist
In many respects eca’s quality reporting format is already aligned with CHSS’s
quality assurance and enhancement reporting guidelines. The main area of current
divergence is that CHSS expects monitoring to occur at the level of the course as well
as the programme, whereas eca monitors solely at programme level (through its
Annual Programme Monitoring and Review, APMR, processes). The joint eca/
University Accreditation Committee has discussed the possibility that over time eca
will become more closely aligned with CHSS’s requirements. In particular, eca could
plan to pilot monitoring at individual module / course level (whilst retaining
monitoring at programme level) within one School in 2007-08, with a view to
introducing this across all of ECA. The Accreditation Committee will discuss this at
its next meeting in June 2007. eca has signalled that it will confirm at that meeting
that monitoring down to module level is inappropriate for a non-modular studio based
structure. The present APMR takes consideration of all the levels of the programme
and incorporates feedback and comments from students, staff and external examiners.
Good Practice










Evidence of well developed and developing teaching-related collaboration with
the University and other institutions across Scotland.
The introduction of an induction programme for External Examiners, and plans to
further develop this in 2006-07.
Development of a web based mechanism for the external examiner process
including the submission of reports.
Introduction of a QAE Handbook, and plans to further develop this.
Ongoing involvement and support for student participation in quality.
Progress in taking forward the recommendations / conditions from the
Institutional Review of Academic Programmes on Sculpture and Drawing.
Ongoing audit of student feedback mechanisms as part of the development of an
eca Code of Assessment.
Ongoing development workshops on plagiarism for staff and students.
In the School of Design and Applied Arts, the development of transferable skills
as part of the Professional Practice programme element.
In the Centre for Visual and Cultural Studies, the development of staff research
clusters based on teaching interests.
Areas for further consideration




Report on progress on developing an eca Code of Assessment.
Report on progress on redesigning programme with the objective of establishing a
module / programme descriptor database.
Provide statistics on grade profiles for UG and PGT programmes, and provide
more reflection on the statistics.
Review progress on developing and embedding an E-Learning environment,
where appropriate, to benefit all learners (on and off campus), and report on the
outcomes of this activity.
Page 28 of 60
CHSS Quality Report for 2005-6

Review the high number of learning profiles across the institution especially those
linked to dyslexia, and report on whether learning profiles are needed in all cases.
Page 29 of 60
CHSS Quality Report for 2005-6
Appendix 3: Associate Dean (QAE) report on Undergraduate External
Examiners’ Reports
1. Introduction
1.1
This report has been compiled by the Associate Dean (QAE) in CHSS and provides
an overview of the comments of External Examiners’ in their submitted reports. It
seeks to identify areas noted for good practice that can be disseminated widely and to
highlight areas which may warrant attention. Schools will, of course, provide their
own responses directly to the External examiners in their area in order to respond to
any issues being raised. The Associate Dean (QAE) will also provide a further report
to each Head of School and to the Head of College, this report will serve to
summarise the points of action suggested in Externals’ reports and identify points that
exemplify good practice.
1.2
There are 140 External Examiners across CHSS at Undergraduate level and all but 2
of their reports (both in Education) have been submitted, follow-up action has been
instigated in order to ensure that the missing reports are received if possible. In total
147 reports have been reviewed (a small number of External Examiners provide more
than one report).
2. Impact of AUT Action Short of a Strike
In quite a number of instances it is noted that External Examiners did not attend the
university during the course of the academic year with one External seemingly given
permission not to attend by ‘the department’. In essence this is contrary to university
regulatory requirements that state quite clearly that attendance is a constituent part of
the contract, being necessary to ensure that the parties fulfil their obligations to the
full. It is clear that in many instances such absence was a direct consequence of the
‘action’ given that the External makes overt reference to this in their report. However,
in a number of other instances this has not warranted comment at all. The
circumstances of 2005-06 were clearly exceptional, however it is worthy of note that
External Examiners ought to be in attendance at the university during the course of an
academic year. The vast majority of Externals who comment upon the impact of the
AUT action provide reassurances regarding the outcomes.
“I was asked by a couple of Edinburgh students whether their degrees were worth less
because of the action…I would assure anyone who has concern that… this is
absolutely not the case.” (PPLS 1)
“The guidelines issued by the University…were faithfully applied and, in the event,
proved entirely appropriate…I…have full confidence that the standard of the degree
was not affected in any way.” (LLC 17)
“ I was most impressed by the conscientiousness of the whole process at New College
under such unusual circumstances.” (D 2)
Page 30 of 60
CHSS Quality Report for 2005-6
“Ultimately, I feel that the assessment process was not compromised by the industrial
action due to the hard work of the assessment team.” (MSE 3)
In the main, where reference is made in Reports to AUT action, the view being
offered is that procedurally all that could be done to minimise negative impact upon
students was done and that the procedures enabled secure outcomes to be enacted.
In a very few instances some Externals did offer comment that the university handled
the action poorly ( H&C 1, 4, 5, 6 and 10) or that difficulties served as an impediment
to clear judgement.
“I was kept in the dark about the impact of strike action until the last minute. This was
not very helpful and resulted in me being unable to attend the rescheduled meeting.”
(Law 6)
“I received no information about …assessment procedures this year because of the
Union action.” (ED 5)
“I found it very difficult to make grade threshold decisions based on a grade rather
than on numeric scores.” (ED 9)
3.
Overall Assessment of Degree Standards
External Examiners across the College provide encouraging comment on the quality
of teaching and provided learning opportunities evidenced in the work that they have
reviewed, and in a number of instances, the positive comments of students they have
engaged with. There are numerous examples of testimony to the fact that the level of
work seen is both appropriate and comparable (or better) than that to be found in
comparable institutions, as the following quotations suggest.
“In this my first year as external examiner …the…programmes…delivered by the
University of Edinburgh achieve the highest international standards of quality.”
(PPLS 2) “The standards…are fully comparable with those of other institutions of
higher education…and the range covered is greater and results achieved often more
impressive tha in most.” (D 4) “…equivalent to or better than comparable
institutions.” (MSE 1) “In my experience…as a head teacher…the quality and
standards of the Edinburgh PGDE course are clearly superior.” (ED 29) “I have no
doubt that the Department meets (and exceeds) the nationally established criteria.”
(H&C 18) “The single subject and combined honours courses meet their aims fully
and students experience a varied and stimulating range of teaching in the discipline.”
(ACE 11) “The high standards of the Department and wide range of its interests must
make it one of the very best places to study…in Great Britain.” (ACE12) “The prehonours programme is well established and comparable with other…courses in
Scotland. Indeed it is arguably the leader in terms of the coherence and depth of each
course, the diversity of material and quality of student work.” (SPS 7) “The
Edinburgh … course compares very well with the 2 other programmes I know,
Oxford and Cambridge.” (LLC 1), this view is echoed almost precisely by another
External (LLC 16), whilst “…degrees …at Edinburgh aim high and produce excellent
results, fully comparable with top-end HEIs in the UK.” (LLC 10)
Page 31 of 60
CHSS Quality Report for 2005-6
4. Assessment Procedures and Practices
4.1 Weighting of Units of Assessment
Concerns expressed in this area previously appear not to be exercising the minds of
Externals possibly due to action taken; “…concerns about the weight attached to
coursework essays as opposed to examinations…were allayed…by the department
putting in place mechanisms…” (H&C 10) to allow Externals to gain access to scripts
on request.
4.2 Assessment Criteria
Here again there seemed to be little cause for concern being expressed by Externals.
“I still think that the marking criteria do not always reflect the demands of the
assignment: care needs to be taken to ensure that the criteria are flexible and
change…need to be weighted…and this needs to be clear on the mark sheet.” (ED 10)
4.3 Mark Descriptors
“Marking criteria were clear, appropriate…and applied consistently by markers.”
(HSS 1) “Marking criteria were excellent…” (OLL 3) “The marking criteria were full
and clear.” (D 4; MSE 7) “The marking criteria were entirely appropriate to the aims
and intended learning outcomes of the course, and were well applied by the markers.”
(ED18) “All staff worked to common assessment sheets which listed appropriate
criteria. There was considerable consistency in the marking and evidence that staff
were discussing the process and engaging in internal moderations.” (ED 26) “The
criteria employed in assessing oral presentations are quite penetrative and
comprehensive.” (LLC 6 and 8)
4.4 Extended Common Marking Scheme (ECMS)
A number of Externals make reference to the disparity in banding across the ECSM
and advocate (ACE 7, 8 and LLC 8) for grade band widths of equal distribution rather
than 30:10:10:10 etc.
“Marks in the area of 90 were given and fully deserved.” (PPLS 1)
“The introduction of the ECMS has had two beneficial effects: (1) …markers more
willing to give marks in the high 70s and the 80s…(2) …greater consistency…in the
award of D and E marks…” (PPLS 7)
“It was good to see attempts to use the full range of marks, particularly in the First
Class division,” (D 4) “I was…pleased to see that there were more marks being
awarded across the entire scale with strong work being graded at over 90%.” (ED 1)
“There has, this year, been a big improvement in the range of marks applied by
markers.” (ED 4)
Page 32 of 60
CHSS Quality Report for 2005-6
“I commend the Extended Common Marking Scale (ECMS) and was pleased that it
seemed to be being effectively used…” (H&C 1) this view is echoed by another
External (ACE 2) who noted, “There was evidence of this in the recorded marks, with
some marks in the 90s for excellent work.” “I was pleased to note that internal
markers are now using the high First range.” (LLC 11)
Not all Externals were as positive with (H&C 4 and LLC 17) noting that the issue
ought to be one of encouraging markers to mark above 70 and below 40 rather than
using the ECMS as a vehicle for this, and wondering whether statistical recalibration
might not generate a suitable outcome. A question regarding the consistency of
application of the ECMS was raised by another examiner (H&C 5), whilst another
(H&C 8, [also SPS 12]) noted that, “…there was still some reluctance by the majority
of staff to use the full range.”
“In a small number of essays…the marking criteria appeared to have been applied in
a different way and high marks (into the 80’s) were awarded.” (H&C 11) An external
(LLC 23) questions the wisdom of having a ‘high first’ at 85 or even of having one at
all, suggesting that Edinburgh’s unilateral decision serves to confuse rather than
enlighten. They “…deplore any movement in this direction.”
4.5 Double Marking/Moderation
“All scripts came…double marked, with helpful comments, and the internal marks
were normally agreed.” (PPLS 1) “I note that a process of second marking exists and
is being carried out in a relevant manner.” (MSE 1) “I was pleased to see evidence of
moderation of scripts by second markers.” (MSE 3) “The procedures applied for
second marking and moderation were impressive…” (ED 1) “I have been impressed
by the development of very careful and robust moderation procedures within these
three courses…” (ED 10) “I commend the staff team on the efforts made through staff
development seminars to ensure common understandings of the assignments and
indeed the expectations placed on them regarding their marking consistency.” (ED 30)
Such procedures were not evident everywhere, however. “Scripts are not doublemarked…marking is not monitored internally either…” (PPLS 3) “I would
recommend a more rigorous system of internal moderation to ensure a greater
consistency in application of marking criteria.” (H&C 15) “All the exam answers that
I saw were marked only by a single internal marker, without internal moderation.”
(ACE 6 also noted by ACE 8) The same External refers to Section 7.1 of the
Undergraduate Assessment regulations to reinforce the potential difficulties where
one member of staff designs, delivers and assesses a course with no second
marker/moderator involved.
It is not necessary to double mark most work (though it may be desirable for
dissertations). It is however necessary that some appropriate form of moderation is in
place.
“In those courses where assessment is carried out by a relatively wide group of
markers …some investment in shared understanding of quality thresholds would
further strengthen consistency of outcomes.” (SPS 14) This consideration can also be
applied where a large number of part-time tutors are marking. (LLC 18)
Page 33 of 60
CHSS Quality Report for 2005-6
4.6 Plagiarism
“My comments in relation to the way in which students use and reference others’
work…- traditional plagiarism - …have been taken on board, with a noticeable
reduction in incidence…” (HSS 2)
One External noted “…the increased potential afforded by ICT itself for plagiarism.
Progressively more sophisticated software for its detection is being
developed…[this]… should remain at the forefront of discussion…” (ED 13)
“Staff were interested in developing use of ‘turnitin’ plagiarism detection service,
especially in a role as a deterrent to students. I recommend they be given IT support to
do this.” (ED 21)
4.7 Variety in Assessment
Many reports allude to the existence of variety in assessment in many courses, as the
comments below suggest.
“ In the Honours years, there is a mix of assessment types: some courses are assessed
by closed examination, others by class assignments, others by a mixture of the two.”
(PPLS 1)
“The range and types of assessment were suitably wide and comprehensive…The mix
and weightings of the various types seemed about right.” (D 4) “…a good mix of
assessment…” (MSE 1) “There is a very good range of assessment methods
employed. Some assessments were innovative and challenging.” (MSE 2)
4.8 Anonymity
One External “…was pleased to note that anonymity is now observed in the
…Board.” (PPLS 3), whilst another asks; “What is the point of examination
numbers? Why not just use matriculation numbers on exam scripts? (H&C 13)
4.9 Feedback Comment for Externals and Students
“Feedback is constructive and helpful, aiming to identify problems (eg poor
referencing, lack of evidence of critical thinking) early and promote their correction.”
(HSS 1) The tutor sheets are a most useful way to ensure both quantitative and
qualitative responses to student work.” (OLL 3) “The work had been marked
thoroughly with extensive annotation to provide good feedback for students.” (ED
19)
“A general comment to all would be to give full feedback on exam scripts…” (OLL
2) “The feedback on essays was invariably constructive and admirably full. In
contrast, I sometimes felt that remarks on exam scripts were so laconic as to be of
little help to me as an external marker…” (H&C 6)
“I found the comments by internal markers to be very helpful in guiding my
decisions.” (SPS 5)
Page 34 of 60
CHSS Quality Report for 2005-6
5. Role of External Examiners
“…it is not the job of an external examiner to resolve such minor discrepancies
[between internal markers]…” (H&C 15) A request for further clarification of the role
of externals in light of changes to degree classification is made with the statement;
“The university’s thinking on the revised role for its Externals was nowhere
apparent.” (H&C 16)
In one area the External expresses disquiet regarding non-involvement; “The class
examinations, coursework and oral examinations…were conducted and assessed
without any reference to me.” (LLC 25)
The role of the external examiner is primarily an audit role, and does not require
external examiners to mark all scripts. Schools should seek to find ways to manage
the expectations of external examiners that want greater involvement in assessment,
beyond the audit function.
6. Changes in Academic Structure and Practice
Little mention is made in reports regarding the structural changes undertaken, this
suggests that in most aspects these changes have bedded in and are seen to be less
problematic.
“A difficult transition period during the change-over to semesterization has been
handled thoughtfully and carefully by the department.” (PPLS 10)
6.1 Final Degree Classification
“I continue to believe…that the department should explore ways to enable first class
students to really show their abilities relative to their very, but not so, able peers.”
(PPLS 9)
“I am glad to see that the former (extremely baroque) marking scheme, in which
marks from lower classes were ‘traded’ against marks from higher classes, is now
being abandoned in favour of a simpler and clearer marking scheme. I approve of the
change to the median system…” (PPLS 10)
“…it will be imperative to mark using the upper end of the scale or there will be very
few First Class degrees awarded.” (H&C 8)
There are a number of robust observations made by Externals regarding this issue
which are located in Section 10.
6.2 Special Circumstances
It was noted by one External (PPLS 3) that marks were being adjusted at the
Examination Board in respect of medical Special Circumstances rather than being
dealt with prior to the Board with recommendations to the Board already tabled.
Another External (H&C 2) is concerned at the ‘avoidance of resits…as a resolution of
special circumstances cases’, whilst (H&C 3) “…was astonished to learn of the lack
of an August re-sit diet at Honours level…for genuine medical or other special
Page 35 of 60
CHSS Quality Report for 2005-6
circumstances.” Concern noted by a number of H&C Examiners of the over-use of SC
by students.
In general though Externals tended to comment positively on the operation of, and
decisions made, in relation to special circumstances. “I attended the Special
Circumstances meeting and am pleased to report that was conducted with the
customary efficiency.” (D 3) “I was impressed by the Chair’s handling of a ‘special
circumstances’ case…as well as the decisions taken to deal with those students
affected by staff on industrial action.” (ED 8)
6.3 Learning Profile
One External Examiner (SPS 9) comments upon the application of a Learning Profile
to a student and the expectation that academic staff marking that students work are
expected to ‘make allowances’ within the marking process. The External is of the
view that the ‘level playing field’ ought to be in place prior to the student submitting
the work with implications for more pro-activity by the Disability Office in this
respect.
7. Administrative Issues
7.1 Examination Timetabling
“…if a problem arose over marking, it might simply not be possible to deal with it
adequately in time, and the college should allow more time. (PPLS 1)
“Time available for scrutinizing pre-Honours scripts is impossibly short.” (PPLS 4)
7.2 Information for External Examiners
“…it would have been good to be able to comment on essay titles before the
submission of coursework.” (PPLS 2)
“Externals are not routinely sent course handbooks and lists of aims and objectives.”
(PPLS 3) Schools should systematically provide external examiners with appropriate
information on courses as part of induction and on an annual basis,
“I did not receive any of the markers’ comments explaining how they arrived at their
marks. I cannot comment on methods for course monitoring as I don’t know what
they are.” (PPLS 5)
”I would recommend that procedures be put in place to ensure that internal examiners
have reached agreement on the content of draft papers before they are despatched to
external examiners for comment.” (Law 2)
“ I have yet to receive feedback on my report for the year 2004-05.” (ED 29)
Page 36 of 60
CHSS Quality Report for 2005-6
7.3 Student Absenteeism
“…the extremely high degree of administrative accuracy that is now demanded in
order to ensure that the draconian penalty of failing students who do not attend a
given number of tutorials is applied correctly..” (MSE 6)
“…there should be minimum requirements for credit (including attending seminars
and handing work in by deadlines) and unless a student meets these they be refused
credit and not permitted to take the resit. (This is the practice at Glasgow). (H&C13)
8. External Examiner Reporting
Across the range of External examiners Reports there are examples which contain
hardly any comments at all. Whilst the use of tick boxes on the reporting form is
indicative External Examiners detailed comments provide a very useful basis for
discussion and response with some indicating helpful and reflective ways in which
enhancement might be enacted. This phenomena of limited feedback from Externals
appears to be more marked within some schools than others and raises questions
regarding the extent to which Examiners accept a role as having a developmental
rather than purely confirmatory function.
9. Useful Feedback from External Examiners
“I also think that a meeting with module leaders and markers ahead of the main
meeting would be valuable.” (PPLS 5)
‘The Group Project [in Psychology] allows students to develop (and be assessed on)
transferable skills.” (PPLS 8)
“At the start of the academic year it would be useful to see one revised list of the
courses to be examined. (MSE 4)
“ I only wish Examiners’ Boards were as efficient in my own institution.” (MSE 6)
“Most courses had elaborated on the general criteria and staff provided useful
descriptions about their expectation of students through the use of outline model
answers. This is excellent practice.” (ED 19)
“The Department…should maintain its mentoring activities for new staff at a high
level.” (MSE 8)
“…there remains an issue of quality assurance of the assessment of the placement
element of the course [Education 1 and 2].” (ED 1)
“I felt that the use of an external convenor for the mathematics board was very helpful
both in the operation of the Board and in supporting consistency across individual
boards.” and “…issues emanating from examiners’ reports are taken seriously and
acted upon.” (ED 5)
Page 37 of 60
CHSS Quality Report for 2005-6
“It may be helpful…to place a greater emphasis on study and research skills…”
(ED23)
“There were opportunities for students to develop a range of transferable skills,
including writing and presentation skills, group work, problem solving and
networking.” (ED 26)
“Perhaps the course team might consider how they could develop the assessment
procedures used within the oral presentation to incorporate more peer feedback and
analytical reflection.” (ED 30)
10. College or University Issues
A number of comments from Externals are directed at college or the university. These
are represented in the quotes offered below;
“…the transition next year from a profile-based system to an averaging system.”
(PPLS 3) is seen to have implications for 2005-06 if markers do not appreciate the
consequences. “I welcome the revisions being made to the procedures used in the
Honours Board to arrive at degree classifications…” (ED 5)
‘I would suggest that the University consider whether its language entrance
requirements are stringent enough.” (PPLS 5)
“Is it possible to get an electronic External Examiner Report form?” (ED15) An
External (LLC10) intimates non-receipt of the updated Assessment Regulations from
the university.
“The new college regulations on dealing with borderzones were not well understood
by the board. Having seen briefly the ‘orange paper’ I am not surprised since the
language is tortuous.” (ED 19)
“There is a lack of clarity in the wording of the regulation pertaining to the
opportunity to resit failed courses in years 3 and 4…They should be permitted to resit
one fail in 3rd year and one fail in 4th year.” also “A D grade in one element of the
course disqualifies access to high grade classifications. This is a very punitive
regulation in a vocational degree with many elements.” (ED 25)
The issue of mean mark towards classification is raised as problematic particularly in
the light of ever tighter marking timetables, “That the system will crash in the near
future seems pretty well certain.” (H&C 10) whilst another External (ACE7) suggests,
“…that the university seriously consider relaxing the final assessment timetable by
about 1 week.”
Similar and lengthy statements are offered (H&C 15, 16 and 17) regarding both mean
mark and the university marking scale coupled with a request for more detailed
information to Externals regarding its implementation.
Given the tight marking schedule in the summer one external questions why the
university loses two days in May to holidays (H&C 16), this same External, in
Page 38 of 60
CHSS Quality Report for 2005-6
referring to various university reorganisations, suggests that the academic and
intellectual needs of History have been marginalised.
One external (ACE9) refers to the possibility of transfer error where Chairs of Boards
hand write outcomes onto a mark sheet with an expectation that externals wait until
the process is complete to sign these off. This is considered to be wasteful of time and
potentially prone to error, asking why the marks cannot be provided centrally by
computer and tabulated.
Alan Ducklin
Associate Dean QAE, CHSS
Page 39 of 60
CHSS Quality Report for 2005-6
Appendix 4: Formal response to Community Education Teaching Programme
Review
The University of Edinburgh
Moray House School of Education
Response to TPR for Community Education Programmes
We welcome the report and its positive tone. We are pleased to have the quality of the
programmes and the work of the CE Programme Team recognised in the report and in
particular in the 29 commendations. We welcome the recommendations and the
thought that has gone into the development of these. Our response to specific
recommendations addressed to us follows:
7.31 The reviewers recommend that Community Education give some
consideration to the timing and monitoring of the distributed placement in Year
2 of the undergraduate programme and the current postgraduate placement in
semester one.
The postgraduate placement in semester one has been discontinued in the new
MSc/PGDCE programme.
The timing and monitoring of the year 2 practice component is under review by a
placement sub-group. An extra tutor has been assigned to this component. We will
report back in due course to the School’s Undergraduate Studies Committee on the
impact of this and on any further required changes.
7.32 The review team recommends that guided ‘lab’ induction sessions be
introduced for the Mac computers and the First Class Package.
Such sessions will be provided at the commencement of each academic year, initially
by the Division but with a view to these being developed and delivered in the longer
term by EUCS.
7.33 The review team recommends that Community Education explore ways to
ensure that their students have (and make use of) a better choice of outside
courses than is currently the case.
Discussion took place at the annual residential planning meeting in June and this will
be taken forward at subsequent staff meetings. The possibility of drawing on
expertise across the University in relation to core courses was also discussed, and this
will also form part of ongoing discussions.
7.34 The reviewers recommend that more information will be provided for
students, prior to entry, on IT provision and the extent to which it is used by
Community Education.
A briefing and advice note will be prepared and sent to entrants to the programme a
few weeks prior to commencement.
Page 40 of 60
CHSS Quality Report for 2005-6
7.35 The reviewers recommend that School reflects upon the level of basic IT
induction offered to students based at Moray House in general.
All new undergraduate students have the opportunity to participate in induction
sessions run by the Senior Computing Officer. These focus on the use of the First
Class email system, including the Helpdesk and other self-help resources, and how to
access on-line records and other relevant university information via the MyEd portal.
Each session is tailored to the likely needs of students on particular degree
programmes.
Incoming students have a wide variety of IT experience and the considerable number
who have a high level of proficiency are encouraged to share their expertise. This is
often a particularly productive and non-threatening strategy with those who are less
confident, including many of those entering the undergraduate programme in
Community Education.
7.36 The review team recommends that community Education move to WebCT
for provision of teaching and learning as this will soon be the norm across the
University.
Some courses have already adopted this and it will be the focus of on-going
discussion across the programmes. However, as First Class remains the intranet
platform for the School, it will continue to be used for email communication and
distribution of course materials etc for the foreseeable future.
7.37 The review team recommends that the issue of staff succession be explored
at division and school level.
The School has a procedure for staff succession at head of division/department level,
which relies on expressions of interest, discussion with the Head of School, and
'soundings' being taken from the division. A similar procedure exists for programme
co-ordinators. The School is currently developing a systematic approach to the issue
of succession planning at all levels of academic staffing.
7.38 The team recommends that the Division and School explore the opportunity
to make proleptic appointments…
We welcome this suggestion and will pursue it with the School and College. The
School has instigated a 'new blood' scheme and a small number of proleptic
appointments should be possible.
7.39 The review team recommends that staff within Community Education
should improve the ‘marketing’ of the Honours route by setting out the clear
intellectual benefits of this year.
Greater prominence will be given to the Honours route in all publicity and in
recruitment process. The programme will be presented as a four year one, with an
exit point at the end of three years – a change of emphasis from the past. Students
will be approached in second year about the honours route, rather than in third year as
is currently the case. This is intended to give the message that fourth year study is an
expectation.
Page 41 of 60
CHSS Quality Report for 2005-6
7.40 The reviewers recommend that Community Education consider
introducing a delayed and/or part-time Honours years or perhaps a
postgraduate Masters course as a ‘surrogate’ Honours year to which students
who have left after three years may return.
We would be positive about such a development and will review it in light of
resource/staffing implications at a future date.
7.41 The team recommend that CE develop the MSc imaginatively to
maximise the number of students willing and able to complete the final
dissertation phase of the MSc.
We have attempted to do so and the early signs are that many/most of the new cohort
due to start in September will be so willing and able. Critical to this will be the
continuation of SAAS funding of 20 places through the PG Awards Scheme.
7.45 The review team recommends that the link between the external examiners
and placement supervisors is retained.
The team is committed to retaining an active link with placement supervisors and to
its further development. This was interrupted in the current year due to the impact of
the AUT industrial action on assessment.
Recommendations 7.42, 7.43, 7.44 are addressed to others. We await with interest
the response to these Recommendations, viz
7.42
The reviewers recommend that the collegiality and teamwork culture within
Community Education is encouraged and fostered across the University. The
reviewers recommend that the Director of Quality Enhancement promotes
this type of teamwork through the Senatus Quality Assurance and
Enhancement Committee (SQAEC). [5.1]
7.43
The reviewers recommend that the Director of Quality Enhancement
investigate ways in which to promote similar schemes, where field
professionals assist with the delivery of courses, in other relevant areas of the
University. [5.2]
7.44
Study support is embedded in the behaviour of the staff and in the ethos of
Community Education. The review team recommends that the Vice-Principal
(Learning and Teaching) in liaison with Centre for Teaching, Learning and
Assessment (TLA) develop this ‘local support’ model for adoption across the
University. [5.3]
Brian Martin
HoD, Higher & Community Education
July 2006
Page 42 of 60
CHSS Quality Report for 2005-6
Appendix 5
Review
Formal response to English Literature Teaching Programme
School response to Teaching Programme Review of English Literature
Responses to Recommendations
7.13 The Review Team strongly recommends that the subject area reconsiders the
present dissertation structure in the context of common practice for undergraduate
dissertations within the University of Edinburgh and English Literature programmes
in comparable institutions. [Paragraph 4.7]
(English Literature subject area)
Dissertation provision has been re-examined as part of the subject area’s ongoing
discussions of teaching and assessment. As the report acknowledges [section 4.4], the
full run of the two-part dissertation had not taken place by the time of the team’s visit.
Since then, the first cohort of students has completed the dissertation and on the basis
of their broadly improved results,1 some very affirmative comments by external
examiners2 and positive informal feedback from both students and staff about the first
full cycle of dissertation work, the subject area has decided to retain the current twoyear structure for at least one more cycle. We will, however, keep this under review.
In response to other recommendations made about the dissertation in paragraphs 4.6
and 4.7, the subject area has from session 2006-07 introduced a more formal advisory
structure with students for both Part 1 and Part 2 being allocated to named advisors
who will meet with them regularly throughout the year and provide technical
assistance with their projects. Since the word-length for Dissertation Part 2 cannot be
changed mid-cycle it will remain at 6,000 words until a further cohort can be
assessed, although this also will be kept under review.
7.14 The Review Team gained the impression that there may be some duplication of
teaching in relation to the first part of the dissertation in year 3 and the 3rd year
Critical Practice: Presentation course and recommends that the subject area reviews
this. [Paragraph 4.8]
(English Literature subject area)
1
Old curriculum Long Essay 2005: 89 candidates
First class: 24
Upper Second: 44
Lower Second: 21
New 2-part Dissertation 2005-6:
Pt 1 (105 candidates)
First Class: 30
Upper Second: 57
Lower Second: 18
Pt 2 (103 candidates)
32
63
8
External Examiner comments: ‘Two-part dissertation has proved a very successful innovation in
recent years.’ ‘Innovative, and integrative of formative and summative assessment in an imaginative
way.’ ‘Envious’ of two-part dissertation.
2
Page 43 of 60
CHSS Quality Report for 2005-6
Since the review, ‘Critical Practice: Presentation’ has been redesigned as ‘Critical
Practice: Research Methods for Honours’, which focuses more widely on the research
and presentation skills necessary for the successful completion of all honours work.
Having introduced a formal advisory structure [see response to 7.13 above], some of
the onus on this course to prepare students for Dissertation Part One has been
removed. The effect of this has been to maintain the development of key skills
suitable for dissertation work while de-coupling the teaching and assessment from the
practical completion of Dissertation Part One.
7.15 The Review Team recommends that the School gives consideration to a revision
of historic nature of the current budgetary allocation in order to ensure that the
subject area be provided with a budget which accurately reflects the number of
students it supports. [Paragraph 4.10]
(School of Literatures, Languages and Cultures)
Response from the Head of School of Literatures, Languages and Cultures
Discussions about resource allocations are always under consideration. Although
English Literature is working under extreme pressure, there is no scope for shifting
resource from one part of the school to another in the short term. LLC is currently in
structural deficit and cannot shift resource without declaring redundancies, which is
beyond our power. However, we are aiming to control budget deficits over the next 2
to 3 years to make sure that structural budget rebalancing can take place without
affecting the range and depth of areas of study we support.
Although English Literature is one of the two net contributors to the School budget,
(those that generate a surplus) we feel we cannot push the logic of the financial
argument to the point where other departments would have to lose staff.
7.16 The Review team recommends that the College Office, School and subject area
review the teaching and resource load in relation to visiting undergraduate students.
[Paragraph 4.11]
(College of Humanities & Social Sciences, School of Literatures, Languages and
English Literature subject area)
Response from English Literature
English Literature has been in discussion with the Visiting Students administration
and has reached some agreement about the numbers of places that can be offered in
honours courses and the mechanics of assigning them to places. Although the
diversity and engagement brought by many Visiting Students is very welcome, there
can be difficulties, both pedagogic and administrative, in incorporating large numbers
of students who are taking only a few separate courses into what has been designed as
an integrated curriculum.
Response from the Head of School of Literatures, Languages and Cultures
The School recognises difficulties imposed on English Literature by the growing
numbers of visiting students it is asked to accommodate (in addition to
disproportionate pressures in other areas), and will do what it can to ensure that
additional income these students generate is used to help resource the subject area.
Page 44 of 60
CHSS Quality Report for 2005-6
The School supports measures the subject area has adopted, in consultation with the
College Visiting Student Office, to assign international entrants to courses, to limit the
number of courses each is normally allowed to take, and to ensure that, ideally, each
is qualified some way above the minimum requirements for this category of entrant to
the School. In this and other ways, it is hoped that the demands imposed by visiting
students can be monitored, properly resourced, and perhaps shared more equably
across the School.
Response from Visiting Student Office, College of Humanities and Social Science
The College Visiting Student Office will continue to work alongside English
Literature in managing enrolment of visiting students. This has worked successfully
since introduced in 05/06. It is unlikely that there will be a significant rise in income
from visiting students unless further places are made available. However if visiting
student places in English Literature are reduced any reduction in income is likely to
be completely lost from the School/College, because those visiting students that come
to the University to study English Literature would generally not be in a position to
consider studying a different subject at the University. Most visiting students who
major in Literature will accept offers at other institutions if Edinburgh do not offer an
adequate number and level of courses. Redirecting demand more equably across the
School is unlikely to be a realistic option, especially at honours level.
7.17 The Team notes the considerable workload already borne by clerical staff and
therefore recommends that the School reconsiders the administrative load of the
teaching staff within the English Literature Subject Area and give consideration to
developing an administrative capability (perhaps in conjunction with the budgetrelated recommendation in 4.10 above) in order to enable academic colleagues to
focus more time on teaching and other duties. [Paragraph 4.12]
(School of Literatures, Languages and Cultures)
English Literature is aware of the significant pressure on the administrative staff and
welcomes the report’s recognition of this situation. Further resource, re-organisation
or reward for existing staff seems essential.
Response from the Head of School of Literatures, Languages and Cultures
See response to point 7.15 above.
7.18 The Review Team recommends that the subject area consult the University’s
Retention Guidelines, available in the annually published Assessment Regulations to
ensure it is not retaining more data than required. [Paragraph 4.14]
(English Literature subject area)
The assessed material referred to in the Assessment Regulations is not a major
difficulty since the timetable for retention is relatively short. Student files, however,
need to be preserved for a minimum of 10 years if staff are to be able fulfil their
responsibilities in writing references etc.
7.19 The Team was very impressed with the varied assessment techniques used,
particularly within the Critical Practice courses, and recommends that the subject
Page 45 of 60
CHSS Quality Report for 2005-6
area continues to explore different assessment alternatives. [Paragraph 4.15]
(English Literature subject area)
Forms of assessment are continually reviewed at Departmental Meetings, at meetings
of the Course Management Group, and particularly at the annual Teaching Review
Meeting held at the beginning of each academic year. The subject area is open to
innovations in assessment and always willing to explore new ideas. Following
discussion at this session’s Teaching Review Meeting, it was agreed to explore further
the use of WebCT facilities for assessment tasks. (See 7.22 and 7.33 below.)
7.20 The Team was concerned that the subject area was still awaiting final guidance
from the University, regarding the introduction of the mean mark scheme and noted
that accurate marks could not be passed to 3rd or 4th year students until further
guidance had been received from the College Office and therefore recommends that
such guidance be provided at the earliest opportunity. [Paragraph 4.16]
(College of Humanities & Social Sciences)
Response from College of Humanities and Social Sciences
The College circulated guidance to Schools regarding the introduction of
classification by mean mark during 2005-06, and has circulated this guidance again in
2006-07. This guidance is also published on the College intranet. The College has
also discussed the issue on different occasions at the College Undergraduate Studies
Committee, and provided Schools with further opportunities to raise issues at a
workshop held on 21 March 2007.
7.21 In relation to a late amendment to the procedures surrounding the reporting of
student special circumstances towards the end of session 2004-05, the Review Team
recommends that in future the University seeks to avoid such procedural changes
mid-year. [Paragraph 4.17]
(Academic Affairs, University of Edinburgh)
Response from Academic Affairs
Although the University tries to ensure that changes to regulations and procedures are
not made mid-cycle, the complex nature of the University, and the issues which arise,
will occasionally mean that changes will need to be implemented outwith the normal
approval cycle. In such circumstances Academic Affairs will always attempt to ensure
that appropriate advice and guidance is made available to those staff and students for
whom such changes may have implications.
7.22 The Team recommends that the Subject Area reviews the operation of the
autonomous learning groups, in the context of best practice approaches to such issues
used within the Problem Based Learning, or Visual Learning Environment (VLE)
communities. [Paragraph 6.7]
(English Literature subject area)
The subject area is very pleased that the review team recognises the value of the
autonomous learning groups [Recommendation 7.12]. Operation of autonomous
learning groups is continually under review by the subject area. For a particular
Page 46 of 60
CHSS Quality Report for 2005-6
example of developments in this respect, see 7.23 below.
7.23 The Team recommends that the Subject Area explore the possibility of utilising a
VLE to deliver the autonomous learning groups in order reduce the administrative
burden on staff and provide an archive of material. [Paragraph 6.7]
(English Literature subject area)
The subject area is in the process of developing VLEs for undergraduate courses using
the WebCT system. Following demonstrations and assessment in the summer, all
honours courses are from 2006-07 administratively run through WebCT, which now
handles the organisation of seminars, the running and communication of autonomous
learning groups and the submission of essays. Members of staff are working
individually on the various further pedagogic uses of the VLE.
7.24 The Team recommends that the autonomous learning groups be more widely
promoted throughout the University and within the UK subject community, as this
style of self-administered tutoring should be seen as an example of good practice.
(English Literature subject area)
Various presentations on autonomous learning groups have been made in recent years
at TLA events, and the system is promoted through the annual QA system. It may be
that the Institutional Review may prove another forum for this.
Page 47 of 60
CHSS Quality Report for 2005-6
Appendix 6
Review
Formal response to Social Anthropology Teaching Programme
Social Anthropology staff were extremely pleased to read the many commendations
contained in the Teaching Programme Review, and with the generally positive and
constructive tone of the report and its recommendations. The following response
follows the numbering of the recommendations contained in the final section of the
Report.
The review team recommends that consideration be given to the introduction
of an additional year 2 semester 2 course to be led by Social Anthropology. This
course should be designed to have broad appeal to a wide range of students from
across and outwith the School. In seeking to make an appropriate place for this
course within the timetable, consideration might be given to running the year 2
School-wide core courses in separate semesters. (3.3)
7.17
Social Anthropology staff are currently developing a proposal to put to the School for
a semester 2 course in Social Anthropology that would be open to second year
undergraduates in the School. This proposal was initially discussed at a meeting of the
UG Teaching Committee in Social Anthropology on 25th October 2006. Student reps
were clear in their view that they welcome this development provided it does not
restrict their choice of courses in 2nd year. They therefore strongly favoured making
one of the two compulsory School courses optional for 2nd year Social Anthropology
students, at the same time as introducing a new Social Anthropology 2B course in
semester 2.
The review team further recommends that the School has a coordinated
investigation of the effectiveness of the year 2 compulsory courses. This should
extend beyond the basic analysis of student questionnaires and should seek the
views of staff, tutors and students and examine the impact of the courses on
individual programmes throughout the School. (3.4)
7.18
This is a matter for the School to take up, but Social Anthropology would support
such an investigation.
The review team recommended that the Space Project and anthropological
methodologies be included in the recommended new year 2 course. (3.5)
7.19
This recommendation falls within the remit of the proposal currently being developed
(see 7.17). A preliminary draft of a course proposal for Social Anthropology 2B is
attached with this response.
The review team recommends that the subject group consider whether Social
Anthropology 1(b) provides too much specialisation too soon in the curriculum
before students have a clear idea about the fundamentals of the discipline. (3.6)
7.20
The content of this course was partly an artefact of the availability of staff in 2005-6.
This year the course has a different content, which is less specialised and may be
more appropriate to the level of the course.
Page 48 of 60
CHSS Quality Report for 2005-6
The reviewers recommend the introduction of an additional seminar as part of
the Imagining Anthropological Research course and suggest that this should take
place in the January before submission of proposals. The team considers that a
seminar at this later stage would facilitate student focus and help improve the
resulting research proposals. (3.8)
7.21
This recommendation appears to be based on a factual error since such a seminar was
part of the course in 2005-6.
It is recommended that Social Anthropology consider including some
discussion within the Imagining Anthropological Research course of possible
longer term considerations regarding the dissertation, e.g. future publication or
employability issues. (3.8)
7.22
This recommendation has already been implemented for Imagining Research in 20067.
The team recommends the reduction of the dissertation proposal coursework
assessment from 20% to 10%. (3.9)
7.23
This recommendation has already been implemented in 2006-7.
The review team recommends that the School and discipline area continue the
exploration of the possible introduction of a placement element. (3.10)
7.24
Social Anthropology staff are actively exploring this recommendation in the current
academic year. We note, however, that elsewhere in the School, running placement
schemes for undergraduates has been quite costly in terms of the academic time input
required.
The review team recommends that the subject area think more deeply about
the role of coursework at Honours level in instilling an appropriate range of
transferable skills in students. The team has the impression that an 80%
weighting allocated to examinations was considerable for a degree professing to
encourage a range of skills. (3.12)
7.25
This recommendation appears to be based on a factual error. Currently, exams
account for the assessment of 80% of ONE HALF of the course units for single
honours students (i.e. the core courses but not the optional courses), and combined
honours students are examined on 80% of approximately ONE THIRD (depending on
their degree programme and choice of courses) of their course units. Given current
concerns about plagiarism in academia, this proportion does not seem to be unduly
high.
The review team recommends more imaginative uses of IT in teaching
delivery, for example interactive tutorials in the form of online discussion groups.
(3.13)
7.26
Page 49 of 60
CHSS Quality Report for 2005-6
Social Anthropology staff are currently exploring ways of extending uses of IT in
teaching. MALTS staff or appropriate equivalent will be invited to make a
presentation to Social Anthropology staff in semester 2.
The review team recommends that there be more consistency in the use of
WebCT for course information and that there be proper training in its use for
staff, students and postgraduate tutors. (3.14)
7.27
Ways to implement this recommendation will be investigated in the current academic
year (see 7.26).
7.28 The team recommends that all tutors have access to the WebCT sites for the
courses on which they are tutoring. (3.14)
Tutors already have access to WebCT sites on the courses they tutor. Apparently, they
do need to be better informed about this. This matter will be taken up through the
Course Organisers and Senior Tutor in 2006-7.
7.29The review team shares Social Anthropology’s ideological opposition to course
capping but considers that high student numbers is pedagogically unacceptable.
It recommends that the School ensure that any capping system be applied fairly
and consistently across all subject areas. (3.16)
School matter.
7.30The members of the review team recommend that Social Anthropology consider
standardising contact hours across core and optional Honours courses, thus
freeing up to one hour per week from core courses. This time could then be used
to accommodate smaller groups for discussion of wider issues arising from
lectures. (3.17)
After initial discussion at a dedicated meeting to consider the recommendations of the
TPR, it was decided to seek student views on this matter. Staff were reluctant to
withdraw one of the few opportunities for small group teaching at Honours level
without first consulting the students concerned. This matter was put to the
Undergraduate Teaching Committee at its meeting on 25th October 2006. It was
absolutely clear from student reps present at this meeting that students were strongly
against the withdrawal of this extra hour of teaching on core courses. In view of this,
at the subsequent staff meeting on 25th October it was decided not to implement this
recommendation.
7.31The review team would also recommend consideration of further support for
those students who need more guidance in choosing dissertation topics, e.g. a
register of possible topics, development of new topics from previous dissertation
titles etc. (4.1)
Social Anthropology staff will consider how students can be further supported in
devising dissertation topics through the Imagining Research course. We note that
devising an appropriate topic is part of the set of skills that this course endeavours to
develop. While we try to support students, we also believe that encouraging students
Page 50 of 60
CHSS Quality Report for 2005-6
to devise and execute their own research topic independently with appropriate
guidance (rather than simply have topics suggested to them) is an important
transferable skill that the dissertation project in its entirety is designed to foster.
7.32The team recommends that Social Anthropology explore taking advantage of the
early dissertation submission date to provide oral feedback to honours students
on their performance. (4.2)
In line with lessons learnt from previous experiences of giving feedback to students
on their dissertations, oral feedback will be offered to students after they have taken
their exams. This is to avoid causing undue anxiety to students prior to their exams,
and takes account of the fact that feedback on the dissertation is not necessarily of
relevance for exam revision.
7.33The review team recommends that there be clearer articulation to tutors and
students of the aims and objectives of tutorials and their link to lectures. (4.4)
Social anthropology staff have resolved to reinstate their former practice of making
notes on the main points of lectures available to tutors. (To be implemented
immediately).
7.34The team recommends that it may be helpful for students to receive guidance in
lectures in years 1 and 2 on assessment preparation and essay writing. (4.4)
Such guidance is available both from tutors in 1st and 2nd year and from TLA in their
dedicated sessions on these topics. The staff view that large lectures do not offer the
most appropriate context for this kind of guidance was strongly supported by students
as expressed at the meeting of the Undergraduate Teaching Committee on 25th
October. A new element of guidance on essay writing and exams at Honours level is
being added to the Imagining Research course in 2006-7.
7.35 The reviewers recommend that consideration should be given to introducing
revision classes to help students understand the overall architecture of the degree
programme. Revision classes could also provide a helpful review of courses and
give students guidance by discussing past examination papers. These classes
could take place in the week prior to commencement of the examination period in
April. (4.4)
This recommendation does not appear to take account of the fact that our students sit
two diets of exams one in December and one in April/May. There is very little time
for revision classes before the December diet. However, tutors on 1st and 2nd year
courses will be asked to provide guidance before exams. Most lecturers already have
an element of revision or review at the end of their courses. There will be further
discussion through the UG Teaching committee of how to standardise some of these
procedures.
7.36The team recommends that there be formal attendance registers in years 3 and 4
and that procedures be implemented for contacting those students who are
persistently absent from class. (4.5)
Page 51 of 60
CHSS Quality Report for 2005-6
Attendance at weekly support group meetings for Honours core courses is
compulsory. Attendance registers will be introduced in 2006-7. Directors of Studies
of students who miss more than two classes in succession will be contacted. The
introduction of such procedures was discussed at the UG Teaching Committee on
25th October and supported by student reps.
7.37The reviewers recommend that there be more consistency in feedback across
courses and by assessors. Consideration should also be given to enabling
students to receive more oral feedback on coursework and being given access to
examples of coursework or examination scripts. (4.6)
The Honours course organiser will provide some guidance in autumn 2006 to markers
in order to help standardise feedback and to suggest ways of providing oral feedback
where this might be helpful – although inevitably differences between markers will
arise. The question of making exam scripts available to students is a matter currently
under discussion in the School and College.
7.38The review team recommends that Social Anthropology consider further how to
share more systematically good practice in teaching (for example by creating a
database). The discipline area may wish to involve the Centre for Teaching,
Learning and Assessment in deciding how best to do this.
Social Anthropology staff already have various mechanisms at their disposal for
sharing good practice, including discussions at staff meetings, the Undergraduate
Teaching Committee, and the Staff Student Liaison Committee. The subject area will
take the opportunity provided by the TPR to revisit this issue systematically in the
current academic year.
7.39The review team recommends the pursuit of further options to secure better
integration of staff/student research, both past and present. (5.1)
The introduction of new options is consistently encouraged and promoted through
discussion among staff, and as staff take up new research interests. The additional
credit given to new teaching is designed to encourage staff to integrate new areas of
research into their teaching.
7.40 To continue this ongoing quality enhancement of the dissertation experience,
the team recommends that Imagining Anthropological Research emphasise the
transferable skills to be gained from preparing a dissertation. For instance
consideration might be given to introducing a compulsory presentation on the
dissertation topic. (5.3)
This recommendation has already been implemented in 2006-7.
7.41The review team recommends that the subject area reflect further on how to
ensure that students receive and are aware of receiving information on the use
that has been made of their feedback. For instance, it may be helpful to make
more imaginative use of WebCT or include in course handbooks details of the
changes made in light of input from the previous student cohort. (6.1)
Page 52 of 60
CHSS Quality Report for 2005-6
This recommendation has been discussed in the UG Teaching Committee and the
Staff Student Liaison Committee. It was proposed that access to reports on feedback
and action taken as a result of student feedback be made available to students through
the Social Anthropology website and also be made available in files in the SPS UG
Reading Room. A further proposal from students at the UG teaching Committee
meeting to use the procedure adopted on some courses, that course evaluations be
collected the week before the end of the course and briefly discussed with students in
the final class, was agreed.
7.42It is recommended that there be a mechanism for obtaining feedback on the
Honours programme as a whole. For instance, there could be a supplementary
section to the student questionnaire where students may comment on the
programme. This need only be completed once per student across the range of
their courses and it would help the discipline area in considering the overall
coherency of the Social Anthropology programme. (6.2)
An end of programme element will be added to student evaluation questionnaires at
the end of Senior Honour year from 2006-7.
7.43The team recommends that it would be useful to enable and encourage greater
staff and student access to the analyses of completed course monitoring forms.
(6.2)
See response to 7.41.
7.44The review team supports the University’s re-launching of teaching peer
observation but recommends that the College properly communicates its
importance to colleagues in all subject areas. (6.3)
A College matter.
7.45The reviewers recommend that there be further discussion on adopting a more
formalised supervision and monitoring scheme to track contact hours with
supervisors in regard to the dissertation and to ensure consistency and fairness
across the board. (6.5)
For the current academic year, this matter has been discussed in a staff meeting at the
start of the academic year, and more explicit guidance has been given to staff by the
Honours Course Organiser orally, and staff have been advised to discuss the
allocation of supervision hours with their dissertation students. From next academic
year, 2007-8, more detailed guidance on this matter will be available for staff and
students in the Honours course book.
Recommendations
7.17, 7.19, 7.24, 7.29
7.18
7.20 -7.23, 7.25-7.28,
7.30-7.43, 7.45
7.44
Responsibility of:
Social Anthropology jointly with School of Social and Political
Studies
School of Social and Political Studies
Social Anthropology
College of Humanities and Social Sciences
Page 53 of 60
CHSS Quality Report for 2005-6
Janet Carsten
Head of Subject, Social Anthropology
26th October 2006
Page 54 of 60
CHSS Quality Report for 2005-6
Appendix 7
Formal response to Sociology Teaching Programme Review
The following lists the department’s response to each recommendation of the
report, any relevant action taken and future changes envisaged.
7.15
The Review Team recommends that the Subject Area considers ways of
continually developing and exploiting WebCT in its teaching, having regard
at all times to the needs of disabled students (such as the need to provide
large-print versions of web materials).
The Honours, Soc.1 and Soc. 2h convenors and Departmental secretary have
reviewed this and extended use of WebCT to include, e.g. tutorial sign-up.
7.16
The Review Team recommends that the Subject Area considers allocating
the member of staff who will supervise a student’s Honours Project, in
replacement of the current system whereby some students identify and select
potential supervisors, in order to ensure that students are not disappointed
if their potential supervisor is unable to work with them, and to ensure
equity of treatment of students and of staff workloads.
We now ensure that supervision is allocated so that the load is distributed
evenly across staff. We allocate supervisors to students where necessary. The
Honours handbook will be revised to describe this system more clearly.
7.17
The Review Team recommends that the Subject Area reflects on the
tightening up of guidelines regarding what supervisors are allowed to
provide in the way of support to students undertaking the Honours Project.
Clearer guidelines have been drawn up by the projects convenor and will be
inserted in the Honours handbook.
7.18
The Review Team recommends that the Subject Area consider making the
Skills Course compulsory for Single Honours students as a minimum and
that they give consideration to enhancements that may be required to enable
this recommendation to comply with University regulations, for example by
requiring students to produce a reflective report.
The course has been completely redesigned with more emphasis on
orientation towards the project. The course now requires students to provide a
‘reflective report’. This has substantially increased participation.
7.19
The Review Team recommends that consideration be given to identifying
further ways of evaluating the success of the Social Inquiry and Social &
Political Theory courses as a preparation for Honours study, and suggests
that a questionnaire or feedback form might be completed by Third Year
students, to seek their views on the content and learning outcomes from the
lectures and tutorials, and as to how well the courses prepare them for the
Honours curriculum.
Page 55 of 60
CHSS Quality Report for 2005-6
J MacInnes will coordinate a meeting of methods and theory teams in
semester 2 (once students have sufficient experience of the relevant honours
courses) to consider this.
7.20
The Review Team recommends that the Subject Area feed into the College
review of the Directors of Studies system their concerns regarding the
current system, namely that Directors are overburdened by the number of
students allocated to them.
The HoS has written to Luke Marsh outlining our concerns. In response to
school advise, we intend to increase number of Dos as permitted.
7.21
The Review Team recommends that serious thought should be given to their
suggestion that more established, senior colleagues take on Director of
Studies roles and that staff in their first year in post and those on temporary
contracts or probation should be excluded.
The department has resolved that all staff are eligible for DOS duties and that
it is desirable that these should be shared more widely, that the HoD should
attempt to ensure that at least one DOS is a female member of staff and that
no staff in their first year of employment should take on this role. We also
aim to increase the number of Dos in the coming year, with an aim to
minimizing the burden on all individuals.
7.22
The Review Team recommends that the Subject Area insist that the relevant
support service ensures that places on Directors of Studies training courses
are always made available to new Directors before they take up their duties.
To be recommended at school level.
7.23
The Team recommends that the Subject Area review the gender balance of
Directors of Studies, noting their concern that the current Directors are all
male.
See 7.21
7.24
The Review Team recommends that the Subject Area consider providing
guidance to new Directors of Studies to assist them in identifying when it is
appropriate for them to refer students experiencing difficulties to specialist
areas within the linked network of support services, and further consider
how to encourage students to attend TLA courses rather than rely on
Directors to provide support for learning skills.
HoS will write to Luke Marsh and TLA about this.
7.25
The Review Team further recommends that the Subject Area reflect on the
current gender balance in general across the Subject Area, with particular
attention given to the desirability of recruiting more female staff,
particularly at lower levels of appointment.
Page 56 of 60
CHSS Quality Report for 2005-6
The HoS will draw this to attention of future appointment panels, within such
constraints as are laid down by equality legislation. The department has since
appointed a further female member of staff.
7.26
The Team shares the general concerns expressed by the Subject Area
regarding the provision of teaching rooms and recommends that they
continue to raise their concerns regarding the allocation of unsuitable
rooms through the Room Bookings System, which is disruptive of good
teaching and a deterrent to committed learning.
HoS will write to relevant SVP (Mike Anderson)
Sue R. has brought forward room planning & booking.
7.27
The Review Team recommends that the Subject Area request that Registry
provide them with data which allows them to match degree entry and exit
qualifications, to enable better determination of the ‘value added’ on
completion of degree programmes.
J. MacInnes has drafted letter for HoS to write to registry, copying to
relevant SVP.
7.28
The Review Team recommends that the Subject Area reflect on whether a
more structured review might be undertaken of which Honours options are
offered, suggesting that it might be beneficial to alternate more courses,
offering them every second year, or simply to reduce the number of options
available.
A department working party has been set up to consider this and has already
agreed to drop the expectation that each staff member offer an honours course
every year, and empowered the HoS to alter the balance of courses offered in
semester 1 and 2, so as to avoid courses with low numbers of sociology
honours students.
7.29
The Review Team recommends that the Subject Area reflect on whether the
practice of allowing both Third and Fourth Year Honours students to take
the same Honours options, with the same modes of assessment, is compliant
with current SHEFC guidance.
HoS has sought advice and determined that our current procedures are fully
compliant with SHEFC guidelines.
7.30
The Review Team recommends that the Subject Area reflect on the issue of
student absence to ensure consistency in reporting procedures, for example
by detailing procedures in course handbooks.
The Year 1, Year 2 convenors and J.Hearn as director of undergraduate
teaching are reviewing this.
7.31
The Review Team recommends that the Subject Area reflects on whether, in
Page 57 of 60
CHSS Quality Report for 2005-6
the interests of equity of treatment, the process for granting extensions
might be harmonised, with a single member of staff being given sole
responsibility for considering all extension requests.
Procedures and handbook entries have been changed. There will now be 2
mitigating circumstances meetings each year.
7.32
The Review Team recommends that the Subject Area implement the
provision of provisional feedback with immediate effect and suggests that it
comply with University regulations by including a disclaimer to the effect
that this feedback is wholly provisional and subject to confirmation by the
external examiner.
The Honours handbook now states that all teachers should provide feedback
to students on semester 1 assessment performance, and comments on long
essays.
7.33
The Review Team recommends that the School remain sensitive to the
career development needs of postgraduate tutors and reflect on their
progression by allowing them to accumulate experience of teaching First
and Second Year students, before possibly being considered for involvement
in Honours teaching.
School has to an extent changed its procedures by opening out and
formalizing recruitment of tutors.
7.34
The Review Team recommends that postgraduate tutors be provided with
feedback on their performance, including the quality of their teaching, and
suggests that this might be implemented by the Subject Area redesigning the
current student feedback forms for collecting data to allow for tutor names
to be paired with the feedback.
Yr 1 and 2 convenors have agreed to do this.
7.35
The Review Team recommends that the Subject Area address the issue of
consistency across tutorials, by reviewing the guidance provided in
handbooks, to ensure that learning outcomes are identified which map to the
learning outcomes and aims of the course and that specific questions are
invariably included for discussion in each tutorial.
Yr 1 and 2 convenors have agreed to do this.
7.36
The Review Team recommends that the Subject Area continues to encourage
more varied and efficient methods for collecting student feedback on
courses and ensure that there is proper reporting back to students on how
such feedback is being acted on.
Handbooks will in future contain reports of action arising from liason
committee meetings where appropriate.
Page 58 of 60
CHSS Quality Report for 2005-6
7.37
The Review Team recommends that the Subject Area consider including
summary evaluations of students’ feedback from the previous academic year
in the following year’s course handbook, along with a summary of the
actions taken or an explanation of the reasons for not taking action.
This would be unduly burdensome. The summary evaluations are placed on
file in Sue Renton’s office for students to consult if they wish. Putting all
summaries in the honours handbook would be problematic, and it makes little
sense to put them in course documents.
7.38
The Review Team recommends that the Subject Area consider introducing
peer-to-peer reviews for postgraduate tutors.
Year 1 and 2 convenors doing this. PGs will be paid to peer review each
other.
7.39
The Review Team recommends that, in the interests of equity in the
distribution of, and transparency in the management of, staff workloads, the
School might assist the subject area by providing data on staff/student
ratios.
HoS has written to School Administrator requesting this.
7.40
The Team further recommends that the Subject Area should seek to increase
awareness of the College’s and School’s resource allocation model and how
it might impact on their planning.
This will be tabled at a future departmental meeting.
7.41
The Review Team recommends that the Subject Area undertake further
consideration of workload norms and how it might manage variances,
taking account of the large number of small credit weighted courses offered
and whether this might be having a disproportionate effect on individuals’
teaching workloads.
A working party is currently considering how best to update our workload
model, including less credit for honours classes with small numbers and
integration of administration and teaching workloads.
7.42
The Review Team recommends that the Subject Area investigate
opportunities for using WebCT to assist in the collection of data for the
Degree Programme Assessment, to determine whether the current process
might be made less labour intensive.
Ross Bond and Sue Renton and Kate Orton Johnson, who have relevant
expertise, are reviewing this.
7.43
The Review Team recommends that the Subject Area make known to the
School its concerns regarding pressures caused by changes in the First
semester and differentials in revision periods between semesters One and
Page 59 of 60
CHSS Quality Report for 2005-6
Two, in order that such concerns may inform School consideration of
semesterisation.
This has been raised at relevant school meetings. The situation has improved
due to removal of first semester reading week.
7.44
The Review Team recommends that the Subject Area investigate what it
might do to manage the strains of the current semesterised system, for
example, by reviewing assessment procedures and examination weightings
in the context of what the University is doing as a whole, and also
investigate whether data is available to monitor the impact of
semesterisation on exam performance between semesters One and Two.
The move to only one optional honours course in semester 1 of Senior
Honours deals with this. Ross Bone has investigated performance and
discovered only random variation across S1 and S2.
Page 60 of 60
Download