UNIVERSITY OF EXETER EXTERNAL EXAMINERS’ REPORTS: CLES POSTGRADUATE TAUGHT PROGRAMMES OVERVIEW 2013/14 1 Introduction 1.1 This paper forms a general overview; highlighting good practice, common themes and key recommendations highlighted by the 18 External Examiners’ Reports for CLES postgraduate taught programmes. The standard online report form for postgraduate programmes was used by all External Examiners. 1.2 It should be noted that External Examiners reports are effectively monitored through the University’s Quality Review Framework section on External Examining. 2 Good Practice 2.1 Of the External Examiners 17 highlighted aspects of good practice as follows: (i) (ii) (iii) (iv) (v) (vi) (vii) (viii) (ix) The dedicated staff teaching on research-led, innovative programmes with an interesting range of modules; The diverse practical, field-based training the students receive; The rich and encouraging feedback provided to students; The pathfinder work into the use of distance learning materials for parts of the research teaching for Psychological Therapies (Psychodynamic Strand) which has been well received; The excellent level of reflection that students are required to undertake on their clinical practice; The variety of creative assessment methods which allow students to display learning outcomes effectively; The use of SWOT analysis in the Biotechnology and Enterprise research project; The responsiveness of staff to suggestions for improvement; The professional conduct of the Board of Examiners meeting. 3 Common Themes/Key Recommendations: 3.1 Those recommendations categorised as Essential, Advisable and Desirable are outlined below: Theme Essential 2 Externals made recommendations: Teaching and learning Assessment Advisable Advisable 6 Externals made Advisable recommendations: Psychology – 2 Externals noted that more advanced statistical training should be provided, as relative to other MSc programmes of which the External is aware, the statistics here are taught to a lower level. Psychology - The School should modify curriculum or assessment, to ensure that the marks gained by students in the core statistical module are not too high. The current mean of 75% appears too high, is at odds with performance on other modules, and is awarded in the context of statistical training that is Desirable 13 Externals made Desirable recommendations: Clinical Psychology – Focus on teaching funnelling skills. Biosciences and Geography (Penryn) - It may be worth considering whether students should compulsorily be required to take at least one module from the GEO and BIO courses, forcing interdisciplinarity. Psychology – The observational study work should stay observational, not drift into interviews and focus groups. Geography (Penryn) – The External suggests that there is a need to find a way to manage the expectations of students in a positive way for all on the course. Psychology – The External makes a number of suggestions for improvement of PSYM202. Further detail is provided in the report. Biosciences (Penryn) - A number of students commented that workloads were occasionally difficult depending on module options being chosen and the timing of assessments. Students should be encouraged to be mindful of workload implications when choosing options. Marking and moderation Feedback not particularly difficult for MSc level. Psychology – 2 Externals feel that Geography (Streatham) – The Sport and Health Sciences – The the School should review its marking External would like to see the External feels that there is still some standards and policies in light of the provision of moderation forms and a under marking. influx of students whose English paper-trail of how moderation was Geography (Penryn) - There is a language and background undertaken. tendency for staff to cluster psychological skills may not be to the assessment marks within a narrow standard that have been typically band of 55 to 65. The different win expected on this leading MSc standard between marks at these programme. The External suggests two levels is often much greater that the School formulate a coherent than a 10 percentage point and principled response to the difference. Staff should be challenge of meeting the increasingly encouraged to use a wider range of diverse needs of their intake fairly marks to reflect more fully and consistently. differences in work quality. Geography (Penryn) - While there is evidence of mark moderation on the coursework feedback sheets; the External would encourage staff to adopt a systematic approach to the use of mark moderation sheets for modules in order to render this process more explicit. Biosciences (Penryn) – There was a narrow range of marks for the Key Skills and Africa Field Course modules again this year. The External suggests weighting the different components to see whether greater differentiation between students can be achieved. SWDTC – The External would like to see the provision of marginal comments on course work and a clearer indication of marking criteria and descriptors. Geography (Penryn)/Sport and Sport and Health Sciences Health Sciences – Staff should be Continue to cross-check feedback Dissertations encouraged to provide typed quantity and quality and make sure feedback for ease of comprehension marks match comments. by students and External Examiners. SWDTC – The External indicates that feedback sheets should be type written and include the essay/project title. Geography (Streatham) – The External suggests that greater care could be used in the choice of language employed to describe work of particular grades in feedback to students, and more consistency is needed in the level of feedback provided by individual assessors. Psychology – the Head of Department should identify staff that provide insufficient feedback and require them to provide it more completely and quickly in future. Sport and Health Sciences – The Biosciences (Penryn) - It may be department should continue to worth developing guidelines for monitor dissertation performance in dissertations which clarify that these "social science" areas of exercise can take multiple forms, ranging and sport science as you move to from conventional academic papers journal article only. through to consultancy reports, and appropriate criteria for assessment Geography (Penryn) The should be developed. dissertations were mostly 8000 words, which is too short to conduct Biosciences (Penryn) – All markers a research project. There was an should justify their marks for the option to do a 15000 word project (both CA and report) using dissertation, which two students took the criteria required. In a few cases up and they were the only two to the report had not been annotated, achieve distinctions. The External and outstanding marks were not strongly recommends enforcing a matched by outstanding comments. 15000 word dissertation. Biosciences (Penryn) - The need for Geography (Penryn) Most proof reading and immaculate students give perfunctory treatment presentation, including the Processes to methodology in dissertations. references at the end of the report This is an important issue in a should be reinforced to students. research project and while students Then the markers should penalise receive effective teaching in failures in this regard when it comes methodology most do not carry it to the project report. through in their own projects. This Biosciences (Penryn) - Although a suggests that supervisors of diverse range of research projects dissertations should pay close are offered to students, fewer attention to this issue in future. mainstream conservation or applied ecology projects are being offered Psychology Double-marking procedures for dissertations should than there are students wishing to be made more robust and do projects in these areas. This transparent. reflects a mismatch between the research interests of academic staff and the MSc students. Where possible the Department should ensure there are options available for students wishing to undertake conservation or applied ecology projects. Geography (Streatham) - The course team should review the GEOM421/GEOM423 dissertation handbook and ensure that the External’s previous advice concerning the discussion section of dissertations is emphasised. Geography (Penryn) – The External wonders if the dissertation weighting of 50% such an important marker for an applied MSc. Geography (Penryn) – The Department should reflect on the Module Evaluations by students (more detail on this is provided in the External’s report). Psychology - Several mark sheets do not include the marker’s name making it hard for Externals to determine reasons for discrepancies in feedback or standards. The External suggests including a field for the markers’ initials. Psychology – All electronically marked work should be provided to external examiners, with the feedback included. Staffing and Resources Quality Review February 2015 MAK/ N:\UFO & PGADD\QUALITY REVIEW\External Examiners\Overview\2013_14\PG\PGT\By_College\CLES\CLES_PGT_Overview_13_14.doc