Assessment, Learning and Teaching Journal Readership Survey Results A readership survey was distributed to colleagues from April to July 2010. The aim of the survey was to find out who is using the ALT Journal, what they like and dislike about it, and how we can improve future editions and reach a wider audience. Participant demographics 77 colleagues responded. Of those, 76 were internal members of staff. 58 of the respondents were academic or research staff, 13 respondents were support staff and 5 were in management. Which job group do you belong to? Answer Options Academic/research staff Part-time/hourly paid lecturer Support staff Management Other Response % 75.0% 1.3% 17.1% 6.6% Answered Skipped Response Count 57 1 13 5 0 76 1 We received responses from across a wide range of Faculties, showing the Journal is being distributed well across the University. Which faculty do you belong to? Met Office Governance & Legal Affairs International Health Carnegie CETL Innovation North Library Arts and Society Business and Law RSO FHE 1 1 5 8 4 1 6 2 3 3 1 1 1 Journal Distribution The majority of respondents (77.5%) are sent an individual copy of the Journal via the internal mail. This is how most of the respondents (69%) would like to receive it. The Journal is available to read on the ALT homepage on the Leeds Metropolitan website and some participants (9.9%) read the Journal online. The remaining respondents (12.7%) received their copy from colleagues. However other methods of distribution were suggested. Although most respondents preferred receiving a printed version of the Journal (69%), an electronic, greener and more cost effective version was preferred by 19 of the respondents. Two respondents suggested using email prompts similar to those of other Journal publishers, with a hyperlinked contents list. Currently, it is not possible to search for individual articles nor to view individual articles without accessing the whole issue of the Journal. As the Journal grows it would be useful to develop this feature. Furthermore, the majority of respondents (56%) indicated that they only read specific articles of interest. Multiple methods of distribution would be most successful in reaching a wider audience. Distributing to colleagues outside of Leeds Metropolitan should also be considered. How would you prefer to receive the Journal? Answer Options As a printed copy In PDF format on the website I do not wish to receive it Other (please specify) Don't mind, though as a PDF would no doubt be cheaper for the uni. I used to get it as a printed copy, and didn't know it had been replaced by email - I don't think I have seen it since it has been in this format. Save on printing and establish a web link where all staff can read it - use email prompts to latest versions. It would be great if we got an email similar to those of Journal publishers with a hyperlinked contents list. I do not get sent a copy but as I work in OPVC there are plenty around so I read a printed copy Response % 69.0% 22.5% 8.5% Answered Skipped Response Count 49 16 6 5 71 6 2 Do you read: Answer Options All of it Skim it Specific articles of interest only None of it Response % 12.0% 29.3% 56.0% 2.7% Answered Skipped Response Count 9 22 42 2 75 2 The majority of the respondents (54) indicated that they would recommend the Journal to colleagues in the profession. How likely are you to recommend the Journal to colleagues working in the profession? Answer Options Very likely Likely Undecided Unlikely Very unlikely Response % 26.7% 45.3% 12.0% 8.0% 8.0% Answered Skipped Response Count 20 34 9 6 6 75 2 3 Quality rating of the Journal The quality of the Journal was rated highly with 33.3% rating it ‘excellent’ and 47.2% ‘good’. Only 2 respondents rated it as ‘very poor’. Overall, how would you rate the quality of the ALT Journal? Answer Options Excellent Good Fair Poor Very poor Response Percent 33.3% 47.2% 16.7% 0.0% 2.8% Response Count 24 34 12 0 2 Answered Skipped 72 5 The respondents were asked to rate the relevance of the last issue on Enterprise. The results are very positive, especially given that this was a specialist issue, with 54 participants finding it relevant. Thinking about the most recent issue (No 8, Spring 2010, on Enterprise), how relevant to you did you find the contents? Answer Options Very relevant Quite relevant Not very relevant Not relevant at all Don’t know/no opinion Response Percent 25.7% 47.3% 9.5% 5.4% 12.2% Answered Skipped Response Count 19 35 7 4 9 74 3 4 The majority of the participants (61) agreed that they found the Journal useful to them professionally. Almost half of the participants (33) had tried out a new teaching or assessment method as a result of something they had read in the Journal. Many of the participants (57) use the Journal to find out what colleagues are working on, and the majority (58) found the Journal to be relevant to their discipline. Do you agree/disagree with the following statements? strongly agree agree disagree strongly disagree don't know/no opinion Response Count 18 43 6 3 5 75 6 27 28 4 10 75 The Journal is mainly for experienced researchers/lecturers The Journal is mainly for new writers The Journal mainly focuses on Leeds Met staff I do not find the Journal relevant to my discipline 1 7 39 21 7 75 3 18 41 7 6 75 9 49 11 0 5 74 4 7 32 26 6 75 I use the Journal to find out what colleagues are working on 12 45 6 6 6 75 I have found the Journal useful to me professionally I have tried out a new teaching/assessment method as a result of something I read in the Journal Answer ed Skipped 75 2 5 Contributing to the Journal Just over half of the respondents had contributed to the Journal (58%), and the majority stated that they would like to submit an article (70.6%). Reasons for not contributing varied, but for the majority of respondents (67.9%) it was due to lack of time. 6 respondents felt it was not relevant to their job. Have you ever submitted an article for publication in the Journal? Answer Options Yes No Response % 58.7% 41.3% Answered Skipped Would you like to submit an article? Answer Options Yes No Response % 70.6% 29.4% Answered Skipped Response Count 44 31 75 2 Response Count 48 20 68 9 6 If you haven’t yet submitted an article, why not? Answer Options Not enough time Don’t see the benefit to me Not confident in writing Not relevant to my job Other Though would consider writing an article if I felt I had something I wanted to share No reason If I wrote something to publish, I’d publish it somewhere else Too much administrative demands on academics these days and this has taken away scholarly hours that one could have used for writing articles see 11 Response % 67.9% 7.1% 3.6% 21.4% Response Count 19 2 1 6 5 Answered Skipped 28 49 Suggestions for improvements Many respondents suggested ways to improve the value/usefulness of the Journal. 4 respondents enjoyed the themed editions and indicated that they would like to see more of them. Many of the respondents (7) suggested broadening the Journal to reach a wider audience and to include a wider range of contributors. Publicising the Journal more internally to support staff and SU staff as well as externally and using a broader pool of writers both internally and externally was suggested. Having a searchable database/central repository with electronic links was also recommended by 3 respondents. 5 respondents liked the variety of articles in the Journal and would like to see even more variety in the form of: book reviews, articles of various lengths, areas of general interest (e.g. IT corner), case studies and a list of ALT events. However, 4 respondents stated that they would like the Journal to be more challenging and detailed, with ‘less newsy items and more working paper equivalents’. 7 What do you think would improve the usefulness/value of the Journal? A bit more depth and rigour in articles More special/themed issues I like 'themed' editions of the ALT Journal, as I can then refer to them for specific areas of my practice (e.g. assessment, enterprise, feedback etc etc) Nothing in particular, it is valuable as it is but of course, the quality and variety of submissions needs to be maintained Not sure Keep a good focus on assessment, teaching and learning principles The quality of the articles and EAB. Strengthening both, esp by broadening beyond the institution, would be useful Distribution more widely than academic staff - ensuring support staff such as careers, as well as SU staff receive it. Themed topics, as the current (and next) issues Some shorter articles, maybe some letters or comment on published research Not sure Wider pool of writers Overall I think it is a good opportunity to publish and for others to see what you are working on, it. More book reviews would be good as would perhaps longer articles in some instances, say a review essay in each edition as currently the articles are limited by the word count. Having a central annotated repository of information about the Journal contents Less newsy items and more working paper equivalents List of ALT conferences Link articles to an electronic version which has individual articles similarly cross linked to the hardcopy version Every staff member gets a copy and there is no need to recommend any. Make it electronic and save on printing and envelope costs. Journal is good as it is. Searchable database of contents by issues I enjoy the variety of themes and articles in the Journal I assume these questions refer to the hard copy which I don't receive - only received a copy of the version in which I had an article published I find it a very useful Journal already Wider range of contributors including from those providing academic support Maybe some more general interest areas, e.g. IT corner :) Greater engagement from authors in raising awareness that the Journal exists and they have a paper in there that colleagues might like to read Include more external contributors particularly from partners A balance of Leeds Met and non Leeds Met More linking to reusable resources or materials the level of detail needed to build on someone else's practice: more sharing of stuff it has taken time to develop Perhaps it would help if it would be widely publicised of the themes to be published. This would help authors to target when to submit their paper More case studies and variety Need to make more challenging for researchers Articles often sound interesting and relevant, but on reading have such a small area of focus that the material is not transferable to other areas of teaching 8 Some respondents were very positive about the Journal and commented that they ‘think it is good as it is’, and comments on what they would like to see more of centred mostly on including articles sharing good teaching and assessment practices (11). Short news items discussing ongoing research projects, bids and outcomes, teaching ideas and a reflection on something new in practice was suggested by respondents. One respondent suggested including updates relating to ALT guidelines and policies, with Teacher Fellows providing advice. Other suggestions include using more images and new writers. What other items would you like to see included/what would you like to see more of? Examples of proformas/reusable learning objects etc More special/themed issues Bigger turnover of writers from the teacher fellow network. Maybe if some writers workshops were offered it might inspire more folks to submit? It is a great showcase both for innovative work across the university as well as for more focused research. Often the showcase of innovative work is more directly of interest and applicable to my work. Think is good as it is People who have got bids and the outcomes Internal as well as external bids Review articles and/or book reviews Brief summaries of ongoing projects in the university Examples of good practice As above Not sure Perhaps an occasional themed call for papers would be useful for some disciplines but the general nature of it seems to me to work well Collaboration opportunities Articles to be more overtly part of the ALT programme strategy NONE 250 words (ish) on something new in practice Short 'news' items about ongoing research or teaching ideas which people are trying out. New writers Perhaps include recent updates relating to assessment learning and teaching guidelines and policies implemented across the University - for example - a current area generating significant debate is three week turn-around - it would be useful to have more information regarding background, implementation, possible obstacles and potential solutions from Teacher Fellows etc. I'd love to see more images added to the content Perhaps variety of things - shorter/longer papers? One page reflections or teaching ideas (perhaps provide a format for this - what the problem was, what I did, what happened, what you need to know to do it too or something) More narrative - similar to THES I think it serves its purpose Both ends of the spectrum from stand up teaching i.e. Olly Bray to on-line delivery More discussion of primary research Articles regarding examples of teaching and assessment practices 9 Future Issues Participants had a range of suggestions for future editions, the most popular being internationalisation (6). Focusing on specific faculties/disciplines was also suggested (2). Other suggestions include student engagement, retention, attendance, group assessments, placements, volunteering, students with disabilities, feedback and curriculum design. What themes would you like to see covered in future issues? Internationalisation Internationalisation Historical overview of specific pedagogic topics Short reports of up-to-date research from other universities Group assessments/attendance What about special faculty issues-? especially now we are all looking for more collaborative projects and an identity with the move to the new structure Discipline specific issues Faculty/Discipline specific issues A CETL edition, bringing together the key outputs and resources from the three Leeds Met CETLs. A research-focused edition Employability is a key issue and I hope that edition is produced soon Not sure Student participation, evaluation of tutors, more on business engagement, evaluation of available professional development opportunities An international theme Fieldtrips/facilitating academic reading and engagement with seminars How to overcome difficulties in developing student understanding, how to deliver more interactive sessions, models of good practice for dealing with student problems, engagement/motivation, more theoretical perspectives and how to translate into practice ALT generally is ok Tips for new teachers Internationalisation Special educational needs Formative feedback International students Employability Student retention Maybe placements and the benefits of them? I don't know. Could get some students involved Blended learning pedagogy Working with diversity and internationalism in teaching and assessment. Peer mentoring schemes; study skills support; international students Distance Learning Curriculum Design Practice as research Creativity in assessment Student engagement beyond the curriculum, volunteering etc 10 Improving the student experience i.e. classroom interaction, supporting weak students, online assessment, working efficiently and effectively i.e. we over assess etc. PDP and particularly the development of student academic skills Do you have ideas for future special editions? Internationalisation Personal tutoring A top tips for teaching idea- a light hearted Christmas issue Enquiry-Based Learning? An edition with articles co-authored between staff and students? A student stand-alone edition? Task Based/Problem Based/Enquiry Based learning might be a useful special edition as we are all involved in practical or applied education and these are all similar, though slightly different, strategies which may have wide applications across the university No First time authors An edition that focuses on our RUN partners' contributions or a copy that contains our students' contributions There could be so many of these - threshold concepts, pedagogical models of practice... Assessment to identify students at risk Special edition on information literacy and librarians who teach NONE PG assessment etc. Employability student retention disability Blended learning pedagogy Not specifically Disability Personal and Professional Development/Personal Development Planning One which encompasses reports from a whole host of SLWGs or other working groups as well as Unfair practice boards etc which impact on ALT e.g. attendance, personal tutoring, unfair practice, feedback etc etc None Teaching creative technology subjects using blended learning 11 Additional comments 18. Do you have any other comments? It is a pity more staff do not read it, I don't know what the answer is...perhaps Associate Deans for ALT and TFs could use parts of it to stimulate discussion in faculty sessions? I really like the in-house Journal, and I hope it continues The ALT Journal has been a huge success both in terms of encouraging staff to produce articles for publication plus in the variety and quality of articles that have stimulated discussion and thought on some key ALT issues. No A useful way of getting feedback for ALT articles Other than I enjoy reading it, no. Yes, I find the publication useful and would not want it to be rationalised in the current climate of cost reduction! I like the thematic presentation NONE I skim the total contents, and read in detail specific articles (Q6) Would be good if it were also distributed to learning support colleagues, learning technologists etc A very valuable resource I had been working at LMU for a year before I heard of it and though I am a Librarian it would have been useful to receive a copy at the start of my employment Sometimes the font colour can be difficult to read Think the Journal is excellent! None I found the process of submitting an article very useful. The review feedback was excellent and it really honed my writing skills. We need more of this I like the idea of the Journal but in practice usually find the articles less useful than I had hoped Linzi Anderson August 2010 12