Assessment, Learning and Teaching Journal Readership Survey

advertisement
Assessment, Learning and Teaching Journal Readership Survey Results
A readership survey was distributed to colleagues from April to July 2010. The aim of the survey was
to find out who is using the ALT Journal, what they like and dislike about it, and how we can improve
future editions and reach a wider audience.
Participant demographics
77 colleagues responded. Of those, 76 were internal members of staff. 58 of the respondents were
academic or research staff, 13 respondents were support staff and 5 were in management.
Which job group do you belong to?
Answer Options
Academic/research staff
Part-time/hourly paid lecturer
Support staff
Management
Other
Response %
75.0%
1.3%
17.1%
6.6%
Answered
Skipped
Response Count
57
1
13
5
0
76
1
We received responses from across a wide range of Faculties, showing the Journal is being
distributed well across the University.
Which faculty do you belong to?
Met Office
Governance & Legal Affairs
International
Health
Carnegie
CETL
Innovation North
Library
Arts and Society
Business and Law
RSO
FHE
1
1
5
8
4
1
6
2
3
3
1
1
1
Journal Distribution
The majority of respondents (77.5%) are sent an individual copy of the Journal via the internal mail.
This is how most of the respondents (69%) would like to receive it. The Journal is available to read on
the ALT homepage on the Leeds Metropolitan website and some participants (9.9%) read the Journal
online. The remaining respondents (12.7%) received their copy from colleagues. However other
methods of distribution were suggested. Although most respondents preferred receiving a printed
version of the Journal (69%), an electronic, greener and more cost effective version was preferred by
19 of the respondents. Two respondents suggested using email prompts similar to those of other
Journal publishers, with a hyperlinked contents list. Currently, it is not possible to search for
individual articles nor to view individual articles without accessing the whole issue of the Journal. As
the Journal grows it would be useful to develop this feature. Furthermore, the majority of
respondents (56%) indicated that they only read specific articles of interest. Multiple methods of
distribution would be most successful in reaching a wider audience. Distributing to colleagues
outside of Leeds Metropolitan should also be considered.
How would you prefer to receive the Journal?
Answer Options
As a printed copy
In PDF format on the website
I do not wish to receive it
Other (please specify)
Don't mind, though as a PDF would no doubt be cheaper for
the uni.
I used to get it as a printed copy, and didn't know it had been
replaced by email - I don't think I have seen it since it has
been in this format.
Save on printing and establish a web link where all staff can
read it - use email prompts to latest versions.
It would be great if we got an email similar to those of
Journal publishers with a hyperlinked contents list.
I do not get sent a copy but as I work in OPVC there are
plenty around so I read a printed copy
Response %
69.0%
22.5%
8.5%
Answered
Skipped
Response Count
49
16
6
5
71
6
2
Do you read:
Answer Options
All of it
Skim it
Specific articles of interest only
None of it
Response %
12.0%
29.3%
56.0%
2.7%
Answered
Skipped
Response Count
9
22
42
2
75
2
The majority of the respondents (54) indicated that they would recommend the Journal to
colleagues in the profession.
How likely are you to recommend the Journal
to colleagues working in the profession?
Answer Options
Very likely
Likely
Undecided
Unlikely
Very unlikely
Response %
26.7%
45.3%
12.0%
8.0%
8.0%
Answered
Skipped
Response Count
20
34
9
6
6
75
2
3
Quality rating of the Journal
The quality of the Journal was rated highly with 33.3% rating it ‘excellent’ and 47.2% ‘good’. Only 2
respondents rated it as ‘very poor’.
Overall, how would you rate the
quality of the ALT Journal?
Answer Options
Excellent
Good
Fair
Poor
Very poor
Response
Percent
33.3%
47.2%
16.7%
0.0%
2.8%
Response
Count
24
34
12
0
2
Answered
Skipped
72
5
The respondents were asked to rate the relevance of the last issue on Enterprise. The results are
very positive, especially given that this was a specialist issue, with 54 participants finding it relevant.
Thinking about the most recent issue (No 8,
Spring 2010, on Enterprise), how relevant to
you did you find the contents?
Answer Options
Very relevant
Quite relevant
Not very relevant
Not relevant at all
Don’t know/no opinion
Response
Percent
25.7%
47.3%
9.5%
5.4%
12.2%
Answered
Skipped
Response
Count
19
35
7
4
9
74
3
4
The majority of the participants (61) agreed that they found the Journal useful to them
professionally. Almost half of the participants (33) had tried out a new teaching or assessment
method as a result of something they had read in the Journal. Many of the participants (57) use the
Journal to find out what colleagues are working on, and the majority (58) found the Journal to be
relevant to their discipline.
Do you agree/disagree with the
following statements?
strongly
agree
agree
disagree
strongly
disagree
don't
know/no
opinion
Response
Count
18
43
6
3
5
75
6
27
28
4
10
75
The Journal is mainly for experienced
researchers/lecturers
The Journal is mainly for new writers
The Journal mainly focuses on Leeds Met
staff
I do not find the Journal relevant to my
discipline
1
7
39
21
7
75
3
18
41
7
6
75
9
49
11
0
5
74
4
7
32
26
6
75
I use the Journal to find out what
colleagues are working on
12
45
6
6
6
75
I have found the Journal useful to me
professionally
I have tried out a new
teaching/assessment method as a result
of something I read in the Journal
Answer
ed
Skipped
75
2
5
Contributing to the Journal
Just over half of the respondents had contributed to the Journal (58%), and the majority stated that
they would like to submit an article (70.6%). Reasons for not contributing varied, but for the majority
of respondents (67.9%) it was due to lack of time. 6 respondents felt it was not relevant to their job.
Have you ever submitted an article
for publication in the Journal?
Answer Options
Yes
No
Response %
58.7%
41.3%
Answered
Skipped
Would you like to submit an article?
Answer Options
Yes
No
Response %
70.6%
29.4%
Answered
Skipped
Response Count
44
31
75
2
Response Count
48
20
68
9
6
If you haven’t yet submitted an article, why not?
Answer Options
Not enough time
Don’t see the benefit to me
Not confident in writing
Not relevant to my job
Other
Though would consider writing an article if I felt I had
something I wanted to share
No reason
If I wrote something to publish, I’d publish it
somewhere else
Too much administrative demands on academics these
days and this has taken away scholarly hours that one
could have used for writing articles
see 11
Response %
67.9%
7.1%
3.6%
21.4%
Response Count
19
2
1
6
5
Answered
Skipped
28
49
Suggestions for improvements
Many respondents suggested ways to improve the value/usefulness of the Journal. 4 respondents
enjoyed the themed editions and indicated that they would like to see more of them. Many of the
respondents (7) suggested broadening the Journal to reach a wider audience and to include a wider
range of contributors. Publicising the Journal more internally to support staff and SU staff as well as
externally and using a broader pool of writers both internally and externally was suggested. Having a
searchable database/central repository with electronic links was also recommended by 3
respondents. 5 respondents liked the variety of articles in the Journal and would like to see even
more variety in the form of: book reviews, articles of various lengths, areas of general interest (e.g.
IT corner), case studies and a list of ALT events. However, 4 respondents stated that they would like
the Journal to be more challenging and detailed, with ‘less newsy items and more working paper
equivalents’.
7
What do you think would improve the usefulness/value of the Journal?
A bit more depth and rigour in articles
More special/themed issues
I like 'themed' editions of the ALT Journal, as I can then refer to them for specific areas of my practice (e.g.
assessment, enterprise, feedback etc etc)
Nothing in particular, it is valuable as it is but of course, the quality and variety of submissions needs to be
maintained
Not sure
Keep a good focus on assessment, teaching and learning principles
The quality of the articles and EAB. Strengthening both, esp by broadening beyond the institution, would be useful
Distribution more widely than academic staff - ensuring support staff such as careers, as well as SU staff receive it.
Themed topics, as the current (and next) issues
Some shorter articles, maybe some letters or comment on published research
Not sure
Wider pool of writers
Overall I think it is a good opportunity to publish and for others to see what you are working on, it. More book
reviews would be good as would perhaps longer articles in some instances, say a review essay in each edition as
currently the articles are limited by the word count.
Having a central annotated repository of information about the Journal contents
Less newsy items and more working paper equivalents
List of ALT conferences
Link articles to an electronic version which has individual articles similarly cross linked to the hardcopy version
Every staff member gets a copy and there is no need to recommend any. Make it electronic and save on printing and
envelope costs. Journal is good as it is.
Searchable database of contents by issues
I enjoy the variety of themes and articles in the Journal
I assume these questions refer to the hard copy which I don't receive - only received a copy of the version in which I
had an article published
I find it a very useful Journal already
Wider range of contributors including from those providing academic support
Maybe some more general interest areas, e.g. IT corner :)
Greater engagement from authors in raising awareness that the Journal exists and they have a paper in there that
colleagues might like to read
Include more external contributors particularly from partners
A balance of Leeds Met and non Leeds Met
More linking to reusable resources or materials the level of detail needed to build on someone else's practice: more
sharing of stuff it has taken time to develop
Perhaps it would help if it would be widely publicised of the themes to be published. This would help authors to
target when to submit their paper
More case studies and variety
Need to make more challenging for researchers
Articles often sound interesting and relevant, but on reading have such a small area of focus that the material is not
transferable to other areas of teaching
8
Some respondents were very positive about the Journal and commented that they ‘think it is good
as it is’, and comments on what they would like to see more of centred mostly on including articles
sharing good teaching and assessment practices (11). Short news items discussing ongoing research
projects, bids and outcomes, teaching ideas and a reflection on something new in practice was
suggested by respondents. One respondent suggested including updates relating to ALT guidelines
and policies, with Teacher Fellows providing advice. Other suggestions include using more images
and new writers.
What other items would you like to see included/what would you like to see more of?
Examples of proformas/reusable learning objects etc
More special/themed issues
Bigger turnover of writers from the teacher fellow network. Maybe if some writers workshops were offered it might
inspire more folks to submit?
It is a great showcase both for innovative work across the university as well as for more focused research. Often the
showcase of innovative work is more directly of interest and applicable to my work.
Think is good as it is
People who have got bids and the outcomes
Internal as well as external bids
Review articles and/or book reviews
Brief summaries of ongoing projects in the university
Examples of good practice
As above
Not sure
Perhaps an occasional themed call for papers would be useful for some disciplines but the general nature of it seems
to me to work well
Collaboration opportunities
Articles to be more overtly part of the ALT programme strategy
NONE
250 words (ish) on something new in practice
Short 'news' items about ongoing research or teaching ideas which people are trying out.
New writers
Perhaps include recent updates relating to assessment learning and teaching guidelines and policies implemented
across the University - for example - a current area generating significant debate is three week turn-around - it would
be useful to have more information regarding background, implementation, possible obstacles and potential
solutions from Teacher Fellows etc.
I'd love to see more images added to the content
Perhaps variety of things - shorter/longer papers? One page reflections or teaching ideas (perhaps provide a format
for this - what the problem was, what I did, what happened, what you need to know to do it too or something)
More narrative - similar to THES
I think it serves its purpose
Both ends of the spectrum from stand up teaching i.e. Olly Bray to on-line delivery
More discussion of primary research
Articles regarding examples of teaching and assessment practices
9
Future Issues
Participants had a range of suggestions for future editions, the most popular being
internationalisation (6). Focusing on specific faculties/disciplines was also suggested (2). Other
suggestions include student engagement, retention, attendance, group assessments, placements,
volunteering, students with disabilities, feedback and curriculum design.
What themes would you like to see covered in future issues?
Internationalisation
Internationalisation
Historical overview of specific pedagogic topics
Short reports of up-to-date research from other universities
Group assessments/attendance
What about special faculty issues-? especially now we are all looking for more collaborative projects and an
identity with the move to the new structure
Discipline specific issues
Faculty/Discipline specific issues
A CETL edition, bringing together the key outputs and resources from the three Leeds Met CETLs. A
research-focused edition
Employability is a key issue and I hope that edition is produced soon
Not sure
Student participation, evaluation of tutors, more on business engagement, evaluation of available
professional development opportunities
An international theme
Fieldtrips/facilitating academic reading and engagement with seminars
How to overcome difficulties in developing student understanding, how to deliver more interactive sessions,
models of good practice for dealing with student problems, engagement/motivation, more theoretical
perspectives and how to translate into practice
ALT generally is ok
Tips for new teachers
Internationalisation
Special educational needs
Formative feedback
International students
Employability
Student retention
Maybe placements and the benefits of them? I don't know. Could get some students involved
Blended learning pedagogy
Working with diversity and internationalism in teaching and assessment.
Peer mentoring schemes; study skills support; international students
Distance Learning
Curriculum Design
Practice as research
Creativity in assessment
Student engagement beyond the curriculum, volunteering etc
10
Improving the student experience i.e. classroom interaction, supporting weak students, online assessment,
working efficiently and effectively i.e. we over assess etc.
PDP and particularly the development of student academic skills
Do you have ideas for future special editions?
Internationalisation
Personal tutoring
A top tips for teaching idea- a light hearted Christmas issue
Enquiry-Based Learning? An edition with articles co-authored between staff and students? A student
stand-alone edition?
Task Based/Problem Based/Enquiry Based learning might be a useful special edition as we are all involved in
practical or applied education and these are all similar, though slightly different, strategies which may have
wide applications across the university
No
First time authors
An edition that focuses on our RUN partners' contributions or a copy that contains our students'
contributions
There could be so many of these - threshold concepts, pedagogical models of practice...
Assessment to identify students at risk
Special edition on information literacy and librarians who teach
NONE
PG assessment etc.
Employability
student retention
disability
Blended learning pedagogy
Not specifically
Disability
Personal and Professional Development/Personal Development Planning
One which encompasses reports from a whole host of SLWGs or other working groups as well as Unfair
practice boards etc which impact on ALT e.g. attendance, personal tutoring, unfair practice, feedback etc etc
None
Teaching creative technology subjects using blended learning
11
Additional comments
18. Do you have any other comments?
It is a pity more staff do not read it, I don't know what the answer is...perhaps Associate Deans for ALT and TFs
could use parts of it to stimulate discussion in faculty sessions?
I really like the in-house Journal, and I hope it continues
The ALT Journal has been a huge success both in terms of encouraging staff to produce articles for publication plus
in the variety and quality of articles that have stimulated discussion and thought on some key ALT issues.
No
A useful way of getting feedback for ALT articles
Other than I enjoy reading it, no.
Yes, I find the publication useful and would not want it to be rationalised in the current climate of cost reduction!
I like the thematic presentation
NONE
I skim the total contents, and read in detail specific articles (Q6)
Would be good if it were also distributed to learning support colleagues, learning technologists etc
A very valuable resource
I had been working at LMU for a year before I heard of it and though I am a Librarian it would have been useful to
receive a copy at the start of my employment
Sometimes the font colour can be difficult to read
Think the Journal is excellent!
None
I found the process of submitting an article very useful. The review feedback was excellent and it really honed my
writing skills. We need more of this
I like the idea of the Journal but in practice usually find the articles less useful than I had hoped
Linzi Anderson
August 2010
12
Download