ISD student survey of IT services and facilities – 2013 Contents

advertisement
ISD student survey of IT services and
facilities – 2013
Vicki Dale, Steve Rowett, Jim Tyson and Fiona Strawbridge
24th May 2013
Contents
Executive summary ................................................................................................................................. 2
Introduction ............................................................................................................................................ 8
What students own and use ................................................................................................................... 8
Existing services ....................................................................................................................................13
Getting help – ISD website and service desks.......................................................................................20
Favourite places to study......................................................................................................................22
Technologies for supporting student learning......................................................................................24
Priorities for new or extended services ................................................................................................30
Actions being undertaken to address student feedback ......................................................................33
Potential limitations of the study .........................................................................................................34
Acknowledgements...............................................................................................................................34
1
Executive summary
Following a similar survey in 2011, an online questionnaire was administered to evaluate students’
perceptions of services offered by the Information Services Division (ISD) at University College
London (UCL). The survey was widely advertised electronically and using posters and flyers, and was
open between 23rd January and 4th February 2013. Of 26,698 potential respondents, 1324 students
took the survey (5%), of which 1016 complete responses were analysed. Respondents were evenly
split across the three main schools and between undergraduate and postgraduate students.
Device ownership
Computer and mobile device ownership
Only 26% of respondents have a desktop computer, of which Windows is the predominant operating
system (23%). This is a reduction from 2011, when 37% of respondents owned desktop computers.
Laptop ownership is ubiquitous at 97%, of which Windows is the predominant operating system
(66%), followed by Apple (32%). This also represents an increase on 2011 figures when 87% of
respondents either owned or planned to buy a laptop. Almost all students (99%) in 2013 have either
a laptop or a desktop computer. Despite the high laptop ownership, 42% of students with laptops
rarely or never bring them onto campus, mainly because their laptop is heavy or bulky, or they are
worried about it being lost or stolen or they have nowhere secure to store it. Twenty three per cent
of students have tablets (mainly iPads, 17%). Again, this is an increase on the 9% of respondents in
2011 that either owned or planned to buy a tablet. E-readers are owned by 18% of respondents,
which also represents an increase on the 8% of respondents who owned or planned to buy an ereader in 2011. The majority of owners of tablets and e-readers in 2013 have few concerns about
bringing them onto campus, though users cited connectivity problems with tablets. E-readers tend
to be more used for personal reading (e.g. novels) rather than textbooks which often do not display
well on e-readers. Ninety-one per cent of students have smartphones, of which Apple and Android
are the major platforms, at 37% and 33% respectively. This is an increase on 2011 figures where 56%
of respondents claimed to have, or planned to buy, a smartphone. Only 1% of students in 2013 do
not possess a mobile phone.
Devices used to access core UCL and external services
Most services are accessed using a laptop or desktop (60% on average), followed by a mobile phone
or iPod Touch (28% on average) with tablets being used least of all (10% on average). The most
accessed services are Live@UCL email (95%), non-UCL email (92%) and Moodle (91%). The least
accessed services are Reddit (13%), followed by Linkedin (33%), Twitter and MyPortfolio (both 37%),
indicating that with the exception of Facebook (87% use), Web 2.0 technologies are still only used by
a minority of students.
Existing services
Importance versus satisfaction
Students’ perceptions of importance and satisfaction with 24 existing core services are shown below,
with an accompanying key to explain the data labels. In 2013, a 4-point Likert scale was used,
2
preventing a direct comparison with 2011 data, collected using a 5-point Likert scale; however, an
approximate comparison was not suggestive of any decrease in satisfaction.
Assist tech
campus
Access to assistive technology on computers across the
campus
Laptop space Spaces where you can work comfortably with your own
laptop or tablet, including wireless and power facilities
Assist tech
SENIT
Access to assistive technology within the SENIT suite
Live@UCL
email
Live@UCL email
Assist tech
training
Training on assistive technologies
Lecturecast
Lecturecast: recordings of lectures with audio, video and
slides/visualiser
B&W printing Black and white printing
Moodle
Moodle
Campus wifi Wireless networking on campus
MyPortfolio
MyPortfolio: an electronic portfolio for recording and
sharing your learning
Cluster PCs Computers in computer workrooms for use for taught
classes, available to students when not booked
Quick access Quick access 'kiosk' computers located around the
PCs
campus
Colour
printing
Colour printing
Residence wifi Wireless networking in halls of residence
Group
spaces
Bookable group study spaces with a whiteboard, PC and
large screen display
Secure
storage
Central secure file storage space (filestore), with backup
copies made automatically
ISD service
desk
The ISD Service Desk (formerly the ISD Helpdesk)
Smartphone
apps
Access to services such as the Library or Moodle via a
smartphone app
ISD website IT support information on the ISD website
(http://www.ucl.ac.uk/isd)
Student-only
PCs
Access to student-only computers that are never booked
for taught classes
IT class
training
IT training in a class
Turnitin
Turnitin: confidentially checking your work for possible
plagiarism
IT online
training
IT training online
UCL software Access to UCL software from your own computer
What students like best, like least and most want to change
Students were also invited to comment on what they like best, like least and most want to change.
The top five things that students like best in 2013 are reported below. The data from 2011 are
included for comparison.
3
Things students like best in 2013
(most liked at top)
1. Wireless internet on campus
2. Support (online, helpdesk, training)
3. Moodle and online learning resources
4. Comprehensive, easy, efficient, fast, free,
reliable, up to date services
5. Computers and cluster rooms
Things students liked best in 2011
(most liked at top)
1. Moodle
2. Wireless internet [on campus]
3. Helpdesk
4. Email
5. Computer workrooms
The top five things that students like least in 2013 are reported below. The data from 2011 are
included for comparison.
Things students like least in 2013
(least liked at top)
1. Not enough free computers or clusters
2. Printers and printing (incl. too few printers,
lack of mobile and colour printing and
printers requiring maintenance)
3. Unreliable, patchy or slow wifi (on campus)
4. Limited or slow IT support (incl. limited out
of hours service)
5. Software limited or out of date
Things students liked least in 2011
(least liked at top)
1. Lack of adequate computers and
workrooms
2. Printing facilities
3. Lack of wireless internet in halls
4. Lack of working space with wifi
5. Inadequate or poor use of Moodle
The top five things that students most want to change in 2013 are reported below. The data from
2011 are included for comparison.
Things students most want to change in 2013
(most want to change at top)
1. More computers (in departments, libraries
and around campus)
2. Improve and extend support including more
IT training
3. More printers
4. Wireless/email/mobile/laptop printing
5. Improve wifi (generally, on campus and at
remote sites)
Things students most wanted to change in 2011
(most want to change at top)
1. More computers
2. More laptop-friendly spaces
3. Wireless printing from laptops
4. Ability to run plagiarism checks
5. Recordings of classes [Lecturecast]
UCLGo
Forty-three per cent of respondents had downloaded the UCL Go! smartphone app. The majority of
students (76%) who had used it rated it as useful or very useful overall. The most useful aspects of
the app included campus maps, timetables and the place finder. In their comments, students
expressed most dissatisfaction with the technical reliability of the system, incorrect timetabling and
PC availability and some elements (timetabling, Moodle and maps) not displaying properly. In terms
of additional features, students stated that they would most like to be able to renew library loans
using the app, and some also commented that they would like to access their email via an app.
4
Lecturecast
Only a third of students had watched Lecturecast recordings (32%); however, this is likely to be a
consequence of the fact that not all lectures are recorded by default, which was a common
complaint. Of those that had used the service, the majority (68%) had also attended most or all of
these classes in person. Students were also asked if, given the option of a live lecture streaming
service, they would prefer to attend lectures online or in person; the majority (77%) would still
prefer to attend most or all of their lectures in person.
Getting help from the ISD website and service desks
Respondents perceived the most useful format for getting support to be a service desk supported by
email, followed by IT support information on the ISD website. The most rated aspects of the service
desk were the overall level of service and quality of the advice provided, while students were least
satisfied with the time taken to respond to a reported problem and the time taken for it to be
solved. The ISD website was rated highest for reminders or resetting of passwords, providing quick
access to core services and ‘how to’ guides, while it performs less well in terms of enabling users to
find out more about ISD services including training or resources, and for downloading software.
Learning spaces
Students were asked to identify their favourite places to study, either alone or in groups. The top 10
places to study, and the top 10 reasons, are shown below.
Top 10 favourite study places (most favourite at top)
1. Science Library (incl. pods)
2. Library or libraries (unspecified)
3. Main Library (incl. Law)
4. Own work space (office or lab)
5. Science Library computers
6. Cruciform Library
7. Cafes
8. UCLU (Wolfson) social study space
9. At home (own room, halls)
10.Social study space (unspecified)
Top 10 reasons (most commonly cited reasons at top)
1. Quiet, private, can concentrate, no distractions
2. Access to computers (including wide monitors and software)
3. Resources (books etc.) available
4. Spaces available, spacious
5. Can do groupwork or talk
6. Cosy, warm, comfortable
7. Nice, pleasant, inviting, decor, airy, good lighting
8. Laptop space and plug sockets
9. Effective learning, good working atmosphere
10.Can eat and/or drink
5
Educational effectiveness of technology use
Basic versus enhanced use of learning technologies
Students were asked to identify how technology was used overall to support learning in their degree
programmes. Categories ranged from administrative to fully-online. Use of technology for teaching
and learning was almost equally split in terms of basic (55%) versus advanced (45%) use. Basic use
constituted 27% of administrative functions (handbooks, timetables and assignments submissions
online) and 28% supplementary materials, e.g. lecture notes online. Advanced use comprised 12%
enhanced activities (optional discussion forums and quizzes), 26% integrated activities (mandatory
discussion forums and quizzes) and 7% fully online activities.
Effectiveness of technology use versus preferred level of use
Students also rated the effectiveness of technology use, as well as how much more or less they
would prefer to use the technology. The results are shown below, with the results from 2011
included for comparison, where available.
Most effectively used in 2013
(most effective at top)
1. Handbooks, resources and documents
provided electronically
2. E-books or electronic readings
3. Quizzes or self-tests to support learning
4. Exams (essays or multiple choice) taken on
a computer
5. Online discussion forums
Most effectively used in 2011
(most effective at top)
1. Handbooks, resources and documents in
Moodle
2. Quizzes or tests in Moodle
3. Audio, video and animation
4. Discussion and debates in Moodle
5. Electronic voting handsets or voting via
mobiles
Preferred level of use in 2013 (most preferred at top)
1. Live streaming of lectures
2. Recordings of lectures using Lecturecast
3. E-books or electronic readings
4. Quizzes or self-tests to support learning
5. Handbooks, resources and documents provided electronically
Examples of effective technology use
When asked to provide examples of good practice in relation to the use of technology in teaching
and learning, the top five included (1) basic Moodle use, (2) electronic readings, (3) videos, (4)
PowerPoint, and (5) electronic voting (with clickers and online). Other examples of good practice
included Lecturecast, online quizzes, animations, discussion forums, teachers using the visualiser or
smartboard for electronic writing/drawing/annotation, Turnitin and social media.
Student suggestions for improving technology use to support learning
Many students commented that no improvements were required; of those that did request
improvements, the five most frequently requested were (1) more Lecturecast and lecture streaming,
(2) more computers, (3) better wifi on campus, (4) more printing facilities and better printing
maintenance, and (5) more information, support and training.
6
Priorities for future development
The top five priorities identified by students in 2013 are shown below, alongside the results from the
2011 survey for comparison.
Priorities for new or extended services in
2013 (highest priority at top)
1. Wireless printing from students’ own
devices on campus
2. Ability to send documents for printing via
email
3. More spaces for laptop use with wifi and
power access
4. More scanners with email functionality
5. Access to file storage via the internet
Priorities for new or extended services in
2011 (highest priority at top)
1. Wireless printing from laptops
2. Ability to run plagiarism checks
3. More laptop-friendly spaces
4. Quiet areas with wifi
5. Access to video recordings of classes
These priorities were largely mirrored in the students’ comments, in which they requested (1)
wireless/laptop/mobile printing, (2) more computers or non-bookable clusters, (3) more printing
facilities and better printer maintenance, (4) more spaces for laptop use and group study, and (5)
Lecturecast for all lectures. Additional suggestions included more scanners (with email functionality)
and further development of the UCL Go! app, including support for Windows phones.
Services that students would have liked to have had prior to enrolling on their course included (1)
access to Moodle and course resources including e-readings, (2) email access and support, (3) advice
on how to connect to the wifi, and (4) more information about core ISD services.
In addition to these stated priorities, the ‘importance versus satisfaction’ chart suggests further
areas for improvement:



Access to core services via a smartphone app
Access to UCL software from users’ own computers and
Wifi in halls of residence.
7
ISD student survey of IT services and
facilities – 2013
Introduction
All UCL students were invited to participate in an online questionnaire entitled “Student Experience
of Information Technology at UCL Survey”, informally referred to as the ‘ISD e-learning survey’. The
questionnaire was similar in design to that conducted two years previously, the results of which
were published in 2011. The questionnaire was designed to gather information about students’
device ownership, their perceptions of ISD services in terms of importance and satisfaction, their
experience of the UCL Go! application, effectiveness of technology use on their programme of study,
attitudes towards Lecturecast and live lecture streaming, most and least liked experiences of UCL’s
IT service provision, and priorities for future development. Basic demographics were also collected
(for example, programme and level of study) to allow for between-group statistical comparisons.
The survey was advertised using A3 posters sent to departmental administrators for posting in
student areas, as well as flyers which were distributed by hand to individual students in learning
spaces and social areas around the UCL campus. The survey was also advertised electronically via
student email lists, the student union e-newsletter, the UCL Facebook page, and the UCL_ELE Twitter
account. The survey was opened Wednesday 23rd January 2013 and was scheduled to close 31st
January; however, it was extended until Monday 4th February 2013, to boost the response rate, with
reminders sent electronically. Incentives were offered; two iPads, three Kindles and five £30
vouchers, to survey participants chosen at random.
Of the 26,698 students who could potentially have responded, 1324 did so (5%). Of the 1324
responses, 1016 completed responses were included in the data analysis. Respondents were fairly
evenly spread across the three UCL Schools (35% SLASH, 31% SLMS and 31% BEAMS); 2% did not
include their programme of study, and 1% constituted students enrolled on ‘other’ inter-disciplinary
programmes). In relation to programme levels, the highest proportion of respondents were
postgraduate students (47%), followed by established undergraduates (year 2 and above, 32%), new
undergraduates (year 1, 18%), and non-credit bearing and other courses (2%). One per cent of
respondents did not specify their level of study.
What students own and use
Note that in relation to devices, percentages may not add up to 100, since respondents could
potentially own more than one brand of each type of device, and/or have a number of concerns
about bringing them into college.
Desktop computers
Figure 1 shows that only 25% of students own a desktop computer. The most common operating
system is Microsoft Windows; 23% of students own a desktop PC running Windows.
8
Figure 1: Desktop computer ownership
Laptop computers
The majority of students own a laptop computer (97%), the most common being Microsoft Windows
(66%) and Apple (32%) devices (Figure 2).
Figure 2: Laptop ownership
A significant proportion of laptop owners (42%) never or rarely bring their laptop onto campus, the
most commonly cited reason being that it is too heavy or bulky (61%). Other concerns are shown in
Figure 3.
9
Figure 3: Concerns about bringing laptops into UCL
In the free text comments (where n>=10), students’ reasons for not bringing their laptop onto
campus included:




Wifi connection problems (n=20)
o I always struggle getting connected to UCL network.
There being nowhere secure to store it and worries about loss or theft (n=19)
o I bring it in, but I worry about it being stolen - it’s annoying to have to take it with me
when I go to the toilet etc. - UCL libraries must get some lockers, this would be very,
very useful for students.
There being alternatives e.g. UCL computers or mobile devices (n=17)
o I also don't bring it because there are alternatives: for group work, students who
own light and well working laptops bring theirs. For my individual study, I use the
computers in the cluster rooms. For checking emails and such information I use my
smartphone.
o Easier to bring my iPad, can do almost the same amount of work with an iPad.
Their laptop being heavy to carry around (n=15)
o I don't want to carry my heavy laptop all day.
Other reported concerns or difficulties included being ashamed of an ‘old’ device (n=9), there being
nowhere to charge their laptop (n=9), commuting (public transport or cycling, n=8), and there not
being enough space to use their laptops (n=6).
Tablets and e-readers
Figure 4 reveals that the majority of students do not own a tablet or e-reader (63%). Of those that
do, 18% have an e-reader (e.g. Kindle), and 17% have an Apple iPad or iPad mini.
10
Figure 4: Tablet or e-reader ownership
There is variation in the extent to which students’ bring their tablet/e-reader into UCL to support
their studies; 37% never or rarely bring their tablet or e-reader onto campus, the most commonly
cited reasons being that it lacks appropriate software (6%) and because of the risk of it being lost or
stolen (6%). Other concerns are shown in Figure 5.
Figure 5: Concerns about bringing tablets or e-readers into UCL
In the free text comments, students’ reasons cited for not bringing their tablet or e-reader onto
campus included:
11





Using e-readers for personal reading only (n=9)
o I bring my Kindle every day but not to support my studies, I read novels on it!
Not being able to view PDFs or textbooks properly (n=4)
o I don't use my e-reader because academic books and text books are usually not well
formatted in Kindle format, so I prefer to just get the original books out the library,
than buy a badly formatted book.
Connectivity problems (n=4)
o My tablet does not allow me to connect to local printers and SharePoint, and
therefore I have to carry both my laptop and tablet.
Using the laptop instead of a tablet or e-reader (n=4)
o I don't need to use it for my studies - my laptop is better.
Not enough spaces to work (n=2)
o I always bring [it] into UCL but there is nowhere I find truly comfortable to work. I
enjoy the study space but it is often very crowded!
Mobile phones
Almost all students own a mobile phone (99%). Smartphones constitute 91% of phone ownership,
including 37% Apple iPhone and 33% Android smartphones (Figure 6). A number of students own a
basic mobile phone (18%) although this is not necessarily their only phone.
Figure 6: Mobile phone ownership
Devices used to access core UCL and external services
Table 1 shows that students predominantly use laptops or desktops, followed by mobile phones, and
tablets least of all, to access core and external services. The most accessed services are email
(Live@UCL followed by non-UCL email). The least accessed services are Reddit, LinkedIn and Twitter,
indicating that Web 2.0 tools (with the exception of Facebook, which is the next most used service
after email) are still only used by a minority of students.
12
I use this service
from a desktop or
laptop (%)
Live@UCL email
A non-UCL email account
e.g. Hotmail, Yahoo
Moodle
Facebook
Audio/video internet
telephony e.g. Skype
Lecturecast
Twitter
MyPortfolio
LinkedIn
Reddit
Average %
95
92
I use this service
from a mobile
phone or iPod
touch (%)
52
59
I use this service
from a tablet (%)
Highest
%
15
18
95
92
91
87
77
35
59
29
14
17
11
91
87
77
40
37
37
33
13
60
2
27
3
10
4
28
3
9
3
4
2
10
40
37
37
33
13
Table 1: Access to core and external services from different devices
13
Existing services
Importance of existing UCL services
Figure 7 shows students’ perceptions of the importance of existing ISD services. The services
perceived as most important, based on the percentage of important/very important ratings, are:

Campus wifi;
14




Black and white printing facilities;
Having access to UCL software from the students’ own computer;
Working space to use own laptop including wifi and power source; and
LIVE@UCL email.
15
Figure 7: Perceived importance of existing services
Satisfaction with existing UCL services
Figure 8 depicts students’ satisfaction with existing services. The services that users are most
satisfied with, according to the percentage of satisfied/very satisfied ratings, are:





LIVE@UCL email;
Moodle;
Campus wifi;
Black and white printing; and
ISD website.
16
Figure 8: Satisfaction with existing services
Satisfaction versus importance
Figure 9 is a scatterplot showing the percentage of respondents who rated importance positively
(important/very important) on one axis, and satisfaction positively (satisfied/very satisfied) on the
17
other, after excluding those who selected ‘Don’t know’. (The horizontal and vertical reference lines
represent the mean values for importance and satisfaction.)
Figure 9: Importance versus satisfaction with existing core services
Assist tech
campus
Access to assistive technology on computers across the
campus
Laptop space Spaces where you can work comfortably with your own
laptop or tablet, including wireless and power facilities
Assist tech
SENIT
Access to assistive technology within the SENIT suite
Live@UCL
email
Live@UCL email
Assist tech
training
Training on assistive technologies
Lecturecast
Lecturecast: recordings of lectures with audio, video and
slides/visualiser
B&W printing Black and white printing
Moodle
Moodle
Campus wifi Wireless networking on campus
MyPortfolio
MyPortfolio: an electronic portfolio for recording and
sharing your learning
Cluster PCs Computers in computer workrooms for use for taught
classes, available to students when not booked
Quick access Quick access 'kiosk' computers located around the
PCs
campus
Colour
printing
Colour printing
Residence wifi Wireless networking in halls of residence
Group
spaces
Bookable group study spaces with a whiteboard, PC and
large screen display
Secure
storage
Central secure file storage space (filestore), with backup
copies made automatically
ISD service
desk
The ISD Service Desk (formerly the ISD Helpdesk)
Smartphone
apps
Access to services such as the Library or Moodle via a
smartphone app
ISD website IT support information on the ISD website
(http://www.ucl.ac.uk/isd)
Student-only
PCs
Access to student-only computers that are never booked
for taught classes
IT class
training
IT training in a class
Turnitin
Turnitin: confidentially checking your work for possible
plagiarism
IT online
training
IT training online
UCL software Access to UCL software from your own computer
Areas that are priorities for development, on the basis of higher importance and lower satisfaction,
are:
 Central secure file storage
 Spaces to use laptops with power and network facilities
 Access to core services via a smartphone app
18



Access to student-only PCs that are never booked for teaching
Access to UCL software from users’ own computers and
Wifi in halls of residence.
UCLGo! application
Forty three per cent of students had downloaded the UCLGo! app; 56% had not downloaded it and
1% were not sure if they had downloaded it or not. Figure 10 shows that the majority (76%) of users
who had used it rated it as useful or very useful overall. Based on the percentage useful/very useful
ratings, the top three features of the app (apart from its overall usefulness) are campus maps,
timetables and the place finder, while the least useful features were news feeds, the staff directory
and web links.
Figure 10: Perceived usefulness of UCL Go! app and its features
In the text comments (where n>=10), students expressed dissatisfaction with:



The technical reliability of the system (n=27)
o The stability of the app on android needs to be MUCH better, it crashes about half of
the time I use it. This doesn't stop me from using the app, but I know people who
take pictures of their timetable for the week instead of using the app because of its
instability.
Incorrect timetabling or PC availability (n=16)
o Although I find PC availability very useful, it is often inaccurate, indicating there are
free computers in a cluster room when in fact there aren't.
o Sometimes personal timetables are not very accurate – there are discrepancies
between the app and the timetable available online.
Timetable not displaying properly (n=15)
o Not everything appears on my personal timetable that would appear when accessing
from a PC e.g. tutorials and practical sessions.
19



Not being able to stay logged in (in Moodle, n=14)
o Having to log into Moodle every time is very annoying and seems pointless as you
have already had to log into the app and it is only available on smartphones that
most people have codes to get into.
Moodle not displaying properly (n=13)
o The Moodle interface isn't well optimised on Android and iPhone devices.
Limitations to the map and place finder features of the app (n=11)
o Fix the map; it either loses its resolution so you can't zoom in or it causes the app to
crash.
o The campus maps and place finder are not useful when trying to find a specific room
for example: G26 in the South Wing.
Despite these limitations, there was also positive feedback from students (n=11), such as:
o Everything the app intends to do is extremely useful.
The most frequent suggestion for future development was the ability to renew books using the app
(n=16). Other miscellaneous suggestions included access to email from within the app (n=3), the
location of all rooms on campus (n=3), and access to Lecturecast via the app (n=2).
Lecturecast
Thirty two per cent of respondents had used Lecturecast to watch recordings of lectures online. Of
those that had used this service, the majority (68%) had also attended most (33%) or all (34%) of
these lectures in person. Only 11% did not attend any lectures in person, and 21% attended some of
them.
Participants were also advised that UCL are considering a service to offer lectures to be streamed
live, but with additional facilities to allow them to vote on questions put to them, ask questions of
the lecturer, or take part in class discussions. The majority (77%) would still prefer to attend most
(53%) or all (24%) of their lectures in person. Only seven per cent of respondents would watch all
their lectures online, and 16% would watch most of their lectures online.
What students like best
Respondents were asked to state the three things that they like best about UCL’s IT provision. These
are listed in Table 2. Some of the individual text entries encompassed two or more aspects. Wifi on
campus, support and Moodle were the most popular.
20
Service
Wireless internet on campus
Support (online, helpdesk, training)
Moodle and online learning resources
Comprehensive, easy, efficient, fast,
free, reliable, up to date services
Computers and cluster rooms
Email (Live@UCL)
Printing
n=
254
228
208
166
104
97
80
Service
Library services including e-journals
Lecturecast
Software including anti-virus
Accessibility and availability
(of hardware, information and support)
Remote access (WTS)
UCL Go! app
n=
74
55
54
52
38
32
Table 2: Aspects of UCL's IT provision that students like best (categories where n<20 omitted for brevity)
What students like least
Respondents were invited to state up to three things that they like least about UCL’s IT provision.
These are listed in Table 3. The lack of open-access computers was overwhelmingly the least liked
aspect, followed by printing services.
Service
Not enough free computers or clusters
Printers and printing (incl. too few
printers, lack of mobile and colour
printing and printers requiring
maintenance)
Unreliable, patchy or slow wifi (on
campus)
Limited or slow IT support (incl. limited
out of hours service)
Software limited or out of date
Password changes and requirements
Faulty or broken equipment (including
printers)
ISD website (lack of information about
services or facilities hard to find)
Poor or no wifi in halls of residence
n=
241
158
Service
Email (Live@UCL and predecessors)
Lack of laptop and social/group study
spaces
n=
32
31
75
Lecturecast – not used enough
31
67
Remote access
29
54
49
45
Old or slow computers
Inadequate file storage
Scanners and scanning
29
28
26
39
Printing and photocopying charges
25
34
Difficulty configuring wifi or email
22
Table 3: Aspects of UCL's IT provision that students like least (categories where n<20 omitted for brevity)
What students would like to change
Respondents were invited to state up to three things that they would most like to change about
UCL’s IT provision. These are listed in Table 4.
21
Service
More computers (in departments,
libraries and around campus)
Improve and extend support including
more IT training
n=
180
n=
31
49
Service
Less frequent and easier password
changes
Printing – easier or better (in general,
including duplex and centralised printing
and swipe card printing)
More information about available
services, including improved ISD website
Printing and photocopying – cheaper or
more free credit
Help lecturers to use e-learning more
extensively and effectively
Newer and quicker computers
More printers
73
Wireless/email/mobile/laptop printing
71
Improve wifi (generally, on campus and
at remote sites)
More Lecturecast and live streaming of
lectures
Software – more, up to date, and freely
available for download
More laptop and social/group study
spaces
Wifi in halls of residence
Improve remote computing
61
48
Integrated systems / single sign-on
25
47
Increased file storage
22
39
37
More scanning facilities
Develop UCL Go! app
22
20
87
31
30
26
26
25
Table 4: Aspects of UCL's IT provision that students would most like to change (categories where n<20 omitted for
brevity)
Getting help – ISD website and service desks
Importance of ISD support formats
Figure 11 shows preferences for different support formats, ordered by the percentage of
important/very important ratings. The most important format for ISD support is a service desk
supported by email. The least important format is printed computer support information.
Figure 11: Perceived importance of ISD support services
22
ISD Service Desk
Figure 12 shows participants’ ratings of different aspects of the ISD service desk support, ordered by
the percentage of good/very good ratings. The majority of users consider the service desk to be at
least ‘okay’, with the exception of the response time to get the problem solved, and the time taken
to speak to someone about the problem.
Figure 12: Ratings of aspects of ISD service desk
ISD website
Figure 13 shows that the majority of users considered aspects of the ISD website to be at ‘okay’,
‘good’ or ‘very good’. Based on the percentage of good/very good ratings, the most valued services
include reminders/resetting of passwords and providing quick access to core services. The lowest
rated service offered by the website was downloading software followed by finding training courses
or resources.
Figure 13: Ratings of ISD website services
23
In the text comments (where n>=10), students expressed dissatisfaction with:



Password changes being too frequent and difficult (n=25)
o Would prefer not to have to change my password so frequently and the strict
requirements for it. It is such a convoluted process that I end up writing my password
down when I finally choose an acceptable one. Not very secure...
Disorganised / not easy to navigate (n=21)
o I believe the website would benefit from a rearrangement. All necessary and useful
information is present on the site but much of it can be difficult to find, i.e. Live@UCL
mobile configuration guides, reducing Myriad profile storage space. Making this
information more accessible will enable the students to become more self-sufficient.
Guides out of date or not helpful (particularly for mobile access to services) (n=10)
o Sometimes changes are made but students are not informed and you have to figure
out why the wireless doesn't work anymore (apparently because some port number
has changed or something). Every document on the ISD website should have a date
of when it was last updated on it and changes should be highlighted.
However, 13 respondents made positive comments about the website, one example being:

Really useful - have used numerous times. The how-to guides are brilliant and save me a
lot of time.
Possible new or extended ISD support services
Of the potential new or extended services listed, the most popular was laptop troubleshooting
support (55%), followed by a wireless set up service (54%), a drop-in IT advisor centre (38%), help
with mobile devices (36%) and an out-of-hours service desk (35%).
Of only 34 comments relating to new or extended ISD support services, the most common were
laptop repair and troubleshooting (n=5) and out of hours support (n=4). Miscellaneous unique
requests included internet safety advice, computer buying advice, software installation support and
extended opening hours of accessibility services from 9 to 5.
Favourite places to study
Some students stated that there was nowhere suitable on campus to study (n=22). Examples
included:
I don't have a favourite place; I think places on campus to study (e.g. library) are just
too crowded, even looking for books on the shelves of the library can be a hassle
because you have to stand too close to people studying.
Currently, there is no suitable space. The ideal space would have power points at
every desk, easy access to bathrooms (which are few and far between at UCL and
often in an unusable state) and a coffee/snack bar.
24
Table 5 shows students’ favourite places to study (where n>=10).
Favourite places to study
Libraries (n=445)
Top spaces
 Science library (n=144)
 Library or libraries (unspecified, n=129)
 Main library (incl. Law, n=111)
 Cruciform library (n=32)
 Archaeology library (n=18)
 Senate House/British library (n=10)
Computer clusters (n=80)
 Science library computers (n=34)
 Cluster (unspecified, n=12)
Own space (my desk, room, flat,
 Work (office, lab, n=39)
halls, office or lab; n=70)
 Home (my room, halls, n=24)
Social study spaces (n=67)
 UCLU (Wolfson study space, n=25)
 Social study space (unspecified, n=21)
 Cruciform pilot room (n=11)
 Group study room (incl. Science library pods, n=11)
Common rooms (n=43)
 Common room (unspecified, n=22)
Cafes, bars and refectories (n=41)  Cafes (Print Room, Bloomsbury, George Farha, etc. (n=31)
Other spaces (n=97)
 Empty or quiet classrooms (n=12)
 Foster Court rooms (n=11)
 Chandler House (n=10)
Table 5: Students' favourite places to study, either alone or with friends (where n>=10)
The top reasons cited for favourite places to study, where n>10, included



















quiet, private, can concentrate, no distractions (n=268)
access to computers (including wide monitors and software, n=99)
resources (books etc.) available (n=95)
spaces available, spacious (n=76)
can do groupwork or talk (n=71)
cosy, warm, comfortable (n=67)
nice, pleasant, inviting, decor, airy, good lighting (n=64)
laptop space and plug sockets (n=55)
effective learning, good working atmosphere (n=55)
can eat and/or drink (n=34)
convenient, accessible (n=33)
relaxed, friendly, enjoyable, social (n=32)
furniture (tables and seating, n=28)
neither too quiet nor too noisy (n=19)
wifi (n=17)
access to printer and or scanner (n=17)
help and support available (n=11)
close to restrooms, shops or cafes (n=11)
flexible space (for individual or group study, n=10)
25
Technologies for supporting student learning
Types of technology use
Figure 14 reveals that the largest use of technology in students’ programme of study is
supplementary (28%), followed by administrative (27%), integrated (26%), enhanced (12%) and fully
online (7%).
Figure 14: Predominant type of technology use in students' programme of study
Administrative = handbooks, reading lists, timetables and assignment submission
Supplementary = core and supplementary learning resources (e.g. lecture slides) but no requirement to use them)
Enhanced = includes a range of activities (e.g. discussion forums and/or quizzes) but no requirement to use them
Integrated = includes a range of activities (e.g. discussion forums and/or quizzes) and students are expected or required to
complete them
Fully online = all or nearly all study takes place online and students are required to complete activities
Effectiveness of technology use
Figure 15 shows students’ perceptions of how effectively different technologies are used to support
teaching and learning. One the basis of the percentage of effective/very effective use, the five most
effectively used technologies included:





Handbooks, resources and documents provided electronically;
E-books or electronic readings;
Quizzes or self-tests to support learning;
Exams (essay or multiple choice) taken on a computer; and
Online discussion forums.
26
Figure 15: Effectiveness of use of different learning technologies
Preference for less or more types of technology use
Figure 16 shows students’ preference for more or less use of various technologies. On the basis of
the percentage that students would like more/much more of, the five technologies that students
want to see most of are:





Live streaming of lectures;
Recordings of lectures using Lecturecast;
E-books or electronic readings;
Quizzes or self-tests to support their learning; and
Handbooks, resources and documents provided electronically.
27
Figure 16: Preference for use (less versus more) of technologies
Effectiveness versus preference for amount of use of different technologies
Figure 17 shows that electronic readings/e-books, quizzes and Lecturecast recordings are the most
effectively used technologies that students want more of. On average, students want more or the
same level of use of all technologies.
28
Figure 17: Preferred amount of use versus effectiveness of technology use (after excluding ‘Not used’/‘Not sure’
responses)
Blogs
Blogs, journals or electronic diaries
Media sharing
sites
Photo or video sharing websites
Clickers
Electronic voting with 'Clickers' in classes
MyPortfolio
Creating and sharing work with MyPortfolio
Consuming
media
Consuming audio, video, and animation
Online forums
Online discussion forums
E-books
E-books or electronic readings
Producing
media
Producing audio, video and animation
Free
resources
Freely available resources like YouTube and the
Khan Academy
Quizzes
Quizzes or self-tests to support your learning
Handbooks
Handbooks, resources and documents provided
electronically
Simulations
Simulations or educational games
Exams on
computer
Exams (essay or multiple choice) taken on a
computer
Social
networking
Social networking tools like Facebook or LinkedIn
Lecturecast
recordings
Recordings of lectures using LectureCast
Webinars
Virtual classrooms or webinars
Live
streamed
lectures
Live streaming of lectures
Wikis
Wikis or collaborative document creation
Examples of effective technology use
When asked to provide one example of how lecturers have used technology to effectively support
learning, the following were cited (where n>=10):

Basic Moodle use (uploaded lecture slides and notes and website links, n=138) for
preparation and revision
o The stuff used by the teacher during lectures is available before the class so the
students can get ready for the lesson.
o Access to course notes and PowerPoint presentations online helpful, to avoid writing
frantically in lectures and to be able to follow/understand better.
29










E-readings (on Moodle, n=95)
o Essential readings are saved as PDFs to Moodle - this is useful as it means you don't
have to fight over a single library book and you can access them even if you are not
at uni.
Videos including YouTube for visualisation, vicarious learning and laboratory preparation
(n=95)
o Showed us videos of Mars rover landing on Mars, this helped us to realise what
surface of mars is actually like without having to imagine.
o Videos showing lab demonstrations were put onto Moodle before we entered the
lab. This helped me to understand exactly what was required of us in the lab, and
helped me to prepare as fully as I could by reading more about the techniques we
were going to use. It also saved time because the lecturers did not have to
demonstrate the practical in front of all of us in the lab.
PowerPoint for visual presentation in class (n=88)
o PowerPoint presentations. They are useful because they are the most effective way
of displaying clear, large images.
E-voting (n=64); includes clickers (n=48), online polling, format unspecified (n=13) and
PollEverywhere (n=3)
o The use of clickers is very helpful because it engages everyone to take part and we
can automatically evaluate and get feedback on our answers. In addition, the votes
are anonymous, which helps people in voting.
Lecturecast for consolidation and revision (n=63)
o Using Lecturecast. This has really helped to go over the parts of the lecture which I
didn't fully understand / didn't have time to write down so quickly. It helps me to
consolidate smaller parts of the lecture, as I can pause whenever I wish to do so.
Online quizzes (including Peerwise) and computer-based assessments (n=44)
o I found online practice quizzes very good and particularly useful, as it is a great way
to consolidate knowledge and it gives a precise idea of what you're expected to know
for the actual test.
Animations for visualising concepts (n=19)
o Animations are great to visualise complex processes e.g. DNA synthesis, protein
folding, Krebs cycle.
Discussion forums (in Moodle) (n=17)
o Moodle forums used to guide class discussion and encourage further engagement
with the topic after a seminar.
Electronic writing/drawing/annotation using visualiser or smartboard (n=13)
o Writing on board electronically, exactly what was on the board is then available on
Moodle. Very useful.
Turnitin for online course submission, marking and feedback (n=13)
o The use of Turnitin with feedback returned online on the essay has been incredibly
beneficial, because I can actually read the comments (no dodgy hand writing) and
the feedback provided is of a higher quality than would be in written form
30

Social media (n=11); includes wiki (n=3), virtual conferencing (n=3), Facebook (n=3 and
blogs/MyPortfolio (n=3)
o One of my supervisors has set up a Facebook page for networking with academics in
my field.
o In a practical project we used MyPortfolio, it was useful because we could share,
compare and comment in each other work, arriving to more general findings
according to everybody data and receive feedback.
o Google Documents was used to make a big collaboration project between 15
students. It was easy to share each other’s works as well as comment and
collaborate in general.
Other examples of good practice included e-tutorials (n=9), simulations and games (n=7), software
demonstrations (e.g. MatLab, n=4) flipped lectures (c=3) and open educational resources such as the
Khan Academy (n=3).
Students’ suggestions for improving technology use to support learning
In relation to suggestions and comments for improving the use of technology to support student
learning a UCL, the most common response (n=120) was that no improvements were needed. This
was evidenced in the following quote:
I think UCL does a very good job of supporting technology for its students,
especially considering the size of the student body. It must be very difficult to
support so many needs! I have been very happy with everything I have
encountered thus far.
Other participants requested the following improvements (n>=10):







More Lecturecast and lecture streaming (n=89)
o The most important of the ones that were mentioned are probably the live streaming
and Lecturecast one. These would be an immensely important addition. In case
someone is sick, he/she can still 'be' at the lecture and thus not miss any classes.
More computers (n=38)
o Quite simply: the provision of computers is woefully inadequate, even with
designated postgraduate 'clusters'.
Better wifi (on campus, n=27)
o Some areas of UCL campus have poor wi-fi signal.
More printing facilities and better printer maintenance (n=26)
o MORE PRINTERS PLEASE. Printing is very difficult - it takes up so much of my time to
find one and queue to print - seems like a huge waste of valuable time on campus.
More information, support and training (n=26)
o Have more IT support staff available especially in the cluster rooms.
More course materials on Moodle (n=16)
o Lecturers should put more resources on Moodle.
Wireless or mobile printing (n=15)
o The ability to send documents to print from our laptops over the internet would be
very useful. I have been stuck having to stick my documents on a USB drive, go to a
31





cluster room, and print from one of the cluster computers - which can be very time
consuming.
More e-books/journals and online reading lists (n=14)
o I would like [my department] to create an electronic bulletin board where all the
week's reading lists could be published - at present, they stick post it notes on a cork
board.
o The use of e-books or handbooks, which are also published in e-book format would
be great. Now I have to carry several kilos of books with me all the time.
More laptop and group study spaces (with computers)
o More study pods with computer and a big screen and whiteboard.
o Have more spaces to sit and work quietly with laptop.
Newer and faster computers (n=12)
o It would be great if computer which performs faster and bigger display can be
provided for use of student in campus. I studied in America before and in comparison
the computers they provide is much better.
Wifi in halls (n=11)
o Provide wireless internet connection in college residence house so that students can
connect to internet on their smartphone/tablets in their rooms.
Increased technology use in learning and teaching generally (n=10)
o Training ought to be given to the lecturers and professors - they are the ones who
will take the lead on how much technology is used. I, for one, would be happy to see
more tech in the classroom.
Additional miscellaneous suggestions include laptop or iPad loans (n=7), greater use of online
discussion forums and other online collaboration tools (n=7), better remote computing (n=7),
Lecturecast improvements (n=7), opening up Moodle courses to other students (n=5), quiet
computer areas (n=4) and more quizzes (on Moodle) for revision (n=3).
Priorities for new or extended services
Based on the percentage of useful/very useful ratings, Figure 18 shows that the top three priorities
for future development are wireless printing from students’ own devices, the ability to send
documents for printing from home or on campus, and having more scanners with the ability to email
a copy of the scanned document.
32
Figure 18: Perceived usefulness of new or extended services, to identify priorities for development
The students’ enthusiasm for new and/or extended services is well illustrated by the following
quote:
All these ideas seem amazing, they'd really make a difference. I particularly like the
laptop borrow one, wireless printing, the first few I’ve listed as "very important" are
brilliant and I'm going to look into this UCL Go! app. If even half of these ideas are
implemented and publicised I can imagine it would be hugely useful and appreciated by
everyone. More spaces to use your own laptop is also a good one since the library can
get pretty packed and most people really don't want the books, it's the space to study
that they seek!
33
Specifically, students requested:







Wireless/laptop/mobile printing (n=35)
o Getting documents printed by email, or wireless printing on campus, would be so
amazingly useful that I'd go beyond "very" [useful] if I could.
More computers or non-bookable clusters (n=28)
o The most important service to me would be more computers available for studentonly use. Or if staff did not insist people not in their classes left the room, even when
there are many available PCs. It's a waste of resources.
More printing facilities and better printer maintenance including a map of printers and their
live status (n=26)
o Having a live map of printers available + their status (on/off, out of ink/paper etc.)
would be very useful - just like the IT cluster map.
More spaces for laptop use and group study (n=13)
o There is a desperate need for study space which allows quiet, uninterrupted work.
o More rooms like the pilot room in the cruciform would be very useful, as it is a good
space to go and work in, where you are allowed to talk and discuss things, rather
than being made to work in silence.
Lecturecast for all lectures (n=12)
o I think Lecturecast is a good concept already, maybe try and improve it, or at least
have all lectures available to watch online.
More scanners (with email function, n=11)
o Email scanners are incredibly useful: SOAS Library has recently upgraded all its
photocopiers to ones with this capability, and I use the scan function almost
exclusively instead of photocopying.
UCL Go! app development, including support for Windows phones (n=10)
o UCL Go! Doesn't work on my Android phone which is very frustrating, as people seem
to find it useful.
Other miscellaneous requests included live streaming of lectures (n=9), laptop or iPad loans (n=9),
increased, online storage like Dropbox (n=9) and improvements to Lecturecast (n=4).
Services students would like to have had prior to starting their course
With regards to services or information that students would have liked before starting their course,
the overwhelming response was that students did not need anything other than that already
provided (n=128). However additional services or information that students would have liked
included:




Access to Moodle and course resources including reading material (n=19)
Email access and support (n=11)
Advice on how to connect to the wifi (n=11)
More information about core ISD services (n=10)
Other miscellaneous requests included more information about computers and printers including
location (n=8), software information and access (n=8), information about UCL Go! app (n=6), help
logging in (n=5) and timetable access (n=5).
34
Actions being undertaken to address student feedback
In relation to the requests from students for development of new and additional services, and areas
of least satisfaction, a number of improvements are already underway, and further work is planned
during 2013. Examples of short-term improvements are listed below.









Lack of computers – a laptop loan scheme is being introduced during summer 2013, to
provide additional computing facilities, for students without laptops or who prefer not to
bring their laptop onto campus. Up to 100 additional open access PCs will also be installed
where there is space available.
Outdated computers – a significant investment is being made to upgrade a number of
available PCs.
Printing and scanning facilities – the Print@UCL initiative is currently being piloted within
ISD before being rolled out across the campus; this is a new print/scan service allowing
students to print wirelessly from their own devices using multifunctional devices which have
the option of colour and duplex printing and scanning. In addition, print jobs may be
collected from any printing device, giving students more immediate access to print facilities.
Wifi in halls of residence – another significant investment being made in 2013 is the
installation of wireless internet access in halls of residence.
Lecturecast (increased use and quality) – development of the Lecturecast service is being
undertaken in relation to the Lecturecast service review. Efforts are underway to engage
academics as part of a Lecturecast user community, and consultations with academics and elearning consultants at other universities are ongoing with regards to optimising the quality
of the service. During 2013, additional investment is being made into device replacement,
disk space capacity planning and scoping of the live streaming facility.
Spaces for laptop and group study – various ‘quick win’ initiatives have been implemented
over the past year, and a comprehensive programme of upgrades to learning and teaching
spaces in terms of updated computing facilities and furniture is being carried out over
summer 2013. A student room booking system will also be piloted over summer 2013, to
allow students to reserve seminar rooms and library pods for group work. In the longer
term, the new Student Centre, expected to be functional by 2016/17 will also provide new
social learning spaces for individual and group study.
Encouraging staff to use learning technologies more – the E-Learning Champions initiative,
led by E-Learning Environments, seeks to enthuse and empower academic staff to use
e-learning more in their teaching, and to inspire colleagues to do the same. Other initiatives
are planned which will help to expand the use of e-learning throughout UCL. In terms of
helping staff to become more confident in using classroom technologies, an innovative
classroom is planned for summer 2013 to offer an experimental learning and teaching space
for training academics.
ISD support and training – the ISD website is being overhauled and redesigned over the next
year to give easier access, via a more navigable interface, to relevant and up to date
information.
System integration and single sign-on – Moodle/Portico/CMIS integration is being
improved.
35
Potential limitations of the study
In terms of reliability of the data, potentially anyone who was not a UCL student could have
completed the survey, since access to the survey was not password-protected. To try to reduce this
possibility, all incomplete responses were excluded from the study.
With regards to response bias, it is possible that students who responded to the survey were those
with greater access to computers and mobile devices, or who had a greater interest in UCL’s IT
service provision than other students. This was unavoidable and all attempts were made to engage
UCL students to participate in the survey.
Acknowledgements
ISD would like to thank all the study participants who took the time to complete the questionnaires,
and to compile thoughtful text responses, all of which will be used to influence decisions regarding
the development of existing and new ISD services to support learning and teaching.
36
Download