Computer Science Department Lecture Capture Case Study Matthew Gracey-McMinn July 2015 1 Contents 1 Overview .............................................................................................................................................. 3 1.1 Challenges ..................................................................................................................................... 3 1.2 Context .......................................................................................................................................... 3 1.3 Implementation ............................................................................................................................ 4 2 Successful Use ...................................................................................................................................... 4 2.1 Feedback from Staff ...................................................................................................................... 4 2.2 Feedback from Students ............................................................................................................... 5 3 Issues .................................................................................................................................................... 5 3.1 Matters of Concern ....................................................................................................................... 6 3.2 Potential Future Issues.................................................................................................................. 7 3.3 Future Plans .................................................................................................................................. 7 4 Summary .............................................................................................................................................. 7 4.1 Common Themes with other Departments and Faculties ............................................................ 8 4.2 Lessons Learnt............................................................................................................................... 8 4.3 Recommendations ........................................................................................................................ 8 2 1 Overview The Department of Computer Science has used Panopto (the software behind the Replay lecture capture pilot project), as a replacement for an earlier podcasting system, for almost three years. The department was amongst the first in the University to employ lecture capture, adopting it independently of the central IT services and in response to requests from groups within the department. They did initially approach IT Services, approximately two and a half years ago, but, at the time, IT Services were investigating various solutions and only later launched a pilot project. Thus, the Department for Computer Science researched available options and decided to implement Panopto. As with most of the rest of the University, the department has chosen an opt-in system. Initially, its use of the software was small, but it has since expanded as more and more lecturers heard about the benefits of the system and asked to participate. 1.1 Challenges The department uses the software for a variety of purposes (student presentations, open days, general lectures, conferences, etc.). Consequently, the software must be versatile enough to meet a diverse range of purposes and different group sizes. Aside from making recordings available to students through WebLearn, the Department of Computer Science also burns conference recordings onto DVDs for conference attendees; hence, the system must be able to output a variety of different formats. The quality of all output formats is of paramount importance (especially for recordings given to non-University members, the quality of which can greatly affect their image of the University). Moreover, as the department’s courses are liable to change regularly, there is little need to store the regular day-to-day lectures for an extensive period of time. However, the department often receives visitors who give talks, and, since these are usually popular proceedings with famous speakers, the department would like to keep recordings of these talks for much longer than those of general lectures. 1.2 Context The department has expanded its use of lecture capture into two buildings, and makes use of the full range of recording functions (audio, slides and video). Consequently, it has had to equip several lecture halls with both visual and audio recording devices. Prior to the start of the project, the department had some suitable equipment, but it has since had to acquire more to meet the growing demand for lecture capture. Although the academics in the department all come from a computing background, there is great variation in each individual’s own enthusiasm for, willingness to use and competency with the lecture capture software (Panopto). Recordings are made available to students in the department, after the lectures have been conducted. As is standard for the University, access is through WebLearn, and therefore restricted to students with the appropriate access permissions. They may be viewed from a variety of locations and at times convenient to the students for study and revision purposes. 3 1.3 Implementation As mentioned above, this department employs an opt-in system. Although most of its lecture rooms are now equipped for lecture capture, the lecture will only be recorded if the lecturer has requested it. Staff are aware of the lecture capture system (having been informed by the local IT support team), and increasing numbers of lecturers have been opting-in to use the system. The most significant factors encouraging them to participate in the system appear to be word of mouth and their own observations of how the initial adopters have benefitted. Lectures for students registered on a course are currently recorded (though the IT staff are open to extending recording capabilities to seminars and tutorials), and usually consist of video, audio, and PowerPoint capture. For conferences, speakers sometimes elect to use other programs for their presentations, or their own laptops, forcing the department to depend upon video only, rather than all three input streams. The recordings are stored ‘in the cloud’, on Panopto’s servers, and are accessible only through WebLearn, thereby restricting access to those students with permission to view the recordings. Conference recordings were made available on DVD, so that graduating students and non-University participants are able to view a recording of proceedings, despite not having an Oxford Single Sign-On password. 2 Successful Use As found in many other departments, students primarily employ the recordings as revision aids, usually just before exams and essay due dates; hence, usage spikes around these times. However, there were also smaller spikes in use just after each lecture, presumably as students reviewed sections they had missed during the live lecture, or to clarify issues they had not properly understood. In every instance, there was successful use of the software; recording regular lectures for students has generally been successful, conference attendees were provided with DVD recordings, open day presentations were recorded without problems, and feedback on student presentations was enhanced by allowing students to watch recordings of themselves speaking (see more under ‘Feedback from Students’). The opt-in system has also proven effective, as shown by increasing numbers of lecturers approaching the IT team to ask that their lectures be recorded. While most lecturers were initially reluctant to use the system, once they saw it in action on other courses and spoke to peers who use it, they become aware of its ease-of-use and benefits, and their initial reluctance tends to dissipate. 2.1 Feedback from Staff The local IT staff note that the Panopto recordings are superior to the previous system that they had employed. They were unhappy with the previous system’s output, particularly the quality of presentation to students. This was compounded by the large amount of effort that was required to edit recordings. They believe Panopto offers a more attractive output format than do other options, and although editing is still necessary, it is significantly easier than it was under the previous system. Further to this, Panopto’s automatic recording capabilities, simplicity, and stability mean that the IT team have had to do little to keep the system running; scheduled lectures are automatically 4 recorded, lecturers themselves activate the software in other instances (after having attended a brief training session run by the local IT team), and there have been no major technical faults. The adoption of Panopto has made lecture capture much easier for the local IT team and reduced their associated workload; the day-to-day running of the system is divided up among other parts of the department’s administrative framework (demonstrating that non-IT specialists can use the system quite effectively). Having previously conducted a lecture capture project, the department already possessed audio and video capture equipment that could be used with Replay. This simplified, and reduced the cost of, installation. Also, under their previous system, recordings were saved to a locally hosted server, which filled up very quickly, and required extra time and cost to run and maintain. During this pilot project, they have stored the recordings on Panopto’s servers, and therefore bypassed this issue. Feedback from academic staff is also very positive, with many lecturers being particularly happy with its ease-of-use, interactivity, and integration with WebLearn. Lecturers’ experiences have been sufficiently positive for them to encourage others to opt-in to the system. 2.2 Feedback from Students Student feedback has also been very positive. Both undergraduate and postgraduate students use the system in much the same manner, and both groups particularly like its ease-of-use and the interactivity it offers. IT staff in the department note that students’ familiarity with social media and internet-based communication tools in general likely informs their willingness to access the recordings, and lecture capture probably ‘makes more sense to them’. Despite fears to the contrary, student attendance at lectures has not declined as a result of introducing lecture capture in the department. As mentioned above, student use of recordings is greatest before exams and essay deadlines, and immediately after lectures. Another use of Panopto is for students to improve their presentation skills. Students give presentations which are recorded, thus allowing them to view themselves speaking and enabling lecturers to give them feedback. A significant improvement in students’ presentation skills has been noted since this was introduced. Additionally, the department has two students with specific learning disabilities. Recordings of lectures have particularly benefitted these students, allowing them to review lectures at their own pace, as many times as required. Finally, DVDs of conference recordings have been provided to graduating students. These conferences take place near the end of these students’ time in Oxford, and so they will lose the ability to access recordings through WebLearn. The department feels this to be a nice gesture that provides students with a memento of their time at Oxford, and can probably be expected to improve the image of Oxford. 3 Issues Technical issues have been few, due to local experience with lecture capture, support from a skilled local IT team, and widespread computing expertise within the department. Despite this, there are some minor matters of concern: 5 3.1 Matters of Concern 1. Slides: Some lecturers prefer to use PDF files in place of PowerPoint presentations. This meant that the presentation could not be recorded as a separate feed within Panopto, and instead the presentation screen had to be kept in shot on the video recording. Further Notes: In fact, Replay is capable of capturing PDFs as part of the screen recording; anything that appears on the screen can be captured by Replay. Additionally, Panopto has Optical Character Recognition (OCR) technology to recognise text within PDF documents. That the local IT team were unaware of this indicates the need for training and information on the system’s capabilities from IT Services. There is a plan for such training to be rolled out alongside the full service next year. 2. Lecturers: While the number of participating lecturers is steadily increasing, there are still many who do not use it, and the interviewee noted that while he would like to see more, he is ‘only the IT guy’ and cannot ‘force them to participate’. Further Notes: It seems likely that the number of lecturers using lecture capture will continue to increase so long as those using it continue to have good experiences. 3. Equipment: While initial costs have been small, the department seeks to improve the quality of recordings, which demands better hardware. Moreover, the department wishes to equip more of its lecture halls with recording equipment. Doing both simultaneously will probably place excessive strain on the budget, and prove financially impossible. Further Notes: While Panopto is a relatively low cost solution, should a user seek high quality video recordings, then high quality cameras are necessary. These can prove quite expensive. If the budget cannot be increased, purchases could be spread over several financial years. Those departments using only audio and slide capture are very unlikely to encounter an issue like this (high quality cameras contribute more to costs than any other equipment). 4. Live streaming: Initial queries about the possibility of live streaming were rejected by the department’s IT team, out of concern for the stress this would place on their bandwidth, and the poor impression that may be given if a technical fault were to disrupt the broadcast partway through (this is a particular worry, as rooms equipped for this sort of broadcasting have only a single camera, so a camera fault would likely prove to be a catastrophic failure). Further Notes: Sustained interest (from lecturers) in the possibility of live streaming has prompted the IT team to reconsider such a project, but this would require further investment in hardware, adding to the budget concerns raised above. Moreover, live streaming to the general public is restricted due to cloud server bandwidth costs; if this is the department’s goal then they should approach Educational Media Services, who offer an alternative commercial live streaming solution for high-profile lectures. 5. Streaming Speeds: Some students have complained of issues with streaming the recordings when using home or college internet connections. 6 Further Notes: The department’s IT team suggested to students experiencing such issues that they should consider downloading the recording from the Panopto servers to their own device before viewing it. This appears to have resolved the issue. 6. Editing: Under the previous system of recordings, editing was a very time-consuming task. Panopto has significantly reduced the amount of time spent on editing, but there are worries that, as more courses are recorded, even this could begin to add up. Further Notes: This is likely to prove a natural consequence of widespread lecture capture, even though Panopto enables faster editing than did the previous system. 3.2 Potential Future Issues 1. Data Storage: The department’s previous foray into recording lectures generated a lot of data, which very rapidly filled their server. At present, they are using Panopto’s cloud service to store their recordings, and prefer this to using their own servers. Switching back to a locally hosted server would necessitate the purchase, managing, and maintenance of such a server, in turn placing further financial burdens on the department. Further Notes: The pilot project being run by central IT Services currently uses a cloud-based solution (i.e. Panopto’s cloud storage system). Even if IT Services were to move to a locally deployed solution, this would be the responsibility of IT Services who plan to roll out a University-wide lecture capture system (called Replay). 3.3 Future Plans The department is keen to roll out the lecture capture system to all its courses, but is adamantly opposed to forcing lecturers to adopt the system. Thus comprehensive adoption is dependent upon encouraging lecturers to use the system. At present their strategy is to depend upon a mixture of word-of-mouth and messages sent to lecturers, outlining what lecture capture can offer. The department’s immediate goal is to equip their final two lecture theatres with recording equipment, so that lecture capture capabilities can be expanded. They will continue to encourage conferences, being held by and at the department, to make use of Panopto’s recording capabilities. Similarly, they will offer use of the software to clubs and societies associated with the Department of Computer Science on occasions when such organisations may wish to keep a permanent record of, or livestream, proceedings. However, use of the Replay system outside of the intended scope of core lecture capture would need to be examined to ensure that cloud bandwidth limits are not exceeded. 4 Summary Overall, the department’s administrative staff, academics, and students are all very positive about their experiences with Panopto. The use of lecture capture in this department is meeting the needs of students and staff, and allowing them to decide for themselves whether or not to make use of the technology. This approach appears to have proven quite successful, as is demonstrated by the steady growth in the number of participating lecturers. The most significant barrier to the spread of Panopto relates to hardware and budget. Without the budget to improve the quality of recording equipment and to expand into new rooms the IT team 7 faces difficult decisions on how to best improve the Panopto service within the department. Nevertheless, these challenges emphasise the fact that Panopto is a useful and desirable tool within the department; the questions being asked relate not to whether or not to continue using the system, but rather, how best to grow it. Lecture capture has not replaced any of the traditional teaching methods employed by the department, nor has it caused any decrease in attendance figures. Instead, it has served as a tool to facilitate the pre-existing teaching and learning methodologies, and has opened up new possibilities, enhancing both learning and teaching experiences. 4.1 Common Themes with other Departments and Faculties Similar to other departments and faculties, staff in the Department for Computer Science have expressed an interest in learning about how other departments are using Panopto (having little formal contact with other departments makes it difficult for them to learn of developments elsewhere within the University). The interviewee also noted that it is very hard to ‘showcase’ the system within the federated University structure. There is a communications plan ready to be rolled out alongside the full service next year, and this should provide a forum for Replay users across the University to share ideas. This case study has highlighted the role that local expertise and equipment can play in easing the adoption of Panopto as a lecture capture system; it has also underlined the need to ensure local staff are trained in effective use of the software. For more details, please view the institutional-level report. 4.2 Lessons Learnt 1. Word-of-mouth is the most potent tool for convincing lecturers of the value of lecture capture. Allowing them to learn of the system and adopt it by their own volition is an effective method of bypassing any resistance they may harbour. This does, however, take time. 2. Integration with WebLearn is a key desirable feature for lecturers. 3. Local expertise eases both the installation and maintenance of the lecture capture system. 4. Pre-existing audio and video capture equipment within the department can reduce installation costs. 5. Hardware limitations can impact upon the quality of recordings. 6. The purchase of high quality video capture equipment can be prohibitively expensive. 7. The recordings are an exceptionally useful tool for students with special learning requirements. 4.3 Recommendations 1. Do not force lecturers to adopt the system. 2. Use local expertise and pre-existing equipment wherever possible, so as to reduce costs and facilitate installation and maintenance. 3. Reduce costs by recording audio and slides only, thus avoiding the need to purchase video cameras (unless strictly necessary). 8