The Student Voice on Blended Learning Dr Yongmei Bentley The University of Bedfordshire The 5th International Blended Learning Conference University of Hertfordshire 16-17 June 2010 The University of Bedfordshire Figures 19,000 students 100+ countries represented 1,000 staff 1,700 study bedrooms (500 en-suite) 44% of students aged over 25 years 3 main campuses in Luton and Bedford 4 faculties 9 Research Institutes £134m invested in facilities by the Academic Year 2010-11 Source: http://www.beds.ac.uk/aboutus/facts Strategic Partners The Business School Over 4000 students – over 2,500 undergraduates, over 1,500 postgraduates. Over 100 academic staff, including 15 Professors. Achieved a grade 4 in Tourism and Leisure in the recent RAE and a 3a in Business and Management. Offering practical, relevant, vocational courses underpinned by research excellence. A budget of over £20 million Teaching and study facilities at Putteridge Bury Objective of this Presentation This presentation reports the students’ blended learning experiences based on a recent investigation into the teaching and learning approaches adopted for the University’s Executive MBA programme. The aim of this research is to examine the students’ experiences and evaluate the effectiveness of the course delivery system that has been in place, and to identify scope for further improvement. The MBA Programme The MBA students (N=362) Master of Business Administration & Executive MBA Marketing Products and Services in a Dynamic Environment (15) Leadership Project (30) Induction, team building and cross-cultural communications Accounting for leaders (15) Mobilising Creativity and Innovation (15) Operations and Project Management (15) Entrepreneurship & small business Management (15) Thriving in a Competitive Global Context (15) Professional Development Mentoring, reflective diaries, careers and skills, employability and networking Integrated Management Project (30) Strategy (15) Leading and Managing People (15) Packaging of MBA Course Online interactive learning approach Pod cast/ video, lectures, case studies, discussions, interviews, news etc. Direct Learning Online Learning Sessions Modules Collaborative Learning Online brainstorming & discussions (text and voice boards) WIMBA Live classroom, WIKI, BLOG Work based projects, assignments Work Based Activities Assessment Presentations, group activities, Individual tasks examinations and on-line tests PDP MBA student, working professional Business School day Three-hour classes per unit monthly Local ‘facilitators’ – practitioners, academics An agreed programme of activities: Clarification Case studies Presentations Assessment work Assessments 26% Group Work; 74% Individual Effort 22% Written Examination Work 14% Oral Presentations 64% Written ‘Assignment’ Work Case Study Analysis Reports Business Plans Research Method: Two rounds of questionnaire surveys The first - covered four sites - Oman, India, UK, and Poland, and carried out between April and July 2008 (delivered both online and off-line). The 2nd - covered only the Oman and India sites, and took place between January and March 2009 (online). Participants: the MBA students on the programme. Number of participants First round: 63 questionnaires were answered out of a total number of 227 students. Response rate: 28% Second round: 37 questionnaires were answered out of a total of 191 students. Response rate: 19% The survey: topics and areas Topics: Learning and teaching strategies, the quality of online learning delivery, the means of assessment, and the support mechanisms that were already in place. Areas: Registration and induction Business School days (face-to-face teaching) Other teaching support Assessment Social networking Overall learning experience. Comments were also invited where appropriate in order to seek for new solutions. Overview of the 1st round of questionnaire response rates Country No. of students No. of respondents % as total no. of students Oman 143 30 21% Indian 41 18 44% Poland 30 9 30% UK 13 6 46% Total 227 63 Average: 28% Findings: Teaching &Tutor Support Area of Investigation Excellent (%) Good Average Poor (%) (%) (%) % of Excl.& Good vs. % of Av. & Poor Teaching at Induction Teaching at local institution 20 60 16 4 80 vs. 20 18 58 24 0 76 vs. 24 UK Tutor support 11 51 33 5 62 vs. 38 Local Tutor support 15 45 33 7 60 vs. 40 Local support facilities 9 51 26 14 60 vs. 40 Course/Units response Unit information from local institution Overall experience with the tutors 2 47 42 9 49 vs. 51 9 67 22 2 76 vs. 24 24 51 23 2 75 vs. 25 Findings: Learning Resources Area of Investigation % of Excl.& Excellent Good Average Poor Good vs. % (%) (%) (%) (%) of Av. & Poor Learning resources 22 45 22 11 67 vs. 33 Usefulness of CD ROMS 20 44 22 14 64 vs. 36 Quality of CD ROM materials 20 58 20 2 78 vs. 22 Audio/video clips 3 45 21 31 48 vs. 52 Textbook availability 18 33 22 27 51 vs. 49 Unit Handbooks 22 47 27 4 69 vs. 31 Findings: Online Support Area of Investigation % of Excl.& Excellent Good Average Poor Good vs. % (%) (%) (%) (%) of Av. & Poor Reading materials on BREO 26 38 27 9 64 vs. 36 PPT slides on BREO 25 44 25 6 69 vs. 31 Voice Café via BREO 11 26 25 38 37 vs. 63 Relevant website links 15 43 29 13 58 vs. 42 IT training and support 11 35 42 12 46 vs. 54 Overall experience of online support 8 49 36 7 57 vs. 43 Findings: Assessments Area of Investigation Excellent Good Average Poor (%) (%) (%) (%) % of Excl.& Good vs. % of Av. & Poor Assignment instructions 16 53 27 4 69 vs. 31 Assignment submission procedures 16 55 13 16 71 vs. 29 Assignment feedback 15 36 29 20 51 vs. 49 Referral procedure 13 57 23 7 70 vs. 30 Failure procedures 18 39 17 26 57 vs. 43 Academic offence procedures 16 44 16 24 60 vs. 40 Findings: Other Areas Excellent (%) Good (%) Average (%) Poor (%) % of Excl.& Good vs. % of Av. & Poor Registration process 31 55 11 3 86 vs. 14 Social networking opportunities 9 38 33 20 47 vs. 53 Overall experience of undertaking the blended learning MBA 20 46 29 5 66 vs. 34 Area of Investigation Summary of the findings Overall, the survey results showed a high level of satisfaction with the MBA programme, with an average of 63% of the respondents perceiving the course as either ‘excellent’ or ‘good’, vs. 25% perceiving it as ‘average’, only 12% as ‘poor’. In terms of the service quality as perceived by the students, 22 out of the 29 areas showed the total percentage of ‘excellent’ and ’good’ greater than total of ‘average’ and ’poor’. Six results had these total about the same, and only one (Voice Café) had this total significantly reversed (37% vs. 63%). Respondents’ Comments Positive comments: ‘It was a pleasure and enjoyable experience taking the MBA with this UK University’. ‘Fast and active response is one of the university’s strengths, as we feel attended to’. ‘I was impressed with the idea of free wireless internet facility and the ever helpful nature of the faculty office and administration team’. ‘Voice Café, blackboard, and the student records system are excellent facilities for remote students like us. I found this course very balanced and suitable for working candidates’. ‘It has been really a correct decision for me to enrol onto the MBA programme. The wisdom derived from e-MBA is tremendous’. Respondents’ Comments Among the more general comments and criticisms were: A desire to be issued with all the essential information about the course at the induction sessions (rather than having some of this information fed piecemeal later). 2. A desire for quicker responses to requests for information and feedback. 3. Some students felt that BREO had been under-used, as it was not used to provide effective discussion forums. 4. Many students asked for more consistent and comprehensive unit information and guidance, clearer assignment instructions, and to be given the formats of examinations. 1. Respondents’ Comments 5. Quite a number of students expressed a dislike of the different assignment submission systems used on different courses within the MBA, as these were often seen as time-consuming and confusing. 6. Some students felt the need to spend more time with the UKbased tutors, and expressed a wish for an additional round of face-to-face interaction in the middle of a semester. 7. Some would have liked to gain the opportunity for the classroom experience at the UK University. 8. Overall, the above comments can be summarised as a need for more support for their independent learning process. Other Feedback Voice Café Many students felt that Voice Café was not very useful, and not well utilized. Some said that very often there were auditory troubles, a lot of interruptions, and the Voice Café sound was poor as many students were talking via the system at the same time. In addition, some students noted that a lot of time was spent fixing technical difficulties. Assignments Most students felt that immediate confirmation of receipt of their assignments was extremely important to reduce unnecessary worries about submission. Some felt very dissatisfied if they failed to receive their assignment feedback within the specified time. In addition, students appreciated the cases where more detailed and customized feedback had been given, rather than just a general comment, as they wanted to understand what was wrong in their work. In addition, it was suggested that the communication and collaboration between the education partners are very important to provide effective and high quality learning support to the students. Summary of Key issues, Suggestions and Actions Taken Key issues Changes suggested Actions taken 1. Problems with Voice Café To replace Voice Café with a (the synchronous more advanced and user communication tool) friendly tool Voice Café has been replaced by WIMBA live classroom 2. BREO had been underused (since the students are busy working professionals, they prefer working online) To make more learning material available through BREO, and to use BREO assignments tool to submit assignment online. 3. Students required having more time with tutors, especially in terms of getting extra support about assignments. To deliver more WIMBA sessions and give clear assignment guidance to overseas students well before the deadline for each assignment submission. The tutors have been encouraged to post extra learning assets for each week (PPT, research papers, pod cast clips) on BREO in addition to weekly learning martial and to use the BREO integrated online assignment submission tool. Tutors are scheduled to make better use of WIMBA Live Classroom to enable synchronous communication and are required to archive materials used for the WIMBA sessions so that they can be reused and re-visited by the students. 4. Students’ dissatisfaction with the assignment instructions and marking To plan more integrated approach for assignment instructions and marking criteria across all the MBA modules. Tutors are required to revise and crosscheck the assignment instructions and marking criteria and make them accessible in the assignment section of the BREO site for each module. The second round of surveys Subsequent to the changes made after the first round of surveys, the opportunity became available to carry out a second survey round at two of the overseas sites: Oman and India. So the results of the key areas from both rounds of the surveys conducted among students in Oman and India have been used. In principle, both surveys had the same type of questions. However, based on the findings from the 1st survey, some changes were made to the MBA programme, and these changes were incorporated in the second survey. New module handbooks, ICT guides, and WIMBA live classroom were introduced after the 1st survey so questions related such changes were added to the 2nd survey. The questionnaire response rates Overview of the 1st questionnaire response rate Total no. of Total no. of % as total Country students respondents students no. Oman 143 30 20.98% Indian 41 18 43.90% Total 184 48 N/A % as total Responses no. 62.50% 37.50% 100.00% Overview of the 2nd questionnaire response rate Total no. of Total no. of % as total Country students respondents students no. Oman 150 27 18.00% Indian 41 8 19.51% Total 191 35 N/A % as total Responses no. 77.14% 22.86% 100.00% Analysis of changes made to the MBA Programme and their impact Provision of learning materials on CD ROM vs. weekly online Students’ perception Excellent Good Average Poor First survey Second survey % in ‘excellent’ and ‘good’ (1st survey vs. 2nd survey) 18.8% 43.8% 22.9% 14.6% 21.6% 51.4% 16.2% 10.8% 62.6% vs. 73% E-learning systems training Training materials for e-learning systems Students’ First survey Second survey perception Excellent 12.5% 13.5% Good 41.7% 54.1% Average 33.3% 29.7% Poor 12.5% 2.7% % in ‘excellent’ & ‘good’ (1st survey vs. 2nd survey) 54.2% vs. 67.6% VLE system – Voice Café vs. WIMBA Voice Café vs. WIMBA Students’ First survey perception Excellent 14.6% Good 20.8% Average 31.2% Poor 33.3% Second survey % in ‘excellent’ & ‘good’ (1st survey vs. 2nd survey) 16.2% 45.9% 18.9% 18.9% 35.4% vs. 62.1% Tutor Support Online support from UK tutors Students’ First survey perception Excellent 16.7% Good 50.0% Average 31.2% Poor 2.1% Second survey % in ‘excellent’ & ‘good’ nd (1st survey vs. 2 survey) 48.6% 32.4% 16.2% 0.0% 66.7% vs. 81% Module Handbook The format of module handbooks Students’ First survey perception Excellent Good Average Poor 29.2% 50.0% 18.8% 2.1% Second survey 13.5% 67.6% 18.9% 0.0% % in ‘excellent’ & ‘good’ (1st survey vs. 2nd survey) 79.2 vs. 81.1% Assignment Feedback Assignment feedback Students’ First survey perception Excellent 16.2% Good 45.9% Average 18.9% Poor 18.9% Second survey % in ‘excellent’ & ‘good’ nd (1st survey vs. 2 survey) 16.7% 43.8% 29.2% 10.4% 62.1% vs. 60.5% Students’ overall experience Students’ overall experience of taking MBA programme Students’ perception First Second survey survey Very satisfied 25.0% 29.7% Somewhat satisfied 43.8% 48.6% Varies from module to 29.2% 16.2% module Not satisfied 2.1% 5.4% % in ‘excellent’ & ‘good’ nd (1st survey vs. 2 survey) 68.8% vs. 78.3% Oman Statistics – BREO Usage Sem. 1 total hits in course content area 125 98 85 ?? 259 172 111 47 226 Sem. 2 total hits in course content area 1750 869 1238 862 5232 4701 1606 2102 1662 Why the increase? WIMBA – used before assessment points Assignments – explanation, samples Materials improved - rewritten BREO sites more reliable More information on the sites – study guides Sites now ready for inductions Rapid assessment of use - surveys Learning Materials Course materials are made available online via the UoB's virtual learning environment ' BREO' Leading and managing people: learning material within BREO (Virtual learning environment of the University of Bedfordshire). Session brake-up of the module. Session corresponding to week Sample session 1 E-Business fundamentals. Media rich quality content with interactivity Sample session 1 Self–awareness Media rich quality content with interactivity Automatic feed-back Leading and managing people case-studies WIMBA online classroom schedule WIMBA online classroom Previously Recorded live classroom sessions library : Available as WIMBA online classroom archives WIMBA online live-classroom Online collaborative activities: WIKI, BLOGS, Discussion forums, Voiceboards IT and other necessary training materials Conclusions The first survey showed a high level of satisfaction with the MBA programme as delivered, but also indicated areas that could see further improvement. The impacts of subsequent changes in both the programme and the blended learning support system were examined in the second round of surveys which revealed students’ improved satisfaction with the programme after the implementation of the changes. The outcomes of this research have helped improve the blended learning support system and enhanced the quality of the programme. It is hoped that these findings can provide guidelines for other universities that offer, or intend to offer, blended learning courses in a global context. University of Bedfordshire Business School Contact: yongmei.bentley@beds.ac.uk