Survey conducted and results analyzed by David Brodosi and Otis Wilder Online Learning and Instructional Technology Services Nelson Poynter Memorial Library 1 Overview In April 2014, Online Learning and Instructional Technology Services (OL/ITS) of the Nelson Poynter Library developed and conducted an online survey to capture perceptions and attitudes towards online courses at the University of South Florida St. Petersburg. The majority of the respondents fell into the following demographic category: female, full-time, juniors and seniors, living off campus, and between the ages of 19-24. The survey results reveal two critical findings: 1) online courses are highly valued by students and 2) students believe the quality of online courses are equal to the quality of face-to-face courses. Methodology The survey was electronically administered to 584 students currently enrolled in up to five courses at USF St. Petersburg. Survey content included questions about students’ perceptions and experiences related to online courses. Specifically, the survey’s content was divided into three sections: student demographic information, attitudes towards online learning at USF St. Petersburg, and input regarding future online courses at USF St. Petersburg. A link to a Google poll was posted to Canvas’s announcements section within each course asking students to provide feedback by April 1st, 2014. Participation was completely voluntary and no personal information was collected. At the close of the survey, 102 students responded, a response rate of 17.46%. Quantitative data in this report was analyzed with SPSS 22 and qualitative data was analyzed with MAXQDA 11. Results Section 1: Student Demographics Based on the sample obtained from the survey, online students at USFSP are mostly female (83%), full-time students (81%), in their junior (39%) or senior (27%) year, and, are living off campus (87%). Employment was also a significant factor with 70% of participants being employed either full- or part-time. Are you a full-time or part-time student? Full-time Part-time 81 % 19 % What is your current designation? First year Sophomore Junior Senior 11 % 23 % 39 % 27 % 2 What is your gender? Female Male Prefer not to answer 83 % 16 % 1% Where do you live? Off campus On campus 87 % 13 % What is your age? 18 years or younger 19-24 years 25-29 years 30-39 years 40-54 years 55 years or older Prefer not to answer 14 % 58 % 15 % 3% 8% 1% 1% Are you employed? Full-time Not currently employed Part-time 23 % 30 % 47 % What is your ethnic group? African-American-black Asian Caucasian/White Latino/Hispanic American Indian Other Prefer not to answer 4% 6% 78 % 6% 1% 3% 2% How many unique online courses have you taken at USFSP? 1-3 online courses 52 % 4-6 online courses 37 % 7 or more online courses 11 % 3 Section 2: Perceptions and Attitudes towards Online Learning and future offerings of online courses at USFSP. The survey aligned respondents’ perceptions and attitudes towards online courses to a Likert scale scored as 1 being “strongly disagree” and 5 being “strongly agree”. One item asked about the level of confidence students had in their ability to perform in an online class. Students largely reported (77%) that they have a high level of confidence in their ability to perform in an online environment when compared with a face-to-face environment. Students were also asked to indicate their preference for taking online courses. Two-thirds of participants (68%) indicated they prefer online or hybrid courses, with 32% preferring face-toface. This data aligns with the students’ desire for additional online course offerings at USFSP, with 68% of participants wanting more online classes. I feel just as confident in my ability to perform well in an online class as in a face-to-face class. 1 (not confident) 2% 2 9% 3 12 % 4 24 % 5 (fully confident) 53 % I believe the quality of my online courses were equal to the quality of my face-to-face classes. 1 (NOT effective) 5% 2 12 % 3 10 % 4 29 % 5 (EQUALLY effective) 44 % I would like to see more online courses available here at USFSP. Yes, definitely 68 % Neutral 29 % No, we seem to have enough 3% If given a choice, which type of class would you rather take? A face-to-face 32 % A hybrid class 27 % An online course 41 % 4 Section 2: Additional Comments Additional items asked participants open-ended questions about their experience with online courses, both positive and negative, along with an inquiry for overall improvement Three open-ended questions were presented to students at the end of the survey. 1. What did you enjoy the MOST from your online course(s) at USFSP? (n = 102) 2. What did you enjoy the LEAST from your online course(s) at USFSP? (n = 102) 3. Do you have any additional feedback about online learning that you would like to provide for Distance Learning? (n = 52) For a complete explanation of the coding rules used in this analysis, please also see the coding rules in the appendix to this document. Comments Analysis Flexibility The flexible nature of online learning was reported most frequently as important to students. Flexibility was identified as how adaptable the online course and its content were to the needs of the student. Keywords: flexible, schedule, own pace, freedom, own time. Of students who provided comments (n = 102) 73% made statements indicating that the flexibility and convenience offered by online classes was a key component of what they most enjoyed about online courses at USFSP. Communication Communication issues were another theme found in student comments. Communication was identified by the keywords and phrases: communication, contact, email, discussion boards, groups, and help. Of the 101 participants who responded, 23 (23%; 20 student-to-instructor, 3 student-to-student) reported items relating to communication. Of the 23 communication issues reported, 2 (8.6%) were clearly positive in nature, and 19 (91.4%) appeared to express concerns. Additional information on best practices and professional development opportunities will be considered for our fall 2014 faculty training series that will help address the concerns of our students. Interactivity Interactive items included interaction with course content and the instructor. Interactivity was identified by the use of keywords: engagement, involvement, activity, feelings of inclusion, feedback, and relationship. In total, 39% of the students mentioned interactivity. Eight (20.5%) of the comments clearly indicated a positive response to interactivity. The remaining 31 comments (79.5%) indicated a 5 concern for interactivity. This data indicates students enjoy the interactive elements included in online courses and would like to see more of them. To address this desire, the Online Learning and Instructional Technology Services department at the Nelson Poynter Memorial Library is offering a number of professional development opportunities for faculty to learn new technologies designed to increase interactivity. Technology Comments regarding technology were a common theme in the survey. Technology comments were identified by the keywords: technology, Canvas, videos, PowerPoints, files, movies. Overall, 25% of the students made a comment on technology. Comments varied but were generally themed on videos, including lecture videos, and PowerPoint presentations within the course. Within the technology comments, 72% of students made comments about videos, video lectures or PowerPoint presentation. These comments mostly consisted of students making positive statements on the use of videos and PowerPoints, or commenting on the desire for the inclusion of videos in their courses. OL/ITS is addressing this by the development and implementation of the MyStudio Booths on the second floor of the library. Along with the online learning studio, these self-service recording booths are designed for ease of use and to allow faculty access to recording equipment for any hours that the library is open. Training on the use of the MyStudio Booths is available for faculty by appointment through the OL/ITS. Summary Overall, students reported enjoying their experience taking online courses at USFSP and overwhelmingly would like to see more online courses added to our offerings. On the positive side, students appreciate the flexibility that online learning provides and enjoy the use of course technologies including videos, video lectures and PowerPoint presentations. Negative comments mostly focus on communication issues between students and their instructors as well as comments on the lack of interactivity in their courses. 6 Appendix Purpose of the Survey This survey was administered to inquire about the demographics, experience and attitudes of undergraduate students currently enrolled in an online course at USFSP. The intent of the survey, provided in the participant instructions, was to gather an overall impression of online learning at USFSP, not to seek information about specific courses. Methods Current online instructors at USFSP volunteered to post the survey in their online courses during the spring 2014 semester. An announcement was sent to students providing a link to the survey hosted within the Google Forms platform. The survey was anonymous and collected no identifying information from the participants, although access to the survey was limited to individuals with valid USF login credentials. Participants The sample consisted of undergraduate students currently enrolled in online courses at USFSP. Total enrollment for all courses was 584 with a 17.5% response rate (n = 102). Participants were largely Caucasian females between 18 and 29 years of age (see results). Coding Rules A post-hoc analysis was completed to determine themes of interest. Coded themes were agreed upon by 3 raters to analyze the student comments. Each question was individually coded based on statements of flexibility, student-to-student communication, student-to-faculty communication, interactivity, and comments on technology. Full details of the coding procedure are located in the Appendix to this document. Items were analyzed using the software MAXQDA 11. Survey Questions: Q1 - What did you enjoy the MOST from your online course(s) at USFSP? Q2 - What did you like the LEAST from your online course(s) at USFSP? Q3 - Do you have any additional feedback about online learning that you would like to provide for Distance Learning? Select the phrase or words that you see meets the coding requirements below. Partial phrases are acceptable as long as they provide an example of the code. Satisfaction - These are specific statements made about overall happiness and contentment with online learning at USFSP. Keywords: happy, satisfied, like, approve. 7 Interactivity - relating to continuous two-way transfer of information between the participant and the course content, student, or instructor. Keywords: engagement, involvement, activity, feelings of inclusion, feedback, relationship. Technology Comments - Relating to technical aspects of the course. Keywords: Canvas, videos, PowerPoints, files, movies. Student Communication* - Specific statements regarding interchange of thoughts, opinions, or information between students. Keywords: communication, contact, email, discussion boards, groups. Teacher Communication* - Specific statements regarding interchange of thoughts, opinions, or information between the student and the instructor. Keywords: communication, contact, email, discussion boards, groups, help. Flexibility - An opinion of the adaptability to various aspects of student course interaction. Keywords: schedule, own pace, freedom, own time. *If communication is not specific, mark both student and teacher. 8