A Benchmarking Study of the Environmental and Pedagogical Challenges of Moving Courses to an Online or Hybrid Format Lora Honeycutt The Best Ways to Provide Students with Feedback Recently, San Diego State University (SDSU) began moving many of their large undergraduate courses online. Fall of 2010 found 38 such courses online (Dabboussy, 2010). Dr. Minjuan Wang proposed a study to find the challenges faced by instructors and the university itself in moving these courses online. The first step in completing this research is to conduct a benchmarking study and uncover the current best practices and industry leaders in online instruction. This literature review is part of a larger benchmarking study which addresses the leading factors leading to student satisfaction with online courses and the optimal methods for fostering an interactive learning environment. This portion of the literature review focuses on the best ways to provide student feedback in online courses. The review is focuses on the following three areas that are related to feedback in online classes: feedback sources, Frequency and timeliness of feedback Feedback methods Feedback Sources In the online environment, various sources are available to provide feedback: peers, instructors and the students themselves. A wide range of research has been performed in all three areas, with each source of feedback providing positive elements to online feedback. Peer Feedback Chickering and Gamson (1987) created the Seven Principles of Good practice to establish best practices for instruction in new, technology based environments They discuss, among other ideas, peer-based feedback and its value to online courses. They found when peer reviews and feedback are encouraged and utilized, learning becomes a group effort, much like the work performed in a “real world” environment. “Working with others often increases involvement in learning. Sharing one’s ideas and responding to others’ improves thinking and deepens understanding” (Chickering & Ehrmann 1996, p. #). They proposed using social tools such as email, chat and social networking to strengthen study groups, collaborative learning, group problem solving, and discussion of assignments (Chickering, Ehrmann, 1996) allowing peers to share information and feedback quickly and efficiently. Instructor Feedback Just as in traditional classrooms, instructor feedback plays a huge role in the success of students online. Espasa and Meneses (2009) studied 186 graduate students from several courses at the Universitat Oberta de Catalunya (UOC, Open University of Catalonia) to find how much instructor feedback affected their success. Of the 186 students, 48.1% of those students who did not receive adequate instructor feedback failed their courses. Those students who did receive feedback obtained good, very good or excellent grades 78.9% of the time. Clearly, students who received instructor feedback achieved better grades and “a positive association was found to exist between student satisfaction with the general functioning of the course and feedback received” (Espasa, Meneses, 2009, p. #). In much the same way that peer-feedback can be helpful to students in online courses, Chickering and Ehrmann note communication technologies can increase access to faculty members, which can replace the face-to-face interaction found in traditional classroom based courses. Such technologies can even strengthen faculty interactions with students, especially those quieter students who may be reluctant to ask questions about the course material or to question the instructor. “It is often easier to discuss values and personal concerns in writing than orally, since inadvertent or ambiguous nonverbal signals are not so dominant” (Chickering, Ehrmann 1996). Technology provides opportunities for quality interaction with instructors and peers, even allowing for more interaction than that which may exist in the traditional classroom setting where students often rush off immediately after the course concludes. Self-Feedback The feedback source thought to be most beneficial is self-feedback; that is, the feedback students give themselves. In online courses, students should be given feedback to empower them to selfregulate their learning (Juwah Macfarlane-Dick, Matthew, Nicol, Ross, & Smith, 2004). Sadler (1989) found internal self-feedback is “derived from a comparison of current progress against internal goals or standards” (as referenced in Juwah et al. 2004). He argued that in many educational settings teachers give students feedback on how their performance compares to an established standard, but this feedback does not fully explain how to better meet the established goals. “By administering feedback which allows students to self-regulate, their learning becomes more effective and satisfying” (Sadler, 1989 as referenced in Juwah et al. 2004). Gaps are then internally identified and further action is taken to close these gaps. Learners are assumed to be active participants in the learning processes and have the potential to regulate their own learning (Lee, Lim, Grabowski, 2010). Frequency and Timeliness of Feedback The amount of feedback, given at the right time, can also make a difference to learner success. In the early stages of an online course, students may need help determining what they currently know about a subject and how competent and confident they feel in the course material (Chickering, Ehrmann, 1996). Then, during online class sessions, students need frequent opportunities to perform and receive feedback on their performance. Chickering and Ehrmann also found students need chances to “reflect on what they have learned, what they still need to know, and how they might assess themselves.” One type of feedback studied is rapid feedback, i.e. feedback provided almost instantaneously either through some technological means or from the instructor themselves. In a study by Chen, Kadlowec and Whittinghill (2010), students were provided rapid feedback when answering questions on personal digital assistants (PDA) or with flash cards. In both cases, their level of success was communicated immediately. Students were then surveyed and overwhelmingly responded that rapid feedback was helpful to them, regardless of the means in which the feedback was provided. The instructor involved in the study also felt the rapid feedback was helpful. He observed that “the students took the feedback questions in class quite seriously and tried hard to answer them correctly even though no grade was involved. This was an additional benefit because the students were forced to think about and apply the concepts now rather than later (or perhaps much later) when they sat down to do homework” (Chen, Kadlowec, Whittinghill, 2010). The results of the rapid feedback also allowed the instructor to improve future instruction by noting those questions the students missed most often. However, perhaps the most important finding was that student satisfaction with classes in which rapid feedback was provided proved to be extremely high (Chen, Kadlowec, Whittinghill, 2010). Rapid feedback is not always as beneficial as it could be if it fails to lead to student selfreflection. Espasa and Meneses (2009) found some issues with feedback in their study for the UOC. In the classes they studied, rapid feedback was most often offered as continuous assessment during course meetings, with feedback given after an assignment the second most common type of feedback. However, both types of feedback basically provided information about errors made in class or while completing an assignment and provided the correct answers, but neglected to direct the student how to improve their work (Espasa, Meneses, 2009). Feedback Methods In online courses, a wide variety of technologies are available to communicate and provide feedback to students. Email, chat tools, and the internet increase opportunities for students and faculty to interact very quickly and easily and with less pressure than that of face-to-face communication found in the traditional classroom setting. Overall, communication via technology shows an increase in frequency and, for many students, the resulting interactions seem more intimate, protected, and convenient (Chickering, Ehrmann, 1996). New technologies can provide feedback in a wide variety of formats. Some technologies found to be of great use include online discussion boards and email/Listserv (Tan, Wang, Xiao, 2010). In addition, computers can keep track of several drafts of assignments allowing instructors and students to see improvements and informational/knowledge gains over time (Chickering, Ehrmann, 1996). Instructors are encouraged to further use quizzes that provide immediate feedback, polls to spark discussion and constantly scan the synchronous online chat during course convenings to acknowledge and answer questions or further discuss any comments (Tan, Wang, Xiao, 2010). This feedback information can also help teachers realign their teaching in response to learners’ needs or gaps found in the course material (Juwah et al. 2004). Another potentially useful tool is a confidence indicator tool built in to learning assessment programs. Nix and Wylie conducted a study of 12 social work students and their interaction with a Learning with Interactive Assessment (LINA) program. The program included a confidence indicator tool to enhance and encourage learner reflection. The subjects were questioned about the confidence-indicator tool and 83% felt it might improve their reflective practice. “Learners welcomed the opportunity to configure and control their own mode of learning” (Nix, Wyllie 2011) through the ability to pause to decide confidence and justify decisions with the confidence indicator tool. The subjects also intimated the tool encouraged self-assessment and reflection, which may ultimately lead to greater understanding and retention. The study found, while not all students were good at self-assessment, they may still benefit from prompted reflection and the ability to mold their learning environment. “The more we can prepare and develop learner skills in managing their own learning environment, the more we will be equipping them to be effective learners. By allowing choice within the assessment environment, we liberate learners to do things their way, reflecting their characteristics, and harnessing their motivation to achieve the best result” (Nix, Wyllie 2011). The confidence-based self-assessment tool was found to be more relevant during the early stages of learning rather than the later, more cumulative lessons and helped build confidence throughout the course leading to greater student performance. Another valuable feedback method involves learners creating their own questions. A study by Mevarech and Fridkin found those students who created their own questions for reflection significantly outperformed the students who did not create such questions. To that end, Lee, Lim and Grabowski proposed instructional designers or instructors design computer-based learning environments that help learners regulate and monitor their learning processes and allow learners generate their own learning strategies and opportunities for refection (Lee, Lim, Grabowski, 2010). These feedback methods and sources will prove valuable as further research is conducted on moving courses online. Need a conclusion: summarize all the above, and connect it to you study. Appendix A: References Chen, J. C., Kadlowec, J. A., & Whittinghill, D. C. (2010). Classes That Click: Fast, Rich Feedback to Enhance Student Learning and Satisfaction. Journal of Engineering Education, 99(2), 159-168. Chickering, A., & Ehrmann, S.C. (1996, October). Implementing the Seven Principles: Technology as Lever. American Association for Higher Education Bulletin, 3-6. Dabboussy, L. (2011). EDTEC 798 - Administrative, Financial, Environmental and Pedagogical Challenges that SDSU faculty face as they move their on-campus to the online format. Unpublished research report, San Diego State University. Espasa, A., & Meneses, J. (2009). Analysing feedback processes in an online teaching and learning environment: an exploratory study. Higher Education, 59(3), 277-292. Juwah, C., Macfarlane-Dick, D., Matthew, B., Nicol, D., Ross, D., & Smith, B. (2006) Enhancing Student Learning Through Effective Formative Feedback. The Higher Education Academy Generic Center. Lee, H.W., Lim, K.Y., & Grabowski, B.L. (2010). Improving self-regulation, learning strategy use and achievement with metacognitive feedback. Education Technology Research & Development, 58, 629-648. Nix, I. & Wyllie, A. (2011) Exploring design features to enhance computer-based assessment: learner’ views on using a confidence indicator tool and computer-based feedback. British Journal of Educational Technology, 42(1), 101-112. Tan, L., Wang, M., & Xiao, J. (2010). Best Practices in Teaching Online or Hybrid Courses: A Synthesis of Principles