Student Satisfaction in a Flipped Classroom Model in an Upper Division Soil Mechanics Course Dr. Laura Sullivan-Green Department of Civil and Environmental Engineering San Jose State University San Jose, CA Introduction This work evaluates the success of a Flipped Classroom Model (FCM) in an upper division soil mechanics course in the Civil and Environmental Engineering Department at San José State University (SJSU). A 4.5-week segment of the 16-week course employed the FCM, which consisted of brief videos to be watched prior to attending class that presented the key information to learn, followed by collaborative activities completed in the classroom during scheduled class times that covered application of the material in the videos. Preliminary results are mixed, with some aspects received positively from the students, but also some areas that need improvement. Based on the preliminary data collected, the FCM has many advantages to the traditional lecture format and shows the potential for improving overall student satisfaction and success. The data also indicates that there is improvement that can be done to the course that will enhance student satisfaction, including adding more videos that demonstrate examples, improving video quality and adjusting the collaborative activities. Background There are a number of studies that point to the need for pedagogical reform of the college STEM curriculum including Shaping the Future [1]; Transforming Undergraduate Education in Science, Mathematics, Engineering, and Technology [2]; the Engineer of 2020 [3][4]; Evaluating and Improving Undergraduate Teaching in Science, Technology, Engineering, and Mathematics [5]; Linking Evidence and Promising Practice in STEM Undergraduate Education [6], and Reinventing Undergraduate Education [7]. These reports recommend that college faculty change their methods to move away from instructor-centered, lecture-based instruction and move towards student-centered, active learning pedagogy. These modern pedagogies also play a significant role in success of underrepresented minorities in STEM fields [8]. San José State University (San Jose, CA), located in the high-tech Silicon Valley, is currently ranked as the sixth most ethnically diverse institution for Master’s degree conferring institutions in the West by U.S. News & World Report [9]. The student body in the College of Engineering also reflects this diversity, with over 35% of the student body identifying with an ethnic group other than white (23.5%) or Asian (41.4%). Underrepresented minority students, including women, in engineering do better in active learning modalities, which are studentcentric, collaborative and exercise-driven. These students experience higher pass rates, higher average final grades and higher graduation rates [10][11][12][13][14][15][16]. Teachingcentered practices that focus on lecturing and passive participation by the students tend to push students, especially minority and under-represented students, out of STEM fields. Several studies have shown that lack of quality teaching and a desire for a more interesting education were the primary reasons students left STEM [17][18][19]. Active and collaborative learning methods, which are student centered pedagogical practices, are linked to higher grades and educational gains [20][21][22][23][24]. There is a large body of research that shows that student learning in STEM fields can be improved when instructors move from a teachercentered approach to a student-centered, interactive approach [25][26][27][28]. The FCM integrates technology with active learning techniques. In a flipped classroom, the standard class lecture is replaced with a student-focused approach that involves the use of strategies implemented outside of the classroom [29]. Students use electronic media to learn 1 about the content before class, allowing them to learn at their own pace and come better prepared for in-class work. This approach is shown to have a positive effect on student learning outcomes, especially in STEM courses [30]. High need students also see improvements with these active learning methods [31]. These improvements increase academic self-confidence, motivate students to persist in difficult academic pathways, motivate students to complete one’s academic study and improve the likelihood of pursuing advanced study [32]. By incorporating these changes into the civil engineering curriculum at SJSU, all students, and especially the large number of underrepresented minority students, will have courses that cater to their unique needs within their curriculum. Course Development The required geotechnical engineering course, CE 140: Introduction to Soil Mechanics is currently testing the FCM. The first unit, a 4.5-week segment, introduces students to the importance of a soil investigation in a civil engineering project, the origin of soils and various methods to define a soil, both by its physical properties and its behaviors. Students have a series of videos, 5-10 minutes in length, that present the content to be covered. Each lesson has 1-3 videos, depending on content and length. The videos are to be watched prior to attending the class for which the work is assigned. Each series of videos is followed by a brief 3-question quiz on Canvas, the course management system. The system is set up so that students are unable to take the quiz without first watching the videos and also from continuing in the module until a satisfactory grade is achieved on the quiz. The quizzes contain information regarding key concepts in the video(s) just seen. The quizzes also provide the instructor with input on the students’ preparation for the class. Once the videos and quizzes are completed, the student will have access to a homework assignment. The homework assignments are short 3-5 question (as opposed to a standard 7-8 question) assignments that compliment the activities carried out during class. During the class sessions students will be given an activity that has 2-3 questions. Students will work collaboratively in groups of 3-5 to find solutions to the activity problems, which enforce and enhance concepts learned in the videos. The combination of the shortened homework and the class activities would be comparable to the work for a typical homework assignment in the traditional class format. Results and Discussion Student satisfaction with the FCM was measured by an online survey that was modeled after the survey by G.B. Johnson in “Student Perceptions of the Flipped Classroom” [33]. Students were asked a series of questions about the FCM and asked to rank their opinion on a scale from 1 (strongly disagree) to 5 (strongly agree). They were then given the opportunity to provide feedback on what they liked and didn’t like about the FCM. Students were collectively more in agreement on their positive feelings about the FCM. Tables 1 and 2 present results of the survey for the Fall 2013 and Spring 2014 cohorts, respectively. Table 3 summarizes comments that students made about what they liked about the FCM. Around half (52.6%, 50%) of the students believed that the flipped classroom model was more engaging than traditional classroom instruction. Their comments were also more consistent, with 31-46% (31.7%, 46.4%) saying they liked that they could rewatch the lecture videos whenever they chose. Another positive aspect of the FCM was that students felt that it allowed them to work at their own pace (29.3%, 32.1%) and enabled them to pace themselves successfully through the course (47.4%, 64.3%). A majority (50%, 57.1%) agreed that the FCM gave them more time to work with fellow classmates and commented that they had more access to the professor and classmates when problem-solving (17.1%, 14.3%). Less than one third of students (31.6%, 25%) stated that they didn’t like the videos, with the remaining percentage either being neutral (26.3%, 17.9%) or positive (42.1%, 57.1%) about them. 2 Table 1. Results from student survey reporting positive support with the FCM in Fall 2013. Disagree/ Agree/ Strongly Strongly Disagree Neutral Agree Mean Responses Statement The Flipped Classroom is more engaging than traditional classroom instruction. No. The Flipped Classroom gives me greater opportunities to communicate with other students. I like watching the lessons on video. I find it easy to pace myself successfully through the course. The Flipped Classroom gives me less class time to practice soil mechanics. % No. % No. % No. 14 36.8 4 10.5 20 52.6 3.21 38 12 31.6 5 13.2 21 55.3 3.37 38 12 31.6 10 26.3 16 42.1 3.16 38 10 26.3 9 23.7 18 47.4 3.34 38 19 50 9 23.7 10 26.3 2.61 38 Table 2. Results from student survey reporting positive support with the FCM in Spring 2014. Statement The Flipped Classroom is more engaging than traditional classroom instruction. Disagree/ Strongly Disagree Neutral No. No. The Flipped Classroom gives me greater opportunities to communicate with other students. I like watching the lessons on video. I find it easy to pace myself successfully through the course. The Flipped Classroom gives me less class time to practice soil mechanics. % Agree/ Strongly Agree % No. Mean % Responses No. 8 28.6 6 21.4 14 50 3.32 28 9 32.1 3 10.7 16 57.1 3.36 28 7 25 5 17.9 16 57.1 3.39 28 4 14.3 6 21.4 18 64.3 3.68 28 14 50 8 28.6 6 21.4 2.61 28 Table 3. Results from student comments reporting what they liked about FCM. Student Likes Ability to rewatch videos Abilty to work at own pace Accessibility of professor/classmates during problem solving Videos (usefulness, duration, access) Fall 2013 13 (31.7%) 12 (29.3%) Spring 2014 13 (46.4%) 9 (32.1%) 7 (17.1%) 4 (14.3%) 3 (7.3%) 2 (7.1%) 3 Negative comments from students tended to be less consistent among the students. Fewer students were in agreement about what they didn’t like about the FCM. Tables 4 and 5 present results from the survey for the Fall 2013 and Spring 2014 cohorts, respectively. Table 6 summarizes the most popular comments that students reported when asked what they didn’t like about the FCM. Most students (51.4%, 64.3%) disagreed with the statement that that they were spending less time with the FCM on soil mechanics than they would have with a traditional format. Their comments also supported this assssment with 14.6% and 10.7% commenting that the format felt more time consuming than a traditional class. Despite reporting that they liked the ability to rewatch the videos and pace themselves with the video/quiz/activity/homework sequence, 47.4% and 50% reported that they would still prefer a traditional lecture format in the class. The greatest complaint in the comments was in regards to the activity format (19.5%, 17.9%). Students’ complaints covered numerous aspects of the activities, including the format, length, and grading. The over-arching theme of the details was that the activities were too stressful due to worry about completion during the class time and impact on grades if did not complete to make the collaboration effective. Students were using the divide-and-conquer method for completion, which defeated the purpose of working together and learning from peers. Table 4. Results from student survey reporting negative support for the FCM in Fall 2013. Disagree/ Agree/ Strongly Strongly Disagree Neutral Agree Mean Responses Statement I am spending less time working on traditional Soil Mechanics homework. I would rather watch a traditional teacher lead a lesson than a lesson video. No. % No. % No. % No. 19 51.4 9 24.3 10 27 2.63 37 5 13.2 15 39.5 18 47.4 3.53 38 Table 5. Results from student survey reporting negative support for the FCM in Spring 2014. Disagree/ Agree/ Strongly Strongly Disagree Neutral Agree Mean Responses Statement I am spending less time working on traditional Soil Mechanics homework. I would rather watch a traditional teacher lead a lesson than a lesson video. No. % No. % No. % No. 18 64.3 2 7.1 8 28.6 2.54 28 5 17.9 9 32.1 14 50 3.39 28 Table 6. Results from student comments reporting what they did not like about FCM. Student Dislikes Fall 2013 Spring 2014 Activity format (length, grading, solutions) 8 (19.5%) 5 (17.9%) Time consuming 6 (14.6%) 3 (10.7%) Video quality 1 (2.4%) 3 (10.7%) Videos not engaging/boring 3 (7.3%) 4 Students were inconsistent across the two semesters on two points, their motivation to learn soil mechanics and their level of learning of soil mechanics. In Fall 2013, students were more likely to disagree with these statements (36.8% against motivation and 39.5% against improved learning). In Spring 2014, students were more likely to agree with these statements (40.7% for motivation and 35.7% for improved learning. More students were also in the Neutral category in Spring 2014 than compared to Fall 2013. More data needs to be collected to evaluate these aspects of the FCM. Table 7. Results from student survey with inconclusive results for/against the FCM from Fall 2013. Disagree/ Agree/ Strongly Strongly Disagree Neutral Agree Mean Responses Statement I am more motivated to learn soil mechanics in the Flipped Classroom. The Flipped Classroom has not improved my learning of soil mechanics. No. % No. % No. % No. 14 36.8 13 34.2 11 28.9 2.95 38 15 39.5 10 26.3 12 31.6 2.81 38 Table 8. Results from student survey with inconclusive results for/against the FCM from Spring 2014. Disagree/ Agree/ Strongly Strongly Disagree Neutral Agree Mean Responses Statement I am more motivated to learn soil mechanics in the Flipped Classroom. The Flipped Classroom has not improved my learning of soil mechanics. No. % No. % No. % No. 6 22.2 10 37 11 40.7 3.22 27 9 32.1 9 32.1 10 35.7 3.37 28 Results tend to show that satisfaction with the fundamentals of the FCM outweigh the negative attitudes towards the method. More people are in agreement that the video lecture concept improves their ability to learn course content by review of the videos at the students’ discretion and to pace themselves through the course material. The collaborative working environment is received well by the students, but improvements need to be made to the course format to maximize the benefits of this working in groups. The additional time reported, whether actual or perceived, on working with the course content with FCM is currently perceived as a negative to the method and additional investigation is needed to evaluate if there are any benefits (improved grades and passing rate) that justify the additional expenditures to the student to reduce these negative perceptions. Several comments that were not consensus across the student body, but have potential for further evaluation are worth mentioning here. One student stated that the FCM was beneficial to his/her educational experience because of their diagnosis with Attention Deficit Disorder. The student reported that they were able to watch the videos again if they “spaced out.” This comment supports the literature, mentioned 5 above, that shows that these active teaching methods help high-need, high-risk students the most. Another student commented that they were able to have time to reflect on the material before moving on, a luxury not afforded in a traditional classroom that many students may not even identify as an important component of their education because it is not compatible with a time-limited lecture. One more student stated that they liked having full time access to the lectures, again another luxury not afforded to students, as a professor is not available limitlessly. The survey also highlighted several areas of improvement, namely with the activities. The activity format needs to change to provide students more time to utilize their group members as resources and work together towards a common solution. A better balance needs to be achieved that forces students to stay on task, while simultaneously not causing stress due to a limited time constraint and worry over a grade. Another area that is in need of improvement includes the time commitment perception. This is a two-sided problem. First, the perception that additional time spent on study is negative needs to be adjusted. Second, the combination of the smaller homework and the activities were thought to eliminate half the homework obligation, may not be accurate. The additional time to work a problem collaboratively over that of a standard work-alone method may need to be accounted for and the homework length reduced accordingly. Conclusion The Flipped Classroom Model was tested in a 4.5-week unit of an upper division soil mechanics class at San Jose State University. Videos containing lecture content were posted for students to watch prior to attending class. During class, students worked collaboratively to solve relevant problems based on that content. Smaller homework assignments were then given to reflect the work in the classroom. Results shows students were satisfied with the video concept and enjoyed the ability to watch the videos whenever they wanted and as many times as they wanted. They enjoyed the ability to pace themselves with the coursework over the 4.5 weeks. Students identified several areas that were not satisfactory, including a reported increase in time spent on the course and the format of the in-class activities. Areas that are slated for reevaluation include the format for the activities and correlated homework and evaluation of the expected time required for success in the course. 1 2 3 4 5 National Science Foundation (1996). Shaping the future: New expectations for undergraduate education in science, mathematics, engineering, and technology. Washington, DC: NSF DUE. National Research Council. (1999). Transforming undergraduate education in science, mathematics, engineering, and technology. Washington, DC: National Academy Press. National Academy of Engineering (2004). The engineer of 2020. Washington, DC: National Academies Press. National Academy of Engineering (2005). Educating the engineer of 2020: Adapting engineering education to the next century. Washington, DC: National Academies Press. Fox, M. A., & Hackerman, N. (Eds.). (2003). Evaluating and improving undergraduate teaching in science, technology, engineering, and mathematics. Washington, DC: National Research Council. 6 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 Fairweather, J. (2009). Linking Evidence and Promising Practices in Science, Technology, Engineering, and Mathematics (STEM) Undergraduate Education, a Status Report for The National Academies National Research Council Board of Science Education, number 17. The Boyer Commission on Educating Undergraduates in the Research University. (1998). Reinventing undergraduate education: A blueprint for America’s research universities. Available: http://naples.cc.sunysb.edu/Pres/boyer.nsf/ Gaffney, J. D., Richards, E., Kustusch, M. B., Ding, L., & Beicher, R. (2008). Scaling up educational reform. Journal of College Science Teaching, 37(5), 48-53. U.S. News and World Report. (2010). Campus diversity ranking. America's best colleges 2010. Treisman, U. (1992). Studying students studying calculus: A look at the lives of minority mathematics students in college. The College Mathematics Journal, 23(5):362–372. Chinn, D., Martin, K., & Spencer, C. (2007). Treisman workshops and student performance in CS. ACM SIGCSE Bulletin, 39(1): 203–207. Fullilove, K., & Treisman, U. (1986). Mathematics achievement among African-American undergraduates in the University of California, Berkeley: An evaluation of the mathematics workshop program. The Journal of Negro Education, 59(3), 463–478. McFarland, R.D. (2004). Effective design considerations to address Hispanic MIS/CS curriculum. Journal of Computing Sciences in Colleges, 20 (1). Burn, H., & Holloway, J. (2006). Why should I care? Student motivation in an introductory programming course. Proceedings of the 2006 ASEE Annual Conference and Exposition, 18-21 June 2006, Chicago, IL. The University of Colorado-Boulder Multicultural Engineering Program. (2007). Impacting the Achievement of Underrepresented Minorities in Science and Engineering. 2007 Conference on the Preparation of Physics and Physical Science Teachers. Rath, K.A., Peterfreund, A.R., Xenos, S.P., Bayliss, F., & Carnal, N. (2007). Supplemental instruction in Introductory Biology I: Enhancing the performance and retention of underrepresented minority students. CBE-Life Sciences Education, 6, 203-216. Hewitt, N. M. & Seymour, E. (1992). A long discouraging climb, ASEE PRISM, 1(6), 24-28. Astin, A. W. (1993). Engineering outcomes. ASEE Prism, pp. 27-30. Tobias, S. (1990). They’re not dumb, they’re different: Stalking the second tier. Tucson, AZ: Research Corporation. Kuh, G. D. (2007). Risky business: Promises and pitfalls of institutional transparency. Change, 39(5) 30-35. Zhao, C., Carini, R. M., & Kuh, G. D. (2005). Searching for the Peach Blossom Shangri-La: Student Engagement of Men and Women SMET Majors, The Review of Higher Education, 28(4), 503-525. Johnson, D., Johnson, R, & Smith, K. (1998). Active learning: Cooperation in the college classroom (2nd ed.). Edina, MN: Interaction Book Co. De Caprariis, P., Barman, C., & Magee, P. (2001). Monitoring the benefits of active learning exercises in introductory survey courses in science: An attempt to improve the education of prospective public school teachers. The Journal of Scholarship of Teaching and Learning, 1(2), 1-11. Chickering, A. W., & Gamson, Z. F. (Eds.). (1987). Seven principles for good proactive in undergraduate education. AAHE Bulletin, 39, 3-7. Handelsman, J., Ebert-May, D., Beichner, R., Bruns, P., Chang, A., DeHaan, R., Gentile, J., Lauffer, S., Stewart, J., Tilghman, S. M., & Wood, W. B. (2004). Education: Scientific teaching. Science, 304(5670), 521-522. 7 26 27 28 29 30 31 32 33 Peters, A. W. (2005). Teaching biochemistry at a minority-serving institution: An evaluation of the role of collaborative learning as a tool for science mastery. Journal of Chemical Education, 82(4), 571-574. Christensen, T. (2005, November-December). Changing the learning environment in large general education astronomy classes, Journal of College Science Teaching, 35(3), 34-38. Fenci, H., & Scheel, K. (2005). Engaging students. An examination of the effects of teaching strategies on self-efficacy and course climate in a nonmajors Physics course. Journal of Research in Science Teaching, 35(1), 20-24. Hughes, H. (2012). Introduction to flipping the college classroom. In T. Amiel & B. Wilson (Eds.), Proceedings of the World Conference on Educational Multimedia, Hypermedia and Telecommunications 2012 (pp. 2434-2438). Chesapeake, VA: AACE. Christensen, T. (2005, November/December). Changing the learning environment in large general education astronomy classes. Journal of College Science Teaching, 34-38. Milem, J. (2001). Increasing diversity benefits: How campus climate and teaching methods affect student outcomes. In Diversity challenged. Cambridge, MA: Harvard Education Publishing Group Adair, J.K., Reyes, M.A., Anderson-Rowland, M.R., & Kouris, D.A. (2001 Workshops vs. tutoring: How ASU’s minority engineering program is changing the way engineering students learn. In Proceedings of the 31st ASEE/IEEE Frontiers in Education Conference, volume 2, pp. T4G–7–T4G–11, October 2001. Johnson, G.B. (2013). “Student Satisfaction of the Flipped Classroom”. Retrieved from https://circle.ubc.ca/handle/2429/44070. May 22, 2014. 8