ACTION RESEARCH Improving Student Performance through Note Taking and Organization Developed by: JEFF R SHERMAN Major Professor: DR. GREG THOMPSON April 29, 2010 OREGON STATE UNIVERSITY INTRODUCTION Improving Student Performance through Note Taking and Organization “Education is often considered the most important form of human capital” (Becker 1993, pg 1-13). In the United States, vocational education teachers earn an average annual wage of $53,700 in 2008. In Oregon, vocational education teachers make an average of $51,850 annually (Bureau of Labor Statistics). Depending on the amount of time spent grading assignments, quizzes, homework, and tests the resulting costs can become a costly investment. On average in Oregon, it will cost $12,962.50 for teachers who spend a quarter of their time grading student work. Creating effective assignments, homework and assessments which increase student achievement will help create lifelong learners (Fidel, Davies, Douglass, Holder, & Hopkins, 1999). Time can be more effectively used in the classroom evaluating student progress through teacher-student interaction. “Success rates of 70-80 percent are effective when a teacher is present to provide immediate feedback and monitor responses” (Michaelsen, Knight, & Fink, pg 53). Knowledge gained in high school classes can impact students for a lifetime. It is the responsibility of teachers to spend time engaging, motivating, and educating students. REVIEW OF THE LITERATURE In Oregon and in the United States there is a need to improve student achievement (Oregon Department of Education). There is an increasing amount of pressure on teachers to Improving Student Performance through Note Taking and Organization ensure that their tests and assessments are aligning with course objectives and learning outcomes (Gibbs & Simpson, 2004). Controversy surrounding education is often about assessments, falling standards, unreliable testing, cheating, and errors in exam papers. Assessments are often the cause of conflict, debate, and countless research articles about the use of formative assessments and examinations, and tying these assessments into course outcomes and objectives. Assessments often include: essays, reports, case studies, laboratory-based practical work, individual work, group projects, written tests, and examinations (Stefani, 2004). Often teachers are set on using tests and exams because these assessments can be monitored to ensure students are not cheating, copying, or reproducing someone else’s work. Studies show that the most reliable way to enhance student learning is through meaningful assignments. “The most reliable, rigorous and cheat-proof assessment systems are often accompanied by dull and lifeless learning that has short lasting outcomes — indeed they often directly lead to such learning… design assessment, first, to support worthwhile learning, and worry about reliability later. Standards will be raised by improving student learning rather than by better measurement of limited learning” (Gibbs & Simpson, p. 2-3). Assessments and coursework should be designed with the sole purpose being student achievement and success. Students tend to do better on course assignments than on examinations, which validate the need for effective assignments, projects, and questions which can advance student learning and save teachers time. Improving Student Performance through Note Taking and Organization Compared to examination scores, assignments are a better indicator of student performance (Gibbs & Simpson, 2004). Often when students are preparing for tests the information is placed in the short-term recall portion of the brain, and the information is gone once the information has been recalled to pass the examination (Marton & Wenestam, 1978). Learning involved with coursework including: homework, research projects, and assignments has long term benefits. Information obtained for the purpose of taking a test is often erased from memory because the information was not made pertinent for students. Examinations often use recall or revision, which do not incorporate the same kind of learning benefits of assignments (Gibbs & Simpson, 2004). In 1997, Gibbs and Lucas conducted an analysis of 1,712 classes at Oxford Polytechnic and discovered that courses with 100% coursework had an average mark 3.5% higher than courses which had 100% examinations. Three times as many students failed courses which only conducted examinations to determine student performance. The format of all of the 100% examination-style courses consisted of readings, lectures, and examinations. In the analysis, courses which utilized more coursework and less examination, showed an increase in student performance (Gibbs & Simpson, 2004). These results may explain the reasoning behind students performing better nationally in Biology, Business Studies, Computer Science, and Law courses compared to English and history classes. Students in hands-on courses often retain more information from their courses because in-class assignments and other coursework is made relevant. If all courses could find a way to make information real and relevant, student achievement levels would continue to rise. Improving Student Performance through Note Taking and Organization Higher average coursework grades are useless if assessment grades are worth a significantly larger amount than coursework. Students consider assignments to be fairer than exams, and measure a greater range of abilities than exams. Through assignments, students can use their own forms of organization and work patterns to a greater extent (Kniveton, 1995). Many schools in Oregon require students to take quizzes, tests, and final examinations, and the teacher must record those results in grade books. A way to incorporate the use coursework for assessments would be to allow students to use their notes, assignments, and previous work for completing assessments; validating the coursework for students. Peer assessment of assignments have shown to increase student retention and learning, and at the same time save teachers valuable time of grading the individual’s coursework. A study by Forbes and Spence in 1991, took a higher education engineering class where students were completing weekly problem sheets for the purpose of a grade in the class and a requirement as per the course syllabus. The instructor stopped asking students to produce the weekly problem sets altogether; student test scores dropped. Students were asked to complete the assignments not for a grade, but because they would be peer-reviewing the assignments and the results concluded that test scores increased a considerable amount. The results of the peer-reviewing assignments showed that student exam scores saw a dramatic increase after students began correcting the work of their peers; without the possibility of receiving a grade for the assignment. The increase in student knowledge is attributed to the quality of engagement in learning tasks between students (Forbes & Spence, 1991). Generating learning engagement is a proven way to enhance student learning. Teachers Improving Student Performance through Note Taking and Organization do not have to spend tremendous amounts of time marking papers and writing assessments to enhance learning; student interaction will produce learning. Assessments, examinations, quizzes, and tests are often closed-note, closed-book, and closed-mouth. Information is expected to roll off the tip of students’ fingers and produce the results teachers are expecting. These types of assessments, as backed up by research, do not evaluate the level of knowledge a student possesses (Gibbs & Simpson, 2004). Assessing for higher order skills should be a focus for teachers, but most tests only require students to recall information. Curriculum design often focuses on the subject matter and not the development of critical thinking. When students develop critical thinking and organizational skills, the information often becomes knowledge which can be retained and utilized for years to come (Stefani, 2004). The question becomes, how do we develop curriculum which encourages students to use higher order thinking skills? Teachers ask students to complete assignments because they find the relevance in the discovery of the information. Why can coursework not be used on examinations, when teachers can see the relevance in assigning the work? Why is coursework given a grade if students just complete the work for a grade? As Gibbs and Simpson reported in 2004, students learn more from coursework than assessments. If examinations and assessments are going to be produced, students should be able to use the information they have acquired and peer-reviewed. Less teacher time will be spent grading assignments and more knowledge will be obtained and retained by students. Improving Student Performance through Note Taking and Organization METHODOLOGY The observations took place in the second section of a horticulture class at a medium size high school in the Pacific Northwest. The classroom was a larger classroom situated on a seventy-six acre school farm. The students were bussed down from the high school. When students entered the classroom from the bus they walked past the teacher’s office and into a well-lit room with many decorations of prior student’s achievements decorating the walls. The west wall was lined with a magazine and newspaper rack, bookshelves, and baskets for students to turn in coursework and retrieve graded assignments from the prior day. Also on the west wall, a door leads to greenhouses. A projector screen and white board establish the front of the classroom and block the teacher’s office window from students. Students are seated in a U-shape around the teacher’s podium. Forty-two students participated in the research ranging from ninth to twelfth grade, and varying academic levels including students on Individualized Education Plans (IEP) to students who are Talented and Gifted (TAG). The class met five times a week during the trimester, and students were evaluated every other week for ten weeks. Students were evaluated on their organization, note-taking, and quiz or test score. Students were required to keep a binder in the class which held information on the course, notes, word-of-the-day activities, and assignments. Improving Student Performance through Note Taking and Organization Before information was presented to the class, or directions were given for specific activities students were asked to write down the important facts and the directions for the day’s activities. In the early weeks of the course students were not told by the teacher the notes were able to be used on tests or quizzes. In the second week of the course the teacher gave a quiz to the students on the prior two weeks assignments, notes, and activities. The teacher then explained that any material used in the class could be used to assist in taking the quiz. The process of allowing students to use notes, assignments, and activities for any quiz or test was implemented in the following weeks of the course. Overall, four quizzes and one test were given to students. The graphs below show the total percentage of students who completed quizzes and tests by using their notebook and the materials within the notebooks. Graph 1 shows the increase in student usage of notes for the quizzes and tests. Graph 2 tracks the students quiz and test scores through the five week research period. Data was also collected on student responses to using notes, and the comments made during and after the quizzes and tests. That data collection is listed below the graphs under the heading “Data.” Improving Student Performance through Note Taking and Organization Students Utilizing Notes 120 Percentage of Students 100 80 60 Percentage of Student's using notes 40 20 Graph 1 0 12-Jan 19-Jan 26-Jan 2-Feb 3-Feb Average Student Quiz and Test Scores 94.00% Average Test Scores 92.00% 90.00% 88.00% Average Student Quiz and Test Scores 86.00% 84.00% 82.00% 80.00% 12-Jan 19-Jan 26-Jan 3-Feb Graph 2 Improving Student Performance through Note Taking and Organization DATA JANUARY 12, 2010 Today was the first day of recorded data for students in the class using their notes on a quiz. Students were told they could use any notes, assignments, or homework from the class for the quiz. Out of 42 students, 3 were absent, and 12 students had papers in front of them. When I asked some of the other students why they were not using their notes I received the following comments: “I didn’t know we could use notes on the quiz.” “I left them at home.” –referring to the notes “I did not take any notes.” After the quiz was finished, I explained to the students that all of the assignments, notes, quizzes, and homework from the class can be used on any test or quiz. I suggested students should use three-ringed notebooks to keep all of their paperwork organized. I offered students free binders if they needed one. Seven students took free binders to organize their class work. JANUARY 19, 2010 Students were asked to take a pop-quiz on hand tool identification. The previous day I had given out guided notes on the common hand tools used in pruning. The test was given orally, but students were still allowed to use their notes from the previous day to complete the quiz. Out of 42 students, 29 were using their notes, 4 were absent the day before, and 4 were absent for the quiz. I asked two of the remaining 5 students why they were not using their notes I received the following comments: Improving Student Performance through Note Taking and Organization “I don’t need my notes, I already know this stuff.” “I left them in my locker” –referring to everything needed for the class After the quiz was completed I again reminded students that everything handed out or written on in class is cleared to be used on tests. JANUARY 26, 2010 A quiz was given today on plant parts and functions. I explained to the students that their notes could be used on the quiz along with any other materials which have been provided to them. I was surprised to notice that I still had students asking questions such as; “Can I use this handout?” My response was tailored, “Did everyone hear Billy’s question? Can you use this handout on your quiz? Yes, you can use any handouts, notes, or assignments for the quiz.” Out of the 42, 35 students were using their notes and had their binders out. Three students were missing which left me with four students still not using their binders or notes to complete the quiz. FEBRUARY 2, 2010 Today I played review jeopardy with the students to cover the pruning lesson from the previous three weeks. I told the students their notes can be used to answer the jeopardy questions and that if they do not have the jeopardy information in their notes, to write them in because the questions would be on the lesson final. Improving Student Performance through Note Taking and Organization Students were responsive to the directions because 37 students out of the 39 students in attendance were writing the information down during jeopardy and/or using their notes to try and answer the questions. FEBRUARY 3, 2010 Today students took the final for the pruning lessons. Every student in attendance had something from the lesson in front of them answer questions on the final. Only one students was absent, so 41 out of 42 students used some sort of assignment, note pages, or activity sheet to complete the final. I asked a few of the students if they liked the opportunity to use coursework on tests and quizzes and the answer was unanimously yes. I asked students if they took better notes, and completed more of the work when the activities could be used on tests and quizzes, and the answer was unanimously, “yes.” Under five percent of the students explained to me that they took the same quality of notes as if they couldn’t use them on the test, and the other ninety-five percent of the students said their notes have improved and they do a more thorough job on the assignments knowing they can use them on tests and quizzes. CONCLUSION AND RECOMMENDATIONS Students learn best from hands-on activities which promote higher order thinking skills. Simply asking students to recall information from notes three weeks early is not the most effective use of student knowledge or teacher time. When teachers assess student learning, the Improving Student Performance through Note Taking and Organization activities, notes, and assignments are dually justified when they can be revisited for quizzes and tests. Many students have never been exposed to a class setting where the tests aren’t generated from memory. In the Agricultural Science and Technology classroom notes aren’t just taken to take notes, but more importantly to reference in the future. By asking students to reference their notes, assignments, and activity outlines to complete other assignments makes those class materials valuable to the students. If assignments, activities, and notes are important enough to assign, students should be allowed to use them as resources to complete assessments. When students are able to use their notes on tests and quizzes the effectiveness of the notes increase along with test scores. BIBLIOGRAPHY Arter, J., & Spandel, V. (1990). Using Portfolios of student work in instruction and assessment. Intructional Topics in Educational Measurement, Retrieved from https://ncme.org/pubs/items/18.pdf Becker, G.S., 1993, Human Capital. 3rd ed. (The University of Chicago Press. Chicago, IL.) Fidel, R., Davies, R., Douglass, M., Holder, J., & Hopkins, C. (1999). A Visit to the information mall: web searching behavior of high school students. Journal of the American Society for Information Science, 50. Retrieved from http://citeseerx.ist.psu.edu doi: 10.1.1.108.1263 Forbes, D. & Spence, J. (1991) An experiment in assessment for a large class, in R. Smith (ed) Innovations in Engineering Education, London: Ellis Horwood. Improving Student Performance through Note Taking and Organization Huffman, W. (1999). Human capital: education and agriculture. Handbook of Agricultural Economics, Retrieved from http://ageconsearch.umn.edu/bitstream/18264/1/isu322.pdf Gibbs, G. & Lucas, L. (1987) Coursework assessment, class size and student performance: 198494, Journal of Further and Higher Education, vol. 21, no. 2, pp. 183-192. Gibbs, G., & Simpson, C. (2004). Conditions under which assessment supports students' learning. Learning and Teaching in Higher Education, 1. Retrieved from http://www2.glos.ac.uk/offload/tli/lets/lathe/issue1/issue1.pdf#page=5 Kniveton, B.H. (1996) Student Perceptions of Assessment Methods, Assessment & Evaluation in Higher Education, vol. 21, no. 3, pp. 229-238. Marton, F. & Wenestam, C.G. (1978) Qualitative differences in the understanding and retention of the main points in some texts based on the principle-example structure, in M.M. Gruneberg, P.E. Moris & R.N. Sykes (eds) Practical Aspects of Memory, London: Academic Press. Marzano, R. (1997). Transforming classroom grading. Retrieved from http://www2.spokaneschools.org/professionallearning/curriculum/reportcard/documents/Tra ns%20Classroom%20Grading.pdf Michaelsen, L., Knight, A., & Fink, L. (2002). Team based learning: a transformative use of small groups. Retrieved from http://books.google.com/books?hl=en&lr=&id=8S8efQkqeqIC&oi=fnd&pg=PA53&dq=effective+ assignments&ots=tel09yKx_i&sig=sVeN89HRh5bfnWSNJfF1Jz2z4k#v=onepage&q=effective%20assignments&f=false Occupational employment and wages. (2008, May). Retrieved from http://www.bls.gov/oes/current/oes252032.htm Oregon Department of Education, (2005). Closing the achievement gap. Oregon's Plan for Success for all Students, 1(1), Retrieved from http://www.ode.state.or.us/pubs/eii/closin gachievementgapprimer.pdf Rust, C., Price, M., & ODonovan, B. (2003). Improving students’ learning by developing their understanding of assessment criteria and processes. Assessment & Evaluation in Higher Education, 28(2), Retrieved from http://teaching.econ.usyd.edu.au/groupwork/Assessing/docs/Rust%20Price%20ODonovan.pdf Stefani, L. (2004). Assessment of student learning: promoting a scholarly approach. Learning and Teaching in Higher Education, (1), Retrieved from http://www2.glos.ac.uk/offload/tli/lets/lathe/issue1/issue1.pdf#page=5 Improving Student Performance through Note Taking and Organization