Published December 19, 2014 Undergraduate Education Student Perception of Metacognitive Activities in Entry-Level Science Courses Leah Sandall, Martha Mamo,* Carol Speth, Don Lee, and Timothy Kettler ABSTRACT A research study investigated student perception of the use of metacognitive activities in the classroom. The courses were large enrollment (n > 100) introductory Plant and Soil Sciences courses taught in the fall semester. The courses implemented activities such as concept sketches or conceptual modeling to help students develop their learning strategies and provided instructors the experience to develop strategies of best practices in implementing metacognitive activities. An endof-semester survey was administered to students to gauge student perception of these learning strategies. In the Soil Resources course, 69% of all students thought the emphasis on metacognition was useful, and 94% of the freshmen said the emphasis on metacognition was useful. In the Plant Science course, 82% of the students said the emphasis on metacognition was useful. Impact Statement Teaching and learning environments in higher education should be created to promote metacognitive thinking to cultivate achievement and prepare students to address societal challenges. Entry-level, college science courses provide students with the opportunity to establish foundational knowledge, explore their interests in a discipline, and develop skills in solving problems relevant to the discipline. The confidence required to meet problem-solving, learning objectives contrasts with student experience in knowledge accumulation and recall. This lack of confidence in problem-solving can be addressed when teachers use metacognition teaching strategies (Lester et al., 1989) as a means to promote students’ academic success and encourage the idea of disposition to understand for oneself (Entwistle and McCune, 2013). Metacognition refers to meta-level knowledge and mental actions used to direct or manage cognitive processes. In its simplest definition, metacognition is “thinking about one’s own thinking” (Flavell, 1979). DeBono (1976) describes metacognition as knowing what to do, when to do it, how to do it, and what to take into consideration. Metacognition is a skill that develops over time where the learner is self-aware of his/her thinking and regulates his/her processes used to solve a problem and/or execute a task. As such, it is intentional and leads one to become a self-regulated learner where the learners set standards or goals to strive for in their learning, monitor their progress Department of Agronomy and Horticulture, 202 Keim Hall, Univ. of Nebraska-Lincoln, Lincoln, NE 68583. Received 12 June 2013. *Corresponding author (mmamo3@unl.edu). Nat. Sci. Educ. 43:25–32 (2014) doi:10.4195/nse2013.06.0021 Available freely online through the author-supported open access option. Copyright © 2014 by the American Society of Agronomy, 5585 Guilford Road, Madison, WI 53711 USA. All rights reserved. No part of this periodical may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or any information storage and retrieval system, without permission in writing from the publisher. Na t ura l Sc i en ces E du ca ti on • V ol u me 4 3 • 2 0 1 4 toward these goals, and then adapt and regulate their cognition, motivation, and behavior in order to reach these goals (Pintrich 2000; Vrugt and Oort, 2008). In science education, metacognitive skills enable the learner to understand science concepts removing misconception and strategies that are barriers to acquiring new concepts (White and Frederiksen, 1998). Sperling et al. (2012) in their analysis indicated metacognition is a significant predictor in science achievement and overall achievement. Developing metacognitive skills in students requires teaching and modeling the metacognitive process in the classroom, cultivating in students explicit knowledge about when and where to use strategies. Promoting metacognition begins with building an awareness among learners that metacognition exists and increases academic success (Schraw, 1998). As such, teachers need to explicitly use the thinking language both verbally and in action in the classroom (Schraw, 1998). In creating a classroom atmosphere that nurtures metacognition, consideration must be given to what is said, how it is said, what is being done, and how it is being done. Marzano (1998) documented that explicit metacognitive talk as one of the most important tools for improving student learning. Costa (2008) suggests using language that evokes thinking and the thinking process rather than vague abstract terms allowing students to internalize these terms and begin to make them part of their vocabulary. For example instead of asking students “What is the effect of climate variability on soil functions?” the teacher should ask “What evidence do you have on how climate variability affects soil functions?” or “What hypothesis do you have to support climate variability effect on soil functions?” The metacognitive process is a self-reflection, asking process that includes asking oneself “What do I know? What tools do I have to address these questions/problems? What are the appropriate steps? How could I do this better?” The work of Mevarech and 25 Table 1. Metacognitive activities implemented in Soil Resources and Plant Science in fall semester 2011 at the University of Nebraska-Lincoln. Soil resources Plant science Develop course goals at the beginning of the semester and assess whether you have achieved them at the end. X X Complete a knowledge survey at the beginning and end of each unit. X Complete an exam wrapper and evaluate what went well and what did not and how you plan to prepare for the next exam. X X Develop conceptual maps and sketches for ideas/concepts and to connect ideas. X X Activity Fig. 1. Example of student work group set-up in Soil Resources and Plant Science fall semester 2011 at the University of Nebraska-Lincoln. Kramarski (1997) on metacognitive instruction emphasizes reflective discourse to teach mathematical knowledge and reasoning. This metacognitive instruction known as IMPROVE entails: 1. Introducing the new material; 2. Metacognitive questioning (what is the problem, connecting problem to past experience, identifying appropriate strategies, evaluating appropriateness of the solution); 3. Practicing; 4. Reviewing; 5. Obtaining mastery on higher and lower cognitive processes; 6. Verification; and 7. Enrichment and remediation. In an effort to create a “thinking classroom” and promote efficiency in learning for academic success, a pilot project was initiated to evaluate the efficacy of course activities in helping students develop self-awareness in learning. The overall goal was to explicitly integrate metacognitive practices in both lower- and upper-level courses. The courses in this pilot project were large enrollment (n > 100) entry level Plant and Soil Sciences courses taught in the fall semester. It is postulated that providing these experiences in gateway courses will help cultivate metacognition in students and promote efficiency in learning. At the same time, teachers have the opportunity to develop the experience and techniques to explicitly integrate metacognitive practices. MATERIALS AND METHODS Course and Student Population Descriptions Soil Resources (AGRO/SOIL/HORT 153), a 4-credit-hour introductory course, is required for many students majoring in the College of Agricultural Sciences and Natural Resources (CASNR) at the University of Nebraska-Lincoln (UNL). Students attend a lecture period (50 minutes) once per week and two laboratory-recitation periods (110 minutes each) each week. There were a total of 7 lab sections, with approximately 20 to 24 students in each section during the fall of 2011. 26 Use models (for the gene expression process) to illustrate processes/ concepts. X Write reflection on topics and/or units recently completed. X Generate questions when reviewing notes. X Discuss responses to oral questions with group. X X Discuss responses to activities with group. X X Solve problems with group X X Explain to instructors how answers were derived. X X Introductory Plant Science (AGRO/HORT 131), a 3-credit-hour course, is required for many students with majors in the Agronomy and Horticulture Department at UNL. The course is taught so that students attend two lectures (50 minutes each) and one recitation period (110 minutes) per week. In the semester that the pilot study was conducted there were a total of four recitation sections with approximately 25 students in each. In the fall of 2011, this course was also taught online in which all course requirements were completed over the Internet and as a hybrid section (lectures and material delivered online with a once per week, face-to-face recitation meeting). Both courses run for a full semester (16 weeks). The labrecitation period consists of short, up-front instruction (10– 20 minutes) during each meeting in addition to some interactive elements (questions, student-centered reviews, inclass quizzes, hands-on activities). Students work in groups of approximately three to four students to complete activities and problems (Fig. 1). Metacognition was explained and instruction given at the beginning of the semester. An instructor was available to answer questions and help guide learning throughout each lab-recitation period. Activities Enforcing Metacognition Both Soil Resources and Plant Sciences implemented metacognitive activities in the classroom in similar ways. Metacognitive activities can be categorized into three areas: planning, monitoring, and evaluation (Schraw et al., 2006). Activities such as developing goals and planning exam strategies fall under the metacognitive area of planning. Monitoring activities included items like developing concept sketches and maps, using models to explain course topics, and generating questions as content is reviewed. Concept sketches engage students in N a tur a l S c i e nc e s E d uc a ti on • Vol um e 43 • 20 1 4 Fig. 2a. Concept sketch on soil erosion and processes from a case study developed by students in Soil Resources fall semester 2011 at the University of Nebraska-Lincoln. Based on the Holmes Lake (Lower Platte South Basin) case study: A. Develop a concept sketch for this case addressing how soil erosion contributed to Holmes lake impairment. Consider the following in your overall sketch: 1. Type of erosion and process within the Holmes Lake watershed 2. Role of land use and land use change 3. Role of Antelope creek banks 4. Impact on lake functions (aquatic life, recreation etc…) B. Develop recommendations for the Antelope Creek watershed to reduce future damage to the Lake (What can builders do? What can home owners do?, etc…). Present your evidence for each recommendation of how it would efficiently work to reduce sedimentation/pollution of the lake and resource loss (soil loss by erosion) within the watershed. Fig. 2b. Example concept sketch activity on erosion in Soil Resources at the University of Nebraska-Lincoln (example student sketch for this activity is presented in Fig. 2a). the learning process, develop critical thinking skills, teach communication skills, and at the same time help identify student misconceptions (Johnson and Reynolds, 2005). The evaluation area pertains to students’ reviewing goals at the end of the semester or reviewing graded exams to identify misconceptions, inaccuracies, and develop better strategies for future exams. The goal of using these activities in the classroom was to provide opportunity for students to practice metacognitive skills while learning Soil or Plant Sciences content. The two courses implemented the metacognitive activities listed in Table 1 (examples of activities in Fig. 2 and 3). Na t ura l Sc i en ces E du ca ti on • V ol u me 4 3 • 2 0 1 4 27 Fig. 3. Concept map on photosynthesis, respiration, translocation, and transpiration developed by students in Plant Science fall semester 2011 at the University of Nebraska-Lincoln. Description of the Evaluation The survey administered asked students to respond to questions assessing their perception of the metacognitive activities and other teaching tools used in the classroom on their overall learning in the course. The survey was deployed using Survey Monkey, which allowed anonymous electronic data collection (Table 2). Data were collected at the end of the semester. The survey included demographic information on students’ year in school and major and was administered with Institutional Review Board Approval (IRB #200306328 EX) to ensure student confidentiality. Completion of the survey indicated that students were consenting to participate in the study. A scale of 0 to 3 was used on questions where students were asked to rank specific activities (Table 2). The survey given was very similar for both Plant Science and Soil Resource students but asked for specific feedback related to activities conducted in each course. Students in both courses were given extra credit points for participating in the survey. RESULTS AND DISCUSSION Academic Major Descriptions In Soil Resources, 44% of students were in an agriculture-related major, whereas 19% were an environmentalrelated major. In Plant Science, almost 60% of students 28 were in an agricultural-related major and only 2.5% were in an environmental area (Table 3). An important question of interest was whether a majority of students in each class acknowledged that the emphasis on metacognition was useful. Another question was how students of different class standing would view the emphasis on metacognitive activities. Open-ended item responses were included in the survey questionnaires. In the Soil Resources course, 69% of all students thought the emphasis on metacognition was useful, 19% said it was not, and 12% were unsure. In Soil Resources, 94% of the freshmen said the emphasis on metacognition was useful. Seventy five percent, 68%, and 48% of the sophomores, juniors, and seniors, respectively, found the emphasis helpful. Here are two sample comments from this course: • The metacognition processes were helpful in outlining course objectives and staying focused on the end result. • If this was the first time I had come into contact with these methods I would definitely have said yes but I’ve had this all throughout high school. I can see how they may be applicable to younger students or different majors though. In Plant Science, 82% of the students said the emphasis on metacognition was useful, 8% said it was not, and N a tur a l S c i e nc e s E d uc a ti on • Vol um e 43 • 20 1 4 Table 2. Survey questions used in survey completed by students in Soil Resources and Plant Science in fall semester 2011 at the University of Nebraska-Lincoln. Survey questions 1 Do you think the emphasis on learning strategies and study skill in this course was valuable to you? 2 Please give an example of a learning strategy or study skill that worked for you in this course. Please be specific. 3 You were asked to participate in a number of activities to improve your learning strategies and study skills. Please evaluate them in terms of their usefulness for you in this course. (Various activities listed in survey for students to evaluate.) 4 Please evaluate each of the following strategies in terms of how often you used them. (Various strategies listed in survey for students to evaluate.) 5 How useful were the following supporting resources? (Various resources listed in survey for students to evaluate.) 6 Did the exams and graded assignments measure how much you really learned? (Various graded items listed in survey for students to evaluate.) 7 Comments about any of the questions. Table 3. Student majors and class standings in Soil Resources and Plant Science in the fall semester 2011 at the University of Nebraska-Lincoln. Major Soil resources n = 95 Plant science n = 138 —————————————— % —————————————— Agricultural Science and Business Agricultural Education and Journalism Environmental Sciences and Natural Resources 39.3 57.1 4.8 2.5 16.7 2.6 Forensic Science 9.5 Horticulture 7.1 9.2 13.2 18.5 7.1 10.1 Landscape Design and Turf Management Mechanized Systems Management 0 Class standing Freshman (≤ 26 hours accrued) 18 52.9 Sophomore (27–52 credit hours accrued) 25 22.1 Junior (53–88 credit hours accrued) 30 15 Senior (≥ 89 credit hours accrued) 26 5.7 Graduate 0 2.9 Other 1 1.4 10% were unsure. Almost 84% of the freshman, 71% of the sophomores, 86% of the juniors, and all of the seniors said it was useful. Sample comments from this course were: • I feel like these strategies and skills would have helped me greatly in a class that I was not very interested or involved in. But since I found this class to be very interesting I was able to study and learn perfectly fine the old fashion (sic) way. • Yes and no. I felt I was still learning, and it was great to pick up new strategies, but it seemed a bit overwhelming to me. The evaluation included which strategies students valued most and least (Table 4). One series of questions focused on learning strategies: “You were asked to participate in a number of activities to improve your learning strategies and study skills. Please evaluate them in terms of their usefulness for you in this course.” In the Soil Resources course, students gave the highest mean rating to “Solve problems with your classmates,” followed by “Explain to the instructor how you derived your answer.” They gave their lowest ratings to “Develop course goals.” In Plant Science, the highest mean rating went to “Using models to explain processes/concepts,” followed by “Solve problems as a group” and “Concept maps.” The lowest ratings were for “Generate your own questions as you review your notes.” Students were asked to evaluate each of the following strategies in terms of how often they used them. Students in the Soil Resources course gave the highest Table 4. Highest and lowest ratings of activities by students in Soil Resources and Plant Science fall semester 2011 at the University of Nebraska-Lincoln. Category Highest rating Lowest rating Soil resources Strategies solve problems with your classmates develop course goals How often use pre-exam summary as a learning tool generate questions Resources manual, lab group, hands-on textbook How useful manual, lab group, hands-on textbook Measures lab quizzes, exam project Strategies using models to explain, solve problems as a group generate questions How often answer all questions in problem set before quiz generate questions Resources instructor communication, problems online resources How useful answer all questions in problem set before quiz online resources Measures reading quizzes, think-a-loud experiment write-up Plant sciences Na t ura l Sc i en ces E du ca ti on • V ol u me 4 3 • 2 0 1 4 29 frequency rating to using the pre-examination reflection (Fig. 4) as a learning tool for each topic, followed by reviewing their completed worksheets. They gave the lowest frequency rating to generating questions from the topic and trying to answer them. Students in Plant Science gave the highest frequency ratings to answering all questions in their problem set before taking the quiz and applying course content to a case study. They gave the lowest frequency ratings to generating questions from the topic and trying to answer them. When students were asked how useful the following supporting resources were, those in the Soil Resources class gave the highest rating to the course manual, then the lab group and hands-on learning. They gave the lowest rating to the textbook. In Plant Science, students gave the highest ratings to instructor communication and working problems. They gave the lowest ratings to online resources. However it should be said that the online ebook was highly valued by some students. Sample comments were: • I liked the ebook quizzes because you got initial feedback and that helped me understand what I needed to study more. • The online ebook that went with each week. This allowed us to read and see how the material was applied to a real life situation, which is helpful as it shows us how we may use it in our futures as well. • The problem set and ebook was a great repetitive learning strategy. Students in each class were asked whether the exams and graded assignments measured how much they really learned. Soils students gave the highest rating to lab quizzes and exams. They gave lowest ratings to the group project. Students in Plant Science gave their highest rating to the quizzes and their lowest ratings to experiment writeups. In both courses the textbook (traditional or as the online eBook), projects, and generating questions seemed to be the least preferred learning activities. It is possible that textbook-assigned reading can be objective based and linked to specific activities. The experiments and project write-ups as well as generating questions require higherorder thinking and self-reflection to interpret the data, connect the data to concepts, and articulate explanations in writing using the data as evidence. The instructors began teaching with this emphasis on metacognition so students would begin to think about their own thinking. The best positive indication came from responses to the open-ended questions, which indicated a degree of success to explicitly integrate certain activities to enhance questioning, monitoring, and evaluation of one’s own thinking. • I feel the test review/reflections were a valuable tool. They allowed me to go back through the sections on the test and gain more information about what was going to be covered on the exam. • Pre-flections for exams. It was a good way of forcing us to study the correct materials. • Filling out the Pre-Exam sheets really helped me to understand the lessons. I liked having to make the word webs because it cemented how concepts were connected. • I learned a lot of discipline throughout this course. It wasn’t something that could be put off and I had to discipline myself to get some studying done around the rest of my schedule. 30 Soil Resources 153 Reflection on Unit and in Preparation for Exam DUE ON DAY OF THE EXAM Please address each of the four items separately. Turn in a clean copy the day of the exam. 1. Develop a list of vocabulary words with your OWN definition (suggested 5 vocabs. per topic). 2. What are the main ideas from each topic? 3. In your opinion, what essential knowledge and skills have you taken from this unit? 4. Create a visual representation of the connection of main ideas (see #2 above) learned thus far (Hint: Think concept sketch and model format). Checklist • Re-review topics exercises. • Find a study group and ask questions or explain to each ideas and calculations. • For problem solving questions, draw pictures to help you understand what the problem is asking and evaluate the given information within the problem, and then seek appropriate solution. • Rework the calculations and know when to use the appropriate equation relationships. Understand what story the calculations are telling you. • Work the calculation problems backward to check yourself. • Use online quizzes as review tool. • Use knowledge survey questions as study guide. • Re-review assigned readings. • Use past exam to prepare for exam. • Attend review session if offered. • Others… Fig. 4. Example guidelines for developing post-lesson and preexamination reflection in Soil Resources fall semester 2011 at the University of Nebraska-Lincoln. • The metacognition processes were helpful in outlining course objectives and staying focused on the end result. • Turning in reviews of the chapters we went over before each test helped me review the concepts and make sure I understood them. • I found the summary and reflections for each section to be quite useful. By the time I was done completing them, I was already pretty well prepared for the coming exam. • I believe when actually taking the time to think about the way your (sic) thinking, you learn more about how your (sic) going to remember this and not just throw out an answer. You try and think about all aspects of the topic, and not just memorize a question. • I believe the learning quizzes helped me after lectures because they made me think about what I learned in the lecture. • Exam Reviews, Jeopardy Tests and Quizzes let me prepare for the exam. They let me know the kind of questions I have to be prepared for and offer a high quality feedback. • I would review the Problem Set questions a lot because they always seemed to help me better understand the lesson. N a tur a l S c i e nc e s E d uc a ti on • Vol um e 43 • 20 1 4 This study suggested that the metacognitive activities were having a positive effect. However, there are a few students who felt this was unnecessary or “busy work.” See example comments below: • I already study well and did not feel that being told how to study a certain way was a good use of my time. • I would have liked more time spent on the material, a better manual, and more helpful teaching techniques, rather then (sic) all of the busy work. • There were way too many surveys, course wrap ups, evaluations, etc. I realize it’s a freshman level course but if I was looking for ways to improve my learning I would take a psychology course. The best measure of my learning was from the exams. CONCLUSIONS AND IMPLICATIONS Students reacted positively in terms of the usefulness of many items. The highest perceived preference in Plant Science was the models (Fig. 5), whereas it was group problem solving for Soil Resources. Soil Resources students reported using the course manual, developing a summary, and relating ideas frequently. Plant Science students reported using problem sets, applying concepts to a case study, and relating ideas most often. Students in both courses reported that generating questions and critiquing ideas were not frequently used. Instructors recognized the importance of being explicit with discussion about metacognition in the classroom so that students can begin making connections between activities and learning. Students are novices in metacognitive skills and may resist such approaches during the course. However, they may value these skills later as independent thinking is expected in other courses and careers. Based on the findings from this pilot study, it seems that a high percentage of students recognize the value of actively engaging in metacognition. Instructors in both courses are motivated to continue expanding these activities, given 82% of the Plant Science students and 69% of the Soil Resources students responded that the metacognition emphasis was useful. Recognizing metacognition as a valuable learning tool for both instructors and students is a long process. Therefore, exposure to metacognitive activities needs to be implemented throughout curriculum to maximize effectiveness for students, at the same time, authentic activities that enhance metacognitive skills require time to prepare, plan, and implement. Instructor Reflections and Metacognition Resources for the Classroom Instructors for both courses observed students being more engaged with the course content when metacognitive activities were implemented. At times this translated into more student questions or even students self-correcting when completing the activities. With certain metacognitive activities, like the concept map/sketch and using models, students appeared to also be more engaged with their peers in the class by posing questions to one another, creating more discussions, and demonstrating more depth of content knowledge. Instructors for both courses also commented that it was necessary, at times, to revise metacognitive activities after the first use to better fit the needs and the level of the students and course content. Occasionally, some students would choose to construct a reflective narrative about the content rather than construct Fig. 5a. Photosynthesis model (hands-on activity) constructed by students in Plant Science fall semester 2011 at the University of Nebraska-Lincoln. Photosynthesis Model Instructions: Use the paper pieces to construct and show the process of both the light reaction and the dark reaction in photosynthesis. You should be able to explain and show the steps in each process to your instructor using the model. Fig. 5b. Photosynthesis model instructions students were given in Plant Science fall semester 2011 at the University of NebraskaLincoln. diagrams to show connection and relationships among ideas. Some, if not all, often did not know how to begin a concept map/sketch. For such reasons, instructors usually provided hints and examples to help students start the activities (apprenticeship). Often the most difficult aspect of implementing new methods in the classroom is the limitation of time. The following is a list of ideas, tips, and resources based on trial and error, as well as observation, to help guide development of metacognitive activities. 1. Teacher enthusiasm about metacognition in the classroom translates to student buy-in. 2. Modify or improve the way questions are asked in the classroom and immerse classroom with explicit metacognitive talk. 3. Model metacognitive thinking and process in the classroom. For example, the instructor constructs or generates a concept map or sketch to help students see how to organize ideas and explain knowledge. 4. Be willing to try an activity with the students and have it not work as planned. This allows for revisions tailored to a specific course. 5. Collaborate with colleagues. Sharing ideas and resources creates synergy. 6. Use available resources, such as the ones from the following website: http://serc.carleton.edu/ NAGTWorkshops/metacognition/index.html 7. Start small by implementing one type of activity in your course, like the concept map or exam reflection/ wrapper. Na t ura l Sc i en ces E du ca ti on • V ol u me 4 3 • 2 0 1 4 31 References Costa, A.L. 2008. The thought-filled curriculum. Educ. Leadership 65(5):20–24. DeBono, E. 1976. Teaching thinking. Temple Smith, London. Entwistle, N., and V. McCune. 2013. The disposition to understand for oneself at university: Integrating learning processes with motivation and metacognition. Brit. J. Educ. Psychol. 83:267– 279. doi:10.1111/bjep.12010 Flavell, J.H. 1979. Metacognition and cognitive monitoring: A new area of cognitive-developmental inquiry. Am. Psychol. 34:906– 911. doi:10.1037/0003-066X.34.10.906 Johnson, J.K., and S.J. Reynolds. 2005. Concept sketches: Using student- and instructor-generated, annotated sketches for learning, teaching, and assessment in geology courses. J. Geosci. Educ. 53(1):85–95. Lester, F.K., J. Garofalo, and D. Lambdin Kroll. 1989. Selfconfidence, interest, beliefs, and metacognition: Key influences on problem-solving behavior. In: D.B. McLeod and V.M. Adams, editors, Affect and mathematical problem solving. Springer-Verlag, New York. p. 75–88. Marzano, R.J. 1998. A theory-based meta-analysis of research on 32 Mevarech, Z.R., and B. Kramarski. 1997. IMPROVE: A multidimensional method for teaching mathematics in heterogeneous classrooms. Am. Educ. Res. J. 34(2):365–395. doi:10.3102/00028312034002365 Pintrich, P.R. 2000. Multiple goals, multiple pathways: The role of goal orientation in learning and achievement. J. Educ. Psychol. 92:544–555. doi:10.1037/0022-0663.92.3.544 Schraw, G. 1998. Promoting general metacognitive awareness. Instr. Sci. 26(1/2):113–125. doi:10.1023/A:1003044231033 Schraw, G., K.J. Crippen, and K. Hartley. 2006. Promoting selfregulation in science education: Metacognition as part of a broader perspective on learning. Res. Sci. Educ. 36:111–139. doi:10.1007/s11165-005-3917-8 Sperling, R.A., A.S. Richmond, C.M. Ramsay, and M. Klapp. 2012. The measurement and predictive ability of metacognition in middle school learners. J. Educ. Res. 105:1–7. doi:10.1080/00 220671.2010.514690 Vrugt, A., and F.J. Oort. 2008. Metacognition, achievement goals, study strategies and academic achievement. Metacognition Learn. 3:123–146. doi:10.1007/s11409-008-9022-4 White, B., and J. Frederiksen. 1998. Inquiry, modeling, and meta- instruction. Mid-Continental Regional Educational Laboratory, cognition: Making science accessible to all students. Cognition Aurora, CO. p. 29–65. Instruct. 16(1):3–118. doi:10.1207/s1532690xci1601_2 N a tur a l S c i e nc e s E d uc a ti on • Vol um e 43 • 20 1 4