Using computer animation and illustration activities to improve high

advertisement
JOURNAL OF RESEARCH IN SCIENCE TEACHING
VOL. 45, NO. 3, PP. 273–292 (2008)
Using Computer Animation and Illustration Activities to Improve High School
Students’ Achievement in Molecular Genetics
Gili Marbach-Ad,1,2 Yosi Rotbain,1 Ruth Stavy1
1
2
School of Education/Humanities, Tel Aviv University, Ramat-Aviv, Tel Aviv, Israel
College of Chemical and Life Sciences, University of Maryland, 1328 Symons Hall,
College Park, Maryland 20742
Received 3 October 2006; Accepted 7 May 2007
Abstract: Our main goal in this study was to determine whether the use of computer animation and
illustration activities in high school can contribute to student achievement in molecular genetics. Three
comparable groups of eleventh- and twelfth-grade students participated: the control group (116 students)
was taught in the traditional lecture format, whereas the experimental groups received instructions that
integrated a computer animation (61 students) or illustration (71 students) activities. We used three research
instruments: a multiple-choice questionnaire; an open-ended, written questionnaire; and personal
interviews. Five of the multiple-choice questions were also given to students before they received their
genetics instruction (pretest). We found that students who participate in the experimental groups improved
their knowledge in molecular genetics compared with the control group. However, the open-ended
questions revealed that the computer animation activity was significantly more effective than the illustration
activity. On the basis of these findings, we conclude that it is advisable to use computer animations
in molecular genetics, especially when teaching about dynamic processes; however, engaging students
in illustration activities can still improve their achievement in comparison to traditional instruction.
ß 2007 Wiley Periodicals, Inc. J Res Sci Teach 45: 273–292, 2008
Keywords: biology; achievement; attitudes
This study integrates two leading research areas in science education today: students’
understanding of molecular biology and the use of computers in science education. As for the first
research area, the rapid development of research in molecular biology in the last two decades and
its major implications for everyday life have had a major influence on high school curricula,
raising much interest in the investigation of students’ conceptions concerning molecular genetics
(e.g., Marbach-Ad, 2001; Bahar, Johnstone, & Sutcliffe, 1999; Garton, 1992; Golan & Reiser,
2002; Kindfield, 1994a,b). Recent studies (e.g., Golan & Reiser, 2002) on students’ understanding
of principles and concepts in molecular genetics suggest that current genetics instruction
Correspondence to: G. Marbach-Ad; E-mail: gilim@umd.edu
DOI 10.1002/tea.20222
Published online 5 December 2007 in Wiley InterScience (www.interscience.wiley.com).
ß 2007 Wiley Periodicals, Inc.
274
MARBACH-AD, ROTBAIN, AND STAVY
leaves students unprepared to understand the everyday benefits and problems resulting from
technological advances in molecular genetics, such as genetic counseling, screening, and choices
(Lewis & Wood-Robinson, 2000). Furthermore, students are not informed enough to understand
and participate in current debates involving genetic issues, such as genetically modified foods,
cloning, and gene therapy (Garton, 1992).
For the second research area, the fast-growing use of personal computers in almost all
domains of life has also influenced science education. A number of science educators believe that
computer animation (also called computer simulation) in particular has tremendous potential for
the enhancement of the teaching and learning of science concepts (e.g., Ellis, 1984; Marks, 1982).
According to those researchers it is in the area of animations that computers have the potential to
deal with higher-learning outcomes in a way not previously possible inside the science classroom.
Educators and researchers have been commenting on the potential of using animations and
other software in genetics instruction to facilitate the visualization of abstract concepts and
processes at the micro level of instruction (Tsui & Treagust, 2004; Wu, Krajcik, & Soloway, 2001).
In fact, on the web we found a fairly large number of dynamic animations, including interactive
animations, illustrating either the molecular structures of DNA, RNA, and protein, or the
processes of DNA replication, transcription, and translation. However, the science education
literature has hardly any experiment-based reports about the effect of the use of computer
animation models on student achievement in molecular biology (Gearner, 2001; Hays, 2001).
The question whether computer animations are preferable to other classroom activities is still
unanswered. In our study we sought to examine the additional value of the computer animation
over illustration activities, and explored the impact of using these activities on students’
achievement in different subtopics (e.g., DNA and RNA structure and DNA replication,
transcription, and translation). This study specifically builds on our previous article published in
this journal (Rotbain, Marbach-Ad, & Stavy, 2006).
Theoretical Background
The molecular aspects of genetics gained central importance in the second half of the
twentieth century, with Watson and Crick’s discovery of the structure of DNA, an event that gave
rise to entirely new disciplines (e.g., genetic engineering) and influenced the direction of many
established ones (Nelson & Cox, 2000, p. 332). Garton (1992), referring to the difficulties of
genetics instruction in high school, argued that, as the revolution in the field of genetics continues,
the web of abstract concepts becomes increasingly complex.
In our earlier investigation (Rotbain et al., 2006) we elaborated on students’ difficulties in
understanding molecular genetics concepts and processes, and argued that these difficulties are
especially attributed to the emphasis on minute detail and abstract concepts (Malacinski & Zell,
1996). Researchers who take a constructivist approach to teaching recommend, in the face of such
difficulties, to enhance teaching through active engagement using models and visualization.
Educators agree that visualization and modeling constitute an important component in
science achievement generally (Gilbert, Justi, & Aksela, 2003), and on the molecular level in
particular. Graphics visualization tools such as molecular modeling and animation can be used to
give an accurate and rich picture of the dynamic nature of molecules and molecular interaction,
which is often very difficult to understand from text-based presentations of information (NSF,
2001).
The enthusiasm for graphics of all kinds rests on the belief that they benefit comprehension
and learning, and foster insight. Many advantages of graphics have been proposed. Graphics
provide an additional way of representing information: two codes, pictorial and verbal, are
Journal of Research in Science Teaching. DOI 10.1002/tea
COMPUTER ILLUSTRATION AND ANIMATION
275
better than one. Graphics may be aesthetically appealing or humorous, attracting attention and
maintaining motivation. Graphics use visual elements and the spatial relations among them to
represent elements and relations that may be visuospatial, or may be metaphorically visuospatial,
applying the power of spatial inference to other domains (Larkin & Simon, 1987; Tversky, Bauer
Morrisony, & Betrancourt, 2002). Graphics may save words by showing things that would
otherwise need many words to describe. Thus, another function of graphic displays is to use space
to organize information and to facilitate memory and inference. The benefit to the individual mind
is reducing the burden on memory and processing by off-loading.
Recently, with the advent of new technologies for instruction, an increasing reliance on
visuals in molecular-level instruction has come to include animated computerized graphics
(Lowe, 2003, p. 157). Animated computerized graphics are widely used in research for the same
reasons that they could be useful in education, namely to explore emergent behavior of systems
too complex for closed solutions and to follow the evolution of these systems. The ability to
visualize what happens to collections of interacting atoms and molecules under many different
conditions and rules gives the researcher a deep, intuitive understanding of the system under
study. Learning experiences based on molecular dynamics tools should help students develop
more scientifically accurate mental models of atomic- and molecular-scale phenomena, which
should in turn help them to reason more effectively at different levels, like experts (Pallant &
Tinker, 2004).
We believe that the phenomena and processes in the molecular genetics domain are likely to
be better understood with graphics and animations for several reasons. In what follows we
elaborate on these reasons, referring to the literature. It is noteworthy that most of the research on
using computerized models for molecular-level domains comes from chemistry (Barnea & Dori,
1996; Williamson & Abraham, 1995; Wu et al., 2000), whereas only a few studies deal specifically
with molecular biology (Pallant & Tinker, 2004; Tsui & Treagust, 2004).
The first reason why using graphics and animation benefits molecular biology instruction
concerns the need to understand the molecular structure and molecular/atomic interactions.
Hmelo, Holton, and Kolodner (2000) suggested that structures are often the easiest aspect of a
complex system to learn; in molecular genetics especially, understanding the structure of
molecules such as DNA and RNA is crucial to comprehending their functions. Graphics in this
case can help to organize the small pieces of information into large chunks of information,
reducing the amount of memorization required by increasing the logical connections between
ideas (Pallant & Tinker, 2004; Tversky et al., 2002).
Pallant and Tinker (2004) described the use of two molecular dynamics models (Molecular
Workbench and Pedagogica) embedded in a set of online learning activities with middle and high
school students in ten classrooms. Their studies found that middle and high school students can
acquire robust mental models of the states of matter through guided explorations of computational
models of matter based on molecular dynamics. Using this approach, students accurately recall
arrangements of the different states of matter, and can reason about atomic interactions. Follow-up
interviews indicate that students are able to transfer their understanding to new contexts.
Barnea and Dori (1996) suggested that the advantage of the computerized molecular model is
that, through the use of software, molecules of any size, number, and type can be conveniently
constructed, making the presentation more accurate. Barnea and Dori, exploring the effect of
using molecular modeling on tenth graders, also found that it helped students understand concepts
in molecular geometry and bonding.
Wu et al. (2000) investigated how students develop their understanding of chemical
representations with the aid of a visualizing tool, eChem, which allows them to build molecular
models and view multiple representations simultaneously. Multiple sources of data were
Journal of Research in Science Teaching. DOI 10.1002/tea
276
MARBACH-AD, ROTBAIN, AND STAVY
collected with the participation of 71 eleventh graders over a 6-week period. The results of the
pre- and posttests show that students’ understanding of chemical representations improved
substantially.
The second reason for using graphics and animation in molecular biology concerns the need
to understand dynamic molecular processing with multiple steps. Phenomena and processes in
the molecular genetics domain (e.g., DNA replication, transcription, and translation) occur on
a minute space scale, involving multiple and diverse entities. They also take place in multiple
locations throughout the cell. Researchers have suggested that instruction involving computer
animations can facilitate the development of students’ visualization skills and their abilities to
think about chemical processes at the molecular level in a stepwise fashion (Sanger, Brecheisen, &
Hynek, 2001; Williamson & Abraham, 1995), especially when the animation allows interactivity.
Clearly, interactivity, a factor known to facilitate learning, can help overcome difficulties in
perception and comprehension. Stopping, starting, and replaying an animation can allow
reinspection, focusing on specific parts and actions. Animations that allow close-ups, zooming,
alternative perspectives, and control of speed are even more likely to be facilitating (Tsui &
Treagust, 2004; Tversky et al., 2002).
Williamson and Abraham (1995), who explored the effect of computer animation on the
particulate mental model of college chemistry students, concluded that animations might help
increase conceptual understanding by prompting the formation of dynamic mental models of the
phenomena at hand. They also found that students who viewed only static visuals either formed
static mental models that failed to provide adequate understanding of the phenomena, or did not
manage to form any mental model for the particulate nature of matter, and were left with
macroscopic views of the phenomena.
The third reason is related to students’ motivation to study the molecular level. Many high
school biology students, especially those who do not study advanced chemistry, have difficulty
in understanding chemical formulas and they develop a ‘‘phobia’’ of biology subjects on the
molecular level (e.g., genetics and photosynthesis). Using computerized animation can reduce this
fear by turning the learning into a kind of game. Barnea and Dori (1996) reported that tenth graders
who used computerized models in chemistry enjoyed using them and their attitudes toward the
software were positive.
Nevertheless, alongside the advantages of the use of computer animations, it is important
to mention that there are still some reservations regarding the recent preference for using
computerized programs as the major learning tool for any subject matter. Furthermore,
the question of whether the dynamic visuals of computer animations are preferable to
illustration activities, when learning dynamic processes, is still unanswered (Gearner, 2001;
Hays, 2001).
On the face of it, animations would seem more appropriate when representing dynamic
processes, an argument that was raised by Lewalter (2003), who claimed that animations are
superior for the visualization of spatial constellations and dynamic processes. However, Lewalter
himself suspected that arrows and series of frames, which are quite conventional symbols for
motion, might be sufficient in some cases.
In a study on the attitudes of prospective high school mathematics teachers toward integrating
computers into their future classroom teaching, 94 teachers were asked to present pro and con
arguments that would influence their use of computers in future mathematics teaching (Hazzan,
2003). In didactic and cognitive terms, the teachers’ major concern was that learners may
progress without understanding previous stages. Most programs enable students to proceed in a
trial-and-error fashion and finish the practice without understanding the topic at hand. Another
cognitive argument for the lack of benefit of computer animations in science learning, raised by
Journal of Research in Science Teaching. DOI 10.1002/tea
COMPUTER ILLUSTRATION AND ANIMATION
277
Lowe (2003), refers to the excessive information processing demands this medium sometimes
makes on learners: ‘‘with some animations, learners may face higher levels of cognitive load than
would be expected for static alternatives’’ (Lowe, 2003, p. 158).
Given the aforementioned advantages and drawbacks of computer animations and illustration
activities in genetic instruction in general, and in instruction of dynamic processes in particular, in
our study, we examined differences between two comparable groups: one used computer
animation and the other used illustration activities. More specifically, we examined the differences
between the two groups in terms of the impact of using dynamic animations or illustration
activities on students’ understanding of dynamic processes (transcription translation and DNA
replication) versus students’ understanding of static configurations (the structure of DNA and
RNA molecules).
Therefore, we established three major goals:
1. To examine and compare the effect of individual activity with illustration and with
computer animation on students’ achievement in molecular genetics.
2. To examine and compare the effect of the illustration activity and the computer activity
on student achievement in different subtopics (of both a static and a dynamic nature).
3. To examine students’ feedback about the contribution of the model to their learning.
Method
The sample consisted of 248 Israeli students from 20 eleventh- and twelfth-grade classrooms
in suburban and urban areas, who were majoring in biology. Students’ socioeconomic level was
similarly distributed in each class, and thus we decided to assign students to the different
treatments according to their biology class session. To verify the comparability of the groups we
also used a pre-test. Because students received the computer animation and the illustration
activities as additional practice to their traditional learning, we decided to compare between the
following three groups. One group, the control group (116 students from eight classes), was taught
in the traditional lecture format. The teachers used blackboard and transparencies and guided the
students to read and answer questions in the textbook. The same textbook was used in all
comparison groups. The second group, the computer animation group (61 students from five
classes), received 4 hours of computer animation activities, and the third group, the illustration
group (71 students from seven classes), engaged in 4 hours of illustration activities. Students in all
groups received about 50 traditional learning hours of genetics instruction, including 20 hours of
molecular genetics. The activities, both with computer animation and illustration, were
incorporated into the 20 hours that were dedicated to molecular genetics instruction. In both
the experimental groups the students received short lecture explanations and then moved to
practice with the models, whereas in the traditional group the teachers concentrated more on
lectures until they thought that the students understood the material.
The illustration activity consisted of typical textbook illustrations and covered the structure of
DNA and RNA, DNA replication, and protein synthesis. (More details about this group have been
provided in the study by Rotbain et al. [2006].) The illustrations we used in connection with the
molecular structure of DNA and RNAwere mainly chemical formulas (see Appendix A), whereas
those used for subcellular processes (DNA replication, transcription, and translation) were more
schematic, representing the major components that are essential for understanding the processes.
Our drawing-based activity offers an active, student-centered approach based on illustrations
typically used in textbooks. We accompanied these illustrations with a set of instructions that were
written for this purpose. The activity includes hands-on tasks, such as drawing, painting, and figure
Journal of Research in Science Teaching. DOI 10.1002/tea
278
MARBACH-AD, ROTBAIN, AND STAVY
completion, while also integrating minds-on tasks, such as finding missing words and answering
guiding questions (see example in Appendix A). It is worth mentioning that, in most textbooks,
drawings and illustrations appear simply alongside the running text and students in traditional
classes usually are not required to do anything with them (e.g., draw, fill in, etc.).
The computer animation (Logal Molecular Biology) presents the same concepts as the
illustration activity, including the structure of DNA and RNA, DNA replication, and protein
synthesis. The animation reduces the complexity of the concepts and processes in molecular
genetics by enabling students to watch the dynamic processes as a whole or step by step, and to
participate in interactive activities, such as taking an active part in simulated DNA replication,
transcription, and translation processes. Figure 1 shows selected snapshots of four computerized
activities. The first activity (Figure 1A, the DNA structure activity) appears on the computer as a
static animation (which can be explored and manipulated by the user), whereas the other three
activities (Figure 1B–D), which deal with processes, are presented through dynamic interactive
animations. Each process can be rerun by the students, continuously or in step-by-step mode, and
can be stopped and continued whenever they wish. These three activities are also interactive.
Figure 1B and C represent activities in which students can manually add new compatible
Figure 1.
Selected snapshots representing four computerized activities.
Journal of Research in Science Teaching. DOI 10.1002/tea
COMPUTER ILLUSTRATION AND ANIMATION
279
nucleotides to the growing chain of nucleic acid (DNA in Figure 1B and RNA in Figure 1C).
Students can also identify the tRNA–amino acid complex and match it with the compatible codon
in the mRNA molecule. Hence, to complete the activity correctly, both on the computer and in the
booklet, students have to select relevant information, organize the information, and integrate this
with their existing knowledge.
The instructions for operating the animation were adapted to the Israeli high school
curriculum. Students were asked to work alone; each student had their own computer and activity
booklet, but they were encouraged to discuss the material in pairs to enhance cooperative learning.
Students received detailed instructions on how to manipulate the animation.
The Activity—Instructions and Guiding Questions
The instructions, written specifically for the computer animation (see example in Figure 2),
were slightly modified for the illustration activity and included activities such as drawing,
Figure 2.
Example of computer animation activity—the translation process.
Journal of Research in Science Teaching. DOI 10.1002/tea
280
MARBACH-AD, ROTBAIN, AND STAVY
painting, figure completion, and finding missing words (for an example of the illustration activity
see Rotbain et al. [2006]).
The computer animation and illustration activities were accompanied by the same set of
guiding questions. The guiding questions were designed to focus students’ attention on main
issues so as to help them select the relevant information and organize it coherently. The questions
asked students to explain what they did in the activity (see Figure 2, Question 9), to relate between
concepts and processes, to find regularities, to predict the next step in the process (see Figure 2,
Question 6b), and to draw conclusions based on having done the activity.
Research Instruments
In this study we used three reliable and valid questionnaires that were used in our previous
study (Rotbain et al., 2006): a multiple-choice, written questionnaire; an open-ended, written
questionnaire; and another open-ended questionnaire, which was used for personal interviews.
The students received the multiple-choice questionnaire only after they had filled out and handed
in their open-ended questionnaire; thus, the correct options in the multiple-choice questions
could not be used as hints for the answers to the open-ended questions. Both the multiple-choice
and the open-ended questionnaires were filled out by 248 students and, of these, 67 students
(computer animation—19; illustration—22; control—26), randomly selected, were personally
interviewed.
The multiple-choice written questionnaire, which included 13 questions (full copies of the
instruments are available from the authors), was given to the students after the molecular genetics
instruction (posttest). Five of these questions were also administered before students received
their genetics instruction (pretest). For the five pretest questions, we constructed a composite
score, which was used for analysis of variance (ANOVA) testing to verify that the groups were
comparable. Composite scores, calculated for the posttest, were used to compare between
the three groups using one-way analysis of covariance (ANCOVA) testing on two levels: the whole
questionnaire and groups of questions (related to same subtopic). In this analysis we used the
pretest scores as a covariant. Then we used paired comparisons, with modified the Bonferroni
correction, to identify the sources of significant differences.
The open-ended written questionnaire included ten questions (see Appendix B) and was given
to the students only after molecular genetic instruction (posttest). We ranked each response to be
able to create a score (between 0 and 100) for each student and calculate composite scores. Thus,
we could analyze differences among the three groups using ANCOVA on three levels: the whole
questionnaire; groups of questions (related to same subtopic, see later); and each question alone.
We used paired comparisons, with the modified Bonferroni correction, to identify the sources of
significant differences.
To evaluate students’ responses, we referred to the scientific literature (Nelson & Cox, 2000;
Suzuki, Griffith, Miller, Lewontin, & Gelbart, 1999). An example of a response considered a
complete answer to the question: What is the ‘‘genetic code’’? is: A triplet of nucleotides (or bases)
in the DNA or RNA molecules, which is translated into amino acid (or codes for amino acids or
construction of proteins).
To validate the categorization and the ranking schemes, a sample of the students’ answers was
also given to two researchers in science education and to two high school biology teachers who
were not connected to this study. The raters were blinded to the treatment. Each of them
analyzed and defined categories and subcategories independently, and their categories were
similar to ours.
Journal of Research in Science Teaching. DOI 10.1002/tea
COMPUTER ILLUSTRATION AND ANIMATION
281
The individual interviews, which were semistructured (each 30 minutes in duration), were
recorded by the second author and included two types of questions: four content questions (What is
DNA composed of? How is genetic information encoded? How are the proteins synthesized
according to the genetic code? How does DNA replicate) and three other questions, which directed
students to talk about their experience during the instruction and about the contribution of the
model to their learning. The author transcribed these interviews. We analyzed the transcript to find
major categories and calculated percentages for each category.
The questions in the three research instruments were grouped under three main categories of
subtopics:
1. Questions dealing with the structure of DNA and RNA.
2. Questions dealing with the molecular processes of replication, transcription, and
translation.
3. Questions whose answer should reflect students’ understanding of the conceptual
relationships between the genetic material (i.e., genes) and the product (i.e., proteins).
Results
We investigated students’ understanding of genetics in three different groups (computer
animation group, illustration group, and control group), using multiple-choice and open-ended
questionnaires as well as individual interviews. Comparison of the three groups’ pretests through
ANOVA testing revealed no significant differences among the groups (mean scores: control group,
35 26; computer group, 32 20, illustration group, 35 17). Therefore, these groups could be
treated as comparable groups.
Table 1 shows the average scores that we calculated from students’ answers to the open-ended
and the multiple-choice questionnaires. Inspection of the average scores composed of the
responses to the multiple-choice questionnaire shows that, in two of the groups (computer and
illustration), the average scores were similar (74 and 70, respectively), whereas in the control
group the average score was lower (61).
Analysis of students’ answers to the open-ended questionnaire showed that, similar to the
findings from the multiple-choice questionnaire, both the average scores composed of the
responses to the open-ended questionnaire of the computer group and of the illustration group
(68 and 58, respectively) differed significantly from those of the control group (46). However, the
Table 1
Average scores and standard deviations (in parentheses) for the open-ended and the multiple-choice
questionnaires
Type of
Questionnaire
Computer
(N ¼ 61)
Illustration
(N ¼ 71)
Control
(N ¼ 116)
F
Paired Comparisons
b
Multiple-choice
questionnaire
74 (19)
70 (21)
61 (21)
11.32
Open-ended
questionnaire
68 (16)
58 (19)
46 (22)
32.23b
Computer/controlb
Illustration/controlb
Computer/illustration
Computer/controlb
Illustration/controlb
Computer/illustrationa
a
p < 0.01; bp < 0.001.
Journal of Research in Science Teaching. DOI 10.1002/tea
282
MARBACH-AD, ROTBAIN, AND STAVY
average score of the computer group was significantly higher than that of the illustration group in
this open-ended questionnaire. Thus, the open-ended questionnaire articulated differences
between the two experimental groups in favor of the computer group.
Analysis of Subtopics
As mentioned in the Method section, the questions in both questionnaires could be grouped
under three categories of subtopics:
1. The structure of DNA and RNA.
2. The molecular processes of DNA replication, transcription, and translation.
3. The conceptual relationships between genetic material and its products.
The first and the second subtopics refer to the contents that were reflected directly by the
activities (structures and processes), whereas the third subtopic refers to an overview of the
whole subject, asking students to explain the relationship between the genetic material and its
product (protein, trait). Thus, it seemed of interest to compare the achievements of the three
groups in terms of the three subtopics. Tables 2 and 3 show the composite scores regarding the
multiple-choice questionnaire and the open-ended questionnaire, calculated for each of the three
categories. In what follows we elaborate on each subtopic, offering some examples of students’
responses to the open-ended questions from the written questionnaire and from the individual
interviews.
1. The structure of DNA and RNA. A total of eight questions in the two questionnaires (four
questions each) were grouped under this subtopic (the structure of DNA and RNA). These
questions focused on: the structure of nucleotides; the nitrogen bases that pair between the two
strands of DNA (A-T, C-G) or between the DNA and the RNA strands (A-U, C-G); and on
comparison between DNA and RNA in terms of their components and structure.
Inspection of the average scores of the multiple-choice questions (Table 2) concerning
this subtopic shows that the average scores for the computer (81) and the illustration (77) groups
were similar, but significantly higher than the average score of the control group (69). The
same pattern occurred with the scores of the open-ended questions of this subtopic (Table 3),
in which there were no significant differences between the computer (82) and the illustration
Table 2
Average scores and standard deviations (in parentheses) for groups of questions related to the same
subtopic in the multiple-choice questionnaire
Subtopic
Computer
(N ¼ 61)
Illustration
(N ¼ 71)
Control
(N ¼ 116)
F
Paired Comparisons
a
DNA and RNA structure
81 (24)
77 (29)
69 (34)
4.23
Transcription and translation
63 (29)
54 (32)
43 (31)
8.83c
The relationships between
DNA and protein
77 (21)
78 (24)
69 (25)
5.57b
a
p < 0.05; bp < 0.01; cp < 0.001.
Journal of Research in Science Teaching. DOI 10.1002/tea
Computer/controlb
Illustration/controla
Computer/illustration
Computer/controlc
Illustration/controla
Computer/illustration
Computer/controla
Illustration/controlb
Computer/illustration
COMPUTER ILLUSTRATION AND ANIMATION
283
Table 3
Average scores and standard deviations (in parentheses) for groups of questions related to the same
subtopic in the open-ended questionnaire
Subtopic
Computer
(N ¼ 61)
Illustration
(N ¼ 71)
Control
(N ¼ 116)
F
Paired Comparisons
b
DNA and RNA structure
82 (13)
76 (20)
60 (25)
30.80
Transcription and translation
69 (24)
56 (30)
40 (29)
25.48c
The relationships between
DNA and protein
48 (24)
37 (25)
34 (26)
8.15c
Computer/controlb
Illustration/controlb
Computer/illustration
Computer/controlb
Illustration/controlb
Computer/illustrationa
Computer/controlc
Illustration/control
Computer/illustrationb
a
p < 0.01; bp < 0.001.
(76) groups, but both scores were significantly higher than the average score of the control
group (60).
In the individual interviews, students were asked to characterize the structure of DNA. Most
of the students (about two thirds) from all groups stated that DNA is a double helix or composed of
nucleotides. Differences among groups were evident, especially concerning the molecular level.
About 72% of the interviewees from each of the illustration and the computer groups referred to
the components of the nucleotides (deoxyribose, phosphate residue and the nitrogen base),
whereas only 19% of the interviewees from the control group referred to the components of the
nucleotides.
The findings that were gathered through the three research instruments (written
questionnaires and individual interviews) indicate that integration of the computer model or
illustration activity in the instruction of the structures of DNA and RNA molecules enhanced
students’ achievement in similar ways.
2. The molecular processes: DNA replication, transcription, and translation. A total of seven
questions in the two questionnaires were concerned with the molecular processes of replication,
transcription, and translation. These questions explored two aspects of students’ understanding:
the mechanism of the molecular processes and the sequence of the phases occurring in each of
the molecular processes. Inspection of the average scores in the multiple-choice questions
(Table 2) concerned with the molecular processes shows a similar pattern to the one found in the
first subtopic: the average scores for the computer (63) and the illustration (54) groups were
similar, but significantly higher than the average score of the control group (43). Interestingly,
the open-ended questions of this subtopic (Table 3) revealed differences among the three
groups: the average scores of the computer group (69) were higher than those of the illustration
group (56), and each of these scores were significantly higher than the average score of the control
group (40).
In the interviews concerning the processes of transcription and translation, students
were asked to answer the question: How are proteins synthesized according to the genetic code?
A complete answer should refer to both processes of transcription and translation. In all
groups a low percentage of students referred to both processes (computer—31%; illustration—
27%; control—15%). About one third of the students in all groups (computer—32%;
Journal of Research in Science Teaching. DOI 10.1002/tea
284
MARBACH-AD, ROTBAIN, AND STAVY
illustration—32%; control—31%) referred correctly to one of the processes (transcription or
translation).
Concerning the process of DNA replication, students’ responses to the question: How is DNA
replicated? showed major differences between the groups that received treatment (computer or
illustration) and the control group. Most of the students from the computer group (95%) and from
the illustration group (82%) correctly explained the semi-conservative mechanism of replication,
whereas only 42% of the students did so in the control group.
The findings concerning this subtopic show that achievement with regard to processes
was lower than with regard to structure, in all questionnaires, for all of the groups. Note that the
open-ended questions in this subtopic reveal that the students who studied with the computer
animation outscored those who studied with the illustration model.
3. Conceptual relationships between the genetic material and its products. Eight questions,
from both questionnaires, were concerned with this subtopic (conceptual relationships between
the genetic material and its products). Table 2 shows that, in the multiple-choice questionnaire, the
average scores for the computer (77) and the illustration (78) groups were similar, but significantly
higher than the average score of the control group (69). In this subtopic, the average scores of the
open-ended questions (Table 3) revealed that the computer group (48) scored higher than the
illustration group (37) and the control group (35); there were no significant differences between
the illustration and the control groups.
In the interviews students were asked to answer the question: How is the genetic information
in DNA coded? Completely correct answers should refer to the structural aspect of the genetic
code—three nucleotides (codon)—and to its functional aspect, which is the relationship between
the codon and the amino acid. Analysis of the responses showed that 79% of the interviewees from
the computer group and 73% from the illustration group referred to the nucleotide triplet or the
nucleotides sequence. For example, one student said, ‘‘There are triplets of nucleotides, each
triplet determining one amino acid.’’ Another student said: ‘‘. . .every three nucleotides are
compatible with one specific amino acid.’’ In the control group, only 46% of the interviewees
referred to triplets of nucleotides or to the relationship between the sequence of nucleotides and
amino acids.
A summary of the findings concerning this subtopic shows that the average scores on the
open-ended questionnaires were much lower than those on the multiple-choice questionnaire, for
all groups. It seems that it was easier for students to choose the correct answer to the multiplechoice questions than to articulate correct responses to the open-ended questions.
Students’ Feedback About the Contribution of the Model to Their Learning
In the interviews, following the content questions, students were asked to reply to three
additional questions. The first question was: What did you visualize when you described the DNA
structure and the processes of DNA replication, transcription, and translation? In the computer
group, 95% of the 19 interviewees referred to the computer animation. One student said: ‘‘I
saw the DNA, how it was drawn on the computer, how the RNA was built according to the
DNA sequence, and then the RNA strand moved from the DNA to the cytoplasm and joined
the ribosome.’’ Another student referred to transcription and translation by saying: ‘‘On the
computer you see exactly how the processes [transcription and translation] occur, and then you can
translate everything into words.’’ In the illustration group, only 54% of the 22 interviewees
answered that they visualized the illustrations (‘‘I saw the illustrations from the booklet; In the
booklet that we received we were asked to complete figures, and thus put things in a more visual
way’’).
Journal of Research in Science Teaching. DOI 10.1002/tea
COMPUTER ILLUSTRATION AND ANIMATION
285
Another interview question was: Did the activity help you in gaining a better understanding of
the subject matter? All the interviewees from the computer and the illustration groups gave an
affirmative answer to this question. Interestingly, most of the interviewees from the computer
group (84%) reported that the activity represented the subject matter in a more concrete
manner, whereas those from the illustration group (90%) said that the activity helped them mainly
to organize and summarize the subject matter. For example, students from the computer
group said: ‘‘Yes, the computer animation helped me very much. It demonstrated the process,
since you can’t really see it’’; ‘‘It was like I could see it in front of my eyes, and so I could connect
between things’’; ‘‘When you see it as a computer animation, even if it is not exactly as the process
occurs in the cell, it is much easier to remember, to visualize the process in your head’’; and ‘‘It
helped me more than the lesson in the class, since I could run it over and over as many times as I
wanted, and I could also do it at different speeds.’’ Students from the illustration group mentioned
how abstract concepts become more concrete: ‘‘I think that the drawing activity really helped
me to understand the components of the DNA. It was much more concrete that way. The figures
and the illustrations were the best part, but also the questions and the sentence completion
activity.’’
The final question in the interviews was: Do you find molecular genetics more difficult
than other topics in biology? This question was designed to determine whether different
activities influenced students’ attitude toward the subject. Indeed, 58% of the interviewees in
the control group evaluated the course in molecular genetics as very difficult, as compared
with 38% from the computer group and 24% from the illustration group. The students’
explanations referred mainly to the multiplicity of new abstract concepts in molecular
biology, such as ‘‘. . .there are many concepts to remember, and when they all get mixed up in
your head it is very difficult to see the relationships between them’’ (student from the computer
group).
Students from the computer group also said that the activities ‘‘broke the routine’’ of the
traditional lecture format, and many commented that they enjoyed the activity very much and
would like to do more, in other biology topics as well.
Discussion
This study has focused on the use of computer animation and illustration activity in
molecular genetics instruction, a difficult topic for high school students (Rotbain et al., 2006). The
findings show that, overall, the students in the illustration group significantly improved
their knowledge compared with the students in the control group, in both the multiple-choice and
the open-ended questionnaires. The findings from the multiple-choice questionnaire also show
that there were no significant differences between the computer animation and the illustration
groups. However, the open-ended questionnaire did bring to light differences between these
groups, revealing that the computer animation was in general more effective than the illustration
activity. This bore out the unique impact of the computer animation model on students’
understanding.
In this investigation we also examined students’ achievements in three subtopics:
1. The structure of DNA and RNA.
2. The molecular processes: DNA replication, transcription, and translation.
3. The conceptual relationships between genetic material and its products.
Journal of Research in Science Teaching. DOI 10.1002/tea
286
MARBACH-AD, ROTBAIN, AND STAVY
Close inspection of the findings reveals interesting results concerning the contribution of
each model (illustration and computer animation) to students’ understanding of each of the
aforementioned subtopics.
The Structure of DNA and RNA
There were no significant differences between the illustration and the computer animation
groups in the multiple-choice and the open-ended questions that dealt with the DNA and the RNA
structures. Also, the scores for these questions were higher than the scores for the other two
subtopics. These results are consistent with the suggestion that structures are the easiest aspect of
a complex system to learn (Hmelo et al., 2000). However, we suspect that, in our case, the
reason could be that the illustration activity (see Appendix A), which explains the structure of the
DNA and RNA molecules, is not inferior to the parallel computer animation activity (see
Figure 1A). In the computer animation the students could point at different parts of the DNA
molecule and use a ‘‘magnifying glass’’ to watch the different structural levels, whereas in
the illustration activity the students had to identify (a higher cognitive level) the different
components and circle each component in different colors. Coloring the different components of
the DNA molecule in different shades (Appendix A) reduced the amount of information students
had to assimilate, and enhanced their understanding of the major structures of the complex DNA
molecule.
In our preliminary study, we found that it is difficult for high school students even to
discriminate between the three basic components of the nucleotides: sugar; the phosphate group;
and the nitrogenous bases. We therefore started the DNA structure activity by introducing
the nucleotide components, emphasizing their unique structures. In the illustration activity the
students were asked to identify and circle the components (sugar, the phosphate group, and
the nitrogenous bases) in each nucleotide’s chemical formula, and then to recognize and identify
the four nucleotides and the hydrogenous bonds in the chemical formula of the double-strand DNA
molecule (see activity in Appendix A). In the computer animation activity students were also
exposed to the different components of the nucleotide, and they could watch it over and over, but
they were not as active as in the illustration activity.
The contribution of the illustration activity to the understanding of the DNA structure was also
mentioned by the students in the interviews: ‘‘In the textbook I couldn’t understand the text and the
illustrations. . .while here, during the [illustration] activity, the coloring of the illustrations really
helped. . .that’s what helped me to understand the DNA structure and all its components. . ..’’ Other
advantages that students from both groups mentioned were that the active way of dealing with the
chemical formulas reduced their anxiety about such abstract forms of representation. As
mentioned in the Theoretical Background section, many high school biology students, especially
those who do not study advanced chemistry, have difficulty understanding chemical formulas and
they develop a ‘‘phobia’’ of biology subjects connected to the molecular level.
The Molecular Processes: DNA Replication, Transcription, and Translation
In contrast to the results concerning the DNA and RNA structure, there were significant
differences between the illustration and the computer animation groups regarding this subtopic,
which deals with dynamic processes. Answers coming from the computer animation group were
more accurate and profound than those from the illustration group. Thus, we believe that the
Journal of Research in Science Teaching. DOI 10.1002/tea
COMPUTER ILLUSTRATION AND ANIMATION
287
computer animation model offers a unique contribution to the understanding of the dynamic
subcellular processes of replication, transcription, and translation. It is noteworthy that, in the
computer animation activities, which deal with the processes of replication, transcription, and
translation, students could run and watch the different steps over and over (Figures 1 and 2); they
were involved in the virtual building of the molecules and, overall, were more active than students
who used the illustration activity. Clearly, interactivity, a factor known to facilitate learning, can
help overcome the difficulties of perception and comprehension. Stopping, starting, and replaying
an animation can allow reinspection, focusing on specific parts and actions. Animations that allow
close-ups, zooming, alternative perspectives, and control of speed are even more likely to facilitate
perception and comprehension (Tversky et al., 2002).
The contributions of the computer animation’s interactivity as well as the immediate feedback
were mentioned by the students in the interviews: ‘‘I actually built the RNA strand according to the
DNA strand and if I made a mistake the computer didn’t let me go on, so I didn’t need the teacher
around to correct me; I could change the nucleotide sequence and immediately watch the impact of
my manipulations on the amino acid chain.’’
Our findings concerning the superiority of the computer animation activities over the
illustration activities in terms of learning the molecular processes also accord with Williamson and
Abraham (1995), who explored the effect of computer animations on college chemistry students,
and found that instruction with animations may increase conceptual understanding by prompting
the formation of dynamic mental models.
The Conceptual Relationships Between Genetic Material and Its Products
Regarding this topic—the conceptual global understanding of the flow of information from
genetic material to the phenotypic product—the findings show that both the illustration and the
computer animation groups scored low, particularly in the open-ended questions. The computer
animation group outscored the illustration group (48% and 37%, respectively), but the score was
still rather low. It seems that the computer animation activity helped students to better understand
each of the processes (DNA replication, transcription, and translation), but was less useful in
explaining the global idea (the central dogma) of how DNA molecule codes for protein and hence
for traits. We suspect that part of the explanation for these results is that students need time to
assimilate the whole idea of the central dogma, and be able to make the synthesis between the
different processes involved (transcription and translation). It appears that one of the reasons
genetics is so difficult both to teach and to learn derives from the fact that students must be able to
integrate several cognitive steps in order to understand the processes underlying genetic
phenomena and to grasp the overall picture of genetics (Fisher, 1983).
We believe that supplemental computerized animation activities can help students gain a
better understanding of the global concept of the flow of information from genetic material to
phenotypic product. Such activities should enable the students to be actively engaged in
manipulating the DNA sequence (i.e., causing mutations) and tracking the changes in the product,
following the DNA changes (protein or trait).
Conclusions and Implications
This study has explored the effect of computer animation and illustration activities on high
school student achievement in molecular genetics. In doing so it integrates the two leading
Journal of Research in Science Teaching. DOI 10.1002/tea
288
MARBACH-AD, ROTBAIN, AND STAVY
research areas in science education today: students’ understanding of molecular biology and the
use of computers in science education. Our results confirm the idea that proper use of technology
can enhance students’ achievement in molecular biology, which encourages wide-ranging
educational research on approaches to teaching scientific topics with new technologies, such as
computer animations.
Our findings specifically show that computer animations work, especially in teaching
about dynamic processes; however, engaging students in illustration activities (especially when
learning about the DNA structure) also improves achievement in comparison to traditional
instruction only.
These findings raise questions about the deep difference between the computer animation and
the illustration activities. We found that, although the computerized activities have enormous and
increasing potential as learning tools, illustration activities are not necessarily inferior to them,
and each model has its strengths and weaknesses: When we decide to use a certain model we
should make sure that it is the best model for the specific activity. Close inspection of the model
activities showed us that the illustration activity for the DNA structure allowed students to be more
interactive and less passive than in the parallel computer activity. In contrast, the computer
animation activities that demonstrate the dynamic processes allowed students to be more
interactive, learn from trial and error, and repeat their trial over and over—none of which were
possible with the illustration activity.
This also brings to light the importance of engaging students in an interactive way. The most
straightforward suggestion for using visualization effectively is to make visualization interactive
and increase active student involvement in learning. These recommendations are in accord with
the educational practice reforms advocated by the major professional science education
communities (AAAS, 1993; NRC, 1996).
We believe that our study offers evidence for the promising potential of using models in
biology topics at the molecular level (molecular genetics, photosynthesis, and cell respiration) as
well. In a previous study we reported on the success of using a tri-dimensional bead model and an
illustration model in the study of molecular biology (Rotbain et al., 2006); the current study adds
new findings to our earlier article by presenting the strengths and weaknesses of a computer
animation model in teaching molecular biology.
Recommendations for Further Study
We consider this study as the groundwork for many future studies. It is hoped that we and
others can:
1. Use the models and the research instruments from this study to measure students’
understanding, while taking into consideration students’ previous knowledge and
cognitive level (e.g., differentiate between top, middle, and low achievers), thus
providing ways to build on students’ personal understanding of science.
2. Examine whether enhancement of the model interactivity could improve
student achievement. For example, in our research we felt that the computer
animation structure activity could be improved to be more interactive and thoughtprovoking.
3. Articulate the differences between the three models that we used—illustration,
computer animation, and three-dimensional bead model (Rotbain et al., 2006)—in a
way that will give us information on how to integrate between the different types of
models, matching the characteristics of the model to the characteristics of the specific
topic or subtopic (i.e., static versus dynamic or structure versus processes).
Journal of Research in Science Teaching. DOI 10.1002/tea
COMPUTER ILLUSTRATION AND ANIMATION
289
The authors gratefully acknowledge Yftach Gordoni for statistical analysis and
Mirjam Hadar for editing, both of whom are at the School of Education, Tel-Aviv
University.
Appendix A
Example of an illustration activity (Rotbain et al., 2006):
Journal of Research in Science Teaching. DOI 10.1002/tea
290
MARBACH-AD, ROTBAIN, AND STAVY
Appendix B
The average scores and standard deviations (in parentheses) of the experimental and control
groups for each of the open-ended questions and F values:
Average Scores
Subtopic
DNA and RNA
structure
Transcription and
translation
The relationships
between DNA
and protein
Questions
1. What is DNA?
2. Write a sentence that
includes the concepts
nucleotide and nitrogen
base.
3. Complete the following
sentences:
(a) The four nucleotides
of DNA have in
common. . ..
(b) The differences between
the four nucleotides of
DNA are due to. . ..
4. Is information about the
sequence of one strands
of DNA sufficient to
determine the sequence of
the other strand?
5. How does DNA replication
occur in the cell?
8. Can the translation process
occur without the
transcription process?
Explain your answer.
9. Can protein synthesis
occur without the presence
of t-RNA? Explain your
answer.
6. Write a sentence that
includes the concepts DNA
and protein.
7. What is the genetic code?
10. You were asked to design a
gene that codes for insulin.
Which information do you
need in order to do it?
Explain your answer.
Computer
(N ¼ 61)
Illustration
(N ¼ 71)
Control
(N ¼ 116)
F
77 (20)
66 (26)
65 (25)
5.03a
94 (18)
81 (32)
60 (44)
20.49b
79 (30)
79 (32)
46 (41)
27.89b
79 (25)
78 (24)
68 (29)
5.28a
79 (31)
58 (44)
40 (44)
19.87b
72 (33)
67 (32)
44 (33)
20.31b
57 (33)
43 (35)
37 (33)
25.16b
63 (35)
49 (39)
41 (41)
7.58a
44 (29)
38 (40)
31 (23)
32 (37)
32 (32)
29 (36)
4.35
1.32
a
p < 0.05; bp < 0.001.
References
American Association for the Advancement of Science (AAAS). (1993). Benchmarks for
science literacy. New York: Oxford University Press.
Journal of Research in Science Teaching. DOI 10.1002/tea
COMPUTER ILLUSTRATION AND ANIMATION
291
Bahar, M., Johnstone, A.H., & Sutcliffe, R.G. (1999). Investigation of students’ cognitive
structure in elementary genetics through word association tests. Journal of Biological Education,
33, 134–141.
Barnea, N., & Dori, Y.G. (1996). Computerized molecular modeling as a tool to improve
chemistry. Journal of Chemical Information and Computer Sciences, 36, 629–636.
Ellis, J.D. (1984). A rational for using computers in science education. The American Biology
Teacher, 46, 200–206.
Fisher, K.M. (1983). Amino acids and translation: A misconception in biology. In H. Helm &
J.D. Novak (Eds.), Proceedings of the international seminar ‘‘Misconceptions in Science and
Mathematics’’ (pp. 407–419). Ithaca, NY: Cornell University.
Garton, G.L. (1992). Teaching genetics in the high school classroom. In M.U. Smith & P.E.
Simmons (Eds.), Teaching genetics: Recommendations and research proceedings of a national
conference (pp. 20–23). Cambridge, MA.
Gearner, G. (2001). Visualizing DNA. The American Biology Teacher 53, 616.
Gilbert, J.K., Justi, R., & Aksela, M. (2003). The visualization of models: A metacognitive
competence in the learning of chemistry. Paper presented at the 4th annual meeting of the
European Science Education Research Association, Noordwijkerhout, The Netherlands.
Golan, R., & Reiser, B.J. (2002). Investigating students’ reasoning about the complexity
manifested in molecular genetics phenomena. In P. Bell & S. Reed (Eds.), Proceedings of the Fifth
International Conference for the Learning Sciences: Keeping learning complex: fostering
multidisciplinary research efforts (pp. 237–244). Mahwah, NJ: Erlbaum.
Hays, R. (2001). Classroom technology reviews: Cell microscope. The American Biology
Teacher, 63, 136–137.
Hazzan, O. (2003). Prospective high school mathematics teachers’ attitudes toward
integrating computers in their future teaching. Journal of Research on Technology in Education,
35, 213–226.
Hmelo, C.E., Holton, D.L., & Kolodner, J.L. (2000). Designing to learn about complex
systems. Journal of the Learning Sciences, 9, 247–298.
Kindfield, A.C.H. (1994a). Assessing understanding of biological processes: Elucidating
students’ models of meiosis. The American Biology Teacher, 56, 367–371.
Kindfield, A.C.H. (1994b). Understanding a basis biological process: Expert and novice
models of meiosis. Science Education, 78, 255–283.
Larkin, J.H., & Simon, H.A. (1987). Why a diagram is (sometimes) worth ten thousand
words. Cognitive Science, 11, 65–99.
Lewalter, D. (2003). Cognitive strategies for learning from static and dynamic visuals.
Learning and Instruction, 13, 177–189.
Lewis, J., & Wood-Robinson, C. (2000). Genes, chromosomes, cell division and
inheritance—do students see any relationship? International Journal of Science Education, 22,
177–195.
Lowe, R.K. (2003). Animation and learning: Selective processing of information in dynamic
graphics. Learning and Instruction, 13, 157–176.
Malacinski, G.M., & Zell, P.W. (1996). Manipulating the ‘‘invisible.’’ Learning molecular
biology using inexpensive models. The American Biology Teacher, 58, 428–432.
Marbach-Ad, G. (2001). Attempting to break the code in student comprehension of genetic
concepts. Journal of Biological Education, 35, 183–189.
Marks, G.H. (1982). Computer simulations in science teaching: An introduction. Journal of
Computers in Mathematics and Science Teaching, 1, 18–20.
Journal of Research in Science Teaching. DOI 10.1002/tea
292
MARBACH-AD, ROTBAIN, AND STAVY
National Research Council (NRC). (1996). National Science Education Standards.
Washington, DC: National Academy Press.
National Science Foundation (NSF). (2001). Molecular visualization in science education.
Report from the molecular visualization in science education workshop. NCSA Access Center.
Arlington, VA: National Science Foundation.
Nelson, D.L., & Cox, M.M. (2000). Lehninger principles of biochemistry (3rd ed.). New
York: Worth.
Pallant, A., & Tinker, R.F. (2004). Reasoning with atomic-scale molecular dynamic models.
Journal of Science Education and Technology, 13, 51–66.
Rotbain, Y., Marbach-Ad, G., & Stavy, R. (2006). The effect of bead and illustration models
on high school student achievement in molecular genetics. Journal of Research in Science
Teaching, 43, 500–529.
Sanger, M.J., Brecheisen, D.M., & Hynek, B.M. (2001). Can computer animation affect
college biology students’ conceptions about diffusion & osmosis? The American Biology
Teacher, 63, 104–109.
Suzuki, D.T., Griffith, A.J.F., Miller, J.H., Lewontin, R.C., & Gelbart, W.M. (1999). An
introduction to genetic analysis (7th ed., pp. 807–827). New York: W.H. Freeman.
Tsui, C.Y., & Treagust, D. (2004). Motivational aspects of learning genetics with interactive
multimedia. The American Biology Teacher, 66, 277–285.
Tversky, B., Bauer Morrisony, J., & Betrancourt, M. (2002). Animation: Can it facilitate?
International Journal Human–Computer Studies, 57, 247–262.
Williamson, V.M., & Abraham, M.R. (1995). The effects of computer animation on the
particulate mental models of college chemistry students. Journal of Research in Science Teaching,
32, 522–534.
Wu, H.K., Krajcik, J.S., & Soloway, E. (2000). Promoting understanding of chemical
representations: Students’ use of a visualization tool in the classroom. Journal of Research in
Science Teaching, 38, 821–842.
Journal of Research in Science Teaching. DOI 10.1002/tea
Download