Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING

advertisement
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING:
PROFILING UNDERGRADUATE STUDENTS IN A SEMESTER-LONG COURSE
Emily M. Grossnickle, Daniel L. Dinsmore, Patricia A. Alexander, and Alexandra List
University of Maryland, College Park
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
Abstract
The interrelations between knowledge, interest, and strategic processing have been well
documented. However, much remains to be learned about how these interrelations manifest
under particular conditions or how they change over time. Using Alexander’s Model of Domain
Learning (Alexander, 2003), the interrelations between these constructs at the beginning and end
of an undergraduate course were investigated to understand contextual and developmental
conditions. Data for 150 students were examined and 6 distinct clusters were established at the
beginning of the term. Membership in the various clusters was tracked from the beginning to
end of the course to understand developmental changes. Results suggested that the direction and
degree of changes in knowledge, interest, and strategic processing depended upon cluster
membership.
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
1
Knowledge, interest, and strategic processing:
Profiling undergraduate students in a semester-long course
Well-rounded (adjective): showing interest or ability in many fields
Webster’s New World College Dictionary (1999)
Higher education aims to educate individuals broadly, across a variety of domains, as
well as intensively, within a selected area of study. The former of these aims is typically
manifest as a general education curriculum to be completed in addition to courses within a major
area of study (Warner & Koeppel, 2009). The purpose and nature of general education has
recently come into the public spotlight as colleges and universities have sought to revamp the
general education requirements, and as current requirements have been criticized for being too
general or too specific (ACTA, 2009; Bourke, Bray, & Horton, 2010). As colleges seek to
produce individuals who are well-rounded with regard to coursework, it is important to consider
the nature of development for students in these general education courses.
The aim of this study was to explicate differences in the knowledge, interest, and
strategies of acclimating learners at the beginning and conclusion of an undergraduate general
education course and to understand how those differences manifest. Variations in these
foundational variables at the point of entry into a new domain and their interplay over time are
key to understanding expertise (Alexander et al., 1997; Hidi & Renninger, 2006). Although we
would not assume that students engaging in general education course would become experts in
the domain (or anything close to that), inquiry into the nature of development across a semester
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
2
should provide further understanding of the individual differences as students enter and leave
such general education courses.
Alexander’s Model of Domain Learning (MDL; 2003; Alexander, Jetton, & Kulikowich,
1995; Alexander et al., 1997) asserts that the interrelation between knowledge, interest, and
strategic processing in an academic domain evolves as an individual progresses through three
stages (i.e., acclimation, competence, proficiency/expertise). According to the MDL, individuals
in acclimation have limited knowledge of the domain they are studying, rely on surface-level
strategies, and display little personal interest in the field. As individuals become more
competent, individual interest should grow; subject-matter knowledge increase quantitatively and
become more cohesive or principled; and more deep-processing strategies should be employed
(Alexander, 2003). Such changes have been documented in prior investigations of the MDL
involving such domains as history, physics, and literacy.
The interrelation among knowledge, interest, and strategic processing has been well
documented in the educational psychology literature (Ainley, Hidi, & Berndorff, 2002;
Alexander, Jetton, & Kulikowich, 1995; Alexander et al., 1997; Lawless & Kulikowich, 2006).
Students enter learning situations with varying levels of prior knowledge, interest, and strategic
processing related to the domain. As students progress through courses, knowledge-based tests
serve as a marker of their progress. Assessments of knowledge determine whether students have
met satisfactory requirements and denote their progress within an area of study. Yet, knowledge
alone does not indicate growth within a domain. Interest and strategic processing also play
important roles in academic development and indicate a students’ advancement.
The relation between knowledge, interest, and strategic progressing are not independent.
Rather, they interact during an individual’s development in an academic domain. Thus, it is
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
3
hypothesized that as individuals’ knowledge of a domain increases across the stages, there is a
greater likelihood of increasing interest in the domain and more willingness to exert the effort
required to process content deeply. Reciprocally, as individuals exert greater strategic effort of a
deep-processing kind, there is enhanced likelihood that subject-matter knowledge will expand
and deepen.
Knowledge in the MDL is identified as domain knowledge or topic knowledge
(Alexander, 2003; Murphy & Alexander, 2002). Domain knowledge is the breadth of knowledge
that an individual has with regard to the field in relative to the whole of knowledge in the field.
For instance, domain knowledge encompasses the breadth of knowledge that one has about the
field of educational psychology. Topic knowledge is distinguished from domain knowledge by
depth of knowledge. Compared to domain knowledge, which is broad and encompasses the span
of the field, topic knowledge is detailed knowledge about particular topics within a domain. For
instance, an individual may have an abundance of topic knowledge about motivation but
relatively little domain knowledge of the field of educational psychology as a whole. Individuals
in acclimation may have detailed knowledge about particular topics, but their overall knowledge
of the domain is fragmented as compared to individuals who have reached proficiency. As
individuals become immersed in the study of a domain, their domain and topic knowledge are
hypothesized to increase (Alexander, 2003).
Interest is often depicted as being one of two types: situational or individual (Hidi, 1990),
with both forms having distinct cognitive and affective components (Hidi & Renninger, 2006).
Situational interest is defined by feelings of enjoyment accompanied by momentary arousal or
attention sparked by features of the environment (Hidi, 1990). Complexity, novelty, and
surprisingness are environmental factors often associated with heightened attention that occurs
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
4
with situational interest (Berlyne, 1960; Silvia, 2005). In contrast, individual interest is depicted
as an enduring disposition toward particular content (Silvia, 2006). Included as defining features
are knowledge of and value for the object of interest (Hidi & Renninger, 2006). Individual
interest involves the enjoyment and attention consistent with situational interest, but is carried
with the individual to different contexts, rather than relying on environmental cues for initiation.
In her Model of Domain Learning, Alexander (2003; Alexander et al., 1995) posits that
as an individual advances in his or her development within a domain, there is interplay between
individual and situational interest. When one is new to a field, the role of situational interest is
important as a means for engagement with learning in the domain. As an individual develops,
the role of situational interest, although still present, becomes significantly less crucial to one’s
involvement. On the contrary, individual interest follows a path by which it increases throughout
development. As individuals become more interested and invested in a domain, they learn more,
and as they continue to learning, their interest increases. It is individual interest which is
relevant for this study.
Strategic processing is defined as procedural knowledge that individuals utilize in an
effort to gain understanding (Murphy & Alexander, 2002). Alexander (2003) defines two
qualitatively different types of processing strategies that develop as an individual progresses in a
domain: surface-level strategies and deep-processing strategies. In the literature, these strategies
have often been related to reading, as processing text is an essential means of learning within
many domains, although there is the expectation that surface-level and deep-processing strategies
are foundational to all domains of learning. Surface strategies are used to make sense of the
problem at hand (Alexander et al., 2005). For the domain of reading, such strategies may include
rereading, changing reading rate, and rehearsing points to remember. Deep strategies are used to
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
5
integrate, transform, or evaluate a problem (Alexander et al., 2005; Nolen & Haladyna, 1990).
Again within the domain of reading, these strategies would include elaborating on main ideas,
identifying an underlying argument, and providing justification for a claim. As acclimating
learners in a domain, individuals rely on surface processing strategies to make sense new ideas
and information. As knowledge is gained, individuals are able to utilize more deep processing
strategies and gain deeper, more integrated understandings.
For this study, educational psychology was the domain of focus and afforded the
opportunity to consider how the interplay of knowledge, strategies, and interest play out over
time in a relatively novel domain. Although we would expect these students to have encountered
some of the content being implemented throughout their K-12 and undergraduate experiences,
we would not anticipate that they have engaged in prior academic study of the domain.
The purpose of this study is to expand on previous research of the MDL by examining
profiles of students according to their domain knowledge, interest, and strategic processing in an
educational psychology course. It is predicted that all of the students enrolled in the course will
be acclimating learners in the field of educational psychology. However, rather than assuming
that all students are similarly acclimated learners when they enter the course, the purpose was to
examine whether different profiles of students emerged at the beginning of the semester
according to their knowledge, interest, and strategic processing. Moreover, as knowledge,
interest, and strategic processing have been shown to be important for learning, the different
profiles of students were examined for changes from the beginning to the end of the semester in
terms of these dimensions. Are certain combinations of knowledge, interest, and strategic
processing at the beginning of the semester more conducive to gains in knowledge, interest, and
strategic processing by the end of the semester in a general education course such as educational
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
6
psychology? Finally, it was hypothesized that knowledge, interest, and the use of deep-level
strategies would increase from the beginning to the end of the semester for the students as a
whole. The hypothesis is consistent with the MDL, which suggests that as students progress in
their study of a domain, their knowledge, interest, and deep-level strategic processing increase
and their reliance on surface strategies decreases.
The research questions that guided this study were as follows:
1. How do students’ domain-specific knowledge, knowledge analogies, interest, strategic
processing, and text comprehension in the field of educational psychology differ at the
beginning and end of a semester-long course?
2. Based on students’ domain-specific knowledge, knowledge analogies, interest, strategic
processing, and text comprehension, what clusters are found at the beginning and end of the
course?
3. How does the degree of change in students’ domain-specific knowledge, knowledge
analogies, interest, strategic processing, and text comprehension over the semester relate to
their initial cluster membership?
Method
Participants
Participants in this study were 167 undergraduates at a large mid-Atlantic university. Of
the 167 participants, 15 were missing either a complete pretest or complete posttest and two were
missing one or more entire measures. As a fundamental aim of this study was to examine
differences across the semester, these individuals were excluded from the analysis, leaving 150
participants. All participants were enrolled in an educational psychology course. For the
students at this university, this course functions as a general elective and is not required for
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
7
students in any particular major. Due to the elective nature of this course, participants were
studying a wide variety of majors from across the university and are not typically education
majors. The average age of participants was 21.6 years and the ethnic makeup of the sample was
as follows: 93 European American (62.0%), 17 African American (11.3%), 18 Asian American /
Pacific Islander (12.0%), 11 Hispanic (7.3%), and 11 other (7.3%). Participants selecting
multiple ethnic categories were classified as other. One hundred six females (70.7%) and 43
males participated; 1 student did not provide his or her sex. The characteristics of the
participants were consistent with the overall makeup of the university.
Measures
Topic interest scale. Subject-matter interest was assessed via a 13-item topic interest
measure. The topics were designed to cover a wide array of topics covered in the course, such as
motivation, memory, classroom management, and learning strategies. For each topic students
were directed to make a slash on the 100mm line ranging from not interested to very interested.
A principal components factor analysis indicated that all 13-items loaded on the same factor,
therefore a summation score was used for the analyses.
Multiple-choice knowledge test. Domain knowledge was measured via a 10-item
multiple choice test with four response options per question. This test was designed to measure
students’ declarative knowledge in educational psychology. A sample item is as follows:
Noah performs substantially better than the rest of his classmates in all subject areas.
Further, he does not appear to work that hard for his grades. This difference between
Noah and his classmates may be attributed to:
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
8
a. motivation
b. general intellectual ability
c. specific academic aptitude
d. spatial reasoning
(b is the correct answer)
The items on the test were drawn from topics covered within the educational psychology
course in which the students were enrolled. One point was awarded for each correct answer for a
maximum score of 10.
Domain knowledge analogies test. Domain knowledge was further assessed through
use of seven analogical reasoning problems. The items on the test were drawn from topics
covered within the educational psychology course in which the students were enrolled. The
analogies followed a standard A:B::C:
format.
The analogy items were scored on a 1 to 7 rubric (see Alexander, Murphy, &
Kulikowich, 1998). Responses ranged from 1 (no response) to 7 (correct response), with points
in between awarded for responses of increasing levels of sophistication and domain-specificity.
For example, 3 was awarded for a response outside the domain of educational psychology and 5
was awarded for a response in the domain of educational psychology that was different from the
correct response. See Appendix A for sample questions and a complete scoring rubric. The first
and fourth authors scored a random sample of analogies for 41 students (25% of the sample).
The interrater agreement was .92. After achieving interrater agreement the first author coded the
remainder of the responses.
Texts. Two text passages were selected for inclusion in this study. Participants received
only one of the passages at each time point and the order of the passages was counterbalanced.
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
9
One text addressed the topic of motivation and the second addressed the topic of strategic
processing. The texts were of comparable length and difficulty (e.g., word count, paragraphs,
sentence structure, and technical language) and both texts addressed topics covered within the
educational psychology course in which the students were enrolled.
Strategic processing inventory. The strategic processing inventory consisted of 20 textprocessing strategies. This measure was taken from a study by Murphy and Alexander (2002).
Strategies related to translating or reading in a different language (i.e., “translated words or
phrases to another language” and “summarized the passage in another language”) were not
included because they were not selected by any of the participants. Additionally, the strategies
“consulted reference materials” and “looked up vocabulary” were omitted because students were
not allowed to access these sources while completing the task. Participants were directed to
check (✓) any strategy that they used and to put an asterisk (*) next to the strategies that they
found most helpful. A 0 to 2 scale was used to score strategic processing for each of the
strategies. Strategies marked with a check were awarded 1 point and strategies marked with an
asterisk were awarded 2 points. Unmarked strategies received 0 points.
The strategies were separated into subgroups of deep processing strategies and surface
processing strategies. This division has been theoretically justified as accounting for different
types of processing (Alexander, 2003) and this distinction is an important component of the
MDL. Examples of surface processing strategies included changed reading rate and rehearsed
main ideas. Deep processing strategies included items such as related to background knowledge
and reflected on reading. There were seven total surface processing strategies and nine deep
processing strategies. The strategies were combined in a random order on the checklist. A list of
all possible strategies are included in Appendix A.
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
10
Domain-specific text recall measure. At the beginning of the study, participants were
instructed that they could spend as much time reading the text as they wanted. After reading,
students completed a free recall of the text without being able to look back at the text. They
were asked two separate questions designed to have them identify both the main ideas and
supporting details. The first question asked students to “list what you consider to be the main
points of the passage you read” and the second question asked students to “jot down anything
else you remember from the passage you studied.”
Procedure
Participants completed all of the measures twice during the semester. The first
administration was during the second week of a fifteen-week semester and the second
administration was following the thirteenth week of the semester. After receiving and signing
the informed consent, participants were provided with a packet including a demographics
questionnaire, interest measure, knowledge tests, and the text passage. They were instructed that
there was no time limit for completing the items and that when they had completed the first
packet they would receive a second packet. The second packet contained the strategic processing
inventory and the recall measure. Participants were not allowed to look back at the text while
completing either the strategic processing inventory or the recall measure. The measures were
completed during their regularly scheduled class and all measures were completed in a single
session.
Results
Students’ Pretest to Posttest Performance
Before conducting the analyses of interest, differences between students who read the
strategy passage first were compared with students who read the motivation passage first to
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
11
ascertain whether different levels of strategic processing were reported for the different passages.
A between-group MANOVA indicated no significant differences in the combination of surface
and deep strategy use for students in either of the counterbalanced text conditions (Wilk’s
Λ=.987, p=.75); therefore, all students were combined into a single sample for the remaining
analyses.
Scores on the text recall measure were equated across passages using z-scores. These
scores were examined for the effect of receiving each passage at either pretest and posttest. A ttest for independent groups revealed a significant difference in text recall scores for the
motivation passage (t=-2.00, p=0.47); individuals scored higher when receiving this passage at
pretest than when receiving this passage at posttest. Due to the nature of this difference, analysis
of text recall was not included in the analyses. The mean z-scores are for both conditions are
included in Table 2.
The relations between the variables at both time points were examined using Pearson’s
correlation coefficients. As expected, pretest and posttest scores were significantly correlated for
all individual measures. Significant correlations between the domain knowledge and knowledge
analogy measures were found for both time points. Additionally, surface and deep processing
strategy use was significantly correlated at pretest (r=.352, p<.001) and posttest (r=.279, p<.001).
Further, surface strategies at pretest were correlated with deep processing strategies at posttest
(r=.200, p=.014). Further, interest at posttest was also significantly correlated with deep
processing strategies at posttest (r=.214, p=.009). The complete correlation matrix is presented
as Table 1.
Changes in domain knowledge, interest, and strategic processing from the beginning to
the end of the course were examined. A summary of pretest and posttest values for all variables
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
12
is presented as Table 2. Over the course of the semester, student domain and knowledge
analogies increased while interest and strategic processing decreased. To examine whether these
changes were significant, an analysis of the effects of each variable at pretest on the combined
posttest scores was observed, followed by analyses of the effects of each individual pretest
variable on the individual posttest scores. This permitted an examination of the cumulative
effects as well as the individual effects of the variables. A repeated-measures MANOVA was
run with knowledge, interactive knowledge, interest, surface processing strategies, and deep
processing strategies as the dependent variables and time as the repeated, within-subjects
variable.
Results from repeated-measures t-tests comparing pretest to posttest scores were in
accordance with some of the predictions. Domain knowledge at pretest significantly differed
from domain knowledge at posttest (t=-8.91(149), p<.001) and knowledge analogies at pretest
significantly differed from knowledge analogies at posttest (t=-12.18(149), p<.001). Students’
domain knowledge and knowledge analogies increased from pretest to posttest. This increase
was expected since the students were enrolled in a course in which the topics of the knowledge
questions were covered as part of the course content. Interest, surface processing strategies, and
deep processing strategies were not significantly different from pretest to posttest. Students’
interest remained high from pretest to posttest. Both types of strategy use declined slightly from
pretest to posttest, albeit not significantly.
Cluster Analysis
A cluster analysis was run to investigate whether profiles of student knowledge, interest,
and strategic processing emerged at the beginning of the semester. Due to the exploratory nature
of this investigation a hierarchical cluster analysis was used first to determine an approximate
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
13
number of clusters. An agglomerative procedure with average linkage was used to form the
clusters. Domain knowledge, knowledge analogies, interest, surface processing, and deep
processing were included in the cluster analysis. Due to the variability in values for the scales
used, scores on all of the measures were transformed to z-scores (CITE). Upon examination of
the dendrogram it was determined that a two or five cluster solution was most appropriate. The
proportional increase in the squared Euclidean distances were examined to converge evidence
and also determined these values as an appropriate number of clusters. A two cluster solution
was eliminated as a possibility because it would not meet the needs of profiling smaller groups of
students based on their beginning of the semester scores. Therefore, the five cluster solution was
compared to four and six cluster solutions using K-means cluster analysis. After examining
mean scores for all variables it was determined that the six cluster solution provided the most
meaningful description of the students at the beginning of the semester.
To verify the replicability of the six cluster solution, the sample was randomly divided
into two samples of equal size and the six cluster solution was examined for each sample. Upon
inspection of the means of the variables for the clusters in each sample, it was determined that
the six cluster solution was replicated well for both samples. To provide further evidance, a
discriminant function analysis of the merged sample was used to determine whether individuals’
transformed scores could accurately predict their cluster membership and provide additional
validation for the five cluster solution. Probabilities were weighted according to cluster group
sizes. 90.8% of the cases were accurately classified. This further supported retention of the six
cluster solution. The six clusters are described below.
Descriptions of the Clusters
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
14
Students in the five clusters differed in terms of their knowledge, interest, and use of
surface and deep processing strategies. All of the scores are reported at pretest. The
configurations of knowledge, interest and strategies differed across groups. A total of 150
students were classified. Table 3 provides the pretest and posttest raw score averages for each of
the clusters.
Cluster 1: High achievers. Students in cluster 1 had high scores across all measures at
pretest. They had relatively high domain knowledge and knowledge analogy scores, high
interest, and high strategy use for both deep and surface strategies. There were 17 students in
this cluster. Due to their relatively high knowledge and individual interest, the MDL would
suggest that these students are beginning the semester in a relatively advanced stage of
acclimation. At this stage it is typical for students to rely on a high level of surface strategies in
addition to accessing deep processing strategies.
Cluster 2: Struggling learners. In contrast to the high achievers, cluster 2, the
struggling learners, had relatively low scores across all pretest measures. The struggling learners
had relatively low scores for both the domain knowledge and the knowledge analogies tests.
They had relatively low interest and reported low strategy use for both deep and surface level
strategies. There were 32 students in this cluster. Their low reported strategy use was likely
linked to their low level interest in the domain. These students are typical of learners early in the
acclimation stage.
Cluster 3: Knowledge reliant. Students in cluster 3, the knowledge reliant cluster, had
above average to high domain knowledge and knowledge analogy scores. However, in
comparison to the high achievers, the knowledge reliant individuals reported very low interest
and low surface-level and deep-processing strategies. There were 26 students in this cluster.
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
15
Cluster 4: Interest reliant. Students in the interest reliant cluster also had relatively
high domain knowledge and knowledge analogy scores. Further, their interest was relatively
high. However, their reported use of surface-level and deep-processing strategies was
comparatively low. Despite having high levels of knowledge and interest, these students
reported using a limited number of strategies in their attempts to perform a domain related task.
There were 32 students in this cluster.
Cluster 5: Effortful surface processors. Students in cluster 5 had relatively low domain
knowledge and knowledge analogy scores, and they reported relatively average interest. In
terms of strategies, the reported using a high number of surface-level strategies but relatively few
deep-processing strategies. There were 17 students in this cluster.
Cluster 6: Effortful deep processors. This final cluster consisted of 26 students with
relatively average to below average domain knowledge and knowledge analogies, and relatively
low interest. As compared with the students in the effortful surface processors cluster, these
students reported using high numbers of surface-level strategies and very high numbers of deepprocessing strategies.
Individuals in the high achievers, knowledge reliant, and interest reliant clusters had
relatively high knowledge as compared to relatively average knowledge in the effortful deep
processors cluster and compared to relatively low knowledge in the struggling learners and
effortful surface processors clusters. High interest was observed in the high achievers and
interest reliant clusters. Relatively average interest was observed for individuals in the
struggling learners and effortful surface processor clusters, while individuals in the knowledge
reliant and effortful deep processor clusters expressed relatively low interest. With regard to
strategy use, the struggling learners, knowledge reliant, and interest reliant clusters had relatively
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
16
low strategy use while the high achievers cluster had high strategy use. This was consistent for
both surface and deep strategies in these four profiles. The two effortful processor clusters
demonstrated different levels of strategy for deep and surface strategic processing. Both of these
clusters were average to above average in terms of their strategic processing; however,
individuals in the effortful surface processors cluster reported a relatively high amount of
surface-level strategies in contrast to low levels of deep-processing strategies. However,
individuals in the effortful deep processing cluster reported high numbers of surface-level
strategies in conjunction with an extremely high level of deep-processing strategies.
Students’ Pretest to Posttest Performance Within Clusters
A summary of pretest and posttest scores for each cluster is included in table 3. Followup repeated measures t-tests were run for all clusters to determine whether there were significant
changes in knowledge, interest, or strategy use within each cluster. Data are presented separately
for each cluster.
High achievers. Repeated-measures t-tests indicated that there were significant changes
from pretest to posttest in terms of domain knowledge (t=-4.34(16), p=.001), knowledge
analogies (t=-3.27(16), p=.005), surface-level strategies (t=5.791(16), p<.001), and deepprocessing strategies (t=3.74(16), p=.009). Both knowledge measures increased, but both types
of strategy use decreased. Interest did not differ significantly from pretest to posttest.
Struggling learners. Repeated-measures t-tests indicated that there were significant
changes from pretest to posttest in terms of domain knowledge (t=-6.96(31), p<.001), knowledge
analogies (t=-5.56(31), p<.001) and surface-level strategies (t=4.50(31), p<.001). Changes in
these three variables from pretest to posttest were all significantly positive. There were no
significant differences in interest or deep-processing strategies from pretest to posttest.
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
17
Knowledge reliant. Repeated-measures t-tests indicated that there were significant
changes from pretest to posttest only in terms of knowledge analogies (t=-4.87(25), p<.001).
These students began the semester with a relatively high level of knowledge and maintained that
high level of knowledge across the semester. There were no significant difference in interest or
strategy use from pretest to posttest.
Interest reliant. Repeated-measures t-tests indicated that there were significant changes
from pretest to posttest in terms of knowledge analogies (t=-3.85(31), p=.001) and interest
(t2.33(31), p=.027). Knowledge significantly increased, while interest significantly decreased.
There were no significant differences in domain knowledge scores or strategy use from pretest to
posttest.
Effortful surface processors. Repeated-measures t-tests indicated that there were
significant changes from pretest to posttest in terms of domain knowledge (t=-6.75(16), p<.001)
and knowledge analogies (t=-8.77(16), p<.001). Both types of knowledge significantly
increased. There were no significant differences in interest or strategy use from pretest to
posttest.
Effortful deep processors.
Repeated-measures t-tests indicated that there were
significant increases from pretest to posttest in terms of domain knowledge (t=-5.67(25), p<.001)
and knowledge analogies (t=-6.81(25), p<.001). There were significant decreases in deepprocessing strategies (t=5.06(25), p<.001). No significant changes were reported for interest or
surface-level processing.
Within the clusters, knowledge increased from pretest to posttest, with all but two
changes as statistically significant. However, the degree of increase in knowledge was not
universal across clusters. For instance, the effortful surface processor cluster’s average
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
18
knowledge analogy score increased from 10.71 to 27.65 as compared to increases of less than 10
points for students in the other clusters. Only one cluster, interest reliant, had a significant
change in interest from pretest to posttest. These students experienced a significant decline in
interest (96.78 at pretest, 92.03 at posttest).
The students in the high achievers cluster experienced a substantial decline in strategy
use. By the end of the semester they were using fewer numbers of surface-level strategies (6.65
at pretest, 4.00 at posttest) and deep-processing strategies (6.71 at pretest, 4.53 at posttest) which
coincided with an increase in knowledge. The MDL suggests that increases in knowledge would
allow these students to rely less on surface-level strategies in order to make sense of texts in the
domain of educational psychology. These students may also have been more successful in their
use of certain deep-processing strategies, thus requiring them to use fewer strategies to make
sense of the text. The effortful deep processors also used significantly fewer deep-processing
strategies at posttest (9.52 at pretest, 5.92 at posttest), although they still remained above the
mean at posttest. On the other hand, the struggling learners demonstrated a significant increase
in surface processing strategies from pretest (M=1.72) to posttest (M=2.81). These students
reported using low levels of strategies at both time points as compared to the other clusters.
Discussion
The purpose of this study was to extend previous research of the MDL by examining
whether clusters of students emerged at the beginning of a semester long course in educational
psychology. Of particular interest were the developmental changes that students in different
clusters made as they progressed through their learning experiences. Understanding the nature of
individual differences in the undergraduate classroom is an important step in learning how to
cater learning environments of general education courses to meet diverse students. This study
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
19
examined individual differences in knowledge, interest, and strategic processing at a level more
general than the individual, yet more specific than grouping all students together as acclimated
learners. Before dividing students into profiles, the sample was examined as a whole. Some of
the initial hypotheses with regard to pretest to posttest changes were observed. For instance, as a
whole, student knowledge increased from pretest to posttest. Conversely, interest did not
significantly increase as hypothesized. This may have been due to the complex relation between
interest and knowledge which is discussed as a future direction.
The second research question addressed whether emergent profiles of student knowledge,
interest, and strategy use could be identified at the beginning of a semester-long course. Situated
within the framework of the MDL, six profiles emerged as a result of clustering analyses. These
profiles were consistent with the stance of the MDL and aided in explicating differences in
individuals within the stage of acclimation. Due to comparatively high knowledge and interest,
students in the high achievers cluster were determined to be learners in mid-to-late acclimation.
Students in the struggling learners cluster were prototypical of students in early acclimation,
while students in the knowledge reliant, interest reliant, and effortful processor clusters contained
students with knowledge, interest, and strategic processing that positions them in early-to-mid
acclimation.
Different patterns of changes were exhibited by each of the beginning of the semester
profiles. All of the profiles demonstrated significant increases in domain knowledge and several
demonstrated increases in knowledge analogy scores. These increases were not equal across
groups. Students in the effortful surface processors cluster exhibited greater knowledge
increases than their peers. In terms of interest, students in the interest reliant cluster reported a
statistically significant decrease. This contrasts findings for the sample as a whole, which
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
20
suggested that interest did not change from pretest to posttest. Similarly, statistically significant
changes in strategic processing were noted for the high achievers, struggling learners, and
effortful deep processors, despite such changes being negligible in the entire sample. These
findings suggest that the changes that occur during a semester in terms of knowledge, interest,
and strategic processing are not equal for all profiles of students.
This study was not without limitations. The measurement of individual interest and its
relation to knowledge is complex (Hidi & Renninger, 2006). Are students answering the interest
items at the beginning of the semester, when their knowledge is relatively low, in the same way
in which they are answering the questions at the end of the semester after they have had specific
learning experiences and greater knowledge of each of the topics? Understanding how students
interpret interest questions at the beginning of the semester compared to the end of the semester
is an important step in understanding changes in interest progress through a domain such as
educational psychology. Further, despite completing a 15-week course, student posttest
knowledge was relatively low. It is possible that students took the questions more seriously at
the beginning of the semester when they were just becoming acquainted with their professor and
less seriously at the end of the semester. Since their results were not associated with their course
grade, there was less incentive to invest effort in demonstrating knowledge and utilizing
strategies when reading. It would be worthwhile in future studies to measure situational as well
as individual interest. Since it is posited that situational interest is of particular importance for
acclimating learners, it is important to examine the relation between the two types of interest and
students’ knowledge and strategic processing. As researchers and educators search for a balance
between understanding individual differences in the classroom and making sense of the diverse
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
21
learners in meaningful ways, the MDL continues to serve as a useful aid in making sense of the
complexity of domain learning and domain learners.
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
22
References
Alexander, P. A., Buehl, M. M., Sperl, C. T., Fives, H., & Chiu, S. (2005). Modeling domain
learning: Profiles from the field of special education. Journal of Educational
Psychology, 96, 545-557.
Ainley, M., Hidi, S., & Berndorff, D. (2002). Interest, learning and the psychological processes
that mediate their relationship. Journal of Educational Psychology, 94, 545-561.
Alexander, P. A. (2003). The development of expertise: The journey from acclimation to
proficiency. Educational Researcher, 32, 10-14.
Alexander, P. A., Jetton, T. L., & Kulikowich, J. M. (1995). Interrelationship of knowledge,
interest, and recall: Assessing a model of domain learning. Journal of Educational
Psychology, 87, 559-575.
Alexander, P. A., Murphy, P. K., & Kulikowich, J. M. (1998). What responses to domainspecific analogy problems reveal about emerging competence: A new perspective on an
old acquaintance. Journal of Educational Psychology, 90, 397-406.
Alexander, P. A., Murphy, P. K., Woods, B. S., Duhon, K. E., & Parker, D. (1997). College
instruction and concomitant changes in students’ knowledge, interest, and strategy use: A
study of domain learning. Contemporary Educational Psychology, 22, 125-146.
American Council of Trustees and Alumni (ACTA, 2009). What Will They Learn? A Report on
General Education Requirements at 100 of the Nation’s Leading Colleges and
Universities. Retrieved from
https://www.goacta.org/publications/downloads/WhatWillTheyLearnFinal.pdf
Bourke, B., Bray, N. J., & Horton, C. C. (2009). Approaches to the core curriculum: An
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
23
exploratory analysis of top liberal arts and doctoral-granting institutions. The Journal of
General Education, 58, 219-240.
Hidi, S. (1990). Interest and its contribution as a mental resource for learning. Review of
Educational Research, 60, 549-561.
Hidi, S., & Renninger, K. A. (2006). The four-phase model of interest development. Educational
Psychologist, 41, 111-127.
Lawless, K. A., & Kulikowich, J. M. (2006). Domain knowledge and individual interest: The
effects of academic level and specialization in statistics and psychology. Contemporary
Educational Psychology, 31, 30-43.
Murphy, P. K., & Alexander, P. A. (2002). What counts? The predictive powers of subjectmatter knowledge, strategic-processing, and interest in domain-specific performance. The
Journal of Experimental Education, 70, 197-214.
Nolen, S. B., & Haladyna, T. M. (1990). Personal and environmental influences on students’
beliefs about effective study strategies. Contemporary Educational Psychology, 15, 116130.
Pastor, D. A. (2010). Cluster analysis. In G. R. Hancock & R. O. Mueller (Eds.). The Reviewer’s
Guide to Quantitative Methods in the Social Sciences (pp. 41-54). New York: Routledge.
Silvia, P. J. (2006). Exploring the psychology of interest. New York: Oxford University Press.
Silvia, P. J. (2005). What is interesting? Exploring the appraisal structure of interest. Emotion, 5,
89-102.
Warner, D. B., & Koeppel, K. (2009). General education requirements: A comparative analysis.
The Journal of General Education, 58, 241-258.
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
Table 1
Pearson Product-Moment correlation coefficients for knowledge, interactive knowledge, interest, and strategy use at pretest and
posttest
1
2
3
4
1. Pretest domain knowledge
1.000
2. Posttest domain knowledge
.463**
3. Pretest knowledge analogies
.358** .185** 1.000
4. Posttest knowledge analogies
.210** .305** .424** 1.000
5
6
7
8
.039
.053
.027
-.027
1.000
6. Posttest interest
.048
.038
-.010
.092
.559** 1.000
7. Pretest surface strategies
-.034
.139
-.061
.043
.038
-.011
8. Posttest surface strategies
-.009
.119
-.014
.042
-.066
-.012 .397** 1.000
9. Pretest deep strategies
-.037
-.063
.094
.020
.044
.098
10. Posttest deep strategies
.016
-.006
-.042
.042
.104
* = Correlation is significant at the .05 level (two-tailed).
10
1.000
5. Pretest interest
** = Correlation is significant at the .001 level (two-tailed).
9
1.000
.352** .159
1.000
.214** .200** .279** .295** 1.000
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
Table 2
Means and standard deviations for knowledge, interest, and strategy use
Pretest
Posttest
Mean
SD
Mean
SD
Domain knowledge
5.27
1.55
6.41**
1.47
Knowledge analogies
23.43
8.08
31.44
6.78
Topic interest
84.43
16.33
83.80
15.29
Surface strategies
3.78
2.16
3.42
1.99
Deep Strategies
4.95
3.15
4.39
2.68
Motivation passage
-.12
.89
.15
1.14
Strategic processing passage
.18
1.07
-.15*
.95
Note. Domain knowledge score out of 10 maximum points; Knowledge analogies score out of 42 maximum points. Topic interest
score is average out of 130 maximum points (10 possible points per interest item); Surface strategies out of 14 possible points; Deep
strategies out of 18 possible points; Motivation and strategic processing passage are z-scores.
** = t was significant at the .001 level (two-tailed).
* = t was significant at the .05 level (two-tailed).
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
Table 3
Pretest means and standard deviations on all variables for the five clusters
High Achievers
Knowledge
reliant
(N=26)
Pre
Post
6.54
6.88
(.91)
(1.31)
Interest reliant
Effortful surface
Effortful deep
(N=17)
Pre
Post
5.29
7.06
(1.11) (1.71)
**
Struggling
learners
(N=32)
Pre
Post
4.13
5.66
(1.01) (1.49)
**
(N=32)
Pre
Post
6.59
6.84
(1.01) (1.39)
(N=17)
Pre
Post
3.65
6.18
(.93)
(1.38)
**
(N=26)
Pre
Pre
4.85
6.08
(1.46) (1.09)
**
Knowledge
analogies
28.24
(7.25)
21.91
(6.21)
25.92
(6.43)
27.97
(6.66)
10.71
(4.97)
22.42
(5.71)
Topic
Interest
99.61
94.48
(11.23) (11.33)
82.69
80.03
(11.09) (14.30)
66.62
70.95
(11.69) (12.69)
96.78 92.03
(8.33) (11.67)
**
85.52
84.80
(16.05) (15.95)
78.58
82.74
(15.77) (14.69)
Surface
Strategies
6.65
(1.58)
4.00
(1.37)
**
1.72
(1.14)
2.81
(1.93)
**
3.54
(1.27)
2.85
(1.78)
2.84
(1.05)
3.16
(1.96)
5.24
(2.28)
3.94
(1.87)
4.88
(1.80)
4.35
(2.33)
Deep
strategies
6.71
(2.23)
4.53
(2.43)
**
3.37
(1.96)
3.66
(1.98)
3.73
(1.65)
3.54
(1.79)
3.47
(1.97)
4.38
(2.72)
3.24
(2.17)
4.65
(2.32)
9.92
(1.81)
5.92
(3.80)
**
Domain
knowledge
33.71
(5.89)
**
30.16
(7.19)
**
32.58
(5.46)
**
32.87
(5.58)
**
27.65
(9.02)
**
31.12
(6.92)
**
Note. Means are listed first for all cells with the standard deviations in parentheses. . Domain knowledge score out of 10 maximum
points; Knowledge analogies score out of 42 maximum points. Topic interest score is average out of 130 maximum points (10
possible points per interest item); Surface strategies out of 14 possible points; Deep strategies out of 18 possible points
* = Pretest to posttest difference with cluster significant at the .05 level (two-tailed).
* = Pretest to posttest difference with cluster significant at the .01 level (two-tailed).
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
Appendix A
Interactive Knowledge Test
Samples:
Knowing what: Declarative knowledge :: Knowing how : Procedural knowledge
Jean Piaget: Cognitive Constructivism :: Vygotsky : Social constructivism
1. No response: Because the absence of a response conveyed no information and appeared to
suggest the least amount of effort on the part of the respondent, it was considered the lowest
order category.
2. Repetition: This category of response entails the duplication of one of the three given
terms of the analogy problem. As such, it provides little information and demonstrates
seemingly little effort on the part of the respondent.
3. Nondomain response: While the individual provides a nonrepetative response to the given
problem, the answer is not in the domain of educational psychology. This type of error was
judged more acceptable than the previous ones, since it did demonstrate some originality
(nonrepetitiveness) on the part of the respondent.
4. Structural dependency: In this response, the individual used some component (e.g., root
word) of a given term in constructing a response. As hypothesized, this type of error
evidenced some effort on the part of the respondent, as well as some understanding of the
development of technical terminology.
5. Domain response: This error demonstrates that the respondent has recognized that the
expected response falls within the domain of educational psychology, and has been able to
provide an answer that is related to that domain.
6. Target variant: This type of response is rated as a high-level error, since it is a form of the
correct answer. Errors in number (i.e., singular and plural) were a common form of error in
this category, because only the correct response (excluding misspellings) were judged as
correct.
7. Correct response: Correct response or misspelling of correct response.
Running head: KNOWLEDGE, INTEREST, AND STRATEGIC PROCESSING
2
Appendix B
Strategic Processing Inventory Strategies
Surface processing strategies
Deep processing strategies
Reread parts of the text
Imaged
Skipped parts that were difficult
Reflected on reading
Skipped parts that were boring
Used context to determine meaning
Changed reading rate
Looked for salient details
Rehearsed main ideas
Mentally summarized
Ignored words or phrases not critical to understanding
Used self-questioning
Made notes or underlined important information
Related to background knowledge
Made predictions
Elaborated on main ideas
Download