does teaching high school students test

advertisement
DOES TEACHING HIGH SCHOOL STUDENTS TEST-TAKING STRATEGIES
IMPROVE TEST SCORES FOR THE END OF COURSE TESTS IN US HISTORY?
Except where reference is made to the work of others, the work described in this thesis is my
own or was done in collaboration with my Advisor. This thesis does not include propriety or
classified information.
Amy Malone Duffy
Certificate of Approval:
________________________
Donald R. Livingston, Ed. D.
Thesis Co-Chair
Education Department
___________________________
Sharon Livingston, Ph.D.
Thesis Co-Chair
Education Department
Test-Taking Strategies ii
TEACHING TEST TAKING STRATEGIES FOR STANDARDIZED TESTS
A thesis submitted
by
Amy Malone Duffy
LaGrange College
in partial fulfillment of
the requirement for the
degree of
MASTER OF EDUCATION
in
Curriculum and Instruction
LaGrange, Georgia
July 27, 2011
Test-Taking Strategies iii
Abstract
The importance of standardized test scores in schools has created anxiety for
teachers and students. There is a need to teach test-taking strategies to students before they
take high-stakes test. It is important for schools to include the teaching of test-taking
strategies as soon as students enter high school. The purpose of this study was to evaluate if
students who were taught test-taking strategies scored higher on the End of Course Test in US
History compared to students who did not receive test-taking strategies. The 18 subjects were
in a co-taught US History class of 10th and 11th graders and included regular and special
education students of both sexes. Both quantitative and qualitative data were collected to find
out if the test-taking strategies taught made a difference in the student’s test scores. The results
found that there was no significant difference in the test scores of the treatment group compared
to the non-treatment group.
Test-Taking Strategies iv
Table of Contents
Abstract ……………………………………………………………………………..iii
Table of Contents …………………………………………………………………...iv
List of Tables ……………………………………………………………………….v
Chapter 1: Introduction…………………………………………………………….. 1
Statement of the Problem...………………………………………………… 1
Significance of the Problem………………………………………………... 2
Theoretical and Conceptual Frameworks………………………………….. 3
Focus Questions……………………………………………………………. 4
Overview of Methodology…………………………………………………. 4
Human as Researcher…………………………………………………….. 5
Chapter 2: Review of the Literature………………………………………………...7
Implementing Test-Taking Strategies……………………………………… 7
Impact of Test-Taking Strategies on Test Scores………………………….. 10
Teacher and Students Attitudes about Test-Taking Strategies…………….. 13
Chapter 3: Methodology…………………………………………………………… 16
Research Design…………………………………………………………….16
Setting……………………………………………………………………… 18
Subjects and Participants………………………………………………….. 19
Procedures and Data Collection Methods………………………………….. 20
Validity, Reliability, Dependability and Bias……………………………… 24
Analysis of Data……………………………………………………………. 27
Chapter 4: Results…………………………………………………………………. 30
Chapter 5: Analysis and Discussion of Results…………………………………… 39
Analysis……………………………………………………………………. 39
Discussion………………………………………………………………….. 42
Impact on Student Learning……………………………………………….. 44
Recommendations for Future Research……………………………………. 45
References………………………………………………………………………….. 47
Appendixes …………………………………………………………………………50
Test-Taking Strategies v
Tables
Tables
Table 3.1
Data Shell …………………………………………………….. .21
Table 4.1
Independent T test ……………………………………………..33
Table 4.2
ANOVA ……………………………………………………….. 34
Test-Taking Strategies 1
CHAPTER ONE: INTRODUCTION
Statement of the Problem
This study explored the impact that test taking strategies have on students’ scores
for the End of Course Exam (EOCT) in US History. The seriousness and weight that
standardized scores have on schools and students cannot be taken lightly. In fact, quite
the opposite is true because of the importance of standardized test scores and their impact
on the students, parents, teachers, and the community. Gulek’s (2003) research states
that schools are pressured to raise standardized test scores by placing more accountability
on teachers to prepare students for high-stakes tests. My thesis presents information that
will either confirm or deny that test taking strategies have an impact on the EOCT scores.
Schools are required by federal law, under The No Child Left Behind Act (NCLB),
to show improvement yearly on standardized tests. These tests determine whether a
school meets or does not meet required state standards. If a school does not show
improvement on standardized test scores, it may lose funding as well as receive
additional consequences.
The significance of standardized tests today and the accountability placed on the
school systems cannot be ignored or minimalized. The purpose of this study is to
discover if students who are taught test taking strategies do better on the EOCT
standardized test than their counterparts who do not receive any test-taking instruction.
Many teachers believe that test taking strategies should be taught to their students,
but they do not have or take the time to incorporate the teaching of these strategies with
course content. I see this first hand as a team teacher in my US History class. Students
understand the importance of the standardized test, but rarely are given any strategies to
assist them on the test. In the fall semester 2010, some students participated in four or
Test-Taking Strategies 2
more standardized test as well as a benchmark tests. With so much emphasis and
importance placed on the results of standardized test, the time spent in acquiring testtaking strategies should equal that of content acquisition. It is a disservice to the student
to provide daily content instruction, yet never give him/her strategies for showing
mastery of that content.
Significance of the Problem
The End of Course Test has become more important because it becomes part of
the student’s permanent records and is averaged in with their course grade. The state of
Georgia requires that the EOCT count 15% of a student’s grade. The potential
consequence for those students who are already struggling with a course is that failing the
EOCT can result in failing the course. The weight placed on standardized test results
puts students, regardless of their grades, either in a pass/fail category. This can create a
negative impact on a student who was previously passing his/her US History class but
failed the standardized test. The importance of standardized testing today has created
many questions from students who have performed adequately in school but not on
standardized test.
The importance of standardized testing today and the accountability placed on the
states cannot be ignored. The purpose of my study was to discover if students who are
taught test-taking strategies do better on the EOCT standardized test than students who
did not receive any test-taking strategies instruction.
By introducing test-taking strategies to students who will be taking the EOCT for
second semester 2011, in their US History classes, my study compared students who are
taught test-taking strategies with those who did not receive the strategies. With so much
Test-Taking Strategies 3
at stake in the education of our students we as teachers have to use as many strategies as
possible to help our students in their test taking participation.
Theoretical and Conceptual Frameworks
My research was based on the belief that test taking strategies implemented in the
classroom will have a positive influence on the students’ standardized test scores. As
noted in the LaGrange College Educational Department’s (2008) Conceptual Framework,
under Tenet 1, “Knowledge of Learners,” the teacher understands and acknowledges that
there are many circumstances that play a part in how a student learns and develops.
These circumstances can also affect how a student performs on tests, especially
standardized test. If the stakes are too high and students know that the results could
hinder their progression, their performance may not be a true indication of their ability.
Teachers must continue to use as many different ways to accurately assess their students’
knowledge, Tenet 1, “Knowledge of Curriculum.”
As educators we know that every student has his/her own way of acquiring
knowledge and we must adhere to providing a variety of tools, teaching strategies and
materials to reach all students. It is equally important for students to be able to assess
their progress of how well they are doing and if they require additional remediation in a
given area, which is stated in Tenet 2, “Assessment Skills.” This Tenet is supported by
the National Board for Professional Teaching Standards’ [NBPTS] Principle 3, “The
teacher understands how students differ in their approaches to learning and creates
instructional opportunities that are adaptive to diverse learners.” It is my belief that if
educators know how each student learns then they are aware of the student’s learning
style therefore providing differentiated instruction to support him/her in that particular
Test-Taking Strategies 4
area in order to build a stronger foundation for taking tests and showing content mastery.
This does not mean teaching to the test but conducting classroom assessments, presenting
power points, visual activities, and actually taking old EOCT test to strengthen the
student’s abilities in test taking strategies. “Both Constructivist and Instructionist”
assumptions are acknowledged and combined to provide the foundation upon which
specific skill deficits are identified and corrected in meaningful context (Johnson, 2004,
p.72).
Focus Questions
The importance of standardized testing is more evident today and will continue to
play a major role in education as we know it. Teachers have to prepare students to meet
test challenges without taking away from the learning in the classroom (Gulek, 2003). To
better understand the effects of teaching test-taking strategies taught to students before
they take the standardized test, focus questions were developed as guides to find out the
outcome of the study. Question one asked, “What is the process of implementing testtaking strategies into the US History class?” Question two asked, “How do standardized
test scores differ between the US History classes with test-taking strategies and without
test-taking strategies?” Question three asked, “What are the teacher’s and his/her
students’ attitudes about test-taking strategies instruction for standardized test in US
History?”
Overview of Methodology
This study conducted action research practices that included both quantitative and
qualitative methods. Data from the treatment group, who received test-taking strategies,
EOCT scores were collected, recorded, and compared to students who did not receive
Test-Taking Strategies 5
test-taking strategies. The treatment group of students completed a survey on test taking
strategies after they took the EOCT. The study took place at South Cobb High school, a
Title One school, which is part of metro Atlanta. Both regular and special education
students were included in the study. Quantitative data were analyzed statistically and the
qualitative data were analyzed by coding, looking for recurring, and dominant and/or
emerging themes. The EOCT was deemed to be valid, reliable, dependable and free of
bias as stated by the Georgia Department of Education. An independent t-test as well as
Cohen’s d that measured the magnitude of the treatment effect and an ANOVA: Single
Factor without Replication was used to analyze the different groups’ test scores.
Human as Researcher
As a special education teacher for fourteen years I have seen the heartache of
students who have not passed standardized test and the effects that it has on them in their
educational journey. I have become very concerned about the number of standardized
test in which students participate and the significance placed on these test. Although
teachers align their curriculum to the standards, they rarely have time to teach students
test-taking strategies. The EOCT is considered a high-stakes test that students take in
several disciplines throughout high school. I compared the US History EOCT test scores
of students who received test-taking strategies instruction with the US History EOCT
scores of students who did not receive test-taking strategies instruction. It is my belief
that those students who are taught test-taking strategies in their US History class will do
better on the EOCT than the class that does not receive the strategies.
Test-Taking Strategies 6
CHAPTER TWO: REVIEW OF LITERATURE
Teachers today are accused of teaching to the test. Since the inception of No
Child Left Behind act, standardized tests have become all too familiar to teachers and
students. It seems that every time we turn around we are giving another standardized
test. In fact it is a well-known truth that of all the industrialized countries, American
students are tested the most (Kohn, 2000). Because of the importance of these high stakes
tests, many teachers are incorporating the teaching of test-taking strategies into their
curriculum. Research suggests that test-taking strategies should be included when
helping students prepare for the required standardized test. The test-taking strategies
recommended have been tried and tested for many years. Most teachers and researchers
are in agreement that teaching test-taking strategies increase student confidence when
they take the test, and in many cases have reported improved test scores as compared to
students who had not receive the test-taking strategies instructions. Both teachers and
students have their own opinion as to the impact that teaching test-taking strategies
instruction will have on the actual test scores themselves. Since standardized test scores
are used to make decisions regarding a student’s future, it would be a wise decision for
teachers to embed test-taking strategies instruction into their curricula to support students
in their testing endeavors.
Implementing Test-Taking Strategies
There are many proven, researched based test-taking strategies to support students
as they also acquire content knowledge via a curriculum. However, Nolen, Haladyna,
Test-Taking Strategies 7
and Haas (1992) believe it is unethical for teacher to use information from standardized
test in their curriculum. Teaching students test-taking strategies familiarizes students
with a variety of testing skills. Students will then have strategies for reducing test
anxiety, managing test time, and considering answer choices. They will be able to
recognize a test question’s format and terminology. They may utilize visualization
activities and motivational strategies. They will be prepared to challenge the results,
recheck answers, and use key words to answer questions. More importantly, students
will have ownership of the test-taking process. Each will feel that he/she, not the test, is
in control (Gulek, 2003).
Teachers must do as much as they can to help students increase their test scores
because so much is on the line as to the outcome and the effect test scores will have on a
student’s educational progress. Because the school’s test scores are so highly publicized,
all those involved in the education of the children have a stake in the outcome (KherDurlabhji & Lacina-Gifford, 1992). Students’ test scores can literally make or break a
school system. This is why there is so much pressure for the students to perform better
each year. The accountability factor is higher than it has ever been.
Content knowledge is a factor that cannot be underestimated. One of the
strategies recommended to use in the research is reducing test anxiety. Research
indicates that test anxiety is significant problem with devastating effects on a student’s
performance (Gulek, 2003). Students who learn to relax and receive test-taking
strategies before the test have more positive approaches to handle the stress. Ritter and
Idol-Maetas (1986), suggested that teaching students strategies to decrease test anxiety in
order to improve test results was making good use of instruction time. They believe
Test-Taking Strategies 8
there is a direction correlation between students who are taught test-taking strategies and
the outcome of the test; those who receive test-taking strategies score higher than those
who do not receive any test-taking strategies. Students who are more confident going
into the testing situation will undoubtedly have an advantage in increasing their scores
over students who are anxious.
Time management is critical for students when taking standardized test. There
are techniques that students can use to help them develop time management skills which
are especially important for students with disabilities (Gulek, 2003). It was highly
recommended by Clovis (1999), that students practice timed tests throughout the year in
order to get into a routine of completing the test. What he was stating was that practice
makes for better time management skills. Students who are familiar with timed test
patterns generally do not get as anxious as those who are not accustomed to them. Time
management skills are not only beneficial for taking test but also will serve students in
most daily living skills.
Reading is essential to all tests and one highly advocated strategy is rereading
directions and any question one does not understand. Students need to understand
exactly what each question is asking, to eliminate unnecessary words and to eliminate
irrelevant information. Donnelly (1999) emphasized that students question the material
they read on the test to find out exactly what is being asked. Reading the instructions
carefully and completely requires the students to pay attention to details and follow
instructions completely. Students are encouraged to practice the process of elimination
when they are unsure of the answer. They look at the answers and select the one or two
answer they know are incorrect and then try to make an educated guess from the
Test-Taking Strategies 9
remaining two answers. Cohen (2006) reported that more proficient learners are capable
of using the test taking strategies to assist them on standardized test, whereas those less
proficient students struggle with incorporating test-taking strategies when they take a test.
Carelessness and messiness cannot be allowed. Students have to go through their
tests to make sure that incorrect answers are completely erased and any stray marks are
erased (Nolan et al., 1992). This test-taking strategy might not seem important, but due
to testing irregularities and the occurrence of unethical practices, it is more important
than ever that students, teachers, administrators, and test proctors pay attention to and
follow test protocol one hundred percent. Each state has their own code of ethics
concerning standardized testing procedures. Teachers, as well as administrators, need to
make sure that all test taking strategies are done ethically. Some educators’ question the
ethics of allowing students to practice by taking older forms of a standardized test.
However, if the Department of Education releases these tests then it completely
legitimate for students to take these older versions of the test. In fact, this is a test-testing
strategy used by many because it gives students a realistic example of the format of the
test appearance. In addition to that type of practice, it is to their advantage to practice
taking test with a variety of formats. Students are encouraged to practice the process of
elimination if they are unsure of the answer. They look at the answers, and then select
one or two answers they know are incorrect and try to make an educated guess from the
remaining two answers.
Impact of Test-Taking Strategies on Test Scores
Teaching test-taking strategies to students helped familiarize them with the format
of the test and reduced test anxiety because students felt more powerful knowing what to
Test-Taking Strategies 10
expect on the test. In addition, by eliminating extraneous factors, such as anxiety, the test
scores show a clearer picture of what students know (Scruggs & Mastropieri, 2009).
There is quite a bit controversy and publicity surrounding test-taking strategies
instruction if test-taking strategies really mean that teachers are teaching to the test. This
criticism has been a concern of teachers and educators, as well as the parents. The
accountability factor weighs heavy on schools to raise test scores every year. For those
schools that do not raise tests scores, the future can be very dismal. However, there are
many in the teaching field who think that there is nothing wrong with teaching test-taking
strategies in order to help students prepare for high stakes tests. There are others who
think that some teachers cross the line when teaching students certain test strategies and
refused to get involved. In a study by Marcia Belcher (1984), the results showed several
findings as to whether students who received test-taking strategies scored higher than
those students who had not receive test-taking strategies. The research took place at
Miami-Dade Community college on the College Level Academic Skills Test (CLAST).
All students who took the CLAST were included in the study. The test included reading,
writing, and computation on the college level. The study pointed out that students were
instructed to guess at any question they did not know. The study’s results also showed
that the students who knew test-taking strategies felt confident answering questions
which they did not know and were more likely to answer the questions instead of leaving
them blank. It was noted that there were some students who left test items blank, even
though they had been told to guess. Belcher (1984) reported that she felt the students
who left questions blank were not test-wise, meaning a lack of test-taking skills. The
research reported the students who left questions unanswered because they were not
Test-Taking Strategies 11
equipped with test-taking strategies had lower scores.
Scruggs and Mastropieri (2009) reported that students who are low performers,
from lower economic backgrounds and students with disabilities can all benefit from
learning test-taking strategies. These are the students that the NCLB Act brought
attention upon; the students are who referred to as the ones who fall through the cracks.
The truth is that all students, regardless of their background, could benefit from learning
new test-taking strategies. No one will argue that content knowledge is the most
important factor when taking standardized test, but there is a lot to be said for the
addition of test-taking strategies to complement the student’s performance. Because the
reputation of the school depends largely on high stakes tests, it would be advantageous
for schools to encourage teachers to teach test-taking strategies. However, Kohn (2000)
believes that standardized test usually measures “superficial thinking” and all the time
spent teaching test-taking strategies takes away from teaching students how to be skillful
thinkers.
Ritter and Idol-Maestas (1986) conducted a study in which they compared
students who received test-taking strategies instruction to a group that did not receive
test-taking strategies instruction on pre and post-test. They found that students who used
test-taking strategies scored significantly better than the group that did not use test-taking
strategies. Twenty-eight students were taught how to use test-taking strategies on what
the researcher called “near” and “far generalizations.” The near generalizations consisted
of pre and post-test in social studies mini tests. The mini tests were where the students
showed significant improvement. On the far generalizations, which were the students’
test scores from a science class, the experimental groups’ scores were not as significant.
Test-Taking Strategies 12
The overall findings were that students do benefit from receiving test-taking strategies
especially for those students identified with learning problems.
One way to look at the usefulness of teaching test-taking strategies is that it
cannot hurt and if there is a chance that it can improve test scores for students then it
should be part of the lesson plan. Although Kohn (2000) refers to standardized test as a
“creature from an old horror movie,” the truth is they are here to stay. In regards to
providing all students with test-taking skills, the teaching of test-taking strategies is sure
to promote confidence and a positive approach to taking test.
Teacher and Students Attitudes about Test-Taking Strategies
It is a known fact that the attitude and the will to succeed of teachers and students
have a direct relationship on test scores (Wright, 2009). The amount of pressure placed
on the student’s performance on standardized test continues to increase, putting not only
students but teachers in the hot seat. This can create anxiety. Test anxiety is real and is a
common condition felt by students and can become a hindrance on test performance
(Gulek, 2003). Research has proven that students who are taught test-taking strategies
generally do better on high stakes testing and have a better attitude about taking test
(Scruggs & Mastropieri, 2009). Students, who are test-wise, approach test-taking in a
positive way and have less test anxiety. It is a known fact that test anxiety can be a factor
that affects the student’s attitude toward the test. Students who are test wise and
knowledgeable about test strategies score higher because they have the needed skills to
help them handle difficult problems.
Students are taking more and more standardized tests than ever before and the
stakes keep getting higher due to The No Child Left Behind Act. The schools receive
Test-Taking Strategies 13
reports cards based on the students test scores and these reports are highly publicized for
all to see. Parents, boards of education and communities have a vested interest in how
their local schools compare to other schools in the state. By integrating test-taking
strategies into the curriculum, students are being prepared to develop a more positive
outlook toward taking test. Test-taking strategies are important to familiarize the
students with methods to use when answering questions. By teaching students about testtaking strategies, they develop confidence and are familiar with test formats. One report
stated that students actually had a better attitude about standardized testing than what was
believed by the National Council on Measurement in Education (Beck & Stetz, 1980).
This might not be true for all students; especially those who have taken the graduation
test several times and failed, but the perception that all students hate standardized test is
not true. Carter et al. (2005) reported that it may be too late to teach test-taking strategies
to students who are in the 11th or 12th grade because they no longer care how they do on
tests.
Research states that the teacher’s attitude toward standardized testing has a
direct relationship on student achievement (Green, 1992). When teachers communicate
negative attitudes toward standardized tests, students’ scores fall (Norton & Park, 1996).
If teachers are not properly trained to administer the tests, the test scores could be
compromised. Also teachers who had difficulty with testing in school often carry their
opinions with them in their teaching practices. Rudman (1989) states that teachers who
have had training and experience tend to project a positive attitude and endorse testing as
opposed to teachers who are not as experience tend to be negative about test-taking
strategies and standardized test in general. When teachers are able to integrate test-taking
Test-Taking Strategies 14
into the curriculum and make necessary changes, they feel motivated and empowering,
believing they can improve student performance on test (Wright, 2009).
Kher-Durlabhji and Lacina-Gifford (1992) stated that researchers believe more
research should be conducted on the role teachers should take in teaching test-taking
strategies. Because the attitude of the teacher toward testing and teaching test-taking
strategies will undoubtedly carry over to the students, it is something that should be taken
into consideration for those who administer test. Another factor to consider is
determining what practices are ethical and unethical regarding the teaching of test-taking
strategies. With all the publicity about teachers teaching to the test, changing answers,
giving answers and other practices, many teachers’ attitudes about administering
standardized test are not favorable. Even college students majoring in education have a
negative attitude about standardized testing (Green, 1992). What was found in some of
the research is that teachers are usually in favor of standardized testing even more than
the administrators (Rudman, 1989). If teachers become more knowledgeable about
standardized testing they can use the results to enhance their teaching and their attitudes.
Gulek (2003) believes that teachers should look at test preparation from an “instructional
preparation practice standpoint; which will make teaching test-taking strategies
effortless.” It was reported in a study by Wright (2009), that there have been teachers
who actually refused to give high stakes tests because they did not agree with them.
Needless to say these teachers were fired for insubordination. Not all teachers agree with
the standardized tests that the NCLB act requires. They believe that standardized tests
are unnecessary. These high-stakes test can keep students from graduating or passing to
Test-Taking Strategies 15
the next grade level. The pressure for teachers to prepare their students to meet the
demands of standardized tests can create a very negative atmosphere.
Test-Taking Strategies 16
CHAPTER THREE: METHODOLOGY
Research Design
This study utilized quantitative data from the End of Course Test (EOCT) scores
in US History for high school students. Qualitative data from observational notes,
students’ survey responses and teacher journal data were used as well. A one-tailed t test
was employed to compare the difference between a treatment group (students who were
taught test-taking strategies) and a control group (students who were not taught testtaking strategies). An Independent t test was appropriate for this research since there
were two mutually exclusive groups (treatment and control) and the null hypothesis to be
tested is that the treatment group will not be able to outperform the control group on the
basis of EOCT scores. The corresponding hypothesis is that the treatment group will
outperform the control group due to exposure to test-taking strategies. An ANOVA:
Single Factor without Replication was used to compare the females’ treatment group
scores to the females’ non-treatment group as well as the males’ treatment group to the
males non- treatment group. An effect size calculator was also used to measure the
magnitude of the treatment.
By introducing test-taking strategies to students who will be taking the EOCT for
second semester 2011, in their US History class as guided by the Instructional Plan, my
study compared students who were taught test-taking strategies with those who did not
receive the strategies. With so much at stake in the education of our students we as
teachers have to use as many strategies as possible to help our students in their test-taking
participation.
Test-Taking Strategies 17
Subjects were tested only once and the difference between the two sample means
(treatment and control groups) was used to test the hypothesis at a 95% level of
confidence or a .05 level of significance. Ritter and Idol-Maestas (1986) used the t-test
to determine if the experimental group (students who received test-taking strategies
instruction) performed better than the control group (student who did not receive any testtaking strategies instructions) on the mini-test. Their findings were that the experimental
subjects performed significantly better than the control group. They even categorized the
question format (multiple-choice, true-false, matching, completion and short answer) to
find out if there were any particular type questions that the experimental and control
group did better. The results were that the experimental group did significantly better on
all question types. Hendricks (2009) recommends for the first time researcher to keep the
number of students participating in the study small so that the beginning researcher will
be able to do a thorough job. My treatment group consisted of eighteen students.
In reference to the validity of the results of the End of Course Test in US History,
Brown and Rolfe (2004) stated that formal assessments such as standardized test have an
“established validity.” (p. 194). The EOCT is reviewed by an independent panel of
educators who examine each item to make sure it aligns with the curriculum and checked
for suitability and potential bias. Items are field tested and approved by Georgia
educators. Since the EOCT is prepared by a panel, absence of bias, internal reliability
and construct validity have already been established. There was discussion underway at
the time of my research with state educators and legislators changing from using the
Georgia High School Graduation Test (GHSGT) to the End of Course Test (EOCT). The
Georgia Department of Education has replaced the GHSGT with the EOCT spring
Test-Taking Strategies 18
semester 2011, except for the Writing portion.
Setting
The setting of the research took place in a co-taught, general education US
History class at South Cobb High School in Austell, Georgia. Austell is fourteen miles
west of Atlanta, Georgia. The population of Austell is 7058, with the median home value
of $118,989. The number of families living below poverty level is 12.8%, which is
higher than the Georgia state average. The number of college students in Austell is
below the state average as well as the percentage of the population with a bachelor
degree. Both male and female students were included in the study. The experimental
group of students consisted of ten sophomores and eight juniors. There are fifteen
African American students, two White students and one Asian student. Both regular and
special education students were included in the study. The class was selected because it
was my class and it was easy to implement the test-taking strategies instructions into the
curriculum. The school is identified as a Title I school and the majority of students are
classified as economically disadvantaged. There are 2161 students and the ethnic
breakdown is 63% Black, 20% White, 12% Hispanic, 2% Asian and 3% unknown. South
Cobb high school serves students in grade nine through twelve. The school has not met
the requirements for Adequate Yearly Progress in the last two years. Consensual
validation was obtained by getting permission for this action research from the principal
of the school to conduct the research to implementing test-taking strategies into the
curriculum as well as LaGrange College’s Institutional Review Board.
Test-Taking Strategies 19
Subjects and Participants
The class subjects consisted of ten 10th graders, and eight 11th graders. The class
was comprised of fifteen African Americans, two White students and one Asian student
in this class. There are eight males and ten females. Four of the eighteen students are
classified as special education students. These four students are identified as low
academic performers. Three students identified with below grade level reading skills and
one student is working toward a certificate of attendance due to repeated failure on the
Georgia High School Graduation Test (GHSGT). Carter, Wehby, Hughes, Johnson,
Plank, Barton-Arwood, and Lunsford (2005) reported that it may be too late to teach testtaking strategies to students who are in the 11th or 12th grade because they no longer care
how they do on tests.
The subjects for this action research were high schools students who were in my
US History co-taught classes. The two classes were selected because they were my only
two US History classes. Both the treatment group and the control group classes met
every day for ninety minutes for one semester.
Two colleagues reviewed the Instructional Plan. Administrator 1, a former
teacher and principal with twenty-five years’ experience and a special education teacher,
Teacher 1, who had twenty-seven years’ experience, critiqued the plan adding
suggestions and comments to improve the teaching of test-taking strategies. Teacher 2,
the team teacher in the US History class with fifteen years of experience, offered
suggestions and made revisions for certain activities during the lesson plan. Although
Teacher 2 did not review the Instructional Plan before the implementation, she did revise
and make suggestions to the lesson plans mostly due to time constraints.
Test-Taking Strategies 20
Procedures and Data Collection Methods
Different collection methods were used in order to obtain data in this study:
Observational notes, Instructional Plan, test scores from the EOCT, and Students’
Surveys. The study covered nine weeks of spring semester 2011 in a US History cotaught classroom. Triangulation was achieved through multiple sources of qualitative
and quantitative data that was gathered and analyzed.
Table 3.1 shows an overview of this action research study with the data collection
methods and how the analysis align with the study’s focus questions.
Test-Taking Strategies 21
Table 3.1 Data Shell
Focus Question
Literature
Sources
Type: Method, Data,
Validity
How are data analyzed
Rationale
FQ 1
What is the
process of
implementing
test-taking
strategies?
Gulek
(2003)
Idol-Maetas
& Ritter
(1986)
Mehrens
(1989)
Clovis
(1999)
Scruggs &
Mastropieri
(1992)
Rudman
(1989)
Belcher
(1984)
Kohn
(2000)
IdolMaestas,
Ritter
(1986)
Type of Method:
Instructional Plan,
Rubric and Observational
Notes
Type of Data:
Qualitative
Type of Validity:
Content
Coded for themes
Recurring
Dominant
Emerging
Looking for
categorical and
repeating data that
form patterns of
behaviors
Type of Method:
Tests
Standardized - EOCT
Type of data:
Quantitative
Interval
Independent T
Inferential
Statistics
FQ 2
How do the
standardized
test scores differ
between
students who
received testtaking strategies
and those who
did not?
Type of Validity:
Content
Cohen’s d Alpha-Effect
size
Measures the magnitude of
a treatment effect for small,
medium & large (could not
put this in 5th column as it
put the rest of the data shell
on another page.
ANOVA: Single Factor
FQ 3
What are the
students and
teacher attitudes
about testtaking strategies
for standardized
tests?
Wright
(2009)
Belcher
(1984)
Rudman
(1989)
Type of Method:
Reflective Journal,
Observational Notes
Student Survey
Type of Data:
Qualitative
Nominal
Type of Validity:
Construct
Coded for
Themes
Recurring
Dominant
Emerging
To determine if
there are
significant
differences
between means
from two
independent
groups.
To determine if
there is a
difference between
female treatment
group compared to
female nontreatment, as well
as male treatment
versus male nontreatment.
Looking for
categorical and
repeating data that
form patterns of
behaviors
Test-Taking Strategies 22
US History students are required to take an End Of Course Test (EOCT) near the
end of the semester. This is a standardized test required by the state of Georgia. The
instructional plan for this study (see Appendix A) included test-taking strategies
embedded into the US History curriculum with the intention of improving test scores for
the students taking the EOCT. The test-taking strategies were administered along with
the daily warm-up activity several times a week for nine weeks. Changes to the
Instructional Plan were made after colleagues read and reviewed the plan (see Appendix
B). Mini lessons on proven test-taking strategies were taught several times a week for
nine weeks. The test-taking strategies were presented at the beginning of the period and
followed by question and answer sessions, student activities and/or discussion. It was
suggested to use flexible grouping for discussion activities after the test-taking strategies
which would be presented by both teacher and students. Students were required to
complete at least one practice test online for homework. The practice tests were previous
US History EOCT available for students to complete online. The strategies that were
taught were research-based test preparation instructions that have been found to increase
students’ test scores. Based on research by Scruggs and Mastropieri (2009), test-taking
strategies instruction should be taught and concluded as near to the testing date as
possible.
The test strategies were designed to build confidence and motivate students.
Educating students about why they are taking test and the goals of the test help to
empower the students to make the test their own. One colleague suggested adding more
interactive technology activities that incorporate test-taking strategies. It was decided
that the “I-Respond” program would be added to the Instructional Plan. The I-Respond
Test-Taking Strategies 23
program allowed students to use individual remotes to answer multiple choice questions
displayed on the white board. This program permitted students to get immediate
feedback on practice tests that had a format similar to the EOCT.
A principal, administrator 1, with twenty-five years’ experience in education
suggested opening the unit plan on teaching test-taking strategies with a short video clip.
This suggestion was rejected due to time constraints. Students practiced filling out mock
answer sheets by writing their name, test date and hour, and test subject. They also
practiced erasing and filling in the bubbles. No grades were involved and they were
checked for completing required information and bubbling information. Students filled
out the student survey (see Appendix C) after the test-taking strategies mini lessons and
EOCT were completed. A journal was kept to record students’ attitudes, concerns, and
questions that would be helpful for future instructions on test-taking strategies. Student
led discussion were included in the mini lessons on test-taking strategies. I observed and
made notes on what worked and what did not work during the student led discussions.
Teacher 1 suggested discussing the observational notes with the students to make sure the
information was correct. This was implemented in the instruction plan and during the
mini lessons.
The End of Course Tests (EOCT) in Georgia is administered three times a year:
winter, spring and summer. For the purpose of my study the data from the EOCT was
administered in April, 2011. Salkind (2007) stated that the independent t test was
appropriate because two separate groups, one group which received test-taking strategies
and another group that did not receive test-taking strategies, were tested only once.
School systems receive a full set of reports for the administration of the test. Teachers
Test-Taking Strategies 24
received their students’ test scores from the administrators at the school. The data
included on the EOCT included a scale scored, grade conversion score, performance level
and domain level information for each student in a specific class. For research purposes,
the scaled score was used for the comparison of the two groups. Each student received an
individual student report, including scale score and a grade conversion score. One copy
was placed in the student’s permanent record folder and one was given to parent/student.
Test scores were collected for the first block class, the treatment group and the second
block class, the control group. A one tail t-test was used to compare the students’ scores
to determine if there was significant difference between the treatment group and the
control group. Gulek (2003) pointed out that teachers should be aware of the error of
measurement because the student’s real score may show the student did not pass, but by
using the error of measurement the score could actually be a passing score. Scores from
both the experimental group, those who received test-taking strategies and the control
group, students who did not received test-taking strategies, were compared with each
other.
Students from the treatment group completed the survey about test-taking
strategies after the EOCT. The surveys were collected and coded for themes to gather
information on test-taking strategies.
Validity, Reliability, Dependability and Bias
Focus Question one looked at qualitative data that was gathered from colleague’s
critique of the Instructional Plan Rubric as well as observational notes that I took.
Construct validity was sought based on the Instructional Plan for implementing
researched based test-taking strategies. Colleagues provided feedback on improving the
Test-Taking Strategies 25
Instructional Plan. In addition students provided information on mini lesson on testtaking strategies which were noted in the teacher’s journal and observational notes. I
checked to see if the content that was taught was learned by all the subjects from the
discussion session. Scruggs and Mastropieri (2009) stated all students, even low
performers and those from lower economic backgrounds can benefit from learning testtaking strategies. The selection of an adequate number of subjects was used in the
experimental and control group. The length of time for the data collection was persistent
and prolonged. The data was accurately recorded with the use of protocol. Researcher
provided complete and accurate supporting data, by using researched based test-taking
strategies. All instruments for unfairness, offensive and disparate impact were checked.
Gulek (2003) discussed the ways to prepare high school students for standardized tests by
teaching test-taking strategies before the test. Ritter and Idol-Maetas (1986) focused on a
learning strategies approach to teach students how to take test. Qualitative data from
students and teacher discussions were recorded to look for recurring, dominant and
emerging themes. Qualitative data from the Instructional Plan Rubric that colleagues
critiqued was used to add to the Instructional Plan. The rationale was to look for
categorical and repeating data that formed patterns or behavior.
Focus Question Two involved quantitative data that was gathered from the EOCT
test results from the State of Georgia. Criterion-based and content based validity was
sought based upon the prediction that students who did not receive test-taking strategies
would score lower on standardized tests than those students who did receive test-taking
strategies. Brown and Rolfe (2004) stated that formal assessments such as standardized
tests have an “established validity” (p. 194). The End of Course Tests were expected to
Test-Taking Strategies 26
be free from bias because they have already been critiqued and all biases removed prior
to administering the tests. School systems received a full set of reports for the
administration of the test. Teachers received their students test scores from the
administrators at the school. The interval data included on the EOCT included grade
conversion scores and domain level information for each student. An independent t-test
compared the students’ scores to determine if there was significant difference between
the treatment group and the control group. Gulek (2003) pointed out that teachers should
be aware of the error of measurement because the student’s real score may show the
student did not pass, but by using the error of measurement the score could be a passing
score. An independent t test was appropriate for the EOCT data, since there were two
mutually exclusive groups (treatment and control) and the null hypothesis to be tested is
that the treatment group will not be able to outperform the control group on the basis of
the EOCT scores. The corresponding hypothesis was that the treatment group would
outperform the control group. Subjects were tested only once and the difference between
the two sample means (treatment and control groups) was used to test the hypothesis at a
95% level of confidence or a .05 level of significance.
Ritter and Idol-Maestas (1986)
used an independent t-test to determine if their experimental group (students who
received test-taking strategies) performed better than the control group (students who did
not received test-taking strategies).
Focus Question three concentrated on qualitative data from the students’ surveys
and teacher journal and observational note. Construct validity was used for students’ and
teacher’s attitudes and beliefs about the test-taking strategies. Dependability was
checked by data collection and treatment group was kept consistent. I maintained well
Test-Taking Strategies 27
organized raw data that provided complete and accurate supporting data to prove or
disprove that providing students with test-taking strategies before they took standardized
test would result in higher scores on the test. Through the collection of qualitative data I
was able to connect the research question to theory to focus questions to conclusions.
All survey questions were checked for unfairness, offensive and disparate impact.
Rudman (1989) stated that students believe that by taking more test, they remembered
more of the content taught and had less anxiety about testing. Belcher (1984) found that
students who received test-taking strategies had a positive attitude about taking test. The
student surveys were coded for themes of recurring, dominant or emerging.
Analysis of Data
Focus Question One used qualitative data to establish themes that were recurring,
dominant or emerging. Students in the treatment group discussed each daily mini lesson
as to the effectiveness of the test-taking strategy taught. The discussions were instigated
to discover if the test-taking strategies would be something the students could use when
they took the EOCT. I took notes during student led discussions to see if all the students
learned the test-taking strategies that were taught.
Focus Question Two looked at quantitative data that was gathered from the EOCT
test results from the State of Georgia. An independent t test was used to compare the
experimental group’s scores with the control group scores. The null hypothesis
confirmed that the treatment group would not be able to outperform the control group on
the basis of the EOCT scores. Subjects were tested only once and the difference between
the two sample means (treatment and control groups) was used to test the hypothesis at a
95% level of confidence or a .05 level of significance. An effect size calculation was
Test-Taking Strategies 28
used to measure the magnitude of the treatment effect for small effect, medium effect or
large effect. An ANOVA Single Factor test was used to compare the females’ treatment
group to the females’ non treatment group and compare the males’ treatment group to the
males’ non treatment group.
Focus question three analyzed qualitative data from students’ surveys and the
teacher’s journal notes to look for common ideas and patterns as well as differences in
students’ responses. The responses were coded, organized and summarized so as to
bring meaning to the survey.
The aim of the whole study was to find out if teaching test-taking strategies
improved the test scores for students taking standardized tests. It was my belief that
students who received test-taking strategies would be better prepared to take the EOCT
test and score higher on their exam. In addition the strategies they learned would
continue to benefit them in their education.
Consensual validation was approved by LaGrange College and the principal of
South Cobb High School which Eisner (1991) stated as one approach that should be
incorporated into the study for validation. The epistemological validity, the second
validation proposed by Eisner (1991), compared the literature and research on teaching
high school students test-taking strategies to prepare them for standardized tests.
Structural corroboration consisted of multiple data sources that included students’
responses to the survey, teacher observation, test scores from the EOCT and journal
notes. To be fair, opposing points of view from a variety of literature reviews were
presented in the study. Eisner (1991) refers to presenting a tight argument as “rightness
of fit.” Great care was taken to present strong evidence that teaching test-taking
Test-Taking Strategies 29
strategies will improve test scores. Transferability through referential adequacy can be
replicated by others and easily used for future research in other content areas. Eisner
(1991) called this process referential adequacy, where perception and understanding by
others will increase because of this research. This study also comprised a degree of
catalytic validity, as reported by the students and teachers. To confirm content validity, a
comprehensive lesson plan was followed as thoroughly as possible, with two exceptions
when activities were removed due to time constraints. Popham (2008. P.53) defined
content validity as “the extent to which an assessment procedure adequately represents
the content of the curricular aim being measured.” The participants and the teacher
agreed that the research changed their opinions about test-taking strategies in a positive
way.
Test-Taking Strategies 30
CHAPTER FOUR: RESULTS
The results of the data collected addressed the three focus questions on teaching
test-taking strategies in this action research design for the US History class. An
Instructional Plan was prepared and was reviewed by two educators, using a rubric
developed by me. According to Teacher 1, the Instructional plan needed more detail on
how the test-taking strategies would be introduced to students. Both qualitative and
quantitative data were analyzed that included a student survey, End of Course Test
(EOCT) Scores, teacher journal and observational notes.
Focus Question One dealt with how to implement test-taking strategies into the
curriculum of a US History class. The class was a team-taught classroom with a special
education teacher and the content teacher, Teacher 2. The instructional plan that was
created included researched based test-taking strategies to assist students on standardized
test. The instructional plan called for embedding test-taking strategies within the
curriculum. The plan was fashioned to teach a series of twelve mini lessons over a nine
week time frame. Each lesson would include two to three test-taking strategies within a
ninety minute class period, of which five to ten minutes would be used. The students
would then be allowed to break into groups to discuss the test-taking strategies. The
instructional plan was critiqued by three colleagues; one was a principal, Administrator 1,
who had twenty-five years’ experience in education, one was a special education teacher,
Teacher 1, with twenty-seven years’ experience, and the content teacher, Teacher 2 with
fifteen years’ experience. Administrator 1’s suggestion was to add more interactive
technology activities that incorporated test-taking strategies. This suggestion was
included and the “I-Respond” program, which is an interactive educational tool, was used
Test-Taking Strategies 31
as a practice session that allowed students to respond to multiple choice questions with a
hand held remote. Teacher 2, created the test questions for the I-Respond which were
similar to the End of Course Test (EOCT) format for the US History test. Students
received immediate feedback on whether their answers were correct or incorrect. This
activity was done two times with the entire class. However for those students who
received special testing considerations no accommodations were allowed. Another
suggestion from Teacher 1 was to use flexible grouping after the test-taking strategies
activities were presented to allow for student discussion. This was done only two times,
as Teacher 2 felt that there was not enough time to allow students to break into groups.
However, discussions were held, both teacher and student led, during and after the testtaking strategies presentation. Administrator 1 suggested opening the lesson plan with a
short video clip. This was rejected due to time constraints, as expressed by Teacher 2 in
charge of teaching the US History class. Teacher 1 stated that the Instructional plan
wording was too brief and needed a more detailed explanation of how the researcher
would teach the test-taking strategies. This suggested was accepted and additional
information on how the test-taking strategies were to be taught was added.
Observational notes on students’ actions were taken when the test-taking
strategies were presented. The test-taking strategies were presented at the beginning of
class along with a warm-up activity. Students were to copy the warm-up activity down
first and then the test-taking strategies were presented. It was noted that many students
felt rushed to copy the warm-up notes down in order to transition to the presentation of
test-taking strategies. For students who were tardy, the pressure to copy the warm up
notes played precedence over listening to the mini lesson on test-taking strategies being
Test-Taking Strategies 32
presented at the time, as the students would be tested over the warm-up notes. Students
were expected to take at least one on line practice EOCT in US History found on the
Georgia Department of Education website. Although there was no way to check to see if
students did this, their word was accepted. Students were given the opportunity to come
before or after school to use the computer lab for the EOCT practice tests, but no one
came. The majority of students who attend South Cobb high school do not have
transportation and have no way of coming to the school early or staying late. Also, four
students stated that they did not have Internet services at home and would not be able to
access the practice test. It was recommended to try to find a friend or relative who did
have internet services so they could practice taking the test. The test-taking strategies
presented to the treatment group included explaining the purpose of the EOCT, how to
reduce test anxiety, reading and following test directions, vocabulary clues, several
strategies to assist with choosing the correct answers, reducing test anxiety, pacing and
time management, visualization activities to use, using positive self-talk, practicing
previous EOCT’s online, challenging and questioning your answers, and using prior
knowledge to draw on what you learned in class. There were no accommodations
implemented for the special needs students due to time limitations. Teacher 2 stated that
she felt that the class needed to move on to the content material that was relevant to US
History. Students also practiced filling out answer sheets and practiced filling in the
bubbles as well as making clean erasures.
Focus Question Two examined how the standardized test scores of the treatment
group, who were taught test-taking strategies, compared to the control group, who did not
receive any test-taking strategies. To establish if there was significant difference between
Test-Taking Strategies 33
the two groups, a one-tailed independent t-test was used to compare the treatment group’s
scores with the control group’s scores.
The null hypothesis was that there was no
difference in the treatment group EOCT test scores compared to the control group EOCT
scores.
Table 4.1 shows the results of the independent t-test between the Treatment group
and the Control group EOCT scores in US History.
Table 4.1 – Independent t-test
t-Test: Two-Sample Assuming Unequal Variances
Treatment
Mean
Variance
Observations
Hypothesized Mean Difference
df
t Stat
P(T<=t) one-tail
t Critical one-tail
P(T<=t) two-tail
t Critical two-tail
67.22222
139.7124
18
0
37
0.791434
0.216868
1.687094
0.433735
2.026192
Control
64
185.1
21
T(37) =.79, P > .05
According to Table 4.1, T (37) = 0.79, p > .05, therefore, since the obtained t-value fails to
exceed the corresponding critical value, the research is unable to reject the null. Thus,
there is no significant difference in the EOCT scores of the treatment group and the
control group. Effect Size was calculated using the means and standard deviation of each
of the groups and the Cohen’s d value was calculated at d=.00011, which falls within the
small range. The two groups tended to be similar.
To explore the EOCT test scores further, an ANOVA Single Factor Analysis of
Variances test was used to determine differences among the means of two sets of two
Test-Taking Strategies 34
groups. The four groups consisted of the following: The female treatment group, female
non-treatment group, male treatment group and the male non-treatment group. An
ANOVA Single Factor was used to test for variances between scores of the different
groups, which in this case were the differences between female treatment group with the
female no treatment group and the male treatment group with the male no treatment
group. The null hypothesis is there are no differences between the female treatment
group score compared to the female no treatment group score as well as no difference
between the male treatment group compared to the male no treatment group. The F value
is less than the F critical value which means that there was no significant difference on
the EOCT scores between the treatment and the non-treatment groups of either the female
group or two different male groups.
Table 4.2
ANOVA: Single Factor
SUMMARY
Groups
Count
8
10
10
11
Female Treatment
Female/No Treatment
Male/Treatment
Male/No Treatment
Sum Average
526
65.75
652
65.2
686
68.6
692 62.90909
Variance
146.2143
206.8444
146.4889
181.2909
Source of
Variation
Between Groups
Within Groups
SS
171.2832
6016.409
df
MS
F
P-value
F crit
3 57.09441 0.332142 0.802136 2.874187
35 171.8974
Total
6187.692
38
F (3,35) = .3321, p > .05
Test-Taking Strategies 35
From the ANOVA test results the research cannot reject the null hypothesis and the
differences did not appear to be large enough to be statistically significant.
The third focus question aimed to explore teacher and student attitudes on the
usefulness of teaching test-taking strategies in the classroom. Students in the treatment
group completed a survey after they finished the EOCT. Observational notes and the
researcher’s journal were used to document the teacher’s views and opinions of teaching
test-taking strategies. Teacher 2 stated that she saw a need for teaching test-taking
strategies but believed that there was not enough time to allow students to discuss or
practice skills taught. She also stated that it might prove more beneficial to teach testtaking strategies in an elective class as the amount of time needed to cover all the
information for the US History EOCT takes the whole semester with very little room to
include other activities. Teacher 2 responded negatively about the amount of information
required to be covered by the Georgia Performance Standards to prepare students for the
US History EOCT. Also several comments were made by teacher 2 that there was not
enough time to cover all the history information. These comments impacted the amount
of time spent teaching the test-taking strategies so much that many activities proposed in
the instructional plan were excluded on several occasions.
The student responses to the survey explained their attitude toward the test-taking
strategies and if they practiced them during the testing. For Survey Questions, the
following responses were recorded. Question 1 on the test-taking strategy survey asked
“Did I have a positive attitude about taking the test”, 66% responded yes and 33% said
no. Survey number 2, “I read the test directions carefully”, of which 94% checked yes
and 5% checked no. Survey statement 3, “If I was not sure of the answer I eliminated the
Test-Taking Strategies 36
answers I thought were incorrect”, of which 77% said yes and 22% said no. Survey
Question 4 asked, “Did you eat breakfast before the test”? 77% said yes and 22% said no.
For Question 5, students were asked, if “they noticed absolute words such as always and
never in responding to questions”, 66% said yes and 33% said no. Question 6 asked,
“did you use your time wisely, not spending too much time on any particular item and
pacing yourself?” of which 72% marked yes and 22% marked no. Students were asked if
they answered the questions they knew first on question 7 and 88% checked yes and 22%
checked no. On Question 8, the survey asked if the student did not know the answer to a
question, did they reread it to make sure they knew what the question was asking and if
they still did not know the answer, did they mark it and move on to come back to it later,
of which 61% said yes and 38% said no. Question 9 asked if the students were neat in
marking answers and making sure their erasers were completely erased of which 83%
checked yes and 16% check no. Question10 asked students if they did not know a word
did they try to figure out the root word or the meaning of the word by using context clues
and the responses were 55% for yes and 44% for no. The last question, number 11 asked
if when the students completed the last item, if time allowed did they review their
answers and check for mistakes by going over the hardest questions before they turned it
in and 66% said yes and 33% said no.
Overall the students responded favorably to the teaching of the test-taking
strategies. Some reoccurring themes developed during the nine weeks of teaching the
test-taking strategies. Students were not familiar with how to figure out the meaning of
words by using context clues and felt this would be beneficial when taking the test.
Students asked to spend more time going over strategies that would help with figuring out
Test-Taking Strategies 37
the meaning of unknown words. Students were more concerned about passing or failing
the EOCT and the impact the score would have on their grade average in US History.
Several students were surprised to learn that by eating a breakfast with protein
rather than one high in carbohydrates there was less chance in a drop in energy. Students
were worried that the teachers would get upset with them if they did not do well on the
test. Three students stated that their parents would be angry with them if they did not
pass the test. Teacher 1 thought that the students did not take the test-taking strategies
information seriously. Both teachers and administrator stated that they were concerned
about how well the students would perform on the EOCT. They stated that the students
test scores were a reflection on the teachers, administrators, the school and the
community. Teacher 2 remarked that when her students did not do well on the test she
took it personally and felt like she did not do her job effectively. She also stated that her
lessons are driven by the EOCT test and the standards that are connected to what she
should teach. Both the teachers and the administrator felt that teaching test-taking
strategies was important but it should be taught in all classes beginning in elementary
school. Both the administrator and teacher 2 expressed concerns that teaching testtaking strategies in the class took away from instruction time of relevant material.
Teacher 2 stated that some of the strategies were very broad and should have been more
content centered. Teacher 1, teacher 2 and I felt that the US History curriculum was very
intense and there was so much to cover that not only do the students feel pressure but the
teachers feel pressure and have to cover topics too quickly. Due to the fact that
standardized tests are used to assess the quality of schools, the administrators and
teachers feel pressure to participate in activities that are projected to increase student
Test-Taking Strategies 38
scores (Mehrens & Kaminski, 1989). Teacher 2 stated that it was hard to rationalize
taking class time to teach test-taking strategies. Teaching test-taking strategies seem to
take away time for learning and understanding and more like teaching to the test. Paris,
Lawton, Turner, and Roth (1991) suggested that the introduction of test-taking skills and
the narrowing of the curriculum were concerns of teaching to the test. Having students
practice released tests and review test items does little to develop an understanding of
concepts or to show relationships between concepts but the practice is suggested to
improved test-taking skills (Bowker & Irish, 2003).
Test-Taking Strategies 39
CHAPTER FIVE: ANALYSIS AND DISCUSSION OF RESULTS
Analysis
The objective of this study was to determine if teaching high school students testtaking strategies would improve test scores for the End of Course Test in US History.
Focus question one addressed how to implement the test-taking strategies into the US
History curriculum. The strategies were taught during the first part of the class period.
The Instruction Plan included over twenty test-taking strategies that were taught during a
nine week period. The strategies were presented in mini lessons that ranged from five to
ten minute segments. The study included two groups, the treatment group and the control
group. All the test-taking strategies used in the study were based on research. Students
were presented with two to three test-taking strategies weekly. The students were
allowed to discuss, comment and ask questions during and after each presentation.
Qualitative data was collected during and after each test-taking strategy lesson.
Observational notes as well as a teacher journal recorded students and teachers views,
opinions and responses about the test-taking strategies. Students were allowed to led
discussions and practice taking previous EOCT.
Focus question two asked how do the standardized test scores differ between the
US History class that received test-taking strategies instruction and the class that did not
receive test-taking strategies. The test scores for both the treatment group and the control
group were collected and recorded. All students were assign a number and the results of
the test scores were locked in a cabinet in my office. The scores were then transferred to
my personal computer, which is locked and can only be unlocked with my password.
An independent t-test established that when the treatment group, who received test-taking
strategies, and the control group, who did not received test-taking strategies, were tested
Test-Taking Strategies 40
for significance there was very little difference shown between the two groups. My
findings did not correlate with the majority of authors presented in this study. Clovis
(1999) stated that students needed to practice timed test throughout the entire year in
order to get into a routine. The students received test-taking strategies for nine weeks
during one semester in this particular study. In addition, an effect size calculation was
used to measure the magnitude of the treatment effect for small effect, medium effect or
large effect. This too revealed that the difference between the two groups test scores
were not significant and fell within the small range. To further investigate the groups’
scores, an ANOVA test was used to compare the females’ treatment group to the
females’ non-treatment group and the males’ treatment group to the males’ non-treatment
group. The null hypothesis was that there were no differences between the female
treatment groups scores compared to the female non- treatment group scores as well as no
differences between the male treatment group compared to the male non-treatment group.
The F value was less than the F critical value. From the ANOVA test, the research
results did not prove that teaching test-taking strategies improved test scores for the
treatment groups’ EOCT scores in US History compared to the non-treatment groups’
scores.
Focus question three addressed what the teachers’ and students’ attitudes were on
test-taking strategies in US History. Cohen (2006) reported that more-proficient learners
are capable of using the test taking strategies to assist them on standardized test. Due to
the fact that there were several special education students in the class who were identified
with reading problems, the EOCT scores may have been influenced by this. Kohn (2000)
believes that standardized test usually measures “superficial thinking” and all the time
Test-Taking Strategies 41
spent teaching test-taking strategies takes away from teaching students how to be skillful
thinkers. A similar comment to Kohn’s statement was made by teacher 2. As mentioned
previously in this study Carter et al (2005), stated that it may be too late to teach testtaking strategies to students who are in the 11th or 12th grade because they no longer care
how they do on tests. My study included students from the 10th and 11th grades.
Although it is not always possible to be precise with students, it is important to
understand and relate the personal opinions and actions of the subjects being studied.
The journal and observational notes focused on the everyday happenings. Overall the
teaching of the test-taking strategies proved to be beneficial for the majority of the
students. This was based on their comments, actions and the surveys. Students saw a
value in the teaching of test-taking strategies. Students who stated they had not been
taught test-taking strategies previously, remarked that they would try the strategies when
they took the EOCT. Several students indicated they were familiar with some of the
strategies such as answering the questions they knew first and not spending too much
time on any particular questions. The strategy about eating the right kind of breakfast
seemed to surprise the students the most. The whole class was receptive about sharing
their ideas and concerns during the discussion time. The majority of students were afraid
that they would not pass the test. They also expressed concerns that the content teacher
and their parents would be upset if they did not pass. The administrator and teacher 2
expressed the need for all the students to have passing scores as this reflected on the
school’s reputation. From my journal entries I recorded that most students found at least
ten to twelve strategies they said they would use. The majority of the students was
receptive to the test-taking strategies and expressed appreciation to me.
Test-Taking Strategies 42
Discussion
This study demonstrated that teaching students test-taking strategies before the
EOCT in US History did not prove significant enough to draw clear-cut conclusions
about whether the strategies made a significant difference in the test scores. Conversely,
my findings did not show a relationship with the majority of the authors cited in this
study. What this study proved was that nine weeks of teaching test-taking strategies may
not be enough to prepare students to score higher on the EOCT. I would suggest that
students receive test-taking strategies throughout the year, not only in one subject, but
each subject area that has an EOCT. It was clear from this study that teachers and
administrators should reflect a positive attitude about the teaching of test-taking
strategies. The students should be allowed to practice the different strategies in a
classroom setting. The content teacher, teacher 2, stated several times that she felt the
teaching of test-taking strategies interfered with teaching the content material. Students
also expressed the pressure to do well on the test so as to not disappoint their teacher or
their parents. It was also mentioned that the students test scores reflect upon the
reputation of the school. This causes undue pressure and anxiety on the students, who
commented that they experienced anxiety when they take tests. I feel that I presented the
test-taking strategies in a positive manner. The students appeared to be interested and
engaged in the lessons on test-taking strategies.
Triangulation of data incorporated both quantitative and qualitative data that
included information from the students EOCT test scores, observational notes, teacher’s
journal and students’ surveys. This provided credibility through the use of multiple data
sources. All through the study several steps were taken to warrant that the study
Test-Taking Strategies 43
remained credible. The research from the literature presented opposing views on the
influence of teaching test-taking strategies to high school students taking standardized
test. Validity and reliability were well-thought-out when defining the information
collection procedures for the three focus questions. Although the sample size for this
study was small, the information gathered was concrete. The results of the study were
not strong enough to prove that teaching test-taking strategies raised test scores and
would not affirm findings for a large population.
The action research I did can be replicated very easily into any content area or
elective class for high school students because it has referential adequacy. The major
themes uncovered and discovered were that students appreciated and saw the worth of
learning test-taking strategies. Students felt that the strategies they learned were
beneficial and would be used during the testing. The content teacher felt that
teaching test-taking strategies took time away from the teaching of the content.
Due to the large number of standardized test given during the high school years and the
importance placed on the results of these test, the majority of teachers would find the
teaching of test-taking strategies worthwhile and valuable for the students.
This study found that while teaching students test-taking strategies was viewed as
beneficial and helpful for the students, the results obtained from the t test did not prove
that the test-taking strategies had a direct influence on the test scores. The quantitative
results showed that the students who received the test-taking strategies did not fare better
than the students who did not received the test-taking strategies. The treatment group did
not have significantly higher scores than the non-treatment group; therefore it would be
difficult to state what the results would be for a larger population.
Test-Taking Strategies 44
The qualitative data collected proved to offer valuable information as to the
benefits for the students. Students expressed that they felt the strategies they received
would help them on the test. They were appreciative and stated they would use the
strategies on the EOCT and would use them for other test. However, the content teacher
expressed that she felt there was not enough time to do all the activities listed in the
instruction plan and the teaching of the strategies took up too much time. There were a
couple of times that I was asked to forego the activities that were planned for that day due
to time issues. The impact of the study was positive for the students as they stated they
would continue to use the strategies. I was most impressed by the fact
that the students expressed they really do care how they do on the standardized test. Too
often remarks are made by teachers that the students do not care, however from my
research the students stated quite the opposite. The teachers have to prepare them to get
ready for the test they are required to take. I see a need for students to learn test-taking
strategies throughout their education. Although the content teacher was more concerned
about time, she did comment that she saw a need for teaching students test-taking
strategies and felt it was important.
Impact on Student Learning
The teaching of test-taking strategies had a positive impact on the students’
attitudes about taking test. Students were engaged in the lessons, showed a direct
interest in the material and an appreciation to the teacher. Although the test scores did
not reflect the results I had hoped for, I learned the importance of listening to what the
students had to say and what they needed from the teachers. The test-taking lessons were
Test-Taking Strategies 45
structured so that the students were allowed to led the discussions and add their own
views and opinions. The students indicated they would use the strategies to help them
with their tests. The time spent with the students was invaluable in that the connections
made between me and the students were priceless. My primary responsibility has been to
assist students with special needs, however during this study, my role was to help all the
students. Comments made by the students included “I will psyche myself up for the
test”, “ I know I will do ok on the test”, “I hope I pass because I don’t want to take this
class again”, I will eat a good breakfast, not any sweets like candy or honeybuns”,
“Whenever I take test I never read the instructions, but I am going to try to read them for
the EOCT”, and “I am going to be more careful about erasing wrong answers”.
When presenting the lessons, I was the primary teacher. The students repeatedly
expressed their concerns about passing the test. After learning the test-taking strategies
the students felt they had some support going into the test and this in turn reduced their
anxiety. Because of this, I saw there was merit to my research.
Recommendation for Future Research
For future research, I would recommend that there has to be consensus among all
the teachers involved as to how to present the test-taking lessons and the amount of time
needed. In fact, it would be advantageous to have several teachers collaborate on the
instructional plan on how the test-taking strategies will be incorporated into the
curriculum. Also, I would suggest that the test-taking strategies be taught throughout the
year, beginning at the start of school until a few days before the test. I would propose
that the test-taking strategies be taught in several classes. Another suggestion would be
to have the students practice taking previous test at school instead of at home. It is
Test-Taking Strategies 46
equally important to make connections between the test-taking strategies and the content
material. I believe that more students should be included in the study to have a larger
sample size. The consensus among teachers at South Cobb is that the teaching of testtaking strategies is important, but finding the time to include them within the schedule is
problematic.
Lastly, I would recommend for future research that more teachers come
together to tailor a plan for each content area that the students are tested in and start the
school year with the test-taking strategies embedded in the curriculum. The more the
students practice the test-taking strategies the more proficient and confident they will
feel.
This study proved that the students made positive changes in how they will take
standardized test in the future. As for myself, I believe that the lessons that I presented
had value and the students acquired strategies that they will use in the future. I do believe
that test-taking strategies need to be taught in more classes, especially since students in
Georgia will now be taking additional EOCT in more subject areas. I enjoyed teaching
the students test-taking strategies and came away with a more encouraging outlook that
the students really do care how they do on tests and want to pass all their tests.
Test-Taking Strategies 47
References
Beck, M.D. & Stetz, F.P. (1980). Standardized testing viewed by test specialists and users.
Paper presented at the annual meeting of the National Council on Measurement in
Education, April 8-10, Boston, MA.
Belcher, M.J. (1984). Improving CLAST Scores through Attention to Test Taking Strategies
(Research Report No. 85-02). Miami, FL: Miami-Date Community College, Office of
Institutional Research.
Bowker, M., & Irish, B. (2003). Using test-taking skills to improve students’ standardized test
scores. Chicago, IL: Saint Xavier University & Skylight. (ERIC Document Reproduction
Service No. ED481116).
Brown, J., & Rolfe, S. (2004). Use of child development assessment in early childhood
education: Early childhood practitioner and student attitudes toward formal and informal
testing. Early Child Development and Care, 175 (3) 193-202.
Carter, E., Wehby, J., Hughes, C., Johnson, S., Plank, D. Barton-Arwood, S, and Lunsford, L.
(2005). Preparing Adolescents With High-Incidence Disabilities for High-Stakes Testing
With Strategy Instruction, 49 (2). Washington, DC. Heldref Publications.
Clovis, D.L. (1999). Take out your no. 2 pencils: Taking the stress out of standardized tests.
Scholastic Instructor, 108 (7), 27-28.
Cohen, A.D. (2006). The coming of age of research on test-taking strategies. Language
Quarterly, 3(4), 307-331.
Donnelly, A. M. (1999). Self-questioning: A comparative analysis of what teachers and
students report about the use of this reading comprehension strategy.
Unpublished Ed.D. diss., Widener University.
Test-Taking Strategies 48
Eisner, E. (1991). The enlightened eye. New York: MacMillan.
Green, K. E. (1992). Differences between pre-service and in-service teachers in opinions about
testing and test use. Journal of Educational Research, 86, 37-42.
Gulek, C. (2003). Preparing for high-stakes testing. Theory into Practice, 42 (1), 42-50.
Henricks, C. (2009). Improving schools through action research. Upper Saddle River:
New Jersey.
Johnson, G. (2004). Constructivist Remediation: Correction in Context. International Journal
of Special Education, 19 (1), 72-88.
Kher-Durlabhji, N., & Lacina-Gifford, L. J. (1992). Quest for test success: Preservice teachers’
views of “high stakes” tests. Paper presented at the Annual Meeting of the Mid-South
Educational Research Association, November 11-13, Knoxville, TN.
Kohn, A. (2000). Standardized testing and its victims. Education Week, September 27, 2000.
LaGrange College Education Department, (2009). Conceptual Framework. LaGrange, GA:
LaGrange College.
Mehrens, W.A., & Kaminski, J. (1989). Methods for improving standardized test scores:
Fruitful, fruitless, or fraudulent? Educational Measurement: Issues and Practice,
8(1), 14-22.
Nolan, S.B., Haladyna, T.M., & Haas, N. (1992). Uses and abuses of achievement test Scores.
Educational Measurement: Issues and Practice, Sm., 9-15.
Test-Taking Strategies 49
Norton, S.M., & Park, H.S. (1996). Relationships between test preparation and academic
performance on a statewide high school exit examination. Paper presented at the annual
meeting of the Mid-South Educational Research Association, November, Tuscaloosa,
AL.
Paris, S. G., Lawton, T. A., Turner, J. C., & Roth, J. L. (1991). A developmental perspective on
standardized achievement testing. Educational Researcher, 20(5), 12-20.
Popham, W. (2008). Classroom assessment: What teachers need to know (5th ed.). Boston:
Pearson, Allyn, & Bacon.
Ritter, S.A., & Idol-Maestas, L (1983). Teaching middle school students to use a test-taking
strategy. Journal of Educational Research, 79 (6), 350-357.
Rudman, H. C. (1989). Integrating testing with teaching. Practical Assessment, Research &
Evaluation, 1(6). Retrieved December 5, 2010 from http://PAREonline.net/getvn.asp?
v=1&n=6.
Scruggs, T. E., & Mastropieri, M. A. (2009). The inclusive classroom: Strategies for effective
instruction (4th ed.). Upper Saddle River, NJ: Prentice Hall.
Salkind, N. (2007). Statistics for people who think they hate statistics. Thousand Oaks, CA: Sage
Publications.
Wright, R.J. (2009). Methods for improving test scores: The good, the bad, and the ugly. Kappa
Delta Pi Record, 45 (3) 116-121.
Test-Taking Strategies 50
Appendix A
Instructional Plan
Essential Question: Does teaching test-taking strategies improve standardized test
scores?
Lesson Title: Teaching Test-Taking Strategies
Subject Area: US History
Grade Level: 10th and 11th grade students
Duration: Nine (ten to fifteen minutes) Mini Lessons
Lesson Description: Teacher integrates test-taking strategies mini lesson as part of the
daily warm-up lessons to help students develop skills that assist them when they take the
End of Course Test in US History.
Instructional Objectives
To introduce students to effective test-taking strategies, including educated
guessing, critical thinking, and problem solving skills
To provide students with resources to gain knowledge and skills to pass the End of
Course Test (EOCT), improve student performance and reduce exam anxiety.
I. Action Plan for teaching test taking strategies
A. Instruction Technology Used
1. Computer
a. Students take old End of Course Test (www.gadoe) for homework
B. Test-taking strategies mini lesson to be taught
1. Explain purpose of test
2. Reduce test anxiety strategies
3. Reading and following directions lesson
4. Test preparation strategies
5. Vocabulary clues and tricks
6. Choosing the correct answers
7. How to answer questions using key words
8. Pacing and time management
9. Visualization activities
10. Challenge your answers/questioning your answers
11. Teach motivation-to do well because of the end results
12. Practice taking old EOCT test
13. Use content domain-specific strategies to answer the questions
14. Focus your attention on the domain/domains you need to improve on
14. Use what you know-Draw on what you learned in class
Test-Taking Strategies 51
15.
16.
17.
18.
Use positive self-talk
Arrive on time
Eat a nutritious breakfast (Eat some food that has protein)
Dress appropriately-If you are too hot or too cold it can affect test
Performance
19. Take care of yourself-Get a good nights’ sleep, don’t alter your usual routine
20. Begin preparing yourself at the beginning of the semester, study a little each
day and pace yourself
21. Students know what skills and standards are measured then practice
understanding and using those standards/skills
C. Teacher Materials Needed
1. Previous EOCT test
2. Paper and pencils
3. Whiteboard
4. Student Survey
D. Accommodations for special needs
1. Pause periodically during an oral presentation to ask for questions and give
students a chance to add notes to their papers.
2. Summarize at the end of the lecture and encourage students to ask questions
about what they may have missed in their notes.
3. Review the notes from the previous lesson before beginning a new
presentation.
4. Assign the student with learning disabilities to a reliable work group
5. Provide graphic organizers. Allow students to highlight in notes or texts
6. Help students to understand that their notes should serve as a study guide. It is
important that they write down the key points, not every word in a lecture.
7. Teach students to use abbreviations for note taking. It may be helpful to post
abbreviations for specific subject matter vocabulary. Ask students to preview
the text pages pertinent to your next lecture the night before.
E. Standards aligned with curriculum
1. Students enhance reading in curriculum areas by
a. Reading notes taken in class
b. Participate in discussions related to curricular learning subject areas.
c. Discuss message and themes from content area (US History)
d. Build vocabulary knowledge
e. Demonstrate an understanding of contextual vocabulary
f. Explore understanding of new words found in subject area texts.
g. Explore life experiences related to subject area content.
h. Determine strategies for finding content and contextual meaning for
unknown words
II. Assessment
A. Students skills and knowledge in the select course assessed through
testing
1. Summative Assessment
Test-Taking Strategies 52
2. Learning Outcomes
B. Student skills and knowledge in the select course assessed through
1. Classroom group activities
2. Open discussion
C. Formative Assessments
1. Engaging students in instruction and learning process
2. Implementing question and answer sessions
3. Asking students to summarize ideas
4. Students fill out survey about the effectiveness of apply test-taking
strategies on standardized test
5. Practice test on former EOCT test
III. Test-taking strategies goals
A. Relevant to students
1. Increase test scores
2. Reduce test taking anxiety
3. Help students use time more efficiently
4. Increase motivation to do well on test
5. Build self confidence
6. Cooperative learning
7. Develop critical thinking skills
8. Link new information and skills to prior knowledge
Test-Taking Strategies 53
Appendix B
Instructional Plan Rubric
Rubric on
Teaching
Test-Taking
Strategies
Beginning
Developing
Accomplished
Exemplary
1
2
3
4
Instructional goals and
objectives are not
stated. Learners cannot
tell what is expected of
them. Learners cannot
determine what they
should know and be
able to do as a result of
learning and instruction.
Instructional goals and
objectives are stated but
are not easy to
understand. Learners
are given some
information regarding
what is expected of
them. Learners are not
given enough
information to
determine what they
should know and be
able to do as a result of
learning and instruction.
Instructional goals and
objectives are stated.
Learners have an
understanding of what
is expected of them.
Learners can determine
what they should know
and be able to do as a
result of learning and
instruction.
Instructional goals and
objectives clearly
stated. Learners have a
clear understanding of
what is expected of
them. Learners can
determine what they
should know and be
able to do as a result of
learning and instruction.
Instructional strategies Some instructional
are missing or strategies strategies are
used are inappropriate. appropriate for learning
Instructional
outcome(s). Some
Strategies
strategies are based on a
combination of
practical experience,
theory, research and
documented best
practice.
Most instructional
strategies are
appropriate for learning
outcome(s). Most
strategies are based on a
combination of practical
experience, theory,
research and
documented best
practice.
Instructional strategies
appropriate for learning
outcome(s). Strategy
based on a combination
of practical experience,
theory, research and
documented best
practice.
Method for assessing
student learning and
evaluating instruction is
Assessment missing.
Method for assessing
student learning and
evaluating instruction is
vaguely stated.
Assessment is teacher
dependent.
Method for assessing
student learning and
evaluating instruction is
present. Can be readily
used for expert, peer,
and/or self-evaluation.
Method for assessing
student learning and
evaluating instruction is
clearly delineated and
authentic. Can be
readily used for expert,
peer, and/or selfevaluation.
Selection and
application of
technologies is
Technology inappropriate (or
Used
nonexistent) for
learning environment
and outcomes.
Selection and
application of
technologies is
beginning to be
appropriate for learning
environment and
outcomes. Technologies
applied do not affect
learning.
Selection and
application of
technologies is basically
appropriate for learning
environment and
outcomes. Some
technologies applied
enhance learning.
Selection and
application of
technologies is
Use more technology based
appropriate for learning
activities.
environment and
outcomes. Technologies
applied to enhance
learning.
Material list is missing. Some materials
necessary for student
and teacher to complete
lesson are listed, but list
is incomplete.
Most materials
necessary for student
and teacher to complete
lesson are listed.
All materials necessary
for student and teacher
to complete lesson
clearly listed.
Lesson plan is
organized and neatly
presented.
Complete package
presented in well
organized and
professional fashion.
Instruction
Goals and
Objectives
Materials
Needed
Lesson plan is
Organization
unorganized and not
and
presented in a neat
Presentation
manner.
Lesson plan is
organized, but not
professionally
presented.
Score/Comments
Need to be clearer on student
goals.
Your Instruction Plan would be
hard for someone else to follow.
Need more details.
Introduce Unit plan with a
video.
Use more interactive
technology.
Use more flexible grouping
Allow students to review
observation notes made by
instructor.
Use more hands on activities to
teach the strategies
Test-Taking Strategies 54
Appendix C
Student Survey
STATEMENT
1. I had a positive attitude about
taking the test
YES
NO
YES
NO
3. If I was not sure of the answer
I eliminated the answers I
thought were incorrect
YES
NO
4.
I ate breakfast before the test
YES
NO
5.
I noticed absolute words such
as always and never in
responding to questions
YES
NO
I used my time wisely, not
spending too much time on any
particular item and pacing
myself
YES
NO
7.
I answered the questions I
knew first
YES
NO
8.
If I did not know the answer
to a question, I reread it to
make sure I knew what they
question was asking, if I still
did not know, I marked the
question and moved on to
come back later
YES
NO
YES
NO
10. If I did not know a word I
tried to figure out the root
word or the meaning of the
word by using context clues
YES
NO
11. When I completed the last
item, with time allowed, I
reviewed my answers, checked
for mistakes and went over the
hardest questions before I
turned it in.
YES
NO
2.
6.
9.
I read the test directions
carefully
I was neat in marking my
answers and making sure my
erasers were completely erased
Test-Taking Strategies 55
Download