Reseach Paper Notes

advertisement
Non-Experimental & Experimental Research
Alright! It's time to learn something using research by … performing a non-experimental study?
Wait, wait, wait! Is it possible to have a non-experimental study? Is that sort of like sugar free candy? Is it something
that you're supposed to have that is replaced by something that makes you scratch your head? Before we discuss
research designs, though, you need a brief walkthrough of some of the terms I am going to throw at you.
A predictor variable is the portion of the experiment that is being manipulated to see if it has an effect on the
dependent variable. For example, do people eat more Gouda or cheddar cheese? The predictor variable in this is
the type of cheese. Now, every time you eat cheese, you'll think about predictor variables. When I say subjects, I
just mean the people in the experiment or the people being studied.
Experimental research is when a researcher is able to manipulate the predictor variable and subjects to identify a
cause-and-effect relationship. This typically requires the research to be conducted in a lab, with one group being
placed in an experimental group, or the ones being manipulated, while the other is placed in a placebo group, or
inert condition or non-manipulated group. A laboratory-based experiment gives a high level of control and reliability.
Non-experimental research is the label given to a study when a researcher cannot control, manipulate or alter the
predictor variable or subjects, but instead, relies on interpretation, observation or interactions to come to a
conclusion. Typically, this means the non-experimental researcher must rely on correlations, surveys or case
studies, and cannot demonstrate a true cause-and-effect relationship. Non-experimental research tends to have a
high level of external validity, meaning it can be generalized to a larger population.
Differences
So, now that we have the basics of what they are, we can see some of the differences between them. Obviously,
the first thing is the very basis of what they are looking at: their methodology. Experimental researchers are capable
of performing experiments on people and manipulating the predictor variables. Non-experimental researchers are
forced to observe and interpret what they are looking at. Being able to manipulate and control something leads to
the next big difference.
The ability to find a cause-and-effect relationship is kind of a big deal in the world of science! Being able to
say X causes Y is something that has a lot of power. While non-experimental research can come close, nonexperimental researchers cannot say with absolute certainty that X leads to Y. This is because there may be
something it did not observe, and it must rely on less direct ways to measure.
For example, let's say we're curious about how violent men and women are. We cannot have a true experimental
study because our predictor variable for violence is gender. To have a true experimental study we would need to be
able to manipulate the predictor variable. If we had a way to switch men into women and women into men, back and
forth, so that we could see which gender is more violent, then we could run a true experimental study. But, we can't
do that. So, our little experiment becomes a non-experimental study because we cannot manipulate our predictor
variable.
Nonexperimental research is research that lacks the manipulation of an independent variable,
random assignment of participants to conditions or orders of conditions, or both.
In a sense, it is unfair to define this large and diverse set of approaches collectively by what they
are not. But doing so reflects the fact that most researchers in psychology consider the distinction
between experimental and nonexperimental research to be an extremely important one. This
distinction is because although experimental research can provide strong evidence that changes in an
independent variable cause differences in a dependent variable, nonexperimental research generally
cannot. As we will see, however, this inability does not mean that nonexperimental research is less
important than experimental research or inferior to it in any general sense.




The research question or hypothesis can be about a single variable rather than a statistical
relationship between two variables (e.g., How accurate are people’s first impressions?).
The research question can be about a noncausal statistical relationship between variables (e.g.,
Is there a correlation between verbal intelligence and mathematical intelligence?).
The research question can be about a causal relationship, but the independent variable cannot
be manipulated or participants cannot be randomly assigned to conditions or orders of
conditions (e.g., Does damage to a person’s hippocampus impair the formation of long-term
memory traces?).
The research question can be broad and exploratory, or it can be about what it is like to have a
particular experience (e.g., What is it like to be a working mother diagnosed with depression?).
Types of Nonexperimental Research
Nonexperimental research falls into three broad categories: single-variable research, correlational
and quasi-experimental research, and qualitative research. First, research can be nonexperimental
because it focuses on a single variable rather than a statistical relationship between two variables.
Although there is no widely shared term for this kind of research, we will call it singlevariable research. Milgram’s original obedience study was nonexperimental in this way. He was
primarily interested in one variable—the extent to which participants obeyed the researcher when he
told them to shock the confederate—and he observed all participants performing the same task under
the same conditions. The study by Loftus and Pickrell described at the beginning of this chapter is
also a good example of single-variable research. The variable was whether participants “remembered”
having experienced mildly traumatic childhood events (e.g., getting lost in a shopping mall) that they
had not actually experienced but that the research asked them about repeatedly. In this particular
study, nearly a third of the participants “remembered” at least one event. (As with Milgram’s original
study, this study inspired several later experiments on the factors that affect false memories.)
As these examples make clear, single-variable research can answer interesting and important
questions. What it cannot do, however, is answer questions about statistical relationships between
variables. This detail is a point that beginning researchers sometimes miss. Imagine, for example, a
group of research methods students interested in the relationship between children’s being the victim
of bullying and the children’s self-esteem. The first thing that is likely to occur to these researchers is
to obtain a sample of middle-school students who have been bullied and then to measure their selfesteem. But this design would be a single-variable study with self-esteem as the only variable.
Although it would tell the researchers something about the self-esteem of children who have been
bullied, it would not tell them what they really want to know, which is how the self-esteem of children
who have been bullied compares with the self-esteem of children who have not. Is it lower? Is it the
same? Could it even be higher? To answer this question, their sample would also have to include
middle-school students who have not been bullied thereby introducing another variable.
Research can also be nonexperimental because it focuses on a statistical relationship between two
variables but does not include the manipulation of an independent variable, random assignment of
participants to conditions or orders of conditions, or both. This kind of research takes two basic
forms: correlational research and quasi-experimental research. In correlational research, the
researcher measures the two variables of interest with little or no attempt to control extraneous
variables and then assesses the relationship between them. A research methods student who finds out
whether each of several middle-school students has been bullied and then measures each student’s
self-esteem is conducting correlational research. In quasi-experimental research, the researcher
manipulates an independent variable but does not randomly assign participants to conditions or
orders of conditions. For example, a researcher might start an antibullying program (a kind of
treatment) at one school and compare the incidence of bullying at that school with the incidence at a
similar school that has no antibullying program.
The final way in which research can be nonexperimental is that it can be qualitative. The types of
research we have discussed so far are all quantitative, referring to the fact that the data consist of
numbers that are analyzed using statistical techniques. In qualitative research, the data are usually
nonnumerical and therefore cannot be analyzed using statistical techniques. Rosenhan’s study of the
experience of people in a psychiatric ward was primarily qualitative. The data were the notes taken by
the “pseudopatients”—the people pretending to have heard voices—along with their hospital records.
Rosenhan’s analysis consists mainly of a written description of the experiences of the pseudopatients,
supported by several concrete examples. To illustrate the hospital staff’s tendency to “depersonalize”
their patients, he noted, “Upon being admitted, I and other pseudopatients took the initial physical
examinations in a semipublic room, where staff members went about their own business as if we were
not there” (Rosenhan, 1973, p. 256)[3]. Qualitative data has a separate set of analysis tools depending
on the research question. For example, thematic analysis would focus on themes that emerge in the
data or conversation analysis would focus on the way the words were said in an interview or focus
group.
characteristics
As previously mentioned, the first characteristic of this type of research is that there is no manipulation of the variables
studied.
Normally, these are phenomena that have already occurred and are analyzed a posteriori. Apart from this characteristic,
other peculiarities present in these designs can be pointed out:
- Non-experimental research is widely used when, for ethical reasons (such as giving drink to young people), there is no
option to conduct controlled experiments.
- No groups are formed to study them, but these are already pre-existing in their natural environments.
-The data is collected directly, and then analyzed and interpreted. There is no direct intervention on the phenomenon.
- It is very common that non-experimental designs are used in applied research, since they study the facts as they occur
naturally.
- Given the characteristics presented, this type of research is not valid to establish unequivocal causal relationships.
Types
Transverse or transectional design
This type of non-experimental research design is used to observe and record the data at a specific time and, by its very
nature, unique. In this way, the analysis is focused on the effects of a phenomenon that occurs at a particular time.
As an example, we can mention the study of the consequences of an earthquake on the housing in a city or the school
failure rates in a given year. You can also take more than one variable, turning the study into a more complex one.
The transversal design allows to cover diverse groups of individuals, objects or phenomena. At the time of developing
them, they can be divided into two different groups:
Descriptive
The objective is to investigate those incidents and their values, in which one or more variables appear. Once the data is
obtained, a description of them is simply made.
Causes
In these designs, we try to establish the relationships between several variables that have occurred at a given moment.
These variables are not described one by one, but rather they try to explain how they are related.
Longitudinal design
Contrary to what happens with the previous design, in the longitudinal the researchers intend to analyze the changes
suffered by certain variables over time. You can also investigate how the relationships between these variables evolve
during this period.
To achieve this goal it is necessary to collect data at different time points. There are three types within this design:
Trend
They study the changes that happen in some population in general.
Of group evolution
The subjects studied are smaller groups or subgroups.
Panel
Similar to the previous ones but with specific groups that are measured at all times. These investigations are useful to
analyze the individual changes together with the group, allowing to know what element has produced the changes in
question.
Examples
In general terms, these designs are prepared for the study of events that have already happened and, therefore, it is
impossible to control the variables. They are very frequent in statistical fields of all kinds, both to measure the incidence of
some factors and for opinion studies.
Download