Psychology 002-01 & 002-02

advertisement
Psych 002 – Methods Syllabus
1
Psychology 002-01, 002-02, 002-03
Research Methods & Statistics
Fall 2014
T/TH 11:00 – 12:15, WGR 206
VERSION: 8/26/2014
Dr. Rebecca M. Ryan
301G White Gravenor
rmr64@georgetown.edu
Office Hours: Tuesday/Thursday 9:00 – 10:00 am. Other times by appointment (please email).
Course website: Blackboard site.
GRADUATE TEACHING FELLOWS:
Elisabeth McClure (01) (em443@georgetown.edu) (recitation: 2:00-2:50pm F; STM G40)
Alaina Pearce (02) (ap1088@georgetown.edu) (recitation: 10:00-10:50pm F; STM G40)
Elise Cardinal (03) (emc62@georgetown.edu) (recitation: 11:00-11:50am F; Reiss 282)
Prerequisite: General Psychology 001 & Math 040 (or equivalent).
COURSE DESCRIPTION: This course offers an introduction to the logic of research design
and to descriptive and inferential statistics. We aim to help you learn the basic concepts of
research methods in psychology. By the end of this course you should be able to:
 think more clearly about what constitutes evidence for or against a conclusion
 read, understand, and critically evaluate research
 design basic research studies
 perform and interpret basic analyses using statistical software
 communicate research findings to other psychologists
These aims correspond to the departmental Learning Goals 2 (Epistemological Foundations), 3
(Application of Psychology), and 4 (Values in Psychology).
Course meetings consist of two weekly lectures and a required recitation section. Lectures will
cover major concepts in research design and statistics; you will apply these principles by
designing and conducting your own research project. Recitation section will focus on the
research project and on learning to use statistical software (e.g., SPSS), and will also cover
concepts from class through discussion and activities.
You are expected to attend all class meetings plus your assigned weekly recitation section. You
are responsible for all of the material discussed in class and recitation, and for all announcements
and handouts from both. This is important, because many days we will make a homework
assignment due in the next class. Also, because of the skill-learning nature of this course we will
sometimes change our schedule or reading assignment to adjust to our progress. We’ll put such
changes on Blackboard most of the time, but you need to monitor announcements in class and
recitation, just in case. Exam dates will be changed only for natural disasters, or the equivalent.
An attendance sheet will be circulated for your signature at recitation and at class meetings, and
attendance will count towards your final grade.
Psych 002 – Methods Syllabus
2
PLEASE ATTEND THE RECITATION SECTION YOU REGISTERED FOR. YOU
CANNOT SUBSTITUTE RECITATION SECTIONS.
REQUIRED TEXTS:
Graziano, A. M., & Raulin, M. L. (2013). Research methods: A process of inquiry (8th Ed).
Boston: Allyn & Bacon.
Nolan, S. A., & Heinzen, T. E. (2014). Essentials of statistics for the behavioral sciences (2nd
Edition). New York: Worth.
*Note, you may purchase either the online only (Statsportal) or text version of Nolan and
Heinzen. Both are available through the bookstore. The online only versions are less expensive.
COURSE REQUIREMENTS:
Exams (180 total points). There will be four exams, on the dates indicated on the class
schedule; the Final Exam (#4) will occur during finals. The first three will emphasize material
covered since the last exam, but questions concerning earlier material will be included as well.
Thus, the exams are cumulative because the material is. The final exam will test all material
covered during the course, so it is fully cumulative. Should it be necessary to cancel an exam due
to weather (e.g., official GU cancellation), the exam will be given in the immediately following
class. Check Blackboard and email in such circumstances. All exams are worth 60 points,
however, your lowest score of the first three will be dropped when calculating your final grade.
Note that exams will focus on skills/facts learned from class, Graziano and from the Williams
text. Not all of the design concepts covered in the Graziano text will be covered during lecture,
however, all of the concepts covered in Graziano could be covered on a test. Thus, if there is a
concept you do not understand in Graziano that falls within the assigned reading, please ask me
or your recitation TF to clarify the concept. Also note, most exam questions will not test your
definitional knowledge of design or statistical concepts or techniques. Rather, most exam
questions will assume your knowledge of concepts or techniques and require you to apply your
understanding to a novel circumstance. Do not simply memorize definitions or formulae.
Understand them.
Lecture-Based Quizzes (20 points). There will be very short (1-2 questions) quizzes after each
Thursday lecture (with some exceptions) testing you on concepts learned in class that week.
Each quiz will be worth very few points. The goal will be to highlight concepts you may not
have fully grasped during lecture to provide areas of study focus for upcoming exams.
Recitation-Based Assignments (20 points). You will receive a separate schedule for your
recitation sections with topics and details of assignments on it. There will be other supporting
documents on Blackboard.
Research Project (180 points). You must complete a research project in which you apply what
you have learned in this course to propose, design, conduct, analyze, and write up a study
addressing a question of your choice. A lot of your recitation section time will be devoted to
learning related to the project. We encourage you to work with one to two other students on the
project. Typically this enables you to test more subjects, and you will have colleagues with
whom you can design your study and think about what your results mean. If you do work with
Psych 002 – Methods Syllabus
3
one or two other people, each member of the group must nonetheless turn in a separate proposal,
introduction and methods, results, and discussion. Thus, each member will receive independent
grades on each part. Although members of the same group will be describing the same research
question, procedure, and results, each must work independently to demonstrate their
understanding and application of research methods and statistics.
The research project is the major assignment in the course and one to be worked on all
semester. Begin immediately to think of possible topics/questions. You should be asking
yourself after every lecture and every reading assignment, “How does this material affect my
approach to the research problem I have chosen?” You should be applying everything you learn
in this course to preparing the project. Also you should begin searching for previously published
research on your topic to help you design your own very early in the semester.
Proposal (45 points). Two of your peers, your TF, and I will read this proposal, and a
group of your peers will advise me as to whether or not the proposed study is ethical and
methodologically sound. So provide as much detail as possible in the space available. To begin,
pick two starting papers on your chosen topic, at least one of which that has been published
within the past 5 years. These papers must be empirical articles, not review papers or chapters.
Your research proposal should propose an original experiment that extends or challenges the
prior studies. It should be written in the future tense because it is describing an experiment that
has yet to be run. Photocopy your starting papers and attach them to your submission.
Keep your “paper trail” (i.e. all your photocopies articles and notes) until your research proposal
is returned.
The page limit for the proposal (not including the reference section or cover page) is 7
double-spaced type-written pages using 12 point font and at least 1 inch margins on all
sides. I will not read any text beyond the 7 pages. This will mean that you will have to be
very concise and precise. Organization and clarity do matter for the proposal and both drafts.
Always number pages and proofread.
The proposal should include the following sections with the following labels. You should write
in full sentences and paragraphs; this is not an outline.
-
Cover page (not counted in page limit) - Title. Here you state the tentative title of
your project and your name as author. (Title should be the same for all team
members).
-
Objective. This contains approximately 2 - 4 sentences explaining the purpose of
your study, what you are going to do, and why.
-
Introduction. Write an introduction (approx. 2 pages) in which you review the
general topic area, summarize relevant literature, culminating in a critical evaluation
of one particular issue that could be addressed empirically. Cite and discuss your
starting papers and other relevant papers that you have found during your literature
search. You must cite at least 10 articles, including the 2 starting papers. At least 7 of
these must be original empirical articles, while 3 may be review articles or chapters or
citations for measures. Clarify what gap in the literature your study would fill and
Psych 002 – Methods Syllabus
4
why that gap is important to fill. Your literature review should also establish the
historical context of previous work, and your proposed study, and the theories upon
which prior work has drawn.
-
Hypothesis. State your hypothesis. Your hypothesis should follow logically from a
theoretical framework and empirical support provided in your literature review. It
should provide a hypothetical answer to the question you posed at the end of your
review (and in your objective) grounded in theory and prior research.
-
Proposed Method. This method section should include separate participants,
apparatus, design, and procedure sections (approx. 3 pages). Participants should
include proposed subject recruitment, and apparatus should include description of
materials your experiment will use, including any questionnaires or surveys. The
design should specify dependent and independent variables you will be using and the
number of factors and levels (in design notation), if applicable. It should also outline
methods of control that you will be using and why (i.e. what sorts of confounds will
you be guarding against?). Also state variables that you will not be controlling.
-
Proposed data analysis. (approx. 1 page) This section should state what aspects of
your data you think will be important, and what you expect to find (i.e. what you
predict). For example, you might state how you will condense your data, and what
cells will be compared to each other. You should also outline the statistical analyses
you plan to use (e.g., ANOVA, Chi-square, t-test) given the measurement of your
dependent and independent variables and the hypotheses you aim to test. However,
you will submit a more detailed data analysis plan later in the semester.
-
Ethical Considerations. (1/2 page) This section should describe what you will do to
ensure fairness to participants and what remaining concerns you have, if any, about
the ethics of the study. You should include your informed consent procedure (and
documentation) as an appendix to the proposal.
-
References (start on a new page – these pages are not counted in page limit).
This contains a list of the articles you have cited in your paper. Again, you must cite
at least 10 articles. Use APA style.
Please turn in a total of 3 copies of your completed proposal. One of the copies should have the
title and your name on the cover page. The two remaining copies should have only the title,
without your name, to make the anonymous peer review process possible.
Peer review (20 points). After proposals are due, we will give you two proposals on
which you are to serve as the primary and secondary reviewer. You will write a brief critique of
both proposals you have been assigned, putting each review on a separate piece of paper.
Your critique of each proposal should list the title and “author number” of the proposal you are
reviewing, and your own peer review number (labeled “reviewer number”). Please turn in two
copies of each review, one with your name written next to your reviewer number. This copy will
come to me for grading and the anonymous one will go to the author of the proposal in question.
Psych 002 – Methods Syllabus
5
Your review should comment constructively on aspects of the design of the study
and outline in a few sentences the features of the study that are relevant for deciding on
soundness of design and fairness to participants. You should indicate whether you think
the study is ethical and why or why not. If you think it isn’t ethical, try to suggest alternatives
or ways of fixing it. Write this review so that it is sufficient to explain the study to the review
group (most of whom won’t have read it) and so that they will be informed enough to vote on
whether or not the study is methodologically sound and acceptable ethically. For the proposal on
which you are the primary reviewer, your written comments will serve as notes for your
presentation to the group.
On Peer Review day, the primary reviewer will provide the summary described in the
previous paragraph, the secondary reviewer will agree or disagree with specific points, and the
group will discuss and then vote on whether the study is acceptable. The outcome of this vote
should be recorded on the review and that will go to author (the one without the reviewer’s
name). The above procedure of the peer group review discussion is based on that used in the
NIH “study sections”, the peer review groups who review the scientific merit of grant proposals
submitted to the NIH for funding.
Components of Final Paper for Research Project:
Introduction/Methods (40 points). This should follow the format outlined in your APA
style writing guide (see Research Project Links in the external links page of Blackboard) and the
“Ingredients of an Introduction” handout. The page limit for the text is 6 double-spaced typewritten (not including the references or appendices). You should include an Appendix containing
a copy of any questionnaire or instructions you gave your participants or stimuli that you will
present. Remember though that the paper itself should contain enough information that the
reader would not need to have the Appendix to understand your study.
Data Analysis Plan (10 points). (1 page) This assignment helps insure that you have a
sound plan for analyzing the data you’ve been collecting. You should detail step by step how you
will describe your data and how you will test your hypotheses statistically. Begin with
descriptive statistics. List the measures of central tendency, shape, and spread you will report in
describing your dependent variable(s). List any other important descriptive statistics you will
report about your sample (e.g., % male/female; mean age). Next, clarify how you will test your
hypotheses statistically, which inferential method you will use (e.g., ANOVA, independent
samples t-test, chi-square) and exactly how you will run that test (which groups you will
compare on which dependent variables, etc.). Provide a clear rationale for your choices. To
insure that you know how to conduct these analyses in SPSS, write the syntax you will use to run
the analyses. Include notes before each command explaining what the command will tell you/do.
You should append the SPSS syntax to the data analysis plan.
Final Results plus Discussion (45 points). (5 pages) As you can see, the project is
structured as a series of assignments in which each section of the final paper are graded and
receive feedback. Just as your Introduction and Method benefit from revisions you make as a
result of feedback on your proposal, and from what you have learned subsequently in the course,
Psych 002 – Methods Syllabus
6
your final Results should incorporate feedback from your draft Results (not a graded assignment,
but part of your recitation grade for participation). Your Discussion will provide the “take home
message” of your study. In it, you should summarize your results, state whether they support
your hypotheses, and interpret why or why not. Qualify the limitations of your study and provide
any alternative explanations for your findings.
Poster presentation (20 points). You will share the final outcome of your research
project with your class as well as members of the Psychology Department by displaying your
results in the form of a “poster”. These posters will be displayed on walls of the hallway on the
3rd floor of WGR. This is a common method of presenting research at academic conferences. A
separate handout with details and directions for the entire project will be provided early in the
semester.
**Please note that the penalty for late submission of components of the project is one step
deducted (e.g., B+ to B) if you turn it in one day late, one letter grade (e.g., B+ to C+) deducted
if you turn it in between two and four days late, and an additional letter grade deducted for each
additional week thereafter.
Your Course Grade. Your course grade will depend equally on lecture assessments (exams and
lecture homework) and on assignments related to the final project. The details are as follows:
Lecture Assessments (50% of total)
Best 2 of first 3 exams: 15% (60 pts) each
Final exam (during finals): 15% (60 pts)
Lecture-based quizzes: 5% (20 pts)
Project/Recitation Assessments (50% of total):
Homework/Attendance/Participation: 5% (20 pts)
Proposal (7 pp): 11.25% (45 pts)
Peer Review (2 pp): 5% (20 pts)
Introduction/Method (6 pp): 10% (40 pts)
Data Analysis plan (1 p (+ SPSS syntax)): (10 pts)
Results + Disc (5 pp): 11.25% (45 pts)
Poster Session: 5% (20 pts)
The final grade will be computed as follows: (Total points/400)*100
The following grade scale will be used:
A course letter grade will be assigned as follows. If your average falls between categories, the
lower grade will be awarded, though I will take class participation and attendance into account
for borderline cases. A 93-100%; A- 90-92; B+ 87-89; B 83-86; B-80-82; C+ 77-79; C 73-76;
C- 70-72; D+67-69; D 60-66; F <60.
Psych 002 – Methods Syllabus
7
Research Methods & Statistics Class Schedule – Fall 2014
DATE
Aug
28 TH
Research Design
Sept
2 T
4 TH
9 T
CLASS TOPIC
Introduction and organization
READING
GR Ch. 1
Research Process and Types of studies
Variables (types, measurement, reliability)
Limits: Internal and External validity
GR Ch. 2
GR Ch. 3, 4
GR Ch. 7, 8
11 TH Limits: Internal and External validity
16 T
Study design: Between and Within subjects
18 TH Factorial Design
23 T
Main effects and interactions
25 TH Main effects and interactions
30 T
Ethics in research
Oct
2 TH EXAM #1 (covering up to Ethics)
Descriptive Statistics
7 T
Distributions, central tendency and variability
9 TH Normal Distributions, z-scores
14 T
IN CLASS PEER REVIEW
16 TH Hypothesis testing: z-test, p-values
Inferential Statistics
21 T
Confidence intervals and power
Nov
Dec
23 TH One sample t-test
28 T
One sample t-test
30 TH T-test for two samples
EXAM #2 (covering Distributions to one
4 T
sample T-test)
6 TH T-test for two samples
11 T
ANOVA (f-test)
13 TH ANOVA (f-test)
18 T
ANOVA/ Interactions and main effects
21
25
27
2
4
13
TH
T
TH
T
TH
SA
ANOVA/ Interactions and main effects
The chi-square
THANKSGIVING BREAK
EXAM #3 (covering up to Nov 21)
POSTER SESSION (WGR 3rd Floor)
FINAL EXAM (4-6pm)
GR Ch. 9
GR Ch. 10, 11
GR Ch. 12
ASSIGNMENTS
Question Due in Recitation
Revised Ques + Articles in
Recitation
Annotated Bibliography
Due in Recitation
Annotated Outline Due in
Recitation
NH 1, 2, 4
NH 6
PROPOSAL DUE in
Lecture
NH 7
NH 8
NH 9, pp.197-210
Online NIH course due on
19th in recitation
NH 9, pp.210-219
INTRO & METHODS DUE
NH 10
NH 11
NH 12
DRAFT DATA ANALYSIS
PLAN due in recitation
NH 15
RESULTS & DISC DUE
Psych 002 – Methods Syllabus
8
GENERAL COMMENTS
Knowledge versus Understanding. Be aware of the difference between knowledge and
understanding, and the difference between understanding and wisdom. These are all different,
but they are related. You must demonstrate knowledge and understanding to receive full credit.
Responsibility. You are responsible for your work in this class. This includes arriving
sufficiently early to be seated and ready for class, peer review day, exams as well as turning in
homework on time. Responsibility also means dealing with the consequences of your actions or
misfortunes (including those related to your research project – research can be messy and
frustrating!). In my class, I don’t give grades, you earn them.
Many of you will ask yourself at some point during the semester why we are covering some of
the material you already covered in Math 040. I direct you first to the distinction between
knowledge and understanding above. Math 040 provided basic knowledge of (some of the)
statistical concepts we will use in this class. Here, your knowledge will deepen to the level of
understanding, you will learn about more advanced statistics (e.g., ANOVA), and you will learn
to APPLY that understanding to psychological research. That is a central aim of this class.
For those unconvinced by the argument above, PLEASE READ THE FOLLOWING
ARTICLE, which has been annotated for context:
Arthur Michelson: The precision of math, like poetry, gets to heart of things
Arthur Michelson, who teaches at Beechwood School in Menlo Park, Calif., wrote this article for
the Los Angeles Times.
December 30, 2004 MICHELSON1230
American middle school {college students} don't much care that they're worse at math than their
counterparts in Hong Kong and Finland. "I don't need it," my students say. "I'm gonna be a
basketball star." Or a beautician, or a car mechanic, or a singer {or work on Wall Street}.
It's also hard to get much of a rise out of adults over the fact, released earlier this year, that the
United States ranked 28th out of 41 countries whose middle school students' math skills were
tested by the Organization for Economic Cooperation and Development. So what if we're tied
with Latvia, while nations such as Japan and South Korea leave us in the dust? After all, when
was the last time you used algebra?
But math is not just about computing quadratic equations, knowing geometric proofs or
balancing a checkbook. And it's not just about training Americans to become scientists.
It has implicit value. It is about discipline, precision, thoroughness and meticulous analysis.
It helps you see patterns, develops your logic skills, teaches you to concentrate and to
separate truth from falsehood. These are abilities and qualities that distinguish successful
people.
Psych 002 – Methods Syllabus
9
Math helps you make wise financial decisions, but also informs you so you can avoid false
claims from advertisers, politicians and others. It helps you determine risk. Some examples:
• If a fair coin is tossed and eight heads come up in a row, most adults would gamble that the
next toss would come up tails. But a coin has no memory. There is always a 50-50 chance. See
you at the casino?
• If you have no sense of big numbers, you can't evaluate the consequences of how government
spends your money. Why should we worry? Let our kids deal with it. ...
• Enormous amounts of money are spent on quack medicine. Many people will reject sound
scientific studies on drugs or nutrition if the results don't fit their preconceived notions, yet they
might leap to action after reading news stories on the results of small, inconclusive or poorly run
studies.
• After an airplane crash, studies show that people are more likely to drive than take a plane in
spite of the fact that they are much more likely to be killed or injured while driving. Planes are
not like copycat criminals. A plane is not more likely to crash just because another recently did.
In fact, the most dangerous time to drive is probably right after a plane crash because so many
more people are on the road.
The precision of math, like poetry, gets to the heart of things. It can increase our awareness.
Consider the Fibonacci series, in which each number is the sum of the preceding two, (0, 1, 1, 2,
3, 5, 8, 13 ...). Comparing each successive pair yields a relationship known as the Golden Ratio,
which often shows up in nature and art. It's the mathematical underpinning of what we consider
beautiful. You'll find it in the design of the Parthenon and the Mona Lisa, as well as in human
proportion; for instance, in the size of the hand compared with the forearm and the forearm to the
entire arm. Stephen Hawking's editor warned him that for every mathematical formula he wrote
in a book, he would lose much of his audience. Yet more than a little is lost by dumbing things
down.
It is not possible to really understand science and the scientific method without understanding
math. A rainbow is even more beautiful and amazing when we understand it. So is a lightning
bolt, an ant or ourselves.
Math gives us a powerful tool to understand our universe. I don't wish to overstate: Poetry,
music, literature and the fine and performing arts are also gateways to beauty. Nothing we study
is a waste. But the precision of math helps refine how we think in a very special way.
How do we revitalize the learning of math? I don't have the big answer. I teach middle school
{college} and try to find an answer one child {student} at a time. When I can get one to say,
"Wow, that's tight," I feel the joy of a small victory.
Download