thesis-survival-guide - The University of Auckland

Survival Guide
1
Writing your Thesis: A Survival Guide
Dr. Suzanne Barker-Collo
© Suzanne Barker-Collo, June 2000. Barbara Tabachnick & Linda Fidell are gratefully acknowledged
for allowing inclusion of their work. This guide may be reproduced for non-commercial purposes. All
rights reserved.
Survival Guide
2
Forward or Forewarning
First, let me say that this document is NOT meant to represent any sort of official
policy or procedure for either The University of Auckland in general, or Department
of Psychology at U of A in specific. The opinions contained in the document are my
own and, therefore, may contradict those of others within the department. It is likely
that some (if not all) of the ideas contained in this document will conflict with those
of other supervisors. In such cases, it is always best to follow the direction of your
particular supervisor. Remember- this is a general guide, while your supervisor is an
expert in the particular area of research in which you have become involved. In
addition, as the title implies, this is meant only as a guide, not a comprehensive work.
More comprehensive assistance can be obtained using the American Psychological
Association’s Publication Manual.
I decided to write this manuscript for a number of reasons. First, as a student I was
required to write three theses. I received good feedback, good direction from my
supervisors, and as a result had positive experiences with all three. Unfortunately,
many of my peers had decidedly negative experiences in conducting thesis research,
and tended to ask “What would your supervisor say if”. I thought that other students
might also benefit from my own positive experiences. The aim of this document is to
help students by answering some questions, providing a little bit of guidance, and to
basically help them to get through the thesis experience. Second, I have clear ideas on
what I expect in my own research papers, and in those of students I supervise. To
avoid repeating myself, I thought a written guide could be used to summarize my
thoughts more efficiently.
Survival Guide
3
General Introduction
Your reaction to writing a thesis will largely be determined by the reason you chose to
take a thesis option. Some of the common reasons for doing a thesis are:
It is required to get a particular degree.
To improve your chances of getting into a higher degree program.
To gain experience in research.
Because you actually like research.
As you might expect, students usually have one of two reactions to having to write a
thesis:
(a)
Anticipation/fear at the possibility to do some hands-on research in
an area they are interested; or
(b)
Feeling overwhelmed/scared at the possibility of having to write a
rather large paper, whose grade will reflect a whole year (or two) of
work.
(You will note that fear/being scared is common to both reactions- being
anxious/fearful is normal, and is only a problem if it stops you from getting the thing
finished!)
The majority of students, particularly those who have never written a thesis before,
react to the thesis with terror, panic, and fear. Regardless of your initial reaction, it is
possible to have a positive experience. Writing a thesis can allow you to work closely
with a staff member whose research you are interested in, contribute to an area of
study in which you are interested, learn about how research is actually done, and do so
with one-to-one assistance and guidance.
While the goal of this document is to answer general questions, and increase your
enthusiasm and positive feelings about doing a thesis (rather than expecting to
undergo emotional pain and suffering), there are some realistic goals about the writing
of a thesis that you should keep in mind:
First, it is important to remember that, as with everything else at University, every
thesis has a deadline. In organizing and planning your research project, one of your
goals should be to establish written timelines that allow you to completing the thesis
on time. Your supervisor may be able to assist you in helping to determine how long
things usually take.
Second, completing a thesis can be beneficial in many ways. Not only is it a
requirement for graduation, it can lead to publishing the results in a journal
(Translation: great for your CV!), provides an indication that you know how to
conduct research (Translation: great for the CV!), may in some instances allow you to
earn a small income from research grants (No translation required), and finally will
often allow you to meet and work with professionals in the community (Translation:
great networking tool).
Survival Guide
4
Finally, though this may sound a bit negative and sarcastic, when doing research there
are a few general caveats that typically apply:
1)
2)
3)
4)
The sooner you start the sooner you’ll get finished.
Whatever can go wrong will go wrong – Murphy’s Law
Keep it simple, stupid - KISS
Revise, Revise, Revise - anonymous
What is a thesis?
A thesis is basically a long version of a journal article. Pick out a journal article that
describes a research project on a topic you are interested in. You will notice that it
includes an abstract, introduction, methods, and discussion/conclusion sections.
Journal articles are usually written in a way that is brief and concise as journal editors
place strict guidelines on the number of pages available per article.
Your thesis should contain the same general headings as a journal article (see APA
publication manual for specifics), but because there is no page limit it should be more
comprehensive and detailed. Note, that though your thesis will not likely be as brief as
a journal article, it should still be clear and concise (i.e., the information presented
should be made relevant to your topic).
General Outline/Style.
In general, your thesis should contain the following sections:
A title page
Table of Contents; list of tables/figures (optional)
Acknowledgments (optional)
Abstract
Introduction
Methods
Participants/Sample
Measures/Apparatus
Procedure
Results
Discussion
References
Appendices
According to APA style, a thesis should always be double spaced, including the
references, and there should be a short title of 2 or 3 words (running head or header)
and a page number on the top right hand corner of every page. Other things keep in
mind are: (a) avoid using the first person (“I”); (b) making things easy for the reader
(i.e., the marker) means having a good flow of ideas between various sections and
paragraphs. Spend time ensuring you have made good transitions between topics; and
(c) be consistent in your terminology. Whether you are going to call the individuals
Survival Guide
5
who completed your questionnaire “participants” or “subjects” be consistent and use
the same term throughout.
A word on length
I have always been one to push the idea that the more concise you are, the more likely
it is that you will get your point across. As such, I tend to prefer theses that provide
coverage of relevant literature, but that do so in a way that is clear and to the point.
It should be noted here that while this rule may be applied to the written introduction
of any thesis; in writing up results and discussions it is best applied to quantitative
research where the results are expressed in numbers. It does not fit as well with
qualitative approaches, which are valuable in there own right.
As a result of different methods of research, supervisor expectations, writing styles,
and expected length of theses vary widely and wildly. I have seen some very well
written theses that deserved A++ grades that were less than 30 pages in length
(including tables, references, etc), but have also come across theses in excess of 200
pages that should have been re-written. In contrast, sometimes the depth and breadth
of a topic requires a longer introduction and discussion while others are made so brief
that they no longer make sense.
Keeping the above in mind, most institutions expect a PhD thesis to make a
significant original contribution to the literature. In completing a thesis, the student is
expected to show that he/she has become a competent and independent researcher and
scholar. The thesis is expected to thoroughly address an issue in the context of all
relevant literature. In some parts of Europe, PhD theses appear as books, averaging
200-400 pages in length and containing numerous chapters. Though still expected to
make an original contribution to the literature, and often containing more than one
experiment, PhD theses elsewhere tend to be shorter.
MA theses are not typically as thorough as a PhD thesis, but are still expected to
answer specific research problem(s) or question(s) raised in the literature. MA theses
typically range in length from 80 - 120 pages and are usually no more that 200 pages
in length.
In general, doing an Honours dissertation is an experience in learning to do research.
Your supervisor will therefore have a large amount of input into the questions asked,
design, and production of the manuscript. While an MA thesis is still regarded as a
learning experience, it typically involves greater independence on the part of the
student. The average Honours dissertation ranges from 25 to 50 pages in length.
Supervisors and Topics
While at some universities students are assigned to supervisors at other universities it
is up to the student to approach a staff member for supervision. If this second situation
applies to you, one of your first jobs as a student who is going to do a thesis is to find
a supervisor. In selecting a supervisor, you should first realize that the supervision
process is much like a teaching process, and no two supervisors work in exactly the
Survival Guide
6
same way.
The amount of assistance provided by individual supervisors varies greatly. Some
supervisors expect students to be independent and self-directed, identifying their own
topic and methods, and provide only minimal direction and feedback. Others provide
extensive written and verbal feedback on drafts of the thesis, meet with students
regularly to discuss progress, and are quite directive in guiding the methodology of the
project. Still others provide feedback in accordance with the level of need and
motivation expressed by the individual student.
It is often best to decide what your own expectations are, and try to find out who will
meet your needs. If you are assigned a supervisor, it is also a good idea to know your
own needs and try to express these to your supervisor. If you feel needy, say so.
Most students decide to work with a supervisor they know, usually someone who they
have had lectures from and who seems like an okay kind of person. If you are unsure
about a potential supervisor, it is a very good idea to talk to one or two students who
have already done work with him or her. Some information you might want to get
from other students include the amount of guidance the supervisor will provide,
whether this supervisor is approachable and easy to discuss things with, the more
recent areas of research being worked on, whether or not students supervised by that
individual typically graduate on time, whether that supervisor assists students in
publishing their work, and an idea of supervisor availability.
The Nuts and Bolts of Writing and Doing Research
A) Abstract
The abstract appears immediately after your title page, table of contents, and any
listings of table or figures. Despite appearing at the beginning of your manuscript, the
abstract is usually written last. It usually contains a sentence or two that summarize
the topic/purpose of the study, 2 or 3 sentences on the participants and method, a
statement of the main finding(s) and a final statement of the implications of the work.
For Example:
This study explored the ability of measures of functional status, cognitive status, and
mood to predict discharge destination and length of stay. Participants included 118
individuals consecutively admitted to an inpatient geriatric rehabilitation unit. The
Functional Independence Measure (FIM), Modified Mini-Mental State exam
(MMMS), and Geriatric Depression Scale (GDS) were individually administered at
admission and discharge. One discriminant function significantly predicted discharge
destination (X2 (24) = 40.956, p < .05). Discharge to independent living was
associated with high scores on the FIM and MMMS at discharge, and MMMS at
admission, and low scores on the GDS at admission and discharge; discharged to the
community with supports scored in the same direction, but to a lesser extent; and
those discharged to long- term care scored in the opposite direction. One
discriminant function significantly predicted length of stay (X2 (30) = 62.329, p <
Survival Guide
7
.001). Shorter length of stay was related to higher scores on MMMS and FIM at
admission, and GDS and FIM at discharge, and lower scores on the MMMS at
discharge. Persons with longer lengths of stay scored in the opposite direction. Early
prediction of discharge destination and length of stay may provide additional time to
prepare for the possibility of long term care, however, while prediction from the
results are good, they are not fail-proof and should (once replicated), be used only as
a general guideline.
B) The Introduction
The introduction of your thesis proposal is your opportunity to tell readers why they
should be interested in your study: Why is your area of study important? and Why
should they be interested in your particular research topic? This means that you have
to produce a paper that reviews the literature in the area of interest but which is also
focused on your research question.
The whole idea is to tell the reader what you are doing and why you want to do it.
In starting to write their introduction, many students do an extensive search of the
literature, ordering 10s and 100s of articles and spending many hours reading.
Unfortunately, this often results in the student being overwhelmed by the huge amount
of information they have found, not quite knowing how to organize or present the
information so that it makes sense.
A better method is to start with a research question, and then decide how you are
going to organize the content of your introduction so that it leads logically to that
question. Writing out a list of topics you wish to cover is a good first step.
While there are many ways to organize an introduction, two that I have used are the
Two-Topic format, and the Inverted Pyramid format. Both formats involve
identification of key topics to be covered in the literature review. You will also note
that both formats break the literature review into sections, each section covering a
specified topic area. By breaking your literature review into specific topics, it makes
the task of writing more manageable, as you can focus on writing one section at a
time, and avoid getting overwhelmed by the size of the whole.
Two-Topic Format
Many thesis questions relate to two topics. Does therapy reduce symptoms of
depression? Does brain injury relate to family discord? Do measures of mood relate to
test performance?
In brief this format includes: an Introductory paragraph; Literature review on Topic 1;
Literature review on Topic 2; Review of Literature linking Topics 1 and 2; a statement
of the Purpose of the proposed study in relation to Topics 1 and 2.
In using this format, you would start by writing an introductory paragraph (at most 2
paragraphs) that tells the reader “This area of study is Important”.
Survival Guide
8
Examples:
Depression is one of the most commonly occurring mental disorders (give a few lines
about the number of people effected, the impact of depression, etc….(references)
Brain injury is one of the leading causes of disability in our society, and is currently
estimated to contribute to ___% of deaths per year in New Zealand (references)
This paragraph should end with an introduction to the 2 main topics of your theses: In
this case, therapy and depressive symptoms. You might say something like
Examples
While numerous studies have examined the prevalence of depression and its impact on
society, both prevalence and impact will be influenced by the ways in which
depression may be manifest (i.e., symptomatology), and the effectiveness of various
modes of therapy.
While research efforts have seen the publication of numerous studies on the
prevalence of brain injury in New Zealand, recent efforts have begun to examine the
impact of brain injury on family functioning (references)
Once you have introduced these two areas, you can then write two separate sections
with the subtitles “Depressive Symptomatology” and “Modes of Therapy”; or
“Brain Injury” and “Family Discord”.
Each of these sections should provide a review of the literature on the specific topic.
This does not mean that you must include EVERY study that is listed by Psychlit, it
does mean that you must provide the reader with enough background information to
understand your study and to put it in the context of what is known about the area.
Once each of the two topics has been discussed, you then try to link the two together
by writing a section on symptoms or depression that is linked/focused on by different
types of treatment you have reviewed.
All of this should lead you to a final paragraph in which you state:
The purpose of the present study is to examine the impact of X and Y modes of
therapeutic intervention of depressive symptomatology. Specific questions to be
addressed/hypotheses of this study include (a) ; (b) ;
Inverted Pyramid Format
This format is commonly used in essay writing, and may be more familiar to most
students. In this approach you begin by discussing their topic in the most general of
terms, and then gradually narrow their discussion to become closer and closer to their
own topic or purpose.
Survival Guide
9
For example, lets look at an outline for the introduction of a study about the impact of
childhood brain injury on siblings:
(i) Childhood Brain Injury Is Important: Prevalence information
(ii) It can have a wide range of effects on child behaviour and
thinking
(iii) It also has an impact on family functioning
(iv) Part of this impact is on siblings
(v) Effect on sibling behaviours
and Relationships
(vi)Purpose
For an honours dissertation, using this format you would have one or two paragraphs
to introduce the topic (i); a page or two on general effects (ii); a page or two on family
(iii); and a page or so on siblings (iv & v); followed by a paragraph stating your
purpose and listing your specific hypotheses or questions you study will address.
MA and PhD theses will be more in depth, and each section will be longer in length.
Introductions for a Masters thesis are usually about 20 - 30 pages in length, while for a
PhD they are typically about 40 - 50 pages long.
A Note on Headings and Sub-headings
While an introduction should flow from one topic to another, writing your thesis will
be done in chunks -- one for each area to be discussed. It is often easier for the reader
(and the writer) if each topic area/section has a heading, and that any divisions within
that area might have sub-headings. In the Inverted Pyramid Example above, separate
heading was used for each of sections (i); (ii); (iii); (iv and v); and (vi).
As another example, in a study on models of responses to sexual abuse, the following
headings and sub-headings were used:
Introduction
Survival Guide
10
Models of Sexual Abuse
The recent literature indicates the for models that explain individual
differences in symptom development following abuse….. The models typically
examined in relation to response to sexual abuse typically originate as models of
stress and coping, or as models of Posttraumatic Stress Disorder (PTSD).
Models of Stress and Coping. The first models of stress and coping were
presented by…..
Models of Posttraumatic Stress Disorder(PTSD). Models used to explain
individual variation in responses to trauma within the context of PTSD were first
introduced by…. One recent model of response to trauma places individual variation
within the realm of stress and coping and PTSD was presented by Joseph et al.
(1995)….
Joseph, Williams, and Yule’s (1995) Model. In describing their model
of response to trauma…
The Present Study/Purpose
The purpose of the present study was to examine Joseph et al.’s (1995) model
of response to trauma when applied to a population of sexual abuse survivors.
In this study, the first paragraph ended with a statement that the majority of models for
sexual abuse were placed within either the literature on Stress and Coping, or the
literature on PTSD- leading into the next two paragraphs. The final statement of the
PTSD section identified that the Joseph model was recent, and was able to place
sexual abuse into the context of both stress/coping and PTSD. The final section of the
introduction went on to outline the specific questions to be answered by the study.
An Important Note on Statements of Purpose
Your literature review/introduction should lead logically to the purpose of your study.
At the introduction, you should have a paragraph that tells the reader: What questions
does this study hope to address? and/or Is the researcher making specific predictions
about what results he/she will find?
This section is often written in paragraph form that is typically more general, or may
contain a listing of the specific questions or hypotheses.
Paragraph form example:
“This study addressed a number of issues in relation to the impact of childhood brain
injury on sibling behaviour. Specific questions that were addressed include: Do
siblings of brain-injured children exhibit challenging behaviours? How does the
presence of a brain injured child influence family functioning? And what are
children’s’ perceptions of their brain-injured siblings?”
Listing Form Example:
In conducting this study, a number of specific hypotheses were tested: (1) It was
hypothesized that siblings of brain injured children would exhibit more behaviour
problems than siblings of non-injured children or children with orthopedic injuries;
(2) it was hypothesized that male siblings would exhibit more behaviour problems
Survival Guide
11
than female siblings, regardless of the type of injury sustained; (3) It was
hypothesized that families with brain injured children would score higher on scales of
family dysfunction than families of orthopedic injured children, while families without
injured children would score lowest on these measures; and (4) It was hypothesized
that children would view their brain-injured siblings as more negative than children
from the other injury groups.
Having a clear statement of questions/hypotheses that will be addressed helps the
reader to know what they can expect from the rest of your paper.
In addition, by listing out the questions you intend to answer, this section will also
help you to write/complete the remaining sections of your thesis (see results and
discussion sections for more on this).
C) Methods Section
Your methods section answers the following questions: Who were your participants?
What apparatus, surveys, questionnaires, materials did you need to run the study?
How did you go about doing the study?
When you write this section, you should keep in mind that after it is written, any John
Doe from off the street should be able to read this section and do the same study the
same way you did it.
The methods section described in detail how the study was done. This section allows
readers to evaluate whether you’re methods are appropriate, and how reliable or
invalid your results might be.
The methods section is typically divided into labelled sub-sections. These usually
include descriptions of the participants were subject, the apparatus or material views,
and a procedure you followed. If the design of your experiment was very complex, or
if the material you use requires a very detailed description, additional subsections or
subheadings to divide the subsections may be needed to help your reader find specific
information. Include in the subsections only the information that essential for people
to comprehend and replicate your study. If you don't provide enough information,
your reader will be left with questions; but if you give too much detail, the reader will
be burdened with irrelevant information.
Participants/Subjects
This subsection should answer in three main questions. (1) Who participated in the
study? (2) How many participants were there? and (3) How were they selected? In
answering these questions, you should likely include information such as the number
of participants, the number of males and females, the range and average age of
participants, information on ethnicity, and any other pertinent participant
characteristics. You should give not only the total number of participants in the study,
but also the number that might have been assigned to each group. If any participants
started the experiment, but didn't finish, you should give the number of participants
and the reasons they did not continue/withdrew.
Survival Guide
12
You should include in this section any criteria that were used in determining who was
selected to participate in your study. For example, did your study specifically include
only people over the age of 16; only people with a specific diagnosis; or only people
who were affiliated with a particular institution or agency. In addition you should
include any method used for assigning subjects to particular groups (e.g., random
assignment; assignment based on a specific characteristic; groups matched on
age/gender; etc..).
Instruments/apparatus/measures
This section should describe the materials for use in their function the experiment.
Standard equipment such as furniture, star watches, video screens, or pencil can
usually be mentioned without describing them in detail. Specialized equipment
should be described with more detail, and complex or custom-made equipment should
be illustrated by drawing or photograph. Many psychology experiments involve the
administration of standardize psychological assessments, such as assessments of
mood, personality, intelligence, etc... In describing the assessment measures, you
should include a description of the number of items on the assessment, how the
questions were answered (e.g., narrative; yes/no; multiple-choice; Likert scale), the
typical amount of time taken to complete the assessment, as well as any previously
published information on the reliability and validity of the assessments.
You may wish to include information that reflects whether a particular assessment has
been used with the population you are using before, other population sit may have
been used with, and an indication of any alterations that may have been made either to
the items or to the administration procedure.
Example., “Due to the physical limitations of participants in the disabled sample,
participants were unable to respond to the items using the standard paper-pencil
method. As such, all items from this assessment were read aloud to each participant,
and their verbal responses were recorded verbatim by the researcher”.
Procedure
The procedure section summarizes each step that you took to complete the research
project. It should begin the beginning. What was the first thing that you did? The
second thing? Etc
For example,
"Forty-three agencies providing counseling services to sexual abuse survivors were
contacted with an introductory letter requesting their assistance in identifying
potential participants. This letter provided the agency with a rationale for the study,
a statement of the study's purpose, and a description of the role they would be asked
to fill in soliciting participants. This letter was followed via telephone contact to
determined willingness of agency service providers to assist in the research project.
A total of 32 agencies agree to participate in the study. Of the 11 agencies who did
not agree to participate, two stated that their contact with sexual abuse survivors was
too limited to be useful, five stated that agency policies did not allow their
Survival Guide
13
participation, and four stated that they had had negative experiences with research
projects in the past. Agencies willing to participate in the study were asked to
distribute surveys packages to all clients consecutively referred to their services.
Survey packages include the following materials: a covering letter explaining the
purpose of the study,......"
This section should include the period of data collection, a statement of response rate,
a statement that the data were scored and entered into the data file for analysis, and a
statement of the accuracy of data entry. Again, the goal is to state exactly what you did
in order that other researchers can replicate your study.
D) Data Analysis and Writing the Results
One of the most fear inducing things about doing a thesis is sitting in front of the
computer with a pile of data. So - take a deep breathe, relax, it is often not as difficult
as you think it is going to be.
Entering the Data.
Once you have collected your data, your first job is to decide how it will go into the
computer. The best way to make decisions about your data is to go back to the
questions you want your thesis to answer.
If you hypothesize that males will be less successful than females at getting a ball
through a hoop, you will have to make sure you include gender and success at getting
the ball into the hoop as variables in your data set.
If you are unsure what data you should be entering or how to enter it, it is a good idea
to sit down with your supervisor. Speaking from experience, it can be very time
consuming to enter data, and then realize you have done it wrong and have to start
again!
In terms of the mechanics of data entry, most statistics software (SPSS, EXCEL,
BMDP) have excellent tutorials that show you how to get started. SPSS is particularly
useful as it comes with ready-made data sets that you can play around with. Other
resources to assist in data entry can be found in written resources in university
libraries, such as SPSS Applications Guide, which provides an overview of data entry,
and how to perform various analyses.
(Note: Just because you have entered your data into the computer does not mean you
can destroy the raw data, most ethics committees/agencies require that raw data kept
from 7 to 10 years).
Organizing the Writing of your Results Section.
One of the things that commonly occur in doing analyses is that you don’t know
where to begin. Try to present your results in a logical sequence and use subheadings
for different sections.
Survival Guide
14
While there are many styles and ways to write up results, I am a very
structured/organized person, and tend to use the same framework for all of my own
writings. So here is my own style.
It often helps to re-state your hypotheses/questions at the start of your results section
and then to divide your results into sections: one section with its own heading and
analyses per question/hypothesis. This is important for a number of reasons:
i)
It ensures that each of your hypotheses/questions is addressed by your
results;
ii)
It helps to guide the reader towards that part of the results section they
are most interested in;
iii)
It can help you to avoid the common trap of running numerous
analyses just because you can, and because you fear you will miss
something if you don’t keep analyzing.
(This last one is a bit of a pet peeve for a number of reasons. First, it is often a waste
of time as you end up running and re-running analyses that are meaningless or
uninteresting. Second, it reduces the power of the tests you have used to answer your
central questions- meaning that it reduces your ability to find real effects and increases
the probability of you finding “significant relationships” that aren’t really there.
Finally, you will eventually have to organize your analyses into a comprehensible
Results section. The more analyses you run, the more difficult this is likely to be!)
An Example Introductory/Organizational paragraph in the Results Section:
Results
In this study, the analyses were conducted in three stages. First, descriptive
data were generated to provide information on the characteristics of the sample.
Second, correlational analysis was conducted to examine the degree and direction of
relationships between exercise characteristics and responses to stress. Finally, a
MANOVA was performed to determine whether groupings based on demographic
variables such as age, gender, and ethnicity differed in their responses to stress.
This would then be followed by the results, under the following headings.
Stage 1: Sample Description
In examining the characteristics of the sample, it can be seen that…
Stage 2: Relationships between exercise and stress response
…..
Stage 3: Stress response in demographic groupings
…..
What Statistic do I Use? – A review of a few statistics
The statistics you use should reflect the questions you are trying to answer with the
data. (Note, due to the huge amount of good information currently available, I will
not be providing detail about various statistics, my goal is only to show that the
statistic used should be guided by the research question you want to answer. Non-
Survival Guide
15
parametric stats will not be reviewed).
i)
Descriptive Statistics
Descriptive Statistics are just that, they provide you with numbers that can be used to
describe the participants in your study, as well as how they performed on the
tests/tasks you asked them to complete. If you are testing participants in different
groups, you may wish to generate these numbers separately for each group.
a. One of your first jobs will be to generate descriptive statistics that describe
your participants. Include demographic information such as age, gender,
education, ethnicity, marital status, etc...The numbers you generate will be
useful in writing your “Participants/Sample” section. Information from SPSS
(Analyze Descriptive Descriptive or Analyze Descriptive
Frequencies) should include range of scores. mean score, and the percentage of
persons obtaining different scores on each variable measured.
“The sample contained 110 individuals of whom 48% were male. Age of the
sample ranged from 18.5 to 24.25 years with a mean age of 19.0 years. The
majority of the sample (84%) had completed 12 years of formal education,
while 12% had completed 10 years, and 4% had completed 13 years...”
b. You may also wish to generate descriptive statistics such as the highest,
lowest, and average scores your participants obtained on the measures/tasks
you had them complete. This will usually be your first stage/subsection of your
results.
“Of the 110 participants 76 (69.1%) reported prior history of suicidal
ideation, while 25 (22.7%) reported a prior history of suicide attempts.
Of those who attempted suicide, only 2 (8%) had received mental
health services following the suicide attempt...”
The Measures section of your Method should describe how you scored and coded and
analyzed your data. In placing descriptive data in your results section you should be
reporting how your sample performed on the measures you have described.
Where the amount of data to present is large, you may wish to present them in clearly
labeled tables or figures. Describe your results verbally/in text, but do not repeat
information that is already provided in a table or graph.
Survival Guide
16
For example
Table 1. Context and Years of Clinician Experience
Psychiatrists
Frequency
(%)
Years clinical experience
 0-2 years
 2-5 years
 5-10 years
 10+ years
Context of employment1
 Inpatient facility
 Outpatient facility
 Justice department
 Community facility
 Private practice
 Tertiary training
institute
 Other
Psychologists
Frequency
(%)
Total
Frequency
(%)
0
1
4
46
(0.0)
(2.0)
(7.8)
(90.2)
0
7
11
45
(0.0)
(11.1)
(17.5)
(71.4)
0
8
15
91
(0.0)
(7.0)
(13.2)
(79.8)
15
28
2
10
20
(29.4)
(54.9)
(3.9)
(19.6)
(39.2)
6
18
2
2
43
(9.5)
(28.6)
(3.2)
(3.2)
(68.3)
21
46
4
12
63
(18.4)
(40.4)
(3.5)
(10.5)
(55.3)
11
(21.6)
7
(11.1)
18
(15.8)
4
(7.8)
6
(9.5)
10
(8.8)
Given that respondents frequently worked in more than one context of employment, total
percentage rates add to more than 100.
“As can be seen in Table 1, the majority of clinicians had greater than 10 years of
experience. While, overall, the majority of clinicians were employed in private
practice, within profession groupings the majority of psychologists were employed in
private practice, followed by outpatient facilities, while the majority of psychiatrists
were employed in outpatient facilities, followed by private practice”
The numbers presented in the table would not be replicated in the text, but the text can
be used to clarify the meaning of the numbers in the table for the reader.
ii) Correlation Coefficients
Correlations are used to examine the degree and direction of relationships between
variables. For example, you may wish to examine whether age is related to extent of
memory loss, or whether increasing dosage of a particular medication is related to
increased or decreased symptoms. (In SPSS use Analyze Correlate click Bivariate;
then select the variables you want to examine)
It is important to consider the variables you will be using in performing your
correlations. Correlation is ONLY appropriate when variables are coded so that the
numbers you assign are meaningful.
This means that a high score on the variable in your correlation must MEAN
something. For example, high scores on an assessment of mood may mean an happier
mood than lower scores; an increased number on the variable age might indicate
greater age; lower scores on a scale of fitness may mean you are less fit than those
Survival Guide
17
with higher scores.
When correlations are generated, the statistic/correlation value is the value of r, and it
is associated with a p value. P values less than 0.05 are considered significant.
In interpreting correlations, it is important to take into consideration the direction (+
or -) associated with the r-value. If the r-value of the correlation between 2 variables is
positive, it means that as the value for one variable increases, so does the value for the
other variable. If the r-value for the correlations between 2 variables is negative, it
means that as the value for one variable increases, the value for the other variable
decreases. If you are having difficulty trying to understand what your correlations
mean, get your stats package to draw you a scatterplot (see below for an example).
For Example:
“Correlations were generated between demographic variables (i.e., age, gender,
extent of developmental disability, residential history, presence of psychiatric/medical
diagnosis) and the four classes of challenging behaviour surveyed (i.e., physical
aggression, verbal aggression, self-injury, socially inappropriate) and presence
versus absence of prescription for four classes of psychotropic medication (i.e.,
antipsychotic, antidepressant, anxiolytic/antimanic, antiepileptic). Significant
correlations are presented in Table 2.
Table 2. Significant correlations of demographics, medication class, & behaviours.
Behaviours
Physical Aggression
Verbal Aggression
Self-Injury
Medication Class
Antidepressant
Antiepileptic
Age
Gender
Diagnosis
Years in Community
--.439*
---
—
—
---
—
—
---
.752*
--.676*
---.439*
.475*
---
-.475*
.607*
—
---
Note: * p < .05
As can be seen in Table 2 as age increase the number of verbally aggressive
behaviours present increased, while the prescription of antiepileptic medications
decreased. Though not significantly related to any class of challenging behaviours,
gender was significantly related to the prescription of antidepressant medications
with females being more likely to receive antidepressants than males….Nonsignificant correlations are not presented.”
Survival Guide
18
If I had had difficulty in interpreting the correlation between age and verbal
aggression, I would ask the computer to draw me a scatter plot of each subjects scores
on age along one side and verbal aggression along the other side (SPSS Graph,
Scatterplot) or would draw one by hand:
70
60
50
40
30
AGE
20
10
0
10
20
30
A GRES
Each plotted point on the graph represents a subject. You can see that as age goes up,
so does the individuals’ aggression score. As higher aggression scores indicate the
presence of more aggressive behaviour, you could interpret the correlation as meaning
that older individuals displayed significantly more aggression than younger people.
iii) Univariate Statistics
Often one of the central questions of a thesis will be “Do group A and Group B differ
significantly on X”. For example: “Do children with brain injury have more behaviour
problems than those without?” “Do depressed people score differently on this test than
non-depressed people?” “Do men and women differ in their performance on a
particular test?”
The central question being asked is “Are the observed differences between the two
group means (averages) on a particular score the result of actual differences between
the groups (i.e., are they significantly different), or due to chance?
In the above examples, the researcher has collected data from 2 groups, and will
compare their performances on a particular measure. Univariate statistics can also be
used if you have only collected data from one group, and want to find out if they differ
from what would be expected. In this case, you would be comparing the data you
collected to some value in the literature, if there is such a value.
The flow chart on the next page indicates the statistics that is appropriate in certain
situations:
Survival Guide
19
Groups/Samples
Standard Deviation
Of population published
Statistic to Use
Yes
Use z-scores
No
One sample t-test
One
groups are
independent
Independent t-test
groups are
dependent
Dependent t-test
Two
Samples are said to be independent if the subjects in each group are different subjects,
and the subjects in one group are not ‘matched’ or ‘paired’ in any fashion with
subjects in the other condition. In independent samples, the outcomes in one sample
have no bearing on the outcomes in the other sample. In dependent or correlated
samples, the outcome for one sample influences the outcome of the other sample.
Very often, this means that the two samples have been matched or in some way.
Repeated measures designs typically involve dependent samples. For example, in a
repeated measures design, you may have a single group of subjects and measure their
mood before counseling, and then again after counseling. To find out if counseling
had an effect, you would compare the scores taken before and after counseling. This
involves treating “before’ and “after” as two separate samples. Because the same
subjects were involved in “before” and “after”, the two samples are considered
dependent.
Journal Form:
When writing the results of univariate tests, the following format is usually use:
“The effect of the enrichment treatment program was significant (z= 2.98, p < .05)”
“Administration of the drug had no significant effect on performance (t(19) = 1.35, p
> .05)”.
The format includes:
(i)
the abbreviated name of the test statistics you used (z or t);
(ii)
the degrees freedom, if any, in parentheses, followed by an equals
sign;
(iii) the calculated value of the test statistic; and
(iv)
the probability value for the result having occurred by chance. Type p,
followed by < or > and then the level of alpha.
a. Usual alpha is p= 0.05; significant statistics are therefore p < .05;
while non-significance is p > .05.
Survival Guide
20
You should note that a recent trend is to present the exact p values that are generated
(e.g., p = 0.04 rather than p < .05).
iv) Multivariate Statistics
Multivariate statistics are much too complex to be described here in any detail. You
should realize that, as would be suggested in their title, multivariate statistics involve
examining more than one variable and/or comparison of more than two groups.
To assist you in going from Question/Hypothesis to statistic, I have shamelessly
reproduced a wonderful set of tables first presented in Tabachnick B. G., & Fidell, L.
S. (1989) Using Multivariate Statistics, 2nd ed. Harper Collins Publishers. The table is
presented on the following pages. Permission to include these figures was obtained
from the authors.
Please note that, in order to fit everything on the pages, abbreviations have been used.
DV means dependent variable; IV is independent variable (often meaning the
grouping variable); vars = variables.
In actually writing up your results, a very good resource is Tabachnick & Fidell’s
Using Multivariate Statistics, which provide sample SPSS, SAS, and BMDP outputs,
how they would be interpreted, and an example of how to write-up the findings.
Survival Guide
21
Research
Question
Predicting Group
Membership
Identifying
Structure
Number of
DVs (number
Of attributes
Groups differ
On)
One
Multiple
Multiple
(Observed)
Number of
IVs (grouping
Variables)
Multiple
Multiple
Multiple
(latent, not
observed)
Covariates
None
Some
None
Some
Factorial
Discrim
Function
Hierarchical
Factorial
Discrim
Function Principle
Components
- empirical
Technique
One-way
Discriminant
Goal of
Analysis
Hierarchical
one-way
Discriminant
Creates a linear combination which
Maximizes group differences on the DVs.
Factor
Analysis
-theoretical
Creates linear combinations of
Observed variables to represent
Latent/un-observed factors
Survival Guide
22
Research
Question
Significance of
Group differences
Number of
DVs
Number of
IVs
Covariates None
One
One
Some
Multiple
Multiple
None
One
Some
None
Multiple
Some
None
One
Multiple
Multiple
(1 within
subjects)
One
Some
Profile
Profile
Analysis
Analysis
Of repeated
Measures
1 way
1 way
Multiple
(1 within
subjects)
Factorial
Factorial
MANOVA MANCOVA MANOVA MANCOVA
t-test or One Way
Factorial Fact
One-way ANCOVA ANOVA ANCOVA
ANOVA
Create linear combinations of DVs to maximize
group differences
Doubly
Multivariate
Profile
Analysis
Survival Guide
23
Research
Question
Degree of Relationship
Between Variables
Number of
DVs
Number of
IVs
One
One
Covariates
Technique
Multiple
Multiple
None
Bivariate
R
Multiple
R
Multiple
None
One
Multiple
(discrete)
Multiple
(discrete)
Some
Hierarchical
Multiple
R
Create a linear combination of
IVs to best predict the DV
Canonical
R
Correlates a
linear combo of
DVs maximally
With a linear
Combo of IVs
Multiway
Frequency
Analysis
(MFA)
MFA
(logit)
creates loglinear combos of
IVs to: best predict category
frequency or best predict the
DV(logit).
D) Discussion
Here is where you interpret your results in relation to the literature. Discussion
sections usually start with a paragraph of two that summarize how your study
contributes to the literature/to understanding the topic area (i.e., summarizes your
main findings). Some reference should be made to the reliability of the findings and
any limitations. For example, state whether your sample size was too small to do
Survival Guide
24
additional analyses; if you only examined children ages 5-6, state that the results may
not be generalizable to other age groups; if questions used were misunderstood by
respondents this should be noted,; etc. Identify any aspects of the procedure (e.g.,
measures used) that you would have changed if you were to re-do the study.
Something should be said about whether your results fit with your hypotheses, and the
agreement/disagreement of your results with those of other studies. Finally, indicate
what conclusions you can draw.
Other sections/topics you might wish to cover include: future research (e.g., if I had
unlimited time, energy, and funding, what would I do to replicate/change/built on
these results?); and the clinical/practical/real life implications of your findings.
What if….(common problems and concerns)
Dealing with Feedback: Everything I do is wrong!
Most theses go through numerous drafts. If you are getting lots of feedback, you
probably have a good supervisor. While I try to ensure that I always provide some
positive feedback about a draft, most feedback given suggests improvements, wording
changes, deletion, etc, and is often has negative connotation. If you feel you are
always getting negative feedback, this will make it very hard to view your thesis in a
positive way. You may wish to address this issue directly with your supervisor by
asking them to identify sections that are well written. He/she may not realize that they
aren’t giving any positive feedback, which is often key in keeping students motivated.
For example, if you notice that there are no red marks/changes to your description of
the sample you may wish to ask, “How did you find the participants section?”
A better solution might be to put more effort into your next draft before handing it in
for review. Try writing 2 or 3 drafts, reading each draft carefully and making your
own corrections to each, before handing it in. Also, ask a friend to read a draft and
make suggestions.
Loss of Momentum
Often during the course of writing a thesis, you will “get stuck”. This can occur due to
feelings of being overwhelmed by the thesis, due to increased workload in other areas,
(such as exams/course work); due to increased commitments outside of school; or for
any of a multitude of other reasons. We all lose momentum on occasion.
One way to avoid losing momentum is to provide yourself with rewards for each small
deadline you have set in regards to the thesis (cheesecake is always a good option!).
Some deadlines worthy of a reward include: Having first draft of introduction
completed by a certain date; finalizing introduction by a certain date; first and final
drafts of measures/procedure section; assessing your first participant; completion of
data collection; entering all your data; conducting analyses and writing up the results
for each hypothesis/question; etc…
If you do lose momentum, try to get back into the thesis by doing easy things first.
This might involve re-reading a key article, reading over your introduction, re-running
Survival Guide
25
a simple analysis, or organizing your data. If your introduction is already done, try rereading your introduction or other sections of your thesis. Make a list of the sentences
you have used that really sound great, or those that you would like to change and
If you have collected your data, try to write up a description of your sample for the
method section, as this tends to be the most straightforward section to write.
You may also try to schedule specific “thesis writing times”, where you will sit at your
desk and do something (anything!) that is related to your thesis. If you do this, try not
to daydream, or procrastinate by cleaning your desktop, making phone calls,
etc…(Again, reward yourself if you are able to carry through on this!)
Nothing Significant
This can happen for many reasons: maybe the theory you tested was wrong; maybe the
measures you used were not able to find an effect that really was there; maybe your
sample was too small and reduced your ability to find effects. Not finding significant
results where they were expected is not the end of the world. In reporting research
findings, honesty is always the best policy – don’t claim your results were positive if
they were not. Also, try to avoid making excuses for non-significant findings such as
“While the finding did not reach significance, it approached significance (p = .58),
and would likely have been significant if a larger sample had been obtained”.
Write up the results, including your non-significant findings, and then address
possible reasons for the lack of significance in your discussion. How might you
change the study in future to increase your ability to find an effect?
Feeling overwhelmed/Incapable
I think that all graduate students have a little voice in the back of their minds that tells
them that they are not really good enough. I have often heard statements such as “I’m
not as bright as the other students” or “I only got in on a fluke”. Most of us feel
inadequate at some point. Imposter Syndrome, where you feel as if you are putting on
an act, and that you will eventually screw up and everyone will then realize that you
are an imposter and not good enough, is actually quite common.
Realize that having self-doubts is a normal part of being a student, and of doing a
thesis. You are probably alright. However, it is also possible that you may have taken
on a task that is too difficult for you. If this is the case you have 2 options: either
simplify the task, or increase your own ability to succeed. Examples of ways to
simplify the task: Instead of planning to use a hugely technical statistic, use one that is
simpler, but still answers your research question; instead of trying to condense ALL
the literature on a topic, try instead to produce an introduction that touches only on the
literature that is directly relevant to your study and provides enough for the reader to
put things into context. Examples of ways to increase own preparation: Try re-reading
some of the key articles and jotting down issues you would like to cover about your
topic to increase your preparedness to start writing; go to your supervisor or to the
library and review one or 2 theses on topics similar to yours in order to get a better
idea of what is expected.
Survival Guide
26
Data Difficulties
Students often run into difficulties when running analyses or entering their data.
Within many departments there will be a staff member who is the identified “stats
expert”. Indeed, some programmes have actually hired additional staff whose sole job
is to answer staff and student questions about data and statistics (Bless you, Bless you,
Bless you, ...Thank you, Thank you, Thank you……).
Give one of these individuals a call and ask to set-up an appointment. Try to go into
the appointment with specific questions or a description of the difficulty you are
having. If you have your data entered into the computer, take along a copy on disc.
Conclusions
While a number of things have prompted me to produce this document, my main
objective has been to provide some basic guidance and ideas and reduce anxiety for
those who have never taken on a research project before. The writing of this document
has increased my own appreciation of the amount of learning, which occurs when
working on a research project, and has also allowed me to identify some of the gaps in
my own knowledge. Having said this, I would encourage my colleagues and peers to
consider the need to improve and expand upon this guide, particularly in the area of
quantitative research.