Surveys Part 2

1.
2.
3.
4.
5.
6.
Determine the objectives
Delimit the sample
Construct the questionnaire
Conduct the pilot study
Establish the distribution process
Analyze the data


1 st pilot – colleagues, peers

2 nd pilot – participants who are part of the intended population

What are we looking for?


Look for:

Questions that lack discrimination
(answered the same by all)





Unexpected responses

May be poorly worded
Questions people don’t respond to
Instructions
Length of the survey
How easy/difficult it is to analyze

1.
Self-administered surveys
2.
Interviews




Mail
Group administration
Internet
E-mail


 Telephone
Interview
Personal Interview
Group Interview





1. Web & mail
2. Web
3. E-mail
4. Mail





1. Advanced letter/e-mail
2. Survey
3. Reminder card/message
4. Final reminder card/message or end survey

Costs
Data entry
Skill
Pre-test
Internet
Software
Automatic entry & coding
Mail
Mailing, printing
Time consuming entry & coding
Need ability to develop survey
Same
Need to test system & data entry
-
Missed items Higher than mail
Open ended
?’s
No difference
Lower than internet
No difference


Each question structure implies a
“scale of measurement”

Likert, semantic differential, etc.

Scales guide statistical analysis

1.
2.
3.
4.
Nominal Scales
Ordinal Scales
Interval Scales
Ratio Scales


Lowest level of measurement

Words & not # values….not a rating

Each value defines a distinct category

Needs to be coded for Excel/SPSS

Example…..

_____ (1) Male _____ (2) Female

 Other examples
2. What was your favorite activity?
(pick one)
___ Golf ___ Soccer ___Baseball
___ Golf (1) ___ Soccer(2) ___Baseball (3)
3. Have you attended this program previously?
___Yes ___No
 Unordered close-ended





Implied rank or order
Each category has a position higher than the previous
Distance between categories isn’t equal

Ie. 1st, 2nd and 3rd place
Example

AP Basketball poll


Ordered categories have meaningful size differences or distance between values

Distance between intervals is equal

Does not have a determined zero point

Distance makes sense, ratios don’t

 Calendar year
 2011 ---365 days ---2012 ----365 days ---2013
 Outdoor temperature



Thermometer – degree increments are equal
Is 0 ° as cold as it gets?
100 degrees isn’t twice as hot as 50
 Meaningful size differences and equal distances (unlike ordinal)
 Likert scales…


Likert scales

Some believe ordinal

Categorical with order

Others believe interval

Ordered categories have meaningful size differences
 What is the difference between strongly agree, and agree….and is that difference the same as the difference between agree and neutral?


Likert scales

Argument for interval

If there is symmetry in the responses


SA/A/N/D/SD
E/G/F/P – not symmetrical, uneven distances between categories



Has a true zero point

Makes ratios possible
Has ordering & distancing properties of interval

Weight

100 lbs. Is twice as heavy as 50 lbs.


Reaction time
Distance traveled: _____

1.
2.
3.
4.
Under 18
19-22
23-26
27 or older
Scale of measurement? Why?
Would you rephrase the question? Why?
How we ask the question may limit us

 Scales of measurement have range from the least precise to the most precise
 Nominal Ordinal Interval Ratio

 Determines what statistics are possible
 Nominal is most limiting ; yes/no questions
 56% enjoyed the show, 44% did not
 Why change YES/NO questions to Likert?
 Degree of interest/opinions/attitudes

With ordinal, interval, and ratio we can compute averages and measure variability

Developing a Codebook

Before entering data into computer

Instructions on converting data

Details how to define & label each variable

Assign #’s (codes) to responses

List every variable…including the ID #

2. What is your current grad school sequence?
______ Athletic Training
______ Biomechanics
______ Exercise Physiology
______ Physical Education Teacher Education
______ Psychology of Sport & Physical Activity
______ Recreation Administration
______ Sport management

Developing a Codebook
Survey
Quest
#
Variable name
2 Major
Values
1=
Athletic Training
2=Biomechanics
3=EP
4=PETE
5=PSP
6=REC
7=Sport mgt
Scale of measurement
Nominal
Stats
Frequencies,
%, mode


Variable Name

Use something you recognize & link to the question

Sales staff

Gender
 Level of satisfaction or level of agreement is likely not appropriate. SPECIFIC ENOUGH to identify.

Developing a Codebook
Survey
Quest
#
Variable name
2 Major
Values
1=
Athletic Training
2=Biomechanics
3=EP
4=PETE
5=PSP
6=REC
7=Sport mgt
Scale of measurement
Nominal
Stats
Frequencies,
%, mode


Values

1=strongly agree

2=agree

3=disagree

4=strongly disagree

Values

1=yes

2=no

1=male

2=female

Developing a Codebook
2
? # Variable name Values
Learn of grad program
1= ISU website
2=NCAA website
3=Word of mouth
4=Family & friends
5=Other
Scale of measurement
Nominal
Stats
Frequencies,
%, mode
20 Trouble free transition
1=Strongly Agree
2=Agree
3=Neutral
4=Disagree
5=Strongly disagree
Interval Mean, median, mode

 “All that apply” question
 Rank questions
 Open ended questions

If this were the question?
___Flyer ___Pantagraph
___ Word of mouth ___Brochure
___Radio ___Other (specify):______

1a
1b
1c
1d
1e
1f
1g
Treat each option as a yes or no question (either checked/unchecked) ?
Flyer 1=yes
2=no
Pantagraph 1=yes
2=no
Word of mouth 1=yes
2=no
Brochure 1=yes
2=no
Radio
Other
1=yes
2=no
1=yes
2=no
Other response n/a
Nominal
Nominal
Nominal
Nominal
Nominal
Nominal
Nominal

If this were the question?
3. Rank each of the activities in order of preference (1=favorite, 3=least favorite)
_____Bingo
_____Yahtzee
_____Twister

Question
#
3a
Variable name
Bingo
3b Yahtzee
Values
1=Favorite
2=2 nd favorite
3=least favorite
1=Favorite
2=2 nd favorite
3=least favorite
3c Twister 1=Favorite
2=2 nd favorite
3=least favorite
Scale
Ordinal
Ordinal
Ordinal
Stats

3
Question
#
Variable name
Favorite activity
Values
1=Bingo
2=Yahtzee
3=Twister
Scale
Nominal
Stats
 What is the difference?

If this were the question?
3. Indicate your overall level of enjoyment at this event by circle the number…..
No Enjoyment Enjoyed
Whatsoever 1 2 3 4 5 6 A Great deal

No Enjoyment Enjoyed
Whatsoever 1 2 3 4 5 6 A Great deal
3
Question
#
Variable name
Overall enjoyment
Values Scale
1=None whatsoever
6=Enjoyed a great deal
Interval
Stats