The Nature of Statistics

advertisement
The Nature of Statistics:
The art of learning about and understanding our
world through data.
Essentials: The Nature of Statistics
(a.k.a: The bare minimum I should take along from this topic.)
• Definitions and relationships as presented on the Anatomy of
the Basics: Statistical Terms and Relationships sheet
• Identification of variables and their characteristics
• Careful review of data and their presentation
• Providing a context for the data
• Why use percentages rather than numeric counts when
making comparisons
69.2 80 35,000
• What do you know about these numbers?
• What do they mean to you?
• What is missing?
Okay, so What is Statistics?
(or is that What ARE Statistics?)
Statistics is the study of how to collect, organize, analyze,
interpret and report numerical information in order to
make decisions.
Statistics are the numeric data we use to better understand
our world. They may take the form of frequencies, means,
percentages, variances, etc.
What is a Study?
• 3 Types:
• Observational – observe and measure; can
identify association, not causation.
• Experimentation – impose treatment and
observe characteristics; can help establish causation.
• Simulation – using computers to simulate
situations that are not practical to do in real time.
Basic Terminology
• DATA: Are numbers with a context - i.e. numbers with
meaning.
– Examples: not 48.2, but 48.2 kg. not 5.23, but 5.23 inches)
• VARIABLE: A characteristic or property of an individual
population unit that varies from one person or thing to
another.
– Examples: age, square footage, and assessed value represent
three variables associated with homes in Oneonta.
– Variables have Values. Example: The variable hair color has the
values of brown, blonde, red, etc.
• UNIT (Element): Any individual member of the defined
population.
– Examples: Each bottle of soda in a production run is a unit; each
penny in a roll of pennies is a unit; each person enrolled in a class
is a unit.
Data: One variable (here unidentified, i.e. no context), multiple values
“Raw” Data (N=160)
“Organized” raw data (N=160)
Unit
73 “different”
numbers
Time Period Otsego Lake was Frozen (days)
Raw Data
Grouped Data
Time Period Otsego Lake was Frozen (days)
Otsego Lake: Days Frozen
!849-50 to 2009-10
70
60
Frequency
50
40
30
20
10
0
0-24
25-49
50-74
75-99
Days
100-124
125-149
Data: Two Variables: year and days; multiple values
Time Period Otsego Lake was Frozen:
Mean Days/Decade
Time Period Otsego Lake was Frozen:
Mean Days/Decade
So is the Greenhouse Effect at work here?
To be studied through further statistical analysis, such as the use of ANOVA…
Anatomy of the Basics: Statistical Terms and Relationships
Descriptive Statistics: methods for organizing and
Statistics is the study of how to collect,
organize, analyze, interpret and report
numerical information.
summarizing information. E.g. Number of students in this
class by major, baseball standings, housing sales by month.
Inferential Statistics: methods for drawing conclusions
and measuring the reliability of those conclusions using sample
results. E.g. Political views of all 4-year college students.
Parameter: numerical characteristic of a
Population: all individuals, items, or objects
Population vs. Sample
whose characteristics are being studied.
population.
Census: data collected from ALL members
of the population.
Sample: a portion of the population
Statistic: numerical characteristic of a
selected for study.
sample.
Variable:
a characteristic or property
of an individual unit. Variables
have values.
Qualitative: a variable that cannot be measured
numerically E.g. Gender, eye color.
Discrete: a variable whose values are countable. It can
Quantitative: a variable that can
only assume certain values, with no intermediate values.
E.g. Number of auto accidents in Oneonta in 1998.
be measured numerically.
E.g. Income, height, number of siblings one has.
Continuous: a variable that can assume any numerical
value over an interval or intervals. E.g.Time.
Nominal: grouping individual observations into qualitative
No Arithmetic Operations: individual
observations can only be categorized.
categories or classes. E.g. Grouping individuals by whether they
are left-handed or right-handed.
Ordinal: individual observations are assigned a number or
“ranking.” There is a sense of “more than,” but you cannot say
“how much” more than. E.g. Military ranks.
Scaling of Variables
(Measurement Levels)
Arithmetic Operations: individual
observations have meaningful numeric
values.
Interval: variables have no true zero point. Cannot say
how much more. E.g. Temperature ( F or C), IQ scores.
Ratio: variables have a true zero point. Can say how
much more. E.g. Weight, height.
Population Basic Terminology
• POPULATION:
– Complete collection of all elements or units (usually people,
objects, transactions, or events) that we are interested in
studying.
– In terms of data, a population is the collection of all outcomes,
responses, measurement, or counts that are of interest.
– CENSUS: A complete enumeration (or accounting) of the
population (i.e. collecting data from every element (or unit) in the
population).
– PARAMETER: A numeric value associated with a population. (e.g.
- the average height of ALL students in this class, given that the
class has been defined as a population)
Sample Basic Terminology
• SAMPLE: Taken from a population a sample is a subset from which
information is collected.
– Example: 25 cans of corn (sample) randomly obtained from a full days production
(population)
• STATISTIC: A numeric value associated with a sample.
–
Example: the average height of 10 individuals randomly selected from the class (defined
population).
• INFERENCE: An estimate, prediction, or some other generalization
about a population based on information contained in a sample.
– Example: Based upon a randomly selected sample of 25 flights at JKF International
Airport (the sample; individual flights are units) taken from all flights on Dec. 24,
2009 (defined population), we can state with a degree of confidence the mean
delay for the population of the day’s flights was 35 minutes (sample statistic in
context being inferred to the population).
In Summary
To include ALL units,
you are looking at:
• POPULATION
• CENSUS
• PARAMETERS
Parameter
Statistic
To work with a subset of
all units, you are
looking at:
• SAMPLE
• STATISTICS
• INFERENCES to a
population
Population
Sample
Example: Identifying Data Sets
In a recent survey, 1708 adults in the United States were asked if
they think global warming is a problem that requires immediate
government action. Nine hundred thirty-nine of the adults said
yes.
Describe the data set. Identify:
The population:
The sample:
A variable being studied:
Values of the Variable:
Source; Adapted from: Pew Research Center; Larson/Farber 4th ed.
Examples: Populations & Samples
• Smoking: Identify the population and sample.
– A survey, 250 college students at Union College were asked if they
smoked cigarettes regularly. Thirty-five of the students said yes.
Identify the population and the sample.
• Student Income: Decide whether the numerical value describes a
population parameter or a sample statistic.
•
A survey of 450 Cornell University students reported their average weekly income
from part-time employment was $325.
• For both of the above studies:
– What are the units of the population/sample?
– Identify a variable being studied.
– Identify values of the variable.
Descriptive Statistics:
• DESCRIPTIVE STATISTICS: Organize and summarize
information using numerical and graphical methods.
– Examples:
• Summarizing the age of cars driven by students in a frequency table.
• Graphing the ages of students.
• Identifying the mean speed of cars driving in a 30 mph zone.
• A descriptive statement describes some aspect of the data.
(Select a statistical measure and put it into sentence format.)
– Examples:
• Thirty-eight percent of the orange trees suffered damage due to the cold
temperatures.
• The average weight for the 23 cars studied was 2,738 lb.
• The mean number of days Otsego Lake was frozen per winter was 88.69 days.
Descriptive Statistics at Work:
SUNY Oneonta Car Registrations
Numeric tables, pictures (graphs & charts), and text are three methods used to present data.
During the 2006 year there were 1.346 cars registered at SUNY Oneonta. Car registrations contain
many variables, such as car type, car color, year of car, and license plate number. Noted below are
ways descriptive statistics are used to convey information about the selected variables: a frequency
table of Registrant Type (i.e. who registered the car); a graphic presentation of Vehicle Age; and
text (written descriptive statement) presenting the mean Vehicle Age, of the registered cars.
Frequency Table:
Graphic presentation (here a Histogram):
Registrant Type
Valid
Commuter
Faculty
Frequency Percent Valid Percent
512
38.0
38.0
Cumulative
Percent
38.0
223
16.6
16.6
54.6
Management
13
1.0
1.0
55.6
Other
58
4.3
4.3
59.9
Resident
287
21.3
21.3
81.2
Staff
253
18.8
18.8
100.0
Total
1346
100.0
100.0
Mean & Median: The Mean age of cars driven by
students was 7.45 years (vs. 6.19 yrs. for employees).
The Median age of registered vehicles for students
was 7.0 years (5.0 years for employees).
Inferential Statistics:
• INFERENTIAL STATISTICS uses sample data to make
estimates, decisions, predictions, or other generalizations
about the population.
– The aim of inferential statistics is to make an inference about a
population, based on a sample (as opposed to a population
census), AND to provide a measure of precision for the method
used to make the inference.
• An inferential statement uses data from a sample and
applies it to a population.
Examples of Inferential Statistics:
• A Gallup Poll found that 57% of dating teens had been out
with somebody of another race or ethnic group (+/- 4.5%;
95% CI)
– Interpretation: We are 95% confident that between 52.5% and 61.5%
(57% +/- 4/5%) of dating teens have been out with someone of a
different race/ethnicity.
• A Gallup Poll found that 40% of Americans would quit their
job if they won the lottery (+/- 4%; 95% CI).
– Interpretation: We are 95% confident that the true population
proportion of Americans who would quit their job if they were to win
a lottery lies between 36% and 44%).
Example: Descriptive and Inferential Statistics
Decide which part of the study represents the
descriptive branch of statistics. What conclusions might
be drawn from the study using inferential statistics?
A large sample of men, aged 48,
was studied for 18 years. For
unmarried men, approximately
70% were alive at age 65. For
married men, 90% were alive at
age 65.
Source: (The Journal of Family Issues)
Larson/Farber 4th ed.
Characteristics of Data
Before conducting any data analysis the characteristics of the variable under study
must be identified. This will result in utilizing appropriate tables, graphs and
statistical analysis.
Two Types of Data
• Qualitative Data can be separated into different
categories (values) that are distinguished by some
nonnumeric characteristic. Qualitative data are also
referred to as categorical or attribute data.
– Examples include gender, eye color, and car brands
– Note that the values of this type of variable are
differentiated by words rather than numeric values.
Example: Eye Color values include blue, brown, hazel,
etc.
• Quantitative Data are “number-based” and
represent counts or measurements. This type of
data may be subdivided into two categories...
• Discrete Data - result when the number of possible
values is either a finite or a countably infinite number.
– Examples: Siblings, Cars, and Coins in a jar (think of whole
number counts here; even if you cannot count them all).
• Continuous Data - result from infinitely many possible
values corresponding to some continuous scale that covers
a range of values without gaps, interruptions, or jumps.
Continuous data can assume any value, including
fractional parts.
– Examples: Height, Weight, Time
N.B.: Qualitative data cannot be classified as discrete or continuous.
Example: Classifying Data by Type
The base prices of several vehicles are shown in the
table. Which data are qualitative data and which are
quantitative data? (Source Ford Motor Company)
Source: Larson/Farber 4th ed.
4 Levels of Measurement
The level of measurement determines which statistical
calculations are meaningful. The four levels of measurement
are: nominal, ordinal, interval, and ratio.
Nominal
Levels
of
Measurement
Ordinal
Interval
Ratio
Lowest
to
highest
Levels of Measurement (cont.)
• Nominal – characterized by data that consist of names,
labels, or categories only. The data cannot be arranged in an
ordering scheme. Qualitative data.
– Examples: Gender, Yes/No, Political Party affiliation,
names of students.
• Ordinal – characterized by data that can be arranged in
some order, but the differences between data values either
cannot be determined or are meaningless. These variables
may be either qualitative (categorical) data or quantitative
(numerical) data.
– Examples: Military Rank, Position in a race, Attitude scales.
Levels of Measurement (cont.)
• Interval – like the ordinal level, with the additional
property that the difference between any two data values is
meaningful. However, there is no natural zero starting point.
Quantitative data.
– Examples: Temperature (F or C); longitude; Calendar
Years.
• Ratio – is the interval level modified to include the natural
zero starting point. At this level, differences and ratios are
both meaningful. Quantitative data.
– Examples: Height, Weight, Time, Age.
Summary of Levels of Measurement
Put data in
categories
Arrange
data in
order
Subtract data
values
Determine if one
data value is a
multiple of another
Nominal
Yes
No
No
No
Ordinal
Yes
Yes
No
No
Interval
Yes
Yes
Yes
No
Ratio
Yes
Yes
Yes
Yes
Level
of
measurement
Example: Classifying Data by Level
Two data sets are shown. Which data set consists of
data at the nominal level? Which data set consists of
data at the ordinal level? (Source: Nielsen Media Research)
Source: Larson/Farber 4th ed.
Example: Classifying Data by Level
Two data sets are shown. Which data set consists of
data at the interval level? Which data set consists of
data at the ratio level? (Source: Major League Baseball)
Source: Larson/Farber 4th ed.
Anatomy of the Basics: Statistical Terms and Relationships
Descriptive Statistics: methods for organizing and
Statistics is the study of how to collect,
organize, analyze, interpret and report
numerical information.
summarizing information. E.g. Number of students in this
class by major, baseball standings, housing sales by month.
Inferential Statistics: methods for drawing conclusions
and measuring the reliability of those conclusions using sample
results. E.g. Political views of all 4-year college students.
Parameter: numerical characteristic of a
Population: all individuals, items, or objects
Population vs. Sample
whose characteristics are being studied.
population.
Census: data collected from ALL members
of the population.
Sample: a portion of the population
Statistic: numerical characteristic of a
selected for study.
sample.
Variable:
a characteristic or property
of an individual unit. Variables
have values.
Qualitative: a variable that cannot be measured
numerically E.g. Gender, eye color.
Discrete: a variable whose values are countable. It can
Quantitative: a variable that can
only assume certain values, with no intermediate values.
E.g. Number of auto accidents in Oneonta in 1998.
be measured numerically.
E.g. Income, height, number of siblings one has.
Continuous: a variable that can assume any numerical
value over an interval or intervals. E.g.Time.
Nominal: grouping individual observations into qualitative
No Arithmetic Operations: individual
observations can only be categorized.
categories or classes. E.g. Grouping individuals by whether they
are left-handed or right-handed.
Ordinal: individual observations are assigned a number or
“ranking.” There is a sense of “more than,” but you cannot say
“how much” more than. E.g. Military ranks.
Scaling of Variables
(Measurement Levels)
Arithmetic Operations: individual
observations have meaningful numeric
values.
Interval: variables have no true zero point. Cannot say
how much more. E.g. Temperature ( F or C), IQ scores.
Ratio: variables have a true zero point. Can say how
much more. E.g. Weight, height.
Misuse of Statistics
ah yes… the old torture the data long enough and they will confess to anything routine...
• Precise Numbers
Tonight’s paid attendance was 56,423
• Guesstimates
It was estimated that one million spectators lined
the rode to L’Alpe d’Heuz for the 16th stage of
the 2004 Tour de France race.
• Distorted Percentages
New and improved with 50% more ... – 50% might
not be a meaningful amount.
• Partial Pictures
Ford truck adds
• Loaded Questions
Line item veto
• Misleading Graphs
Visual distortions of data
• Pictographs
The crescive cow.
• Pollster Pressure
Public bathrooms.
• Small/Bad Samples
67% suspended
• Self-Selected Surveys
CNN phone-in surveys
Pictograph: “This year my business
profits doubled!”
Visual Presentations of Data – Beware
Source: http://findarticles.com
Data Considerations
• Anecdotal Evidence – basing our conclusions
on a few individual cases. e.g. We remember
the airplane crash that kills several hundred
people and fail to notice that data for all flights
show that flying is much safer than driving.
• Lurking Variables – almost all relationships
between two variables are influenced by other
variables lurking in the background.
Airline Flights: Alaska Airlines vs. American West
Which would you choose to fly?
On Time Delayed
Alaska Airlines
America West
3274
(86.7%)
6438
(89.1%)
501
(13.3%)
787
(10.9%)
Alaska Airlines vs. American West
A Closer Look
Alaska Air
America West
On Time
Delayed
On
Time
Delayed
Los Angeles
497
62
694
117
Phoenix
221
12
4840
415
San Diego
212
20
383
65
San Francisco
503
102
320
129
Seattle
1841
305
201
61
TOTAL
3274
501
6438
787
Departure
Location
We now know that American West has a better “On Time” record, but Alaska
Airlines has a better “On Time” record at every airport. How can that be?
Alaska Air
On Time
Delayed
On
Time
Delayed
497
62
694
117
(88.9%)
(11.1)
(85.6)
(14.4)
221
12
4840
415
(94.8)
(5.2)
(92.1)
(7.9)
212
20
383
65
(91.4)
(8.6)
(85.5)
(14.5)
503
102
320
129
(83.1)
(16.9)
(71.3)
(28.7)
1841
305
201
61
(85.8)
(14.2)
(76.7)
(23.3)
3274
501
6438
787
(86.7)
(13.3)
(89.1)
(10.9)
Departure
Location
Los Angeles
Phoenix
San Diego
San Francisco
Seattle
TOTAL
America West
End of Slides
Download