Chapter 4 Describing the Relation between Two Variables
4.1 Scatter Diagrams and Correlation
The _______________________is the variable whose value can be explained by the value of
the__________________ or ___________________.
A _________________ is a graph that shows the relationship between two quantitative variables
measured on the same individual. Each individual in the data set is represented by a point in the scatter
diagram.
I. Scatter plot
(x)
# hour
of sleep
6
8
10
2
(y)
performance
3
5
4
1
1
II. Correlation coefficient (r)
The linear correlation coefficient or Pearson product moment correlation coefficient is a measure of the
strength and direction of the linear relation between two quantitative variables. The Greek letter ρ (rho)
represents the population correlation coefficient, and r represents the sample correlation coefficient.
We present only the formula for the sample correlation coefficient.
Sample Linear Correlation Coefficient
r
 xi  x   yi  y 
  s   s 
x
y
n 1
x
where
is the sample mean of the explanatory variable
sx is the sample standard deviation of the explanatory variable
y
is the sample mean of the response variable
sy is the sample standard deviation of the response variable
n is the number of individuals in the sample
Properties of the Linear Correlation Coefficient
1. The linear correlation coefficient is always between –1 and 1, inclusive. That is, –1 ≤ r ≤ 1.
2. If r = + 1, then a perfect positive linear relation exists between the two variables.
3. If r = –1, then a perfect negative linear relation exists between the two variables.
4. The closer r is to +1, the stronger is the evidence of positive association between the two
variables.
5. The closer r is to –1, the stronger is the evidence of negative association between the two
variables.
6. If r is close to 0, then little or no evidence exists of a linear relation between the two variables.
So r close to 0 does not imply no relation, just no linear relation.
7. The linear correlation coefficient is a unit less measure of association. So the unit of measure for
x and y plays no role in the interpretation of r.
8. The correlation coefficient is not resistant. Therefore, an observation that does not follow the
overall pattern of the data could affect the value of the linear correlation coefficient.
2
EXAMPLE Determining the Linear Correlation Coefficient
Determine the linear correlation coefficient of the drilling data.
Testing for a Linear Relation
• Step 1 Determine the absolute value of the correlation coefficient
• Step 2 Find the critical value in Table II from Appendix A for the given sample size
• Step 3 If the absolute value of the correlation coefficient is greater than the critical
value, we say a linear relation exists between the two variables. Otherwise, no linear
relation exists.
EXAMPLE Does a Linear Relation Exist?
4.2 Least-Squares Regression
EXAMPLE Finding an Equation that Describes Linearly Relate Data
Using the following sample data:
3
(a) Find a linear equation that relates x (the explanatory variable) and y (the response
variable) by selecting two points and finding the equation of the line containing the
points.
(b) Graph the equation on the scatter diagram.
(c) Use the equation to predict y if x = 3.
The difference between the observed value of y and the predicted value of y is the error, or residual.
Using the line from the last example, and the predicted value at x = 3:
residual = observed y – predicted y
Least-Squares Regression Criterion
If there is positive / negative correlation between X and Y, find the best fitted line for the data.
The least-squares regression line is the line that minimizes the sum of the squared errors (or residuals).
This line minimizes the sum of the squared vertical distance between the observed values of y and those
predicted by the line
the squared errors).
ŷ , (“y-hat”). We represent this as “minimize Σ residuals2 ” (minimizes the sum of
4
The Least-Squares Regression Line
The equation of the least-squares regression line is given by
____________________
where ________________ is the slope of the least-squares regression line
and __________________ is the y-intercept of the least-squares regression line
The Least-Squares Regression Line
Note: is the sample mean and sx is the sample standard deviation of the explanatory variable x ; is the
sample mean and sy is the sample standard deviation of the response variable y.
EXAMPLE Finding the Least-squares Regression Line
Using the drilling data
(a) Find the least-squares regression line.
(b) Predict the drilling time if drilling starts at 130 feet.
(c) Is the observed drilling time at 130 feet above, or below, average.
(d) Draw the least-squares regression line on the scatter diagram of the data.
Interpretation of Slope:
Interpretation of the y-Intercept:
Caution: If the least-squares regression line is used to make predictions based on values of the
explanatory variable that are much larger or much smaller than the observed values, we say the
researcher is working outside the scope of the model. Never use a least-squares regression line to make
5
predictions outside the scope of the model because we can’t be sure the linear relation continues to
exist.
Predictions When There is No Linear Relation:
When the correlation coefficient indicates no linear relation between the explanatory and response
variables, and the scatter diagram indicates no relation at all between the variables, then we use the
mean value of the response variables, then we use the mean value of the response variable as the
predicted value so that ŷ  y
Summary
1. Use StatCrunch to plot a scatter plot
2. Use StatCrunch to calculate r
3. Determine whether there is a positive/negative linear correlation between X and Y.
4. If there is a linear correlation between X and Y, use StatCrunch to find the least squares regression
line. Otherwise, do not find the least squares regression line.
5. When a value is assigned to X  if there is a correlation between X and Y, use the least squares
regression line to find the best predicted Y.
6. When a value is assigned to X  if there is no correlation between X and Y, use StatCrunch to find
y and the best predicted Y is y for any X.
6