7 Advanced Regression Analysis Business Analytics, 1e By Sanjiv Jaggia, Alison Kelly, Kevin Lertwachara, and Leida Chen 8/17/2020 Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-1 Chapter 7 Learning Objectives (LOs) LO 7.1 Estimate and interpret regression models with interaction variables. LO 7.2 Estimate and interpret nonlinear regression models. LO 7.3 Estimate and interpret linear probability and logistic regression models. LO 7.4 Use cross-validation techniques to evaluate regression models. 7-2 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-2 Use Gender_Gap 7-3 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-3 Introductory Case: Gender Gap in Manager Salaries • Is there a gender gap in salaries for project managers? Data on 200 managers in small- to middle-sized firms in Boston: – – – – – Salary (in $1,000’s) The number of employees at the firm (Size, number of employees) The manager’s years of experience (Experience, in years) Whether or not the manager is a female (Female equals 1 if the manager is female, 0 otherwise) Whether or not the manager has a graduate degree (Grad equals 1 if the manager has a graduate degree, 0 otherwise) 1. Analyze the determinants of a project manager’s salary. 2. Estimate and interpret a regression model with relevant interaction variables. 3. Determine whether there is evidence of a gender gap in salaries. 7-4 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-4 7.1: Regression Models with Interaction Variables (1/15) • Recall the sample regression equation ๐ฆเท = ๐0 + ๐1 ๐ฅ1 + ๐2 ๐ฅ2 + โฏ + ๐๐ ๐ฅ๐ . – • • • • – ๐๐ measures the change in the predicted value of the response given in a unit increase ๐ฅ๐ , holding all other predictor variables constant. ๐๐ is the partial (or marginal) effect of ๐ฅ๐ on ๐ฆเท (the partial derivative). – This partial effect does not depend on other predictor variables. The interaction effect in a regression model occurs when the partial effect of a predictor variable on the response depends on the value of another predictor variable. Example: An additional bedroom results in a higher increase in house prices for larger houses than smaller houses. Here, the effect of an additional bedroom depends on house size. An interaction variable is the product of predictor variables. Three types of interaction variables: – – – The interaction between two dummy variables The interaction between a dummy variable and a numerical variable The interaction between two numerical variables 7-5 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-5 7.1: Regression Models with Interaction Variables (2/15) • Consider a regression model with two dummy variables ๐1 and ๐2 , and an interaction variable ๐1 ๐2 . ๐ฆเท = ๐0 + ๐1 ๐1 + ๐2 ๐2 + ๐3 ๐1 ๐2 • The partial effect of ๐1 on ๐ฆเท is ๐1 + ๐3 ๐2, this depends on ๐2 . – ๐2 = 0: the partial effect of ๐1 on ๐ฆเท is ๐1 – ๐2 = 1: the partial effect of ๐1 on ๐ฆเท is ๐1 + ๐3 • The partial effect of ๐2 on ๐ฆเท is ๐2 + ๐3 ๐1, this depends on ๐1 . – ๐1 = 0: the partial effect of ๐2 on ๐ฆเท is ๐2 – ๐1 = 1: the partial effect of ๐2 on ๐ฆเท is ๐2 + ๐3 • Tests of significance can be conducted on the interaction variables. 7-6 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-6 Use Salary_MIS 7-7 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-7 7.1: Regression Models with Interaction Variables (3/15) • Example: Data were collected on the starting salary of business graduates (Salary in $1,000s) along with their cumulative GPA, whether they have an MIS concentration (MIS = 1 if yes, 0 otherwise), and whether they have a statistics minor (Statistics = 1 if yes, 0 otherwise). a. Estimate and interpret the effect of GPA, MIS, and Statistics on Salary. Predict the salary of a business graduate with and without a MIS concentration and a statistics minor. Use a GPA of 3.5 for making predictions. Extend the model from part a to include the interaction between MIS and Statistics. Predict the salary of a business graduate with and without a MIS concentration and a statistics minor. Use a GPA of 3.5 for making predictions. b. 7-8 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-8 7.1: Regression Models with Interaction Variables (4/15) 7-9 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-9 7.1: Regression Models with Interaction Variables (5/15) เทฃ = 44.0073 + 6.6227๐บ๐๐ด + 6.6071๐๐ผ๐ + 6.7309๐๐ก๐๐ก๐๐ ๐ก๐๐๐ • ๐๐๐๐๐๐ฆ • All predictor variables exert a positive and significant influence on the starting salary. • The MIS concentration and a statistics minor are predicted to fetch an additional starting salary of $6,607 and $6,731. • No MIS concentration and no statistics minor – ๐บ๐๐ด = 3.5, ๐๐ผ๐ = 0, ๐๐ก๐๐ก๐๐ ๐ก๐๐๐ = 0 เทฃ = 44.0073 + 6.6227 ∗ 3.5 + 6.6071 ∗ 0 + 6.7309 ∗ 0 – ๐๐๐๐๐๐ฆ – The predicted salary is $67,187. • MIS concentration and statistics minor – ๐บ๐๐ด = 3.5, ๐๐ผ๐ = 1, ๐๐ก๐๐ก๐๐ ๐ก๐๐๐ = 1 เทฃ = 44.0073 + 6.6227 ∗ 3.5 + 6.6071 ∗ 1 + 6.7309 ∗ 1 – ๐๐๐๐๐๐ฆ – The predicted salary is $80,525. 7-10 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-10 7.1: Regression Models with Interaction Variables (6/15) • • • • เทฃ = 44.0993 + 6.7109๐บ๐๐ด + 5.3250๐๐ผ๐ + 5.5350๐๐ก๐๐ก๐๐ ๐ก๐๐๐ + ๐๐๐๐๐๐ฆ ๐. ๐๐๐๐(๐ด๐ฐ๐บ ∗ ๐บ๐๐๐๐๐๐๐๐๐) The interaction is positive and significant. The coefficient indicates that graduates with an MIS concentration and Statistics minor earn $3,492 more than graduates with an MIS concentration or Statistics minor. This model has a higher adjusted ๐ 2 and provides a better fit. No MIS concentration and no statistics minor – ๐บ๐๐ด = 3.5, ๐๐ผ๐ = 0, ๐๐ก๐๐ก๐๐ ๐ก๐๐๐ = 0, ๐๐ผ๐ ∗ ๐๐ก๐๐ก๐๐ ๐ก๐๐๐ = 0 – เทฃ = 44.0993 + 6.7109 ∗ 3.5 + 5.3250 ∗ 0 + 5.5350 ∗ 0 + 3.4915(0 ∗ 0) ๐๐๐๐๐๐ฆ – The predicted salary is $67,588. • MIS concentration and statistics minor – ๐บ๐๐ด = 3.5, ๐๐ผ๐ = 1, ๐๐ก๐๐ก๐๐ ๐ก๐๐๐ = 1, ๐๐ผ๐ ∗ ๐๐ก๐๐ก๐๐ ๐ก๐๐๐ = 1 เทฃ = 44.0993 + 6.7109 ∗ 3.5 + 5.3250 ∗ 0 + 5.5350 ∗ 0 + 3.4915(1 ∗ 1) – ๐๐๐๐๐๐ฆ – The predicted salary is $81,939. 7-11 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-11 7.1: Regression Models with Interaction Variables (7/15) • Consider a regression model with a numerical variable ๐ฅ, a dummy variable ๐, and an interaction variable ๐ฅ๐. ๐ฆเท = ๐0 + ๐1 ๐ฅ + ๐2 ๐ + ๐3 ๐ฅ๐ • The partial effect of ๐ฅ on ๐ฆเท is ๐1 + ๐3 ๐, this depends on ๐. – ๐ = 0: the partial effect of ๐ฅ on ๐ฆเท is ๐1 – ๐ = 1: the partial effect of ๐ฅ on ๐ฆเท is ๐1 + ๐3 • The partial effect of ๐ on ๐ฆเท is ๐2 + ๐3 ๐ฅ, this depends on ๐ฅ. – Difficult to interpret because ๐ฅ is numerical – Common to interpret this partial effect at the sample mean ๐ฅาง – At ๐ฅ,าง the partial effect of ๐ on ๐ฆเท is ๐2 + ๐3 ๐ฅาง – ๐3 > 0: the partial effect on ๐ฆเท will be greater (smaller) at values higher (lower) than ๐ฅาง 7-12 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-12 Use BP_Race 7-13 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-13 7.1: Regression Models with Interaction Variables (8/15) • Example: A public policy researcher in Atlanta surveyed 150 adult men in the 55–60 age group. Data were collected on their systolic pressure, weight (in pounds), and race (Black = 1 for African American, 0 otherwise). a. Estimate and interpret the effect of Weight and Black on systolic pressure. Predict the systolic pressure of black and nonblack adult men with a weight of 180 pounds. Extend the model in part a to include the interaction between Weight and Black. Predict the systolic pressure of black and nonblack adult men with a weight of 180 pounds. b. 7-14 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-14 7.1: Regression Models with Interaction Variables (9/15) 7-15 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-15 7.1: Regression Models with Interaction Variables (10/15) เทฃ = 80.2085 + 0.3901๐๐๐๐โ๐ก + 6.9082๐ต๐๐๐๐ a. ๐๐ฆ๐ ๐ก๐๐๐๐ – ๐๐๐๐โ๐ก = 180, ๐ต๐๐๐๐ = 1 เทฃ = 80.2085 + 0.3901 ∗ 180 + 6.9082 ∗ 1 • ๐๐ฆ๐ ๐ก๐๐๐๐ • The predicted systolic pressure is 157. – ๐๐๐๐โ๐ก = 180, ๐ต๐๐๐๐ = 0 เทฃ = 80.2085 + 0.3901 ∗ 180 + 6.9082 ∗ 0 • ๐๐ฆ๐ ๐ก๐๐๐๐ • The predicted systolic pressure is 150. เทฃ = 70.8312 + 0.4362๐๐๐๐โ๐ก + 30.2482๐ต๐๐๐๐ − 0.1118๐๐๐๐โ๐ก ∗ ๐ต๐๐๐๐ b. ๐๐ฆ๐ ๐ก๐๐๐๐ – ๐๐๐๐โ๐ก = 180, ๐ต๐๐๐๐ = 1, ๐๐๐๐โ๐ก ∗ ๐ต๐๐๐๐ = 180 เทฃ = 70.8312 + 0.4362 ∗ 180 + 30.2482 ∗ 1 − 0.1118 ∗ 180 ∗ 1 • ๐๐ฆ๐ ๐ก๐๐๐๐ • The predicted systolic pressure is 159. – ๐๐๐๐โ๐ก = 180, ๐ต๐๐๐๐ = 0, ๐๐๐๐โ๐ก ∗ ๐ต๐๐๐๐ = 0 เทฃ = 70.8312 + 0.4362 ∗ 180 + 30.2482 ∗ 0 − 0.1118 ∗ 180 ∗0 • ๐๐ฆ๐ ๐ก๐๐๐๐ • The predicted systolic pressure is 149. 7-16 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-16 7.1: Regression Models with Interaction Variables (11/15) • Consider a regression model with two numerical variables, ๐ฅ1 and ๐ฅ2 , and an interaction variable ๐ฅ1 ๐ฅ2 . ๐ฆเท = ๐0 + ๐1 ๐ฅ1 + ๐2 ๐ฅ2 + ๐3 ๐ฅ1 ๐ฅ2 • The partial effect of ๐ฅ1 on ๐ฆเท is ๐1 + ๐3 ๐ฅ2 , this depends on ๐ฅ2 . • The partial effect of ๐ฅ2 on ๐ฆเท is ๐2 + ๐3 ๐ฅ1 , this depends on ๐ฅ1 . • The partial effects of both variables are difficult to interpret. • Consider the partial effects at the sample means ๐ฅาง1 and ๐ฅาง2 . – At ๐ฅาง1 , the partial effect of ๐ฅ2 on ๐ฆเท is ๐2 + ๐3 ๐ฅาง1 . – ๐3 > 0: the partial effect on ๐ฆเท will be greater (smaller) at values higher (lower) than ๐ฅาง1 7-17 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-17 Use Marketing_MSA 7-18 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-18 7.1: Regression Models with Interaction Variables (12/15) • Example: Consider the data collected on the number of applications received (Applicants), marketing expense (Marketing, in $1,000s), and the percentage employed within three months (Employed). a. Estimate and interpret the effect of Marketing and Employed on the number of applications received. For a given marketing expense of $80,000, predict the number of applications received if 50% of the graduates were employed within three months. Repeat the analysis with 80% employed within three months. b. Extend the model in part a to include the interaction between Marketing and Employed. For a given marketing expense of $80,000, predict the number of applications received if 50% of the graduates were employed within three months. Repeat the analysis with 80% employed within three months. 7-19 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-19 7.1: Regression Models with Interaction Variables (13/15) 7-20 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-20 7.1: Regression Models with Interaction Variables (14/15) เทฃ ๐ด๐๐๐๐๐๐๐๐ก๐ = −49.5490 + 0.3550๐๐๐๐๐๐ก๐๐๐ + 1.1049๐ธ๐๐๐๐๐ฆ๐๐ a. – – – Given Employment, a $10,000 increase in the marketing expense is predicted to bring in 3.55 more applicants. Given Marketing, a 10% increase in Employed brings in 10.149 more applicants. ๐๐๐๐๐๐ก๐๐๐ = 90, ๐ธ๐๐๐๐๐ฆ๐๐ = 50 เทฃ • ๐ด๐๐๐๐๐๐๐๐ก๐ = −49.5490 + 0.3550 ∗ 90 + 1.1049 ∗ 50 • The predicted number of applicants is 30. – ๐๐๐๐๐๐ก๐๐๐ = 90, ๐ธ๐๐๐๐๐ฆ๐๐ =80 เทฃ • ๐ด๐๐๐๐๐๐๐๐ก๐ = −49.5490 + 0.3550 ∗ 90 + 1.1049 ∗ 80 • The predicted number of applicants is 60. b. เทฃ ๐ด๐๐๐๐๐๐๐๐ก๐ = −16.6359 + 0.0865๐๐๐๐๐๐ก๐๐๐ + 0.5405๐ธ๐๐๐๐๐ฆ๐๐ + 0.0039๐๐๐๐๐๐ก๐๐๐ ∗ ๐ธ๐๐๐๐๐ฆ๐๐ – ๐๐๐๐๐๐ก๐๐๐ = 90, ๐ธ๐๐๐๐๐ฆ๐๐ = 50, ๐๐๐๐๐๐ก๐๐๐ ∗ ๐ธ๐๐๐๐๐ฆ๐๐ = 90 ∗ 50 • The predicted number of applicants is 33. – ๐๐๐๐๐๐ก๐๐๐ = 90, ๐ธ๐๐๐๐๐ฆ๐๐ = 80, ๐๐๐๐๐๐ก๐๐๐ ∗ ๐ธ๐๐๐๐๐ฆ๐๐ = 90 ∗80 • The predicted number of applicants is 59. 7-21 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-21 Use Gender_Gap 7-22 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-22 7.1: Regression Models with Interaction Variables (15/15) • Example: The objective outlined in the introductory case is to analyze a possible gender gap in the salaries of project managers. 7-23 BUSINESS ANALYTICS, 1e | Jaggia, Kelly, Copyright © 2021 McGraw-Hill Education. AllLertwachara, rights reserved.Chen No reproduction or distribution without the prior written consent of McGraw-Hill Education. Copyright © 2021 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education. 7-23
0
You can add this document to your study collection(s)
Sign in Available only to authorized usersYou can add this document to your saved list
Sign in Available only to authorized users(For complaints, use another form )