Football in the ’90’s Curtis Olswold University of Iowa 22S Honors Project Sunday Afternoon Ritual • A team’s strategy, or tactical approach to a game is not unique. • There are three dominant types of offense that exist in the NFL: 1) Pass oriented 2) Run oriented 3) Balanced (Run and Pass oriented) Purpose • Construct a model to predict the points a team scores. • Determine the probability that a team wins given certain factors. • Investigate whether or not there exists a significant difference in the points a team scores by year and week. Why Am I Doing This? • Determine what and how certain variables affect the amount of points a team scores • How effective the variables are at determining the outcome of the game: Win or Lose • Rules change almost annually in the NFL to increase the amount of points a team scores, is it really working? The Variables • Score • Rushing Yards • Passing Attempts • Rushing Attempts • Passing Yards • Completions • Outcome • Interceptions • Fumbles The Sample • A random sample was drawn from the population of every regular season week from the 1990 season to the 1999 season. • Individual team names were not identified • From each week of each year, a sample of 5 teams were randomly chosen. This gave a sample of 850 observations. Regression Model Score = 4.92593 +0.15441 * (Rushing Attempts) +0.05858 * (Rushing Yards) - 0.43734 * (Passing Attempts) +0.20470 * (Pass Completions) +0.08080 * (Passing Yards) - 0.56074 * (Intereceptions) - 1.09088 * (Fumbles) Statistics of the Model • R2 is the proportion of variability in Score that is explained by the model. • Adjusted R2 is a measure of how efficient the predictor variables are: Penalizes for overcomplicating the model. • For this model: R-Square Adj R-Sq 0.5020 0.4978 • This indicates the model explains over 50% of the variability in score and is not overly complex Significance of Predictors Parameter Standard Variable DF Estimate Error t Value Pr > |t| Intercept 1 4.92593 1.66448 2.96 0.0032 ratt 1 0.15441 0.04725 3.27 0.0011 ryds 1 0.05858 0.00785 7.47 <.0001 patt 1 -0.43734 0.06043 -7.24 <.0001 comp 1 0.20470 0.10039 2.04 0.0418 pyds 1 0.08080 0.00534 15.12 <.0001 int 1 -0.56074 0.23748 -2.36 0.0184 fumble 1 -1.09088 0.25782 -4.23 <.0001 Interpretation of Significance • Every parameter is significantly different from zero. This means that each of the variables constructively adds to the precision of the model. • The significance level is 0.05, meaning there is only a 5% chance of wrongly rejecting the hypothesis that the parameter is zero, or does not help in prediction. Interpretation of the Model • For every rush attempt a team makes, the model predicts they will score 3/20 of a point. • Every yard that a team gains on the ground suggests 3/50 of a point increase. • When a rush attempt results in a fumble, the team’s score will decrease by 1 and 9/100 of a point. Interpretation of the Model • As a team throws the ball more, for each pass attempt, they will decrease their score by 11/25 of a point. • However, for every completion, they will increase their point total by 1/5 of a point. • For every yard that is gained from the completion of a pass, a team’s score increases by 2/25 of a point. • If a pass attempt is intercepted, then their points scored will decrease by just over ½ of a point. Interpretation of the Model All of this can be summed up quite simply: A rushing team is superior to a passing team.This is magnified if the team is able to gain substantial yardage per rush. Conversely, if a team passes many times, but completes a good percentage of them for good yardage, the effects of the pass attempt statistic are not as prevalent. Examples of Prediction Actual Score 19 24 13 14 11 13 20 45 20 Predicted Value 22.4272 26.3893 5.8283 8.6153 14.5838 14.6197 24.8587 31.7385 15.1015 95% Confidence Level for the Mean 21.1840 23.6705 24.8230 27.9555 4.3773 7.2793 6.3462 10.8845 13.7462 15.4215 13.3944 15.8451 23.7494 25.9680 30.6684 32.8086 13.7705 16.4324 Explanation of the Predictions • The above are the predictions for 9 observations of the sample. • Obviously, none are exact, which should not be expected. • They are, however, relatively close to the actual values. Residual: Error vs. Predicted Test of First and Second Moment Specification DF Chi-Square Pr > ChiSq 35 37.52 0.3543 Diagnostic Checking • Residual, or Prediction Error: 1) Constant Variance: The plot shows that the variance is slightly shaped like a megaphone. The Cook and Weisberg1 formal test indicates that the null hypothesis of constant variance cannot be rejected. 2) Normality: The regression coefficients do not rely upon residual normality assumption to be asymptotically normal2. Diagnostics Continued Variance Inflation 0 2.71820 2.49829 4.37648 5.67120 2.57837 1.18387 1.02425 • The Variance Inflation is a measure of the multicollinearity (linear relationship among 2 or more predictors) of the variables. • None of these indicates severe multicollinearity. Example of a Run vs. Pass Oriented Offense • If a team rushes the ball 35 times in a game gaining 150 yards with 1 fumble, passes 12 times for 115 yards and no interceptions, then on average it will score 23.5 points. If they throw an interception then the points scored reduces to 22.9. • Now suppose a team rushes 12 times for 75 yards without fumbling, passes 35 times, completing 19 for 315 yards with 2 interceptions. They will average 24.085 points. Example of a Balanced Offense • For a team that rushes the ball 25 times for 110 yards with 1 fumble, passes 22 times and completing 12 for 145 yards and 2 interceptions will score on average 17.57 points per game. • If they only throw one interception, then the points scored becomes 18.13. Statistical Comparison of Offenses • Definitions: 1) An offense is run oriented if it’s attempts are 1.5 times or greater than it’s pass attempts. 2) An offense is pass oriented if it’s pass attempts are 1.5 times or more than it’s rush attempts. 3) If a team’s passing and rushing attempts are anywhere within 1.5 of each other, then it is balanced. The ANOVA Procedure Tukey's Studentized Range (HSD) Test for score This test controls the Type I experimentwise error rate. Alpha 0.05 Error Degrees of Freedom 847 Error Mean Square 89.94897 Critical Value of Studentized Range 3.32034 Comparisons significant at the 0.05 level indicated by ***. Difference orient Between Simultaneous 95% Comparison Means Confidence Limits Run - Bala 5.2083 2.8845 7.5320 *** Run - Pass 9.2933 6.7978 11.7888 *** Bala - Pass 4.0850 2.3737 5.7963 *** Interpretation of Comparisons • There is a difference between the orientations of teams. • In fact, they are all different from each other! • Run oriented teams will actually score more points than both pass oriented and balanced offenses. • Balanced offenses score more often than pass oriented teams. • Why? Possibly due to the fact that more time is used by running the football than by passing. Determining the Probability of Winning the Game • A win is given a value of 1. If a team ties or loses, they are given a value of 0. • The only variables that are in a coach’s immediate control are whether they run or pass the ball on offense. • For this reason, only rushing and passing attempts will be used as independent variables. Distribution of Wins and Losses Frequencies of Game Outcomes Cumulative Cumulative Outcome Loss Tie Win Frequency Percent Frequency Percent 426 50.12 426 50.12 23 2.71 449 52.82 47.18 850 100.00 401 Method of Analysis • Logistic Regression will be used to model the probability that a team wins. • The form of the model is: (eβ0 + β1 * rushes +β2 *passes) (1 + eβ0 + β1 * rushes +β2 *passes) Estimation of Parameters Analysis of Maximum Likelihood Estimates Standard Parameter DF Estimate Error Chi-Square Pr >ChiSq Intercept 1 -2.1140 0.5403 15.3082 <.0001 ratt 1 0.1259 0.0119 112.5931 <.0001 patt 1 -0.0481 0.0107 20.1301 <.0001 Interpretation of the Model • Both Rushing and Passing Attempts are significant factors in determining the probability of winning a game. • The parameter estimates are in the form of the natural logarithm. • Odds Ratios will give more insight into how the model is affected by rushing and passing. Fit of the Model Hosmer and Lemeshow Goodness-of-Fit Test Chi-Square 9.2815 DF 8 Pr > ChiSq 0.3191 This shows that there is not evidence for lack of model fit. Odds Ratios Effect Point Estimate ratt patt 1.134 0.953 95% Wald Confidence Limits 1.108 0.933 1.161 0.973 Interpretation of the Odds Ratios • For a one attempt increase in Rushing Attempts, the odds in favor of winning are multiplied by 1.134. • For every one Pass Attempt, the odds in favor of winning are multiplied by 0.953. Conversion into Probabilities • The equation for the probability of winning a game: P(Win) = 1 / ( 1 + eβ0 + β1 * rushes +β2 *passes) • This yields: P(Win) = 1 / (1 + e –2.114+ .1259 * rushes +-.0481 *passes) Some Examples • For a team rushing 25 times and passing 25 times, the model yields a probability of .458 that they will win the game, or a 45.8% chance they will win. • If a team rushes 35 times and passes only 15 times, their probability of winning is .827, or nearly an 83% chance of victory. • Now, say that team rushes only 15 times and passes 35 times, the probability changes to .129 or a 13% chance of winning. What the Model Does Not Suggest • Given the model predicts a higher success rate if a team rushes the ball, it may seem that a team should never pass. If this is done, the model gives a 98.5% chance of victory for 50 rushes and no passes. • Obviously, if the other team knows you are never going to pass, you won’t be able to move the ball 10 yards on 3 plays very consistently. This shows how real world circumstances aren’t always modeled perfectly. Another Consideration • The model also does not take into account middle of the game strategies. In other words, the farther you are behind, the more passes your team will attempt. Why? Less time is taken off of the game clock by passing. Does the Year and Week affect Points Scored? • • (1) (2) (3) (4) Year in and year out rules are changed to increase scoring. Rule changes include: 2 point conversions allowed Defensive Line Encroachment Rules The 5-Yard Bump Rule on Receivers Etc……. 2 Way ANOVA for Points Scored, Year and Week Sum of Source DF Squares Mean Square F Value Model 25 321.405283 12.856211 Error 824 9509.705603 11.540905 C Total 849 9831.110886 1.11 Pr > F 0.3186 R-Square Coeff Var Root MSE tscore Mean 0.032693 38.39034 3.397191 8.849077 Source DF Type III SS Mean Square F Value Pr > F year 9 133.2107197 14.8011911 1.28 0.2423 week 16 188.1945631 11.7621602 1.02 0.4333 Interpretation of the 2 Way ANOVA • The model indicates there is not sufficient evidence to conclude that Year and Week have no effect on how many points are scored. • This means that for any given week in any given year, the points scored by a team is not affected, in this model. Conclusion All 3 statistical models point towards Rushing Attempts as being the important statistic in determining the points a team scores, and whether or not they win the game. Ball control is thus the essence to winning a football game. This is most readily seen by a team that rushes with consistency. A team is in better position to win if they can run and pass only occasionally. References (1) Applied Linear Regression, 2nd Edition, pp.135-136 Sanford Weisberg Publisher: John Wiley and Sons, 1985 (2) Applied Linear Statistical Models, 4th Edition, pp. 54-55 Neter, Kutner, Nachtsteim, Wasserman Publisher: Irwin (Chicago) 1996 (3) Professor Kate Cowles University of Iowa Department of Statistics and Actuarial Science (4) Data collected from: http://www.mrncaa.com