Grading and Grade Inflation at Georgia Tech Preliminary Report to the Academic Senate April 22, 2003 Grade Inflation Defined The upward shift in the grade point average (GPA) of students over an extended period of time without a corresponding increase in student achievement. Goldman, L. 1985. “The Betrayal of the Gatekeepers: Grade Inflation.” Journal of General Education 37 (2): 97-121 Methodology • Extensive study of literature • Survey of peers and other institutions of higher education • Statistical analysis of Georgia Tech data – Focus on undergraduate level only – Historic perspective – In-depth study of last 10 years by department Georgia Tech’s Peer Institutions • • • • • • • • • • CalTech Carnegie-Mellon Cornell Johns Hopkins MIT Northwestern Stanford NC State Penn State Purdue • • • • • • • • • • Texas A & M UC-Berkeley UCLA Florida Illinois-Urbana Michigan Minnesota Texas Washington Virginia Tech Other Institutions Reviewed • University of Arizona • University of North CarolinaChapel Hill • Harvard University • Louisiana State University • Hood College Peer Review • Surveyed 10 peers for recent grade inflation studies at their own institutions • Compiled grading definitions, including the use of plus/minus systems, at all 20 peers • Review of grade inflation studies at other institutions, most notably UNC-Chapel Hill and Harvard Of the 10 Peers Surveyed… • Five had conducted studies on grading and grade inflation • These five “studies” ranged from the effects of a plus/minus grading system to charts showing SAT score plotted against GPA • Interesting responses from Berkeley and MIT regarding need to do such studies Grade Definitions at Peers • Most use 4.0 scale • Standard: A = Excellent, B=Good, C=Satisfactory, D=Poor/Passing, F=Failure • CalTech and MIT use Pass/Fail in freshman year • 14 peers use some form of plus/minus grading system Cause for Alarm? • At Princeton, the median GPA for the class of 1973 was 3.09; in 2000 it was 3.36 • At Dartmouth, the average GPA has risen from 2.70 to 3.33 from 1967 to 2001 • At Harvard, over the last three years, more than 50% of the grades awarded have been A’s • At Georgia Tech, the average overall GPA in Fall 1985 was 2.59; last Fall, it was 2.86 Fall 2002 Fall 2001 Fall 2000 Fall 1999 Fall 1998 Fall 1997 Fall 1996 Fall 1995 Fall 1994 Fall 1993 Fall 1992 Fall 1991 Fall 1990 Fall 1989 Fall 1988 Fall 1987 Fall 1986 Fall 1985 Fall 1984 Fall 1983 Fall 1982 Fall 1981 Fall 1980 Fall 1979 Fall 1978 Fall 1977 Fall 1976 Fall 1975 Fall 1974 Fall 1973 Fall 1972 Georgia Tech GPA Georgia Tech Undergraduate GPA Fall 1972 through Fall 2002 3 2.9 2.8 2.7 2.6 2.5 2.4 2.3 2.2 Georgia Tech University of Washington University of Florida Princeton University of NC-Chapel Hill Texas A&M Purdue University Harvard Fall 2002 Fall 2001 Fall 2000 Fall 1999 Fall 1998 Fall 1997 Fall 1996 Fall 1995 Fall 1994 Fall 1993 Fall 1992 Fall 1991 Fall 1990 Fall 1989 Fall 1988 Fall 1987 Fall 1986 Fall 1985 Fall 1984 Fall 1983 Fall 1982 Fall 1981 Fall 1980 Fall 1979 Fall 1978 Fall 1977 Fall 1976 Fall 1975 Fall 1974 Fall 1973 Fall 1972 GT vs. Other Institutions Comparison of Georgia Tech Undergraduate GPAs vs. Other Institutions Various Time Frames 3.6 3.4 3.2 3 2.8 2.6 2.4 2.2 Harvard’s Solution: Policy Change • 15-point grading scale became the more common 4-point scale • Honor degrees will be awarded to a limited percentage of each graduating class (20% summa cum laude and magna cum laude combined and 50% overall) Where Does Georgia Tech Stand: Student Expectations Fall 2000 Freshmen Anticipated GPA All 3.5-4.0 40.6% 3.0-3.4 53.3% 2.5-2.9 5.6% 2.0-2.4 0.2% < 2.0 0.3% Cumulative Spring 2001 GPA < 2.0 2.0-2.4 2.5-2.9 3.0-3.4 3.5-4.0 11.4% 11.4% 16.1% 27.1% 34.1% 12.0% 19.0% 24.9% 24.3% 19.8% 7.9% 42.1% 23.7% 23.7% 2.6% 0.0% 100.0% 0.0% 0.0% 0.0% 50.0% 50.0% 0.0% 0.0% 0.0% Input Dynamics: High School GPA and Admissions Index Freshman Cohorts Fall 1993-Fall 2002 High School GPA, Georgia Tech GPA, and Admissions Index 4 3.9 GT GPA HSGPA Admissions Index 3.8 3.7 3.6 Correlation Between GT GPA and HSGPA 3.5 3.4 3.75 3.3 3.2 3.1 3.70 3 2.9 3.65 HS GPA 2.8 2.7 2.6 3.60 3.50 2.8 2.85 2.9 2.95 GT GPA 3 3.05 3.1 Fall 2002 Fall 2001 Fall 2000 Fall 1999 Fall 1998 Fall 1997 Fall 1996 Fall 1995 3.55 Fall 1994 Fall 1993 2.5 Freshman Cohorts Fall 1993-Fall 2002 High School GPA by Ethnicity 4 Asian 3.9 Black Hispanic Multi-racial White All 3.8 3.7 3.6 3.5 3.4 3.3 3.2 3.1 Fall 2002 Fall 2001 Fall 2000 Fall 1999 Fall 1998 Fall 1997 Fall 1996 Fall 1995 Fall 1994 Fall 1993 3 Incoming Student Performance 2002 Freshman Cohort 1994 Freshman Cohorts Fall 1994 GT Cumulative GPA 4 3.5 3 Fall 2002 GT Cumulative GPA 4 3.5 3 2.5 2 1.5 1 0.5 2.5 0 2 2 2.25 2.5 2.75 3 High School GPA 1.5 1 0.5 0 2 2.25 2.5 2.75 3 High School GPA 3.25 3.5 3.75 4 3.25 3.5 3.75 4 Impact of Instructor Tenure Status Fall 1999 Lower Division Upper Division A B C D F Not Tenured/ Not Tenure Track 31.82% 32.75% 21.71% 7.73% 6.00% Tenure Track 33.46% 35.91% 20.60% 5.58% 4.44% Tenured 29.00% 32.36% 25.32% 7.73% 5.59% Not Tenured/ Not Tenure Track 46.72% 31.94% 14.33% 4.39% 2.61% Tenure Track 40.10% 36.18% 15.87% 4.18% 3.67% Tenured 36.45% 34.54% 20.93% 5.31% 2.78% 33.86% 33.28% 21.47% 6.65% 4.74% A B C D F Not Tenured/ Not Tenure Track 34.59% 33.38% 19.86% 6.90% 5.27% Tenure Track 33.30% 32.65% 22.75% 6.76% 4.54% Tenured 31.08% 34.63% 23.55% 6.46% 4.28% Not Tenured/ Not Tenure Track 45.84% 36.62% 13.00% 2.71% 1.83% Tenure Track 40.89% 37.35% 16.45% 3.29% 2.02% Tenured 41.83% 34.45% 16.99% 4.13% 2.60% 36.93% 34.46% 19.16% 5.55% 3.90% Total Fall 2002 Lower Division Upper Division Total Georgia Tech 4000 Level Grade Distribution F 1.5% D 3.3% A 42.0% Fiscal Year 1993, 1999, 2002 C 16.5% F 1.5% D 2.9% C 14.0% A 47.3% B 34.2% B 36.6% FY 1999 FY 1993 F 1.0% D 2.0% C 11.8% A 51.9% B 33.4% FY 2002 1000 Level Grade Distribution (%) College Georgia Tech Architecture Computing Engineering Ivan Allen College Sciences FY A B C D F 1993 31.79% 35.43% 23.06% 6.16% 3.57% 2002 36.53% 33.39% 18.63% 6.60% 4.85% Increase or Decrease 4.74% -2.04% -4.43% 0.44% 1.28% 1993 53.39% 31.05% 12.74% 1.45% 1.37% 2002 79.30% 15.55% 3.60% 0.41% 1.13% Increase or Decrease 25.91% -15.50% -9.14% -1.04% -0.24% 1993 29.30% 31.67% 22.46% 9.47% 7.10% 2002 26.92% 29.92% 21.72% 10.79% 10.65% Increase or Decrease -2.38% -1.75% -0.74% 1.32% 3.55% 1993 36.97% 34.22% 19.44% 5.71% 3.66% 2002 41.67% 41.51% 13.81% 1.67% 1.35% Increase or Decrease 4.70% 7.29% -5.63% -4.04% -2.31% 1993 30.06% 42.03% 22.34% 3.87% 1.69% 2002 40.46% 40.80% 13.97% 2.80% 1.96% Increase or Decrease 10.40% -1.23% -8.37% -1.07% 0.27% 1993 30.60% 31.40% 25.15% 8.04% 4.80% 2002 33.96% 31.04% 21.59% 8.20% 5.21% Increase or Decrease 3.36% -0.36% -3.56% 0.16% 0.41% 4000 Level Grade Distribution (%) College Georgia Tech Architecture Computing Engineering Ivan Allen College Management Sciences FY A B C D F 1993 42.00% 36.63% 16.48% 3.34% 1.55% 2002 51.88% 33.38% 11.77% 1.99% 0.98% Increase or Decrease 9.88% -3.25% -4.71% -1.35% -0.57% 1993 36.02% 36.30% 20.65% 4.98% 2.05% 2002 44.39% 34.24% 15.87% 3.52% 1.98% Increase or Decrease 8.37% -2.06% -4.78% -1.46% -0.07% 1993 45.14% 34.84% 14.91% 2.39% 2.73% 2002 51.38% 31.89% 13.52% 2.14% 1.07% Increase or Decrease 6.24% -2.95% -1.39% -0.25% -1.66% 1993 42.54% 36.13% 16.84% 3.20% 1.29% 2002 50.49% 33.47% 13.25% 2.06% 0.73% Increase or Decrease 7.95% -2.66% -3.59% -1.14% -0.56% 1993 52.52% 32.91% 11.09% 2.12% 1.37% 2002 61.45% 29.90% 6.66% 0.61% 1.38% Increase or Decrease 8.93% -3.01% -4.43% -1.51% 0.01% 1993 27.50% 42.53% 25.07% 3.92% 0.98% 2002 43.13% 37.92% 14.69% 3.32% 0.94% Increase or Decrease 15.63% -4.61% -10.38% -0.60% -0.04% 1993 40.05% 34.95% 17.01% 5.30% 2.69% 2002 51.76% 32.60% 10.59% 2.70% 2.36% Increase or Decrease 11.71% -2.35% -6.42% -2.60% -0.33% Average Textile and Fiber Engr Public Policy Psychology Physics Modern Languages Mechanical Engineering Mathematics Materials Science & Engr Management Literature, Comm & Culture International Affairs Industrial & Systems Engr Hist, Technology & Society Electrical & Computer Engr Fall 1993 Economics Earth & Atmospheric Sci Civil & Environmental Engr Chemistry and Biochemistry Chemical Engineering Biology Aerospace Engineering Naval Science Music Military Science Industrial Design Health & Performance Sci Computer Science City Planning Building Construction Architecture Air Force Aerospace Stud 4 Fall 2002 3.75 3.5 3.25 3 2.75 2.5 2.25 2 Sources of Grade Inflation • External – – – – HSGPA SAT Admission Index Proportion of Women • Internal: – Variations by Dept. – Presence of Grade Deflation in Some Units – Impact of Instructors’ Tenure Status Implications FEEDBACK AND PERFORMANCE ASSESSMENT STUDENTS SCHOOLS ASSESSMENT OF PROSPECTIVE EMPLOYEES EMPLOYERS REPUTATION OF EDUCATIONAL INSTITUTIONS Mitigation • • • • • • • • • • • • Adoption of more clear and specific grade definitions Adoption of a plus/minus grading system Establishment of a University/Institute average GPA Expanded transcript data Changes to student honors Broad dissemination of grading definitions and policies Training for teaching assistants, adjunct faculty, and tenuretrack faculty Self-calibration of grade distributions External calibration of grade distributions External enforcement of grade distributions Standardized testing Changes to student course evaluations Report Outline • Scope and Definitions • Grading at Georgia Tech – Opinions • Analysis of Peer Institutions • Discussion – Sources – Implications – Remedies • Conclusions and Bibliography Conclusions? • Statistically, there is grade inflation • Peer comparison does not indicate cause for alarm • Quality of incoming students is increasing • Lower level courses: quality of student experience • Impact of tenure status of the instructors • Non-uniform departmental distribution