The Gender Gap in Academic Achievement among Primary-School Children: Test Scores, Teacher Grades and the Importance of Non-Cognitive Skills Chris Cornwell, University of Georgia David Mustard, University of Georgia Jessica Van Parys, Columbia University ‘The challenge for all of us is how to engage these guys at a younger age,’ said Nancy Beane, a college counselor from the Westminster Schools in Atlanta. Motivation Today, females are more likely than males to … – Graduate high school – Enroll in college immediately following high school – Graduate from college within six years Measure 1960 2003 M/F undergraduate ratio 1.55 .77 M/F ratio graduating from 4-year schools 1.60 .74 Source: Goldin, Katz and Kuziemko (2006) Why do gender differences matter? • Implications for the functioning of … – Labor markets: labor-force participation, wage gap, within-industry and occupation diversity – Marriage markets: matching, fertility rates, family structure • Implications for human-capital policy – Single-sex classrooms? – Same-sex teachers? – Gender-based college admission? Our contribution • Examine gender differences in test scores and teacher grades • Link classroom behavior to grades • Why teacher grades are important – Determine class-level placement, HS graduation and college admissibility – Feedback to student influences academic choices The questions we address 1. Do gender differences in academic achievement emerge in children ages 5-12, and, if so, in which subjects? 2. Are differences in teacher grades consistent with test-score differences? 3. How do the differences – in test scores and grades – change over time? 4. To what extent can non-cognitive skills explain the differences? Data • Early Childhood Longitudinal Study, 1998-99 Kindergarten Cohort (ECLS-K) • Tracks a nationally representative sample of students from kindergarten to fifth grade – Begins with 10,604 students – Ends with 6,496 students • Records test scores (IRT scores) and teacher grades (ARS scores) in reading, math, and science, teachers’ behavioral assessments of students (SRS scores) • Rich information on family, teacher and school characteristics Personal & family characteristics Personal Characteristics K First Third Fifth Male 0.51 (0.50) 0.50 (0.50) 0.50 (0.50) 0.50 (0.50) Black 0.13 (0.34) 0.12 (0.32) 0.09 (0.29) 0.08 (0.28) Hispanic 0.14 (0.34) 0.14 (0.35) 0.14 (0.35) 0.15 (0.36) WIC Benefits 0.37 (0.48) 0.34 (0.47) 0.30 (0.46) 0.31 (0.46) Teenage Mom 0.24 (0.42) 0.22 (0.41) 0.19 (0.39) 0.19 (0.39) Mom > 30 years old 0.13 (0.33) 0.13 (0.34) 0.14 (0.35) 0.15 (0.35) Age at K entry 65.70 (4.13) 65.79 (4.15) 65.79 (4.19) 65.73 (4.17) # Books in the home 79.44 (60.18) 110.12 (152.56) 132.66 (185.52) 116.08 (178.60) SES Index 0.08 (0.77) 0.09 (0.78) 0.09 (0.77) 0.08 (0.79) Observations 10604 9299 6362 6496 Family Characteristics Teacher & school characteristics Teacher Characteristics K First Third Fifth Teacher experience 9.06 (7.61) 14.85 (10.09) 15.11 (10.07) 14.62 (10.22) Teacher education 2.11 (0.90) 2.13 (0.93) 2.20 (0.92) 2.24 (0.92) Public school 0.80 (0.40) 0.79 (0.41) 0.78 (0.42) 0.78 (0.41) Urban school 0.38 (0.48) 0.37 (0.48) 0.34 (0.47) 0.35 (0.48) Rural school 0.24 (0.43) 0.23 (0.42) 0.26 (0.44) 0.26 (0.44) Southern school 0.34 (0.47) 0.36 (0.48) 0.30 (0.46) 0.29 (0.45) % Minority 50-75 0.10 (0.29) 0.10 (0.29) 0.09 (0.28) 0.08 (0.27) % Minority >75 0.18 (0.39) 0.18 (0.39) 0.16 (0.37) 0.18 (0.39) Observations 10604 9494 6658 6496 School Characteristics Measures of academic achievement • IRT Scores – NCES develops and administers tests – Tests based on standard curriculum in reading, math and science – Intended to test the same skills assessed by teachers • ARS and SRS Scores – NCES administers questionnaires to the teachers – Teachers rate child’s knowledge and ability on specific components of the reading, math, and science curriculum – From these questionnaires NCES creates a composite score, which is the “teacher grade” in our analysis – Teachers do not know the test score when they answer questions about academic ability ARS and SRS examples ARS Scores On a scale of 1-5 where 1 implies the child has not yet demonstrated the skill and 5 indicates proficiency … (1) “This child reads words with regular vowel sounds.” (2) “This child reads first grade books independently with comprehension.” (ECLS-K First Grade Teacher Questionnaire Part C for language and literacy) SRS Scores The “Approaches to Learning” scale measures behaviors that … “affect the ease with which children can benefit from the learning environment. It includes six items that rate the child’s attentiveness, task persistence, eagerness to learn, learning independence, flexibility and organization.” (ECLS-K First Grade User Manual) Score, ARS and SRS data Female Male Reading Scores Fifth Mean 144.17 Std. Dev. 20.81 Mean 141.02 Std. Dev. 23.06 Reading Grades Fifth 3.62 0.80 3.37 0.82 Math Scores Fifth 114.16 20.11 118.74 20.06 Math Grades Fifth 3.45 0.65 3.47 0.72 Science Scores Fifth 58.28 13.72 61.65 13.20 Science Grades Fifth 3.41 0.85 3.36 0.87 SRS Score for ATL Fifth 2.30 0.59 1.95 0.67 Baseline achievement regression yi 0 1malei X i ui • Outcomes – test scores and teacher-assigned grades for a given student (i) in a particular subject for a certain grade level • OLS estimation by grade-level cross section: spring K, first, third and fifth grades • Use ECLS-K sample weights Reading Scores (Male – Female) Test scores Grades Girls outperform boys in every case Girls receive higher grades in every case, but the disparities are greater Group K 1 3 5 Group K 1 3 5 W -.16 -.13 -.13 -.16 W -.26 -.25 -.26 -.29 B -.16 -.17 -.25 -.26 B -.35 -.24 -.40 -.37 H -.17 -.23 -.25 -.36 H -.22 -.21 -.33 -.38 Also, observables explain more test-score than grades variation. Math Scores (Male – Female) Test scores Grades • White boys outperform white girls in every grade • For blacks and Hispanics, no clear evidence of a gender gap • White boys and girls receive roughly similar grades • Some evidence that black boys receive significantly lower grades • Disparity between test-score and grade gaps rise with grade level Group K 1 3 5 Group K 1 3 5 W .06 .14 .28 .19 W -.13 -.002 .09 .02 B -.06 -.08 .03 .18 B -.28 -.11 -.24 -.28 H -.03 .09 .20 .02 H -.09 -.06 -.12 -.18 Science (Male – Female) Test scores Grades • Through 1st grade, small and imprecisely estimated differences favoring boys • After 1st grade, boys generally outperform girls by at least .25 sd • Boys generally receive lower grades • Disparity between test-score and grade gaps rise with grade level Group K 1 3 5 Group K 1 3 5 W .06 .11 .28 .25 W -.11 -.06 .01 -.03 B -.02 .05 .23 .56 B -.27 -.13 -.22 .07 H .05 .05 .13 .29 H -.11 -.03 -.04 -.21 Reading grades, test scores and behavior scores: whites Whites Male First Grade (Spring) Third Grade (Spring) Fifth Grade (Spring) (a) (b) (c) (a) (b) (c) (a) (b) (c) -0.247* -0.161* -0.089* -0.258* -0.171* -0.087* -0.285* -0.185* -0.067 (0.032) (0.023) (0.023) (0.040) (0.032) (0.030) (0.057) (0.045) (0.046) 0.672* 0.609* 0.674* 0.586* 0.617* 0.518* (0.014) (0.014) (0.019) (0.020) (0.025) (0.030) Test Scoret SRS Scoret-1 0.189* 0.235* 0.244* (0.013) (0.018) (0.032) R2 0.12 0.51 0.54 0.16 0.48 0.52 0.17 0.45 0.49 N 5983 5983 5983 4338 4338 4338 4327 4327 4327 Math grades, test scores and behavioral scores: whites Whites Male First Grade (Spring) Third Grade (Spring) Fifth Grade (Spring) (a) (b) (c) (a) (b) (c) (a) (b) (c) -0.002 -0.072* 0.035 0.094* -0.072+ 0.033 0.022 -0.094+ 0.006 (0.032) (0.028) (0.028) (0.042) (0.038) (0.040) (0.063) (0.052) (0.048) 0.491* 0.414* 0.601* 0.521* 0.604* 0.541* (0.016) (0.017) (0.022) (0.025) (0.035) (0.037) Test Scoret SRS Scoret-1 0.227* 0.204* 0.149* (0.017) (0.024) (0.030) R2 0.12 0.32 0.36 0.13 0.37 0.40 0.13 0.38 0.40 N 5983 5983 5983 4338 4338 4338 2113 2113 2113 Science grades, test scores and behavioral scores: whites Whites Male First Grade (Spring) Third Grade (Spring) Fifth Grade (Spring) (a) (b) (c) (a) (b) (c) (a) (b) (c) -0.063+ -0.110* 0.010 0.006 -0.117* -0.000 -0.026 -0.165* -0.032 (0.033) (0.031) (0.032) (0.042) (0.040) (0.041) (0.074) (0.069) (0.069) 0.422* 0.335* 0.435* 0.372* 0.543* 0.446* (0.025) (0.024) (0.023) (0.024) (0.049) (0.051) Test Scoret SRS Scoret-1 0.261* 0.245* 0.250* (0.018) (0.023) (0.041) R2 0.10 0.19 0.25 0.11 0.24 0.29 0.12 0.28 0.32 N 5983 5983 5983 4338 4338 4338 2021 2021 2021 Summary (1/2) 1. Do gender differences in academic achievement emerge in children ages 5-12, and, if so, in which subjects? YES • Girls of all races outperform boys on reading tests. • White boys outperform white girls on math and science tests. • There are no gender differences in math test scores for black and Hispanic children. • After 1st grade, boys generally outperform girls in science by at least .25 sd 2. Are differences in teacher grades consistent with test-score differences? NO • Girls receive higher reading grades than test scores would suggest. • There is no statistically significant difference in math or science grades for white children. • Black and Hispanic boys receive lower grades in math and science, despite their equivalent or higher test scores. Summary (2/2) 3. How do the differences – in test scores and grades – change over time? • The reading test score gap is constant over time for white students, but increases for black and Hispanic students. • The math test score gap increases over time for white students, but is constant for black and Hispanic students. 4. To what extent can non-cognitive skills explain the differences? • Classroom behavior explains the gender differences in test scores and grades. • When boys and girls have the same test scores and exhibit the same classroom behavior, boys earn higher grades.