Preseason Neurocognitive Testing in Athletes with Academic Problems Grant L. Iverson University of British Columbia & British Columbia Mental Health & Addiction Services Michael W. Collins University of Pittsburgh Medical Center Marie-Claude Roberge British Columbia Mental Health & Addiction Services Mark R. Lovell University of Pittsburgh Medical Center Author Notes: Drs. Mark Lovell and Michael Collins have a proprietary interest in ImPACT. Please address correspondence to Grant Iverson, Ph.D., Department of Psychiatry, University of British Columbia, 2255 Wesbrook Mall, Vancouver, B.C., Canada V6T 2A1. Phone: (604) 822-7588; Fax: (604) 822-7756; Email: giverson@interchange.ubc.ca. Abstract Objective: Baseline preseason neurocognitive testing is recommended for amateur and professional athletes. Then, if an athlete sustains a concussion, it can be determined more precisely when he or she returns to normal neurocognitive functioning. Baseline testing is particularly important if an athlete has a developmental condition, such as ADHD or a learning disability, because these conditions might have an adverse effect on cognitive functioning. However, the effect of learning problems and disabilities on test batteries used in athletics is unknown. The purpose of this study was to examine the effect of academic problems on preseason testing in amateur athletes. Participants and Methods: Forty-one student athletes with academic problems (e.g., those who receive special education services or have repeated a grade) were compared to 41 randomly selected controls on ImPACT, a 20-minute computerized neurocognitive test battery. The two groups were compared on the five composite scores using MANOVA followed by univariate ANOVAs. Results: The multivariate effect was nonsignificant [Wilks’ Lambda =.88; F(5, 76) = 3.1, p < .075, eta squared=.12]. The ANOVA results revealed significantly worse test scores for students with academic problems on the Verbal Memory (p<.014, Cohen’s d=.55) and Processing Speed (p<.033, d=.48) composites. The groups did not differ on the Visual Memory, Reaction Time, or Impulse Control composites. The students with academic problems also reported significantly more subjective symptoms on the Post-Concussion Scale (p<.006, Cohen’s d=.70). Conclusions: Knowing the pre-injury symptom reporting and neurocognitive test performance of student athletes with academic problems will facilitate the interpretation of post-injury evaluations and return-toplay decision making. Introduction Neurocognitive testing is widely cited and recommended as a component of a comprehensive concussion management program in athletics (1-7). This, of course, is because neurocognitive testing is sensitive to the acute effects of concussion and can be used to serially monitor an athlete’s recovery (8-24). Baseline, preseason neurocognitive testing has become increasingly feasible given the availability of brief Presented at the annual conference of the International Neuropsychological Society, February, 2008, Hawaii, USA. computerized batteries (11; 25-27). Regardless of whether computerized or traditional neurocognitive tests are used, preseason testing is frequently recommended as a clinical methodology in which the athlete serves as his or her own comparison if injured in the future (9; 19; 28-30). Following a concussion, an athlete can be monitored to determine when he or she recovers to baseline levels of functioning. Baseline testing is especially important for athletes who might have a developmental condition, such as a learning disability or attention-deficit hyperactivity disorder (ADHD). This is because normative data for neurocognitive tests, as a rule, are not available for youth with these conditions. In fact, having a learning disability or ADHD typically is an exclusion criterion for being included in a normative sample. Thus, if ADHD or a learning disability has an adverse effect on a particular neurocognitive test, then the postconcussion results from that test in an athlete with a pre-existing condition will be particularly difficult to interpret. In fact, there is a large literature indicating that youth with learning disabilities perform more poorly on some neuropsychological tests (e.g., 31-35). The most common subtypes of learning disabilities, in the literature, are reading (dyslexia), writing (dysgraphia), and mathematics (dyscalculia). Researchers have reported that adults with reading disabilities can have slowed speed of processing on verbal and visual tasks, slowed naming speed, poor temporal processing, and reduced working memory, listening comprehension, and general knowledge (36-39). Some aspects of executive functioning have been reported to be adversely affected, including impaired sequence learning (40) and reduced ability to inhibit distracters and sequence events (41). Differences in short-term verbal memory, phonological awareness, and backwards counting abilities have been reported in individuals with a familial pattern of dyslexia (42). A learning disability in mathematics, often referred to as developmental dyscalculia, involves problems with memorization of numerical facts, ability to solve simple mathematical questions, and the learning of simple arithmetic skills (43). Mathematics disabilities occur in 5 to 6% of the school-aged population (44). Boys with ADHD and a comorbid learning disability in mathematics have pronounced cognitive deficits on a number of neuropsychological tests (45). One theory from research on children with early mathematical disabilities (i.e., identifiable as early as grade 1) suggests that there is a problem with the central executive (46; 47). Baddeley (46; 47) theorized that children with mathematics disabilities have problems with the “central executive.” The central executive, which oversees cognitive processing, is comprised of two components that allow for information to be held and manipulated: the phonological loop (verbal, auditory information) and the visual sketchpad (nonverbal, visuospatial information). Researchers have reported that children with mathematics disabilities have problems with phonological processing, working memory, reading, short-term memory, and vocabulary (48-50), which are believed to be mediated by, and subsequently overload, the central executive. Adults with learning disabilities in mathematics also show neurocognitive deficits in other domains, although the research appears to be limited in this area. Greiffenstein and Baker (51) reported that adults with arithmetic deficiency had problems with nonverbal reasoning and constructional problems. Individuals with this difficulty also perform poorly on the Tower of London test, which measures visual attention, working memory, and planning (52). Therefore, it is quite clear that amateur and professional athletes with learning disabilities might perform differently on neurocognitive testing than athletes without learning disabilities. This has not been adequately studied, however. The purpose of this study was to determine if student athletes with selfreported learning problems perform more poorly on a commonly used computerized battery called Immediate Postconcussion Assessment and Cognitive Testing (ImPACT). It was hypothesized that Page 2 of 8 athletes with learning problems would perform more poorly on at least one of the five composite scores derived from ImPACT. Methods Participants All participants were young men who were participating in high school athletics. The vast majority were football players (90%). Their average age was 15.3 years (SD = 1.5). Their average number of completed years of education was 9.1 (SD = 1.2). Learning problems were operationally-defined as (a) past or present special education services, or (b) past grade failure. Forty-one student athletes with academic problems (e.g., those who receive special education services or have repeated a grade) were compared to 41 randomly selected controls on ImPACT, a 20-minute computerized neurocognitive test battery. The two groups were compared on the five composite scores using MANOVA followed by univariate ANOVAs. Measure Version 2.0 of ImPACT is a brief (20-25 minutes) computer-administered neuropsychological test battery that consists of six individual test modules that measure aspects of neurocognitive functioning including attention, memory, reaction time, and processing speed. Each test module may contribute scores to multiple composite scores. Five composite scores were used for this study. The Verbal Memory composite score represents the average percent correct for a word recognition paradigm, a symbol number match task, and a letter memory task with an accompanying interference task. These tests are conceptually similar to traditional verbal learning (word list) tasks and the auditory consonant trigrams test (i.e., the Brown-Peterson short-term memory paradigm), although the information is presented visually on the computer, not auditorily by an examiner. The Visual Memory composite score is comprised of the average percent correct scores for two tasks; a recognition memory task that requires the discrimination of a series of abstract line drawings, and a memory task that requires the identification of a series of illuminated X’s or O’s after an intervening task (mouse clicking a number sequence from 25 to 1). The first test taps immediate and delayed memory for visual designs and the second test measures short-term spatial memory (with an interference task). The Reaction Time composite score represents the average response time (in milliseconds) on a choice reaction time, a go/no-go task, and the previously mentioned symbol match task (which is similar to a traditional digit symbol task). The Processing Speed composite represents the weighted average of three tasks that are done as interference tasks for the memory paradigms. The Impulse Control composite score represents the total number of errors of omission or commission on the go/no-go test and the choice reaction time test. In addition to the cognitive measures, ImPACT also contains a Post-Concussion Scale that consists of 22 commonly reported symptoms (e.g., headache, dizziness, “fogginess”). The dependent measure is the total score derived from this 22-item scale. The reliability (53; 54) and concurrent validity (55; 56) of the cognitive composite scores and the Post-Concussion Scale (57-59), and the sensitivity of the battery to the acute effects of concussion (21-24; 29; 54; 60-62), have been examined in a number of studies. Results The two groups were compared on the five neuropsychological composite scores using mulivariate analysis of variance (MANOVA) followed by univariate ANOVAs. Box’s M Test was not significant, indicating that the covariance matrices did not differ across the dependent variables. However, a few of the individual variables within groups had significant departures from normality as assessed by Shapiro Wilk test for normality. No neurocognitive variables had unequal error variances between groups (i.e., Page 3 of 8 based on Levene’s Test). MANOVA and ANOVA tend to be quite robust to relatively minor violations of underlying general linear model assumptions. Therefore, the results will be reported. The multivariate effect was nonsignificant [Wilks’ Lambda =.88; F(5, 76) = 3.1, p < .075, eta squared=.12]. The ANOVA results revealed significantly worse test scores for students with academic problems on the Verbal Memory (p<.014, Cohen’s d=.55) and Processing Speed (p<.033, d=.48) composites. The groups did not differ on the Visual Memory, Reaction Time, or Impulse Control composites. The students with academic problems also reported significantly more subjective symptoms on the Post-Concussion Scale (p<.006, Cohen’s d=.70). Table 1. Descriptive statistics, univariate F tests, and effect sizes for the ImPACT composite scores. Composite Score Verbal Memory Visual Memory Processing Speed Reaction Time Impulse Control Total Symptoms Group Mean SD p .014 Eta Squared .073 Control Learning Problems Control Learning Problems Control Learning Problems Control Learning Problems Control Learning Problems Control Learning Problems 87.7 82.9 77.8 73.1 35.6 32.3 .56 .57 10.5 13.3 3.1 8.5 8.5 8.9 12.2 14.5 7.0 6.9 .07 .07 8.2 10.2 3.8 11.4 Cohen’s d .55 .116 .031 .35 .033 .056 .48 .695 .002 .09 .179 .022 .30 .006 -- .70 Note: By convention, effect sizes are interpreted as follows: .2 = small, .5 = medium, and .8 = large. A modified Bonferonni procedure would set the experimentwise alpha at .008 (.05/6). Discussion To our knowledge, this is the first published study examining computerized neurocognitive test performance in student athletes with learning problems. Students with learning problems performed more poorly on tests measuring verbal memory and processing speed. These findings are consistent with the literature, in general, that suggest that children and adults with learning disabilities perform more poorly on some neuropsychological tests. This study has significant limitations. The primary limitation is the self-report method of identifying young people with learning problems. Using self-report with no independent verification is not ideal. Moreover, the operational definition of learning problems was (a) involvement in special education, or (b) repeating a grade. It is not known whether these students met formal criteria for a learning disability, or the type of learning disability they might have. Moreover, it is possible, although unlikely, that a small number of subjects in the control group could have had a learning disability. Clearly, there could be uncontrolled heterogeneity in these groups. This study has important implications for the use of neurocognitive testing with athletes who have learning problems or disabilites. There are very few published studies relating to preseason neurocognitive testing in student athletes with learning disabilities, or in outcome from concussion in athletes with this pre-existing condition. Athletes with pre-existing conditions, such as learning disabilities and/or ADHD, might need to be assessed and managed somewhat differently. In a previous Page 4 of 8 study, Collins and colleagues reported that college football players with diagnosed learning disabilities were more likely to (a) sustain a concussion, and (b) have slow recovery (9). Having baseline preseason testing on athletes with learning disabilities is important because there is no normative data for athletes with pre-existing conditions. Thus, it is can be difficult to interpret their post-injury test performance. Knowing the pre-injury symptom reporting and neurocognitive test performance of student athletes with academic problems will facilitate the interpretation of post-injury evaluations and return-to-play decision making. In the future, it might be helpful to create neurocognitive normative data for athletes with pre-existing conditions. In addition, future research should focus on post-injury recovery curves in athletes with learning disabilities, ADHD, or both, as well as whether these pre-existing conditions may be a risk factor for recurrent concussive injury. References 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. Aubry, M., Cantu, R., Dvorak, J., Graf-Baumann, T., Johnston, K., Kelly, J., et al. (2002). Summary and agreement statement of the First International Conference on Concussion in Sport, Vienna 2001. Recommendations for the improvement of safety and health of athletes who may suffer concussive injuries. British Journal of Sports Medicine, 36(1), 6-10. McCrory, P., Johnston, K., Meeuwisse, W., Aubry, M., Cantu, R., Dvorak, J., et al. (2005). Summary and agreement statement of the 2nd International Conference on Concussion in Sport, Prague 2004. British Journal of Sports Medicine, 39(4), 196-204. Guskiewicz, K. M., Bruce, S. L., Cantu, R. C., Ferrara, M. S., Kelly, J. P., McCrea, M., et al. (2004). Recommendations on management of sport-related concussion: summary of the National Athletic Trainers' Association position statement. Neurosurgery, 55(4), 891-895; discussion 896. Collins, M. W., & Hawn, K. L. (2002). The clinical management of sports concussion. Current Sports Medicine Reports, 1(1), 12-22. Putukian, M. (2006). Repeat mild traumatic brain injury: how to adjust return to play guidelines. Current Sports Medicine Reports, 5(1), 15-22. Randolph, C. (2001). Implementation of Neuropsychological Testing Models for the High School, Collegiate, and Professional Sport Settings. Journal of Athletic Training, 36(3), 288-296. Moser, R. S., Iverson, G. L., Echemendia, R. J., Lovell, M. R., Schatz, P., Webbe, F. M., et al. (2007). Neuropsychological evaluation in the diagnosis and management of sports-related concussion. Archives of Clinical Neuropsychology, 22(8), 909-916. Barr, W. B., & McCrea, M. (2001). Sensitivity and specificity of standardized neurocognitive testing immediately following sports concussion. Journal of the International Neuropsychological Society, 7, 693-702. Collins, M. W., Grindel, S. H., Lovell, M. R., Dede, D. E., Moser, D. J., Phalin, B. R., et al. (1999). Relationship between concussion and neuropsychological performance in college football players. Journal of the American Medical Association, 282(10), 964-970. Delaney, J. S., Lacroix, V. J., Gagne, C., & Antoniou, J. (2001). Concussions among university football and soccer players: a pilot study. Clinical Journal of Sport Medicine, 11(4), 234-240. Erlanger, D., Feldman, D., Kutner, K., Kaushik, T., Kroger, H., Festa, J., et al. (2003). Development and validation of a web-based neuropsychological test protocol for sports-related return-to-play decision-making. Archives of Clinical Neuropsychology, 18(3), 293-316. Erlanger, D., Saliba, E., Barth, J., Almquist, J., Webright, W., & Freeman, J. (2001). Monitoring resolution of postconcussion symptoms in athletes: Preliminary results of a web-based neuropsychological test protocol. Journal of Athletic Training, 36(3), 280-287. Guskiewicz, K. M., Ross, S. E., & Marshall, S. W. (2001). Postural stability and neuropsychological deficits after concussion in collegiate athletes. Journal of Athletic Training, 36(3), 263-273. Page 5 of 8 14. Macciocchi, S. N., Barth, J. T., Alves, W., Rimel, R. W., & Jane, J. A. (1996). Neuropsychological functioning and recovery after mild head injury in collegiate athletes. Neurosurgery, 39(3), 510-514. 15. Makdissi, M., Collie, A., Maruff, P., Darby, D. G., Bush, A., McCrory, P., et al. (2001). Computerised cognitive assessment of concussed Australian Rules footballers. British Journal of Sports Medicine, 35(5), 354-360. 16. Matser, J. T., Kessels, A. G., Lezak, M. D., & Troost, J. (2001). A dose-response relation of headers and concussions with cognitive impairment in professional soccer players. Journal of Clinical and Experimental Neuropsychology, 23(6), 770-774. 17. McCrea, M., Kelly, J. P., Randolph, C., Cisler, R., & Berger, L. (2002). Immediate neurocognitive effects of concussion. Neurosurgery, 50(5), 1032-1040. 18. Warden, D. L., Bleiberg, J., Cameron, K. L., Ecklund, J., Walter, J., Sparling, M. B., et al. (2001). Persistent prolongation of simple reaction time in sports concussion. Neurology, 57(3), 524-526. 19. Echemendia, R. J., Putukian, M., Mackin, R. S., Julian, L., & Shoss, N. (2001). Neuropsychological test performance prior to and following sports-related mild traumatic brain injury. Clinical Journal of Sport Medicine, 11(1), 23-31. 20. Iverson, G. L., Brooks, B. L., Collins, M. W., & Lovell, M. R. (2006). Tracking neuropsychological recovery following concussion in sport. Brain Injury, 20(3), 245-252. 21. Broglio, S. P., Macciocchi, S. N., & Ferrara, M. S. (2007). Sensitivity of the concussion assessment battery. Neurosurgery, 60(6), 1050-1057; discussion 1057-1058. 22. Van Kampen, D. A., Lovell, M. R., Pardini, J. E., Collins, M. W., & Fu, F. H. (2006). The "value added" of neurocognitive testing after sports-related concussion. American Journal of Sports Medicine, 34(10), 1630-1635. 23. Schatz, P., Pardini, J. E., Lovell, M. R., Collins, M. W., & Podell, K. (2006). Sensitivity and specificity of the ImPACT test battery for concussion in athletes. Archives of Clinical Neuropsychology, 21(1), 91-99. 24. McClincy, M. P., Lovell, M. R., Pardini, J., Collins, M. W., & Spore, M. K. (2006). Recovery from sports concussion in high school and collegiate athletes. Brain Injury, 20(1), 33-39. 25. Collie, A., Makdissi, M., Maruff, P., Bennell, K., & McCrory, P. (2006). Cognition in the days following concussion: comparison of symptomatic versus asymptomatic athletes. Journal of Neurology, Neurosurgery and Psychiatry, 77(2), 241-245. 26. Cernich, A., Reeves, D., Sun, W., & Bleiberg, J. (2007). Automated Neuropsychological Assessment Metrics sports medicine battery. Archives of Clinical Neuropsychology, 22 Suppl 1, S101-114. 27. Covassin, T., Swanik, C. B., Sachs, M., Kendrick, Z., Schatz, P., Zillmer, E., et al. (2006). Sex differences in baseline neuropsychological function and concussion symptoms of collegiate athletes. British Journal of Sports Medicine, 40(11), 923-927; discussion 927. 28. McCrea, M., Guskiewicz, K. M., Marshall, S. W., Barr, W., Randolph, C., Cantu, R. C., et al. (2003). Acute effects and recovery time following concussion in collegiate football players: the NCAA Concussion Study. Journal of the American Medical Association, 290(19), 2556-2563. 29. Lovell, M. R., Collins, M. W., Iverson, G. L., Johnston, K. M., & Bradley, J. P. (2004). Grade 1 or "ding" concussions in high school athletes. American Journal of Sports Medicine, 32(1), 47-54. 30. Moser, R. S., Schatz, P., & Jordan, B. D. (2005). Prolonged effects of concussion in high school athletes. Neurosurgery, 57(2), 300-306; discussion 300-306. 31. Ferri, B. A., Gregg, N., & Heggoy, S. J. (1997). Profiles of college students demonstrating learning disabilities with and without giftedness. Journal of Learning Disabilities, 30(5), 552-559. 32. Hendriksen, J. G., Keulers, E. H., Feron, F. J., Wassenberg, R., Jolles, J., & Vles, J. S. (2007). Subtypes of learning disabilities: neuropsychological and behavioural functioning of 495 children referred for multidisciplinary assessment. European Child & Adolescent Psychiatry, 16(8), 517-524. 33. McIntosh, D. E., Dunham, M. D., Dean, R. S., & Kundert, D. K. (1995). Neuropsychological characteristics of learning disabled/gifted children. International Journal of Neuroscience, 83(1-2), 123-130. Page 6 of 8 34. Sanchez, P. N., & Coppel, D. (2000). Adult outcomes of verbal learning disability. Seminars in Clinical Neuropsychiatry, 5(3), 205-209. 35. Vlachos, F., & Karapetsas, A. (2003). Visual memory deficit in children with dysgraphia. Perceptual and Motor Skills, 97(3 Pt 2), 1281-1288. 36. Miller-Shaul, S. (2005). The characteristics of young and adult dyslexics readers on reading and reading related cognitive tasks as compared to normal readers. Dyslexia, 11(2), 132-151. 37. Meyler, A., & Breznitz, Z. (2005). Visual, auditory and cross-modal processing of linguistic and nonlinguistic temporal patterns among adult dyslexic readers. Dyslexia, 11(2), 93-115. 38. Ransby, M. J., & Swanson, H. L. (2003). Reading comprehension skills of young adults with childhood diagnoses of dyslexia. Journal of Learning Disabilities, 36(6), 538-555. 39. Cohen-Mimran, R., & Sapir, S. (2007). Deficits in working memory in young adults with reading disabilities. Journal of Communication Disorders, 40(2), 168-183. 40. Howard, J. H., Jr., Howard, D. V., Japikse, K. C., & Eden, G. F. (2006). Dyslexics are impaired on implicit higher-order sequence learning, but not on implicit spatial context learning. Neuropsychologia, 44(7), 1131-1144. 41. Brosnan, M., Demetre, J., Hamill, S., Robson, K., Shepherd, H., & Cody, G. (2002). Executive functioning in adults and children with developmental dyslexia. Neuropsychologia, 40(12), 21442155. 42. Brambati, S. M., Termine, C., Ruffino, M., Danna, M., Lanzi, G., Stella, G., et al. (2006). Neuropsychological deficits and neural dysfunction in familial dyslexia. Brain Research, 1113(1), 174-185. 43. Shovman, M. M., & Ahissar, M. (2006). Isolating the impact of visual perception on dyslexics' reading ability. Vision Research, 46(20), 3514-3525. 44. Shalev, R. S., Weirtman, R., & Amir, N. (1988). Developmental dyscalculia. Cortex, 24(4), 555-561. 45. Seidman, L. J., Biederman, J., Monuteaux, M. C., Doyle, A. E., & Faraone, S. V. (2001). Learning disabilities and executive dysfunction in boys with attention-deficit/hyperactivity disorder. Neuropsychology, 15(4), 544-556. 46. Baddeley, A. D. (1986). Working memory. Oxford, UK: Oxford University Press. 47. Baddeley, A. D. (1996). Exploring the central executive. Quarterly Journal of Experimental Psychology, 49a, 5-28. 48. Hecht, S. A., Torgesen, J. K., Wagner, R. K., & Rashotte, C. A. (2001). The relations between phonological processing abilities and emerging individual differences in mathematical computation skills: a longitudinal study from second to fifth grades. Journal of Experimental and Child Psychology, 79(2), 192-227. 49. Swanson, H. L., & Beebe-Frankenberger, M. (2004). The relationship between working memory and mathematical problem-solving in children at risk and not at risk for serious math difficulties. Journal of Educational Psychology, 96, 471-491. 50. Wilson, K. M., & Swanson, H. L. (2001). Are mathematics disabilities due to a domain-general or a domain-specific working memory deficit? Journal of Learning Disabilities, 34(3), 237-248. 51. Greiffenstein, M. F., & Baker, W. J. (2002). Neuropsychological and psychosocial correlates of adult arithmetic deficiency. Neuropsychology, 16(4), 451-458. 52. Bigler, E. D. (1992). The neurobiology and neuropsychology of adult learning disorders. Journal of Learning Disabilities, 25(8), 488-506. 53. Iverson, G. L., Lovell, M. R., Collins, M. W., & Norwig, J. (2002). Tracking recovery from concussion using ImPACT: Applying reliable change methodology. Archives of Clinical Neuropsychology, 17, 770. 54. Iverson, G. L., Lovell, M. R., & Collins, M. W. (2003). Interpreting change on ImPACT following sport concussion. The Clinical Neuropsychologist, 17(4), 460-467. Page 7 of 8 55. Iverson, G. L., Lovell, M. R., & Collins, M. W. (2005). Validity of ImPACT for measuring processing speed following sports-related concussion. Journal of Clinical and Experimental Neuropsychology, 27, 1-7. 56. Iverson, G. L., Franzen, M. D., Lovell, M. R., & Collins, M. W. (2004). Construct validity of ImPACT in athletes with concussions. Archives of Clinical Neuropsychology, 19(7), 961-962. 57. Iverson, G. L., & Gaetz, M. (2004). Practical considerations for interpreting change following concussion. In M. R. Lovell, R. J. Echemendia, J. Barth & M. W. Collins (Eds.), Traumatic brain injury in sports: An international neuropsychological perspective (pp. 323-356). Netherlands: SwetsZeitlinger. 58. Janusz, J. A., Gioia, G. A., Gilstein, K., & Iverson, G. L. (2004). Construct validity of the ImPACT Post-Concussion scale in children. British Journal of Sports Medicine, 38, 659. 59. Lovell, M. R., Iverson, G. L., Collins, M. W., Podell, K., Johnston, K. M., Pardini, D., et al. (2006). Measurement of symptoms following sports-related concussion: Reliability and normative data for the post-concussion scale. Applied Neuropsychology, 13(3), 166-174. 60. Iverson, G. L., Gaetz, M., Lovell, M. R., & Collins, M. W. (2002). Relation between fogginess and outcome following concussion. Archives of Clinical Neuropsychology, 17, 769-770. 61. Collins, M. W., Iverson, G. L., Lovell, M. R., McKeag, D. B., Norwig, J., & Maroon, J. (2003). Onfield predictors of neuropsychological and symptom deficit following sports-related concussion. Clinical Journal of Sport Medicine, 13(4), 222-229. 62. Lovell, M. R., Collins, M. W., Iverson, G. L., Field, M., Maroon, J. C., Cantu, R., et al. (2003). Recovery from mild concussion in high school athletes. Journal of Neurosurgery, 98(2), 296-301. Page 8 of 8