Supplementary information S3 | Reliability, clinical validity and norms for social perception measures
Test
Ekman 60 Faces
(From the Facial
Expressions of
1
Emotion – Stimuli and Tests,
FEEST)*
Reliability
Internal consistency
Split-half reliability r = 0.62.
1
Clinical validity
Autism can disrupt recognition of specific emotions.
2,3 One study identified no deficits in accuracy, but slower responses.
4
The Ekman 60, particularly when negative expressions are used, is also sensitive to bvFTD.
5–7
People with schizophrenia are impaired relative to controls.
8
Norms
Norms and cut-off scores available.
1
Population
Adults and children
Comprehensive
Affect Testing
System
(CATS) 11–13
Internal consistency
‡
α across all subtests = –0.15–
0.76, 13 split half r s = –0.12–
0.75.
13 For subtest 10,
α = 0.67–0.72
14 and 0.66.
15
For subtest 5, α = 0.61.
15 α for two facial subtests = 0.70, 16 and for two prosody subtests = 0.56.
16
Test-retest
Mean interval of 1 year, r s = 0.61, 16 and 0.70 for subtest 10.
14
The Ekman 60 is also sensitive to brain damage that differentially affects the recognition of specific emotions.
9,10
Performance on subtests from the CATS is impaired in bvFTD.
17,18 One of these studies found impairment on one of two administered subtests, 18 the other identified impairment on both administered subtests.
17 subtests from the CATS battery, but not in a global manner, with performance on some subtests typically intact.
19–22
People with schizophrenia exhibit deficits on
Adult norms are available for both the original and abbreviated
CATS.
13,23
Adults
Florida Affect
Battery (FAB) 24
Internal consistency
α = 0.85 for a total score towards which all subtests contribute.
25 α = 0.82 for a composite score pooling the facial subtests, 25 and α = 0.76 for a composite score pooling the prosody subtests.
25
Test-retest
People with FTD exhibit impairments in facial affect recognition but not in identity discrimination.
26
Recognition of facial expressions is related to regional changes in grey matter in neurodegenerative disorders.
27
A high proportion of people with TBI are impaired on the FAB.
28
The FAB is sensitive to emotion recognition
Norms are available for adults, 24 as children and adolescents aged 9–
15 years.
31
as well
Developed for adults, but some studies have also used the FAB to assess children and adolescents
Mean interval of 2 weeks, r = 0.89–0.97.
24 difficulties in other clinical groups, including patients who have undergone temporal lobectomy, 29 patients with multiple-domain mild cognitive impairment, 30 and schizophrenia.
25
TASIT Emotion
Evaluation Test
(EET) 32,33
Test-retest
Mean interval of 1 week, r = 0.74.
34
Alternative forms
Mean interval of 15 weeks, r = 0.83.
34
People with bvFTD are impaired relative to controls.
17,18
Many studies show that people with TBI also exhibit deficits on the EET, 33–36 although exceptions have been noted.
37
The EET also differentiates between people with schizophrenia and controls.
8
Adult and adolescent norms are available.
32,38
Age ≥13 years
*The FEEST also includes the Emotion Hexagon Test, which uses stimuli of graded difficulty and may be more sensitive to subtle emotion recognition difficulties. This task has higher split-half reliability ( r = .92), and also has norms available.
1
‡
Composite and quotient scales can also be derived for the CATS, and have higher reliability overall.
13 α refers to Cronbach’s alpha, mean interval refers to average interval between testing occasions. Abbreviations: bvFTD, behavioural-variant frontotemporal dementia; TBI, traumatic brain injury.
1.
2.
3.
4.
Young, A., Perrett, D., Calder, A., Sprengelmeyer, R. & Ekman, P. Facial
Expressions of Emotion - Stimuli and Tests (FEEST) (Thames Valley Test Company,
Bury St Edmunds, England, 2002).
Wright, B . et al. Emotion recognition in faces and the use of visual context in young people with high-functioning autism spectrum disorders. Autism 12 , 607-26 (2008).
Philip, R.C. et al. Deficits in facial, body movement and vocal emotional processing in autism spectrum disorders. Psychol. Med . 40 , 1919-29 (2010).
Wright, B.
et al . Gamma activation in young people with autism spectrum disorders and typically-developing controls when viewing emotions on faces. PLoS One 7 , e41326 (2012).
5.
6.
Keane, J., Calder, A.J., Hodges, J.R. & Young, A.W. Face and emotion processing in frontal variant frontotemporal dementia. Neuropsychologia 40 , 655-65 (2002).
Kumfor, F. et al. Are you really angry? The effect of intensity on facial emotion recognition in frontotemporal dementia. Soc. Neurosci.
6 , 502-514 (2011).
7. Hsieh, S., Hodges, J.R. & Piguet, O. Recognition of positive vocalizations is impaired in behavioral-variant frontotemporal dementia. J. Int. Neuropsychol. Soc.
19 , 483-7
(2013).
Sparks, A., McDonald, S., Lino, B., O'Donnell, M. & Green, M.J. Social cognition, 8. empathy and functional outcome in schizophrenia. Schizophr. Res.
122 , 172-178
(2010).
Calder, A.J. et al . Facial emotion recognition after bilateral amygdala damage: 9.
Differentially severe impairment of fear. Cogn. Neuropsychol.
13 , 699-745 (1996).
10. Sprengelmeyer, R. et al.
Knowing no fear. Proc. Biol. Sci.
266 , 2451-2456 (1999).
11. Froming, K.B., Weiner, S.G., Gregory, A.L., Levy, C.M. & Ekman, P. The
Comprehensive Affect Testing System: An emotion processing system - Clinical version. (Psychology Software Inc., Gainesville FL 2006).
12. Weiner, S.G., Gregory, A., Froming, K.B., Levy, C.M. & Ekman, P. Emotion processing: The Comprehensive Affect Testing System user’s manual (Psychology
Software Inc., Sanford, FL 2006).
13. Schaffer, S.G., Gregory, A.L., Froming, K.B., Levy, C.M. & Ekman, P. Emotion
Processing: The Comprehensive Affect Testing System User's Manual (Psychology
Software Inc. 2517 River Tree Circle 2006).
14. McKown, C., Allen, A.M., Russo-Ponsaran, N.M. & Johnson, J.K. Direct assessment of children's social-emotional comprehension. Psychol. Assess.
25 , 1154-1166 (2013).
15. McKown, C., Gumbiner, L.M., Russo, N.M. & Lipton, M. Social-emotional learning skill, self-regulation, and social competence in typically developing and clinicreferred children. J. Clin. Child Adolesc. Psychol.
38 , 858-871 (2009).
16. Albuquerque, L. et al. STN-DBS does not change emotion recognition in advanced
Parkinson's disease. Parkinsonism Relat. Disord.
20 , 166-9 (2014).
17. Shany-Ur, T. et al . Comprehension of insincere communication in neurodegenerative disease: lies, sarcasm, and theory of mind. Cortex 48 , 1329-1341 (2012).
18. Rankin, K.P. et al.
Detecting sarcasm from paralinguistic cues: anatomic and cognitive correlates in neurodegenerative disease. Neuroimage 47 , 2005-2015 (2009).
19. Rossell, S.L., Van Rheenen, T.E., Joshua, N.R., O'Regan, A. & Gogos, A.
Investigating facial affect processing in psychosis: A study using the Comprehensive
Affective Testing System. Schizophr. Res.
157 , 55-9 (2014).
20. Rossell, S.L. et al. Investigating affective prosody in psychosis: A study using the
Comprehensive Affective Testing System. Psychiatry Res.
210 , 896-900 (2013).
21. Castagna, F. et al. Prosody recognition and audiovisual emotion matching in schizophrenia: The contribution of cognition and psychopathology. Psychiatry Res.
205 , 192-8 (2013).
22. Martins, M.J., Moura, B.L., Martins, I.P., Figueira, M.L. & Prkachin, K.M.
Sensitivity to expressions of pain in schizophrenia patients. Psychiatry Res.
189 , 180-
4 (2011).
23. Schaffer, S.G., Wisniewski, A., Dahdah, M. & Froming, K.B. The Comprehensive
Affect Testing System-abbreviated: effects of age on performance. Arch. Clin.
Neuropsychol.
24 , 89-104 (2009).
24. Bowers, D., Blonder, L.X. & Heilman, K.M. Florida Affect Battery manual. (Center for Neuropsychological Studies, Cognitive Neuroscience Laboratory, University of
Florida, 1999).
25. Shaw, R.J. et al. The relationship between affect expression and affect recognition in schizophrenia. Schizophr. Res.
37 , 245-50 (1999).
26. Rosen, H.J.
et al.
Recognition of emotion in the frontal and temporal variants of frontotemporal dementia. Dement. Geriatr. Cogn. Disord.
17 , 277-81 (2004).
27. Rosen, H.J
. et al. Neuroanatomical correlates of impaired recognition of emotion in dementia. Neuropsychologia 44 , 365-73 (2006).
28. Biszak, A.M. & Babbage, D.R. Facial affect recognition difficulties in traumatic brain injury rehabilitation services. Brain Inj.
28 , 97-104 (2014).
29. Carvajal, F., Rubio, S., Martin, P., Serrano, J.M. & Garcia-Sola, R. Perception and recall of faces and facial expressions following temporal lobectomy. Epilepsy Behav.
14 , 60-5 (2009).
30. Teng, E., Lu, P.H. & Cummings, J.L. Deficits in facial emotion processing in mild cognitive impairment. Dement. Geriatr. Cogn. Disord.
23 , 271-9 (2007).
31. Tonks, J., Williams, W.H., Frampton, I., Yates, P. & Slater, A. Assessing emotion recognition in 9-15-years olds: preliminary analysis of abilities in reading emotion from faces, voices and eyes. Brain Inj.
21 , 623-629 (2007).
32. Flanagan, S., McDonald, S. & Rollins, J. The Awareness of Social Inference Test -
Revised (TASIT-R) manual. (Pearson Clinical and Talent Assessment, Sydney, NSW
2011).
33. McDonald, S., Flanagan, S., Rollins, J. & Kinch, J. TASIT: A new clinical tool for assessing social perception after traumatic brain injury. J. Head Trauma Rehabil.
18 ,
219-238 (2003).
34. McDonald, S.
et al.
Reliability and validity of The Awareness of Social Inference
Test (TASIT): A clinical test of social perception. Disabil. Rehabil.
28 , 1529-1542
(2006).
35. McDonald, S., Flanagan, S., Martin, I. & Saunders, C. The ecological validity of
TASIT: A test of social perception. Neuropsychol. Rehabil.
14 , 285-302 (2004).
36. McDonald, S. & Flanagan, S. Social perception deficits after traumatic brain injury: interaction between emotion recognition, mentalizing ability, and social communication. Neuropsychology 18 , 572-579 (2004).
37. McDonald, S.
et al.
Assessing social cognition and pragmatic language in adolescents with traumatic brain injuries. J. Int. Neuropsychol. Soc.
19 , 528-538 (2013).
38. McDonald, S. et al. Adolescent performance on The Awareness of Social Inference
Test: TASIT. Brain Impair.
16 , 3-18 (2015).