Abstract
Autistic youth display difficulties in emotion recognition, yet little research has examined behavioral and neural indices of vocal emotion recognition (VER). The current study examines behavioral and event-related potential (N100, P200, Late Positive Potential [LPP]) indices of VER in autistic and non-autistic youth. Participants (N = 164) completed an emotion recognition task, the Diagnostic Analyses of Nonverbal Accuracy (DANVA-2) which included VER, during EEG recording. The LPP amplitude was larger in response to high intensity VER, and social cognition predicted VER errors. Verbal IQ, not autism, was related to VER errors. An interaction between VER intensity and social communication impairments revealed these impairments were related to larger LPP amplitudes during low intensity VER. Taken together, differences in VER may be due to higher order cognitive processes, not basic, early perception (N100, P200), and verbal cognitive abilities may underlie behavioral, yet occlude neural, differences in VER processing.
Similar content being viewed by others
Notes
The current manuscript uses identity-first language/“on the autism spectrum” as recommended by autistic self-advocates and autism researchers (Bottema-Beutel et al., 2020).
References
Baum, K. M., & Nowicki, S. (1998). Perception of emotion: Measuring decoding accuracy of adult prosodic cues varying in intensity. Journal of Nonverbal Behavior, 22(2), 89–107.
Benning, S. D., Kovac, M., Campbell, A., Miller, S., Hanna, E. K., Damiano, C. R., Sabatino-DiCriscio, A., Turner-Brown, L., Sasson, N. J., & Aaron, R. V. (2016). Late positive potential ERP responses to social and nonsocial stimuli in youth with autism spectrum disorder. Journal of Autism and Developmental Disorders, 46(9), 3068–3077.
Berard, N., Loutzenhiser, L., Sevigny, P. R., & Alfano, D. P. (2017). Executive function, social emotional learning, and social competence in school-aged boys with autism spectrum disorder. Canadian Journal of School Psychology, 32(3–4), 265–281. https://doi.org/10.1177/0829573517707907
Berggren, S., Fletcher-Watson, S., Milenkovic, N., Marschik, P. B., Bölte, S., & Jonsson, U. (2018). Emotion recognition training in autism spectrum disorder: A systematic review of challenges related to generalizability. Developmental Neurorehabilitation, 21(3), 141–154.
Booth, A. J., Rodgers, J. D., Volker, M. A., Lopata, C., & Thomeer, M. L. (2019). Psychometric characteristics of the DANVA-2 in high-functioning children with ASD. Journal of Autism and Developmental Disorders, 49(10), 4147–4158. https://doi.org/10.1007/s10803-019-04130-w
Borod, J. C., Pick, L. H., Hall, S., Sliwinski, M., Madigan, N., Obler, L. K., Welkowitz, J., Canino, E., Erhan, H. M., & Goral, M. (2000). Relationships among facial, prosodic, and lexical channels of emotional perceptual processing. Cognition & Emotion, 14(2), 193–211.
Bottema-Beutel, K., Kapp, S. K., Lester, J. N., Sasson, N. J., & Hand, B. N. (2020). Avoiding ableist language: Suggestions for autism researchers. Autism in Adulthood. https://doi.org/10.1089/aut.2020.0014
Boucher, J., Lewis, V., & Collis, G. M. (2000). Voice processing abilities in children with autism, children with specific language impairments, and young typically developing children. Journal of Child Psychology and Psychiatry, 41(7), 847–857.
Brennand, R., Schepman, A., & Rodway, P. (2011). Vocal emotion perception in pseudo-sentences by secondary-school children with autism spectrum disorder. Research in Autism Spectrum Disorders, 5(4), 1567–1573.
Bryant, G., & Barrett, H. C. (2008). Vocal emotion recognition across disparate cultures. Journal of Cognition and Culture, 8(1–2), 135–148.
Castiajo, P., & Pinheiro, A. P. (2021). Acoustic salience in emotional voice perception and its relationship with hallucination proneness. Cognitive, Affective, & Behavioral Neuroscience, 21(2), 412–425.
Chronaki, G. (2016). Event-related potentials and emotion processing in child psychopathology. Frontiers in Psychology, 7, 564.
Chronaki, G., Benikos, N., Fairchild, G., & Sonuga-Barke, E. J. S. (2015a). Atypical neural responses to vocal anger in attention-deficit/hyperactivity disorder. Journal of Child Psychology and Psychiatry, 56(4), 477–487.
Chronaki, G., Hadwin, J. A., Garner, M., Maurage, P., & Sonuga-Barke, E. J. S. (2015b). The development of emotion recognition from facial expressions and non-linguistic vocalizations during childhood. British Journal of Developmental Psychology, 33(2), 218–236.
Constantino, J. N., & Gruber, C. P. (2012). Social responsiveness scale second edition (SRS-2): Manual. Western Psychological Services (WPS).
Fairbanks, G., & Pronovost, W. (1939). An experimental study of the pitch characteristics of the voice during the expression of emotion. Communications Monographs, 6(1), 87–104.
Fan, Y.-T., Chen, C., Chen, S.-C., Decety, J., & Cheng, Y. (2014). Empathic arousal and social understanding in individuals with Autism: Evidence from fMRI and ERP measurements. Social Cognitive and Affective Neuroscience. https://doi.org/10.1093/scan/nst101
Globerson, E., Amir, N., Kishon-Rabin, L., & Golan, O. (2015). Prosody recognition in adults with high-functioning autism spectrum disorders: From psychoacoustics to cognition. Autism Research, 8(2), 153–163.
Golan, O., Baron-Cohen, S., & Hill, J. (2006). The Cambridge mindreading (CAM) face-voice battery: Testing complex emotion recognition in adults with and without Asperger syndrome. Journal of Autism and Developmental Disorders, 36(2), 169–183.
Golan, O., Baron-Cohen, S., Hill, J. J., & Rutherford, M. (2007). The ‘Reading the Mind in the Voice’test-revised: A study of complex emotion recognition in adults with and without autism spectrum conditions. Journal of Autism and Developmental Disorders, 37(6), 1096–1106.
Gotham, K., Pickles, A., & Lord, C. (2009). Standardizing ADOS scores for a measure of severity in autism spectrum disorders. Journal of Autism and Developmental Disorders, 39(5), 693–705.
Gratton, G., Coles, M. G., & Donchin, E. (1983). A new method for off-line removal of ocular artifact. Electroencephalography and Clinical Neurophysiology, 55(4), 468–484.
Grossman, R. B., Bemis, R. H., Skwerer, D. P., & Tager-Flusberg, H. (2010). Lexical and affective prosody in children with high-functioning autism. Journal of Speech, Language, and Hearing Research. https://doi.org/10.1044/1092-4388(2009/08-0127)
Grossman, R. B., & Tager-Flusberg, H. (2012). “Who said that?” Matching of low-and high-intensity emotional prosody to facial expressions by adolescents with ASD. Journal of Autism and Developmental Disorders, 42(12), 2546–2557.
Hajcak, G., Dunning, J. P., & Foti, D. (2009). Motivated and controlled attention to emotion: Time-course of the late positive potential. Clinical Neurophysiology, 120(3), 505–510.
Harms, M. B., Martin, A., & Wallace, G. L. (2010). Facial emotion recognition in autism spectrum disorders: A review of behavioral and neuroimaging studies. Neuropsychology Review, 20(3), 290–322.
Heikkinen, J., Jansson-Verkasalo, E., Toivanen, J., Suominen, K., Väyrynen, E., Moilanen, I., & Seppänen, T. (2010). Perception of basic emotions from speech prosody in adolescents with Asperger’s syndrome. Logopedics Phoniatrics Vocology, 35(3), 113–120.
Ho, H. T., Schröger, E., & Kotz, S. A. (2015). Selective attention modulates early human evoked potentials during emotional face–voice processing. Journal of Cognitive Neuroscience, 27(4), 798–818.
Hudephl, M. B., Robins, D. L., King, T. Z., & Henrich, C. C. (2015). The role of emotion perception in adaptive functioning of people with autism spectrum disorders. Autism, 19(1), 107–112. https://doi.org/10.1177/1362361313512725
Hus, V., & Lord, C. (2014). The autism diagnostic observation schedule, module 4: Revised algorithm and standardized severity scores. Journal of Autism and Developmental Disorders, 44(8), 1996–2012.
Ingersoll, B. (2010). Broader autism phenotype and nonverbal sensitivity: Evidence for an association in the general population. J Autism Development Disorder, 40, 590–598. https://doi.org/10.1007/s10803-009-0907-0
Iredale, J. M., Rushby, J. A., McDonald, S., Dimoska-Di Marco, A., & Swift, J. (2013). Emotion in voice matters: Neural correlates of emotional prosody perception. International Journal of Psychophysiology, 89(3), 483–490.
Jasper, H. (1958). Report of committee on methods of clinical examination in electroencephalography. Electroencephalography and Clinical Neurophysiology, 10, 370–375.
Jiang, J., Liu, F., Wan, X., & Jiang, C. (2015). Perception of melodic contour and intonation in autism spectrum disorder: Evidence from Mandarin speakers. Journal of Autism and Developmental Disorders, 45(7), 2067–2075.
Jones, C. R. G., Pickles, A., Falcaro, M., Marsden, A. J. S., Happé, F., Scott, S. K., Sauter, D., Tregay, J., Phillips, R. J., & Baird, G. (2011). A multimodal approach to emotion recognition ability in autism spectrum disorders. Journal of Child Psychology and Psychiatry, 52(3), 275–285.
Jorgensen, A. R., Whitehouse, A. J. O., Fox, A. M., & Maybery, M. T. (2021). Delayed cortical processing of auditory stimuli in children with autism spectrum disorder: A meta-analysis of electrophysiological studies. Brain and Cognition, 150, 105709.
Kang, E., Keifer, C. M., Levy, E. J., Foss-Feig, J. H., McPartland, J. C., & Lerner, M. D. (2018). Atypicality of the N170 event-related potential in autism spectrum disorder: A meta-analysis. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 3(8), 657–666.
Kaufman, A. S. (2004). Kaufman brief intelligence test–second edition (KBIT-2).
Keifer, C. M., Hauschild, K. M., Nelson, B. D., Hajcak, G., & Lerner, M. D. (2019). Differences in the late positive potential and p300 to emotional faces in individuals with autism spectrum disorder. Journal of Autism and Developmental Disorders, 49, 5009–5022. https://doi.org/10.1007/s10803-019-04207-6
Korpilahti, P., Jansson-Verkasalo, E., Mattila, M.-L., Kuusikko, S., Suominen, K., Rytky, S., Pauls, D. L., & Moilanen, I. (2007). Processing of affective speech prosody is impaired in Asperger syndrome. Journal of Autism and Developmental Disorders, 37(8), 1539–1549.
Lakens, D., Scheel, A. M., & Isager, P. M. (2018). Equivalence testing for psychological research: A tutorial. Advances in Methods and Practices in Psychological Science, 1(2), 259–269.
Lartseva, A., Dijkstra, T., & Buitelaar, J. K. (2015). Emotional language processing in autism spectrum disorders: A systematic review. Frontiers in Human Neuroscience, 8, 991.
Le Sourn-Bissaoui, S., Aguert, M., Girard, P., Chevreuil, C., & Laval, V. (2013). Emotional speech comprehension in children and adolescents with autism spectrum disorders. Journal of Communication Disorders, 46(4), 309–320.
Lerner, M. D., McPartland, J. C., & Morris, J. P. (2013). Multimodal emotion processing in autism spectrum disorders: An event-related potential study. Developmental Cognitive Neuroscience, 3, 11–21.
Lindner, J. L., & Rosén, L. A. (2006). Decoding of emotion through facial expression, prosody and verbal content in children and adolescents with Asperger’s syndrome. Journal of Autism and Developmental Disorders, 36(6), 769–777.
Liu, Y., Meng, J., Yao, M., Ye, Q., Fan, B., & Peng, W. (2019). Hearing other’s pain is associated with sensitivity to physical pain: An ERP study. Biological Psychology, 145, 150–158.
Lord, C., Rutter, M., DiLavore, P., Risi, S., Gotham, K., & Bishop, S. (2012). Autism diagnostic observation schedule–2nd edition (ADOS-2) (p. 284). Western Psychological Corporation.
Mazefsky, C. A., & Oswald, D. P. (2007). Emotion perception in Asperger’s syndrome and high-functioning autism: The importance of diagnostic criteria and cue intensity. Journal of Autism and Developmental Disorders, 37(6), 1086–1095.
McCade, D., Savage, G., & Naismith, S. L. (2011). Review of emotion recognition in mild cognitive impairment. Dementia and Geriatric Cognitive Disorders, 32(4), 257–266.
Milton, D. E. (2012). On the ontological status of autism: The ‘double empathy problem.’ Disability & Society, 27(6), 883–887.
Morningstar, M., Nelson, E. E., & Dirks, M. A. (2018). Maturation of vocal emotion recognition: Insights from the developmental and neuroimaging literature. Neuroscience & Biobehavioral Reviews, 90, 221–230.
Näätänen, R., & Picton, T. (1987). The N1 wave of the human electric and magnetic response to sound: A review and an analysis of the component structure. Psychophysiology, 24(4), 375–425.
Norris, M., & Lecavalier, L. (2010). Screening accuracy of level 2 autism spectrum disorder rating scales: A review of selected instruments. Autism, 14(4), 263–284.
Nowicki, S., Glanville, D., & Demertzis, A. (1998). A Test of the Ability to Recognize Emotion in the Facial Expressions of African American Adults. Journal of Black Psychology, 24(3), 335–350. https://doi.org/10.1177/00957984980243005
O’connor, K. (2012). Auditory processing in autism spectrum disorder: A review. Neuroscience & Biobehavioral Reviews, 36(2), 836–854.
O’Connor, K. (2007). Brief report: Impaired identification of discrepancies between expressive faces and voices in adults with Asperger’s syndrome. Journal of Autism and Developmental Disorders, 37(10), 2008–2013.
O’Hearn, K., Schroer, E., Minshew, N., & Luna, B. (2010). Lack of developmental improvement on a face memory task during adolescence in autism. Neuropsychologia, 48(13), 3955–3960.
Paulmann, S. (2016). The neurocognition of prosody. Neurobiology of language (pp. 1109–1120). Elsevier.
Paulmann, S., Bleichner, M., & Kotz, S. A. E. (2013). Valence, arousal, and task effects in emotional prosody processing. Frontiers in Psychology, 4, 345.
Paulmann, S., & Kotz, S. A. (2008). Early emotional prosody perception based on different speaker voices. NeuroReport, 19(2), 209–213.
Pellicano, E. (2013). Sensory symptoms in autism: A blooming, buzzing confusion? Child Development Perspectives, 7(3), 143–148.
Peppé, S., McCann, J., Gibbon, F., O’Hare, A., & Rutherford, M. (2007). Receptive and expressive prosodic ability in children with high-functioning autism. Journal of Speech, Language, and Hearing Research. https://doi.org/10.1044/1092-4388(2007/071)
Philip, R. C. M., Whalley, H. C., Stanfield, A. C., Sprengelmeyer, R. H., Santos, I. M., Young, A. W., Atkinson, A. P., Calder, A. J., Johnstone, E. C., & Lawrie, S. M. (2010). Deficits in facial, body movement and vocal emotional processing in autism spectrum disorders. Psychological Medicine. https://doi.org/10.1017/S0033291709992364
Pinheiro, A. P., Del Re, E., Mezin, J., Nestor, P. G., Rauber, A., McCarley, R. W., Gonçalves, Ó. F., & Niznikiewicz, M. A. (2013). Sensory-based and higher-order operations contribute to abnormal emotional prosody processing in schizophrenia: An electrophysiological investigation. Psychological Medicine, 43(3), 603.
Pinheiro, A. P., Galdo-Alvarez, S., Rauber, A., Sampaio, A., Niznikiewicz, M., & Gonçalves, O. F. (2011). Abnormal processing of emotional prosody in Williams syndrome: An event-related potentials study. Research in Developmental Disabilities, 32(1), 133–147.
Pinheiro, A. P., Rezaii, N., Nestor, P. G., Rauber, A., Spencer, K. M., & Niznikiewicz, M. (2016). Did you or I say pretty, rude or brief? An ERP study of the effects of speaker’s identity on emotional word processing. Brain and Language, 153–154, 38–49. https://doi.org/10.1016/j.bandl.2015.12.003
Pinheiro, A. P., Rezaii, N., Rauber, A., Nestor, P. G., Spencer, K. M., & Niznikiewicz, M. (2017). Emotional self–other voice processing in schizophrenia and its relationship with hallucinations: ERP evidence. Psychophysiology, 54(9), 1252–1265.
Rosen, T. E., & Lerner, M. D. (2016). Externalizing and internalizing symptoms moderate longitudinal patterns of facial emotion recognition in autism spectrum disorder. Journal of Autism and Developmental Disorders, 46(8), 2621–2634.
Rosenblau, G., Kliemann, D., Dziobek, I., & Heekeren, H. R. (2017). Emotional prosody processing in autism spectrum disorder. Social Cognitive and Affective Neuroscience, 12(2), 224–239.
Rump, K. M., Giovannelli, J. L., Minshew, N. J., & Strauss, M. S. (2009). The development of emotion recognition in individuals with autism. Child Development, 80(5), 1434–1447.
Russo, N. M., Skoe, E., Trommer, B., Nicol, T., Zecker, S., Bradlow, A., & Kraus, N. (2008). Deficient brainstem encoding of pitch in children with autism spectrum disorders. Clinical Neurophysiology, 119(8), 1720–1731.
Rutherford, M. D., Baron-Cohen, S., & Wheelwright, S. (2002). Reading the mind in the voice: A study with normal adults and adults with Asperger syndrome and high functioning autism. Journal of Autism and Developmental Disorders, 32(3), 189–194.
Rutter, M., Bailey, A., & Lord, C. (2003). The social communication questionnaire: Manual. Western Psychological Services.
Sauter, D. A., Eisner, F., Ekman, P., & Scott, S. K. (2010). Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations. Proceedings of the National Academy of Sciences, 107(6), 2408–2412.
Schelinski, S., Roswandowitz, C., & von Kriegstein, K. (2017). Voice identity processing in autism spectrum disorder. Autism Research, 10(1), 155–168.
Schelinski, S., & von Kriegstein, K. (2019). The relation between vocal pitch and vocal emotion recognition abilities in people with autism spectrum disorder and typical development. Journal of Autism and Developmental Disorders, 49(1), 68–82.
Scherer, K. R. (1979). Nonlinguistic vocal indicators of emotion and psychopathology. Emotions in personality and psychopathology (pp. 493–529). Springer.
Schirmer, A., Chen, C.-B., Ching, A., Tan, L., & Hong, R. Y. (2013). Vocal emotions influence verbal memory: Neural correlates and interindividual differences. Cognitive, Affective, & Behavioral Neuroscience, 13(1), 80–93.
Schirmer, A., & Kotz, S. A. (2006). Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing. Trends in Cognitive Sciences, 10(1), 24–30.
Sivathasan, S., Fernandes, T. P., Burack, J. A., & Quintin, E.-M. (2020). Emotion processing and autism spectrum disorder: A review of the relative contributions of alexithymia and verbal IQ. Research in Autism Spectrum Disorders, 77, 101608.
Thye, M. D., Bednarz, H. M., Herringshaw, A. J., Sartin, E. B., & Kana, R. K. (2018). The impact of atypical sensory processing on social impairments in autism spectrum disorder. Developmental Cognitive Neuroscience, 29, 151–167.
Trentacosta, C. J., & Fine, S. E. (2010). Emotion knowledge, social competence, and behavior problems in childhood and adolescence: A meta-analytic review. Social Development, 19(1), 1–29. https://doi.org/10.1111/j.1467-9507.2009.00543.x
Trevisan, D. A., & Birmingham, E. (2016). Are emotion recognition abilities related to everyday social functioning in ASD? A meta-analysis. Research in Autism Spectrum Disorders, 32, 24–42.
Uljarevic, M., & Hamilton, A. (2013). Recognition of emotions in autism: A formal meta-analysis. Journal of Autism and Developmental Disorders, 43(7), 1517–1526.
Wang, J., Barstein, J., Ethridge, L. E., Mosconi, M. W., Takarae, Y., & Sweeney, J. A. (2013). Resting state EEG abnormalities in autism spectrum disorders. Journal of Neurodevelopmental Disorders, 5(1), 1–14.
Wang, P., Pan, Z., Liu, X., & Chen, X. (2015). Emotional intensity modulates vocal emotion decoding in a late stage of processing: An event-related potential study. NeuroReport, 26(17), 1051–1055.
Weinberg, A., Ferri, J., & Hajcak, G. (2013). Interactions between attention and emotion: Insights from the late positive potential.
Williams, Z. J., Abdelmessih, P. G., Key, A. P., & Woynaroski, T. G. (2020). Cortical auditory processing of simple stimuli is altered in autism: A meta-analysis of auditory evoked responses. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging. https://doi.org/10.1016/j.bpsc.2020.09.011
Wood, P. M., & Kroese, B. S. (2007). Enhancing the emotion recognition skills of individuals with learning disabilities: A review of the literature. Journal of Applied Research in Intellectual Disabilities, 20(6), 576–579.
Xavier, J., Vignaud, V., Ruggiero, R., Bodeau, N., Cohen, D., & Chaby, L. (2015). A multidimensional approach to the study of emotion recognition in autism spectrum disorders. Frontiers in Psychology, 6, 1954.
Zhang, M., Xu, S., Chen, Y., Lin, Y., Ding, H., & Zhang, Y. (2021). Recognition of affective prosody in autism spectrum conditions: A systematic review and meta-analysis. Autism. https://doi.org/10.1177/1362361321995725
Funding
Grant sponsor: National Institutes of Mental Health (NIMH); Grant number: 1R01MH110585.
Author information
Authors and Affiliations
Contributions
MDL: Conceptualization, methodology, formal analysis, resources, writing - review & editing, supervision, funding acquisition. TCD: Conceptualization, formal analysis, writing - original draft, visualization, project administration. KMH: Writing - review & editing, project administration, methodology. IM: Investigation, writing - review & editing. SB: Investigation, writing - review & editing.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare. Dr. Lerner is an Associate Editor at the Journal of Autism and Developmental Disorders.
Research Involving Human and Animal Rights
This research involves human subjects. It was prospectively approved by the Stony Brook University Institutional Review Board (IRB).
Informed Consent
Consents, for caregivers, and assents, for participants aged 11–17 years old, were prospectively reviewed and approved by the Stony Brook University IRB. The consent and assent form were given to participating families and reviewed by research assistants. During the consenting and assenting process, research assistant answered any questions about the research process, and if participants and their caregivers agreed to research, they signed the assent and consent, respectively. This process is outlined in the methods section of our manuscript.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Day, T.C., Malik, I., Boateng, S. et al. Vocal Emotion Recognition in Autism: Behavioral Performance and Event-Related Potential (ERP) Response. J Autism Dev Disord 54, 1235–1248 (2024). https://doi.org/10.1007/s10803-023-05898-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10803-023-05898-8