Abstract
This study investigated the ability of adults with Asperger syndrome to recognize emotional categories of facial expressions and emotional prosodies with graded emotional intensities. The individuals with Asperger syndrome showed poorer recognition performance for angry and sad expressions from both facial and vocal information. The group difference in facial expression recognition was prominent for stimuli with low or intermediate emotional intensities. In contrast to this, the individuals with Asperger syndrome exhibited lower recognition accuracy than typically-developed controls mainly for emotional prosody with high emotional intensity. In facial expression recognition, Asperger and control groups showed an inversion effect for all categories. The magnitude of this effect was less in the Asperger group for angry and sad expressions, presumably attributable to reduced recruitment of the configural mode of face processing. The individuals with Asperger syndrome outperformed the control participants in recognizing inverted sad expressions, indicating enhanced processing of local facial information representing sad emotion. These results suggest that the adults with Asperger syndrome rely on modality-specific strategies in emotion recognition from facial expression and prosodic information.
Similar content being viewed by others
Notes
The IQ tests were conducted as a part of routine clinical examination, and we did not re-run the WAIS specially for the present study. Therefore, the timing when WAIS was administered varied among the participants with AS. Because of this, the nine participants, who have their IQ scores measured recently, were tested by Wais-3. Some of the participants with AS were introduced to the outpatient clinic, where the present research was conducted, from other medical facilities. The IQ sub-scores of three participants with AS were not fully disclosed or forwarded to Showa University Hospital, which made the IQ sub-scores unavailable for these participants.
References
Adolphs, R., Sears, L., & Piven, J. (2001). Abnormal processing of social information from faces in autism. Journal of Cognitive Neuroscience, 13, 232–240.
Ashwin, C., Baron-Cohen, S., Wheelwright, S., O’Riordan, M., & Bullmore, E. T. (2007). Differential activation of the amygdala and the ‘social brain’ during fearful face-processing in Asperger syndrome. Neuropsychologia, 45, 2–14.
Asperger, H. (1944). Die ‘Autistischen Psychopathen’ im Kindesalter. Archiv fur Psychiatrie und Nervenkrankheiten, 117, 76–136.
Baker, K. F., Montgomery, A. A., & Abramson, R. (2010). Brief report: Perception and lateralization of spoken emotion by youths with high-functioning forms of autism. Journal of Autism and Developmental Disorders, 40, 123–129.
Banno, H., Hata, H., Morise, M., Takahashi, T., Irino, T., & Kawahara, H. (2007). Implementation of realtime STRAIGHT speech manipulation system: Report on its first implementation. Acoustic Science and Technology, 28, 140–146.
Baron-Cohen, S., Jolliffe, T., Mortimore, C., & Robertson, M. (1997). Another advanced test of theory of mind: Evidence from very high functioning adults with autism or Asperger syndrome. Journal of Child Psychology and Psychiatry, 38, 813–822.
Barton, J. J., Hefter, R. L., Cherkasova, M. V., & Manoach, D. S. (2007). Investigations of face expertise in the social developmental disorders. Neurology, 69, 860–870.
Boucher, J., Lewis, V., & Collis, G. M. (2000). Voice processing abilities in children with autism, children with specific language impairments, and young typically developing children. Journal of Child Psychology and Psychiatry and Allied Disciplines, 41, 847–857.
Bourne, V. J. (2011). Examining the effects of inversion on lateralisation for processing facial emotion. Cortex, 47, 690–695.
Brennand, R., Schepman, A., & Rodway, P. (2011). Vocal emotion perception in pseudo-sentences by secondary-school children with autism spectrum disorder. Research in Autism Spectrum Disorders, 5, 1567–1573.
Calder, A. J., Young, A. W., Keane, J., & Dean, M. (2000). Configural information in facial expression perception. Journal of Experimental Psychology: Human Perception and Performance, 26, 527–551.
Carey, S. (1992). Becoming a face expert. Philosophical Transactions of Royal Society of London: Series B: Biological Science, 335, 95–102.
Caron, R. F., Caron, A. J., & Myers, R. S. (1982). Abstraction of invariant face expressions in infancy. Child Development, 53, 1008–1015.
Chevallier, C., Noveck, I., Happé, F., & Wilson, D. (2011). What’s in a voice? Prosody as a test case for the theory of mind account of autism. Neuropsychologia, 9, 507–517.
Critchley, H. D. (2005). Neural mechanisms of autonomic, affective, and cognitive integration. Journal of Comparative Neurology, 493, 154–166.
Dawson, G., Meltzoff, A. N., Osterling, J., Rinaldi, J., & Brown, E. (1998). Children with autism fail to orient to naturally occurring social stimuli. Journal of Autism and Developmental Disorders, 28, 479–485.
De Gelder, B., & Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition and Emotion, 14, 289–311.
Derntl, B., Seidel, E. M., Kainz, E., & Carbon, C. C. (2009). Recognition of emotional expressions is affected by inversion and presentation time. Perception, 38, 1849–1862.
Doi, H., Amamoto, T., Okishige, Y., Kato, M., & Shinohara, K. (2010). The own-sex effect in facial expression recognition. NeuroReport, 21, 564–568.
Doi, H., Kato, A., Hashimoto, A., & Masataka, N. (2008). Role of biological-motion information in recognition of facial expressions by young children. Perception, 37, 1399–1411.
Doi, H., Ueda, K., & Shinohara, K. (2009). Learning gaze direction perception-An investigation by behavioral and neurocomputational approaches. Psychologia, 52, 224–234.
Ekman, P. (1992). Are there basic emotions? Psychological Review, 99, 550–553.
Faja, S., Aylward, E., Bernier, R., & Dawson, G. (2008). Becoming a face expert: A computerized face-training program for high-functioning individuals with autism spectrum disorders. Developmental Neuropsychology, 33, 1–24.
Faja, S., Webb, S. J., Merkle, K., Aylward, E., & Dawson, G. (2009). Brief report: Face configuration accuracy and processing speed among adults with high-functioning autism spectrum disorders. Journal of Autism and Developmental Disorders, 39, 532–538.
Frith, U. (1991). Asperger and his syndrome. In autism and Asperger syndrome. London: Cambridge University Press.
Gauthier, I., & Tarr, M. J. (2002). Unraveling mechanisms for expert object recognition: Bridging brain activity and behavior. Journal of Experimental Psychology: Human Perception and Performance, 28, 431–446.
Gauthier, I., Williams, P., Tarr, M. J., & Tanaka, J. (1998). Training ‘greeble’ experts: A framework for studying expert object recognition processes. Vision Research, 38, 2401–2428.
Grabenhorst, F., & Rolls, E. T. (2011). Value, pleasure and choice in the ventral prefrontal cortex. Trends in Cognitive Sciences, 15, 56–67.
Gross, T. F. (2008). Recognition of immaturity and emotional expressions in blended faces by children with autism and other developmental disabilities. Journal of Autism and Developmental Disorders, 38, 297–311.
Grossman, R. B., Bemis, R. H., Skwerer, D. P., & Tager-Flusberg, H. (2010). Lexical and affective prosody in children with high-functioning Autism. Journal of Speech, Language, and Hearing Research, 53, 778–793.
Grossman, J. B., Klin, A., Carter, A. S., & Volkmar, F. R. (2000). Verbal bias in recognition of facial emotions in children with Asperger syndrome. Journal of Child Psychology and Psychiatry and Allied Disciplines, 41, 369–379.
Grossman, R. B., & Tager-Flusberg, H. (2012). “Who Said That?” Matching of Low- and High-Intensity Emotional Prosody to Facial Expressions by adolescents with ASD. Journal of Autism and Developmental Disorders, 42, 2546–2557.
Hadjikhani, N., Joseph, R. M., Snyder, J., Chabris, C. F., Clark, J., Steele, S., et al. (2004). Activation of the fusiform gyrus when individuals with autism spectrum disorder view faces. NeuroImage, 22, 1141–1150.
Happé, F., & Charlton, R. A. (2012). Aging in autism spectrum disorders: A mini-review. Gerontology, 58, 70–78.
Hobson, R. P., Ouston, J., & Lee, A. (1988). What’s in a face? The case of autism. British Journal of Psychology, 79, 441–453.
Humphreys, K., Minshew, N., Leonard, G. L., & Behrmann, M. (2007). A fine-grained analysis of facial expression processing in high-functioning adults with autism. Neuropsychologia, 45, 685–695.
Järvinen-Pasley, A., Peppé, S., King-Smith, G., & Heaton, P. (2008). The relationship between form and function level receptive prosodic abilities in autism. Journal f Autism and Developmental Disorders, 38, 1328–1340.
Jolliffe, T., & Baron-Cohen, S. (1997). Are people with autism and Asperger syndrome faster than normal on the Embedded Figures Test? Journal of Child Psychology and Psychiatry, 38, 527–534.
Jones, C. R. G., Pickles, A., Falcaro, M., Marsden, A. J. S., Happé, F., Scott, S. K., et al. (2011). A multimodal approach to emotion recognition ability in autism spectrum disorders. Journal of Child Psychology and Psychiatry and Allied Disciplines, 2, 275–285.
Kanwisher, N., & Yovel, G. (2006). The fusiform face area: A cortical region specialized for the perception of faces. Philosophical Transactions of the Royal Society Series B, 361, 2109–2128.
Kätsyri, J., Saalasti, S., Tiippana, K., von Wendt, L., & Sams, M. (2008). Impaired recognition of facial emotions from low-spatial frequencies in Asperger syndrome. Neuropsychologia, 46, 1888–1897.
Kawahara, H., Morise, M., Takahashi, T., Nisimura, R., Irino, T., & Banno, H. (2008). Tandem-STRAIGHT: A temporally stable power spectral representation for periodic signals and applications to interference-free spectrum, F0, and aperiodicity estimation. ICASSP 2008: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 3933–3936.
Kleinhans, N. M., Richards, T., Weaver, K., Johnson, L. C., Greenson, J., Dawson, G., et al. (2010). Association between amygdala response to emotional faces and social anxiety in autism spectrum disorders. Neuropsychologia, 48, 3665–3670.
Korpilahti, P., Jansson-Verkasalo, E., Mattila, M. L., Kuusikko, S., Suominen, K., Rytky, S., et al. (2007). Processing of affective speech prosody is impaired in Asperger syndrome. Journal of Autism and Developmental Disorders, 37, 1539–1549.
Kreifelts, B., Ethofer, T., Grodd, W., Erb, M., & Wildgruber, D. (2007). Audiovisual integration of emotional signals in voice and face: An event-related fMRI study. NeuroImage, 37, 1445–1456.
Kret, M. E., & De Gelder, B. (2012). A review on sex differences in processing emotional signals. Neuropsychologia, 50, 1211–1221.
Kujala, T., Lepistö, T., Nieminen-Von Wendt, T., Näätänen, P., & Näätänen, R. (2005). Neurophysiological evidence for cortical discrimination impairment of prosody in Asperger syndrome. Neuroscience Letters, 383, 260–265.
Kumar, D., & Srinivasan, N. (2011). Emotion perception is mediated by spatial frequency content. Emotion, 11, 1144–1151.
Kuusikko, S., Haapsamo, H., Jansson-Verkasalo, E., Hurtig, T., Mattila, M.-L., Ebeling, H., et al. (2009). Emotion recognition in children and adolescents with autism spectrum disorders. Journal of Autism and Developmental Disorders, 39, 938–945.
Lacroix, A., Guidetti, M., Rogé, B., & Reilly, J. (2009). Recognition of emotional and nonemotional facial expressions: A comparison between Williams syndrome and autism. Research in Developmental Disabilities, 30, 976–985.
Lahaie, A., Mottron, L., Arguin, M., Berthiaume, C., Jemel, B., & Saumier, D. (2006). Face perception in high-functioning autistic adults: Evidence for superior processing of face parts, not for a configural face-processing deficit. Neuropsychology, 20, 30–41.
Langdell, T. (1978). Recognition of faces: An approach to the study of autism. Journal of Child Psychology and Psychiatry, 19, 255–268.
Law Smith, M. J., Montagne, B., Perrett, D. I., Gill, M., & Gallagher, L. (2010). Detecting subtle facial emotion recognition deficits in high-functioning Autism using dynamic stimuli of varying intensities. Neuropsychologia, 48, 2777–2781.
Le Grand, R., Mondloch, C. J., Maurer, D., & Brent, H. P. (2001). Neuroperception. Early visual experience and face processing. Nature, 410, 890.
Leppänen, J. M., & Hietanen, J. K. (2004). Positive facial expressions are recognized faster than negative facial expressions, but why? Psychological Research, 69, 22–29.
Lindner, J. L., & Rosén, L. A. (2006). Decoding of emotion through facial expression, prosody and verbal content in children and adolescents with Asperger’s syndrome. Journal of Autism and Developmental Disorders, 36, 769–777.
Lopez, B., Donnelly, N., Hadwin, J. A., & Leekam, S. R. (2004). Face processing in high-functioning adolescents with autism: Evidence for weak central coherence. Visual Cognition, 11, 673–688.
Magnée, M. J. C. M., De Gelder, B., Van Engeland, H., & Kemner, C. (2007). Facial electromyographic responses to emotional information from faces and voices in individuals with pervasive developmental disorder. Journal of Child Psychology and Psychiatry and Allied Disciplines, 48, 1122–1130.
Maurer, D., Grand, R. L., & Mondloch, C. J. (2002). The many faces of configural processing. Trends in Cognitive Sciences, 6, 255–260.
Mazefsky, C. A., & Oswald, D. P. (2007). Emotion perception in Asperger’s syndrome and high-functioning autism: The importance of diagnostic criteria and cue intensity. Journal of Autism and Developmental Disorders, 37, 1086–1095.
Mottron, L., Burack, J. A., Iarocci, G., Belleville, S., & Enns, J. T. (2003). Locally oriented perception with intact global processing among adolescents with high-functioning autism: Evidence from multiple paradigms. Journal of Child Psychology and Psychiatry, 44, 904–913.
Nelson, C. A., Morse, P. A., & Leavitt, L. A. (1979). Recognition of facial expressions by seven-month-old infants. Child Development, 50, 1239–1242.
Neth, D., & Martinez, A. M. (2009). Emotion perception in emotionless face images suggests a norm-based representation. Journal of Vision, 9, 1–11.
Neth, D., & Martinez, A. M. (2010). A computational shape-based model of anger and sadness justifies a configural representation of faces. Vision Research, 50, 1693–1711.
O’Connor, K. (2007). Brief report: Impaired identification of discrepancies between expressive faces and voices in adults with Asperger’s syndrome. Journal of Autism and Developmental Disorders, 37, 2008–2013.
Osterling, J., & Dawson, G. (1994). Early recognition of children with autism: A study of first birthday home videotapes. Journal of Autism and Developmental Disorders, 24, 247–257.
Pelphrey, K. A., Morris, J. P., Mccarthy, G., & Labar, K. S. (2007). Perception of dynamic changes in facial affect and identity in autism. Social Cognitive and Affective Neuroscience, 2, 140–149.
Pessoa, L., & Adolphs, R. (2010). Emotion processing and the amygdala: From a ‘low road’ to ‘many roads’ of evaluating biological significance. Nature Reviews Neuroscience, 11, 773–782.
Philip, R. C. M., Whalley, H. C., Stanfield, A. C., Sprengelmeyer, R., Santos, I. M., Young, A. W., et al. (2010). Deficits in facial, body movement and vocal emotional processing in autism spectrum disorders. Psychological Medicine, 40, 1919–1929.
Rump, K. M., Giovannelli, J. L., Minshew, N. J., & Strauss, M. S. (2009). The development of emotion recognition in individuals with autism. Child Development, 80, 1434–1447.
Rutherford, M. D., Baron-Cohen, S., & Wheelwright, S. (2002). Reading the mind in the voice: A study with normal adults and adults with Asperger syndrome and high functioning autism. Journal of Autism and Developmental Disorders, 32, 189–194.
Rutherford, M. D., Clements, K. A., & Sekuler, A. B. (2007). Differences in discrimination of eye and mouth displacement in autism spectrum disorders. Vision Research, 47, 2099–2110.
Rutherford, M. D., & McIntosh, D. N. (2007). Rules versus prototype matching: Strategies of perception of emotional facial expressions in the autism spectrum. Journal of Autism and Developmental Disorders, 37, 187–196.
Sato, W., Kochiyama, T., & Yoshikawa, S. (2011). The inversion effect for neutral and emotional facial expressions on amygdala activity. Brain Research, 1378, 84–90.
Scherer, K. R. (1981). Speech and emotional states. In J. Darby (Ed.), Speech evaluation in psychiatry (pp. 171–187). New York: Grune & Stratton.
Schultz, R. T., Gauthier, I., Klin, A., Fulbright, R. K., Anderson, A. W., Volkmar, F., et al. (2000). Abnormal ventral temporal cortical activity during face discrimination among individuals with autism and Asperger syndrome. Archives of General Psychiatry, 57, 331–340.
Schultz, R. T., Grelotti, D. J., Klin, A., Kleinman, J., Van der Gaag, C., Marois, R., et al. (2003). The role of the fusiform face area in social cognition: Implications for the pathobiology of autism. Philosophical Transactions of Royal Society of London: Series B: Biological Science, 358, 415–427.
Schweinberger, S. R., Casper, C., Hauthal, N., Kaufmann, J. M., Kawahara, H., Kloth, N., et al. (2008). Auditory adaptation in voice perception. Current Biology, 18, 684–688.
Senju, A., Southgate, V., White, S., & Frith, U. (2009). Mindblind eyes: An absence of spontaneous theory of mind in Asperger syndrome. Science, 325, 883–885.
Stevens, J. S., & Hamann, S. (2012). Sex differences in brain activation to emotional stimuli: A meta-analysis of neuroimaging studies. Neuropsychologia, 50, 1578–1593.
Teunisse, J. P., & de Gelder, B. (1994). Do autistics have a generalized face processing deficit? International Journal of Neuroscience, 77, 1–10.
Teunisse, J. P., & de Gelder, B. (2003). Face processing in adolescents with autistic disorder: The inversion and composite effects. Brain and Cognition, 52, 285–294.
Wagner, H. L. (1993). On measuring performance in category judgment studies of nonverbal behavior. Journal of Nonverbal Behavior, 17, 3–28.
Watanabe, T., Yahata, N., Abe, O., Kuwabara, H., Inoue, H., Takano, Y., et al. (2012). Diminished medial prefrontal activity behind autistic social judgments of incongruent information. PLoS ONE, 7, art. no. e39561.
Yang, H. H., Savostyanov, A. N., Tsai, A. C., & Liou, M. (2011). Face recognition in Asperger syndrome: A study on EEG spectral power changes. Neuroscience Letters, 492, 84–88.
Young, A. W., Rowland, D., Calder, A. J., Etcoff, N. L., Seth, A., & Perrett, D. I. (1997). Facial expression megamix: Tests of dimensional and category accounts of emotion recognition. Cognition, 63, 271–313.
Acknowledgments
This work was supported by Grant-in-Aid for Young Scientists (B) KAKENHI (22791130) from the Ministry of Education, Culture, Sports, Science and Technology of Japan. The use of ATR DB99 database and FUTON software was approved by ATR-Promotions. We would like to thank Dr. Kazuhiro Ueda at the University of Tokyo for assisting the recruitment of control participants.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Doi, H., Fujisawa, T.X., Kanai, C. et al. Recognition of Facial Expressions and Prosodic Cues with Graded Emotional Intensities in Adults with Asperger Syndrome. J Autism Dev Disord 43, 2099–2113 (2013). https://doi.org/10.1007/s10803-013-1760-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10803-013-1760-8