Skip to main content
Log in

Recognition of Facial Expressions and Prosodic Cues with Graded Emotional Intensities in Adults with Asperger Syndrome

  • Original Paper
  • Published:
Journal of Autism and Developmental Disorders Aims and scope Submit manuscript

Abstract

This study investigated the ability of adults with Asperger syndrome to recognize emotional categories of facial expressions and emotional prosodies with graded emotional intensities. The individuals with Asperger syndrome showed poorer recognition performance for angry and sad expressions from both facial and vocal information. The group difference in facial expression recognition was prominent for stimuli with low or intermediate emotional intensities. In contrast to this, the individuals with Asperger syndrome exhibited lower recognition accuracy than typically-developed controls mainly for emotional prosody with high emotional intensity. In facial expression recognition, Asperger and control groups showed an inversion effect for all categories. The magnitude of this effect was less in the Asperger group for angry and sad expressions, presumably attributable to reduced recruitment of the configural mode of face processing. The individuals with Asperger syndrome outperformed the control participants in recognizing inverted sad expressions, indicating enhanced processing of local facial information representing sad emotion. These results suggest that the adults with Asperger syndrome rely on modality-specific strategies in emotion recognition from facial expression and prosodic information.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. The IQ tests were conducted as a part of routine clinical examination, and we did not re-run the WAIS specially for the present study. Therefore, the timing when WAIS was administered varied among the participants with AS. Because of this, the nine participants, who have their IQ scores measured recently, were tested by Wais-3. Some of the participants with AS were introduced to the outpatient clinic, where the present research was conducted, from other medical facilities. The IQ sub-scores of three participants with AS were not fully disclosed or forwarded to Showa University Hospital, which made the IQ sub-scores unavailable for these participants.

References

  • Adolphs, R., Sears, L., & Piven, J. (2001). Abnormal processing of social information from faces in autism. Journal of Cognitive Neuroscience, 13, 232–240.

    Article  PubMed  Google Scholar 

  • Ashwin, C., Baron-Cohen, S., Wheelwright, S., O’Riordan, M., & Bullmore, E. T. (2007). Differential activation of the amygdala and the ‘social brain’ during fearful face-processing in Asperger syndrome. Neuropsychologia, 45, 2–14.

    Article  PubMed  Google Scholar 

  • Asperger, H. (1944). Die ‘Autistischen Psychopathen’ im Kindesalter. Archiv fur Psychiatrie und Nervenkrankheiten, 117, 76–136.

    Article  Google Scholar 

  • Baker, K. F., Montgomery, A. A., & Abramson, R. (2010). Brief report: Perception and lateralization of spoken emotion by youths with high-functioning forms of autism. Journal of Autism and Developmental Disorders, 40, 123–129.

    Article  PubMed  Google Scholar 

  • Banno, H., Hata, H., Morise, M., Takahashi, T., Irino, T., & Kawahara, H. (2007). Implementation of realtime STRAIGHT speech manipulation system: Report on its first implementation. Acoustic Science and Technology, 28, 140–146.

    Article  Google Scholar 

  • Baron-Cohen, S., Jolliffe, T., Mortimore, C., & Robertson, M. (1997). Another advanced test of theory of mind: Evidence from very high functioning adults with autism or Asperger syndrome. Journal of Child Psychology and Psychiatry, 38, 813–822.

    Article  PubMed  Google Scholar 

  • Barton, J. J., Hefter, R. L., Cherkasova, M. V., & Manoach, D. S. (2007). Investigations of face expertise in the social developmental disorders. Neurology, 69, 860–870.

    Article  PubMed  Google Scholar 

  • Boucher, J., Lewis, V., & Collis, G. M. (2000). Voice processing abilities in children with autism, children with specific language impairments, and young typically developing children. Journal of Child Psychology and Psychiatry and Allied Disciplines, 41, 847–857.

    Article  Google Scholar 

  • Bourne, V. J. (2011). Examining the effects of inversion on lateralisation for processing facial emotion. Cortex, 47, 690–695.

    Article  PubMed  Google Scholar 

  • Brennand, R., Schepman, A., & Rodway, P. (2011). Vocal emotion perception in pseudo-sentences by secondary-school children with autism spectrum disorder. Research in Autism Spectrum Disorders, 5, 1567–1573.

    Article  Google Scholar 

  • Calder, A. J., Young, A. W., Keane, J., & Dean, M. (2000). Configural information in facial expression perception. Journal of Experimental Psychology: Human Perception and Performance, 26, 527–551.

    Article  PubMed  Google Scholar 

  • Carey, S. (1992). Becoming a face expert. Philosophical Transactions of Royal Society of London: Series B: Biological Science, 335, 95–102.

    Article  Google Scholar 

  • Caron, R. F., Caron, A. J., & Myers, R. S. (1982). Abstraction of invariant face expressions in infancy. Child Development, 53, 1008–1015.

    Article  PubMed  Google Scholar 

  • Chevallier, C., Noveck, I., Happé, F., & Wilson, D. (2011). What’s in a voice? Prosody as a test case for the theory of mind account of autism. Neuropsychologia, 9, 507–517.

    Article  Google Scholar 

  • Critchley, H. D. (2005). Neural mechanisms of autonomic, affective, and cognitive integration. Journal of Comparative Neurology, 493, 154–166.

    Article  PubMed  Google Scholar 

  • Dawson, G., Meltzoff, A. N., Osterling, J., Rinaldi, J., & Brown, E. (1998). Children with autism fail to orient to naturally occurring social stimuli. Journal of Autism and Developmental Disorders, 28, 479–485.

    Article  PubMed  Google Scholar 

  • De Gelder, B., & Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition and Emotion, 14, 289–311.

    Article  Google Scholar 

  • Derntl, B., Seidel, E. M., Kainz, E., & Carbon, C. C. (2009). Recognition of emotional expressions is affected by inversion and presentation time. Perception, 38, 1849–1862.

    Article  PubMed  Google Scholar 

  • Doi, H., Amamoto, T., Okishige, Y., Kato, M., & Shinohara, K. (2010). The own-sex effect in facial expression recognition. NeuroReport, 21, 564–568.

    Article  PubMed  Google Scholar 

  • Doi, H., Kato, A., Hashimoto, A., & Masataka, N. (2008). Role of biological-motion information in recognition of facial expressions by young children. Perception, 37, 1399–1411.

    Article  PubMed  Google Scholar 

  • Doi, H., Ueda, K., & Shinohara, K. (2009). Learning gaze direction perception-An investigation by behavioral and neurocomputational approaches. Psychologia, 52, 224–234.

    Article  Google Scholar 

  • Ekman, P. (1992). Are there basic emotions? Psychological Review, 99, 550–553.

    Article  PubMed  Google Scholar 

  • Faja, S., Aylward, E., Bernier, R., & Dawson, G. (2008). Becoming a face expert: A computerized face-training program for high-functioning individuals with autism spectrum disorders. Developmental Neuropsychology, 33, 1–24.

    Article  PubMed  Google Scholar 

  • Faja, S., Webb, S. J., Merkle, K., Aylward, E., & Dawson, G. (2009). Brief report: Face configuration accuracy and processing speed among adults with high-functioning autism spectrum disorders. Journal of Autism and Developmental Disorders, 39, 532–538.

    Article  PubMed  Google Scholar 

  • Frith, U. (1991). Asperger and his syndrome. In autism and Asperger syndrome. London: Cambridge University Press.

    Book  Google Scholar 

  • Gauthier, I., & Tarr, M. J. (2002). Unraveling mechanisms for expert object recognition: Bridging brain activity and behavior. Journal of Experimental Psychology: Human Perception and Performance, 28, 431–446.

    Article  PubMed  Google Scholar 

  • Gauthier, I., Williams, P., Tarr, M. J., & Tanaka, J. (1998). Training ‘greeble’ experts: A framework for studying expert object recognition processes. Vision Research, 38, 2401–2428.

    Article  PubMed  Google Scholar 

  • Grabenhorst, F., & Rolls, E. T. (2011). Value, pleasure and choice in the ventral prefrontal cortex. Trends in Cognitive Sciences, 15, 56–67.

    Article  PubMed  Google Scholar 

  • Gross, T. F. (2008). Recognition of immaturity and emotional expressions in blended faces by children with autism and other developmental disabilities. Journal of Autism and Developmental Disorders, 38, 297–311.

    Article  PubMed  Google Scholar 

  • Grossman, R. B., Bemis, R. H., Skwerer, D. P., & Tager-Flusberg, H. (2010). Lexical and affective prosody in children with high-functioning Autism. Journal of Speech, Language, and Hearing Research, 53, 778–793.

    Article  PubMed  Google Scholar 

  • Grossman, J. B., Klin, A., Carter, A. S., & Volkmar, F. R. (2000). Verbal bias in recognition of facial emotions in children with Asperger syndrome. Journal of Child Psychology and Psychiatry and Allied Disciplines, 41, 369–379.

    Article  Google Scholar 

  • Grossman, R. B., & Tager-Flusberg, H. (2012). “Who Said That?” Matching of Low- and High-Intensity Emotional Prosody to Facial Expressions by adolescents with ASD. Journal of Autism and Developmental Disorders, 42, 2546–2557.

    Google Scholar 

  • Hadjikhani, N., Joseph, R. M., Snyder, J., Chabris, C. F., Clark, J., Steele, S., et al. (2004). Activation of the fusiform gyrus when individuals with autism spectrum disorder view faces. NeuroImage, 22, 1141–1150.

  • Happé, F., & Charlton, R. A. (2012). Aging in autism spectrum disorders: A mini-review. Gerontology, 58, 70–78.

    Article  PubMed  Google Scholar 

  • Hobson, R. P., Ouston, J., & Lee, A. (1988). What’s in a face? The case of autism. British Journal of Psychology, 79, 441–453.

    Article  PubMed  Google Scholar 

  • Humphreys, K., Minshew, N., Leonard, G. L., & Behrmann, M. (2007). A fine-grained analysis of facial expression processing in high-functioning adults with autism. Neuropsychologia, 45, 685–695.

    Article  PubMed  Google Scholar 

  • Järvinen-Pasley, A., Peppé, S., King-Smith, G., & Heaton, P. (2008). The relationship between form and function level receptive prosodic abilities in autism. Journal f Autism and Developmental Disorders, 38, 1328–1340.

    Article  Google Scholar 

  • Jolliffe, T., & Baron-Cohen, S. (1997). Are people with autism and Asperger syndrome faster than normal on the Embedded Figures Test? Journal of Child Psychology and Psychiatry, 38, 527–534.

    Article  PubMed  Google Scholar 

  • Jones, C. R. G., Pickles, A., Falcaro, M., Marsden, A. J. S., Happé, F., Scott, S. K., et al. (2011). A multimodal approach to emotion recognition ability in autism spectrum disorders. Journal of Child Psychology and Psychiatry and Allied Disciplines, 2, 275–285.

    Google Scholar 

  • Kanwisher, N., & Yovel, G. (2006). The fusiform face area: A cortical region specialized for the perception of faces. Philosophical Transactions of the Royal Society Series B, 361, 2109–2128.

    Article  Google Scholar 

  • Kätsyri, J., Saalasti, S., Tiippana, K., von Wendt, L., & Sams, M. (2008). Impaired recognition of facial emotions from low-spatial frequencies in Asperger syndrome. Neuropsychologia, 46, 1888–1897.

    Article  PubMed  Google Scholar 

  • Kawahara, H., Morise, M., Takahashi, T., Nisimura, R., Irino, T., & Banno, H. (2008). Tandem-STRAIGHT: A temporally stable power spectral representation for periodic signals and applications to interference-free spectrum, F0, and aperiodicity estimation. ICASSP 2008: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 3933–3936.

  • Kleinhans, N. M., Richards, T., Weaver, K., Johnson, L. C., Greenson, J., Dawson, G., et al. (2010). Association between amygdala response to emotional faces and social anxiety in autism spectrum disorders. Neuropsychologia, 48, 3665–3670.

    Article  PubMed  Google Scholar 

  • Korpilahti, P., Jansson-Verkasalo, E., Mattila, M. L., Kuusikko, S., Suominen, K., Rytky, S., et al. (2007). Processing of affective speech prosody is impaired in Asperger syndrome. Journal of Autism and Developmental Disorders, 37, 1539–1549.

    Article  PubMed  Google Scholar 

  • Kreifelts, B., Ethofer, T., Grodd, W., Erb, M., & Wildgruber, D. (2007). Audiovisual integration of emotional signals in voice and face: An event-related fMRI study. NeuroImage, 37, 1445–1456.

    Article  PubMed  Google Scholar 

  • Kret, M. E., & De Gelder, B. (2012). A review on sex differences in processing emotional signals. Neuropsychologia, 50, 1211–1221.

    Article  PubMed  Google Scholar 

  • Kujala, T., Lepistö, T., Nieminen-Von Wendt, T., Näätänen, P., & Näätänen, R. (2005). Neurophysiological evidence for cortical discrimination impairment of prosody in Asperger syndrome. Neuroscience Letters, 383, 260–265.

    Article  PubMed  Google Scholar 

  • Kumar, D., & Srinivasan, N. (2011). Emotion perception is mediated by spatial frequency content. Emotion, 11, 1144–1151.

    Article  PubMed  Google Scholar 

  • Kuusikko, S., Haapsamo, H., Jansson-Verkasalo, E., Hurtig, T., Mattila, M.-L., Ebeling, H., et al. (2009). Emotion recognition in children and adolescents with autism spectrum disorders. Journal of Autism and Developmental Disorders, 39, 938–945.

    Article  PubMed  Google Scholar 

  • Lacroix, A., Guidetti, M., Rogé, B., & Reilly, J. (2009). Recognition of emotional and nonemotional facial expressions: A comparison between Williams syndrome and autism. Research in Developmental Disabilities, 30, 976–985.

    Article  PubMed  Google Scholar 

  • Lahaie, A., Mottron, L., Arguin, M., Berthiaume, C., Jemel, B., & Saumier, D. (2006). Face perception in high-functioning autistic adults: Evidence for superior processing of face parts, not for a configural face-processing deficit. Neuropsychology, 20, 30–41.

    Article  PubMed  Google Scholar 

  • Langdell, T. (1978). Recognition of faces: An approach to the study of autism. Journal of Child Psychology and Psychiatry, 19, 255–268.

    Article  PubMed  Google Scholar 

  • Law Smith, M. J., Montagne, B., Perrett, D. I., Gill, M., & Gallagher, L. (2010). Detecting subtle facial emotion recognition deficits in high-functioning Autism using dynamic stimuli of varying intensities. Neuropsychologia, 48, 2777–2781.

    Article  PubMed  Google Scholar 

  • Le Grand, R., Mondloch, C. J., Maurer, D., & Brent, H. P. (2001). Neuroperception. Early visual experience and face processing. Nature, 410, 890.

    Article  PubMed  Google Scholar 

  • Leppänen, J. M., & Hietanen, J. K. (2004). Positive facial expressions are recognized faster than negative facial expressions, but why? Psychological Research, 69, 22–29.

    Article  PubMed  Google Scholar 

  • Lindner, J. L., & Rosén, L. A. (2006). Decoding of emotion through facial expression, prosody and verbal content in children and adolescents with Asperger’s syndrome. Journal of Autism and Developmental Disorders, 36, 769–777.

    Article  PubMed  Google Scholar 

  • Lopez, B., Donnelly, N., Hadwin, J. A., & Leekam, S. R. (2004). Face processing in high-functioning adolescents with autism: Evidence for weak central coherence. Visual Cognition, 11, 673–688.

    Article  Google Scholar 

  • Magnée, M. J. C. M., De Gelder, B., Van Engeland, H., & Kemner, C. (2007). Facial electromyographic responses to emotional information from faces and voices in individuals with pervasive developmental disorder. Journal of Child Psychology and Psychiatry and Allied Disciplines, 48, 1122–1130.

    Article  Google Scholar 

  • Maurer, D., Grand, R. L., & Mondloch, C. J. (2002). The many faces of configural processing. Trends in Cognitive Sciences, 6, 255–260.

    Article  PubMed  Google Scholar 

  • Mazefsky, C. A., & Oswald, D. P. (2007). Emotion perception in Asperger’s syndrome and high-functioning autism: The importance of diagnostic criteria and cue intensity. Journal of Autism and Developmental Disorders, 37, 1086–1095.

    Article  PubMed  Google Scholar 

  • Mottron, L., Burack, J. A., Iarocci, G., Belleville, S., & Enns, J. T. (2003). Locally oriented perception with intact global processing among adolescents with high-functioning autism: Evidence from multiple paradigms. Journal of Child Psychology and Psychiatry, 44, 904–913.

    Article  PubMed  Google Scholar 

  • Nelson, C. A., Morse, P. A., & Leavitt, L. A. (1979). Recognition of facial expressions by seven-month-old infants. Child Development, 50, 1239–1242.

    Article  PubMed  Google Scholar 

  • Neth, D., & Martinez, A. M. (2009). Emotion perception in emotionless face images suggests a norm-based representation. Journal of Vision, 9, 1–11.

    Article  PubMed  Google Scholar 

  • Neth, D., & Martinez, A. M. (2010). A computational shape-based model of anger and sadness justifies a configural representation of faces. Vision Research, 50, 1693–1711.

    Article  PubMed  Google Scholar 

  • O’Connor, K. (2007). Brief report: Impaired identification of discrepancies between expressive faces and voices in adults with Asperger’s syndrome. Journal of Autism and Developmental Disorders, 37, 2008–2013.

    Article  PubMed  Google Scholar 

  • Osterling, J., & Dawson, G. (1994). Early recognition of children with autism: A study of first birthday home videotapes. Journal of Autism and Developmental Disorders, 24, 247–257.

    Article  PubMed  Google Scholar 

  • Pelphrey, K. A., Morris, J. P., Mccarthy, G., & Labar, K. S. (2007). Perception of dynamic changes in facial affect and identity in autism. Social Cognitive and Affective Neuroscience, 2, 140–149.

    Article  PubMed  Google Scholar 

  • Pessoa, L., & Adolphs, R. (2010). Emotion processing and the amygdala: From a ‘low road’ to ‘many roads’ of evaluating biological significance. Nature Reviews Neuroscience, 11, 773–782.

    Article  PubMed  Google Scholar 

  • Philip, R. C. M., Whalley, H. C., Stanfield, A. C., Sprengelmeyer, R., Santos, I. M., Young, A. W., et al. (2010). Deficits in facial, body movement and vocal emotional processing in autism spectrum disorders. Psychological Medicine, 40, 1919–1929.

    Article  PubMed  Google Scholar 

  • Rump, K. M., Giovannelli, J. L., Minshew, N. J., & Strauss, M. S. (2009). The development of emotion recognition in individuals with autism. Child Development, 80, 1434–1447.

    Article  PubMed  Google Scholar 

  • Rutherford, M. D., Baron-Cohen, S., & Wheelwright, S. (2002). Reading the mind in the voice: A study with normal adults and adults with Asperger syndrome and high functioning autism. Journal of Autism and Developmental Disorders, 32, 189–194.

    Article  PubMed  Google Scholar 

  • Rutherford, M. D., Clements, K. A., & Sekuler, A. B. (2007). Differences in discrimination of eye and mouth displacement in autism spectrum disorders. Vision Research, 47, 2099–2110.

    Article  PubMed  Google Scholar 

  • Rutherford, M. D., & McIntosh, D. N. (2007). Rules versus prototype matching: Strategies of perception of emotional facial expressions in the autism spectrum. Journal of Autism and Developmental Disorders, 37, 187–196.

    Article  PubMed  Google Scholar 

  • Sato, W., Kochiyama, T., & Yoshikawa, S. (2011). The inversion effect for neutral and emotional facial expressions on amygdala activity. Brain Research, 1378, 84–90.

    Article  PubMed  Google Scholar 

  • Scherer, K. R. (1981). Speech and emotional states. In J. Darby (Ed.), Speech evaluation in psychiatry (pp. 171–187). New York: Grune & Stratton.

    Google Scholar 

  • Schultz, R. T., Gauthier, I., Klin, A., Fulbright, R. K., Anderson, A. W., Volkmar, F., et al. (2000). Abnormal ventral temporal cortical activity during face discrimination among individuals with autism and Asperger syndrome. Archives of General Psychiatry, 57, 331–340.

    Google Scholar 

  • Schultz, R. T., Grelotti, D. J., Klin, A., Kleinman, J., Van der Gaag, C., Marois, R., et al. (2003). The role of the fusiform face area in social cognition: Implications for the pathobiology of autism. Philosophical Transactions of Royal Society of London: Series B: Biological Science, 358, 415–427.

    Article  Google Scholar 

  • Schweinberger, S. R., Casper, C., Hauthal, N., Kaufmann, J. M., Kawahara, H., Kloth, N., et al. (2008). Auditory adaptation in voice perception. Current Biology, 18, 684–688.

    Article  PubMed  Google Scholar 

  • Senju, A., Southgate, V., White, S., & Frith, U. (2009). Mindblind eyes: An absence of spontaneous theory of mind in Asperger syndrome. Science, 325, 883–885.

    Article  PubMed  Google Scholar 

  • Stevens, J. S., & Hamann, S. (2012). Sex differences in brain activation to emotional stimuli: A meta-analysis of neuroimaging studies. Neuropsychologia, 50, 1578–1593.

    Article  PubMed  Google Scholar 

  • Teunisse, J. P., & de Gelder, B. (1994). Do autistics have a generalized face processing deficit? International Journal of Neuroscience, 77, 1–10.

    Article  PubMed  Google Scholar 

  • Teunisse, J. P., & de Gelder, B. (2003). Face processing in adolescents with autistic disorder: The inversion and composite effects. Brain and Cognition, 52, 285–294.

    Article  PubMed  Google Scholar 

  • Wagner, H. L. (1993). On measuring performance in category judgment studies of nonverbal behavior. Journal of Nonverbal Behavior, 17, 3–28.

    Article  Google Scholar 

  • Watanabe, T., Yahata, N., Abe, O., Kuwabara, H., Inoue, H., Takano, Y., et al. (2012). Diminished medial prefrontal activity behind autistic social judgments of incongruent information. PLoS ONE, 7, art. no. e39561.

  • Yang, H. H., Savostyanov, A. N., Tsai, A. C., & Liou, M. (2011). Face recognition in Asperger syndrome: A study on EEG spectral power changes. Neuroscience Letters, 492, 84–88.

    Article  PubMed  Google Scholar 

  • Young, A. W., Rowland, D., Calder, A. J., Etcoff, N. L., Seth, A., & Perrett, D. I. (1997). Facial expression megamix: Tests of dimensional and category accounts of emotion recognition. Cognition, 63, 271–313.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

This work was supported by Grant-in-Aid for Young Scientists (B) KAKENHI (22791130) from the Ministry of Education, Culture, Sports, Science and Technology of Japan. The use of ATR DB99 database and FUTON software was approved by ATR-Promotions. We would like to thank Dr. Kazuhiro Ueda at the University of Tokyo for assisting the recruitment of control participants.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kazuyuki Shinohara.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Doi, H., Fujisawa, T.X., Kanai, C. et al. Recognition of Facial Expressions and Prosodic Cues with Graded Emotional Intensities in Adults with Asperger Syndrome. J Autism Dev Disord 43, 2099–2113 (2013). https://doi.org/10.1007/s10803-013-1760-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10803-013-1760-8

Keywords

Navigation