On the Trail of Facial Processing in Autism Spectrum Disorders

  • Diana ArellanoEmail author
  • Ulrich Max Schaller
  • Reinhold Rauh
  • Volker Helzle
  • Marc Spicker
  • Oliver Deussen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9238)


To investigate the difficulties in communication, socialization abilities, and emotion perception deficits in individuals with autism spectrum disorders (ASD), we propose the project SARA. Its main goal is to assess how abstracted emotional facial expressions influence the categorization of the emotions by children and adolescents with high-functioning ASD. This paper focuses on the first pilot study where an adapted version of the Dynamic Emotional Categorization Test (DECT) was implemented. The results support the validity of the emotional facial animations, which is confirmed by the low performance of subjects with high-functioning ASD when categorizing emotions, in comparison with their peers without ASD.


Autism spectrum disorders Real-time NPR Abstraction 3D characters Dynamic facial animations 



The SARA project (officially Impact of non-photorealistic rendering for the understanding of emotional facial expressions by children and adolescents with high-functioning Autism Spectrum Disorders) is funded by the DFG - German Research Foundation (AR 892/1-1, DE 620/18-1, RA 764/4-1).


  1. 1.
    Hudepohl, M.B., Robins, D.L., King, T.Z., Henrich, C.: The role of emotion perception in adaptive functioning of individuals with high-functioning autism spectrum disorders. In: Autism: Int. J. Res. Pract. (2013)Google Scholar
  2. 2.
    Rauh, R., Schaller, U.M.: Categorical Perception of Emotional Facial Expressions in Video Clips with Natural and Artificial Actors: A Pilot Study. Technical report ALU-KJPP-2009-001, University of Freiburg (2009)Google Scholar
  3. 3.
    Collin, L., Bindra, J., Raju, M., Gillberg, C., Minnis, H.: Facial emotion recognition in child psychiatry: a systematic review. Res. Dev. Disabil. 34(5), 1505–1520 (2013)CrossRefGoogle Scholar
  4. 4.
    Lozier, L.M., Vanmeter, J.W., Marsh, A.A.: Impairments in facial affect recognition associated with autism spectrum disorders: a meta-analysis. Dev. Psychopathol. 26(4 Pt 1), 933–945 (2014)CrossRefGoogle Scholar
  5. 5.
    Uljarevic, M., Hamilton, A.: Recognition of emotions in autism: a formal meta-analysis. J. Autism Dev. Disord. 43(7), 1517–1526 (2013)CrossRefGoogle Scholar
  6. 6.
    Baio, J.: Prevalence of autism spectrum disorders autism and developmental disabilities monitoring network, 14 sites, United States, 2008. Surveill. Summ. 61(SS03), 1–19 (2012)Google Scholar
  7. 7.
    Baio, J.: Prevalence of autism spectrum disorder among children aged 8 years autism and developmental disabilities monitoring network, 11 sites, United States, 2010. Surveill. Summ. 63(2), 1–21 (2014)Google Scholar
  8. 8.
    Hill, E.L.: Executive dysfunction in autism. Trends Cogn. Sci. 8(1), 2632 (2004)CrossRefGoogle Scholar
  9. 9.
    Ospina, M.B., Seida, J.K., Clark, B., Karkhaneh, M., Hartling, L., Vandermeer, B., Smith, V.: Behavioural and developmental interventions for autism spectrum disorder: a clinical systematic review. Autism 3(11), e3755 (2008)Google Scholar
  10. 10.
    Alcorn, A., Pain, H., Rajendran, G., Smith, T., Lemon, O., Porayska-Pomsta, K., Foster, M.E., Avramides, K., Frauenberger, C., Bernardini, S.: Social communication between virtual characters and children with autism. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds.) AIED 2011. LNCS, vol. 6738, pp. 7–14. Springer, Heidelberg (2011) CrossRefGoogle Scholar
  11. 11.
    Serret, S., Hun, S., Iakimova, G., Lozada, J., Anastassova, M., Santos, A., Vesperini, S. Askenazy, F.: Facing the challenge of teaching emotions to individuals with low- and high-functioning autism using a new Serious game: a pilot study. Molecular Autism. 5(37), (2014)Google Scholar
  12. 12.
    Alves, S., Marques, A., Queirós, C., Orvalho, V.: LIFEisGAME prototype: a serious game about emotions for children with autism spectrum disorders. PsychNology J. 11(3), 191–211 (2013)Google Scholar
  13. 13.
    Hourcade, J.P., Bullock-Rest, N.E., Hansen, T.E.: Multitouch tablet applications and activities to enhance the social skills of children with autism spectrum disorders. Pers. Ubiquitous Comput. 16(2), 157–168 (2012)CrossRefGoogle Scholar
  14. 14.
    Whyte, E.M., Smyth, J.M., Scherf, S.: Designing serious game interventions for Individuals with autism. J. Autism Dev. Disord. (2014)Google Scholar
  15. 15.
    Baron-Cohen, S., Golan, O., Ashwin, E.: Can emotion recognition be taught to children with autism spectrum conditions? Phil. Trans. R. Soc. B. 364, 3567–74 (2009)CrossRefGoogle Scholar
  16. 16.
    Milne, M.K., Luerssen, M.H., Lewis, T.W., Leibbrandt, R.E., Powers, D.M.: Designing and evaluating interactive agents as social skills tutors for children with autism spectrum disorder. In: Conversational Agents and Natural Language Interaction: Techniques and Effective Practices, pp. 23–48. IGI Global, USA (2011)Google Scholar
  17. 17.
    Grawemeyer, B., Johnson, H., Brosnan, M., Ashwin, E., Benton, L.: Developing an embodied pedagogical agent with and for young people with autism spectrum disorder. In: Cerri, S.A., Clancey, W.J., Papadourakis, G., Panourgia, K. (eds.) ITS 2012. LNCS, vol. 7315, pp. 262–267. Springer, Heidelberg (2012) CrossRefGoogle Scholar
  18. 18.
    Kätsyri, J., Saalasti, S., Tiippana, K., von Wendt, L., Sams, M.: Impaired recognition of facial emotions from low-spatial frequencies in Asperger syndrome. Neuropsychologia. 46, 1888–1897 (2008)CrossRefGoogle Scholar
  19. 19.
    Valla, J.M., Maendel, J.W., Ganzel, B.L., Barsky, A.R., Belmonte, M.K.: Autistic trait interactions underlie sex-dependent facial recognition abilities in the normal population. Front Psychol. 4(286) (2013)Google Scholar
  20. 20.
    Strauss, M.S., Newell, L.C., Best, C.A., Hannigen, S.F., Gastgeb, H.Z., Giovannelli, J.L.: The development of facial gender categorization in individuals with and without autism: the impact of typicality. J Autism Dev Disord. 42(9), 1847–1855 (2012)CrossRefGoogle Scholar
  21. 21.
    Götzelmann, T.: Towards non-photorealistic rendering in car navigation. J. Comput. Eng. Inf. Technol. 1(1) (2012)Google Scholar
  22. 22.
    Lee, J., Kim, H., Kim, M., Park, H., Kim, H.: Non-Photorealistic Rendering applied Semantic LOD. In: HCI KOREA 2015. pp. 1–6. Hanbit Media, Inc. (2015)Google Scholar
  23. 23.
    Epp, K.M.: Outcome-based evaluation of a social skills program using art therapy and group therapy for children on the autism spectrum. Child. Sch. 30(1), 27–36 (2008)CrossRefGoogle Scholar
  24. 24.
    Emery, M.J.: Art therapy as an intervention for autism. Art Ther.: J. Am. Art Ther. Assoc. 21(3), 143–147 (2004)MathSciNetCrossRefGoogle Scholar
  25. 25.
    Arellano, D., Helzle, V., Schaller, U.M., Rauh, R.: Animated faces, abstractions and autism. In: Bickmore, T., Marsella, S., Sidner, C. (eds.) IVA 2014. LNCS, vol. 8637, pp. 22–25. Springer, Heidelberg (2014) Google Scholar
  26. 26.
    Peirce, J. W.: Generating Stimuli for Neuroscience Using PsychoPy. Front. Neuroinform. 2(10) (2009)Google Scholar
  27. 27.
    Helzle, V., Biehn, C., Schlömer, T., Linner, F.: Adaptable setup for performance driven facial animation. In: ACM SIGGRAPH 2004 Sketches, p. 54 (2004)Google Scholar
  28. 28.
    Ekman, P., Friesen, W., Hager, J.: The Facial Action Coding System. Weidenfeld & Nicolson, London (2002)Google Scholar
  29. 29.
    Rühl, D., Bölte, S., Feineis-Matthews, S., Poustka, F.: ADOS: Diagnostische Beobachtungsskala für Autistische Störungen. Huber, Bern (2004)Google Scholar
  30. 30.
    Bölte, S., Rühl, D., Schmötzer, G., Poustka, F.: ADI-R: Diagnostisches Interview für Autismus - Revidiert German version of Autism Diagostic Interview - Revised. Huber, Bern (2006) Google Scholar
  31. 31.
    Smith, M.J.L., Montagne, B., Perrett, D.I., Gill, M., Gallagher, L.: Detecting subtle facial emotion recognition deficits in high-functioning Autism using dynamic stimuli of varying intensities. Neuropsychologia 48(9), 2777–2781 (2010)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Diana Arellano
    • 1
    Email author
  • Ulrich Max Schaller
    • 2
  • Reinhold Rauh
    • 2
  • Volker Helzle
    • 1
  • Marc Spicker
    • 3
  • Oliver Deussen
    • 3
  1. 1.Filmakademie Baden-WürttembergLudwigsburgGermany
  2. 2.University Medical Center FreiburgFreiburg Im BreisgauGermany
  3. 3.University of KonstanzKonstanzGermany

Personalised recommendations