Abstract
Facial expression perception and production are crucial for social functioning. Children with autism spectrum disorders (ASD) are impaired in their ability to produce and perceive dynamic facial expressions, which may contribute to social deficits. Here we present a novel intervention system for improving facial expression perception and production in children with ASD based on computer vision. We present a live demo of the Emotion Mirror, a game where the children make facial expressions of basic emotions (anger, disgust, fear, happiness, sadness, and surprise) that are “mirrored” by a cartoon character on the screen who responds dynamically in real-time. In the reverse mirror condition, the character makes an expression and children are rewarded when they successfully copy the expression of the character. This application demonstrates a novel intersection of computer vision and medicine enabled by real-time facial expression processing.
Chapter PDF
Similar content being viewed by others
References
McIntosh, D., et al.: When the social mirror breaks ... Developmental Science 9, 295–302 (2006)
Adolphs, R., Sears, L., Piven, J.: Abnormal processing of social information from faces in autism. J. Cog. Neuroscience 13, 232–240 (2001)
Williams, J., et al.: Imitation, mirror neurons and autism. Neuroscience & Biobehavioral Reviews 25(4), 287–295 (2001)
Littlewort, G., et al.: The computer expression recognition toolbox (CERT). In: IEEE International Conference on Automatic Face and Gesture Recognition, pp. 298–305. IEEE Xplore (2011)
Ekman, P., Friesen, W.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psych. Press, Palo Alto (1978)
Viola, P., Jones, M.: Robust real-time face detection. J. Computer Vision 57(2), 137–154 (2004)
Niedenthal, P.M., Mermillod, M., Maringer, M., Hess, U.: The Simulation of Smiles (SIMS) Model: Embodied Simulation and the Meaning of Facial Expression. Behavioral and Brain Sciences 33(6), 417–433 (2010)
Gepner, B., Féron, F.: Autism: a world changing too fast for a mis-wired brain? Neurosci. Biobehav. Rev. 33(8), 1227–1242 (2009)
Bartlett, M.: Emotion simulation and expression understanding: A case for time. Invited commentary on Niedenthal et al. Behavioral and Brain Sciences 33(6), 435-436 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Deriso, D., Susskind, J., Krieger, L., Bartlett, M. (2012). Emotion Mirror: A Novel Intervention for Autism Based on Real-Time Expression Recognition. In: Fusiello, A., Murino, V., Cucchiara, R. (eds) Computer Vision – ECCV 2012. Workshops and Demonstrations. ECCV 2012. Lecture Notes in Computer Science, vol 7585. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33885-4_79
Download citation
DOI: https://doi.org/10.1007/978-3-642-33885-4_79
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33884-7
Online ISBN: 978-3-642-33885-4
eBook Packages: Computer ScienceComputer Science (R0)