Exploring the Facial Expression Perception-Production Link Using Real-Time Automated Facial Expression Recognition
Motor production may play an important role in learning to recognize facial expressions. The present study explores the influence of facial production training on the perception of facial expressions by employing a novel production training intervention built on feedback from automated facial expression recognition. We hypothesized that production training using the automated feedback system would improve an individual’s ability to identify dynamic emotional faces. Thirty-four participants were administered a dynamic expression recognition task before and after either interacting with a production training video game called the Emotion Mirror or playing a control video game. Consistent with the prediction that perceptual benefits are tied to expression production, individuals with high engagement in production training improved more than individuals with low engagement or individuals who did not receive production training. These results suggest that the visual-motor associations involved in expression production training are related to perceptual abilities. Additionally, this study demonstrates a novel application of computer vision for real-time facial expression intervention training.
Unable to display preview. Download preview PDF.
- 1.Eisenberger, N., Cole, S.: Social neuroscience and health: neurophysiological mechanisms linking social ties with physical health. Nature Neuroscience (2012)Google Scholar
- 6.Madsen, M., El Kaliouby, R., Goodwin, M., Picard, R.: Technology for just-in-time in-situ learning of facial affect for persons diagnosed with an autism spectrum disorder. In: Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 19–26. ACM (2008)Google Scholar
- 7.Tanaka, J., Wolf, J., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., Brown, C., Stahl, S., Kaiser, M., Schultz, R.: Using computerized games to teach face recognition skills to children with autism spectrum disorder: the lets face it! program. Journal of Child Psychology and Psychiatry 51, 944–952 (2010)CrossRefGoogle Scholar
- 10.Heberlein, A., Adolphs, R.: Neurobiology of emotion recognition. Social Neuroscience: Integrating Biological and Psychological Explanations of Social Behavior 31 (2007)Google Scholar
- 16.Ekman, P., Friesen, W.: Facial action coding system: A technique for the measurement of facial movement (1978)Google Scholar
- 18.Littlewort, G., Whitehill, J., Wu, T., Fasel, I., Frank, M., Movellan, J., Bartlett, M.: The computer expression recognition toolbox (cert). In: 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), pp. 298–305. IEEE (2011)Google Scholar
- 20.Schyns, P., Petro, L., Smith, M.: Transmission of facial expressions of emotion co-evolved with their efficient decoding in the brain: behavioral and brain evidence. PLoS One 4, e5625 (2009)Google Scholar
- 21.Cribbie, R., Jamieson, J.: Decreases in posttest variance and the measurement of change. Methods of Psychological Research Online 9, 37–55 (2004)Google Scholar