Abstract
In this study, we tested the feasibility of capturing video of facial expressions while concurrently capturing motion capture and video of bodily expressions. To collect facial expression data, we used a custom designed head-mount for a video camera that provided images for facial expression microanalysis but did not limit freedom of movement. We assessed the effect of the head-mount on emotion elicitation, emotion recognition, qualitative aspects of body movement, and quantitative aspects of body movement. The results indicate that while the head-mount may slightly constrain arm movement, wearing the head-mounted camera during motion capture is a valid method for collecting facial and bodily data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ambadar, Z., Schooler, J.W., Cohn, J.F.: Deciphering the enigmatic face. The importance of facial dynamics in interpreting subtle facial expressions. Psychol. Sci. 16, 403–410 (2005)
Atkinson, A.P., Dittrich, W.H., Gemmell, A.J., Young, A.W.: Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33, 717–746 (2004)
Bachorowski, J.-A.: Vocal expression and perception of emotion. Curr. Dir. Psychol. Sci. 8, 53–57 (1999)
Banse, R., Scherer, K.R.: Acoustic profiles in vocal emotion expression. J. Pers. Soc. Psychol. 70, 614–636 (1996)
Castellano, G. Kessous, L., Caridakis, G.: Emotion recognition through multiple modalities: face, body gesture, speech. In: Peter C., Beale R. (eds.) Affect and Emotion in Human–Computer Interaction, vol. 4868. Springer, Heidelberg (2008)
Chi, D.M.: A motion control scheme for animating expressive arm movements. University of Pennsylvania (1999)
Chi, D., Costa, M., Zhao, L., Badler, N.: The EMOTE model for effort and shape. In: Proceedings of the 27th annual conference on Computer Graphics and Interactive Techniques, pp. 173–182 (2000)
Cohn, J.F., Kanade, T.: Use of automated facial image analysis for measurement of emotion expression. In: Coan, J.A., Allen, J.J.B. (eds.) Handbook of Emotion Elicitation and Assessment, pp. 222–238. Oxford University Press, Oxford (2007)
Coulson, M.: Attributing emotion to static body postures: recognition accuracy confusions, and viewpoint dependence. J. Nonverbal Behav. 28, 117–139 (2004)
De Silva, P.R.: Therapeutic tool for develop child nonverbal communication skills through interactive game. In: International Conference on Computational Intelligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and International Commerce (CIMCA’06), pp. 33–33 (2006)
Ekman, P.: Facial expression and emotion. Am. Psychol. 48, 384–392 (1993)
Ekman, P., Friesen, W.V.: The facial action coding system. Consulting Psychologists Press, Palo Alto (1978)
Ellgring, H., Scherer, K.: Vocal indicators of mood change in depression. J. Nonverbal Behav. 20, 83–110 (1996)
Gray, E.K., Watson, D.: Assessing positive and negative affect via self-report. In: Coan, J.A., Allen, J.J.B. (eds.) Handbook of Emotion Elicitation and Assessment, pp. 171–183. Oxford University Press, Oxford (2007)
Janssen, D., Schöllhorn, W., Lubienetzki, J., Fölling, K., Kokenge, H., Davids, K.: Recognition of emotions in gait patterns by means of artificial neural nets. J. Nonverbal Behav. 32, 79–92 (2008)
Karg, M., Hnlenz, K., Buss, M.: Recognition of affect based on gait patterns, part B: cybernetics. IEEE Trans. Syst. Man Cybern. 40, 1050–1061 (2010)
Labouvie-Vief, G., Lumley, M.A., Jain, E., Heinze, H.: Age and gender differences in cardiac reactivity and subjective emotion responses to emotional autobiographical memories. Emotion 3, 115–126 (2003)
Larsen, R.J., Fredrickson, B.L.: Measurement issues in emotion research. In: Kahneman, D., Diener, E., Schwarz, N. (eds.) Well-Being: The Foundations of Hedonic Psychology. Russell Sage, New York (1999)
Levenson, R., Cartensen, L., Friesen, W., Ekman, P.: Emotion, physiology and expression in old age. Psychol. Aging 6, 28–35 (1991)
Montepare, J., Goldstein, S.B., Clausen, A.: The identification of emotions from gait information. J. Nonverbal Behav. 11, 33–42 (1987)
Pollick, F.E., Paterson, H.M., Bruderlin, A., Sanford, A.J.: Perceiving affect from arm movement. Cognition 82, B51–B61 (2001)
Scherer, K., Ellgring, H.: Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal? Emotion 7, 113–130 (2007)
Scherer, K., Ellgring, H.: Multimodal expression of emotion: affect programs or componential appraisal patterns? Emotion 7, 158–171 (2007)
Torresani, L., Hackney, P., Bregler, C.: Learning motion style synthesis from perceptual observations. In: Conference Proceedings of Neural Information Processing Systems, Vancouver (2007)
Vural, E., Cetin, M., Ercil, A., Littlewort, G. Bartlett, M., Movellan, J.: Drowsy driver detection through facial movement analysis. In: ICCV Workshop on Human Computer Interaction Rio de Janeiro, Brazil (2007)
Wallbott, H.G.: Bodily expression of emotion. Eur. J. Soc. Psychol. 28, 879–896 (1998)
Zhan, C., Li, W., Ogunbona, P., Safaei, F.: A real-time facial expression recognition system for online games. Int. J. Comput. Game. Technol. 2008, 7 (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag London Limited
About this chapter
Cite this chapter
Crane, E.A., Gross, M.M., Fredrickson, B.L. (2011). Feasibility of Using a Head-Mounted Camera to Capture Dynamic Facial Expressions During Body Movement. In: England, D. (eds) Whole Body Interaction. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-0-85729-433-3_12
Download citation
DOI: https://doi.org/10.1007/978-0-85729-433-3_12
Published:
Publisher Name: Springer, London
Print ISBN: 978-0-85729-432-6
Online ISBN: 978-0-85729-433-3
eBook Packages: Computer ScienceComputer Science (R0)