Augmenting a Ballet Dance Show Using the Dancer’s Emotion: Conducting Joint Research in Dance and Computer Science

  • Alexis Clay
  • Elric Delord
  • Nadine Couture
  • Gaël Domenger
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 30)


We describe the joint research that we conduct in gesture-based emotion recognition and virtual augmentation of a stage, bridging together the fields of computer science and dance. After establishing a common ground for dialogue, we could conduct a research process that equally benefits both fields. As computer scientists, dance is a perfect application case. Dancer’s artistic creativity orient our research choices. As dancers, computer science provides new tools for creativity, and more importantly a new point of view that forces us to reconsider dance from its fundamentals. In this paper we hence describe our scientific work and its implications on dance. We provide an overview of our system to augment a ballet stage, taking a dancer’s emotion into account. To illustrate our work in both fields, we describe three events that mixed dance, emotion recognition and augmented reality.


Dance Augmented Reality Affective Computing Stage Augmentation Emotion Recognition Arts and Science Research 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Grimson, W.E.L., Ettinger, G.J., White, S.J., Lozano-Perez, T., Wells, W.M., Kikinis, R.: An Automatic Registration Method for Frameless Stereotaxy, Image Guided Surgery and Enhanced Reality Visualisation. IEEE Trans. on Medical Imaging 15(2), 129–140 (1996)CrossRefGoogle Scholar
  2. 2.
    De Meijer, M.: The contribution of general features of body movement to the attribution of emotions. Journal of Nonverbal Behavior 13(4), 247–268 (1989)CrossRefGoogle Scholar
  3. 3.
    Wallbott, H.G.: Bodily expression of emotion. European Journal of Social Psychology 28, 879–896 (1998)CrossRefGoogle Scholar
  4. 4.
    Coulson, M.: Attributing emotion to static body postures: recognition accuracy, confusions, and viewpoint dependence. Journal of Nonverbal Behavior 28, 117–139 (2004)CrossRefGoogle Scholar
  5. 5.
    Camurri, A., Lagerlof, I., Volpe, G.: Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques. International Journal of Human-Computer Studies 59(1-2), 213–225 (2003)CrossRefGoogle Scholar
  6. 6.
    Castellano, G., Mortillaro, M., Camurri, A., Volpe, G., Scherer, K.R.: Automated analysis of body movement in emotionally expressive piano performances. Journal Article, Music Perception 26(2), 103–120 (2008)CrossRefGoogle Scholar
  7. 7.
    Valdez, P., Mehrabain, A.: Effects of Color on Emotions. Journal of Experimental Psychology 123(4), 394–409 (1994)CrossRefGoogle Scholar
  8. 8.
    Picard, R.: Affective Computing, Comput. Entertain. MIT Press, Cambridge (1997)Google Scholar
  9. 9.
    Scherer, K., WP3 Members: Preliminary Plans for Exemplars: Theory, Version 1.0, In HUMAINE Deliverable D3c, 28/05/2004 (2004),
  10. 10.
    Birren, F.: Color psychology and color therapy. University Books Inc., New Hyde Park (1961)Google Scholar
  11. 11.
    Darwin, C.: The expression of the emotions in man and animals. The Portable Darwin (1872)Google Scholar
  12. 12.
    Clay, A., Couture, N., Nigay, L.: Towards Emotion Recognition in Interactive Systems: Application to a Ballet Dance Show. In: Proceedings of the World Conference on Innovative Virtual Reality (WinVR 2009) - World Conference on Innovative Virtual Reality (WinVR 2009), Chalon-sur-Saone, France (2007)Google Scholar
  13. 13.
    Hodgson, J.: Mastering Movement: The Life and Work of Rudolf Laban. Paperback edition (2001)Google Scholar
  14. 14.
  15. 15.
  16. 16.
  17. 17.
    Kaiser, P.: Hand-drawn spaces. In: SIGGRAPH 1998: ACM SIGGRAPH 98 Electronic art and animation catalog, Orlando, Florida, United States, p. 134. ACM, New York (1998)CrossRefGoogle Scholar
  18. 18.
  19. 19.
    Milgram, P., Kishino, F.: A Taxonomy of Mixed Reality Visual Displays. IEICE Transactions on Information Systems E77-D(12), 1321–1329 (1994)Google Scholar
  20. 20.
    Ekman, P., Friesen, W.V.: Unmasking the face. A guide to recognizing emotions from facial clues. Prentice-Hall Inc., Englewood Cliffs (1975)Google Scholar
  21. 21.
    The Ethiopiques show (2009),
  22. 22.
    The CARE Project,

Copyright information

© ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering 2010

Authors and Affiliations

  • Alexis Clay
    • 1
    • 2
  • Elric Delord
    • 1
  • Nadine Couture
    • 1
    • 2
  • Gaël Domenger
    • 3
  1. 1.ESTIA, Technopole IzarbelBidartFrance
  2. 2.LaBRIUniversité de Bordeaux 1, CNRSTalenceFrance
  3. 3.Malandain Ballet BiarritzBiarritzFrance

Personalised recommendations