Exploring Body Language as Narrative Interface

  • Nahum Álvarez
  • Federico Peinado
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7648)

Abstract

The limitations of current technology in the field of user interaction cause a bottleneck in the development of interactive digital storytelling systems. The use of body language has recently arisen as a simple but expressive approach to human-computer interaction, motion capture devices being used in interactive simulations and videogames. This paper discusses the use of these devices for recognition of body movements as key elements for designing interactive stories in virtual environments, presenting our findings in the early stages of development of a serious game that uses Microsoft Kinect for allowing players to interact in a more sensitive and amusing way.

Keywords

Theory of Interactive Storytelling Narrative Videogames Edutainment User Interaction Nonverbal Communication Motion Sensing 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Alexiadis, D.S., Kelly, P., Daras, P., O’Connor, N.E., Boubekeur, T., Moussa, M.B.: Evaluating a Dancer’s Performance using Kinect-based Skeleton Tracking. In: 19th ACM International Conference on Multimedia, pp. 659–662. ACM, New York (2011)CrossRefGoogle Scholar
  2. 2.
    Seif El-Nasr, M., Wei, H.: Exploring Non-verbal Behavior Models for Believable Characters. In: Spierling, U., Szilas, N. (eds.) ICIDS 2008. LNCS, vol. 5334, pp. 71–82. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  3. 3.
    Ganesan, S., Anthony, L.: Using the Kinect to Encourage Older Adults to Exercise: a Prototype. In: 2012 ACM Annual Extended Abstracts on Human Factors in Computing Systems, pp. 2297–2302. ACM, New York (2012)CrossRefGoogle Scholar
  4. 4.
    Kendon, A.: Nonverbal Communication, Interaction and Gesture: Selections from Semiotica. Approaches to Semiotics, vol. 41. Mouton and Co., The Hague (1981)CrossRefGoogle Scholar
  5. 5.
    Kistler, F., Sollfrank, D., Bee, N., André, E.: Full Body Gestures Enhancing a Game Book for Interactive Story Telling. In: Si, M., Thue, D., André, E., Lester, J.C., Tanenbaum, J., Zammitto, V. (eds.) ICIDS 2011. LNCS, vol. 7069, pp. 207–218. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  6. 6.
    Kleinsmith, A., Bianchi-Berthouze, N., Steed, A.: Automatic Recognition of Non-Acted Affective Postures. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 41(4), 1027–1038 (2011)CrossRefGoogle Scholar
  7. 7.
    Kress, G., van Leeuwen, T.: Multimodal Discourse, Bloomsbury, USA (2001)Google Scholar
  8. 8.
    Lang, S., Block, M., Rojas, R.: Sign Language Recognition Using Kinect. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2012, Part I. LNCS, vol. 7267, pp. 394–402. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  9. 9.
    Maraffi, C.T., Jhala, A.: Performatology: A Procedural Acting Approach for Interactive Drama in Cinematic Games. In: Si, M., Thue, D., André, E., Lester, J.C., Tanenbaum, J., Zammitto, V. (eds.) ICIDS 2011. LNCS, vol. 7069, pp. 322–325. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  10. 10.
    Marquardt, Z., Beira, J., Em, N., Paiva, I., Kox, S.: Super Mirror: a Kinect Interface for Ballet Dancers. In: ACM Annual Conference Extended Abstracts on Human Factors in Computing Systems, pp. 1619–1624. ACM, New York (2012)Google Scholar
  11. 11.
    Norris, S.: Analyzing Multimodal Interaction: A Methodological Framework. Routledge, New York (2004)Google Scholar
  12. 12.
    Oh, J., Jung, Y., Cho, Y., Hahm, C., Sin, H., Lee, J.: Hands-up: Motion Recognition using Kinect and a Ceiling to Improve the Convenience of Human Life. In: ACM Annual Conference Extended Abstracts on Human Factors in Computing Systems, New York, USA, pp. 1655–1660 (2012)Google Scholar
  13. 13.
    Ren, Z., Meng, J., Yuan, J., Zhang, Z.: Robust Hand Gesture Recognition with Kinect Sensor. In: 19th ACM International Conference on Multimedia, pp. 759–760. ACM, New York (2011)CrossRefGoogle Scholar
  14. 14.
    Zhang, Z.: Microsoft Kinect Sensor and Its Effect. IEEE Multimedia 19(2), 4–10 (2012)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Nahum Álvarez
    • 1
  • Federico Peinado
    • 2
  1. 1.National Institute of InformaticsJapan
  2. 2.Universidad Complutense de MadridSpain

Personalised recommendations