Advertisement

HIP-Storytelling: Hand Interactive Projection for Storytelling

  • Narciso Melo
  • Pedro Salgado
  • Ido Iurgel
  • Pedro Branco
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7069)

Abstract

We have created an interactive storytelling system for public spaces that is collaborative, easy and entertaining to use, and allows for a natural interaction. The system consists of a table, a ceiling mounted projector that projects onto the table, and a 3D camera for tracking hands and for object recognition. The main feature of the system is the projection on top of the palm of the hand of the users; thus, the hand becomes also a viewing surface. This allows for very natural gestural interaction, such as holding and passing objects between users. For example, in the course of narrative, users can hand over a story character or object to each other. We also employ projection based augmented reality to animate real objects on the table. Apart from entertainment, the system shall be employed for concrete educational interactive storytelling applications in public spaces.

Keywords

Interactive Storytelling HCI Natural User Interfaces Augmented Reality 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Ishii, Y., Homura, H.: It’s fire, you can touch it (July 5, 2011), http://www.ok-centrum.at/?q=en/content/presse/701
  2. 2.
    OASIS (Object-Aware Situated Interactive System) (July 5, 2011), http://software.intel.com/en-us/videos/oasis-object-aware-situated-interactive-system/
  3. 3.
    Lee, Y., Oh, S., Park, Y., Woo, W.: Responsive Multimedia System (RMS) for Personalized Storytelling. In: Proceedings of The 4th International Symposium on Ubiquitous VR, pp. 29–32 (2006)Google Scholar
  4. 4.
    Mazalek, A., Davenport, G., Ishii, H.: Tangible Viewpoints: a Physical Approach to Multimedia Stories. In: Proceedings of the 10th ACM International Conference on Multimedia (MM 2002), pp. 153–160 (2002)Google Scholar
  5. 5.
    Majewski, J.: Theorising Video Game Narrative. Master: Bond University (2003)Google Scholar
  6. 6.
    Biocca, F., Kim, J., Choi, Y.: Visual Touch In virtual environments: An exploratory study of presence, multimodal interfaces, and cross-modal sensory illusions. Presence 10(3), 247–265 (2001)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Narciso Melo
    • 1
  • Pedro Salgado
    • 1
  • Ido Iurgel
    • 1
    • 2
    • 3
  • Pedro Branco
    • 1
    • 3
  1. 1.engageLabUniversity of MinhoGuimarãesPortugal
  2. 2.CCG (Computer Graphics Center)University of MinhoGuimarãesPortugal
  3. 3.Department of Information SystemsUniversity of MinhoGuimarãesPortugal

Personalised recommendations