HIP-Storytelling: Hand Interactive Projection for Storytelling
We have created an interactive storytelling system for public spaces that is collaborative, easy and entertaining to use, and allows for a natural interaction. The system consists of a table, a ceiling mounted projector that projects onto the table, and a 3D camera for tracking hands and for object recognition. The main feature of the system is the projection on top of the palm of the hand of the users; thus, the hand becomes also a viewing surface. This allows for very natural gestural interaction, such as holding and passing objects between users. For example, in the course of narrative, users can hand over a story character or object to each other. We also employ projection based augmented reality to animate real objects on the table. Apart from entertainment, the system shall be employed for concrete educational interactive storytelling applications in public spaces.
KeywordsInteractive Storytelling HCI Natural User Interfaces Augmented Reality
Unable to display preview. Download preview PDF.
- 1.Ishii, Y., Homura, H.: It’s fire, you can touch it (July 5, 2011), http://www.ok-centrum.at/?q=en/content/presse/701
- 2.OASIS (Object-Aware Situated Interactive System) (July 5, 2011), http://software.intel.com/en-us/videos/oasis-object-aware-situated-interactive-system/
- 3.Lee, Y., Oh, S., Park, Y., Woo, W.: Responsive Multimedia System (RMS) for Personalized Storytelling. In: Proceedings of The 4th International Symposium on Ubiquitous VR, pp. 29–32 (2006)Google Scholar
- 4.Mazalek, A., Davenport, G., Ishii, H.: Tangible Viewpoints: a Physical Approach to Multimedia Stories. In: Proceedings of the 10th ACM International Conference on Multimedia (MM 2002), pp. 153–160 (2002)Google Scholar
- 5.Majewski, J.: Theorising Video Game Narrative. Master: Bond University (2003)Google Scholar