Juke Cylinder: Sound Image Augmentation to Metamorphose Hands into a Musical Instrument
This paper proposes a piece of interactive art installation named the “Juke Cylinder” to augment sound images through hand interaction and to metamorphose hands into a musical instrument. To augment a sound image onto users’ hands, we used a parametric loudspeaker because it can localize a sound image on a reflecting surface. When users interact with our system, they perceive that their hands are metamorphosed into various musical instruments such as a guitar, a piano, or a synthesizer. Users can control the pitches of the sounds depending on their hand interactions such as with real musical instruments. In a demonstration at a media art exhibition, this system provided visitors with extraordinary sound experiences, and we received positive feedback from them.
KeywordsSound image localization Parametric loudspeaker Musical instrument Media art
Unable to display preview. Download preview PDF.
- 1.Pompei, F.J.: The use of airborne ultrasonics for generating audible sound beams. J. Audio Eng. Soc. 47(9), 726–731 (1999)Google Scholar
- 3.Dobler, D., Haller, M., Stampfl, P.: ASR: Augmented sound reality. In: ACM SIGGRAPH 2002 Conference Abstracts and Applications, p. 148 (2002)Google Scholar
- 4.Nishimura, K., Kimura, K., Yamazaki, M., Suzuki, Y., Tanikawa, T., Hirose, M.: Public art at a baggage claim at haneda airport: Bird of luggage. Transactions of the Virtual Reality Society of Japan 15(3), 467–470 (2010)Google Scholar
- 5.Kimura, K., Hoshuyama, O., Narumi, T., Tanikawa, T., Hirose, M.: Sound-power visualization system for real-world interaction based on ultrasonic power transmission. In: Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology, ACE 2011, 60:1–60:8(2011)Google Scholar
- 6.Zerroug, A., Cassinelli, A., Ishikawa, M.: Invoked computing: Spatial audio and video ar invoked through miming. In: Proceedings of Virtual Reality International Conference, LAVAL VIRTUAL 2011, pp. 31–32 (2011)Google Scholar
- 7.Harrison, C., Benko, H., Wilson, A.D.: Omnitouch: wearable multitouch interaction everywhere. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST 2011, pp. 441–450 (2011)Google Scholar
- 8.Wilson, A.D., Benko, H.: Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In: Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, UIST 2010, pp. 273–282 (2010)Google Scholar