Advertisement

Juke Cylinder: Sound Image Augmentation to Metamorphose Hands into a Musical Instrument

  • Masamichi Ueta
  • Osamu Hoshuyama
  • Takuji Narumi
  • Sho Sakurai
  • Tomohiro Tanikawa
  • Michitaka Hirose
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7624)

Abstract

This paper proposes a piece of interactive art installation named the “Juke Cylinder” to augment sound images through hand interaction and to metamorphose hands into a musical instrument. To augment a sound image onto users’ hands, we used a parametric loudspeaker because it can localize a sound image on a reflecting surface. When users interact with our system, they perceive that their hands are metamorphosed into various musical instruments such as a guitar, a piano, or a synthesizer. Users can control the pitches of the sounds depending on their hand interactions such as with real musical instruments. In a demonstration at a media art exhibition, this system provided visitors with extraordinary sound experiences, and we received positive feedback from them.

Keywords

Sound image localization Parametric loudspeaker Musical instrument Media art 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Pompei, F.J.: The use of airborne ultrasonics for generating audible sound beams. J. Audio Eng. Soc. 47(9), 726–731 (1999)Google Scholar
  2. 2.
    Gan, W.S., Tan, E.L., Kuo, S.M.: Audio projection. IEEE Signal Processing Magazine 28(1), 43–57 (2011)CrossRefGoogle Scholar
  3. 3.
    Dobler, D., Haller, M., Stampfl, P.: ASR: Augmented sound reality. In: ACM SIGGRAPH 2002 Conference Abstracts and Applications, p. 148 (2002)Google Scholar
  4. 4.
    Nishimura, K., Kimura, K., Yamazaki, M., Suzuki, Y., Tanikawa, T., Hirose, M.: Public art at a baggage claim at haneda airport: Bird of luggage. Transactions of the Virtual Reality Society of Japan 15(3), 467–470 (2010)Google Scholar
  5. 5.
    Kimura, K., Hoshuyama, O., Narumi, T., Tanikawa, T., Hirose, M.: Sound-power visualization system for real-world interaction based on ultrasonic power transmission. In: Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology, ACE 2011, 60:1–60:8(2011)Google Scholar
  6. 6.
    Zerroug, A., Cassinelli, A., Ishikawa, M.: Invoked computing: Spatial audio and video ar invoked through miming. In: Proceedings of Virtual Reality International Conference, LAVAL VIRTUAL 2011, pp. 31–32 (2011)Google Scholar
  7. 7.
    Harrison, C., Benko, H., Wilson, A.D.: Omnitouch: wearable multitouch interaction everywhere. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST 2011, pp. 441–450 (2011)Google Scholar
  8. 8.
    Wilson, A.D., Benko, H.: Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In: Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, UIST 2010, pp. 273–282 (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Masamichi Ueta
    • 1
  • Osamu Hoshuyama
    • 2
  • Takuji Narumi
    • 1
  • Sho Sakurai
    • 1
  • Tomohiro Tanikawa
    • 1
  • Michitaka Hirose
    • 1
  1. 1.The University of TokyoBunkyo-kuJapan
  2. 2.NEC CorporationKawasakiJapan

Personalised recommendations