Sound and Movement Visualization in the AR-Jazz Scenario

  • Cristina Portalés
  • Carlos D. Perales
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5709)


This paper describes AR-Jazz, an augmented reality application designed to visualize sound and movements in live jazz performances. The augmented scenario is achieved within the program Max MSP Jitter, with an integrated inertial sensor and a microphone. As a display, a cinema screen is used. The application was first shown at the SedaJazz Festival 2007 in Valencia (Spain). In first place, a workshop was made in order the musicians to become familiar with the application. Secondly, a live performance was shown. The experience is described in this paper.


augmented reality jam session sound visualization inertial sensor 


  1. 1.
    Galantay, R., Torpus, J., Engeli, M.: “living-room” Interactive, Space-Oriented Augmented Reality. In: Proceedings of the 12th annual ACM international conference on Multimedia. ACM, New York (2004)Google Scholar
  2. 2.
    Cheok, A.D., Goh, K.H., Wei, L., Farbiz, F., Fong, S.W., Teo, S.L., Li, Y., Yang, X.: Human Pacman: a mobile, wide-area entertainment system based on physical, social, and ubiquitous computing. Personal and Ubiquitous Computing 8(2), 71–81 (2004)CrossRefGoogle Scholar
  3. 3.
    Kaufmann, H., Schmalstieg, D.: Mathematics and geometry education with collaborative augmented reality. Computers & Graphics 27(3), 339–345 (2003)CrossRefGoogle Scholar
  4. 4.
    Juan, M.C., Alcañiz, M., Monserrat, C., Botella, C., Baños, R.M., Guerrero, B.: Using augmented reality to treat phobias. IEEE Computer Graphics and Applications 25(6), 31–37 (2005)CrossRefGoogle Scholar
  5. 5.
    Ben-Joseph, E., Ishii, H., Underkoffler, J., Piper, B., Yeung, L.: Urban Simulation and the Luminous Planning Table: Bridging the Gap between the Digital and the Tangible. Journal of Planning Education and Research 21(2), 196–203 (2001)Google Scholar
  6. 6.
    Ha, T., Chang, Y., Woo, W.: Usability Test of Immersion for Augmented Reality Based Product Design. In: Technologies for E-Learning and Digital Entertainment, pp. 152–161. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  7. 7.
    Giner Martínez, F., Portalés Ricart, C.: The Augmented User: A Wearable Augmented Reality Interface. In: International Conference on Virtual Systems and Multimedia. Hal Thwaites, Ghent (2005)Google Scholar
  8. 8.
    Portalés Ricart, C.: Entornos de realidad aumentada en el campo del arte, in Departamento de Pintura, Universidad Politécnica de Valencia: Valencia. p. 508 (2008)Google Scholar
  9. 9.
  10. 10.

Copyright information

© IFIP International Federation for Information Processing 2009

Authors and Affiliations

  • Cristina Portalés
    • 1
  • Carlos D. Perales
    • 1
  1. 1.Universidad Politécnica de ValenciaValenciaSpain

Personalised recommendations