Handel, a Free-Hands Gesture Recognition System

  • Leonello Tarabella
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3310)

Abstract

I describe here a real-time vision-based gesture recognition system used in interactive computer music performances. The performer moves his hands in a video-camera capture area, the camera sends the signal to a video digitizer card plugged in a laptop computer. By processing the reconstructed im-ages of the performer’s hands in movement the computer detects x-y positions, shape (posture) and angle of rotation of both the hands. Data extracted from image analysis every frame is used for controlling real-time interactive computer music performances. Two approaches, one more formal the other really operative, are presented.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bordegoni, M., Faconti, G.P.: Architectural Models of Gesture System. In: Harling, P.A., Edwards, A. (eds.) Proceedings of Gesture Workshop 1996, pp. 61–74. Springer, Heidelberg (1996)Google Scholar
  2. 2.
    Rubine, D.: Specifying gesture by example, Computer Graphics, 25(4), pp. 329–337 (1991)Google Scholar
  3. 3.
    Hartung, K., Münch, S., Schomaker, L., Guiard-Marigny, T., Le Goff, B., MacLaverty, R., Nijtmans, J., Camurri, A., Defée, I., Benoît, C.: Development of a System Architecture for the Acquisition, Integration, and Representation of Multimodal Information, A Report of the ESPRIT Project 8579 MIAMI, -WP 3 (March 1996)Google Scholar
  4. 4.
    Duke, D.J.: Reasoning about gestural interaction. In: Proceedings of Eurographics 1995, NCC Blackwellm, pp. 55–56 (1995)Google Scholar
  5. 5.
    Nagashima, Y.: Interactive multimedia performance with bio-sensing and bio-feedback, Shizuoka University of Art and Culture & Science Laboratory. In: Int. Conference on Auditory Display, 1794-1 Nuguchi, Hamamatsu, Shizuoka, 430–8533, Japan (2002)Google Scholar
  6. 6.
    Wexelblat, A.: An approach to natural gesture in virtual environment. In: ACM ToCHI, pp. 179–200. ACM Press, New York (1996)Google Scholar
  7. 7.
    Paradiso, J.: Electronic Music: New Ways to Play, pp. 18–30. IEEE Spectrum Computer Society Press, Los Alamitos (1997)Google Scholar
  8. 8.
    Rowe, R.: Machine Musicianship, pp. 343–353. MIT Press, Cambridge (March 2001)Google Scholar
  9. 9.
    Bertini, G., Carosi, P.: Light Baton, A System for Conducting Computer Music Performance. “Interface” (Journal of New Music Research), 22(3), 243–247 (1993)Google Scholar
  10. 10.
    Tarabella, L., Magrini, M., Scapellato, G.: Devices for interactive computer music and computer graphics performances. In: Procs. of IEEE First Workshop on Multimedia Signal Processing, Princeton, NJ, USA. IEEE (cat.n.97TH8256) Los Alamitos (1997)Google Scholar
  11. 11.
    New Music for Musical Expression, NIME 2002, Dublin, Ireland (May 2002)Google Scholar
  12. 12.
    Cardini, M., Tarabella, L.: Wireless, Premio Marconi 2002 per l’arte tecnologica, Circolo Artistico e Università di Bologna, Corte Isolani 7/a, Bologna (2002)Google Scholar
  13. 13.
    Cardini, M.: Segno elettronico contemporaneo. International Conference on Tecnologie e forme nell’arte e nella scienza, Università degli studi di Salerno (2003)Google Scholar
  14. 14.
    Tarabella, L., Bertini, G.: About the Role of Mapping in gesture controlled live computer music. In: Wiil, U.K. (ed.) CMMR 2003. LNCS, vol. 2771, pp. 217–224. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  15. 15.
    Cappellini, V.: Elaborazione numerica delle immagini, Editior Boringhieri SpA, Torino (1985)Google Scholar
  16. 16.
    Tarabella, L., Magrini, M., Scapellato, G.: A system for recognizing shape, position and rotation of the hands. In: Proceedings of th Internationl Computer Music Conference 1998, pp. 288–291 ICMA S.Francisco (1998)Google Scholar
  17. 17.
    Povall, R.: Realtime control of audio and video through physical motion: Steim’s Bigeye. In: Proc. Journées d’Informatique Musicale (1996)Google Scholar
  18. 18.
    Tarabella, L.: The pCM framework for realtime sound and music generation. In: Proceedings of the XIV Colloquium on Musical Informatics, Firenze, Italy (May 2003)Google Scholar
  19. 19.
    Tarabella, L.: The Object-Oriented pureCMusic framework. In: Proceedings of the International Conference on Understanding and Creating Music, Seconda Università di Napoli, Facoltà di Matematica, Caserta (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Leonello Tarabella
    • 1
  1. 1.computerART project of ISTI / CNRResearch Area of the Italian National Council of ResearchPisaItaly

Personalised recommendations