Abstract
I describe here a real-time vision-based gesture recognition system used in interactive computer music performances. The performer moves his hands in a video-camera capture area, the camera sends the signal to a video digitizer card plugged in a laptop computer. By processing the reconstructed im-ages of the performer’s hands in movement the computer detects x-y positions, shape (posture) and angle of rotation of both the hands. Data extracted from image analysis every frame is used for controlling real-time interactive computer music performances. Two approaches, one more formal the other really operative, are presented.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Bordegoni, M., Faconti, G.P.: Architectural Models of Gesture System. In: Harling, P.A., Edwards, A. (eds.) Proceedings of Gesture Workshop 1996, pp. 61–74. Springer, Heidelberg (1996)
Rubine, D.: Specifying gesture by example, Computer Graphics, 25(4), pp. 329–337 (1991)
Hartung, K., Münch, S., Schomaker, L., Guiard-Marigny, T., Le Goff, B., MacLaverty, R., Nijtmans, J., Camurri, A., Defée, I., Benoît, C.: Development of a System Architecture for the Acquisition, Integration, and Representation of Multimodal Information, A Report of the ESPRIT Project 8579 MIAMI, -WP 3 (March 1996)
Duke, D.J.: Reasoning about gestural interaction. In: Proceedings of Eurographics 1995, NCC Blackwellm, pp. 55–56 (1995)
Nagashima, Y.: Interactive multimedia performance with bio-sensing and bio-feedback, Shizuoka University of Art and Culture & Science Laboratory. In: Int. Conference on Auditory Display, 1794-1 Nuguchi, Hamamatsu, Shizuoka, 430–8533, Japan (2002)
Wexelblat, A.: An approach to natural gesture in virtual environment. In: ACM ToCHI, pp. 179–200. ACM Press, New York (1996)
Paradiso, J.: Electronic Music: New Ways to Play, pp. 18–30. IEEE Spectrum Computer Society Press, Los Alamitos (1997)
Rowe, R.: Machine Musicianship, pp. 343–353. MIT Press, Cambridge (March 2001)
Bertini, G., Carosi, P.: Light Baton, A System for Conducting Computer Music Performance. “Interface” (Journal of New Music Research), 22(3), 243–247 (1993)
Tarabella, L., Magrini, M., Scapellato, G.: Devices for interactive computer music and computer graphics performances. In: Procs. of IEEE First Workshop on Multimedia Signal Processing, Princeton, NJ, USA. IEEE (cat.n.97TH8256) Los Alamitos (1997)
New Music for Musical Expression, NIME 2002, Dublin, Ireland (May 2002)
Cardini, M., Tarabella, L.: Wireless, Premio Marconi 2002 per l’arte tecnologica, Circolo Artistico e Università di Bologna, Corte Isolani 7/a, Bologna (2002)
Cardini, M.: Segno elettronico contemporaneo. International Conference on Tecnologie e forme nell’arte e nella scienza, Università degli studi di Salerno (2003)
Tarabella, L., Bertini, G.: About the Role of Mapping in gesture controlled live computer music. In: Wiil, U.K. (ed.) CMMR 2003. LNCS, vol. 2771, pp. 217–224. Springer, Heidelberg (2004)
Cappellini, V.: Elaborazione numerica delle immagini, Editior Boringhieri SpA, Torino (1985)
Tarabella, L., Magrini, M., Scapellato, G.: A system for recognizing shape, position and rotation of the hands. In: Proceedings of th Internationl Computer Music Conference 1998, pp. 288–291 ICMA S.Francisco (1998)
Povall, R.: Realtime control of audio and video through physical motion: Steim’s Bigeye. In: Proc. Journées d’Informatique Musicale (1996)
Tarabella, L.: The pCM framework for realtime sound and music generation. In: Proceedings of the XIV Colloquium on Musical Informatics, Firenze, Italy (May 2003)
Tarabella, L.: The Object-Oriented pureCMusic framework. In: Proceedings of the International Conference on Understanding and Creating Music, Seconda Università di Napoli, Facoltà di Matematica, Caserta (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tarabella, L. (2005). Handel, a Free-Hands Gesture Recognition System. In: Wiil, U.K. (eds) Computer Music Modeling and Retrieval. CMMR 2004. Lecture Notes in Computer Science, vol 3310. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-31807-1_11
Download citation
DOI: https://doi.org/10.1007/978-3-540-31807-1_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24458-5
Online ISBN: 978-3-540-31807-1
eBook Packages: Computer ScienceComputer Science (R0)