Abstract
This paper presents a method of image processing used in a mono-vision system in order to study semiotic gestures. We present a robust method to track the hands and face of a person performing gestural communication and the Signs’ language communication. A model of skin is used to compute the observation density as a skin colour distribution in the image. Three particle filter trackers are implemented, with re-sampling and annealed update steps to increase their robustness to occultation and high acceleration variations of body parts’. Evaluations of the trackers with and without these enhancements, show the improvement that they bring.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cadoz, C.: Le geste canal de communication homme/machine. La communication “instrumentale”. Techniques et Sciences Informatiques (13), 32–61 (1994)
McNeill, D.: Hand and mind: What gestures reveal about thought. University of Chicago Press (1992)
Carbini, S., Viallet, J.E., Bernier, O., Bascle, B.: Tracking body parts of multiple people for multi-person multimodal interface. In: IEEE International Workshop on Human-Computer Interaction, Beijing, China, October 21 (2005)
Gall, J., Potthoff, J., Schnoerr, C., Rosenhahn, B., Seidel, H.: Interacting and annealing particle filters: Mathematics and a recipe for applications. Technical Report MPI-I-2006-4-009, Max-Planck Institute for Computer Science (2006)
Kitagawa, G.: Monte carlo filter and smoother for non-gaussian nonlinear state space models. Journal of Computational and Graphical Statistics 5(1), 1–25 (1996)
Deutscher, J., Blake, A., Reid, I.: Articulated body motion capture by annealed particle filtering. In: Computer Vision and Pattern Recognition (2000)
MacCormick, J., Isard, M.: Partitioned sampling, articulated objects, and interface-quality hand tracking. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1843, pp. 3–19. Springer, Heidelberg (2000)
Bar-Shalom, Y.: Tracking and data association. Academic Press Professional, Inc, San Diego (1987)
Haritaoglu, I., Harwood, D., Davis, L.S.: Ghost: a human body part labelling system using silhouette. In: Proc. of IEEE Conf. on Pattern Recognition (1), pp. 77–82 (1998)
MacCormick, J., Blake, A.: A probabilistic exclusion principle for tracking multiple objects. Int. Journal on Computer Vision 39(1) (2000)
Cassel, R., Collet, C., Gherbi, R.: Real-time acrobatic gesture analysis. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS, vol. 3881, pp. 88–99. Springer, Heidelberg (2006)
Braffort, A., Choisier, A., Collet, C., Dalle, P., Gianni, F., Lenseigne, B., Segouat, J.: Toward an annotation software for video of sign language, including image processing tools and signing space modelling. In: Proc. of 4th International Conference on Language Resources and Evaluation - LREC 2004, Lisbon, Portugal, May 26–28, 2004, vol. 1, pp. 201–203 (2004)
Lenseigne, B., Dalle, P.: Using Signing Space as a Representation for Sign Language Processing . In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS, vol. 3881, pp. 25–36. Springer, Heidelberg (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gianni, F., Collet, C., Dalle, P. (2009). Robust Tracking for Processing of Videos of Communication’s Gestures. In: Sales Dias, M., Gibet, S., Wanderley, M.M., Bastos, R. (eds) Gesture-Based Human-Computer Interaction and Simulation. GW 2007. Lecture Notes in Computer Science(), vol 5085. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92865-2_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-92865-2_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92864-5
Online ISBN: 978-3-540-92865-2
eBook Packages: Computer ScienceComputer Science (R0)