Abstract
This paper presents a method for tracking multiple skin-colored objects in images acquired by a possibly moving camera. The proposed method encompasses a collection of techniques that enable the modeling and detection of skin-colored objects as well as their temporal association in image sequences. Skin-colored objects are detected with a Bayesian classifier which is bootstrapped with a small set of training data. Then, an off-line iterative training procedure is employed to refine the classifier using additional training images. On-line adaptation of skin-color probabilities is used to enable the classifier to cope with illumination changes. Tracking over time is realized through a novel technique which can handle multiple skin-colored objects. Such objects may move in complex trajectories and occlude each other in the field of view of a possibly moving camera. Moreover, the number of tracked objects may vary in time. A prototype implementation of the developed system operates on 320x240 live video in real time (28Hz) on a conventional Pentium 4 processor. Representative experimental results from the application of this prototype to image sequences are also provided.
Chapter PDF
References
Canny, J.F.: A computational approach to edge detection. IEEE Trans. on PAMI 8(11), 769–798 (1986)
Chai, D., Ngan, K.N.: Locating facial region of a head-and-shoulders color image. In: Proc. of FG 1998, pp. 124–129 (1998)
Delamarre, Q., Faugeras, O.: 3d articulated models and multi-view tracking wih physical forces. Computer Vision and Image Understanding 81, 328–357 (2001)
Gavrila, D.M.: The visual analysis of human movement: A survey. Computer Vision and Image Understanding 73(1), 82–98 (1999)
Hue, C., Le Cadre, J.-P., Perez, P.: Sequential monte carlo methods for multiple target tracking and data fusion. IEEE Trans. on Signal Proc. 50(2), 309–325 (2002)
Isard, M., Blake, A.: Icondensation: Unifying low-level and high-level tracking in a stochastic framework. In: Burkhardt, H.-J., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1406, pp. 893–908. Springer, Heidelberg (1998)
Javed, O., Shah, M.: Tracking and object classification for automated surveillance. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 343–357. Springer, Heidelberg (2002)
Jebara, T.S., Pentland, A.: Parameterized structure from motion for 3d adaptive feedback tracking of faces. In: Proc. of CVPR 1997, pp. 144–150 (1997)
Jebara, T.S., Russel, K., Pentland, A.: Mixture of eigenfeatures for real-time structure from texture. In: Proc. of ICCV 1998, pp. 128–135 (1998)
Jones, M.J., Rehg, J.M.: Statistical color models with application to skin detection. In: Proc. of CVPR 1999, vol. 1, pp. 274–280 (1999)
Kalman, R.E.: A new approach to linear filtering and prediction problems. Transactons of the ACME-Journal of Basic Engineering, 35–45 (1960)
Kim, S.H., Kim, N.K., Ahn, S.C., Kim, H.G.: Object oriented face detection using range and color information. In: Proc. of FG 1998, pp. 76–81 (1998)
Koller-Meier, E., Ade, F.: Tracking multiple objects using the condensation algorithm. Journal of Robotics and Autonomous Systems 34(2-3), 93–105 (2001)
Raja, Y., McKenna, S., Gong, S.: Tracking color objects using adaptive mixture models. IVC journal 17(3-4), 225–231 (1999)
Saxe, D., Foulds, R.: Toward robust skin identification in video images. In: Proc. of FG 1996, pp. 379–384 (1996)
Siebel, N.T., Maybank, S.J.: Fusion of multiple tracking algorithms for robust people tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 373–387. Springer, Heidelberg (2002)
Spengler, M., Schiele, B.: Multi object tracking based on a modular knowledge hierarchy. In: Crowley, J.L., Piater, J.H., Vincze, M., Paletta, L. (eds.) ICVS 2003. LNCS, vol. 2626, pp. 373–387. Springer, Heidelberg (2003)
Terrillon, J.C., Shirazi, M.N., Fukamachi, H., Akamatsu, S.: Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images. In: Proc. of FG 2000, pp. 54–61 (2000)
Triesch, J., von der Malsburg, C.: Democratic integration: Self-organized integration of adaptive cues. Neural Computation 13(9), 2049–2074 (2001)
Yang, M.H., Ahuja, N.: Detecting human faces in color images. In: Proc. of ICIP 1998, vol. 1, pp. 127–130 (1998)
Yang, M.H., Ahuja, N.: Face Detection and Gesture Recognition for Human computer Interaction. Kluwer Academic Publishers, New York (2001)
Yang, M.H., Kriegman, D.J., Ahuja, N.: Detecting faces in images: A survey. IEEE Trans. on PAMI 24(1), 34–58 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Argyros, A.A., Lourakis, M.I.A. (2004). Real-Time Tracking of Multiple Skin-Colored Objects with a Possibly Moving Camera. In: Pajdla, T., Matas, J. (eds) Computer Vision - ECCV 2004. ECCV 2004. Lecture Notes in Computer Science, vol 3023. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24672-5_29
Download citation
DOI: https://doi.org/10.1007/978-3-540-24672-5_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21982-8
Online ISBN: 978-3-540-24672-5
eBook Packages: Springer Book Archive