Abstract
This paper proposes the use of a particle filter combined with color, depth information, gradient and shape features as an efficient and effective way of dealing with tracking of a head on the basis of image stream coming from a mobile stereovision camera. The head is modeled in the 2D image domain by an ellipse. A weighting function is used to include spatial information in color histogram representing the interior of the ellipse. The lengths of the ellipse’s minor axis are determined on the basis of depth information. The dissimilarity between the current model of the tracked object and target candidates is indicated by a metric based on Bhattacharyya coefficient. Variations of the color representation as a consequence of ellipse’s size change are handled by taking advantage of the scale invariance of the similarity measure. The color histogram and parameters of the ellipse are dynamically updated over time to discriminate in the next iteration between the candidate and actual head representation. This makes possible to track not only a face profile which has been shot during initialization of the tracker but in addition different profiles of the face as well as the head can be tracked. Experimental results which were obtained on long image sequences in a typical office environment show the feasibility of our approach to perform tracking of a head undergoing complex changes of shape and appearance against a varying background. The resulting system runs in real-time on a standard laptop computer installed on a real mobile agent.
Chapter PDF
Similar content being viewed by others
References
Wren, C., Azarbayejani, A., Darrell, T., Pentland, A.: Pfinder: Real-Time Tracking of the Human Body. IEEE Trans. on PAMI 19(7), 780–785 (1997)
Bradski, G.R.: Computer Vision Face Tracking as a Component of a Perceptual User Interface. In: Proc. IEEE Workshop on Applications of Comp. Vision, Princeton, pp. 214–219 (1998)
Recognition Comaniciu, D., Ramesh, V., Meer, P.: Real-Time Tracking of Non- Rigid Objects Using Mean Shift. In: Proc. of IEEE Conf. on Comp. Vision and Pat. Rec., pp. 142–149 (2000)
Isard, M., Blake, A.: Contour Tracking by Stochastic Propagation of Conditional Density. In: Buxton, B.F., Cipolla, R. (eds.) ECCV 1996. LNCS, vol. 1065, pp. 343–356. Springer, Heidelberg (1996)
Rui, Y., Chen, Y.: Better Proposal Distributions: Object Tracking Using Unscented Particle Filter. In: Proc. IEEE Conf. on Comp. Vision and Pat. Rec., pp. 786–793 (2001)
Chen, Y., Rui, Y., Huang, T.: Mode-based Multi-Hypothesis Head Tracking Using Parametric Contours. In: Proc. IEEE Int. Conf. on Aut. Face and Gesture Rec., pp. 112–117 (2002)
Nummiaro, K., Koller-Meier, E., Van Gool, L.: An Adaptive Color-Based Particle Filter. Image and Vision Computing 21(1), 99–110 (2003)
Perez, P., Hue, C., Vermaak, J., Gangnet, M.: Color-Based Probabilistic Tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 661–675. Springer, Heidelberg (2002)
Schulz, D., Burgard, W., Fox, D., Cremers, A.B.: Tracking Multiple Moving Targets with a Mobile Robot using Particle Filters and Statistical Data Association. In: Proc. of the IEEE Int. Conf. on Robotics and Automation, pp. 1665–1670 (2001)
Isard, M., Blake, A.: A Mixed-State Condensation Tracker with Automatic Model- Switching. In: Proc. of IEEE Int. Conf. on Comp. Vision, Mumbai, pp. 107–112 (1998)
Recognition, Santa Birchfield, S.: Elliptical Head Tracking Using Intensity Gradients and Color Histograms. In: Proc. of IEEE Conf. on Comp. Vision and Pat. Rec., Santa Barbara, pp. 232–237 (1998)
Hunke, M., Waibel, A.: Face Locating and Tracking for Human-Computer Interaction. In: Proc. of the 28th Asilomar Conf. on Signals, Systems and Computers, pp. 1277–1281 (1994)
Fieguth, P., Terzopoulos, D.: Color-Based Tracking of Heads and Other Mobile Objects at Video Frame Rates. In: Proc. of the IEEE Conf. on Comp. Vision Pat. Rec., Hilton Head Island, pp. 21–27 (1997)
Schwerdt, K., Crowley, J.L.: Robust Face Tracking Using Color. In: Proc. of the Int. Conf. on Automatic Face and Gesture Rec., pp. 90–95 (2000)
Sobottka, K., Pitas, I.: Segmentation and Tracking of Faces in Color Images. In: Proc. of the Second Int. Conf. on Automatic Face and Gesture Rec., pp. 236–241 (1996)
Darrell, T., Gordon, G., Harville, M., Woodfill, J.: Integrated Person Tracking Using Stereo, Color, and Pattern Detection. In: Proc. of IEEE Conf. on Computer Vision and Pat. Rec., Santa Barbara, pp. 601–609 (1998)
Swain, M.J., Ballard, D.H.: Color Indexing. Int. Journal of Computer Vision 7(1), 11–32 (1991)
Cheng, Y.: Mean Shift, Mode Seeking, and Clustering. IEEE Trans. on PAMI 17(8), 790–799 (1995)
Meier, E.B., Ade, F.: Using the Condensation Algorithm to Implement Tracking for Mobile Robots. In: Proc. of the Third European Workshop on Advanced Mobile Robots, pp. 73–80 (1999)
ActivMedia Robotics, Pioneer 2 mobile robots (2001)
Konolige, K.: Small Vision System: Hardware and Implementation. In: Proc. of Int. Symp. on Robotics Research, Hayama, pp. 111–116 (1997)
Turk, M.A., Pentland, A.P.: Face Recognition Using eigenfaces. In: Proc. of IEEE Conf. on Comp. Vision and Pat. Rec., pp. 586–591 (1991)
Schneiderman, H., Kanade, T.: A Histogram-Based Method for Detection of Faces and Cars. In: Proc. of the, Int. Conf. on Image Processing, pp. 504–507 (2000)
Merwe, R., Doucet, A., Freitas, N., Wan, E.: The Unscented Particle Filter. Advances in Neural Information Processing Systems, 584–590 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kwolek, B. (2004). Stereovision-Based Head Tracking Using Color and Ellipse Fitting in a Particle Filter. In: Pajdla, T., Matas, J. (eds) Computer Vision - ECCV 2004. ECCV 2004. Lecture Notes in Computer Science, vol 3024. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24673-2_16
Download citation
DOI: https://doi.org/10.1007/978-3-540-24673-2_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21981-1
Online ISBN: 978-3-540-24673-2
eBook Packages: Springer Book Archive