Skin-color modeling and adaptation
This paper studies a statistical skin-color model and its adaptation. It is revealed that (1) human skin colors cluster in a small region in a color space; (2) the variance of a skin color cluster can be reduced by intensity normalization, and (3) under a certain lighting condition, a skin-color distribution can be characterized by a multivariate normal distribution in the normalized color space. We then propose an adaptive model to characterize human skin-color distributions for tracking human faces under different lighting conditions. The parameters of the model are adapted based on the maximum likelihood criterion. The model has been successfully applied to a real-time face tracker and other applications.
Unable to display preview. Download preview PDF.
- 1.Y. Ohta, T. Kanade and T. Sakai, “Color information for region segmentation,” Computer Graphics and Image Processing, Vol. 13, No. 3, pp.222–241, July 1980.Google Scholar
- 2.M.J. Swain and D.H. Ballard, “Color indexing,” International Journal of Computer Vision. Vol. 7, No.1, pp. 11–32, 1991.Google Scholar
- 3.M. Hunke and A. Waibel, “Face locating and tracking for human-computer interaction,” Proc. Twenty-Eight Asilomar Conference on Signals, Systems & Computers, Monterey, CA, USA, 1994.Google Scholar
- 4.T.C. Chang, T.S. Huang, and C. Novak, “Facial feature extraction from color images,” Proc. the 12th IAPR International Conference on Pattern Recognition, Vol. 2, pp. 39–43, 1994.Google Scholar
- 5.J. Yang and A. Waibel, “A real-time face tracker,” Proceedings of the Third IEEE Workshop on Applications of Computer Vision (Sarasota, Florida, 1996), pp. 142–147 (“Tracking human faces in real-time,” Technical Report CMU-CS-95-210, CS department, CMU, 1995).Google Scholar
- 6.G. Wyszecki and W.S. Styles, “Color Science: Concepts and Methods, Quantitative Data and Formulae,” Second Edition, John Wiley & Sons, New York, 1982.Google Scholar
- 7.S.A. Shafer, “Optical phenomena in computer vision,” Prec. Canadian Soc. Computational Studies of Intelligence, pp. 572–577, 1984.Google Scholar
- 8.G.J. Winker, S.A. Shafer, and T. Kanade, “Using a color reflection model to separate highlights from object color,” Proc. ICCV, pp. 145–150, 1987.Google Scholar
- 9.J. D. Jobson, “Applied Multivariate Data Analysis,” Vol. I: Reregression and Experimental Design, Springer-Verlag, 1991.Google Scholar
- 10.T.W. Anderson, “Asymptotically efficient estimation of covariance matrices with linear structure,” The Annals of Statistics, Vol. 1, No. 1, 135–141, 1973.Google Scholar
- 11.J. Yang, L. Wu, and A. Waibel, “Focus of attention: towards low bitrate video tele-conferencing,” Proceedings of 1996 IEEE International Conference on Image Processing (Lausanne, Switzerland), Vol. 2, pp. 97–100.Google Scholar
- 12.R. Stiefelhagen, J. Yang, and A. Waibel, “A model-based gaze tracking system,” To appear on International Journal on Artificial Intelligence Tools.Google Scholar
- 13.U. Meier, R. Stiefelhagen, J. Yang, “Preprocessing of Visual Speech under Real World Conditions” European Tutorial & Research Workshop on Audio-Visual Speech Processing: Computational & Cognitive Science Approaches (AVSP 97).Google Scholar