Skin-color modeling and adaptation

  • Jie Yang
  • Weier Lu
  • Alex Waibel
Poster Session III
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1352)


This paper studies a statistical skin-color model and its adaptation. It is revealed that (1) human skin colors cluster in a small region in a color space; (2) the variance of a skin color cluster can be reduced by intensity normalization, and (3) under a certain lighting condition, a skin-color distribution can be characterized by a multivariate normal distribution in the normalized color space. We then propose an adaptive model to characterize human skin-color distributions for tracking human faces under different lighting conditions. The parameters of the model are adapted based on the maximum likelihood criterion. The model has been successfully applied to a real-time face tracker and other applications.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Y. Ohta, T. Kanade and T. Sakai, “Color information for region segmentation,” Computer Graphics and Image Processing, Vol. 13, No. 3, pp.222–241, July 1980.Google Scholar
  2. 2.
    M.J. Swain and D.H. Ballard, “Color indexing,” International Journal of Computer Vision. Vol. 7, No.1, pp. 11–32, 1991.Google Scholar
  3. 3.
    M. Hunke and A. Waibel, “Face locating and tracking for human-computer interaction,” Proc. Twenty-Eight Asilomar Conference on Signals, Systems & Computers, Monterey, CA, USA, 1994.Google Scholar
  4. 4.
    T.C. Chang, T.S. Huang, and C. Novak, “Facial feature extraction from color images,” Proc. the 12th IAPR International Conference on Pattern Recognition, Vol. 2, pp. 39–43, 1994.Google Scholar
  5. 5.
    J. Yang and A. Waibel, “A real-time face tracker,” Proceedings of the Third IEEE Workshop on Applications of Computer Vision (Sarasota, Florida, 1996), pp. 142–147 (“Tracking human faces in real-time,” Technical Report CMU-CS-95-210, CS department, CMU, 1995).Google Scholar
  6. 6.
    G. Wyszecki and W.S. Styles, “Color Science: Concepts and Methods, Quantitative Data and Formulae,” Second Edition, John Wiley & Sons, New York, 1982.Google Scholar
  7. 7.
    S.A. Shafer, “Optical phenomena in computer vision,” Prec. Canadian Soc. Computational Studies of Intelligence, pp. 572–577, 1984.Google Scholar
  8. 8.
    G.J. Winker, S.A. Shafer, and T. Kanade, “Using a color reflection model to separate highlights from object color,” Proc. ICCV, pp. 145–150, 1987.Google Scholar
  9. 9.
    J. D. Jobson, “Applied Multivariate Data Analysis,” Vol. I: Reregression and Experimental Design, Springer-Verlag, 1991.Google Scholar
  10. 10.
    T.W. Anderson, “Asymptotically efficient estimation of covariance matrices with linear structure,” The Annals of Statistics, Vol. 1, No. 1, 135–141, 1973.Google Scholar
  11. 11.
    J. Yang, L. Wu, and A. Waibel, “Focus of attention: towards low bitrate video tele-conferencing,” Proceedings of 1996 IEEE International Conference on Image Processing (Lausanne, Switzerland), Vol. 2, pp. 97–100.Google Scholar
  12. 12.
    R. Stiefelhagen, J. Yang, and A. Waibel, “A model-based gaze tracking system,” To appear on International Journal on Artificial Intelligence Tools.Google Scholar
  13. 13.
    U. Meier, R. Stiefelhagen, J. Yang, “Preprocessing of Visual Speech under Real World Conditions” European Tutorial & Research Workshop on Audio-Visual Speech Processing: Computational & Cognitive Science Approaches (AVSP 97).Google Scholar

Copyright information

© Springer-Verlag 1997

Authors and Affiliations

  • Jie Yang
    • 1
  • Weier Lu
    • 1
  • Alex Waibel
    • 1
  1. 1.School of Computer ScienceCarnegie Mellon UniversityPittsburghUSA

Personalised recommendations