Abstract
In this paper we propose a novel approach for facial feature detection in color image sequences using Haar-like classifiers. The feature extraction is initialized without manual input and has the capability to fulfill the real time requirement. For facial expression recognition, we use geometrical measurement and simple texture analysis in detecting facial regions based on the prior detected facial feature points. For expression classification we used a three layer feed forward artificial neural network. The efficiency of the suggested approach is demonstrated under real world conditions.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
P. Ekman and W. V. Friesen, “Facial Action Coding System (FACS),” Consulting Psychologies Press, 1978.
G. L. Ford, et al., “Fully Automatic Coding of Basic Expressions from Video,” Tech. Report INC-MPLab-TR-2002.03, Machine Perception Lab, Institute for Neural Computation, University of California.
J. Skelley, R. Fischer, A. Sarma, and B. Heisele, “Recognizing Expressions in a New Database Containing Played and Natural Expressions,” ICPR, 2006, vol. 1, pp. 1220–1225.
S. Ioannou, M. Wallace, and S. Kollias, “Intelligent Facial Analysis and Expression Recognition,” Proceedings of International Joint Conference on Neural Networks (IJCNN) 2006 (Vancouver, Canada, 2006).
N. Sebe, I. Cohen, T. Gevers, and T. S. Huang, “Emotion Recognition Based on Joint Visual and Audio Cues,” ICPR, 2006, Vol. 1, pp. 1136–1139.
K. Anderson and P. McOwan, “A Real-Time Automated System for the Recognition of Human Facial Expressions,” IEEE Transactions on Systems, Man, and Cybernetics—Part B, 2006 (in press).
C.-S. Lee and A. Elgammal, “Nonlinear Shape and Appearance Models for Facial Expression Analysis and Synthesis,” ICPR 1, 497–502 (2006).
B. Abboud, F. Davoine, and M. Dang, “Statistical Modeling for Facial Expression Analysis and Synthesis,” ICIP 2003 (IEEE, Barcelona, 2003), Vol. 1.
P. Viola and M. Jones, “Rapid Object Detection Using a Boosted Cascade of Simple Features,” Proceedings of IEEE Conf. on Computer Vision and Pattern Recognition, 2001.
R. Lienhart and J. Maydt, “An Extended Set of Haar-Like Features for Rapid Object Detection,” IEEE ICIP 1, 900–903 (2002).
Open Source Computer Vision Library, “openCV”, http://www.intel.com/technology/computing/opencv/.
P. I. Wilson and J. Fernandez, “Facial Feature Detection Using Haar Classifiers,” The Journal of Computing Sciences in Colleges 21(4), (2006).
T. Wang and P. Shi, “Facial Components Detection with Boosting and Geometric Constraints”, ICPR 1, 446–449 (2006).
F. Dornaika and F. Davoine, “Facial Expression Recognition Using Auto-Regressive Models,” ICPR 2, 520–523 (2006).
F. Wallhoff, “Facial Expressions and Emotion Database,” http://www.mmk.ei.tum.de/:_waf/fgnet/feedtum.html (Technische Universität MÜnchen, 2006).
S. Nissen and E. Nemerson, “Fast Artifical Neural Network,” http://leenissen.dk/fann/.
Author information
Authors and Affiliations
Corresponding author
Additional information
The text was submitted by the authors in English.
Axel Panning was born in Magdeburg, Germany, in 1980. He received his Masters Degree (Dipl.-Ing.) in Computer Science at the University of Magdeburg, Germany, in 2006. He is currently working on a PhD thesis focusing on image processing, tracking, and pattern recognition.
Ayoub K. Al-Hamadi was born in Yemen in 1970. He received his Masters Degree (Dipl.-Ing.) in Electrical Engineering and Information Technology in 1997 and his PhD in Technical Computer Science at the Ottovon-Guericke-University of Magdeburg, Germany, in 2001. Since 2002 he has been Assistant Professor and Junior-Research-Group-Leader at the Institute for Electronics, Signal Processing, and Communications at the Otto-von-Guericke-University Magdeburg. His research work concentrates on the field of image processing, tracking analysis, pattern recognition, and artificial neural networks. Dr. Al-Hamadi is the author of more than 60 articles.
Robert Niese was born in Halberstadt, Germany, in 1977. He received his Masters Degree (Dipl.-Ing.) with distinction in computer science at the Otto-von-Guericke-University Magdeburg, Germany, in 2004. He gathered broad experience in several international internship investigations on medical image and data analysis, including MRI, CT, and EEG. He is currently working at Magdeburg University on his PhD thesis, which focuses on 3D, image processing, tracking, and pattern recognition. Robert Niese is the author of more than 15 publications.
Bernd Michaelis was born in Magdeburg, Germany, in 1947. He received a Masters Degree in Electronic Engineering from the Technische Hochschule Magdeburg in 1971 and his first PhD in 1974. Between 1974 and 1980 he worked at the Technische Hochschule Magdeburg and was granted a second doctoral degree in 1980. In 1993 he became Professor of Technical Computer Science at the Otto-von-Guericke University Magdeburg. His research work concentrates on the field of image processing, artificial neural networks, pattern recognition, processor architectures, and microcomputers. Professor Michaelis is the author of more than 200 papers.
Rights and permissions
About this article
Cite this article
Panning, A., Al-Hamadi, A.K., Niese, R. et al. Facial expression recognition based on Haar-like feature detection. Pattern Recognit. Image Anal. 18, 447–452 (2008). https://doi.org/10.1134/S1054661808030139
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S1054661808030139