A Study for the Self Similarity Smile Detection
Facial expression recognition has been the subject of much research in the last years within the Computer Vision community. The detection of smiles, however, has received less attention. Its distinctive configuration may pose less problem than other, at times subtle, expressions. On the other hand, smiles can still be very useful as a measure of happiness, enjoyment or even approval. Geometrical or local-based detection approaches like the use of lip edges may not be robust enough and thus researchers have focused on applying machine learning to appearance-based and self-similarity descriptors. This work makes an extensive experimental study of smile detection testing the Local Binary Patterns (LBP) combined with self similarity (LAC) as main descriptors of the image, along with the powerful Support Vector Machines classifier. Results show that error rates can be acceptable and the self similarity approach for the detection of smiles is suitable for real-time interaction, although there is still room for improvement.
Unable to display preview. Download preview PDF.
- 1.Bartlett, M., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I., Movellan, J.: Fully automatic facial action recognition in spontaneous behavior. In: Proceedings of the Seventh IEEE International Conference on Automatic Face and Gesture Recognition (2006)Google Scholar
- 2.Bay, H., Tuytelaars, T.: Surf: Speeded up robust features. In: Proceedings of the Ninth European Conference on Computer Vision (May 2006)Google Scholar
- 3.Bourel, F., Chibelushi, C., Low, A.: Robust facial expression recognition using a state-based model of spatially-localised facial dynamics. In: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (2002)Google Scholar
- 5.Castrillón Santana, M., Déniz Suárez, O., Hernández Tejera, M., Guerra Artal, C.: ENCARA2: Real-time detection of multiple faces at different resolutions in video streams. Journal of Visual Communication and Image Representation, 130–140 (April 2007)Google Scholar
- 6.Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines (2001), http://www.csie.ntu.edu.tw/~cjlin/libsvm
- 7.Datcu, D., Rothkrantz, L.: Automatic recognition of facial expressions using bayesian belief networks. Proceedings of IEEE Systems, Man and Cybernetics (2004)Google Scholar
- 9.Freire, D., Castrillon, M., Deniz, O.: Smile detection using local binary patterns and support vector machines. In: Proceedings of the Fourth International Joint Conference on Computer Vision and Computer Graphics Theory and Applications (2009)Google Scholar
- 10.Ito, A., Wang, X., Suzuki, M., Makino, S.: Smile and laughter recognition using speech processing and face recognition from conversation video. In: Procs. of the 2005 IEEE Int. Conf. on Cyberworlds, CW 2005 (2005)Google Scholar
- 12.Kirby, Y., Sirovich, L.: Application of the Karhunen-Loéve procedure for the characterization of human faces. IEEE Trans. on Pattern Analysis and Machine Intelligence 12(1) (July 1990)Google Scholar
- 15.Sébastien Marcel, Y.R., Heusch, G.: On the recent use of local binary patterns for face authentication. In: International Journal of Image and Video Preprocessing, Special Issue on Facial Image Processing (2007)Google Scholar
- 16.Shechtman, E., Irani, M.: Matching local self-similarities across images and videos. In: IEEE Conference on Computer Vision and Pattern Recognition 2007 (CVPR 2007) (June 2007)Google Scholar
- 17.Tao, Q., Veldhuis, R.: Illumination normalization based on simplified local binary patterns for a face verification system. In: Proc. of the Biometrics Symposium, pp. 1–6 (2007)Google Scholar