Real-World Facial Expression Recognition Using Metric Learning Method
Real-world human facial expressions recognition has great value in Human-Computer Interaction. Currently facial expression recognition methods perform quite poor in real-world compared with in traditional laboratory conditions. A key factor is the lack of reliable large real-world facial expression database. In this paper, a large and reliable real-world facial expression database and a Modified Metric Learning Method based on NCM classifier (PR-NCMML) to regress the probability distribution of emotional labels will be introduced. According to experiments, the six-dimension emotion probability vector derived by PR-NCMML is closer to human perception, which leads to better accuracy than the state-of-the-art methods, such as the SVM based algorithms, both dominant emotion prediction and multi-label emotion recognition.
KeywordsReal-world facial expressions Metric Learning Probability regression
This work was partially sponsored by supported by the NSFC (National Natural Science Foundation of China) under Grant No. 61375031, No. 61573068, No. 61471048, and No.61273217, the Fundamental Research Funds for the Central Universities under Grant No. 2014ZD03-01, This work was also supported by Beijing Nova Program, CCF-Tencent Open Research Fund, and the Program for New Century Excellent Talents in University.
- 1.Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: 2000 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–53. IEEE (2000)Google Scholar
- 2.Sim, T., Baker, S., Bsat, M.: The CMU pose, illumination, and expression (PIE) database. In: 2002 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–51. IEEE (2002)Google Scholar
- 3.Dhall, A., Goecke, R., Lucey, S., Gedeon, T.: Acted facial expressions in the wild database. Australian National University, Canberra, Australia, Technical report TR-CS-11-02 (2011)Google Scholar
- 4.Ekman, P., Scherer, K.: Expression and the nature of emotion. Approaches to emotion 3, 19–344 (1984)Google Scholar
- 7.Buciu, I., Pitas, I.: Application of non-negative and local non negative matrix factorization to facial expression recognition. In: Proceedings of the 17th International Conference on Pattern Recognition, ICPR2004, vol. 1, pp. 288–291. IEEE (2004)Google Scholar
- 12.Dahmane, M., Meunier, J.: Emotion recognition using dynamic grid-based hog features. In: 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), pp. 884–888. IEEE (2011)Google Scholar
- 14.Duin, R.: PRtools version 3.0: a matlab toolbox for pattern recognition. In: Proceedings of SPIE, Citeseer (2000)Google Scholar
- 15.Deng, H.B., Jin, L.W., Zhen, L.X., Huang, J.C.: A new facial expression recognition method based on local Gabor filter bank and PCA plus LDA. Int. J. Inf. Technol. 11(11), 86–96 (2005)Google Scholar
- 17.Zhang, M-L., Zhou, Z-H.: Multi-instance multi-label learning with application to scene classificationGoogle Scholar