Using Kinect for Facial Expression Recognition under Varying Poses and Illumination
Emotions analysis and recognition by the smartphones with front cameras is a relatively new concept. In this paper we present an algorithm that uses a low resolution 3D sensor for facial expression recognition. The 3D head pose as well as 3D location of the fiducial points are determined using Face Tracking SDK. Tens of the features are automatically selected from a pool determined by all possible line segments between such facial landmarks. We compared correctly classified ratios using features selected by AdaBoost, Lasso and histogram-based algorithms. We compared the classification accuracies obtained both on 3D maps and RGB images. Our results justify the feasibility of low accuracy 3D sensing devices for facial emotion recognition.
KeywordsFacial Image Analysis Depth Maps Analysis
Unable to display preview. Download preview PDF.
- 3.Fang, T., Zhao, X., Ocegueda, O., Shah, S., Kakadiaris, I.A.: 3D facial expression recognition: A perspective on promises and challenges. In: FG, pp. 603–610 (2011)Google Scholar
- 5.Li, B., Mian, A., Liu, W., Krishna, A.: Using Kinect for face recognition under varying poses, expressions, illumination and disguise. In: WACV, pp. 186–192 (2013)Google Scholar
- 8.Ahlberg, J.: Candide-3 - an updated parameterised face. Technical report, Dept. of Electrical Engineering, Linkping University, Sweden (2001)Google Scholar
- 9.Kwolek, B.: Model based facial pose tracking using a particle filter. In: Int. Conf. on Geometric Modeling and Imaging: New Trends, pp. 203–208. IEEE Comp. Soc. (2006)Google Scholar
- 10.Soyel, H., Demirel, H.: Optimal feature selection for 3D facial expression recognition with geometrically localized facial features. In: Int. Conf. on Soft Computing, Comp. with Words and Perceptions in Syst. Anal., Dec. and Control, pp. 1–4 (2009)Google Scholar
- 13.Tang, H., Huang, T.: 3D facial expression recognition based on automatically selected features. In: Conf. CVPR, pp. 1–8 (2008)Google Scholar
- 14.Tang, H., Huang, T.: 3D facial expression recognition based on properties of line segments connecting facial feature points. In: Conf. FG, pp. 1–6 (2008)Google Scholar
- 18.Hsu, C.W., Chang, C.C., Lin, C.J.: A practical guide to support vector classification. Technical report, Department of Computer Science, National Taiwan University, Taipei 106, Taiwan (2010)Google Scholar