Abstract
Facial expressions are important cues to observe human emotions. Facial expression recognition has attracted many researchers for years, but it is still a challenging topic since expression features vary greatly with the head poses, environments, and variations in the different persons involved. In this work, three major steps are involved to improve the performance of micro-facial expression recognition. First, an Adaptive Homomorphic Filtering is used for face detection and rotation rectification processes. Secondly, Micro-facial features were used to extract the appearance variations of a testing image-spatial analysis. The features of motion information are used for expression recognition in a sequence of facial images. An effective Micro-Facial Expression Based Deep-Rooted Learning (MFEDRL) classifier is proposed in this paper to better recognize spontaneous micro-expressions by learning parameters on the optimal features. This proposed method includes two loss functions such as cross entropy loss function and center loss function. Then the performance of the algorithm will be evaluated using recognition rate and false measures. Simulation results show that the predictive performance of the proposed method outperforms that of the existing classifiers such as Convolutional Neural Network (CNN), Deep Neural Network (DNN), Artificial Neural Network (ANN), Support Vector Machine (SVM), and k-Nearest Neighbors (KNN) in terms of accuracy and Mean Absolute Error (MAE).
Article PDF
Avoid common mistakes on your manuscript.
References
B. Hasani, M.H. Mahoor, Facial expression recognition using enhanced deep 3D convolutional neural networks, in 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, 2017, pp. 2278–2288.
Y. Tian, T. Kanade, J.F. Cohn, Recognizing lower face action units for facial expression analysis, in Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition, Grenoble, 2000, pp. 484–490.
D.M. Vo, T.H. Le, Deep generic features and SVM for facial expression recognition, in Proceeding of 3rd National Foundation for Science and Technology Development Conference on Information and Computer Science (NICS), Danang, 2016, pp. 80–84.
D. Hamester, P. Barros, S. Wermter, Face expression recognition with a 2-channel convolutional neural network, in Proceeding of International Joint Conference on Neural Networks (IJCNN), Killarney, 2015, pp. 1–8.
F. Zhang, Y. Yu, Q. Mao, J. Gou, Y. Zhan, Pose-robust feature learning for facial expression recognition, J. Frontiers Comput. Sci. 10 (2016), 832–844
Y. Guo, D. Tao, J. Yu, H. Xiong, Y. Li, D. Tao, Deep neural networks with relativity learning for facial expression recognition, in Proceeding of IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Seattle, 2016, pp. 1–6.
T. Zhang, W. Zheng, Z. Cui, Y. Zong, J. Yan, K. Yan, A deep neural network-driven feature learning method for multi-view facial expression recognition, IEEE Trans. Multimedia. 18 (2016), 2528–2536
H. Jung, S. Lee, J. Yim, S. Park, J. Kim, Joint fine-tuning in deep neural networks for facial expression recognition, in Proceeding of IEEE International Conference on Computer Vision (ICCV), Santiago, 2015, pp. 2983–2991.
Y.-H. Byeon, K.-C. Kwa, Facial expression recognition using 3D convolutional neural network, Int. J. Adv. Comput. Sci. Appl. 5 (2014), 107–112
Z. Meng, P. Liu, J. Cai, S. Han, Y. Tong, Identity-aware convolutional neural network for facial expression recognition, in Proceeding of IEEE International Conference on Automatic Face & Gesture Recognition, Washington, 2017, pp. 558–565.
C. Zhang, P. Wang, K. Chen, J.-K. Kämäräinen, Identity-aware convolutional neural networks for facial expression recognition, J. Syst. Eng. Electron, 28 (2017), 784–792
X. Geng, Z.H. Zhou, K. Smith-Miles, Automatic age estimation based on facial aging patterns, IEEE Trans. Pattern Anal. Mach. Intell. 29 (2007), 2234–2240
U. Park, Y. Tong, A.K. Jain, Age-invariant face recognition, IEEE Trans. Pattern Anal. Mach. Intell. 32 (2010), 947–954
G. Guo, Y. Fu, C.R. Dyer, T.S. Huang, Image-based human age estimation by manifold learning and locally adjusted robust regression, IEEE Trans. Image Process. 17 (2008), 1178–1188
J. Suo, S.C. Zhu, S. Shan, X. Chen, A compositional and dynamic model for face aging, IEEE Trans. Pattern Anal. Mach. Intell. 32 (2010), 385–401
Z. Li, U. Park, A.K. Jain, A discriminative model for age invariant face recognition, IEEE Trans. Inf. Forensics Secur. 6 (2011), 1028–1037
H. Ling, S. Soatto, N. Ramanathan, D.W. Jacobs, Face verification across age progression using discriminative methods, IEEE Trans. Inf. Forensics Secur. 5 (2010), 82–91
C. Otto, H. Han, A. Jain, How does aging affect facial components? in Proceeding of International Conference on Computer Vision, Florence, 2012, pp. 189–198.
L. Du, H. Ling, Cross-age face verification by coordinating with cross-face age verification, in Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, Boston, 2015, pp. 2329–2338.
B.C. Chen, C.S. Chen, W.H. Hsu, Face recognition and retrieval using cross-age reference coding with cross-age celebrity dataset, IEEE Trans. Multimedia. 17 (2015), 804–815
D. Bouchaffra, Nonlinear topological component analysis: application to age-invariant face recognition, IEEE Trans. Neural Netw. Learn. Syst. 26 (2015), 1375–1387
Z. Li, D. Gong, X. Li, D. Tao, Learning compact feature descriptor and adaptive matching framework for face recognition, IEEE Trans. Image Process. 24 (2015), 2736–2745
Y. Wen, Z. Li, Y. Qiao, Latent factor guided convolutional neural networks for age-invariant face recognition, in Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, 2016, pp. 4893–4901.
L. Liu, C. Xiong, H. Zhang, Z. Niu, M. Wang, S. Yan, Deep aging face verification with large gaps, IEEE Trans. Multimedia, 18 (2016), 64–75
K.R. Sreenivasan, M. Havlicek, G. Deshpande, Nonparametric hemodynamic deconvolution of fMRI using homomorphic filtering, IEEE Trans. Med. Imaging. 34 (2015), 1155–1163
L. Xiao, C. Li, Z. Wu, T. Wang, An enhancement method for X-ray image via fuzzy noise removal and homomorphic filtering, Neu-rocomputing. 195 (2016), 56–64
S.K.A. Kamarol, M.H. Jaward, J. Parkkinen, R. Parthiban, Spatiotemporal feature extraction for facial expression recognition, IET Image Process. 10 (2016), 534–541
P.M. Kamble, R.S. Hegadi, Handwritten Marathi character recognition using R-HOG feature, Procedia Comput. Sci. 45 (2015), 266–274
E. Barsoum, C. Zhang, C.C. Ferrer, Z. Zhang, Training deep networks for facial expression recognition with crowd-sourced label distribution, in Proceedings of the 18th ACM International Conference on Multimodal Interaction, ACM, Tokyo, 2016, pp. 279–283.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
This is an open access article distributed under the CC BY-NC 4.0 license (http://creativecommons.org/licenses/by-nc/4.0/).
About this article
Cite this article
Lalitha, S.D., Thyagharajan, K.K. Micro-Facial Expression Recognition Based on Deep-Rooted Learning Algorithm. Int J Comput Intell Syst 12, 903–913 (2019). https://doi.org/10.2991/ijcis.d.190801.001
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.2991/ijcis.d.190801.001