Abstract
Facial keypoints (FKP) detection is considered as a challenging task in the field of computer vision, as facial features vary from individual to individual. It becomes a more challenging proposition as the same person facial image may also vary due to change in position, size, pose, expression etc. Some methods exist in literature for detection of FKPs. In this paper, a deep architecture is used to locate the keypoints on gray-scale images. As baseline method one hidden layer neural network and convolutional neural networks are built in the proposed work. Additionally, a block of pretrained Inception module is used to extract the intermediate features. Specifically, the sparse structure of Inception model reduces the computational cost of the proposed method significantly. The methods are evaluated on standard dataset and compared with existing state-of-the-art CNN based methods. The obtained results are promising and also bring out the efficiency of the proposed work.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Shi, S.: Facial Keypoints Detection, arXiv preprint arXiv:1710.05279, 15 October 2017
Kaggle dataset. https://www.kaggle.com/c/facial-keypoints-detection
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
Sun, Y., Wang, X., Tang, X.: Deep convolutional network cascade for facial point detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3476–3483 (2013)
Wang, Y., Song, Y.: Facial Keypoints Detection. Stanford University (2014)
Zhang, S., Meng, C.: Facial keypoints detection using neural network (2016)
Longpre, S., Sohmshetty, A.: Facial Keypoint Detection. Stanford University (2016)
Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)
Lin, M., Chen, Q., Yan, S.: Network in network. arXiv preprint arXiv:1312.4400 (2013)
Agarwal, N., Krohn-Grimberghe, A., Vyas, R.: Facial Key points Detection using Deep convolutional Neural Network – NaimishNet (2017)
Vukadinovic, D., Pantic, M.: Fully automatic facial feature point detection using gabor feature based boosted classifiers. In: 2005 IEEE International Conference on Systems, Man and Cybernetics, vol. 2, pp. 1692–1698. IEEE (2005)
Valstar, M., Martinez, B., Binefa, X., Pantic, M.: Facial point detection using boosted regression and graph models. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2729–2736. IEEE (2010)
Amberg, B., Vetter, T.: Optimal landmark detection using shape models and branch and bound. In: 2011 IEEE International Conference on Computer Vision (ICCV). IEEE (2011)
Belhumeur, P.N., et al.: Localizing parts of faces using a consensus of exemplars. IEEE Trans. Pattern Anal. Mach. Intell. 35(12), 2930–2940 (2013)
Parkhi, O.M., Vedaldi, A., Zisserman, A.: Deep face recognition. In: BMVC, vol. 1, no. 3, p. 6 (2015)
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Peter, S.: Detecting facial features using Deep Learning. https://towardsdatascience.com/detecting-facial-features-using-deep-learning-2e23c8660a7a
Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8689, pp. 818–833. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10590-1_53
Aggarwal, C.C.: Chapter 1 An Introduction to Neural Networks. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-94463-0_8
Sun, Y., Wang, X., Tang, X.: Deep convolutional network cascade for facial point detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2013)
Daniel Nouri’s blog. http://danielnouri.org/notes/2014/12/17/using-convolutional-neural-nets-to-detect-facial-keypoints-tutorial/
Simonyan, K., Zisserman, A.: Very deep convolutional networks for largescale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Wang, W., Yang, J., Xiao, J., Li, S., Zhou, D.: Face recognition based on deep learning. In: Zu, Q., Hu, B., Gu, N., Seng, S. (eds.) HCC 2014. LNCS, vol. 8944, pp. 812–820. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-15554-8_73
Cao, X., Wipf, D., Wen, F., Duan, G., Sun, J.: A practical transfer learning algorithm for face verification. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 3208–3215 (2013)
Sutskever, I., Martens, J., Dahl, G.E., Hinton, G.E.: On the importance of initialization and momentum in deep learning. In: Proceedings of the 30th International Conference on Machine Learning ICML 2013, Atlanta, GA, USA, volume 28 of JMLR Proceedings, pp. 1139–1147, 16–21 June 2013
Glorot, X., Bengio, Y.: Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the 13th International Conference on Artificial Intelligence and Statistics (AISTATS) 2010, Chia Laguna Resort, Sardinia, Italy, volume 9 of J. Mach. Learn. Res. pp. 249–256 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Dasgupta, M., Mandal, J.K. (2019). Deep Convolutional Neural Network Based Facial Keypoints Detection. In: Mandal, J., Mukhopadhyay, S., Dutta, P., Dasgupta, K. (eds) Computational Intelligence, Communications, and Business Analytics. CICBA 2018. Communications in Computer and Information Science, vol 1030. Springer, Singapore. https://doi.org/10.1007/978-981-13-8578-0_4
Download citation
DOI: https://doi.org/10.1007/978-981-13-8578-0_4
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-8577-3
Online ISBN: 978-981-13-8578-0
eBook Packages: Computer ScienceComputer Science (R0)