Advertisement

Realtime Face Verification with Lightweight Convolutional Neural Networks

  • Nhan Dam
  • Vinh-Tiep Nguyen
  • Minh N. Do
  • Anh-Duc Duong
  • Minh-Triet TranEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9475)

Abstract

Face verification is a promising method for user authentication. Besides existing methods with deep convolutional neural networks to handle millions of people using powerful computing systems, the authors aim to propose an alternative approach of a lightweight scheme of convolutional neural networks (CNN) for face verification in realtime. Our goal is to propose a simple yet efficient method for face verification that can be deployed on regular commodity computers for individuals or small-to-medium organizations without super-computing strength. The proposed scheme targets unconstrained face verification, a typical scenario in reality. Experimental results on original data of Labeled Faces in the Wild dataset show that our best CNN found through experiments with 10 hidden layers achieves the accuracy of \((82.58 \pm 1.30)\,\%\) while many other instances in the same scheme can also approximate this result. The current implementation of our method can run at 60 fps and 235 fps on a regular computer with CPU-only and GPU configurations respectively. This is suitable for deployment in various applications without special requirements of hardware devices.

Keywords

Unconstrained face verification Convolutional neural network Lightweight 

Notes

Acknowledgement

This article was funded in part by a grant from the Vietnam Education Foundation (VEF). The opinions, findings, and conclusions stated herein are those of the authors and do not necessarily reflect those of VEF.

References

  1. 1.
    Arashloo, S.R., Kittler, J.: Efficient processing of mrfs for unconstrained-pose face recognition. In: IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems, BTAS 2013, pp. 1–8 (2013)Google Scholar
  2. 2.
    Cao, Q., Ying, Y., Li, P.: Similarity metric learning for face recognition. In: IEEE International Conference on Computer Vision, ICCV 2013, pp. 2408–2415 (2013)Google Scholar
  3. 3.
    Chatfield, K., Simonyan, K., Vedaldi, A., Zisserman, A.: Return of the devil in the details: delving deep into convolutional nets. In: British Machine Vision Conference, BMVC 2014 (2014)Google Scholar
  4. 4.
    Chen, D., Cao, X., Wang, L., Wen, F., Sun, J.: Bayesian face revisited: a joint formulation. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part III. LNCS, vol. 7574, pp. 566–579. Springer, Heidelberg (2012) CrossRefGoogle Scholar
  5. 5.
    Chen, D., Cao, X., Wen, F., Sun, J.: Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2013, pp. 3025–3032 (2013)Google Scholar
  6. 6.
    Chopra, S., Hadsell, R., LeCun, Y.: Learning a similarity metric discriminatively, with application to face verification. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, pp. 539–546 (2005)Google Scholar
  7. 7.
    Hassner, T., Harel, S., Paz, E., Enbar, R.: Effective face frontalization in unconstrained images. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015 (2015)Google Scholar
  8. 8.
    Huang, G.B., Jain, V., Learned-Miller, E.G.: Unsupervised joint alignment of complex images. In: IEEE International Conference on Computer Vision, ICCV 2007, pp. 1–8 (2007)Google Scholar
  9. 9.
    Huang, G.B., Lee, H., Learned-Miller, E.G.: Learning hierarchical representations for face verification with convolutional deep belief networks. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2012, pp. 2518–2525 (2012)Google Scholar
  10. 10.
    Huang, G.B., Mattar, M.A., Lee, H., Learned-Miller, E.G.: Learning to align from scratch. In: 26th Annual Conference on Neural Information Processing Systems, NIPS 2012, pp. 773–781 (2012)Google Scholar
  11. 11.
    Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Technical report 07-49, University of Massachusetts, Amherst, October 2007Google Scholar
  12. 12.
    Juefei-Xu, F., Luu, K., Savvides, M.: Spartans: single-sample periocular-based alignment-robust recognition technique applied to non-frontal scenarios. IEEE Trans. Image Process. 24(12), 4780–4795 (2015)CrossRefGoogle Scholar
  13. 13.
    Li, H., Hua, G.: Hierarchical-PEP model for real-world face recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, pp. 4055–4064 (2015)Google Scholar
  14. 14.
    Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. CoRR abs/1411.4038 (2014)Google Scholar
  15. 15.
    Pinto, N., DiCarlo, J.J., Cox, D.D.: How far can you get with a modern face recognition test set using only simple features? In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 2591–2598 (2009)Google Scholar
  16. 16.
    Sanderson, C., Lovell, B.C.: Multi-region probabilistic histograms for robust and scalable identity inference. In: Tistarelli, M., Nixon, M.S. (eds.) ICB 2009. LNCS, vol. 5558, pp. 199–208. Springer, Heidelberg (2009) CrossRefGoogle Scholar
  17. 17.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. Computing Research Repository - CoRR abs/1409.1556 (2014)Google Scholar
  18. 18.
    Srivastava, N., Hinton, G.E., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)zbMATHMathSciNetGoogle Scholar
  19. 19.
    Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A.: Going deeper with convolutions. Computing Research Repository-CoRR abs/1409.4842 (2014)Google Scholar
  20. 20.
    Taigman, Y., Yang, M., Ranzato, M., Wolf, L.: Deepface: closing the gap to human-level performance in face verification. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014, pp. 1701–1708 (2014)Google Scholar
  21. 21.
    Yi, D., Lei, Z., Li, S.Z.: Towards pose robust face recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2013, pp. 3539–3545 (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Nhan Dam
    • 1
  • Vinh-Tiep Nguyen
    • 2
  • Minh N. Do
    • 3
  • Anh-Duc Duong
    • 4
  • Minh-Triet Tran
    • 2
    Email author
  1. 1.AI Lab, University of ScienceVNUHCMHo Chi MinhVietnam
  2. 2.Faculty of IT, University of ScienceVNUHCMHo Chi MinhVietnam
  3. 3.Department of ECEUniversity of Illinois at Urbana-ChampaignChampaignUSA
  4. 4.University of Information TechnologyVNUHCMHo Chi MinhVietnam

Personalised recommendations