Skip to main content
SpringerLink
Log in

A Performance Evaluation of Loss Functions for Deep Face Recognition

  • Conference paper
  • First Online:
Computer Vision, Pattern Recognition, Image Processing, and Graphics (NCVPRIPG 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1249))

Abstract

Face recognition is one of the most widely publicized feature in the devices today and hence represents an important problem that should be studied with the utmost priority. As per the recent trends, the Convolutional Neural Network (CNN) based approaches are highly successful in many tasks of Computer Vision including face recognition. The loss function is used on the top of CNN to judge the goodness of any network. In this paper, we present a performance comparison of different loss functions such as Cross-Entropy, Angular Softmax, Additive-Margin Softmax, ArcFace and Marginal Loss for face recognition. The experiments are conducted with two CNN architectures namely, ResNet and MobileNet. Two widely used face datasets namely, CASIA-Webface and MS-Celeb-1M are used for the training and benchmark Labeled Faces in the Wild (LFW) face dataset is used for the testing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Chollet, F.: Xception: deep learning with depthwise separable convolutions. CoRR abs/1610.02357 (2016)

    Google Scholar 

  2. Deng, J., Guo, J., Zafeiriou, S.: Arcface: additive angular margin loss for deep face recognition. arXiv preprint arXiv:1801.07698 (2018)

  3. Deng, J., Zhou, Y., Zafeiriou, S.: Marginal loss for deep face recognition. In: IEEE CVPR Workshop on Faces "in-the-wild" (2017)

    Google Scholar 

  4. Goodfellow, I., Bengio, Y., Courville, A., Bengio, Y.: Deep Learning, vol. 1. MIT Press, Cambridge (2016)

    MATH  Google Scholar 

  5. Guo, Y., Zhang, L., Hu, Y., He, X., Gao, J.: MS-Celeb-1M: a dataset and benchmark for large-scale face recognition. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9907, pp. 87–102. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46487-9_6

    Chapter  Google Scholar 

  6. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: IEEE CVPR, pp. 770–778 (2016)

    Google Scholar 

  7. Huang, G.B., Learned-Miller, E.: Labeled faces in the wild: updates and new reporting procedures. Department Computer Science University Massachusetts Amherst, Amherst, MA, USA, Technical report, pp. 14–003 (2014)

    Google Scholar 

  8. Huang, G.B., Mattar, M., Berg, T., Learned-Miller, E.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments. In: Workshop on Faces in ‘Real-Life’ Images: Detection, Alignment, and Recognition (2008)

    Google Scholar 

  9. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS, pp. 1097–1105 (2012)

    Google Scholar 

  10. Liang, X., Wang, X., Lei, Z., Liao, S., Li, S.Z.: Soft-margin softmax for deep classification. In: Liu D., Xie S., Li Y., Zhao D., El-Alfy ES. (eds) Neural Information Processing. ICONIP 2017. LNCS, vol. 10635. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-70096-0_43

  11. Liu, W., Wen, Y., Yu, Z., Yang, M.: Large-margin softmax loss for convolutional neural networks. ArXiv e-prints (2016)

    Google Scholar 

  12. Liu, W., Wen, Y., Yu, Z., Li, M., Raj, B., Song, L.: Sphereface: deep hypersphere embedding for face recognition. In: IEEE CVPR, vol. 1, p. 1 (2017)

    Google Scholar 

  13. Liu, Y., Li, H., Wang, X.: Learning deep features via congenerous cosine loss for person recognition. CoRR abs/1702.06890 (2017)

    Google Scholar 

  14. Parkhi, O.M., Vedaldi, A., Zisserman, A., et al.: Deep face recognition. In: BMVC (2015)

    Google Scholar 

  15. Ranjan, R., Castillo, C.D., Chellappa, R.: L2-constrained softmax loss for discriminative face verification. CoRR abs/1703.09507 (2017)

    Google Scholar 

  16. Schroff, F., Kalenichenko, D., Philbin, J.: Facenet: a unified embedding for face recognition and clustering. CoRR abs/1503.03832 (2015)

    Google Scholar 

  17. Srivastava, R.K., Greff, K., Schmidhuber, J.: Highway networks. CoRR abs/1505.00387 (2015)

    Google Scholar 

  18. Sun, Y., Chen, Y., Wang, X., Tang, X.: Deep learning face representation by joint identification-verification. In: NIPS, pp. 1988–1996 (2014)

    Google Scholar 

  19. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. CoRR abs/1512.00567 (2015)

    Google Scholar 

  20. Taigman, Y., Yang, M., Ranzato, M., Wolf, L.: Deepface: closing the gap to human-level performance in face verification. In: IEEE CVPR, pp. 1701–1708, June 2014

    Google Scholar 

  21. Wang, F., Cheng, J., Liu, W., Liu, H.: Additive margin softmax for face verification. IEEE SPL 25(7), 926–930 (2018)

    Google Scholar 

  22. Wei, X., Wang, H., Scotney, B.W., Wan, H.: Minimum margin loss for deep face recognition. CoRR abs/1805.06741 (2018)

    Google Scholar 

  23. Wen, Y., Zhang, K., Li, Z., Qiao, Yu.: A discriminative feature learning approach for deep face recognition. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9911, pp. 499–515. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46478-7_31

    Chapter  Google Scholar 

  24. Xie, S., Girshick, R.B., Dollár, P., Tu, Z., He, K.: Aggregated residual transformations for deep neural networks. CoRR abs/1611.05431 (2016)

    Google Scholar 

  25. Yi, D., Lei, Z., Liao, S., Li, S.Z.: Learning face representation from scratch. arXiv preprint arXiv:1411.7923 (2014)

  26. Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE SPL 23(10), 1499–1503 (2016)

    Google Scholar 

  27. Zhang, X., Fang, Z., Wen, Y., Li, Z., Qiao, Y.: Range loss for deep face recognition with long-tail. CoRR abs/1611.08976 (2016)

    Google Scholar 

Download references

Acknowledgment

This research is funded by Science and Engineering Research Board (SERB), Govt. of India under Early Career Research (ECR) scheme through SERB/ECR/2017/000082 project fund. We also gratefully acknowledge the support of NVIDIA Corporation with the donation of the GeForce Titan X Pascal GPU for our research.

Author information

Authors and Affiliations

  1. Computer Vision Group, Indian Institute of Information Technology, Chittor, Sri City, A.P., India

    Yash Srivastava, Vaishnav Murali & Shiv Ram Dubey

Authors
  1. Yash Srivastava
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vaishnav Murali
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shiv Ram Dubey
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shiv Ram Dubey .

Editor information

Editors and Affiliations

  1. Department of Computational and Data Sciences, Indian Institute of Science Bangalore, Bangalore, India

    R. Venkatesh Babu

  2. Department of Electrical Engineering, Indian Institute of Technology Dharwad, Dharwad, India

    Mahadeva Prasanna

  3. Computer Science & Engineering, Indian Institute of Technology Kanpur, Kanpur, India

    Vinay P. Namboodiri

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Srivastava, Y., Murali, V., Dubey, S.R. (2020). A Performance Evaluation of Loss Functions for Deep Face Recognition. In: Babu, R.V., Prasanna, M., Namboodiri, V.P. (eds) Computer Vision, Pattern Recognition, Image Processing, and Graphics. NCVPRIPG 2019. Communications in Computer and Information Science, vol 1249. Springer, Singapore. https://doi.org/10.1007/978-981-15-8697-2_30

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-8697-2_30

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-8696-5

  • Online ISBN: 978-981-15-8697-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation