Skip to main content
SpringerLink
Log in

Dyn-arcFace: dynamic additive angular margin loss for deep face recognition

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Deep convolutional neural networks (CNNs) are widely used in face recognition, because they can extract features with higher discrimination, which is the basis for correctly identifying the identity of a face image. In order to improve the face recognition performance, in addition to improving the structures of convolutional neural networks, many new loss functions have been proposed to enhance the distinguishing ability of extract features. However, according to our research, it is found that when using the present loss functions in CNNs, there is overfitting of the training dataset and redeuces the effect of face recognition. Therefore, a new loss function called Dyn-arcFace(Dynamic Additive Angular Margin Loss for Deep Face Recognition) is proposed in this paper. In Dyn-arcFace, the traditional fixed additive angular margin is developed into a dynamic one, which can reduce the degree of overfitting caused by the fixed additive angular margin. To verify the effect of Dyn-arcFace, we tested on different layers of neural networks. The proposed algorithm achieved state-of-the-art performance on the most popular public-domain face recognition datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Abualigah LMQ (2019) Feature selection and enhanced krill herd algorithm for text document clustering. Springer

  2. Abualigah L (2020) Multi-verse optimizer algorithm: a comprehensive survey of its results, variants, and applications. Neural Comput & Applic:1–21

  3. Abualigah LM, Khader AT (2017) Unsupervised text feature selection technique based on hybrid particle swarm optimization algorithm with genetic operators for the text clustering. J Supercomput 73(11):4773–4795

    Article  Google Scholar 

  4. Al-Waisy AS, Al-Fahdawi S, Qahwaji R (2020) A multi-biometric face recognition system based on multimodal deep learning representations. Deep Learning in Computer Vision: Principles and Applications, p. 89

  5. Deng J, Zhou Y, Zafeiriou S (2017) Marginal loss for deep face recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 60–68

  6. Deng J, Guo J, Xue N, Zafeiriou SJAPA (2018) Arcface: Additive angular margin loss for deep face recognition

  7. Dong X, Shen J (2018) Triplet loss in siamese network for object tracking. In Proceedings of the European Conference on Computer Vision (ECCV), pp. 459–474

  8. Gatys LA, Ecker AS, Bethge M (2016) Image style transfer using convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2414–2423

  9. Guo Y, Zhang LJAPA (2017) One-shot face recognition by promoting underrepresented classes

  10. Guo Y, Zhang L, Hu Y, He X, Gao J (2016) Ms-celeb-1m: A dataset and benchmark for large-scale face recognition. In European Conference on Computer Vision, Springer, pp. 87–102

  11. He K, Zhang X, Ren S, Sun J (2016) Identity mappings in deep residual networks. In: European conference on computer vision, Springer, pp. 630–645

  12. Huang GB, Mattar M, Berg T, Learned-Miller E (2008) Labeled faces in the wild: a database forstudying face recognition in unconstrained environments. In: Workshop on faces in'Real-Life'Images: detection, alignment, and recognition

  13. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 1097–1105

  14. Leng L, Zhang J, Xu J, Khan MK, Alghathbar K (2010) Dynamic weighted discrimination power analysis in DCT domain for face and palmprint recognition, IEEE, pp. 467–471

  15. Leng L, Li M, Kim C, Bi X (2017) Dual-source discrimination power analysis for multi-instance contactless palmprint recognition. Multimed Tools Appl 76(1):333–354

    Article  Google Scholar 

  16. Liu W, Wen Y, Yu Z, Yang M (2016) Large-margin softmax loss for convolutional neural networks. ICML 2(3):7

    Google Scholar 

  17. Liu W, Wen Y, Yu Z, Li M, Raj B, Song L (2017) Sphereface: Deep hypersphere embedding for face recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 212–220

  18. Liu W, Jiao J, Mo Y, Jiao J, Deng Z (2019) MaaFace: Multiplicative and Additive Angular Margin Loss for Deep Face Recognition. In: International Conference on Image and Graphics, Springer, pp. 642–653.

  19. Liu L, Li H, Dai Y (2019) Stochastic Attraction-Repulsion Embedding for Large Scale Image Localization. In Proceedings of the IEEE International Conference on Computer Vision, pp. 2570–2579

  20. Moschoglou S, Papaioannou A, Sagonas C, Deng J, Kotsia I, Zafeiriou S (2017) Agedb: the first manually collected, in-the-wild age database,. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 51–59

  21. Parkhi OM, Vedaldi A, Zisserman A (2015) Deep face recognition. BMVC 1(3):6

    Google Scholar 

  22. Prasoon A, Petersen K, Igel C, Lauze F, Dam E, Nielsen M (2013) Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network. In International conference on medical image computing and computer-assisted intervention, Springer, pp. 246–253

  23. Schroff F, Kalenichenko D, Philbin J (2015 Facenet: A unified embedding for face recognition and clustering. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 815–823

  24. Sengupta S, Chen J-C, Castillo C, Patel VM, Chellappa R, Jacobs DW (2016) Frontal to profile face verification in the wild. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), IEEE, pp. 1–9

  25. Simard PY, Steinkraus D, Platt JC (2003) Best practices for convolutional neural networks applied to visual document analysis. Icdar 3(2003)

  26. Sun Y, Chen Y, Wang X, Tang X (2014) Deep learning face representation by joint identification-verification. Adv Neural Inf Process Syst, pp. 1988-1996

  27. Szegedy C et al. (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1–9

  28. Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In Thirty-First AAAI Conference on Artificial Intelligence

  29. Taigman Y, Yang M, Ranzato MA, Wolf L (2014) Deepface: closing the gap to human-level performance in face verification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1701-1708

  30. Wang F, Xiang X, Cheng J, Yuille AL (2017) Normface: l 2 hypersphere embedding for face verification. In Proceedings of the 25th ACM international conference on Multimedia, ACM, pp. 1041–1049

  31. Wang F, Cheng J, Liu W, Liu HJISPL (2018) Additive margin softmax for face verification, 25(7): 926–930

  32. Wang H et al. (2018) Cosface: Large margin cosine loss for deep face recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5265–5274

  33. Wen Y, Zhang K, Li Z, Qiao Y (2016) A discriminative feature learning approach for deep face recognition. In: European conference on computer vision, Springer, pp. 499–515

  34. Zhang K, Zhang Z, Li Z, and Qiao YJISPL (2016) Joint face detection and alignment using multitask cascaded convolutional networks, 23(10): 1499–1503

  35. Zhang X, Fang Z, Wen Y, Li Z, Qiao Y (2017) Range loss for deep face recognition with long-tailed training data. In Proceedings of the IEEE International Conference on Computer Vision, pp. 5409–5418

Download references

Acknowledgements

The project sponsored by the National Key Research and Development Program (No.2016YFB0502002) and the Fundamental Research Funds for the Central Universities under Grant 2019PTB-010. We would like to express our sincere appreciation to Prof. Ning Li, Prof. Wei Xu served as scientific advisors. Bedides, we also thank the anonymous reviewers for their insightful comments, which have greatly aided us in improving the quality of the paper.

Author information

Authors and Affiliations

  1. Beijing University of Posts and Telecommunications, Peking, China

    Jichao Jiao, Weilun Liu, Yaokai Mo, Jian Jiao, Zhongliang Deng & Xinping Chen

Authors
  1. Jichao Jiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Weilun Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yaokai Mo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jian Jiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zhongliang Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xinping Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jichao Jiao.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiao, J., Liu, W., Mo, Y. et al. Dyn-arcFace: dynamic additive angular margin loss for deep face recognition. Multimed Tools Appl 80, 25741–25756 (2021). https://doi.org/10.1007/s11042-021-10865-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10865-5

Keywords

Search

Navigation