Skip to main content
SpringerLink
Log in

Deep palmprint recognition algorithm based on self-supervised learning and uncertainty loss

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

With the rapid development of deep learning technology, an increasing number of people are adopting palmprint recognition algorithms based on deep learning for identity authentication. However, these algorithms are susceptible to factors such as palm placement, light source, and insufficient data sampling, resulting in poor recognition accuracy. To address these issues, this paper proposes a new end-to-end deep palmprint recognition algorithm (SSLAUL), which introduces self-supervised representation learning based on contextual prediction, utilizing unlabeled palmprint data for pre-training before introducing the trained parameters into the downstream model for fine-tuning. An uncertainty loss function is introduced into the downstream model, using the homoskedastic uncertainty as a benchmark to do adaptive weight adjustment for different loss functions dynamically. Channel and spatial attention mechanisms are also introduced to extract highly discriminative local features. In this paper, the algorithm is validated on publicly available IITD, CASIA, and PolyU palmprint datasets. The method always achieves the best recognition performance compared to other state-of-the-art algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

All datasets used in this study are covered in Sect. 4.2, and corresponding public access websites are provided in the references.

References

  1. Xu, Y., Fei, L.K., Wen, J., et al.: Discriminative and robust competitive code for palmprint recognition. IEEE Trans. Syst. Man Cybernet. Syst. 48(2), 232–241 (2018)

    Article  Google Scholar 

  2. Zheng, Q., Kumar, A., Pan, G.: A 3D feature descriptor recovered from a single 2D palmprint image[J]. IEEE Trans. Pattern Anal. Mach. Intell. 38(6), 1272–1279 (2016)

    Article  Google Scholar 

  3. Fei, L., Zhang, B., Zhang, W., et al.: Local apparent and latent direction extraction for palmprint recognition[J]. Inf. Sci. 473, 59–72 (2019)

    Article  Google Scholar 

  4. Jia, W., Hu, R.X., Lei, Y.K., et al.: Histogram of oriented lines for palmprint recognition[J]. IEEE Trans. Syst. Man Cybernet. Syst. 44(3), 385–395 (2013)

    Article  Google Scholar 

  5. Zhao, S., Zhang, B., Chen, C.L.P.: Joint deep convolutional feature representation for hyperspectral palmprint recognition[J]. Inf. Sci. 489, 167–181 (2019)

    Article  MathSciNet  Google Scholar 

  6. Fei, L., Zhang, B., Zhang, L., et al.: Learning compact multifeature codes for palmprint recognition from a single training image per palm[J]. IEEE Trans. Multimedia 23, 2930–2942 (2020)

    Article  Google Scholar 

  7. Jain, A.K., Feng, J.: Latent palmprint matching[J]. IEEE Trans. Pattern Anal. Mach. Intell. 31(6), 1032–1047 (2008)

    Article  Google Scholar 

  8. Doersch, C., Gupta, A., Efros, A.A. Unsupervised visual representation learning by context prediction[C]. In: Proceedings of the IEEE international conference on computer vision. 2015: 1422–1430

  9. Kendall, A., Gal, Y., Cipolla, R.: Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 7482–7491. (2018)

  10. Woo, S., Park, J., Lee, J.Y., et al.: Cbam: Convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV). pp 3–19. (2018)

  11. Dian, L., Dongmei, S.: Contactless palmprint recognition based on convolutional neural network. In: 2016 IEEE 13th International Conference on Signal Processing (ICSP). IEEE, pp: 1363–1367. (2016)

  12. Tan, M., Le, Q.: Efficientnet: Rethinking model scaling for convolutional neural networks. In: International conference on machine learning. PMLR, 6105–6114. (2019)

  13. Sun, Q., Zhang, J., Yang, A., et al.: Palmprint recognition with deep convolutional features. In: Advances in Image and Graphics Technologies: 12th Chinese conference, IGTA 2017, Beijing, China, June 30–July 1, 2017, Revised Selected Papers 12. Springer Singapore, pp 12-19 (2018)

  14. Bao, X., Guo, Z.: Extracting region of interest for palmprint by convolutional neural networks. In: 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA). IEEE, pp 1–6. (2016)

  15. Izadpanahkakhk, M., Razavi, S.M., Taghipour-Gorjikolaie, M., et al.: Deep region of interest and feature extraction models for palmprint verification using convolutional neural networks transfer learning[J]. Appl. Sci. 8(7), 1210 (2018)

    Article  Google Scholar 

  16. Wang, G., Kang, W., Wu, Q., et al.: Generative adversarial network (GAN) based data augmentation for palmprint recognition. In: 2018 Digital Image Computing: Techniques and Applications (DICTA). IEEE, pp 1–7. (2018)

  17. Zhong, D., Zhu, J.: Centralized large margin cosine loss for open-set deep palmprint recognition[J]. IEEE Trans. Circuits Syst. Video Technol. 30(6), 1559–1568 (2019)

    Article  Google Scholar 

  18. Zhu, J., Zhong, D., Luo, K.: Boosting unconstrained palmprint recognition with adversarial metric learning[J]. IEEE Transactions on Biometrics, Behavior, and Identity Science 2(4), 388–398 (2020)

    Article  Google Scholar 

  19. Chen, T., Kornblith, S., Norouzi, M., et al.: A simple framework for contrastive learning of visual representations. In: International conference on machine learning. PMLR, pp 1597–1607. (2020)

  20. Su, J.C., Maji, S., Hariharan, B.: When does self-supervision improve few-shot learning? In: European conference on computer vision. Cham: Springer International Publishing, pp 645–666. (2020)

  21. Gidaris, S., Singh, P., Komodakis, N.: Unsupervised representation learning by predicting image rotations[J]. arXiv preprint arXiv:1803.07728, 2018

  22. Noroozi, M., Favaro, P.: Unsupervised learning of visual representations by solving jigsaw puzzles. In: European conference on computer vision. Cham: Springer International Publishing, pp 69–84. (2016)

  23. Pathak, D., Krahenbuhl, P., Donahue, J. et al.: Context encoders: Feature learning by inpainting. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 2536–2544. (2016)

  24. Wen, Y., Zhang, K., Li, Z., et al.: A discriminative feature learning approach for deep face recognition. In: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part VII 14. Springer International Publishing, pp 499-515. (2016)

  25. Deng, J., Guo, J., Xue, N., et al.: Arcface: Additive angular margin loss for deep face recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp 4690–4699. (2019)

  26. Nanda, A., Im, W., Choi, K.S., et al.: Combined center dispersion loss function for deep facial expression recognition[J]. Pattern Recogn. Lett. 141, 8–15 (2021)

    Article  Google Scholar 

  27. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 7132–7141. (2018)

  28. Kumar, A.: Incorporating cohort information for reliable palmprint authentication. In: 2008 Sixth Indian conference on computer vision, graphics & image processing. IEEE, pp 583–590. (2008)

  29. Sun, Z., Tan, T., Wang, Y., et al.: Ordinal palmprint represention for personal identification [represention read representation]. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05). IEEE, 1: 279-284. (2005)

  30. GPDS Palmprint Database. Accessed: May 8, 2018. [Online]. Available:http://www.gpds.ulpgc.es

  31. Zhang, L., Li, L., Yang, A., et al.: Towards contactless palmprint recognition: A novel device, a new benchmark, and a collaborative representation based identification approach[J]. Pattern Recogn. 69, 199–212 (2017)

    Article  Google Scholar 

  32. Zhang, D., Guo, Z., Lu, G., et al.: An online system of multispectral palmprint verification[J]. IEEE Trans. Instrum. Meas. 59(2), 480–490 (2009)

    Article  Google Scholar 

  33. Zhang, D., Guo, Z., Lu, G., Zhang, L., Zuo, W.: An online system of multispectral palmprint verification. IEEE Trans. Instrum. Meas. 59(2), 480–490 (2010)

    Article  Google Scholar 

  34. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05). IEEE, 1: 886-893. (2005)

  35. Ojala, T., Pietikainen, M., Harwood, D.: Performance evaluation of texture measures with classification based on Kullback discrimination of distributions. In: Proceedings of 12th international conference on pattern recognition. IEEE, 1: 582-585. (1994)

  36. Ojansivu, V., Heikkilä, J.: Blur insensitive texture classification using local phase quantization[C]//Image and Signal Processing: 3rd International Conference, ICISP 2008. Cherbourg-Octeville, France, July 1-3, 2008. Proceedings 3. Springer Berlin Heidelberg, 236-243. (2008)

  37. Ojansivu, V., Rahtu, E., Heikkila, J.: Rotation invariant local phase quantization for blur insensitive texture analysis. In: 2008 19th International conference on pattern recognition. IEEE, pp 1–4. (2008)

  38. Kong, W.K., Zhang, D., Li, W.: Palmprint feature extraction using 2-D Gabor filters[J]. Pattern Recogn. 36(10), 2339–2347 (2003)

    Article  Google Scholar 

  39. Vu, N.S., Dee, H.M., Caplier, A.: Face recognition using the POEM descriptor[J]. Pattern Recogn. 45(7), 2478–2488 (2012)

    Article  Google Scholar 

  40. Genovese, A., Piuri, V., Plataniotis, K.N., et al.: PalmNet: gabor-PCA convolutional networks for touchless palmprint recognition[J]. IEEE Trans. Inf. Forensics Secur. 14(12), 3160–3174 (2019)

    Article  Google Scholar 

  41. Matkowski, W.M., Chai, T., Kong, A.W.K.: Palmprint recognition in uncontrolled and uncooperative environment[J]. IEEE Trans. Inf. Forensics Secur. 15, 1601–1615 (2019)

    Article  Google Scholar 

  42. Zhao, S., Zhang, B.: Joint constrained least-square regression with deep convolutional feature for palmprint recognition[J]. IEEE Trans. Syst. Man Cybernet. Syst. 52(1), 511–522 (2020)

    Article  Google Scholar 

  43. Zhang Y, Zhang L, Zhang R, et al. Towards palmprint verification on smartphones[J]. arXiv preprint arXiv:2003.13266, 2020.

  44. Deng, J., Dong, W., Socher, R., et al.: Imagenet: A large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 248–255. (2009)

Download references

Author information

Authors and Affiliations

  1. College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology (TYUT), TaiYuan, China

    Rui Fan & Xiaohong Han

Authors
  1. Rui Fan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaohong Han
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Rui Fan: Data analysis and Writing. Rui Fan: Formal analysis. Rui Fan: Validation. Rui Fan: Methodology. Xiaohong Han: Supervision. All authors reviewed the manuscript

Corresponding author

Correspondence to Xiaohong Han.

Ethics declarations

Competing interests

The authors declare no competing interests.

Ethical approval

The datasets used in this article are all public datasets. Written informed consent was obtained from all the participants prior to the enrollment (or for the publication) of this study (or case report).

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fan, R., Han, X. Deep palmprint recognition algorithm based on self-supervised learning and uncertainty loss. SIViP (2024). https://doi.org/10.1007/s11760-024-03104-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11760-024-03104-5

Keywords

Search

Navigation