Skip to main content
SpringerLink
Log in

A multi-classifier system for automatic fingerprint classification using transfer learning and majority voting

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Fingerprints fulfill a critical role in the context of community safety and criminal investigations, especially for forensic investigations, law enforcement, border access and security. For fingerprint analysis, a variety of machine learning and neural network techniques have been presented. Various AI-driven approaches are available to conduct automated activities to maintain biometric systems at the forefront of technological development. In this paper, we propose a framework for automatic classification of fingerprints that combines deep transfer learning and a majority voting system. Our multi-classifier system is capable of efficiently classifying six different types of fingerprints. We build 16 commonly used deep transfer learning models by training them with fingerprint datasets, resulting in 16 fingerprint classifiers. The training and testing phases involve six distinct fingerprint databases consisting of both real and synthetic images. We created sets of fingerprint classifiers and applied a soft majority voting method to each set, aiming to identify the optimal combination of classifiers. This allowed us to determine the most effective set of classifiers for fingerprint classification. The results of our experiments indicate that the majority voting approach of three deep transfer-learning models, namely DenseNet 121, ResNet152V1, and EfficientNetB7, outperforms the individual transfer learning structures in terms of precision in fingerprint classification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data Availability

The data used and analyzed during the current study are available from the corresponding author on reasonable request.

Notes

  1. https://github.com/prip-lab/fingerprint-synthesis

References

  1. Anguli Synthetic fingerprint generator, https://dsl.cds.iisc.ac.in/projects/Anguli [Online; Accessed May 2021]

  2. Abdulrahman S A, Alhayani B (2021) A comprehensive survey on the biometric systems based on physiological and behavioural characteristics. Materials Today: Proceedings. https://doi.org/10.1016/j.matpr.2021.07.005

  3. Abou Elassad Z E, Mousannif H, Al Moatassime H (2020) A real-time crash prediction fusion framework: an imbalance-aware strategy for collision avoidance systems. Transport Res Part C: Emerging Technol 118:102708

    Article  Google Scholar 

  4. Akhter M, Zheng J, Afzal F, Lin H, Riaz S, Mehmood A (2021) Supervised ensemble learning methods towards automatically filtering urdu fake news within social media. PeerJ Computer Science, 7. https://doi.org/10.7717/peerj-cs.425

  5. Alzubaidi L, Zhang J, Humaidi A J, Al-Dujaili A, Duan Y, Al-Shamma O, Santamaría J, Fadhel M A, Al-Amidie M, Farhan L (2021) Review of deep learning: concepts, cnn architectures, challenges, applications, future directions. J Big Data 8(1):1–74. https://doi.org/10.1186/s40537-021-00444-8

    Article  Google Scholar 

  6. Ansari A H (2011) Generation and storage of large synthetic fingerprint database. ME Thesis, Jul

  7. Behera T K, Khan M A, Bakshi S (2022) Brain mr image classification using superpixel-based deep transfer learning. IEEE J Biomed Health Inform, 1–11. https://doi.org/10.1109/JBHI.2022.3216270

  8. Cao K, Jain A (2018) Fingerprint synthesis: evaluating fingerprint search at scale. In: 2018 International Conference on Biometrics (ICB). IEEE, pp 31–38. https://doi.org/10.1109/ICB2018.2018.00016

  9. Chicco D, Jurman G (2020) The advantages of the matthews correlation coefficient (mcc) over f1 score and accuracy in binary classification evaluation. BMC genomics 21(1):1–13. https://doi.org/10.1186/s12864-019-6413-7

    Article  Google Scholar 

  10. Clement D, Agu E, Suleiman M A, Obayemi J, Adeshina S, Soboyejo W (2023) Multi-class breast cancer histopathological image classification using multi-scale pooled image feature representation (mpifr) and one-versus-one support vector machines. Appl Sci 13:1. https://doi.org/10.3390/app13010156

    Article  Google Scholar 

  11. Dasgupta D, Akhtar Z, Sen S (2020) Machine learning in cybersecurity: a comprehensive survey. J Defense Model Simul 19:2020. https://doi.org/10.1177/1548512920951275

    Article  Google Scholar 

  12. Elsadai A, Adamović S, Šarac M, Saračević M, Kumar Sharma S (2022) New approach for fingerprint recognition based on stylometric features with blockchain and cancellable biometric aspects. Multimed Tools Applic 81 (25):36715–36733

    Article  Google Scholar 

  13. Fiumara G, Flanagan P, Schwarz M, Tabassi E, Boehnen C (2018) National institute of standards and technology special database 301: Nail to nail fingerprint challenge dry run. Technical Note 2002, National Insti- tute of Standards and Technology. https://nvlpubs.nist.gov/nistpubs/TechnicalNotes/NIST.TN.2002.pdf

  14. Garris M D, Garris M D (2000) Nist special database 27: fingerprint minutiae from latent and matching tenprint images

  15. Ghiani L, Yambay D, Mura V, Tocco S, Marcialis G L, Roli F, Schuckcrs S (2013) Livdet 2013 fingerprint liveness detection competition 2013. In: 2013 International conference on biometrics (ICB), pp 1–6, https://doi.org/10.1109/ICB.2013.6613027

  16. Ghiani L, Yambay D A, Mura V, Marcialis G L, Roli F, Schuckers S A (2017) Review of the fingerprint liveness detection (livdet) competition series: 2009 to 2015. Image Vis Comput 58:110–128. https://doi.org/10.1016/j.imavis.2016.07.002

    Article  Google Scholar 

  17. González S, García S, Del Ser J, Rokach L, Herrera F (2020) A practical tutorial on bagging and boosting based ensembles for machine learning: algorithms, software tools, performance study, practical perspectives and opportunities. Inform Fus 64:205–237. https://doi.org/10.1016/j.inffus.2020.07.007

    Article  Google Scholar 

  18. Hamdi D E, Elouedi I, Fathallah A, Nguyuen M K, Hamouda A (2018) Combining fingerprints and their radon transform as input to deep learning for a fingerprint classification task. In: 2018 15th International conference on control, automation, robotics and vision (ICARCV), pp 1448–1453. https://doi.org/10.1109/ICARCV.2018.8581072

  19. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778. https://doi.org/10.1109/CVPR.2016.90

  20. He K, Zhang X, Ren S, Sun J (2016) Identity mappings in deep residual networks. In: European conference on computer vision. Springer, pp 630–645. https://doi.org/10.1007/978-3-319-46493-0_38

  21. Henry E R (1913) Classification and uses of finger prints

  22. Howard A, Sandler M, Chen B, Wang W, Chen L, Tan M, Chu G, Vasudevan V, Zhu Y, Pang R, Adam H, Le Q (2019) Searching for mobilenetv3. In: 2019 IEEE/CVF International conference on computer vision (ICCV). IEEE Computer Society, Los Alamitos, pp 1314–1324. https://doi.org/10.1109/ICCV.2019.00140, https://doi.ieeecomputersociety.org/10.1109/ICCV.2019.00140

  23. Huang X, Qian P, Liu M (2020) Latent fingerprint image enhancement based on progressive generative adversarial network. In: 2020 IEEE/CVF Conference on computer vision and pattern recognition workshops (CVPRW), pp 3481–3489. https://doi.org/10.1109/CVPRW50498.2020.00408

  24. Jaafar R, Walhazi H, Maalej A, Ben Amara N E (2022) U-net based deep learning architectures for latent fingerprint segmentation. In: 2022 19th International multi-conference on systems, signals and devices (SSD), pp 485–490. https://doi.org/10.1109/SSD54932.2022.9955982

  25. Jain A K, Nandakumar K, Ross A (2016) 50 years of biometric research: accomplishments, challenges, and opportunities. Pattern Recogn Lett 79:80–105. https://doi.org/10.1016/j.patrec.2015.12.013

    Article  Google Scholar 

  26. Jain A, Deb D, Engelsma J (2021) Biometrics: trust, but verify. IEEE Trans Biometr Behav Identity Sci PP:1–1. https://doi.org/10.1109/TBIOM.2021.3115465

    Article  Google Scholar 

  27. Jawarneh I, Alsharman N (2021) The mathematical model and deep learning features selection for whorl fingerprint classifications. Int J Comput Intell Syst 14(1):1208–1216

    Article  Google Scholar 

  28. Joshi M, Mazumdar B, Dey S (2018) Security vulnerabilities against fingerprint biometric system. arXiv e-prints, 1805

  29. Jurman G, Riccadonna S, Furlanello C (2012) A comparison of mcc and cen error measures in multi-class prediction. PLOS ONE 7(8):1–8. https://doi.org/10.1371/journal.pone.0041882

    Article  Google Scholar 

  30. Kandel I, Castelli M (2020) How deeply to fine-tune a convolutional neural network: a case study using a histopathology dataset. Appl Sci 10:10. https://doi.org/10.3390/app10103359

    Article  Google Scholar 

  31. Kumar G, Bakshi S, Sa P K, Majhi B (2021) Non-overlapped blockwise interpolated local binary pattern as periocular feature. Multimed Tools Applic 80:16565–16597

    Article  Google Scholar 

  32. Li X, Liu G, Wang Z, Zhang L, Liu H, Ai H (2023) Ensemble multiclassification model for aquatic toxicity of organic compounds. Aquat Toxicol 255:106379. https://doi.org/10.1016/j.aquatox.2022.106379

    Article  Google Scholar 

  33. Maio D, Maltoni D, Cappelli R, Wayman JL, Jain AK (2002) Fvc2002: second fingerprint verification competition. In: 2002 International conference on pattern recognition, vol 3, pp 811–814, https://doi.org/10.1109/ICPR.2002.1048144

  34. Maio D, Maltoni D, Cappelli R, Wayman J L, Jain A K (2004) Fvc2004: third fingerprint verification competition. In: International conference on biometric authentication. Springer, pp 1–7

  35. Marqués AI, García V, Sánchez JS (2012) Two-level classifier ensembles for credit risk assessment. Expert Syst Appl 39(12):10916–10922. https://doi.org/10.1016/j.eswa.2012.03.033

    Article  Google Scholar 

  36. Militello C, Rundo L, Vitabile S, Conti V (2021) Fingerprint classification based on deep learning approaches: experimental findings and comparisons. Symmetry 13:5. https://doi.org/10.3390/sym13050750

    Article  Google Scholar 

  37. Mo T, Wang L, Wu Y, Huang J, Liu W, Yang R, Zhen X (2023) Classifier ensemble with evolutionary optimisation enforced random projections. Expert Syst Appl 222:119845. https://doi.org/10.1016/j.eswa.2023.119845

    Article  Google Scholar 

  38. Monir A, Onieva E, Wozniak M (2020) Training set selection and swarm intelligence for enhanced integration in multiple classifier systems. Appl Soft Comput 95:106568. https://doi.org/10.1016/j.asoc.2020.106568

    Article  Google Scholar 

  39. Nahar P, Chaudhari N, Tanwani S (2022) Fingerprint classification system using cnn. Multimed Tools Applic, 81. https://doi.org/10.1007/s11042-022-12294-4

  40. Nist (2019) Biometric special databases and software. https://www.nist.gov/itl/iad/image-group/resources/biometric-special-databases-and-software, [Online; accessed 17. May 2021]

  41. Park E, Cui X, Kim W, Liu J, Kim H (2018) Patch-based fake fingerprint detection using a fully convolutional neural network with a small number of parameters and an optimal threshold. arXiv:1803.07817 [cs.CV]

  42. Predić B, Manić D, Saračević M, Karabašević D, Stanujkić D (2022) Automatic image caption generation based on some machine learning algorithms. Math Probl Eng, 2022. https://doi.org/10.1155/2022/4001460

  43. Rai A, Dey S, Patidar P, Rai P (2023) Mosfpad: an end-to-end ensemble of mobilenet and support vector classifier for fingerprint presentation attack detection. arXiv:2303.01465

  44. Raj S, Pannu J, Fernandes S, Ramanathan A, Pullum L, Jha S (2019) Attacking nist biometric image software using nonlinear optimization. Pattern Recogn Lett, 131. https://doi.org/10.1016/j.patrec.2019.12.003

  45. Rajasekar V, Krishnamoorthi S, Saraĉević M, Pepic D, Zajmović M, Zogic H (2022) Ensemble machine learning methods to predict the constituents in the human body. Computer Science, 23. https://doi.org/10.7494/csci.2022.23.1.4315

  46. Ranawana R, Palade V (2006) Multi-classifier systems: review and a roadmap for developers. Int J Hybrid Intell Syst 3:35–61. https://doi.org/10.3233/HIS-2006-3104

    Article  Google Scholar 

  47. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M et al (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252. https://doi.org/10.1007/s11263-015-0816-y

    Article  MathSciNet  Google Scholar 

  48. Shaheed K, Mao A, Qureshi I, Kumar M, Abbas Q, Ullah I, Zhang X (2021) A systematic review on physiological-based biometric recognition systems: current and future trends. Archives of Computational Methods in Engineering, 1–44. https://doi.org/10.1007/s11831-021-09560-3

  49. Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556 [cs.CV]

  50. Singla N, Kaur M, Sofat S (2022) Hybrid framework for identifying partial latent fingerprints using minutiae points and pores. Multimed Tools Applic, 1–18

  51. SM J, Aravindan C, Appavu R et al (2022) Classification of skin cancer from dermoscopic images using deep neural network architectures. Multimed Tools Applic, 1–16

  52. Souza G, Santos D, Pires R, Marana A, Papa J (2019) Deep features extraction for robust fingerprint spoofing attack detection. J Artif Intell Soft Comput Res 9:41–49. https://doi.org/10.2478/jaiscr-2018-0023

    Article  Google Scholar 

  53. Sullabi M A, AL-Montaser J H (2021) Fingerprint classification technique using gradient-based method for singular points detection. J Acad Res(Appl Sci) 17:1

    Google Scholar 

  54. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: 2016 IEEE Conference on computer vision and pattern recognition (CVPR), pp 2818–2826. https://doi.org/10.1109/CVPR.2016.308

  55. Szegedy C, Ioffe S, Vanhoucke V, Alemi A (2017) Inception-v4, inception-resnet and the impact of residual connections on learning, 31. https://doi.org/10.1609/aaai.v31i1.11231, https://ojs.aaai.org/index.php/AAAI/article/view/11231

  56. Tan M, Le Q (2019) Efficientnet: rethinking model scaling for convolutional neural networks. In: International conference on machine learning, vol 97. PMLR, pp 6105–6114. https://proceedings.mlr.press/v97/tan19a.html

  57. Tanha J, Abdi Y, Samadi N, Razzaghi N, Asadpour M (2020) Boosting methods for multi-class imbalanced data classification: an experimental review. J Big Data 7(1):1–47. https://doi.org/10.1186/s40537-020-00349-y

    Article  Google Scholar 

  58. Uliyan D M, Sadeghi S, Jalab H A (2020) Anti-spoofing method for fingerprint recognition using patch based deep learning machine. Eng Sci Technol Int J 23(2):264–273. https://doi.org/10.1016/j.jestch.2019.06.005

    Article  Google Scholar 

  59. Walhazi H, Haddada L R, Maalej A, Amara N E B (2020) Preprocessing latent-fingerprint images for improving segmentation using morphological snakes. In: 2020 5th International conference on advanced technologies for signal and image processing (ATSIP), pp 1–6. https://doi.org/10.1109/ATSIP49331.2020.9231908

  60. Walhazi H, Maalej A, Amara N E B (2020) Mask2lfp: mask-constrained adversarial latent fingerprint synthesis. In: 2020 International conference on cyberworlds (CW), pp 265–271. https://doi.org/10.1109/CW49994.2020.00049

  61. Wu F, Yan S, Smith J, Zhang B (2021) Deep multiple classifier fusion for traffic scene recognition. Granular Comput, 6. https://doi.org/10.1007/s41066-019-00182-6

  62. Yambay D, Ghiani L, Denti P, Marcialis G L, Roli F, Schuckers S (2012) Livdet 2011 — fingerprint liveness detection competition 2011. In: 2012 5th IAPR International conference on biometrics (ICB), pp 208–215. https://doi.org/10.1109/ICB.2012.6199810

  63. Zhang R, Zong Q, Dou L, Zhao X, Tang Y, Li Z (2021) Hybrid deep neural network using transfer learning for eeg motor imagery decoding. Biomed Signal Process Control 63:102144. https://doi.org/10.1016/j.bspc.2020.102144

    Article  Google Scholar 

  64. Zhao Q, Zhang D, Zhang L, Luo N (2010) High resolution partial fingerprint alignment using pore–valley descriptors. Pattern Recogn 43(3):1050–1061. https://doi.org/10.1016/j.patcog.2009.08.004

    Article  Google Scholar 

  65. Zhou Y, Liang X, Gu Y, Yin Y, Yao L (2020) Multi-classifier interactive learning for ambiguous speech emotion recognition. arXiv:2012.05429

  66. Zoph B, Vasudevan V, Shlens J, Le Q V (2018) Learning transferable architectures for scalable image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 8697–8710. https://doi.org/10.1109/CVPR.2018.00907

Download references

Acknowledgements

This work has been funded by the Tunisian Ministry of Higher Education and Scientific Research within the PAQ COLLABORA project ”Kit for the Detection and Authentication of Fingerprints” led by the GEOGLOB Research Lab, Faculty of Sciences of Sfax.

Author information

Author notes

    Authors and Affiliations

    1. Higher Institute of Applied Sciences and Technology, University of Sousse, Sousse, 4023, Tunisia

      Hajer Walhazi

    2. LATIS-Laboratory of Advanced Technology and Intelligent Systems, Sousse, 4023, Tunisia

      Hajer Walhazi, Ahmed Maalej & Najoua Essoukri Ben Amara

    3. Higher Institute of Applied Mathematics and Computer Science, University of Kairouan, Kairouan, 3100, Tunisia

      Ahmed Maalej

    4. National School of Engineering of Sousse, University of Sousse, Sousse, 4023, Tunisia

      Najoua Essoukri Ben Amara

    Authors
    1. Hajer Walhazi
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Ahmed Maalej
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Najoua Essoukri Ben Amara
      View author publications

      You can also search for this author in PubMed Google Scholar

    Corresponding author

    Correspondence to Hajer Walhazi.

    Ethics declarations

    Conflict of Interests

    The authors declare that they have no conflict of interest.

    Additional information

    Publisher’s note

    Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

    Ahmed Maalej and Najoua Essoukri Ben Amara contributed equally to this work.

    Rights and permissions

    Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Walhazi, H., Maalej, A. & Amara, N.E.B. A multi-classifier system for automatic fingerprint classification using transfer learning and majority voting. Multimed Tools Appl 83, 6113–6136 (2024). https://doi.org/10.1007/s11042-023-15337-6

    Download citation

    • Received:

    • Revised:

    • Accepted:

    • Published:

    • Issue Date:

    • DOI: https://doi.org/10.1007/s11042-023-15337-6

    Keywords

    Search

    Navigation