Skip to main content
SpringerLink
Log in

Feature selection for the fusion of face and palmprint biometrics

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Multimodal biometric systems aim to improve the recognition accuracy by minimizing the limitations of unimodal systems. In this paper, different fusion schemes based on feature-level and match score-level fusion are employed to provide a robust recognition system. The proposed method presents a multimodal approach based on face–palmprint biometric systems by match score-level fusion technique. Local binary patterns are performed as local feature extractor to obtain efficient texture descriptor. Feature selection is performed using backtracking search algorithm to select an optimal subset of face and palmprint extracted features. Hence, computation time and feature dimension are considerably reduced while obtaining the higher level of performance. Then, match score-level fusion is performed to show the effectiveness and accuracy of the proposed method. In score-level fusion, face and palmprint scores are normalized using tanh normalization and matching scores of individual classifiers are fused using sum rule method. The experimental results are tested on a developed virtual multimodal database combining FERET face and PolyU palmprint databases. The results demonstrate a significant improvement compared with unimodal identifiers, and the proposed approach significantly outperforms other face–palmprint multimodal systems with a recognition accuracy of 99.17 %. Additionally, the proposed approach is compared with the state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Ross, A., Nandakumar, K., Jain, A.K.: Handbook of Multibiometrics. Springer, New York (2006)

    Google Scholar 

  2. Jain, A.K., Ross, A., Prabhakar, S.: An introduction to biometric recognition. IEEE Trans. Circuits Syst. Video Technol. 14, 4–20 (2004)

    Article  Google Scholar 

  3. Demirel, H., Anbarjafari, G.: Pose invariant face recognition using probability distribution functions in different color channels. IEEE Signal Process. Lett. 15, 537–540 (2008)

    Article  Google Scholar 

  4. Prabhakar, S., Pankanti, S., Jain, A.K.: Biometric recognition: security and privacy concerns. IEEE Secur. Priv. Mag. 1, 33–42 (2003)

    Article  Google Scholar 

  5. Jain, A.K., Bolle, RuudM, Pankanti, S.: Biometrics: Personal Identification in Networked Society. Kluwer, Massachusetts (1999)

    Book  Google Scholar 

  6. Xu, Y., Zhang, D., Yang, J.-Y.: A feature extraction method for use with bimodal biometrics. Pattern Recogn. 43, 1106–1115 (2010)

    Article  MATH  Google Scholar 

  7. Raghavendra, R., Dorizzi, B., Rao, A., Kumar, G.H.: Designing efficient fusion schemes for multimodal biometric systems using face and palmprint. Pattern Recogn. 44, 1076–1088 (2011)

    Article  MATH  Google Scholar 

  8. Jing, X.-Y., Li, S., Li, W.-Q., Yao, Y.-F., Lan, C., Lu, J.-S., Yang, J.-Y.: Palmprint and face multi-modal biometric recognition based on SDA-GSVD and its kernelization. Sensors 12, 5551–5571 (2012)

    Article  Google Scholar 

  9. Yao, Y.-F., Jing, X.-Y., Wong, H.-S.: Face and palmprint feature level fusion for single sample biometrics recognition. Neurocomputing 70, 1582–1586 (2007)

    Article  Google Scholar 

  10. Jing, X.-Y., Yao, Y.-F., Zhang, D., Yang, J.-Y., Li, M.: Face and palmprint pixel level fusion and Kernel DCV-RBF classifier for small sample biometric recognition. Pattern Recognit. 40, 3209–3224 (2007)

    Article  MATH  Google Scholar 

  11. Nirmala, S., Aloka, S.: Face and palmprint multimodal biometric systems using Gabor-Wigner transform as feature extraction. Pattern Anal. Appl. (2014). doi:10.1007/s10044-014-0414-6

    Google Scholar 

  12. Eskandari, M., Toygar, Ö.: Fusion of face and iris biometrics using local and global feature extraction methods. Signal Image Video Process. 8(6), 995–1006 (2014)

    Article  Google Scholar 

  13. Eskandari, M., Toygar, Ö., Demirel, H.: Feature extractor selection for face–iris multimodal recognition. Signal Image Video Process. 8(6), 1189–1198 (2014)

    Article  Google Scholar 

  14. Gholam, M.S., Mansoor, A.B., Masood, H., Mumtaz, M.: Personal identification using feature and score level fusion of palm- and fingerprints. Signal Image Video Process. 5(4), 477–483 (2011)

    Article  Google Scholar 

  15. Ahonen, T., Hadid, A., Pietikäinen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)

    Article  MATH  Google Scholar 

  16. Wei, Y., Lin, G., Sha, Y., Yonggang, D., Pan, J., Jun, W., Shijun, L.: An improved LBP algorithm for texture and face classification. Signal Image Video Process. 8(1), 155–161 (2014)

    Google Scholar 

  17. Anbarjafari, G.: Face recognition using color local binary pattern from mutually independent color channels. EURASIP J. Image Video Process. (2013). doi:10.1186/1687-5281-2013-6

    Google Scholar 

  18. Izadpanahi, S., Toygar, Ö.: Human Age Classification with Optimal Geometric Ratios and Wrinkle Analysis. Int. J. Pattern Recognit. Artif. Intell. 28(2), 1456003-1–1456003-17 (2014)

    Article  Google Scholar 

  19. Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture meature with classification based on feature distributions. Pattern Recognit. 29, 51–59 (1996)

    Article  Google Scholar 

  20. Nanni, L., Lumini, A., Brahnam, S.: Survey on LBP based texture descriptors for image classification. J. Expert Syst. Appl. 39, 3634–3641 (2012)

    Article  Google Scholar 

  21. Hadid, A., Dugelay, J.L., Pietikäinen, M.: On the use of dynamic features in face biometrics: recent advances and challenges. Signal Image Video Process. 5(4), 495–506 (2011)

    Article  Google Scholar 

  22. Civicioglu, P.: Backtracking search optimization algorithm for numerical optimization problems. Appl. Math. Comput. 219, 8121–8144 (2013)

    MATH  MathSciNet  Google Scholar 

  23. Jain, A.K., Nandakumara, K., Ross, A.: Score normalization in multimodal biometric systems. Pattern Recognit. 38, 2270–2285 (2005)

    Article  Google Scholar 

  24. PolyU palmprint Database. http://www.comp.polyu.edu.hk/~biometrics/

  25. FERET database. [Online] Department of Defense’s Counterdrug Technology Development Program 1993–1997, 7441, 74–81 (2012). http://www.itl.nist.gov/iad/humanid/feret/

  26. Shan, C., Braspenning, R.: Recognizing facial expressions automatically from video. Handb. Ambient Intell. Smart Environ. 7441, 479–509 (2010)

    Article  Google Scholar 

  27. Ramon-Balmaseda, E., Lorenzo-Navarro, J., Castrillon-Santana, M.: Gender classification in large databases. In: 17th Iberoamerican Congress in Pattern Recognition, Image Analysis, Computer Vision, and Applications (CIARP2012). Lecture Notes in Computer Science, vol. 7441, pp. 74–81. Springer, Berlin, Heidelberg (2012)

  28. ORL face database, AT&T Laboratories, Cambridge University, UK. http://www.uk.research.att.com/facedatabase.html

  29. Essex face database, vision group, University of Essex, UK. http://cswww.essex.ac.uk/mv/allfaces/index.html

  30. Lee, K.C., Ho, J., Kriegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. 27, 684–698 (2005)

    Article  Google Scholar 

  31. Extended Yale Face Database B, University of Yale. http://vision.ucsd.edu/~leekc/ExtYaleDatabase/ExtYaleB.html

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Eastern Mediterranean University, Gazimagusa, Northern Cyprus, Mersin 10, Turkey

    Mina Farmanbar & Önsen Toygar

Authors
  1. Mina Farmanbar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Önsen Toygar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Önsen Toygar.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Farmanbar, M., Toygar, Ö. Feature selection for the fusion of face and palmprint biometrics. SIViP 10, 951–958 (2016). https://doi.org/10.1007/s11760-015-0845-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-015-0845-6

Keywords

Search

Navigation