Fusion of Multiple Biometric Traits: Fingerprint, Palmprint and Iris

Part of the Intelligent Systems Reference Library book series (ISRL, volume 70)


Biometric recognition protocols involving single sources of information for human authentication which are commonly termed as unimodal systems though show satisfying performance, still suffered from problems relating to non-universality, permanence, collectability, convenience and susceptibility to circumvention. This paper emphasizes the priority of biometric information fusion by analyzing two kinds of fusion: Fusion of multiple representations of single biometric trait and Fusion of multiple biometric traits. As biometric traits possess large variance between persons and small variance between samples of the same person, it is important to capture this information using multiple representations at both global-level and local-level and perform fusion at feature-level. As a feature set is a straightforward representation of raw biometric data, it is theoretically presumed to incorporate richer information. Hence, we propose to use a fusion method that maximally correlates information captured from both the features and eliminates the redundant information giving a more compact representation. Fusion of multiple biometric traits is realized using fingerprint, palmprint and iris modalities. We explore this kind of fusion using two architectures: Parallel architecture and Hierarchical-cascade architecture. Multi-biometric recognition systems designed with hierarchical architecture not only are robust, fast and highly secure but also mitigate problems like missing and noisy data associated with parallel and serial architectures respectively, not to be forgotten that parallel architectures are preferred in high security-demanding defense/military applications as they evidently provide more precision for the reason that they combine more modalities and evidences about the user for recognition. Parallel framework proposed in this work takes advantage of score-level fusion. Score-level fusion is widely put to use as it offers best trade-off between ease and efficiency. We propose two score-level fusion techniques which rely on Equal Error Rates of individual modalities. Since error rate is a percentage of misclassified samples, we attempt to minimize the overlapped area between genuine and imposter curves by choosing to maximize the stability of the modality with superior performance. The proposed rule addresses the fusion problem from error rate minimization point of view so as to increase the decisive efficiency of the fusion system. To take the advantage of feature-level fusion, serial/cascade architecture and hierarchical architectures, we also propose a two-stage cascading frame-work based on fusion of fingerprint and palmprint feature sets in the first stage and iris features to eliminate the ambiguity of false matches in the next stage. The proposed frame work takes advantage of both unimodal and multimodal architectures. Proportionate experimental results reported on both real and virtual databases in this work demonstrate the superior performance of a multimodal recognition system over a unimodal system but however infers that the design of a multimodal biometric system predominantly depends on the application criteria and so is difficult to anticipate the best fusion strategy. The review of biometric based recognition systems indicate that a number of factors including the accuracy, cost, and speed of the system may play vital role in assessing its performance. But today with the cost of biometric sensors constantly diminishing and high speed processors and parallel programming techniques widely available to affordable research, accuracy performance has become predominant focus of biometric system design. The main aim of the present work is to improve the accuracy of a multimodal biometric recognition system by reducing the error rates.


Local Binary Pattern Canonical Correlation Analysis Equal Error Rate Biometric System False Acceptance Rate 


  1. 1.
    Bolle, R.M., Connell, J.H., Pankanti, S., Ratha, N.K., Senior, A.W.: Guide To Biometrics. Springer, Berlin (2003)Google Scholar
  2. 2.
  3. 3.
    Korotkaya, Z.: Biometric person authentication: Odor, pp. 1–6Google Scholar
  4. 4.
    Komogortsev, O.V., Karpov, A., Price, L.R.: Biometric authentication via oculomotor plant characteristics, In: IARP/IEEE International Conference on Biometrics, March 29–April 1, 2012 New Delhi, IndiaGoogle Scholar
  5. 5.
    Kasprowski, P., Ober, J.: Eye movement in biometrics. In: Proceedings of Biometric Authentication Workshop, European Conference on Computer Vision in Prague 2004, LNCS 3087, Springer-Verlag 2004Google Scholar
  6. 6.
    Chellappa, R., Wilson, C.L., Sirohey, S.: Human and machine recognition of faces: a survey. Proc. IEEE 83, 5 (1995)CrossRefGoogle Scholar
  7. 7.
    Bruce, P., Ashraful Amin, M., Hong Y.: Performance evaluation and comparison of PCA Based human face recognition methods for distorted images. Int. J. Mach. Learn. Cybern. 2, 245–259 (2011)Google Scholar
  8. 8.
    Tistarelli, M., Bigun, J., Grosso, E. (eds.): Biometrics school 2003, LNCS 3161, 1942 (2005)Google Scholar
  9. 9.
    Wu, X., Wang, K., Zhang, D.: Line feature extraction and matching in palmprint. In: Proceedings of the Second International Conference on Image and Graphics, pp. 583–590 (2002)Google Scholar
  10. 10.
    Nalwa, V.S.: Automatic on-line signature verification. In: Proceedings of the IEEE Transactions on Biometrics, 85(2), February 1997Google Scholar
  11. 11.
    Daugman, J.: How iris recognition works. In: IEEE Transaction Circuits System for video technology, vol. 14, no. 1, January 2004Google Scholar
  12. 12.
  13. 13.
    Human Identification in Information Systems, http://www.anu.edu.au/people/Roger.Clarke/DV/HumanID.html
  14. 14.
    Karthik, N.: Integration of multiple cues in biometric systems. MS thesis, Michigan State University (2005)Google Scholar
  15. 15.
    Hong, L., Jain, A.K.: Integrating Faces and Fingerprints for Personal Identification. IEEE Trans. Pattern Anal. Mach. Intell. 20(12), 1295–1307 (1998)Google Scholar
  16. 16.
    Ross, A., Jain, A.K.: Information Fusion in Biometrics. Pattern Recog. Lett. Special Issue on Multimodal Biometrics 24(13), 2115–2125 (2003)CrossRefGoogle Scholar
  17. 17.
    Jain, A.K., Ross, A., Prabhakar, S.: An Introduction to Biometric Recognition. IEEE Trans. Circuits Syst. Video Technol. Special Issue on Image- and Video-Based Biometrics 14(1), 420 (2004)Google Scholar
  18. 18.
    Ojala, T., Pietikinen, M., Menp, T.: Multiresolution gray-scale and rotation invariant texture classification with Local Binary Patterns. IEEE Trans. PAMI 24(7), 971–987 (2002)Google Scholar
  19. 19.
    Selesnick, I.W., Baraniuk, R.G., Kingsbury, N.C.: The dual-tree complex wavelet transform. IEEE Signal Process. Mag. 2(2), 123–151 (2005)Google Scholar
  20. 20.
    Belcher, C., Du, Y.: Region-based SIFT approach to iris recognition. In: Optics and Lasers in Engineering, vol. 47 pp. 139–147, Elsevier (2009)Google Scholar
  21. 21.
    Park, C.H., Lee, J.J.: Extracting and combining multimodal directional iris features. vol. 3832, pp. 389–396. Springer, Heidelberg (2005)Google Scholar
  22. 22.
    Quan-Sen, S., et al.: A theorem on the generalized canonical projective vectors, In: Pattern Recognition, vol. 38, pp. 449–452 (2005)Google Scholar
  23. 23.
    Indovina, M., Uludag, U., Snelick, R., Mink, A., Jain, A.K.: Multimodal biometric authentication methods: a COTS approach. In: Proceedings of workshop on multimodal user authentication, pp. 99106, Santa Barbara, USA, December 2003Google Scholar
  24. 24.
  25. 25.
    P. Ejarque, A. Garde, J Anguita, J. Hernando; On the use of genuine-imposter statistical information for score fusion in multimodal biometrics. In, Ann. Telecommun., (2007).Google Scholar
  26. 26.
    Ross, A., Jain, A.K.: Fingerprint mosaicking. In: Proceedings of International Conference on Acoustic Speech and Signal Processing (ICASSP), pp. 4064–4067. Florida, U.S.A., May 2002Google Scholar
  27. 27.
    Moon, Y.S., Yeung, H.W., Chan, K.C., Chan, S.O.: Template synthesis and image mosaicking for fingerprint registration: an experimental study. In: Proceedings of International Conference on Acoustic Speech and Signal Processing (ICASSP), vol. 5, pp. 409–412. Quebec, Canada, May 2004Google Scholar
  28. 28.
    Kumar, A., Wong, D.C.M., Shen, H.C., Jain, A.K.: Personal verification using palmprint and hand geometry biometric. In: Proceedings of Fourth International Conference on Audio- and Video-Based Biometric Person Authentication (AVBPA), pp. 668–678, Guildford, U.K., June 2003Google Scholar
  29. 29.
    Ross, A., Govindarajan, R.: Feature level fusion using hand and face biometrics. In: Proceedings of of SPIE Conference on Biometric Technology for Human Identification, vol. 5779, pp. 196–204, Florida, U.S.A., March 2005Google Scholar
  30. 30.
    Krishneswari, K., Arumugam, S.: Multimodal biometrics using feature fusion. J. Comput. Sci. 8(3), 431–435 (2012)CrossRefGoogle Scholar
  31. 31.
    Lam, L., Suen, C.Y.: Application of majority voting to pattern recognition: an analysis of its behavior and performance. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 27(5), 553–568 (1997)CrossRefGoogle Scholar
  32. 32.
    Daugman, J.: Combining Multiple Biometrics. Available at http://www.cl.cam.ac.uk/users/jgd1000/combine/combine.html
  33. 33.
    Radha, N., Kavitha, A.: Rank level fusion using fingerprint and iris biometrics. Indian J. Comput. Sci. Eng. 2(6), 917–923 (2012)Google Scholar
  34. 34.
    Abbas, N., Bengherabi, M., Boutellaa, E.: Experimental investigation of OC-SVM for multibiometric score fusion. In: 8th International Workshop on systems, signal processing and their applications (WoSSPA), pp. 250–255, 12–15 May 2013Google Scholar
  35. 35.
    Sharma, P., Kaur, M.: Multimodal classification using feature level fusion and SVM. Int. J. Comput. Appl. 76(1–16), 26–32 (2013)Google Scholar
  36. 36.
    Shariatmadar, Z.S., Faez, K.: Finger-knuckle-print recognition performance improvement via multi-instance fusion at the score level. Optik - Int. J. Light Electron Opt. 125(3), 908–910 (2014)Google Scholar
  37. 37.
    Yuanyuan. Z., Shuming, J., Zijiang Y., Yanqing Z.: A score level fusion framework for gait-based human recognition: Multimedia Signal Processing (MMSP), In: IEEE 15th International Workshop on, pp. 189–194, Sept. 30 2013–Oct. 2 2013Google Scholar
  38. 38.
    Yu, Y., Tang, Y., Cao, J., Gan, J.: Multispectral palmprint recognition using score-level fusion. In: IEEE International Conference on and IEEE Cyber, Physical and Social Computing, pp. 1450–1453, 20–23, August 2013Google Scholar
  39. 39.
    Eskandari, M., önsen, T.: Score level fusion for face-Iris multimodal biometric system: information sciences and systems 2013. Lect. Notes Electr. Eng. 264, 199–208 (2013)Google Scholar
  40. 40.
    Kar-Ann, T., Jaihie, K., Sangyoun, L.: Biometric scores fusion based on total error rate minimization. Pattern Recog. 41(3), 1066–1082 (2008)Google Scholar
  41. 41.
    Labati, R.D., Sassi, R., Scotti, F.: ECG biometric recognition: Permanence analysis of QRS signals for 24 hours continuous authentication, In: IEEE International Workshop on Information Forensics and Security (WIFS), pp. 31–36, 18–21 November (2013)Google Scholar
  42. 42.
  43. 43.
    Unsang, P., Ross, A., Jain, A.K.: Periocular biometrics in the visible spectrum: a feasibility study, In: Proceedings of the 3rd IEEE International Conference on Biometrics: Theory, Applications and systems, pp. 153–158 (2009)Google Scholar
  44. 44.
    Zhenan, S., Yunhong, W., Tieniu, T., Jiali, C.: Cascading statistical and structural classifiers for iris recognition. In: International Conference on Image Processing (2004)Google Scholar
  45. 45.
    Zhenan, S., Yunhong, W., Tieniu, T., Jiali, C.: Improving iris recognition accuracy via cascaded classifiers. IEEE Trans. Syst. Man Cyber. 35(3), 435–441 (2005)Google Scholar
  46. 46.
    Sun, Z., Tan, T., Qiu, X.: Graph matching iris image blocks with local binary pattern. In: Springer LNCS 3832: International Conference on Biometrics, January 2006Google Scholar
  47. 47.
    Zhang, P.-F., Li, D.-S., Wang, Q.: A novel iris recognition method based on feature fusion, In: International Conference on Machine Learning and Cybernetics, pp. 3661–3665 (2004)Google Scholar
  48. 48.
    Vatsa, M., Singh, R., Noore, A.: Reducing the false rejection rate of iris recognition using textural and topological features. Int. J. Signal Process, 2(2), 66–72 (2005)Google Scholar
  49. 49.
    Kumar, A., Zhang, D.: Personal authentication using multiple palmprint representation. Pattern Recog. 38, 1695–1704 (2005)CrossRefGoogle Scholar
  50. 50.
    You, J., et al.: On hierarchical palmprint coding with multiple features for personal identification in large databases. IEEE Trans. Circuits Syst. Video Tech. 14(2), 234–243 (2004)Google Scholar
  51. 51.
    Kong, W., Zhang, D., Li, W.: Palmprint feature extraction using 2-d gabor filters. Pattern Recog. 36(10), 2339–2347 (2003)CrossRefGoogle Scholar
  52. 52.
    Zuo, W., Lin, Z., Guo, Z., Zhang, D.: The multiscale competitive code via sparse representation for palmprint verification. In: Proceedings of CVPR, pp. 2265–2272 (2010)Google Scholar
  53. 53.
    Pan, X., et al.: Palmprint recognition using fusion of local and global features. In: Proceedings of the International Symposium on Intelligent Signal Processing and Communication Systems, pp. 642–645 (2007)Google Scholar
  54. 54.
    Hong, L., Jain, AK., Pankanti, S.: Can multi-biometrics improve performance. In: Proceedings of IEEE Workshop on Automatic Identification Advanced Technologies (WAIAT-99), Morristown NJ, pp. 59–64, October 1999Google Scholar
  55. 55.
    Chen, G.Y., Xie, W.F.: Pattern recognition with SVM and dual-tree complex. Image Vis. Comput. 25(6), 960–966 (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  1. 1.Jawaharlal Nehru Technological University KakinadaKakinadaIndia
  2. 2.Jawaharlal Nehru Technological University HyderabadHyderabadIndia

Personalised recommendations