Applied Intelligence

, Volume 49, Issue 3, pp 1016–1035 | Cite as

A novel hybrid score level and decision level fusion scheme for cancelable multi-biometric verification

  • Rudresh DwivediEmail author
  • Somnath Dey


In spite of the benefits of biometric-based authentication systems, there are few concerns raised because of the sensitivity of biometric data to outliers, low performance caused due to intra-class variations, and privacy invasion caused by information leakage. To address these issues, we propose a hybrid fusion framework where only the protected modalities are combined to fulfill the requirement of secrecy and performance improvement. This paper presents a method to integrate cancelable modalities utilizing Mean-Closure Weighting (MCW) score level and Dempster-Shafer (DS) theory based decision level fusion for iris and fingerprint to mitigate the limitations in the individual score or decision fusion mechanisms. The proposed hybrid fusion scheme incorporates the similarity scores from different matchers corresponding to each protected modality. The individual scores obtained from different matchers for each modality are combined using MCW score fusion method. The MCW technique achieves the optimal weight for each matcher involved in the score computation. Further, DS theory is applied to the induced scores to output the final decision. The rigorous experimental evaluations on three virtual databases indicate that the proposed hybrid fusion framework outperforms over the component level or individual fusion methods (score level and decision level fusion). As a result, we achieve (48%, 66%), (72%, 86%) and (49%, 38%) of performance improvement over unimodal cancelable iris and unimodal cancelable fingerprint verification systems for Virtual_A, Virtual_B, and Virtual_C databases, respectively. Also, the proposed method is robust enough to the variability of scores and outliers satisfying the requirement of secure authentication.


Biometric Multibiometric system Verification fusion Decision level fusion Security Privacy 



The authors are thankful to SERB (ECR/2017/000027), Department of Science & Technology, Govt. of India for providing financial support. Also, we would like to acknowledge Indian Institute of Technology Indore for providing the laboratory support and research facilities to carry out this research.


  1. 1.
    Bengio S, Mariéthoz J (2004) A statistical significance test for person authentication. In: Proceedings of Odyssey 2004: The Speaker and Language Recognition Workshop, pp 237–244Google Scholar
  2. 2.
    Camlikaya E, Kholmatov A, Yanikoglu B (2008) Multi-biometric templates using fingerprint and voice. In: Biometric technology for human identification V. vol. 6944, p 69440i. International society for optics and photonicsGoogle Scholar
  3. 3.
    Canuto AM, Pintro F, Xavier-Junior JC (2013) Investigating fusion approaches in multi-biometric cancellable recognition. Expert Syst Appl 40(6):1971–1980CrossRefGoogle Scholar
  4. 4.
    CASIA V-3-Interval database: Institute of automation, chinese academy of sciences(CASIA), CASIA iris image database version 3.0 (2010),
  5. 5.
    Chenghua Y, Qixiang C (2009) An improved algorithm for dempster-shafer theory of evidence. In: 2009 International conference on electronic commerce and business intelligence, pp 475–478Google Scholar
  6. 6.
    Chin Y, Ong T, Teoh A, Goh K (2014) Integrated biometrics template protection technique based on fingerprint and palmprint feature-level fusion. Information Fusion 18:161–174CrossRefGoogle Scholar
  7. 7.
    Cimato S, Gamassi M, Piuri V, Sassi R, Scotti F (2008) Privacy-aware biometrics: Design and implementation of a multimodal verification system. In: 2008 Annual computer security applications conference (ACSAC), pp 130–139Google Scholar
  8. 8.
    Daugman J (2002) How iris recognition works. In: International conference on image processing. vol. 1, pp 33–36Google Scholar
  9. 9.
    Dwivedi R, Dey S (2018a) Securing fingerprint template using non-invertible ridge feature transformation. Unpublished manuscriptGoogle Scholar
  10. 10.
    Dwivedi R, Dey S (2018b) Score-level fusion for cancelable multi-biometric verification. Pattern Recognition Letters pp –Google Scholar
  11. 11.
    Dwivedi R, Dey S, Singh R, Prasad A (2017) A privacy-preserving cancelable iris template generation scheme using decimal encoding and look-up table mapping. Computers & Security 65:373–386CrossRefGoogle Scholar
  12. 12.
    FVC2002: Fingerprint Verification Competition (2002).
  13. 13.
    Grover J, Hanmandlu M (2015) Hybrid fusion of score level and adaptive fuzzy decision level fusions for the finger-knuckle-print based authentication. Appl Soft Comput 31:1–13CrossRefGoogle Scholar
  14. 14.
    He M, Horng SJ, Fan P, Run RS, Chen RJ, Lai JL, Khan MK, Sentosa KO (2010) Performance evaluation of score level fusion in multimodal biometric systems. Pattern Recogn 43(5):1789–1800CrossRefzbMATHGoogle Scholar
  15. 15.
    ISO/IEC 19795-1:2006 Information technology – Biometric performance testing and reporting – Part 1: Principles and framework: ISO/IEC 19795-1:2006 information technology – biometric performance testing and reporting – part 1: Principles and framework (2006).
  16. 16.
    ISO/IEC 2382-37:2012 information technology – vocabulary – part 37: biometrics 2012: ISO/IEC 2382-37:2012 information technology – vocabulary – part 37: biometrics 2012 (2012).
  17. 17.
    Joshi T, Dey S, Samanta D (2009) Multimodal biometrics: state of the art in fusion techniques. International Journal of Biometrics 1(4):393–417CrossRefGoogle Scholar
  18. 18.
    Kabir W, Ahmad MO, Swamy MNS (2018) Normalization and weighting techniques based on genuine-impostor score fusion in multi-biometric systems. IEEE Trans Inf Forensics Secur 13(8):1989–2000CrossRefGoogle Scholar
  19. 19.
    Kelkboom EJC, Zhou X, Breebaart J, Veldhuis RNJ, Busch C (2009) Multi-algorithm fusion with template protection. In: 2009 IEEE 3rd international conference on biometrics: Theory, applications, and systems, pp 1–8Google Scholar
  20. 20.
    Kolomvatsos K, Anagnostopoulos C, Hadjiefthymiades S (2015) Contextual reasoning under uncertainty in sensor data stream monitoring. International Journal of Monitoring and Surveillance Technologies Research 3 (1):1–19CrossRefzbMATHGoogle Scholar
  21. 21.
    Kolomvatsos K, Anagnostopoulos C, Hadjiefthymiades S (2017a) Data fusion and type-2 fuzzy inference in contextual data stream monitoring. IEEE Trans Syst Man Cybern Syst Hum 47(8):1839–1853Google Scholar
  22. 22.
    Kolomvatsos K, Anagnostopoulos C, Hadjiefthymiades S (2017b) Distributed localized contextual event reasoning under uncertainty. IEEE Internet of Things Journal 4(1):183–191Google Scholar
  23. 23.
    Kumar A, Kumar A (2016) Adaptive management of multimodal biometrics fusion using ant colony optimization. Information Fusion 32:49–63CrossRefGoogle Scholar
  24. 24.
    Li SZ, Jain AK (2009) Encyclopedia of Biometrics, vol. 1 Springer Science & Business MediaGoogle Scholar
  25. 25.
    Maiorana E, Hine GE, Campisi P (2015) Hill-climbing attacks on multibiometrics recognition systems. IEEE Trans Inf Forensics Secur 10(5):900–915CrossRefGoogle Scholar
  26. 26.
    Masek L (2003) Recognition of human iris patterns for biometric identification. Tech. rep., University of Western Australia, CrawleyGoogle Scholar
  27. 27.
    Mezai L, Hachouf F (2015) Score-level fusion of face and voice using particle swarm optimization and belief functions. IEEE Transactions on Human-Machine Systems 45(6):761–772CrossRefGoogle Scholar
  28. 28.
    Multimedia University version-1.0: Multimedia university version-1.0, MMU1 iris image database (2014 (Accessed))
  29. 29.
    Nandakumar K, Jain AK (Sept 2015) Biometric template protection: Bridging the performance gap between theory and practice. IEEE Signal Proc Mag 32(5):88–100Google Scholar
  30. 30.
    Nguyen K, Denman S, Sridharan S, Fookes C (2015) Score-level multibiometric fusion based on dempster shafer theory incorporating uncertainty factors. IEEE Transactions on Human-Machine Systems 45(1):132–140CrossRefGoogle Scholar
  31. 31.
    Othman A, Ross A (2013) On mixing fingerprints. IEEE Trans Inf Forensics Secur 8(1):260–267CrossRefGoogle Scholar
  32. 32.
    Paul PP, Gavrilova M (2012) Multimodal cancelable biometrics. In: 2012 IEEE 11th international conference on cognitive informatics and cognitive computing, pp 43–49Google Scholar
  33. 33.
    Prabhakar S, Jain AK (2002) Decision-level fusion in fingerprint verification. Pattern Recogn 35(4):861–874CrossRefzbMATHGoogle Scholar
  34. 34.
    Provan GM (1990) A logic-based analysis of dempster-shafer theory. Int J Approx Reason 4(5):451–495MathSciNetCrossRefzbMATHGoogle Scholar
  35. 35.
    Rathgeb C, Gomez-Barrero M, Busch C, Galbally J, Fierrez J (2015) Towards cancelable multi-biometrics based on bloom filters: a case study on feature level fusion of face and iris. In: 3rd international workshop on biometrics and forensics (IWBF 2015), pp 1–6Google Scholar
  36. 36.
    Ross AA, Nandakumar K, Jain AK (2006) Handbook of multibiometrics. Springer, New YorkGoogle Scholar
  37. 37.
    Sadhya D, Singh SK (2018) Construction of a bayesian decision theory-based secure multimodal fusion framework for soft biometric traits. IET Biometrics 7(3):251–259CrossRefGoogle Scholar
  38. 38.
    Shafer G (1976) A mathematical theory of evidence, vol. 42, Princeton University Press, PrincetonGoogle Scholar
  39. 39.
    Simoens K, Bringer J, Chabanne H, Seys S (2012) A framework for analyzing template security and privacy in biometric authentication systems. IEEE Trans Inf Forensics Secur 7(2):833– 841CrossRefGoogle Scholar
  40. 40.
    Smets P (2002) Decision making in a context where uncertainty is represented by belief functions, pp. 17–61. Physica-Verlag HD, HeidelbergzbMATHGoogle Scholar
  41. 41.
    Sutcu Y, Li Q, Memon N (2007) Secure biometric templates from fingerprint-face features. In: 2007 IEEE Conference on computer vision and pattern recognition, pp 1–6Google Scholar
  42. 42.
    Talreja V, Valenti MC, Nasrabadi NM (2017) Multibiometric secure system based on deep learning. In: 2017 IEEE Global conference on signal and information processing (globalSIP), pp 298–302Google Scholar
  43. 43.
    Tao Q, Veldhuis R (2008) Hybrid fusion for biometrics: Combining score-level and decision-level fusion. In: 2008 IEEE Computer society conference on computer vision and pattern recognition workshops, pp 1–6Google Scholar
  44. 44.
    Wong WJ, Teoh AB, Wong MD, Kho YH (2013) Enhanced multi-line code for minutiae-based fingerprint template protection. Pattern Recogn Lett 34(11):1221–1229CrossRefGoogle Scholar
  45. 45.
    Yang W, Wang S, Hu J, Zheng G, Valli C (2018) A fingerprint and finger-vein based cancelable multi-biometric system. Pattern Recogn 78:242–251CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Discipline of Computer Science & EngineeringIndian Institute of Technology IndoreIndoreIndia

Personalised recommendations