Abstract
A multi-biometric verification system lowers the verification errors by fusing information from multiple biometric sources. Information can be fused in parallel or serial modes. While parallel fusion gives a higher accuracy, it may suffer from a serious problem of taking a longer verification time. Serial fusion can alleviate this problem by allowing the users to submit a subset of the available biometric characteristics. Unfortunately, several studies show that serial fusion may not reach the level of accuracy of parallel fusion. In this paper, we propose a fusion framework which combines the advantages of both parallel and serial fusion. The core of the framework is a new concept of “confident reject region” which incurs nearly zero verification error. We evaluate our framework by performing experiments on two multi-biometric verification systems built with NIST biometric scores set release 1. The experimental results show that our framework achieves a lower equal error rate and takes a shorter verification time than standard parallel fusion.
Similar content being viewed by others
References
Abo-Zahhad M, Ahmed SM, Abbas SN (2016) A new multi-level approach to eeg based human authentication using eye blinking. Pattern Recogn Lett 82:216–225
Akhtar, Z., Fumera, G., Marcialis, G., Roli, F.: Evaluation of serial and parallel multibiometric systems under spoofing attacks. In: Biometrics: Theory, Applications and Systems (BTAS), 2012 IEEE Fifth International Conference on, pp. 283 –288 (2012)
Allano L, Dorizzi B, Garcia-Salicetti S (2010) Tuning cost and performance in multi-biometric systems: A novel and consistent view of fusion strategies based on the sequential probability ratio test (sprt). Pattern Recogn Lett 31(9):884–890
Allano L, Garcia-Salicetti S, Dorizzi B (2008) An adaptive multi-biometric incremental fusion strategy in the context of bmec 2007. In: 10th international conference on control, automation, robotics and vision, 2008. ICARCV 2008, pp 1144–1149
Bergamini C, Oliveira L, Koerich A, Sabourin R (2009) Combining different biometric traits with one-class classification. Signal Process 89(11):2117–2127
Brunelli R, Falavigna D (1995) Person identification using multiple cues. IEEE Trans Pattern Anal Mach Intell 17(10):955–966
Dass S, Nandakumar K, Jain A (2005) A principled approach to score level fusion in multimodal biometric systems. In: Audio- and video-based biometric person authentication, Lecture Notes in Computer Science, vol. 3546, pp 1049–1058. Springer (2005)
Dinca LM, Hancke GP (2017) The fall of one, the rise of many: a survey on multi-biometric fusion methods. IEEE Access 5:6247–6289
Edwards T, Hossain MS (2021) Effectiveness of deep learning on serial fusion based biometric systems. IEEE Trans Artif Intell. https://doi.org/10.1109/TAI.2021.3064003
Fierrez-Aguilar J, Ortega-Garcia J, Gonzalez-Rodriguez J, Bigun J (2005) Discriminative multimodal biometric authentication based on quality measures. Pattern Recogn 38(5):777–779
Fierrez-Aguilar J, Nanni L, Ortega-Garcia J, Cappelli R, Maltoni D (2005) Combining multiple matchers for fingerprint verification: a case study in fvc2004. In: Proceedings of the 13th IAPR international conferences on image analysis and processing ICIAP, LNCS, vol 3617, pp 1035–1042. Springer (2005)
Fierrez J, Morales A, Vera-Rodriguez R, Camacho D (2018) Multiple classifiers in biometrics. Part 1: fundamentals and review. Inf Fusion 44: 57–64 (2018)
Fierrez J, Morales A, Vera-Rodriguez R, Camacho D (2018) Multiple classifiers in biometrics. Part 2: Trends and challenges. Inf Fusion 44: 103–112
Griffin P (2004) Optimal biometric fusion for identity verification. Tech. Rep. RDNJ-03-0064, Identix Research
He M, Horng SJ, Fan P, Run RS, Chen RJ, Lai JL, Khan MK, Sentosa KO (2010) Performance evaluation of score level fusion in multimodal biometric systems. Pattern Recogn 43(5):1789–1800
Hossain MS (2016) On finding appropriate reject region in serial fusion based biometric verification. In: 2016 IEEE international multi-disciplinary conference on cognitive methods in situation awareness and decision support (CogSIMA), pp 102–108 (2016). https://doi.org/10.1109/COGSIMA.2016.7497795
Hossain M, Chen J, Rahman K (2018) On enhancing serial fusion based multi-biometric verification system. Appl Intell 48:4824–4833
Hossain M, Balagani K, Phoha V (2012) New impostor score based rejection methods for continuous keystroke verification with weak templates. In: 2012 IEEE fifth international conference on biometrics: theory, applications and systems (BTAS), pp 251–258 (2012)
Hossain M, Balagani K, Phoha V (2020) Effectiveness of symmetric rejection for a secure and user convenient multistage biometric system. Pattern Anal Appl
Intel 64 and ia-32 architectures software developer’s manual, volume 2, instruction set reference, a-z (2014)
Jain A, Nandakumar K, Ross A (2005) Score normalization in multimodal biometric systems. Pattern Recogn 38(12):2270–2285
Kumar A, Zhang D (2006) Personal recognition using hand shape and texture. IEEE Trans Image Process 15(8):2454–2461
Li SZ, Jain A (eds.) DET Curves, pp. 223–223. Springer US, Boston, MA (2009)
Lumini A, Nanni L (2007) When fingerprints are combined with iris - a case study: Fvc 2004 and casia. Int J Netw Secur 4(1):27–34
Lumini A, Nanni L (2017) Overview of the combination of biometric matchers. Inf Fusion 33:71–85
Ma Y, Cukic B, Singh H (2005) A classification approach to multi-biometric score fusion. In: Audio- and video-based biometric person authentication. Lecture Notes in Computer Science, vol 3546, pp 484–493. Springer
Marasco E, Sansone C (2009) Improving the accuracy of a score fusion approach based on likelihood ratio in multimodal biometric systems. In: Image analysis and processing ICIAP 2009, Lecture Notes in Computer Science, vol 5716, pp 509–518 (2009)
Marcialis GL, Roli F, Didaci L (2009) Personal identity verification by serial fusion of fingerprint and face matchers. Pattern Recogn 42(11):2807–2817
Marcialis G, Mastinu P, Roli F (2010) Serial fusion of multi-modal biometric systems. In: 2010 IEEE workshop on biometric measurements and systems for security and medical applications (BIOMS), pp 1 –7 (2010)
Monwar M, Gavrilova M (2008) Fes: a system for combining face, ear and signature biometrics using rank level fusion. In: Fifth international conference on information technology: new generations, 2008. ITNG 2008., pp 922–927 (2008)
Murakami T, Takahashi K, Matsuura K (2012) Towards optimal countermeasures against wolves and lambs in biometrics. In: 2012 IEEE fifth international conference on biometrics: theory, applications and systems (BTAS), pp 69 –76 (2012)
Nandakumar K, Chen Y, Dass SC, Jain A (2008) Likelihood ratio-based biometric score fusion. IEEE Trans Pattern Anal Mach Intell 30:342–347
Nanni L, Lumini A (2009) Ensemble of multiple palmprint representation. Expert Syst Appl 36(3, Part 1), 4485–4490
NIST biometric scores set (BSSR1). Retrieved February 28, 2020, from https://www.nist.gov/itl/iad/image-group/nist-biometric-scores-set-bssr1
Popescu-Bodorin N, Balas VE, Motoc IM (2011) 8-valent fuzzy logic for iris recognition and biometry. In: International symposium on computational intelligence and intelligent informatics (ISCIII), pp 149–154 (2011)
Popescu-Bodorin N, Noaica CM, Penariu P (2015) Iris recognition with 4 or 5 fuzzy sets. In: IFSA-EUSFLAT (2015)
Prabhakar S, Jain AK (2002) Decision-level fusion in fingerprint verification. Pattern Recogn 35(4):861–874
Raja KB, Raghavendra R, Stokkenes M, Busch C (2015) Multi-modal authentication system for smartphones using face, iris and periocular. In: International conference on biometrics (ICB), pp 143–150
Ross A, Jain A (2003) Information fusion in biometrics. Pattern Recogn Lett 24:2115–2125
Ross A, Nandakumar K, Jain A (2006) Handbook of biometrics. Springer, Berlin
Sabri M, Moin M, Razzazi F (2018) A new framework for match on card and match on host quality based multimodal biometric authentication. J Sign Process Syst, pp 1–15
Saevanee H, Clarke N, Furnell S, Biscione V (2015) Cont. user authentication using multi-modal biometrics. Comput Sec. pp 234–246
Sansone C, Vento M (2000) Signature verification: increasing performance by a multi-stage system. Pattern Anal Appl 3:169–181
Sharma R, Das S, Joshi P (2018) Score-level fusion using generalized extreme value distribution and dsmt, for multi-biometric systems. IET Biometrics 7(5):474–481
Snelick R, Uludag U, Mink A, Indovina M, Jain A (2005) Large scale evaluation of multimodal biometric authentication using state-of-the-art systems. IEEE Trans Pattern Anal Mach Intell 27:450–455
Takahashi K, Mimura M, Isobe Y, Seto Y (2004) A secure and user-friendly multimodal biometric system. Proc SPIE 5404:12–19
Tao Q, Veldhuis R (2008) Hybrid fusion for biometrics: combining score-level and decision-level fusion. In: 2008 IEEE computer society conference on computer vision and pattern recognition, workshop on biometrics, pp 1–6
Toh KA, Jiang X, Yau WY (2004) Exploiting global and local decisions for multimodal biometrics verification. IEEE Trans Signal Process 52(10):3059–3072
Ulery B, Hicklin A, Watson C, Fellner W, Hallinan P (2006) Studies of biometric fusion–executive summary. Tech. Rep. 7346, National Institute of Standards and Technology
Yang F, Ma B (2007) A new mixed-mode biometrics information fusion based-on fingerprint, hand-geometry and palm-print. In: Fourth international conference on image and graphics, 2007. ICIG 2007, pp 689–693
Zhang Q, Yin Y, Zhan DC, Peng J (2014) A novel serial multimodal biometrics framework based on semisupervised learning techniques. IEEE Trans Inf Forensics Secur 9(10):1681–1694
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Hossain, M.S., Phoha, V.V. Enhancing performance and user convenience of multi-biometric verification systems. Pattern Anal Applic 24, 1569–1582 (2021). https://doi.org/10.1007/s10044-021-01008-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10044-021-01008-5