Abstract
Cohort selection benefits a biometric system by providing the information collected from non-match templates, whereas fusion benefits a system by combining information collected from different sources or from same source in different ways. The benefits of both approaches are availed here by proposing a cohort selection technique which is exploited prior to fusion and after fusion of matching scores for a face recognition system. Two robust facial features, viz. scale-invariant feature transform and speeded up robust features, are used here. This study presents a novel way of fusion based on cohort selection unlike the traditional levels of fusion (i.e., sensor, feature, match score, rank and decision level fusions). Cohort-based fusion is performed in two different fashions—pre-cohort fusion and post-cohort fusion. In case of early fusion, fusion rules like sum, max, min and average rules are applied before cohort selection to be performed. In contrast, the cohort selection is followed by the fusion in post (or late)-cohort fusion. Union operation is applied as late fusion rule. The matching scores are normalized by T-norm cohort score normalization technique prior to be compared with the threshold value to govern the decision of acceptance by the system. The experiments are carried out on FEI and the Look-alike (IIIT Delhi) face databases. The outcomes of the proposed method are looked to be encouraging and much convincing over non-cohort systems and state-of-the-art methods.
Similar content being viewed by others
References
Best-Rowden, L.; Jain, A.K.: Longitudinal study of automatic face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 40(1), 148–162 (2018)
Pillai, A.; Soundrapandiyan, R.; Satapathy, S.; Satapathy, S.C.; Jung, K.H.; Krishnan, R.: Local diagonal extrema number pattern: a new feature descriptor for face recognition. Future Gener. Comput. Syst. 81, 297–306 (2018)
Goel, T.; Nehra, V.; Vishwakarma, V.P.: An adaptive non-symmetric fuzzy activation function-based extreme learning machines for face recognition. Arab. J. Sci. Eng. 42(2), 805–816 (2017)
Singh, D.; Kumar, V.: Defogging of road images using gain coefficient-based trilateral filter. J. Electronic Imaging 27(1), 013004 (2018)
Singh, D.; Kumar, V.: Single image haze removal using integrated dark and bright channel prior. Mod. Phys. Lett. B 32(04), 1850051 (2018)
Zhang, W.; Xi, Z.H.A.O.; Morvan, J.M.; Chen, L.: Improving Shadow Suppression for Illumination Robust Face Recognition. IEEE Trans. Pattern Anal. Mach. Intell. (2018)
Liu, L.; Liu, B.; Huang, H.; Bovik, A.C.: No-reference image quality assessment based on spatial and spectral entropies. Signal Process. Image Commun. 29(8), 856–863 (2014)
Sun, Y.; Tistarelli, M.; Poh, N.: Picture-specific cohort score normalization for face pair matching. In: 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS), pp. 1–8. IEEE (2013 September)
Garain, J.; Kumar, R.K.; Kisku, D.R.; Sanyal, G.: Selection of user-dependent cohorts using bezier curve for person identification. In: International Conference Image Analysis and Recognition, pp. 566–572. Springer (2016 July)
Sarhan, S.; Alhassan, S.; Elmougy, S.: Multimodal biometric systems: a comparative study. Arab. J. Sci. Eng. 42(2), 443–457 (2017)
Ross, A.; Jain, A.: Fusion techniques in multibiometric systems, from Face Biometrics for Personal Identification. In: Hammound, R.I.; Abidi, B.R.; Abidi, M.A. (eds.) pp. 185–212. Springer, Berlin (2007)
Singh, D.; Garg, D.; Singh Pannu, H.: Efficient landsat image fusion using fuzzy and stationary discrete wavelet transform. Imaging Sci. J. 65(2), 108–114 (2017)
Kisku, D.R.; Rattani A.; Gupta, P.; Sing, J.K.: Biometric sensor image fusion for identity verification: a case study with wavelet-based fusion rules and graph matching. In: IEEE Conference on Technologies for Homeland Security, pp. 433–439 (2009)
Srivastava, S.: Accurate human recognition by score-level and feature-level fusion using palm-phalanges print. Arab. J. Sci. Eng. 43(2), 543–554 (2018)
He, M.; Horng, S.J.; Fan, P.; Run, R.S.; Chen, R.J.; Lai, J.L.; Khan, M.K.; Sentosa, K.O.: Performance evaluation of score level fusion in multimodal biometric systems. Pattern Recogn. 43(5), 1789–1800 (2010)
Kumar, A.; Shekhar, S.: Personal identification using multibiometrics rank-level fusion. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 41(5), 743–752 (2011)
Veeramachaneni, K.; Osadciw, L.; Ross, A.; Srinivas, N.: Decision-level fusion strategies for correlated biometric classifiers. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2008. CVPRW’08, pp. 1–6. IEEE (2008)
Maltoni, D.; Maio, D.; Jain, A.K.; Prabhakar, S.: Handbook of Fingerprint Recognition. Springer, Berlin (2009)
Auckenthaler, R.; Carey, M.; Lloyd-Thomas, H.: Score normalization for text-independent speaker verification systems. Dig. Signal Process. 10(1), 42–54 (2000)
Aggarwal, G.; Ratha, N.K.; Bolle, R.M.: Biometric verification: Looking beyond raw similarity scores. In: 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW’06), pp. 31–31. IEEE (2006 June)
Merati, A.; Poh, N.; Kittler, J.: User-specific cohort selection and score normalization for biometric systems. IEEE Trans. Inf. Forensics Secur. 7(4), 1270–1277 (2012)
Das, P.: A score-level solution to speaker verification using UBM pooling and adaptive cohort selection. In: Advances in Electronics, Communication and Computing, pp. 459—466. Springer, Singapore (2018)
Schroff, F.; Treibitz, T.; Kriegman, D.; Belongie, S.: Pose, illumination and expression invariant pairwise face-similarity measure via doppelganger list comparison. In: 2011 International Conference on Computer Vision, pp. 2494–2501. IEEE (2011 November)
Wagner, A.; Wright, J.; Ganesh, A.; Zhou, Z.; Ma, Y.: Towards a practical face recognition system: Robust registration and illumination by sparse representation. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, p. 3(2009)
Deng, W.; Hu, J.; Guo, J.: Extended SRC: undersampled face recognition via intraclass variant dictionary. IEEE Trans. Pattern Anal. Mach. Intell. 34(9), 1864–1870 (2012)
Yang, X.; Liu, F.; Tian, L.; Li, H.; Jiang, X.: Pseudo-full-space representation based classification for robust face recognition. Signal Process. Image Commun. 60, 64–78 (2018)
Wolf, L.; Hassner, T.; Taigman, Y.: Similarity scores based on background samples. In: Asian Conference on Computer Vision, pp. 88–97. Springer, Berlin (2009 September)
Wolf, L.; Hassner, T.; Taigman, Y.: The one-shot similarity kernel. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 897–902. IEEE (2009 September)
Snelick, R.; Uludag, U.; Mink, A.; Indovina, M.; Jain, A.: Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems. IEEE Trans. Pattern Anal. Mach. Intell. 27(3), 450–455 (2005)
Rattani, A.; Kisku, D.R.; Bicego, M.; Tistarelli, M.: Feature level fusion of face and fingerprint biometrics. In: First IEEE International Conference on Biometrics: Theory, Applications, and Systems, 2007 (BTAS 2007), pp. 1–6. IEEE (2007 September)
Kittler, J.; Hatef, M.; Duin, R.P.; Matas, J.: On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20(3), 226–239 (1998)
Ross, A.; Jain, A.: Information fusion in biometrics. Pattern Recogn. Lett. 24(13), 2115–2125 (2003)
Kisku, D.R.; Gupta, P.; Mehrotra, H.; Sing, J.K.: Multimodal belief fusion for face and ear biometrics. Intell. Inf. Manag. 1(03), 166 (2009)
Kisku, D.R.; Gupta, P.; Sing, J.K.; Nasipuri, M.: Fusion of Gaussian mixture densities for face and ear biometrics using support vector machines. In: International Conference on Future Generation Information Technology, pp. 344–351. Springer, Berlin (2010 December)
Higgins, A.; Bahler, L.; Porter, J.: Speaker verification using randomized phrase prompting. Digital Signal Process. 1(2), 89–106 (1991)
Aggarwal, G.; Ratha, N.K.; Bolle, R.M.; Chellappa, R.: Multi-biometric cohort analysis for biometric fusion. In: 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 5224–5227. IEEE (2008 March)
Taigman, Y.; Yang, M.; Ranzato, M.A.; Wolf, L.: Deepface: Closing the gap to human-level performance in face verification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1701–1708 (2014)
Sun, Y.; Chen, Y.; Wang, X.; Tang, X.: Deep learning face representation by joint identification-verification. In: Advances in neural information processing systems, pp. 1988–1996 (2014)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Bay, H.; Tuytelaars, T.; Van Gool, L.: Surf: speeded up robust features. In: European conference on computer vision, pp. 404–417. Springer, Berlin (2006 May)
Garain, J.; Shah, A.; Kumar, R.K.; Kisku, D.R.; Sanyal, G.: BCP-BCS: best-fit cascaded matching paradigm with cohort selection using bezier curve for individual recognition. In: Chen, C.S.; Lu, J.; Ma, K.K. (eds) Computer Vision—ACCV 2016 Workshops. ACCV 2016. Lecture Notes in Computer Science, vol. 10118. Springer, Cham (2017)
Merati, A.; Poh, N.; Kittler, J.: Extracting discriminative information from cohort models. In: 2010 Fourth IEEE International Conference on Biometrics: Theory Applications and Systems (BTAS), pp. 1–6. IEEE (2010 September)
Casteljau, P.D.F.D.: Outillage Méthodes Calcul. Enveloppe Soleau P, 2108 (1959)
Thomaz, C.E.; Giraldi, G.A.: A new ranking method for principal components analysis and its application to face image analysis. Image Vis. Comput. 28(6), 902–913 (2010)
Lamba, H.; Sarkar, A.; Vatsa, M.; Singh, R.; Noore, A.: Face recognition for look-alikes: a preliminary study. In: 2011 International Joint Conference on Biometrics (IJCB), pp. 1–6. IEEE (2011 October)
Singh, D.; Kumar, V.: Dehazing of remote sensing images using fourth-order partial differential equations based trilateral filter. In: IET Computer Vision (2017)
Singh, D.; Kumar, V.: Modified gain intervention filter based dehazing technique. J. Mod. Opt. 64(20), 2165–2178 (2017)
Soldera, J.; Behaine, C.A.R.; Scharcanski, J.: Customized orthogonal locality preserving projections with soft-margin maximization for face recognition. IEEE Trans. Instrum. Meas. 64(9), 2417–2426 (2015)
Azad, R.; Azad, B.: Optimized method for real-time face recognition system based on PCA and multiclass support vector machine. Adv. Comput. Sci. Int. J. 2(5), 126–132 (2013)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Garain, J., Mishra, S.R., Kumar, R.K. et al. Bezier Cohort Fusion in Doubling States for Human Identity Recognition with Multifaceted Constrained Faces. Arab J Sci Eng 44, 3271–3287 (2019). https://doi.org/10.1007/s13369-018-3501-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13369-018-3501-y