Skip to main content
Log in

Bezier Cohort Fusion in Doubling States for Human Identity Recognition with Multifaceted Constrained Faces

  • Research Article - Computer Engineering and Computer Science
  • Published:
Arabian Journal for Science and Engineering Aims and scope Submit manuscript

Abstract

Cohort selection benefits a biometric system by providing the information collected from non-match templates, whereas fusion benefits a system by combining information collected from different sources or from same source in different ways. The benefits of both approaches are availed here by proposing a cohort selection technique which is exploited prior to fusion and after fusion of matching scores for a face recognition system. Two robust facial features, viz. scale-invariant feature transform and speeded up robust features, are used here. This study presents a novel way of fusion based on cohort selection unlike the traditional levels of fusion (i.e., sensor, feature, match score, rank and decision level fusions). Cohort-based fusion is performed in two different fashions—pre-cohort fusion and post-cohort fusion. In case of early fusion, fusion rules like sum, max, min and average rules are applied before cohort selection to be performed. In contrast, the cohort selection is followed by the fusion in post (or late)-cohort fusion. Union operation is applied as late fusion rule. The matching scores are normalized by T-norm cohort score normalization technique prior to be compared with the threshold value to govern the decision of acceptance by the system. The experiments are carried out on FEI and the Look-alike (IIIT Delhi) face databases. The outcomes of the proposed method are looked to be encouraging and much convincing over non-cohort systems and state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Best-Rowden, L.; Jain, A.K.: Longitudinal study of automatic face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 40(1), 148–162 (2018)

    Article  Google Scholar 

  2. Pillai, A.; Soundrapandiyan, R.; Satapathy, S.; Satapathy, S.C.; Jung, K.H.; Krishnan, R.: Local diagonal extrema number pattern: a new feature descriptor for face recognition. Future Gener. Comput. Syst. 81, 297–306 (2018)

    Article  Google Scholar 

  3. Goel, T.; Nehra, V.; Vishwakarma, V.P.: An adaptive non-symmetric fuzzy activation function-based extreme learning machines for face recognition. Arab. J. Sci. Eng. 42(2), 805–816 (2017)

    Article  Google Scholar 

  4. Singh, D.; Kumar, V.: Defogging of road images using gain coefficient-based trilateral filter. J. Electronic Imaging 27(1), 013004 (2018)

    Article  Google Scholar 

  5. Singh, D.; Kumar, V.: Single image haze removal using integrated dark and bright channel prior. Mod. Phys. Lett. B 32(04), 1850051 (2018)

    Article  MathSciNet  Google Scholar 

  6. Zhang, W.; Xi, Z.H.A.O.; Morvan, J.M.; Chen, L.: Improving Shadow Suppression for Illumination Robust Face Recognition. IEEE Trans. Pattern Anal. Mach. Intell. (2018)

  7. Liu, L.; Liu, B.; Huang, H.; Bovik, A.C.: No-reference image quality assessment based on spatial and spectral entropies. Signal Process. Image Commun. 29(8), 856–863 (2014)

    Article  Google Scholar 

  8. Sun, Y.; Tistarelli, M.; Poh, N.: Picture-specific cohort score normalization for face pair matching. In: 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS), pp. 1–8. IEEE (2013 September)

  9. Garain, J.; Kumar, R.K.; Kisku, D.R.; Sanyal, G.: Selection of user-dependent cohorts using bezier curve for person identification. In: International Conference Image Analysis and Recognition, pp. 566–572. Springer (2016 July)

  10. Sarhan, S.; Alhassan, S.; Elmougy, S.: Multimodal biometric systems: a comparative study. Arab. J. Sci. Eng. 42(2), 443–457 (2017)

    Article  Google Scholar 

  11. Ross, A.; Jain, A.: Fusion techniques in multibiometric systems, from Face Biometrics for Personal Identification. In: Hammound, R.I.; Abidi, B.R.; Abidi, M.A. (eds.) pp. 185–212. Springer, Berlin (2007)

  12. Singh, D.; Garg, D.; Singh Pannu, H.: Efficient landsat image fusion using fuzzy and stationary discrete wavelet transform. Imaging Sci. J. 65(2), 108–114 (2017)

    Article  Google Scholar 

  13. Kisku, D.R.; Rattani A.; Gupta, P.; Sing, J.K.: Biometric sensor image fusion for identity verification: a case study with wavelet-based fusion rules and graph matching. In: IEEE Conference on Technologies for Homeland Security, pp. 433–439 (2009)

  14. Srivastava, S.: Accurate human recognition by score-level and feature-level fusion using palm-phalanges print. Arab. J. Sci. Eng. 43(2), 543–554 (2018)

    Article  Google Scholar 

  15. He, M.; Horng, S.J.; Fan, P.; Run, R.S.; Chen, R.J.; Lai, J.L.; Khan, M.K.; Sentosa, K.O.: Performance evaluation of score level fusion in multimodal biometric systems. Pattern Recogn. 43(5), 1789–1800 (2010)

    Article  MATH  Google Scholar 

  16. Kumar, A.; Shekhar, S.: Personal identification using multibiometrics rank-level fusion. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 41(5), 743–752 (2011)

    Article  Google Scholar 

  17. Veeramachaneni, K.; Osadciw, L.; Ross, A.; Srinivas, N.: Decision-level fusion strategies for correlated biometric classifiers. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2008. CVPRW’08, pp. 1–6. IEEE (2008)

  18. Maltoni, D.; Maio, D.; Jain, A.K.; Prabhakar, S.: Handbook of Fingerprint Recognition. Springer, Berlin (2009)

    Book  MATH  Google Scholar 

  19. Auckenthaler, R.; Carey, M.; Lloyd-Thomas, H.: Score normalization for text-independent speaker verification systems. Dig. Signal Process. 10(1), 42–54 (2000)

    Article  Google Scholar 

  20. Aggarwal, G.; Ratha, N.K.; Bolle, R.M.: Biometric verification: Looking beyond raw similarity scores. In: 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW’06), pp. 31–31. IEEE (2006 June)

  21. Merati, A.; Poh, N.; Kittler, J.: User-specific cohort selection and score normalization for biometric systems. IEEE Trans. Inf. Forensics Secur. 7(4), 1270–1277 (2012)

    Article  Google Scholar 

  22. Das, P.: A score-level solution to speaker verification using UBM pooling and adaptive cohort selection. In: Advances in Electronics, Communication and Computing, pp. 459—466. Springer, Singapore (2018)

  23. Schroff, F.; Treibitz, T.; Kriegman, D.; Belongie, S.: Pose, illumination and expression invariant pairwise face-similarity measure via doppelganger list comparison. In: 2011 International Conference on Computer Vision, pp. 2494–2501. IEEE (2011 November)

  24. Wagner, A.; Wright, J.; Ganesh, A.; Zhou, Z.; Ma, Y.: Towards a practical face recognition system: Robust registration and illumination by sparse representation. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, p. 3(2009)

  25. Deng, W.; Hu, J.; Guo, J.: Extended SRC: undersampled face recognition via intraclass variant dictionary. IEEE Trans. Pattern Anal. Mach. Intell. 34(9), 1864–1870 (2012)

    Article  Google Scholar 

  26. Yang, X.; Liu, F.; Tian, L.; Li, H.; Jiang, X.: Pseudo-full-space representation based classification for robust face recognition. Signal Process. Image Commun. 60, 64–78 (2018)

    Article  Google Scholar 

  27. Wolf, L.; Hassner, T.; Taigman, Y.: Similarity scores based on background samples. In: Asian Conference on Computer Vision, pp. 88–97. Springer, Berlin (2009 September)

  28. Wolf, L.; Hassner, T.; Taigman, Y.: The one-shot similarity kernel. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 897–902. IEEE (2009 September)

  29. Snelick, R.; Uludag, U.; Mink, A.; Indovina, M.; Jain, A.: Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems. IEEE Trans. Pattern Anal. Mach. Intell. 27(3), 450–455 (2005)

    Article  Google Scholar 

  30. Rattani, A.; Kisku, D.R.; Bicego, M.; Tistarelli, M.: Feature level fusion of face and fingerprint biometrics. In: First IEEE International Conference on Biometrics: Theory, Applications, and Systems, 2007 (BTAS 2007), pp. 1–6. IEEE (2007 September)

  31. Kittler, J.; Hatef, M.; Duin, R.P.; Matas, J.: On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20(3), 226–239 (1998)

    Article  Google Scholar 

  32. Ross, A.; Jain, A.: Information fusion in biometrics. Pattern Recogn. Lett. 24(13), 2115–2125 (2003)

    Article  Google Scholar 

  33. Kisku, D.R.; Gupta, P.; Mehrotra, H.; Sing, J.K.: Multimodal belief fusion for face and ear biometrics. Intell. Inf. Manag. 1(03), 166 (2009)

    Google Scholar 

  34. Kisku, D.R.; Gupta, P.; Sing, J.K.; Nasipuri, M.: Fusion of Gaussian mixture densities for face and ear biometrics using support vector machines. In: International Conference on Future Generation Information Technology, pp. 344–351. Springer, Berlin (2010 December)

  35. Higgins, A.; Bahler, L.; Porter, J.: Speaker verification using randomized phrase prompting. Digital Signal Process. 1(2), 89–106 (1991)

    Article  Google Scholar 

  36. Aggarwal, G.; Ratha, N.K.; Bolle, R.M.; Chellappa, R.: Multi-biometric cohort analysis for biometric fusion. In: 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 5224–5227. IEEE (2008 March)

  37. Taigman, Y.; Yang, M.; Ranzato, M.A.; Wolf, L.: Deepface: Closing the gap to human-level performance in face verification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1701–1708 (2014)

  38. Sun, Y.; Chen, Y.; Wang, X.; Tang, X.: Deep learning face representation by joint identification-verification. In: Advances in neural information processing systems, pp. 1988–1996 (2014)

  39. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  40. Bay, H.; Tuytelaars, T.; Van Gool, L.: Surf: speeded up robust features. In: European conference on computer vision, pp. 404–417. Springer, Berlin (2006 May)

  41. Garain, J.; Shah, A.; Kumar, R.K.; Kisku, D.R.; Sanyal, G.: BCP-BCS: best-fit cascaded matching paradigm with cohort selection using bezier curve for individual recognition. In: Chen, C.S.; Lu, J.; Ma, K.K. (eds) Computer Vision—ACCV 2016 Workshops. ACCV 2016. Lecture Notes in Computer Science, vol. 10118. Springer, Cham (2017)

  42. Merati, A.; Poh, N.; Kittler, J.: Extracting discriminative information from cohort models. In: 2010 Fourth IEEE International Conference on Biometrics: Theory Applications and Systems (BTAS), pp. 1–6. IEEE (2010 September)

  43. Casteljau, P.D.F.D.: Outillage Méthodes Calcul. Enveloppe Soleau P, 2108 (1959)

  44. Thomaz, C.E.; Giraldi, G.A.: A new ranking method for principal components analysis and its application to face image analysis. Image Vis. Comput. 28(6), 902–913 (2010)

    Article  Google Scholar 

  45. Lamba, H.; Sarkar, A.; Vatsa, M.; Singh, R.; Noore, A.: Face recognition for look-alikes: a preliminary study. In: 2011 International Joint Conference on Biometrics (IJCB), pp. 1–6. IEEE (2011 October)

  46. Singh, D.; Kumar, V.: Dehazing of remote sensing images using fourth-order partial differential equations based trilateral filter. In: IET Computer Vision (2017)

  47. Singh, D.; Kumar, V.: Modified gain intervention filter based dehazing technique. J. Mod. Opt. 64(20), 2165–2178 (2017)

    Article  Google Scholar 

  48. Soldera, J.; Behaine, C.A.R.; Scharcanski, J.: Customized orthogonal locality preserving projections with soft-margin maximization for face recognition. IEEE Trans. Instrum. Meas. 64(9), 2417–2426 (2015)

    Article  Google Scholar 

  49. Azad, R.; Azad, B.: Optimized method for real-time face recognition system based on PCA and multiclass support vector machine. Adv. Comput. Sci. Int. J. 2(5), 126–132 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jogendra Garain.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Garain, J., Mishra, S.R., Kumar, R.K. et al. Bezier Cohort Fusion in Doubling States for Human Identity Recognition with Multifaceted Constrained Faces. Arab J Sci Eng 44, 3271–3287 (2019). https://doi.org/10.1007/s13369-018-3501-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13369-018-3501-y

Keywords

Navigation