Skip to main content
SpringerLink
Log in

FLBP: Fechner local binary pattern for face representation

  • Original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Most images are ultimately observed and interpreted by humans, so the ideal image descriptor should take into account the effects of human psychology and psychophysics. In this paper, we develop a novel feature descriptor named Fechner local binary pattern (FLBP) based on the well-known psychological law, Fechner’s law. FLBP describes images using mental perception, which is a logarithmic function of the stimulus change, allowing for a more detailed and hierarchical representation of the represented image. In addition, considering the structural features of the face, we adjusted the size of the blocks so that it can be large enough to include the complete face organ(s), since these face organs, like the eyes, nose, and mouth contain the most discriminative features. The addition of changeable size blocks effectively reduces the effects of noise and illumination. Experiments on four face image databases demonstrate the effectiveness of the proposed FLBP method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

Data availability

The processed data required to reproduce these findings cannot be shared at this time as the data also forms part of an ongoing study.

References

  1. Swets, D.L., Weng, J.J.: Using discriminant eigenfeatures for image retrieval. IEEE Trans. Patt. Anal. Mach. Intell. 18(8), 831–836 (1996)

    Article  Google Scholar 

  2. Turhal, U., Günay Yılmaz, A., Nabiyev, V.: A new face presentation attack detection method based on face-weighted multi-color multi-level texture features. Vis. Comput. (2023). https://doi.org/10.1007/s00371-023-02866-2

    Article  Google Scholar 

  3. Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Patt. Anal. Mach. Intell. 24(7), 971–987 (2002)

    Article  Google Scholar 

  4. Tan, X.Y., Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans. Image Process 19(6), 1635–1650 (2010)

    Article  MathSciNet  Google Scholar 

  5. Huang, D., Ardabilian, M., Wang, Y., Chen, L.: 3-D face recognition using eLBP-based facial description and local feature hybrid matching. IEEE Trans. IFS 7(5), 1551–1565 (2012)

    Google Scholar 

  6. Liao, S., Law, M.W.K., Chung, A.C.S.: Dominant local binary patterns for texture classification. IEEE Trans. Image Process. 18(5), 1107–1118 (2009)

    Article  MathSciNet  Google Scholar 

  7. Shu, X., Song, Z., Shi, J., Huang, S., Wu, X.J.: Multiple channels local binary pattern for color texture representation and classification. Sign. Process.: Image Commun. 98, 116392 (2021)

    Google Scholar 

  8. Huang, D., Shan, C., et al.: Local binary patterns and its application to facial image analysis: a survey, IEEE Trans. Syst. Man. Cybern. Part C: Appl. Rev. 41(6), 765–781 (2011)

    Article  Google Scholar 

  9. Guo, C., Liang, J., Zhan, G., Liu, Z., et al.: Extended local binary patterns for efficient and robust spontaneous facial micro-expression recognition. IEEE Access 7, 174517–174530 (2019)

    Article  Google Scholar 

  10. Singh, C., Walia, E., Kaur, K.P.: Color texture description with novel local binary patterns for effective image retrieval. Patt. Recogn. 76, 50–68 (2018)

    Article  Google Scholar 

  11. Wu, X., Sun, J.: Joint-scale LBP: a new feature descriptor for texture classification. Vis. Comput. 33, 317–329 (2017)

    Article  Google Scholar 

  12. Zhang, J., Liang, J., Zhao, H.: Local energy pattern for texture classification using selfadaptive quantization thresholds. IEEE Trans. Image Process. 22(1), 31–42 (2012)

    Article  Google Scholar 

  13. Kayhan, N., Fekri-Ershad, S.: Content based image retrieval based on weighted fusion of texture and color features derived from modified local binary patterns and local neighborhood difference patterns. Multimed. Tools Appl. 80(21), 32763–32790 (2021)

    Article  Google Scholar 

  14. Liao, S., Zhu, X., Lei, Z., Zhang, L., Li, S.Z.: Learning multiscale block local binary patterns for face recognition. In: Proceedings of the International Conference on Biometrics (ICB2007), pp. 828–837 (2007)

  15. Vu, H.N., Nguyen, M.H., Pham, C.: Masked face recognition with convolutional neural networks and local binary patterns. Appl. Intell. 52(5), 5497–5512 (2022)

    Article  Google Scholar 

  16. Jain, A.K.: Fundamentals of Digital Image Processing. Prentice-Hall Inc (1989)

    Google Scholar 

  17. Chen, J., Shan, S., He, C., Zhao, G., Pietikainen, M., Chen, X., Gao, W.: WLD: a ro-bust local image descriptor. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1705–1719 (2010)

    Article  Google Scholar 

  18. Banerjee, A., Das, N., Santosh, K.C.: Weber local descriptor for image analysis and recognition: a survey. Vis. Comput. 38, 321–343 (2022)

    Article  Google Scholar 

  19. Li, S., Gong, D., Yuan, Y.: Face recognition using weber local descriptors. Neurocomputing 122, 272–283 (2013)

    Article  Google Scholar 

  20. Wang, B., Li, W., Yang, W., Liao, Q.: Illumination normalization based on Weber’s law with application to face recognition. IEEE Signal Process. Lett. 18(8), 462–465 (2011)

    Article  Google Scholar 

  21. Bhatt, H.S., Bharadwaj, S., Singh, R., Vatsa, M.: Memetically optimized MCWLD for matching sketches with digital face images. IEEE Trans. Inf. Forens. Secur. 7(5), 1522–1535 (2012)

    Article  Google Scholar 

  22. Han, X.H., Chen, Y.W., Xu, G.: High-order statistics of weber local descriptors for image representation. IEEE Trans. Cybern. 45(6), 1180–1193 (2015)

    Article  Google Scholar 

  23. Liu, F., Tang, Z., Tang, J.: WLBP: weber local binary pattern for local image description. Neurocomputing 120, 325–335 (2013)

    Article  Google Scholar 

  24. Sun, S., Zhao, L., Yang, S.: Gabor weber local descriptor for bovine iris recognition. Math. Probl. Eng. 10, 15 (2013)

    MathSciNet  Google Scholar 

  25. Li, J., Sang, N., Gao, C.: Log-Gabor weber descriptor for face recognition. In: Jawahar, C., Shan, S. (eds.) Computer Vision-ACCV 2014 Workshops, pp. 541–553. Springer, Cham (2015)

    Chapter  Google Scholar 

  26. Banerjee, A., Das, N., Nasipuri, M.: Texture Classification Using Deep Neural Network Based on Rotation Invariant Weber Local Descriptor. Springer, Singapore (2016)

    Google Scholar 

  27. Lan, R., Zhou, Y., Tang, Y.Y.: Quaternionic weber local descriptor of color images. IEEE Trans. Circuits Syst. Video Technol. 27(2), 261–274 (2017)

    Article  Google Scholar 

  28. Yang, G., Fang, B., Tang, Y.Y.: Robust face recognition with multi-scale Weber local descriptor. Int. J. Wavel. Multiresolut. Inf. Process. 15(05), 1750052 (2017)

    Article  MathSciNet  Google Scholar 

  29. Khan, S.A., Hussain, A., Usman, M.: Reliable facial expression recognition for multi-scale images using weber local binary image based cosine transform features. Multimed. Tools Appl. 77(1), 1133–1165 (2018)

    Article  Google Scholar 

  30. Tran, C.K., Tseng, C.D., Lee, T.F.: Improving the face recognition accuracy under varying illumination conditions for local binary patterns and local ternary patterns based on weber-face and singular value decomposition. In: 2016 3rd International Conference on Green Technology and Sustainable Development (GTSD), pp:5–9, IEEE. (2016)

  31. Yang, W., Zhang, X., Li, J.: A local multiple patterns feature descriptor for face recognition. Neurocomputing 373, 109–122 (2020)

    Article  Google Scholar 

  32. Xia, Z., Yuan, C., Lv, R., Sun, X., Xiong, N.N., Shi, Y.Q.: A novel weber local binary descriptor for fingerprint liveness detection. IEEE Trans. Syst. Man. Cybern. Syst. 50(4), 1526–1536 (2018)

    Article  Google Scholar 

  33. Thurstone, L.L.: A law of comparative judgment. Psycol. Rev 34(4), 273–286 (1927)

    Article  Google Scholar 

  34. Shrivastava, N., Tyagi, V.: An effective scheme for image texture classification based on binary local structure pattern. Vis. Comput. 30, 1223–1232 (2014)

    Article  Google Scholar 

  35. Ruyi, B.: A general image orientation detection method by feature fusion. Vis. Comput. (2023). https://doi.org/10.1007/s00371-023-02782-5

    Article  Google Scholar 

  36. Phillips, P.J., Moon, H., Rizvi, S.A., Rauss, P.J.: The FERET evaluation methodology for face recognition algorithms. IEEE Trans. Patt. Anal. Machine Intell. 22(10), 1090–1104 (2000)

    Article  Google Scholar 

  37. Phillips, P.J.: The facial recognition technology (FERET) database, http://www.itl.nist.gov/iad/humanid/feret/feret_master.html, (2004)

  38. Martinez, A.M., Benavente, R.: The AR face database, http://rvl1.ecn.purdue.edu/aleix/aleix_face_DB.html, (2003)

  39. Martinez, A.M., Benavente, R.: The AR Face Database, The Ohio State University, CVC Technical Report #24, (1998)

  40. Lee, K.C., Ho, J., Driegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Patt. Anal. Mach. Intell. 27(5), 684–698 (2005)

    Article  Google Scholar 

Download references

Acknowledgements

In addition, the authors would like to thank the anonymous reviewers for their critical and constructive comments and suggestions. This work was partially supported by the National Natural Science Foundation of China under Grant No. 61773128.

Author information

Authors and Affiliations

  1. Information and Communication Engineering, Guangzhou Maritime University, Guangzhou, 510000, People’s Republic of China

    Jie Xu

  2. Faculty of Automation, Guangdong University of Technology, Guangzhou, 510006, People’s Republic of China

    Jun Gao

Authors
  1. Jie Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jun Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jie Xu.

Ethics declarations

Ethics approval

The authors declare that they have no conflict of interest. All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. This article does not contain any studies with animals performed by any of the authors. Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, J., Gao, J. FLBP: Fechner local binary pattern for face representation. Vis Comput 40, 3487–3502 (2024). https://doi.org/10.1007/s00371-023-03047-x

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-023-03047-x

Keywords

Search

Navigation