Skip to main content
SpringerLink
Log in

Novel and robust color texture descriptors for color face recognition

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

We propose novel and robust color texture descriptors which are based on the relative dominance of the discriminative power of the color components in a multi-channel representation of a color model. LBP-like operators are derived by fitting linear regression models in 2D color subspaces RG, and GB of a 3D RGB color space keeping in view of the relative dominance of G component over the R, and B components. The linear regression models yield three operators LBPLRG, LBPLGB, and LBPLCGB, which are jointly referred to as local binary patterns using lines (LBPL). The features of the three operators are combined to form feature vectors. To further boost the performance, the LBPL features are combined with the existing local binary pattern of color images (LBPC). Experimental results demonstrate the superiority of the proposed operators, LBPL and LBPL + LBPC over the state-of-the-art LBP-, SRC- and under certain conditions over CNN-based approaches across various classifiers and they are found to be robust to many variations in the face images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Aghdam OA, Bozorgtabar B, Ekenel HK, Thiran J-P (2019) Exploring factors for improving low resolution face recognition. In: CVPR Workshops. pp 2363–2370

  2. Ahonen T, Hadid A, Pietikäinen M (2004) Face recognition with local binary patterns. In: European conference on computer vision. Springer, pp 469–481

  3. Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041. https://doi.org/10.1109/TPAMI.2006.244

    Article  MATH  Google Scholar 

  4. Baudat G, Anouar F (2000) Generalized discriminant analysis using a kernel approach. Neural Comput 12(10):2385–2404

    Article  Google Scholar 

  5. Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  6. Bucak SS, Jin R, Jain AK (2013) Multiple kernel learning for visual object recognition: a review. IEEE Trans Pattern Anal Mach Intell 36(7):1354–1369

    Google Scholar 

  7. Chen Z, Zuo W, Hu Q, Lin L (2015) Kernel sparse representation for time series classification. Inf Sci 292:15–26

    Article  MathSciNet  MATH  Google Scholar 

  8. Choi JY, Ro YM, Plataniotis KN (2009) Color face recognition for degraded face images. IEEE Trans Syst Man Cybern B 39(5):1217–1230

    Article  Google Scholar 

  9. Choi JY, Ro YM, Plataniotis KN (2012) Color local texture features for color face recognition. IEEE Trans Image Process 21(3):1366–1380

    Article  MathSciNet  MATH  Google Scholar 

  10. Deng W, Hu J, Guo J (2012) Extended SRC: undersampled face recognition via intraclass variant dictionary. IEEE Trans Pattern Anal Mach Intell 34(9):1864–1870

    Article  Google Scholar 

  11. Deng W, Hu J, Guo J (2013) In defense of sparsity based face recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 399–406

  12. Fan Z, Wei C (2020) Fast kernel sparse representation based classification for undersampling problem in face recognition. Multimed Tools Appl 79(11):7319–7337

    Article  Google Scholar 

  13. Fan Z, Zhang D, Wang X, Zhu Q, Wang Y (2018) Virtual dictionary based kernel sparse representation for face recognition. Pattern Recogn 76:1–13

    Article  Google Scholar 

  14. Gao S, Tsang IW-H, Chia L-T (2012) Sparse representation with kernels. IEEE Trans Image Process 22(2):423–434

    MathSciNet  MATH  Google Scholar 

  15. Gao S, Chia L-T, Tsang IW-H, Ren Z (2014) Concurrent single-label image classification and annotation via efficient multi-layer group sparse coding. IEEE Trans Multimed 16(3):762–771

    Article  Google Scholar 

  16. Georgia Tech face database. http://www.anefian.com/research/face_reco.htm

  17. Guo Y, Xu Z (2008) Local Gabor phase difference pattern for face recognition. In: 2008 19th International Conference on Pattern Recognition. IEEE, pp 1–4. https://doi.org/10.1109/ICPR.2008.4761167

  18. Guo Z, Zhang L, Zhang D (2010) A completed modeling of local binary pattern operator for texture classification. IEEE Trans Image Process 19(6):1657–1663

    Article  MathSciNet  MATH  Google Scholar 

  19. Hafed ZM, Levine MD (2001) Face recognition using the discrete cosine transform. Int J Comput Vis 43(3):167–188

    Article  MATH  Google Scholar 

  20. He X, Yan S, Hu Y, Niyogi P, Zhang H-J (2005) Face recognition using laplacian faces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340

    Article  Google Scholar 

  21. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 770-778

  22. Huang GB, Mattar M, Berg T, Learned-Miller E (2008) Labeled faces in the wild: a database forstudying face recognition in unconstrained environments. In: Workshop on faces in ‘real-life’ images: detection, alignment, and recognition

  23. Huang K-K, Dai D-Q, Ren C-X, Lai Z-R (2016) Learning kernel extended dictionary for face recognition. IEEE Trans Neural Netw Learn Syst 28(5):1082–1094

    Article  Google Scholar 

  24. Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 4700–4708

  25. Iandola FN, Han S, Moskewicz MW, Ashraf K, Dally WJ, Keutzer K (2016) SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and < 0.5 MB model size. arXiv preprint arXiv:160207360

  26. Khan SA, Usman M, Riaz N (2015) Face recognition via optimized features fusion. J Intell Fuzzy Syst 28(4):1819–1828

    Article  Google Scholar 

  27. Khan SA, Ishtiaq M, Nazir M, Shaheen M (2018) Face recognition under varying expressions and illumination using particle swarm optimization. J Comput Sci 28:94–100

    Article  Google Scholar 

  28. Lee SH, Choi JY, Ro YM, Plataniotis KN (2012) Local color vector binary patterns from multichannel face images for face recognition. IEEE Trans Image Process 21(4):2347–2353

    Article  MathSciNet  MATH  Google Scholar 

  29. Leng L, Zhang J (2012) Palmhash code for palmprint verification and protection. In: 2012 25th IEEE Canadian conference on electrical and computer Engineering (CCECE). IEEE, pp 1–4. https://doi.org/10.1109/CCECE.2012.6334853

  30. Leng L, Zhang J, Khan MK, Chen X, Alghathbar K (2010) Dynamic weighted discrimination power analysis: a novel approach for face and palmprint recognition in DCT domain. Int J Phys Sci 5(17):2543–2554. https://doi.org/10.5897/IJPS.9000180

    Article  Google Scholar 

  31. Leng L, Zhang J, Chen G, Khan MK, Alghathbar K (2011) Two-directional two-dimensional random projection and its variations for face and palmprint recognition. In: International conference on computational science and its applications. Springer, pp 458–470

  32. Leng L, Zhang S, Bi X, Khan MK (2012) Two-dimensional cancelable biometric scheme. In: 2012 International Conference on Wavelet Analysis and Pattern Recognition. IEEE, pp 164–169

  33. Leng L, Li M, Teoh ABJ (2013) Conjugate 2DPalmHash code for secure palm-print-vein verification. In: 2013 6th International congress on image and signal processing (CISP). IEEE, pp 1705–1710

  34. Leng L, Li M, Kim C, Bi X (2017) Dual-source discrimination power analysis for multi-instance contactless palmprint recognition. Multimed Tools Appl 76(1):333–354. https://doi.org/10.1007/s11042-015-3058-7

  35. Li J, Sang N, Gao C (2016) Completed local similarity pattern for color image recognition. Neurocomputing 182:111–117

    Article  Google Scholar 

  36. Liao W-H (2010) Region description using extended local ternary patterns. In: 2010 20th International Conference on Pattern Recognition. IEEE, pp 1003–1006. https://doi.org/10.1109/ICPR.2010.251

  37. Liu C (2008) Learning the uncorrelated, independent, and discriminating color spaces for face recognition. IEEE Trans Inf Forensic Secur 3(2):213–222

    Article  Google Scholar 

  38. Liu P, Guo J-M, Chamnongthai K, Prasetyo H (2017) Fusion of color histogram and LBP-based features for texture image retrieval and classification. Inf Sci 390:95–111

    Article  Google Scholar 

  39. Lu Z, Jiang X, Kot A (2018) Color space construction by optimizing luminance and chrominance components for face recognition. Pattern Recogn 83:456–468

    Article  Google Scholar 

  40. Lu Z, Jiang X, Kot A (2018) Deep coupled resnet for low-resolution face recognition. IEEE Signal Proc Lett 25(4):526–530

    Article  Google Scholar 

  41. Mäenpää T, Pietikäinen M (2004) Classification with color and texture: jointly or separately? Pattern Recogn 37(8):1629–1640

    Article  Google Scholar 

  42. Maenpaa T, Pietikainen M, Viertola J (2002) Separating color and pattern information for color texture discrimination. In: Object recognition supported by user interaction for service robots. IEEE, pp 668–671. https://doi.org/10.1109/ICPR.2002.1044840

  43. Martinez AM (1998) The AR face database. CVC Technical Report24

  44. Munir A, Hussain A, Khan SA, Nadeem M, Arshid S (2018) Illumination invariant facial expression recognition using selected merged binary patterns for real world images. Optik 158:1016–1025

    Article  Google Scholar 

  45. Nanni L, Lumini A, Brahnam S (2012) Survey on LBP based texture descriptors for image classification. Expert Syst Appl 39(3):3634–3641

    Article  Google Scholar 

  46. Nguyen H-T, Caplier A (2015) Local patterns of gradients for face recognition. IEEE Trans Inf Forensic Secur 10(8):1739–1751

    Article  Google Scholar 

  47. Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    Article  MATH  Google Scholar 

  48. Perlibakas V (2004) Distance measures for PCA-based face recognition. Pattern Recogn Lett 25(6):711–724

    Article  Google Scholar 

  49. Pietikäinen M, Mäenpää T, Viertola J (2002) Color texture classification with color histograms and local binary patterns. In: Workshop on Texture Analysis in Machine Vision. Citeseer

  50. Ramesha K, Raja K (2011) Face recognition system using discrete wavelet transform and fast PCA. In: International Conference on Advances in Information Technology and Mobile Communication. Springer, pp 13–18. https://doi.org/10.1007/978-3-642-20573-6_3

  51. Ranade SK, Anand S (2021) Color face recognition using normalized-discriminant hybrid color space and quaternion moment vector features. Multimed Tools Appl 1–24. https://doi.org/10.1007/s11042-020-10244-6

  52. Sao AK, Yegnanarayana B (2010) On the use of phase of the Fourier transform for face recognition under variations in illumination. SIViP 4(3):353–358

    Article  MATH  Google Scholar 

  53. Shakoor MH, Boostani R (2018) Radial mean local binary pattern for noisy texture classification. Multimed Tools Appl 77(16):21481–21508

    Article  Google Scholar 

  54. Singh C, Walia E, Kaur KP (2018) Color texture description with novel local binary patterns for effective image retrieval. Pattern Recogn 76:50–68

    Article  Google Scholar 

  55. Song L, Gong D, Li Z, Liu C, Liu W (2019) Occlusion robust face recognition based on mask learning with pairwise differential siamese network. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp 773–782

  56. Sotoodeh M, Moosavi MR, Boostani R (2019) A novel adaptive LBP-based descriptor for color image retrieval. Expert Syst Appl 127:342–352

    Article  Google Scholar 

  57. Sun Z, Ampornpunt N, Varma M, Vishwanathan S (2010) Multiple kernel learning and the SMO algorithm. Adv Neural Inf Proces Syst 23:2361–2369

    Google Scholar 

  58. Sun Y, Cheng C, Zhang Y, Zhang C, Zheng L, Wang Z, Wei Y (2020) Circle loss: a unified perspective of pair similarity optimization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp 6398–6407

  59. Swets DL, Weng JJ (1996) Using discriminant eigenfeatures for image retrieval. IEEE Trans Pattern Anal Mach Intell 18(8):831–836

    Article  Google Scholar 

  60. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 1–9

  61. Topi M, Matti P, Timo O (2000) Texture classification by multi-predicate local binary pattern operators. In: Proceedings 15th International Conference on Pattern Recognition. ICPR-2000. IEEE, pp 939–942. https://doi.org/10.1109/ICPR.2000.903699

  62. Topi M, Timo O, Matti P, Maricor S (2020) Robust texture classification by subsets of local binary patterns. In: Proceedings 15th International Conference on Pattern Recognition. ICPR-2000. IEEE, pp 935–938. https://doi.org/10.1109/ICPR.2000.903698

  63. Torres L, Reutter J-Y, Lorente L (1999) The importance of the color information in face recognition. In: Image Processing, 1999. ICIP 99. Proceedings. 1999 International Conference on, IEEE, pp 627–631

  64. Turk MA, Pentland AP (1991) Face recognition using eigenfaces. In: Computer vision and pattern recognition, 1991. Proceedings CVPR'91., IEEE Computer Society Conference on. IEEE, pp 586–591

  65. Wang H-Y, Wu X-J (2005) Weighted PCA space and its application in face recognition. In: 2005 International Conference on Machine Learning and Cybernetics. IEEE, pp 4522–4527. https://doi.org/10.1109/ICMLC.2005.1527735

  66. Wang Z, Miao Z, Wu QJ, Wan Y, Tang Z (2014) Low-resolution face recognition: a review. Vis Comput 30(4):359–386

    Article  Google Scholar 

  67. Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2008) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227

    Article  Google Scholar 

  68. Wu F, Jing X-Y, Dong X, Ge Q, Wu S, Liu Q, Yue D, Yang J-Y (2016) Uncorrelated multi-set feature learning for color face recognition. Pattern Recogn 60:630–646

    Article  Google Scholar 

  69. Xu Y, Jin Z (2008) Down-sampling face images and low-resolution face recognition. In: 2008 3rd international conference on innovative computing information and control. IEEE, pp 392–392. https://doi.org/10.1109/ICICIC.2008.234

  70. Yang J, Zhang D, Frangi AF, Yang J-y (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Pattern Anal Mach Intell 26(1):131–137

    Article  Google Scholar 

  71. Yang J, Liu C, Yang J-y (2010) What kind of color spaces is suitable for color face recognition? Neurocomputing 73(10-12):2140–2146

    Article  Google Scholar 

  72. Yin J, Liu Z, Jin Z, Yang W (2012) Kernel sparse representation based classification. Neurocomputing 77(1):120–128

    Article  Google Scholar 

  73. Yip A, Sinha P (2001) Role of color in face recognition.

  74. Zhang D, Lu G (2003) Evaluation of similarity measurement for image retrieval. In: International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003. IEEE, pp 928–931

  75. Zhang D, Zhou Z-H (2005) (2D) 2PCA: two-directional two-dimensional PCA for efficient face representation and recognition. Neurocomputing 69(1–3):224–231. https://doi.org/10.1016/j.neucom.2005.06.004

    Article  Google Scholar 

  76. Zhang L, Chu R, Xiang S, Liao S, Li SZ (2007) Face detection based on multi-block lbp representation. In: International conference on biometrics. Springer, pp 11–18

  77. Zhang B, Gao Y, Zhao S, Liu J (2009) Local derivative pattern versus local binary pattern: face recognition with high-order local pattern descriptor. IEEE Trans Image Process 19(2):533–544. https://doi.org/10.1109/TIP.2009.2035882

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Punjabi University, Patiala, 147002, India

    Chandan Singh & Shahbaz Majeed

Authors
  1. Chandan Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shahbaz Majeed
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chandan Singh.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

ESM 1

(DOCX 88 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, C., Majeed, S. Novel and robust color texture descriptors for color face recognition. Multimed Tools Appl 81, 21313–21347 (2022). https://doi.org/10.1007/s11042-022-12625-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12625-5

Keywords

Search

Navigation