Skip to main content
SpringerLink
Log in

A novel framework based on wavelet transform and principal component for face recognition under varying illumination

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

One of the most primitive problems in face recognition is illumination variation, which is of significance for image processing and pattern recognition. Existing studies concentrate on the wavelet transform (WT) without elaborately considering high-frequency information and most do not efficiently tackle a computation explosion of facial dimensions in classification. Therefore, a novel framework based on wavelet transform and principal component is proposed to improve the accuracy under illumination variation in this paper. In the proposed framework, low-frequency sub-band (LFSB) and high-frequency sub-band (HFSB) images from wavelet transform are simultaneously enhanced and denoised, unlike previous studies that usually cause loss of details due to less consideration of HFSB. For LFSB image, a multiple scale Retinex-based steering kernel is designed to enhance more details, and then an adaptive strategy of gamma correction is developed to automatically expand gray-dynamic range. For HFSB image, a non-local mean filtering is established to suppress the noise and subsequently, more image details are preserved by local of mean of local variance. Moreover, the principal component technique based Fisherface and virtual auxiliary sample strategy is developed in order to overcome the computation explosion of facial dimensions, in which a sample strategy with interpolation mechanism is employed to avoid the complicated singularity and Fisherface analysis is further applied to extract features and dimensionality reduction. In addition, the particle swarm optimization-neural network (PSO-NN) is employed to perform classification in the framework. Experimental results prove that the proposed framework can effectively obtain the robust visual effect under varying illumination and significantly improve the recognition performance in comparison to existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26

Similar content being viewed by others

References

  1. Liu T, Mi JX, Liu Y, Li C (2016) Robust face recognition via sparse boosting representation. Neurocomputing 214:994–957

    Article  Google Scholar 

  2. Cheng EJ, Chou KP, Rajora S, Jin BH, Tanveer M, Lin CT, Young KY, Lin WC, Prasad M (2019) Deep sparse representation classifier for facial recognition and detection system. Pattern Recogn Lett 125:71–77

    Article  Google Scholar 

  3. Cheng EJ, Prasad M, Puthal D, Sharma N, Prasad OK, Chin PH, Lin CT, Blumenstein M (2017) Deep learning based face recognition with sparse representation classification. In: Liu D, Xie S, Li Y, Zhao D, El-Alfy ES (eds) Neural information processing. ICONIP 2017. Lecture Notes in Computer Science, vol 10636. Springer, Cham. https://doi.org/10.1007/978-3-319-70090-8_67

  4. Chou KP, Li DL, Prasad M, Pratama M, Su SY, Lu HY, Lin CT, Lin WC (2017) Robust facial alignment for face recognition. In: Liu D, Xie S, Li Y, Zhao D, El-Alfy ES (eds) Neural information processing. ICONIP 2017. Lecture Notes in Computer Science, vol 10636. Springer, Cham. https://doi.org/10.1007/978-3-319-70090-8_51

  5. Ling HF, Wu JY, Huang JR, Chen JZ, Li P (2020) Attention-based convolutional neural network for deep face recognition. Multimed Tools Appl 79:5595–5616

    Article  Google Scholar 

  6. Li SZ, Chu RF, Liao SC, Zhang L (2007) Illumination Invariant Face Recognition Using Near-Infrared Images. IEEE Trans Pattern Anal Machine Intell 29(4):627–639

    Article  Google Scholar 

  7. Lee MS, Chen MY, Lin FS (2009) Face recognition under variant illumination using PCA and wavelets, Proc of SCIA:341–350

  8. Richhariya B, Gupta D (2019) Facial expression recognition using iterative universum twin support vector machine. Appl Soft Comput 76:53–67

    Article  Google Scholar 

  9. Ahmed SB, Ali SF, Ahmad J, Adnan M, Fraz MM (2020) On the frontiers of pose invariant face recognition: a review. Artificial Intell Rev 53:2571–2634

    Article  Google Scholar 

  10. Phillips PJ, Scruggs WT, Toole AJ, Flynn PJ, Bowyer KW, Schott CL, Sharpe M, FRVT 2006 and ICE 2006 (2010) Large-scale experimental results. IEEE Trans Pattern Anal Mach Intell 32(5):831–846

    Article  Google Scholar 

  11. Wang JW, Le NT, Lee JS, Wang CC (2018) Illumination compensation for face recognition using adaptive singular value decomposition in the wavelet domain. Information Sci 435:69–93

    Article  MathSciNet  Google Scholar 

  12. Zhao MH, Wang L (2012) Face recognition based on a novel illumination normalization method. Proc 5th Int Congress Image Signal Process:434–438

  13. Pan J, Wang XS, Cheng YH (2016) Single-Sample Face Recognition Based on LPP Feature Transfer. IEEE Access 4:2873–2884

    Article  Google Scholar 

  14. Jiang X, Cheng Y, Xiao R, Li Y, Zhao R (2007) Spherical harmonic based linear face de-lighting and compensation. Appl Mathematics Comput 185:857–868

    Article  Google Scholar 

  15. Ali H, Hariharan M, Yaacob S, Adom AH (2015) Facial emotion recognition using empirical mode decomposition. Expert Syst Appl 42:1261–1277

    Article  Google Scholar 

  16. Imtiaz SA (2011) Fattah, a face recognition scheme using wavelet based dominant features. Signal Image Process Int J 2(3):69–80

    Article  Google Scholar 

  17. Shan D, Ward R (2005) Wavelet-based illumination normalization for face recognition. Proc IEEE Int Confer Image Process 2(II):954–957

    Google Scholar 

  18. Vishwakarma VP, Dalal S, Sisaudia V (2018) Efficient Feature Extraction using DWT-DCT for Robust Face Recognition under varying Illuminations, 2018 2nd IEEE international conference on power electronics, Intell Control Energy Syst: 22-24

  19. Mukhedkar MM, Powalkar SB (2016) Fast face recognition based on wavelet transform on PCA, Proc of 2015 international conference on energy systems and applications

  20. Hu HF (2011) Variable lighting face recognition using discrete wavelet transform. Pattern Recognition Lett 32:1526–1534

    Article  Google Scholar 

  21. Zhang T, Fang B, Yuan Y, Tang YY, Shang Z, Li D, Lang F (2009) Multiscale Facial Structure Representation for Face Recognition Under Varying Illumination. Pattern Recognition 42(2):252–258

    Article  Google Scholar 

  22. Cao X, Shen W, Yu LG, Wang YL, Yang JY, Zhang ZW (2012) Illumination invariant extraction for face recognition using neighboring wavelet coefficients. Pattern Recogn 45:1299–1305

    Article  Google Scholar 

  23. Wang JW, Le NT, Lee JS, Wang CC (2018) Illumination compensation for face recognition using adaptive singular value decomposition in wavelet domain. Inf Sci 435:69–93

    Article  MathSciNet  Google Scholar 

  24. Hu HF (2011) Multiscale illumination normalization for face recognition using dual-tree complex wavelet transform in logarithm domain. Comput Vision Image Understanding 115:1384–1394

    Article  Google Scholar 

  25. Mallat SG (1989) A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans Pattern Anal Machine Intell 11(7):674–693

    Article  Google Scholar 

  26. Meena MS, Singh P, Rana A, Mery D, Prasad M (2019) A robust face recognition system for one sample problem. Proc Pacific-Rim Sym Image Video Technol: 13–26

  27. Oloyede MO, Hancke GP, Myburgh HC (2018) Improving face recognition systems using a new image enhancement technique, Hybrid Features and the Convolutional Neural Network. IEEE Access 6:75181–75191

    Article  Google Scholar 

  28. Salo F, Nassif AB, Essex A (2019) Dimensionality reduction with IG-PCA and ensemble classifier for network intrusion detection. Comput Netw 148:164–175

    Article  Google Scholar 

  29. Alzate C, Suykens J (2008) Kernel component analysis using an epsilon-insensitive robust loss function. IEEE Trans Neural Netw 1(9):1583–1598

    Article  Google Scholar 

  30. Li ZC, Liu J, Tang JH (2015) Robust structured subspace learning for data representation. IEEE Trans Pattern Anal Mach Intell 37(10):2085–2098

    Article  Google Scholar 

  31. Chen SG, Wu XJ, Yin HF (2017) KPCA method based on within-class auxiliary training samples and its application to pattern classification. Pattern Anal Appl 20:749–767

    Article  MathSciNet  Google Scholar 

  32. Zheng WS, Lai JH, Yuen PC (2005) GA-fisher: a new LDA-based face recognition algorithm with selection of principal components. Ieee Trans Syst Man Cybernetics-Part B: Cybernetics 35(5):1065–1078

    Article  Google Scholar 

  33. Sharifzadeh S, Ghodsi A, Clemmensen LH, Ersbøll BK (2017) Sparse supervised principal component analysis (SSPCA) for dimension reduction and variable selection. Eng Appl Artificial Intell 65:168–177

    Article  Google Scholar 

  34. Hastie T, Tibshirani R, Friedman J (2014) Gradient-orientation-based PCA subspace for novel face recognition. IEEE Access 2:914–920

    Article  Google Scholar 

  35. Lu Y, Zeng NY, Liu YR, Zhang N (2015) A hybrid wavelet neural network and switching particle swarm optimization algorithm for face direction recognition. Neurocomputing 155:219–224

    Article  Google Scholar 

  36. Land EH, McCann JJ (1971) Lightness and Retinex theory. J Optical Soc Am 61(1):1–11

    Article  Google Scholar 

  37. Zhang S, Wang T, Dong JY, Yu H (2017) Underwater image enhancement via extended multi-scale Retinex. Neurocomputing 245:1–9

    Article  Google Scholar 

  38. Takeda H, Farsiu S, Milanfar P (2007) Kernel Regression for Image Processing and Reconstruction. IEEE Trans Image Process 16(2):349–366

    Article  MathSciNet  Google Scholar 

  39. Gupta B, Agarwal TK (2017) Linearly quantile separated weighted dynamic histogram equalization for contrast enhancement. Comput Electric Eng 62:360–374

    Article  Google Scholar 

  40. Lee DU, Cheung RCC, Villasenor JD (2007) A flexible architecture for precise gamma correction. IEEE Trans Large Scale Integration Syst 15(4):474–478

    Article  Google Scholar 

  41. Muqeet MA, Holambe RS (2019) Local appearance-based face recognition using adaptive directional wavelet transform. J King Saud Univ - Comput Inform Sci 31(16):161–174

    Google Scholar 

  42. Xiang X, Huang D (2006) Feature Extraction Using Recursive Cluster-Based Linear Discriminant With Application to Face Recognition. IEEE Trans Image Process 15(12):488–493

    Article  MathSciNet  Google Scholar 

  43. Gupta P, Srivastava P, Bhardwaj S, Bhateja V (2011) A modified PSNR metric based on HVS for quality assessment of color images, 2011 Int Confer Commun Indust Appl

  44. Shen JH, Li GF, Yan WQ, Tao WJ, Xu G, Diao DF, Green P (2018) Nighttime driving safety improvement via image enhancement for driver face detection, IEEE Access: 45625–45634

  45. Ayyavoo T, Suseela JJ (2018) Illumination pre-processing method for face recognition using 2D DWT and CLAHE. IET Biometrics 7(4):380–390

    Article  Google Scholar 

  46. Li CR, Huang YY, Xue Y (2019) Dependence structure of Gabor wavelets based on copula for face recognition. Expert Syst Appl 137:453–470

    Article  Google Scholar 

  47. Park S, Yu S, Kim M, Park K, Paik J (2018) Dual autoencoder network for Retinex-based low-light image enhancement. IEEE Access 6:22084–22093

    Article  Google Scholar 

  48. Machidon AL, Machidon OM, Ogrutan PL (2019) Face recognition using Eigenfaces, geometrical PCA approximation and neural networks. 42nd Int Confer Ttelecommun Signal Process (TSP), Budapest

    Book  Google Scholar 

  49. Lahaw ZB, Essaidani, Seddik, Robust H Face recognition approaches using PCA, ICA, LDA based on DWT, and SVM Algorithms,41st international conference on telecommunications and signal processing (TSP), Athens, Greece, 1-5, 2018

Download references

Acknowledgments

This work is supported in part by The National Natural Science Foundation of China under Grant 11404205, Natural Science Foundation of Shaanxi under Grant 2019JQ-026 and Fundamental Research Funds for the Central Universities under Grant GK201903016 and GK202003016.

Author information

Authors and Affiliations

  1. School of Physics and Information Technology, Shaanxi Normal University, No. 620, West Chang’an Avenue, Xian, 710119, China

    Hongtao Liang, Jie Gao & Ning Qiang

Authors
  1. Hongtao Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jie Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ning Qiang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hongtao Liang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liang, H., Gao, J. & Qiang, N. A novel framework based on wavelet transform and principal component for face recognition under varying illumination. Appl Intell 51, 1762–1783 (2021). https://doi.org/10.1007/s10489-020-01924-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-020-01924-9

Keywords

Search

Navigation