Skip to main content
SpringerLink
Log in

Illumination Normalization of Face Images Using Layers Extraction and Histogram Processing

  • Research Article-Computer Engineering and Computer Science
  • Published:
Arabian Journal for Science and Engineering Aims and scope Submit manuscript

Abstract

An illumination normalization algorithm for face images is proposed. For preprocessing of the input image, low light is enhanced to improve image quality. The reflection layer of image is normalized for edge preservation and to remove the artifacts, which is added to a small-scale image. Noise is removed, and details are enhanced to improve the quality of the image. Contrast is corrected by histogram truncation. Shape from shading is extracted and passed through a guided filter to acquire a face image having illumination normalized. Simulation outcome on Multi-PIE, CAS-PEAL, and Extended Yale B face dataset shows the strength of the suggested approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Su, Y.; Liu, Z.; Ban, X.: Symmetric face normalization. Symmetry 11(1), 1–11 (2019)

    Google Scholar 

  2. Chen, G.Y.; Bui, T.D.; Krzyzak, A.: Illumination invariant face recognition using dual-tree complex wavelet transform in logarithm domain. J. Electr. Eng. 70(2), 113–121 (2019)

    Google Scholar 

  3. Chen, G.Y.; Bui, T.D.; Krzyzak, A.: Local pattern-based illumination compensation in face images. In: International Conference on Graphics and Image Processing, pp. 1–7 (2019)

  4. Iqbal, M.; Riaz, M.M.; Ghafoor, A.; Ali, S.S.; Ahmad, A.: Guided image filtering using data mining and decomposition. Imaging Sci. J. 67(6), 1–7 (2019)

    Google Scholar 

  5. Zhang, W.; Zhao, X.; Morvan, J.; Chen, L.: Improving shadow suppression for illumination robust face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 41(3), 611–624 (2019)

    Article  Google Scholar 

  6. Yadav, J.; Rajpal, N.; Mehta, R.: An improved illumination normalization and robust feature extraction technique for face recognition under varying illuminations. Arabian J. Sci. Eng. 44, 9067–9086 (2019)

    Article  Google Scholar 

  7. Zheng, C.; Wu, S.; Xu, W.; Xie, S.: Illumination normalization via merging locally enhanced textures for robust face recognition. In: Computer Vision and Pattern Recognition, pp. 1–10 (2019)

  8. Gao, T.; Zhao, X.; Chen, T.; Liu, Z.; Li, S.: Illumination-insensitive image representation via synergistic weighted center-surround receptive field model and weber law. Pattern Recogn. 69, 124–140 (2017)

    Article  Google Scholar 

  9. Lee, S.; Lee, C.: Multiscale morphology based illumination normalization with enhanced local textures for face recognition. Expert Syst. Appl. 62, 347–357 (2017)

    Article  Google Scholar 

  10. Tu, X.; Gao, J.; Xie, M.; Qi, J.; Ma, Z.: Illumination normalization based on correction of large-scale components for face recognition. Neurocomputing 266, 465–476 (2017)

    Article  Google Scholar 

  11. Yang, Z.Y.; Nie, X.F.; He, X.; Xiong, W.Y.: Face illumination processing using nonlinear dynamic range adjustment and gradientfaces. Conf. Electron. Electr. Eng. Inf. Sci. 117, 202–208 (2017)

    Google Scholar 

  12. Guo, K.; Wu, S.; Xu, Y.: Face recognition using both visible light image and near-infrared image and a deep network. CAAI Trans. Intell. Technol. 2(1), 38–47 (2017)

    Google Scholar 

  13. Hanmandlu, M.; Singhal, S.: Face recognition under pose and illumination variations using combination of information set and PLPP features. Appl. Soft Comput. 53, 396–406 (2017)

    Article  Google Scholar 

  14. Hu, C.; Lu, X.; Ye, M.; Zeng, W.: Singular value decomposition and local near neighbors for face recognition under varying illumination. Pattern Recogn. 64, 60–83 (2017)

    Article  Google Scholar 

  15. Zhu, J.Y.; Zheng, W.S.; Lu, F.; Lai, J.H.: Illumination invariant single face image recognition under heterogeneous lighting condition. Pattern Recogn. 66, 313–327 (2017)

    Article  Google Scholar 

  16. Yu, Y.F.; Dai, D.Q.; Ren, C.X.; Huang, K.K.: Discriminative multi-layer illumination-robust feature extraction for face recognition. Pattern Recogn. 67, 201–212 (2017)

    Article  Google Scholar 

  17. Hu, L.; Kan, M.; Shan, S.; Song, X.; Chen, X.: LDF-Net: Learning a displacement field network for face recognition across pose. In: IEEE International Conference on Automatic Face and Gesture Recognition, pp. 9–16 (2017)

  18. Ranjan, R.; Sankaranarayanan, S.; Castillo, C.D.; Chellappa, R.: An All-In-One convolutional neural network for face analysis. In: IEEE International Conference on Automatic Face and Gesture Recognition, pp. 17–24 (2017)

  19. Liu, H.; Lu, J.; Feng, J.; Zhou, J.: Ordinal deep feature learning for facial age estimation. In: IEEE International Conference on Automatic Face and Gesture Recognition, pp. 157–164 (2017)

  20. Chen, C.; Patel, V.M.; Chellappa, R.: Learning from ambiguously labeled face images. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1–1 (2017)

  21. Mahbub, U.; Sarkar, S.; Chellappa, R.: Pooling facial segments to face: the shallow and deep ends. In: IEEE International Conference on Automatic Face and Gesture Recognition, pp. 634–641 (2017)

  22. Reale, C.; Lee, H.; Kwon, H.; Chellappa, R.: Deep network shrinkage applied to cross-spectrum face recognition. In: IEEE International Conference on Automatic Face and Gesture Recognition, pp. 897–903 (2017)

  23. Najibi, M.; Samangouei, P.; Chellappa, R.; Davis, L.S.: SSH: Single Stage Headless Face Detector. In: IEEE International Conference on Computer Vision, pp. 4885–4894 (2017)

  24. Yan, Y.; Lee, F.; Wu, X.; Chen, Q.: Face recognition algorithm using extended vector quantization histogram features. In: IEEE International Conference on Signal and Image Processing, pp. 90–95 (2016)

  25. Yao, M.: Illumination robust single sample face recognition based on ESRC. Multimedia Tools Appl. 76(24), 1–28 (2016)

  26. Chowdhry, D.A.; Siddique, A.M.; Touqir, I.: Contrast enhancement in poor visibility conditions using guided filtering. Radioengineering 22(2), 650–656 (2013)

    Google Scholar 

  27. Mahbub, U.; Sarkar, S.; Chellappa, R.: Segment-based methods for facial attribute detection from partial faces. IEEE Trans. Affect. Comput. 11(4), 601–613 (2018). https://doi.org/10.1109/TAFFC.2018.2820048

    Article  Google Scholar 

  28. Matsukawa, T.; Okabe, T,; Sato, Y.: Illumination Normalization of Face Images with Cast Shadows. In: International Conference on Pattern Recognition, pp. 1848–1851 (2012)

  29. Fitzgibbon, A.; Zisserman, A.: On affine invariant clustering and automatic cast listing in movies. In: Proceedings of the European Conference on Computer Vision, pp. 304–321 (2002)

  30. Wang, H.; Li, S.Z.; Wang, Y.: Face recognition under varying lighting conditions using self quotient image. In: Sixth IEEE International Conference onProceedings of the Automatic Face and Gesture Recognition, pp. 819–824 (2004)

  31. Chen, W.; Er, M.J.; Wu, S.: Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain. IEEE Trans. Syst. Man, Cybern. Part B: Cybern. 36, 458–466 (2006)

    Article  Google Scholar 

  32. Chen, T.; Yin, W.; Zhou, X.S.; Comaniciu, D.; Huang, T.S.: Total variation models for variable lighting face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28, 1519–1524 (2006)

    Article  Google Scholar 

  33. Xie, X.; Lam, K.: An efficient illumination normalization method for face recognition. Pattern Recogn. Lett. 27, 609–617 (2006)

    Article  Google Scholar 

  34. Tan, X.; Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans. Image Process. 19, 1635–1650 (2010)

    Article  MathSciNet  Google Scholar 

  35. Guo, X.; Li, Y.; Ling, H.: LIME: low-light image enhancement via illumination map estimation. IEEE Trans. Image Process. 26(2), 982–993 (2017)

    Article  MathSciNet  Google Scholar 

  36. Li, Y.; Brown, M.S.: Single image layer separation using relative smoothness. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2752–2759 (2014)

  37. Gu, S.; Zhang, L.; Zuo, W.; Feng, X.: Weighted nuclear norm minimization with Application to Image Denoising. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2862–2869 (2014)

  38. Zhu, Q.; Shi, J.: Shape from shading: Recognizing the mountains through a global view. IEEE Conf. Comput. Vis. Pattern Recogn. 2, 1839–1846 (2006)

    Google Scholar 

  39. He, K.; Sun, J.: Fast guided filter. In: Computer Science, pp. 1–2 (2015)

  40. Chen, T.; Yin, W.; Zhou, X.S.; Comaniciu, D.; Huang, T.S.: Total variation models for variable lighting face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(9), 1519–1524 (2006)

    Article  Google Scholar 

  41. Gross, R.; Matthews, I.; Cohn, J.; Kanade, T.; Baker, S.: MultiPIE. Image Vis. Comput. 28(5), 807–813 (2010)

    Article  Google Scholar 

  42. Gao, W.; Cao, B.; Shan, S.; Chen, X.; Zhou, D.; Zhang, X.; Zhao, D.: The CAS-PEAL large-scale chinese face database and baseline evaluations. IEEE Trans. Syst. Man, Cybern. 38(1), 149–161 (2008)

    Article  Google Scholar 

  43. Georghiades, A.S.; Belhumeur, P.N.; Kriegman, D.J.: From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 643–660 (2001)

    Article  Google Scholar 

  44. Gastal, E.S.L.; Oliveira, M.M.: Adaptive manifolds for real-time high-dimensional filtering. ACM Trans. Graph. 31(4), 1–13 (2012)

    Article  Google Scholar 

  45. Woo, W.L.; Dlay, S.S.: 3D shape restoration using sparse representation and separation of illumination effects. Signal Process. 103, 258–272 (2014)

    Article  Google Scholar 

  46. Liu, P.; Woo, W.L.; Dlay, S.S.: Maximum a posteriori approach to 2.5D image reconstruction using Laplacian-Gaussian Mixture model. In: International Conference on Visual Information Engineering. pp. 594–599 (2008)

  47. Sulistyo, S.B.; Wu, D.; Woo, W.L.; Dlay, S.S.; Gao, B.: Computational deep intelligence vision sensing for nutrient content estimation in agricultural automation. IEEE Trans. Autom. Sci. Eng. 15(3), 1243–1257 (2018)

    Article  Google Scholar 

  48. Sulistyo, S.B.; Woo, W.L.; Dlay, S.S.; Gao, B.: Building a globally optimized computational intelligent image processing algorithm for on-site inference of nitrogen in plants. IEEE Intell. Syst. 33(3), 15–26 (2018)

    Article  Google Scholar 

  49. Xiong, G.: Local Normalization. In: https://www.mathworks.com/matlabcentral/fileexchange/8303-local-normalization, MATLAB Central File Exchange. (2020)

  50. Li, X.; Feng, R.; Guan, X.; Shen, H.; Zhang, L.: Remote sensing image mosaicking: achievements and challenges. IEEE Geosci. Remote Sens. Magaz. 7(4), 8–22 (2019)

    Article  Google Scholar 

  51. Li, X.; Shen, H.; Zhang, L.; Zhang, H.; Yuan, Q.; Yang, G.: Recovering quantitative remote sensing products contaminated by thick clouds and shadows using Multitemporal Dictionary Learning. IEEE Trans. Geosci. Remote Sens. 52(11), 7086–7098 (2014)

    Article  Google Scholar 

  52. Wagner, A.; Wright, J.; Ganesh, A.; Zhou, Z.; Mobahi, H.; Ma, Y.: Toward a practical face recognition system: robust alignment and illumination by sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 34(2), 372–386 (2012)

    Article  Google Scholar 

  53. Wright, J.; Yang, A.Y.; Ganesh, A.; Sastry, S.S.; Ma, Y.: Ma: Robust Face Recognition via Sparse Representation. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 210–227 (2009)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National University of Sciences and Technology (NUST), Islamabad, Pakistan

    Mehwish Iqbal, Abdul Ghafoor & Attiq Ahmad

  2. Centre for Advanced Studies in Telecommunication (CAST), COMSATS, Islamabad, Pakistan

    Muhammad Mohsin Riaz

Authors
  1. Mehwish Iqbal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Muhammad Mohsin Riaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abdul Ghafoor
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Attiq Ahmad
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abdul Ghafoor.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Iqbal, M., Riaz, M.M., Ghafoor, A. et al. Illumination Normalization of Face Images Using Layers Extraction and Histogram Processing. Arab J Sci Eng 46, 3319–3328 (2021). https://doi.org/10.1007/s13369-020-05142-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13369-020-05142-w

Keywords

Search

Navigation