Skip to main content
SpringerLink
Log in

Shadow removal from uniform-textured images using iterative thresholding of shearlet coefficients

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Shadows are natural phenomena that appear in images due to inconsistent illumination of the scene being captured. Recently, the need for removal of shadows from images and videos has gained wide attention due to the ill-effects of shadows on many computer vision tasks. This paper presents a novel technique to remove shadows from images with a uniform background. Initially, our method identifies the shadow and the lit regions by discarding the low-frequency image details. This is followed by an iterative procedure in which the shadow pixels to be corrected are located by eliminating the Shearlet approximation coefficients greater than a threshold. The shadow pixels identified in each iteration are corrected using a pre-computed correction factor. The shadow-corrected image is finally inpainted to generate the shadow-free output. In order to demonstrate the superior performance of the proposed method, we provide both qualitative and quantitative comparisons of the method with other state-of-the-art techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. https://www3.math.tu-berlin.de/numerik/www.shearlab.org/

References

  1. Al-Najdawi N, Bez HE, Singhai J, Edirisinghe EA (2012) A survey of cast shadow detection algorithms. Pattern Recogn Lett 33(6):752–764

    Article  Google Scholar 

  2. Arbel E, Hel-Or H (2011) Shadow removal using intensity surfaces and texture anchor points. IEEE Trans Pattern Anal Mach Intell 33(6):1202–1216

    Article  Google Scholar 

  3. Barrow H, Tenenbaum J (1978) Recovering intrinsic scene characteristics. Comput Vis Syst, A Hanson & E Riseman (Eds), pp 3–26

  4. Criminisi A, Pérez P, Toyama K (2004) Region filling and object removal by exemplar-based image inpainting. IEEE Trans Image Process 13(9):1200–1212

    Article  Google Scholar 

  5. Easley G, Labate D, Lim WQ (2008) Sparse directional image representations using the discrete shearlet transform. Appl Comput Harmon Anal 25(1):25–46

    Article  MathSciNet  MATH  Google Scholar 

  6. Easley GR, Labate D (2012) Image processing using shearlets. In: Shearlets, Springer, pp 283–325

  7. Elad M, Starck JL, Querre P, Donoho DL (2005) Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA). Appl Comput Harmon Anal 19(3):340–358

    Article  MathSciNet  MATH  Google Scholar 

  8. Finlayson GD, Hordley SD, Drew MS (2002) Removing shadows from images. In: European Conference on Computer Vision, Springer, pp 823–836

  9. Finlayson GD, Hordley SD, Lu C, Drew MS (2006) On the removal of shadows from images. IEEE Trans Pattern Anal Mach Intell 28(1):59–68

    Article  Google Scholar 

  10. Fredembach C, Finlayson G (2006) Simple shadow removal. In: IEEE 18Th International Conference on Pattern Recognition, vol 1. pp 832–835

  11. Gong H, Cosker D (2016) Interactive removal and ground truth for difficult shadow scenes. JOSA A 33(9):1798–1811

    Article  Google Scholar 

  12. Gong H, Cosker D (2017) User-assisted image shadow removal. Image Vis Comput 62:19–27

    Article  Google Scholar 

  13. Gryka M, Terry M, Brostow GJ (2015) Learning to remove soft shadows. ACM Trans Graph (TOG) 34(5):153

    Article  Google Scholar 

  14. Guo R, Dai Q, Hoiem D (2013) Paired regions for shadow detection and removal. IEEE Trans Pattern Anal Mach Intell 35(12):2956–2967

    Article  Google Scholar 

  15. Hu X, Zhu L, Fu CW, Qin J, Heng PA (2018) Direction-aware spatial context features for shadow detection. In: Proceedings of the CVPR Salt Lake City

  16. Khan SH, Bennamoun M, Sohel F, Togneri R (2016) Automatic shadow detection and removal from a single image. IEEE Trans Pattern Anal Mach Intell 38 (3):431–446

    Article  Google Scholar 

  17. Kutyniok G, Lim WQ, Reisenhofer R (2016) Shearlab 3D: Faithful digital shearlet transforms based on compactly supported shearlets. ACM Trans Math Softw 42(1):5:1–5:42

    Article  MathSciNet  MATH  Google Scholar 

  18. Labate D, Lim WQ, Kutyniok G, Weiss G (2005) Sparse multidimensional representation using shearlets. In: Wavelets XI, International Society for Optics and Photonics, vol 5914. p 59140U

  19. Murali S, Govindan VK (2013) Shadow detection and removal from a single image using LAB color space. Cybernetics and Information Technologies 13(1):95–103

    Article  MathSciNet  Google Scholar 

  20. Murali S, Govindan VK, Kalady S (2016) A survey on shadow removal techniques for single image. International Journal of Image, Graphics & Signal Processing 8(12):38–46

    Article  Google Scholar 

  21. Murali S, Govindan VK, Kalady S (2018) A survey on shadow detection techniques in a single image. Information Technology and Control 47(1):75–92

    Article  Google Scholar 

  22. Qu L, Tian J, He S, Tang Y, Lau RW (2017) Deshadownet: a multi-context embedding deep network for shadow removal. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), vol 1. p 3

  23. Shen L, Wee Chua T, Leman K (2015) Shadow optimization from structured deep edge detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2067–2074

  24. Stockham TG (1972) Image processing in the context of a visual model. Proc IEEE 60(7):828–842

    Article  Google Scholar 

  25. Su YF, Chen HH (2010) A three-stage approach to shadow field estimation from partial boundary information. IEEE Trans Image Process 19(10):2749–2760

    Article  MathSciNet  MATH  Google Scholar 

  26. Vicente TFY, Hou L, Yu CP, Hoai M, Samaras D (2016) Large-scale training of shadow detectors with noisily-annotated shadow examples. In: European Conference on Computer Vision, Springer, pp 816–832

  27. Wang J, Li X, Yang J (2018) Stacked conditional generative adversarial networks for jointly learning shadow detection and shadow removal. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1788–1797

  28. Wang Z, Simoncelli E, Bovik A, et al. (2003) Multi-scale structural similarity for image quality assessment. In: Asilomar Conference on Signals Systems and Computers, IEEE; 1998, vol 2. pp 1398–1402

  29. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13 (4):600–612

    Article  Google Scholar 

  30. Xiao C, Xiao D, Zhang L, Chen L (2013) Efficient shadow removal using subregion matching illumination transfer. In: Computer Graphics Forum, vol 32. Wiley online library, pp 421–430

  31. Yang Q, Tan KH, Ahuja N (2012) Shadow removal using bilateral filtering. IEEE Trans Image Process 21(10):4361–4368

    Article  MathSciNet  MATH  Google Scholar 

  32. Yu X, Li G, Ying Z, Guo X (2017) A new shadow removal method using color-lines. In: Felsberg M, Heyden A, Krüger N (eds) Computer Analysis of Images and Patterns. Springer International Publishing, Cham, pp 307–319

  33. Zhang L, Zhang L, Mou X, Zhang D, et al. (2011) FSIM: A feature similarity index for image quality assessment. IEEE Trans Image Process 20(8):2378–2386

    Article  MathSciNet  MATH  Google Scholar 

  34. Zhang L, Zhang Q, Xiao C (2015) Shadow remover: image shadow removal based on illumination recovering optimization. IEEE Trans Image Process 24(11):4623–4636

    Article  MathSciNet  MATH  Google Scholar 

  35. Zhu J, Samuel KG, Masood SZ, Tappen MF (2010) Learning to recognize shadows in monochromatic natural images. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, pp 223–230

  36. Zhu L, Deng Z, Hu X, Fu CW, Xu X, Qin J, Heng PA (2018) Bidirectional feature pyramid network with recurrent attention residual modules for shadow detection. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 121–136

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, National Institute of Technology Calicut, Kerala, India

    Saritha Murali, V. K. Govindan & Saidalavi Kalady

Authors
  1. Saritha Murali
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. V. K. Govindan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Saidalavi Kalady
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Saritha Murali.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Murali, S., Govindan, V.K. & Kalady, S. Shadow removal from uniform-textured images using iterative thresholding of shearlet coefficients. Multimed Tools Appl 78, 21167–21186 (2019). https://doi.org/10.1007/s11042-019-7435-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-7435-5

Keywords

Search

Navigation