Shadow removal from uniform-textured images using iterative thresholding of shearlet coefficients

  • Saritha MuraliEmail author
  • V. K. Govindan
  • Saidalavi Kalady


Shadows are natural phenomena that appear in images due to inconsistent illumination of the scene being captured. Recently, the need for removal of shadows from images and videos has gained wide attention due to the ill-effects of shadows on many computer vision tasks. This paper presents a novel technique to remove shadows from images with a uniform background. Initially, our method identifies the shadow and the lit regions by discarding the low-frequency image details. This is followed by an iterative procedure in which the shadow pixels to be corrected are located by eliminating the Shearlet approximation coefficients greater than a threshold. The shadow pixels identified in each iteration are corrected using a pre-computed correction factor. The shadow-corrected image is finally inpainted to generate the shadow-free output. In order to demonstrate the superior performance of the proposed method, we provide both qualitative and quantitative comparisons of the method with other state-of-the-art techniques.


Shadow removal Shearlet transform Thresholding Inpainting Illumination 



  1. 1.
    Al-Najdawi N, Bez HE, Singhai J, Edirisinghe EA (2012) A survey of cast shadow detection algorithms. Pattern Recogn Lett 33(6):752–764CrossRefGoogle Scholar
  2. 2.
    Arbel E, Hel-Or H (2011) Shadow removal using intensity surfaces and texture anchor points. IEEE Trans Pattern Anal Mach Intell 33(6):1202–1216CrossRefGoogle Scholar
  3. 3.
    Barrow H, Tenenbaum J (1978) Recovering intrinsic scene characteristics. Comput Vis Syst, A Hanson & E Riseman (Eds), pp 3–26Google Scholar
  4. 4.
    Criminisi A, Pérez P, Toyama K (2004) Region filling and object removal by exemplar-based image inpainting. IEEE Trans Image Process 13(9):1200–1212CrossRefGoogle Scholar
  5. 5.
    Easley G, Labate D, Lim WQ (2008) Sparse directional image representations using the discrete shearlet transform. Appl Comput Harmon Anal 25(1):25–46MathSciNetCrossRefGoogle Scholar
  6. 6.
    Easley GR, Labate D (2012) Image processing using shearlets. In: Shearlets, Springer, pp 283–325Google Scholar
  7. 7.
    Elad M, Starck JL, Querre P, Donoho DL (2005) Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA). Appl Comput Harmon Anal 19(3):340–358MathSciNetCrossRefGoogle Scholar
  8. 8.
    Finlayson GD, Hordley SD, Drew MS (2002) Removing shadows from images. In: European Conference on Computer Vision, Springer, pp 823–836Google Scholar
  9. 9.
    Finlayson GD, Hordley SD, Lu C, Drew MS (2006) On the removal of shadows from images. IEEE Trans Pattern Anal Mach Intell 28(1):59–68CrossRefGoogle Scholar
  10. 10.
    Fredembach C, Finlayson G (2006) Simple shadow removal. In: IEEE 18Th International Conference on Pattern Recognition, vol 1. pp 832–835Google Scholar
  11. 11.
    Gong H, Cosker D (2016) Interactive removal and ground truth for difficult shadow scenes. JOSA A 33(9):1798–1811CrossRefGoogle Scholar
  12. 12.
    Gong H, Cosker D (2017) User-assisted image shadow removal. Image Vis Comput 62:19–27CrossRefGoogle Scholar
  13. 13.
    Gryka M, Terry M, Brostow GJ (2015) Learning to remove soft shadows. ACM Trans Graph (TOG) 34(5):153CrossRefGoogle Scholar
  14. 14.
    Guo R, Dai Q, Hoiem D (2013) Paired regions for shadow detection and removal. IEEE Trans Pattern Anal Mach Intell 35(12):2956–2967CrossRefGoogle Scholar
  15. 15.
    Hu X, Zhu L, Fu CW, Qin J, Heng PA (2018) Direction-aware spatial context features for shadow detection. In: Proceedings of the CVPR Salt Lake CityGoogle Scholar
  16. 16.
    Khan SH, Bennamoun M, Sohel F, Togneri R (2016) Automatic shadow detection and removal from a single image. IEEE Trans Pattern Anal Mach Intell 38 (3):431–446CrossRefGoogle Scholar
  17. 17.
    Kutyniok G, Lim WQ, Reisenhofer R (2016) Shearlab 3D: Faithful digital shearlet transforms based on compactly supported shearlets. ACM Trans Math Softw 42(1):5:1–5:42MathSciNetCrossRefGoogle Scholar
  18. 18.
    Labate D, Lim WQ, Kutyniok G, Weiss G (2005) Sparse multidimensional representation using shearlets. In: Wavelets XI, International Society for Optics and Photonics, vol 5914. p 59140UGoogle Scholar
  19. 19.
    Murali S, Govindan VK (2013) Shadow detection and removal from a single image using LAB color space. Cybernetics and Information Technologies 13(1):95–103MathSciNetCrossRefGoogle Scholar
  20. 20.
    Murali S, Govindan VK, Kalady S (2016) A survey on shadow removal techniques for single image. International Journal of Image, Graphics & Signal Processing 8(12):38–46CrossRefGoogle Scholar
  21. 21.
    Murali S, Govindan VK, Kalady S (2018) A survey on shadow detection techniques in a single image. Information Technology and Control 47(1):75–92CrossRefGoogle Scholar
  22. 22.
    Qu L, Tian J, He S, Tang Y, Lau RW (2017) Deshadownet: a multi-context embedding deep network for shadow removal. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), vol 1. p 3Google Scholar
  23. 23.
    Shen L, Wee Chua T, Leman K (2015) Shadow optimization from structured deep edge detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2067–2074Google Scholar
  24. 24.
    Stockham TG (1972) Image processing in the context of a visual model. Proc IEEE 60(7):828–842CrossRefGoogle Scholar
  25. 25.
    Su YF, Chen HH (2010) A three-stage approach to shadow field estimation from partial boundary information. IEEE Trans Image Process 19(10):2749–2760MathSciNetCrossRefGoogle Scholar
  26. 26.
    Vicente TFY, Hou L, Yu CP, Hoai M, Samaras D (2016) Large-scale training of shadow detectors with noisily-annotated shadow examples. In: European Conference on Computer Vision, Springer, pp 816–832Google Scholar
  27. 27.
    Wang J, Li X, Yang J (2018) Stacked conditional generative adversarial networks for jointly learning shadow detection and shadow removal. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1788–1797Google Scholar
  28. 28.
    Wang Z, Simoncelli E, Bovik A, et al. (2003) Multi-scale structural similarity for image quality assessment. In: Asilomar Conference on Signals Systems and Computers, IEEE; 1998, vol 2. pp 1398–1402Google Scholar
  29. 29.
    Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13 (4):600–612CrossRefGoogle Scholar
  30. 30.
    Xiao C, Xiao D, Zhang L, Chen L (2013) Efficient shadow removal using subregion matching illumination transfer. In: Computer Graphics Forum, vol 32. Wiley online library, pp 421–430Google Scholar
  31. 31.
    Yang Q, Tan KH, Ahuja N (2012) Shadow removal using bilateral filtering. IEEE Trans Image Process 21(10):4361–4368MathSciNetCrossRefGoogle Scholar
  32. 32.
    Yu X, Li G, Ying Z, Guo X (2017) A new shadow removal method using color-lines. In: Felsberg M, Heyden A, Krüger N (eds) Computer Analysis of Images and Patterns. Springer International Publishing, Cham, pp 307–319Google Scholar
  33. 33.
    Zhang L, Zhang L, Mou X, Zhang D, et al. (2011) FSIM: A feature similarity index for image quality assessment. IEEE Trans Image Process 20(8):2378–2386MathSciNetCrossRefGoogle Scholar
  34. 34.
    Zhang L, Zhang Q, Xiao C (2015) Shadow remover: image shadow removal based on illumination recovering optimization. IEEE Trans Image Process 24(11):4623–4636MathSciNetCrossRefGoogle Scholar
  35. 35.
    Zhu J, Samuel KG, Masood SZ, Tappen MF (2010) Learning to recognize shadows in monochromatic natural images. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, pp 223–230Google Scholar
  36. 36.
    Zhu L, Deng Z, Hu X, Fu CW, Xu X, Qin J, Heng PA (2018) Bidirectional feature pyramid network with recurrent attention residual modules for shadow detection. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 121–136Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringNational Institute of Technology CalicutKeralaIndia

Personalised recommendations