Removing Shadows from Images
Illumination conditions cause problems for many computer vision algorithms. In particular, shadows in an image can cause segmentation, tracking, or recognition algorithms to fail. In this paper we propose a method to process a 3-band colour image to locate, and subsequently remove shadows. The result is a 3-band colour image which contains all the original salient information in the image, except that the shadows are gone.
We use the method set out in  to derive a 1-d illumination invariant shadow-free image. We then use this invariant image together with the original image to locate shadow edges. By setting these shadow edges to zero in an edge representation of the original image, and by subsequently re-integrating this edge representation by a method paralleling lightness recovery, we are able to arrive at our sought after full colour, shadow free image. Preliminary results reported in the paper show that the method is effective.
A caveat for the application of the method is that we must have a calibrated camera. We show in this paper that a good calibration can be achieved simply by recording a sequence of images of a fixed outdoor scene over the course of a day. After calibration, only a single image is required for shadow removal. It is shown that the resulting calibration is close to that achievable using measurements of the camera’s sensitivity functions.
KeywordsTexture shading, & colour shadow removal lightness recovery illuminant invariance
Unable to display preview. Download preview PDF.
- 1.G.D. Finlayson and S.D. Hordley. Color constancy at a pixel. J. Opt. Soc. Am. A, 18(2):253–264, Feb. 2001. Also, UK Patent application no. 0000682.5. Under review, British Patent Office.Google Scholar
- 3.D. L. Waltz. Understanding line drawings of scenes with shadows. In P.H. Winston, editor, The Psychology of Computer Vision, pages 19–91. McGraw-Hill, 1975.Google Scholar
- 4.P.M. Hubel. The perception of color at dawn and dusk. In IS&T and SID’s 7th Color Imaging Conference, pages 48–51. 1999.Google Scholar
- 5.J.J. McCann. Lessons learned from mondrians applied to real images and color gamuts. In IS&T and SID’s 7th Color Imaging Conference. 1999.Google Scholar
- 6.Y. Weiss. Deriving intrinsic images from image sequences. In ICCV01, pages II: 68–75. IEEE, 2001.Google Scholar
- 7.H.G. Barrow and J. Tenenbaum. Recovering intrinsic scene characteristics from images. In A.R. Hanson and E.M. Riseman, editors, Computer Vision Systems, pages 3–26. Academic Press, 1978.Google Scholar
- 8.G.D. Finlayson and M.S. Drew. 4-sensor camera calibration for image representation invariant to shading, shadows, lighting, and specularities. In ICCV’01: International Conference on Computer Vision, pages II: 473–480. IEEE, 2001.Google Scholar
- 10.G.D. Finlayson, M.S. Drew, and B.V. Funt. Spectral sharpening: sensor transformations for improved color constancy. J. Opt. Soc. Am. A, 11(5):1553–1563, May 1994.Google Scholar
- 12.Th. Gevers and H. M. G. Stokman. Classifying color transitions into shadow-geometry, illumination highlight or material edges. In International Conference on Image Processing, pages 521–525, 2000.Google Scholar
- 13.R. Jain, R. Kasturi, and B.G. Schunck. Machine Vision. McGraw-Hill, 1995.Google Scholar
- 16.Yogesh Raja, J. McKenna, and Shaogang Gong. Colour model selection and adaptation in dynamic scenes. In The Fifth European Conference on Computer Vision. European Vision Society, 1998.Google Scholar
- 18.B.V. Funt and G.D. Finlayson. Color constant color indexing. PAMI, 17(5):522–529, May 1995.Google Scholar