Graph Cut Based Segmentation of Soft Shadows for Seamless Removal and Augmentation
This paper introduces a new concept within shadow segmentation for usage in shadow removal and augmentation through construction of a multiplicity alpha overlay shadow model. Previously, an image was considered to consist of shadow and non-shadow regions. This makes it difficult to seamlessly remove shadows and insert augmented shadows that overlap real shadows. We construct a model that accounts for sunlit, umbra and penumbra regions by estimating the degree of shadow. The model is based on theories about color constancy, daylight, and the geometry that causes penumbra. A graph cut energy minimization is applied to estimate the alpha parameter. Overlapping shadow augmentation and removal is also demonstrated. The approach is demonstrated on natural complex image situations. The results are convincing, and the quality of augmented shadows overlapping real shadows and removed shadows depends on the quality of the estimated alpha gradient in penumbra.
Keywordsshadow segmentation graph cuts augmented reality
- 4.Finlayson, G.D., Drew, M.S., Lu, C.: Intrinsic Images by Entropy Minimization. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3023, pp. 582–595. Springer, Heidelberg (2004)Google Scholar
- 5.Lu, C., Drew, M.S.: Shadow segmentation and shadow-free chromaticity via markov random fields. In: IS&T/SID 13th Color Imaging Conference, Scottsdale, AZ (2005)Google Scholar
- 6.Finlayson, G.D., Hordley, S.D., Drew, M.S.: Removing shadows from images using retinex. In: Color Imaging Conference, pp. 73–79. IS&T - The Society for Imaging Science and Technology (2002)Google Scholar