Abstract
Cloud removal from satellite imagery is a well-known problem in both remote sensing and deep learning. Many methods have been developed to address the cloud removal problem in a supervised setting. These methods require gathering of huge datasets to learn the mapping from cloudy images to cloud-free images. In this paper, we address cloud removal as an inverse problem. We convert this problem into an inpainting task in which cloudy regions are treated as missing pixels and completely solve the cloud removal problem in an unsupervised setting. We show that the structure of a network is a good prior by itself and is sufficient to remove clouds from satellite imagery using Deep Image Prior algorithm. Experimental results on Sentinel-2 Imagery have quantitatively and qualitatively demonstrated the effectiveness of our technique on a diverse range of clouds.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ronneberger, O., Fischer, P., & Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation. CoRR, arXiv:abs/1505.04597.
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278–2324.
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 25, 1097–1105.
He, K., Zhang, X., Ren, S., & Sun, J. (2015). Deep residual learning for image recognition. CoRR, arXiv:abs/1512.03385.
Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. CoRR, arXiv:abs/1409.1556.
Wang, A., Xu, Y., Wei, X., & Cui, B. (2020). Semantic segmentation of crop and weed using an encoder-decoder network and image enhancement method under uncontrolled outdoor illumination. IEEE Access, 8, 81724–81734.
Li, W., He, C., Fang, J., Zheng, J., Fu, H., & Yu, L. (2019). Semantic segmentation-based building footprint extraction using very high-resolution satellite images and multi-source GIS data. Remote Sensing, 11(4), 403.
Singh, P., & Komodakis, N. (2018). Cloud-Gan: Cloud removal for sentinel-2 imagery using a cyclic consistent generative adversarial networks. In IEEE International Geoscience and Remote Sensing Symposium (pp. 1772–1775).
Chen, Y., Tang, L., Yang, X., Fan, R., Bilal, M., & Li, Q. (2019). Thick clouds removal from multitemporal ZY-3 satellite images using deep learning. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 13, 143–153.
Ulyanov, D., Vedaldi, A., & Lempitsky, V. S. (2020). Deep image prior. International Journal of Computer Vision, 128, 1867–1888.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Maiya, A., Shylaja, S.S. (2022). Cloud Image Prior: Single Image Cloud Removal. In: Khanna, A., Gupta, D., Bhattacharyya, S., Hassanien, A.E., Anand, S., Jaiswal, A. (eds) International Conference on Innovative Computing and Communications. Advances in Intelligent Systems and Computing, vol 1387. Springer, Singapore. https://doi.org/10.1007/978-981-16-2594-7_8
Download citation
DOI: https://doi.org/10.1007/978-981-16-2594-7_8
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-2593-0
Online ISBN: 978-981-16-2594-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)