Journal of the Indian Society of Remote Sensing

, Volume 46, Issue 8, pp 1255–1264 | Cite as

A Cloud Removal Algorithm to Generate Cloud and Cloud Shadow Free Images Using Information Cloning

  • Kaan KalkanEmail author
  • M. Derya Maktav
Research Article


One of the main problems of optical remote sensing is clouds and cloud shadows caused by specific atmospheric conditions during data acquisition. These features limit the usage of acquired images and increase the difficulty in data analysis, such as normalized difference vegetation index values, misclassification, and atmospheric correction. Accurate detection and reliable cloning of cloud and cloud shadow features in satellite images are very useful processes for optical remote sensing applications. In this study, an automated cloud removal algorithm to generate cloud and cloud shadow free images from multitemporal Landsat-8 images is introduced. Cloud and cloud shadow areas are classified by using process-based rule set developed by using spectral and spatial features after applying simple linear iterative clustering superpixel segmentation algorithm to the image to find cloud pixel groups easily and correctly. Segmentation-based cloud detection method gives better results than pixel-based for detection of cloud and cloud shadow patches. After detection of clouds and cloud shadows, cloud-free images are created by cloning cloudless regions from multitemporal dataset. Spectral and structural consistency are preserved by considering spectral features and seasonal effects while cloning process. Statistical similarity tests are applied to find best cloud-free image to use for cloning process. Cloning results are tested with the structural similarity index metric to evaluate the performance of cloning algorithm.


Landsat 8 Cloud Cloud shadow Cloud determination Cloning Information reconstruction Flood Fill 


  1. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., & Süsstrunk, S. (2012). SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(11), 2274–2282.CrossRefGoogle Scholar
  2. Arvidson, T., Gasch, J., & Goward, S. N. (2001). Landsat 7’s long-term acquisition plan—An innovative approach to building a global imagery archive. Remote Sensing of Environment, 78(1–2), 13–26.CrossRefGoogle Scholar
  3. Benabdelkader, S., & Melgani, F. (2008). Contextual spatiospectral postreconstruction of cloud-contaminated images. IEEE Geoscience and Remote Sensing Letters, 5(2), 204–208.CrossRefGoogle Scholar
  4. Chun, F., Jian-wen, M., Qin, D., & Xue, C. (2004). An improved method for cloud removal in ASTER data change detection. In Proceedings of IEEE international geoscience and remote sensing symposium, 2004. IGARSS’04, IEEE (Vol. 5, pp. 3387–3389).Google Scholar
  5. Gabarda, S., & Cristóbal, G. (2007). Cloud covering denoising through image fusion. Image and Vision Computing, 25(5), 523–530.CrossRefGoogle Scholar
  6. Gundersen, E. (2013). Cloudless Atlas with Landsat. Accessed 4 Nov 2016.
  7. Hancher, M. (2016). Only clear skies on Google Maps and Earth. Google Official. Accessed 6 June 2014.
  8. Helmer, E., & Ruefenacht, B. (2005). Cloud-free satellite image mosaics with regression trees and histogram matching. Photogrammetric Engineering and Remote Sensing, 71(9), 1079–1089.CrossRefGoogle Scholar
  9. Irish, R. R. (2000). Landsat 7 automatic cloud cover assessment. In Proceedings of SPIEThe international society for optical engineering (p. 348).Google Scholar
  10. Jiao, Q., Luo, W., Liu, X., & Zhang, B. (2007). Information reconstruction in the cloud removing area based on multi-temporal CHRIS images. In Y. Wang, J. Li, B. Lei, & J. Yang (Eds.), Proceedings of SPIE, MIPPR 2007: Remote sensing and GIS data processing and applications; and innovative multispectral technology and applications, International Symposium on Multispectral Image Processing and Pattern Recognition, 2007. (Vol. 6790, p. 679029). Wuhan, China: SPIE.
  11. Kalkan, K., & Maktav, D. (2016). Segmentation based cloud and cloud shadow detection in satellite imagery. Journal of Aeronautics and Space Technologies, 10(1), 45–54.Google Scholar
  12. Lin, C.-H., Tsai, P.-H., Lai, K.-H., & Chen, J.-Y. (2013). Cloud removal from multitemporal satellite images using information cloning. IEEE Transactions on Geoscience and Remote Sensing, 51(1), 232–241.CrossRefGoogle Scholar
  13. Lorenzi, L., Melgani, F., & Mercier, G. (2011). Inpainting strategies for reconstruction of missing data in VHR images. IEEE Geoscience and Remote Sensing Letters, 8(5), 914–918.CrossRefGoogle Scholar
  14. Loyd, C. (2012). Cloudless atlas. Accessed 2 Nov 2016.
  15. Maalouf, A., Carre, P., Augereau, B., & Fernandez-Maloigne, C. (2009). A Bandelet-based inpainting technique for clouds removal from remotely sensed images. IEEE Transactions on Geoscience and Remote Sensing, 47(7), 2363–2371.CrossRefGoogle Scholar
  16. MathWorks, I. (2014). Corr2, 2-D correlation coefficient. MATLAB Image Processing Toolbox. Accessed 2 Nov 2016.
  17. Melgani, F. (2006). Contextual reconstruction of cloud-contaminated multitemporal multispectral images. IEEE Transactions on Geoscience and Remote Sensing, 44(2), 442–455.CrossRefGoogle Scholar
  18. Rakwatin, P., Takeuchi, W., & Yasuoka, Y. (2009). Restoration of Aqua MODIS band 6 using histogram matching and local least squares fitting. IEEE Transactions on Geoscience and Remote Sensing, 47(2), 613–627.CrossRefGoogle Scholar
  19. Roy, D. P., Ju, J., Lewis, P., Schaaf, C., Gao, F., Hansen, M., et al. (2008). Multi-temporal MODIS–Landsat data fusion for relative radiometric normalization, gap filling, and prediction of Landsat data. Remote Sensing of Environment, 112(6), 3112–3130.CrossRefGoogle Scholar
  20. Tseng, D.-C., Tseng, H.-T., & Chien, C.-L. (2008). Automatic cloud removal from multi-temporal SPOT images. Applied Mathematics and Computation, 205(2), 584–600.CrossRefGoogle Scholar
  21. USGS. (2004). SLC-off gap-filled products gap-fill algorithm methodology. Accessed 4 Nov 2016.
  22. Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004). Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4), 600–612.CrossRefGoogle Scholar
  23. Wang, Z., Jin, J., Liang, J., Yan, K., & Peng, Q. (2005). A new cloud removal algorithm for multi-spectral images. In L. Zhang, J. Zhang, & M. Liao (Eds.), Proceedings of SPIE, MIPPR 2005: SAR and multispectral image processing (vol. 6043, p. 60430W). Wuhan, China: SPIE.
  24. Wang, B., Ono, A., Muramatsu, K., Fujiwara, N., Bin, W., Atsuo, O. N. O., et al. (1999). Automated detection and removal of clouds and their shadows from Landsat TM images. IEICE Transactions on Information and Systems, 82(2), 453–460.Google Scholar
  25. Zhang, C., Li, W., & Travis, D. J. (2009). Restoration of clouded pixels in multispectral remotely sensed imagery with cokriging. International Journal of Remote Sensing, 30(9), 2173–2195.CrossRefGoogle Scholar
  26. Zhang, X., Qin, F., & Qin, Y. (2010). Study on the thick cloud removal method based on multi-temporal remote sensing images. In 2010 international conference on multimedia technology, IEEE (pp. 1–3).Google Scholar
  27. Zhu, Z., & Woodcock, C. E. (2012). Object-based cloud and cloud shadow detection in Landsat imagery. Remote Sensing of Environment, 118, 83–94.CrossRefGoogle Scholar

Copyright information

© Indian Society of Remote Sensing 2018

Authors and Affiliations

  1. 1.TÜBİTAK Space Technologies Research Institute, ODTUAnkaraTurkey
  2. 2.Geomatics Engineering DepartmentIstanbul Technical UniversityMaslak, IstanbulTurkey

Personalised recommendations