Abstract
In the field of remote sensing satellite imagery, malfunctions in the available raw data are prominent. Especially in Short-Wave Infrared (SWIR) detectors used in satellite imaging cameras, which suffer from dropouts in pixel and line direction in raw data. With the recent development in generative adversarial networks and its vast application in inpainting the missing data, the possibility to predict and fill in the missing data accurately with contextual attention has become prevalent. This paper presents SN-GANs (SN-generative adversarial networks) which is two-staged architecture, and it is based on the concept of feed forward neural networks with contextual attention layers. While reconstructing the corrupted part of the images, the model takes surrounding pixels into consideration. Moreover, this architecture is adept enough to fill in the multiple lines and pixel dropouts efficiently even in super-resolution satellite images. The available traditional methods fail to address the loss of data that incurs, while inpainting a 16-bit raw image because they are effective enough for 8-bit RGB images. SN-GANs have effectively resolved this issue with a lossless image inpainting method for 16-bit satellite images as it retains the features of non-corrupted data. The performance of the model is evaluated using similarity metrics like structural similarity index measure (SSIM), peak signal-to-noise ratio (PSNR) and mean-squared error (MSE).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ahuja SN, Biday S (2013) A survey of satellite image enhancement techniques. Int J Adv Innov Res (IJAIR), 2 (8)
LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436–444. https://doi.org/10.1038/nature14539
Dinh L, Sohl-Dickstein J, Bengio S, (2021) Density estimation using real NVP. [online] arXiv.org. Available at: <https://arxiv.org/abs/1605.08803>
Lei S, Shi Z, Zou Z (2017) Super-resolution for remote sensing images via local-global combined network. IEEE Geosci Remote Sens Lett 14(8):1243–1247. https://doi.org/10.1109/LGRS.2017.2704122
Wei Y, Yuan Q, Shen H, Zhang L Boosting the accuracy of multispectral image pansharpening by learning a deep residual network. IEEE Geosci Remote Sens Lett 14(10):1795–1799
Zhang L, Zhang L, Du B (2016) Deep learning for remote sensing data: a technical tutorial on the state of the art. IEEE Geosci Remote Sensing Magazine 4(2):22–40. https://doi.org/10.1109/MGRS.2016.2540798
Xia G-S, Hu J, Hu F, Shi B, Bai X, Zhong Y, Lu X, Zhang L (2017) AID: a benchmark data set for performance evaluation of aerial scene classification. IEEE Trans Geosci Remote Sens 55:3965–3981. https://doi.org/10.1109/TGRS.2017.2685945
Xiaoqiang L, Wei L, Lichao M (2014) Semi-supervised multitask learning for scene recognition. IEEE Trans Cybernetics 45 https://doi.org/10.1109/TCYB.2014.2362959
Xie W, Li Y (2017) Hyperspectral imagery denoising by deep learning With trainable nonlinearity function. IEEE Geosci Remote Sens Lett 14(11):1963–1967. https://doi.org/10.1109/LGRS.2017.2743738
Li X, Shen H, Li H, Zhang L (2016) Patch matching-based multitemporal group sparse representation for the missing information reconstruction of remote-sensing images. IEEE J Selected Topics Appl Earth Observations Remote Sensing 9(8):3629–3641. https://doi.org/10.1109/JSTARS.2016.2533547
Zhang Q, Yuan Q, Zeng C, Li X, Wei Y (2018) Missing data reconstruction in remote sensing image With a unified spatial–temporal–spectral deep convolutional neural network. IEEE Trans Geosci Remote Sens 56(8):4274–4288. https://doi.org/10.1109/TGRS.2018.2810208
Śmieja M, Struski Ł, Tabor J, Zieliński B, Spurek P (2018) Processing of missing data by neural networks. In: Advances in neural information processing systems, pp 2719–2729
Liu G, Reda FA, Shih KJ, Wang T-C, Tao A, Catanzaro B (2018) Image inpainting for irregular holes using partial convolutions. In: European conference on computer vision (ECCV), September 2018
Yu J, Lin Z, Yang J, Shen X, Lu X, Huang TS (2018) Generative image inpainting with contextual attention. In: 2018 IEEE/CVF conference on computer vision and pattern recognition, Salt Lake City, UT, USA, 2018, pp 5505–5514. https://doi.org/10.1109/CVPR.2018.00577
Yu J, Lin Z, Yang J, Shen X, Lu X, Huang TS (2018) Free-form image inpainting with gated convolution. arXiv preprint arXiv:1806.03589, 2018
Dabov K, Foi A, Katkovnik V, Egiazarian K (2006) Image denoising with block-matching and 3D filtering. In: Proceedings SPIE 6064, image processing: algorithms and systems, neural networks, and machine learning, 606414 (17 February 2006)
Azzari L, Foi A (2016) Variance stabilization for noisy+estimate combination in iterative poisson denoising. IEEE Signal Process Lett 23(8):1086–1090. https://doi.org/10.1109/LSP.2016.2580600
Po-Yu L, Lam EY (2018) Image reconstruction using deep learning. arXiv preprint arXiv:1809.10410
Oord A, Kalchbrenner N, Vinyals O, Espeholt L, Graves A Kavukcuoglu K (2021) Conditional image generation with PixelCNN decoders. [online] arXiv.org. Available at: <https://arxiv.org/abs/1606.05328>
Iizuka S, Simo-Serra E, Ishikawa H (2017) Globally and locally consistent image completion. ACM TransGraphics (TOG) 36(4):107
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Panchal, P., Raman, V.C., Baraskar, T., Sinha, S., Purohit, S., Modi, J. (2022). Reconstruction of Missing Data in Satellite Imagery Using SN-GANs. In: Zhang, YD., Senjyu, T., So-In, C., Joshi, A. (eds) Smart Trends in Computing and Communications. Lecture Notes in Networks and Systems, vol 286. Springer, Singapore. https://doi.org/10.1007/978-981-16-4016-2_60
Download citation
DOI: https://doi.org/10.1007/978-981-16-4016-2_60
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-4015-5
Online ISBN: 978-981-16-4016-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)