Abstract
In current work a complex solution for very high resolution remote sensing data processing is suggested. The approach is based on modern deep learning techniques such as fully convolutional neural networks and solves multiple significant remote sensing problems such as detection and instance segmenetation of manmade land objects on very high resolution hyperspectral map scenes and taking an advantage of non-visible bandwidths. The solution consists of three parts: dataset development, neural network development, neural network fine-tuning. The first part of the solution suggests a semi-automated method of rapid dataset development using modern tools and keeping the advantages of remote sensing imagery such as very high resolution and using the variety of hyperspectral imagery bandwidths, both - visual and thermal. In order to prove application of a dataset, current article suggests an approach to the problem of remote sensing imagery segmentation using deep fully convolutional neural networks. The best deep learning architectures for instance segmentation are considered and investigated, and the binary classifier for a dataset is built based on Mask RCNN. The final neural network architecture with the new classifier is fine-tuned using alternative configurations and optimizers, and altered to benefit more from the developed hyperspectral remote sensing dataset.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Deep learning in ArcGIS Pro–ArcGIS Pro \(|\) Documentation. https://pro.arcgis.com/en/pro-app/help/analysis/image-analyst/deep-learning-in-arcgis-pro.htm
Export Training Data For Deep Learning (Spatial Analyst)–ArcGIS Pro \(|\) Documentation. https://pro.arcgis.com/en/pro-app/tool-reference/spatial-analyst/export-training-data-for-deep-learning.htm
Papers with Code - Instance Segmentation. https://paperswithcode.com/task/instance-segmentation
The use of geometrical methods in multispectral image processing. https://doi.org/10.1615/JAutomatInfScien.v35.i12.10
Satellite Images Segmentation and Sustainable Farming, July 2018. https://devblogs.microsoft.com/cse/2018/07/05/satellite-images-segmentation-sustainable-farming/
Abdulla, W.: Mask R-CNN for object detection and instance segmentation on keras and tensorflow (2017). https://github.com/matterport/Mask_RCNN
Chen, L., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834–848 (2018). https://doi.org/10.1109/TPAMI.2017.2699184
Dutta, A., Zisserman, A.: The VIA annotation software for images, audio and video. In: Proceedings of the 27th ACM International Conference on Multimedia, pp. 2276–2279. ACM, Nice France, October 2019. https://dl.acm.org/doi/10.1145/3343031.3350535
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask R-CNN (2017)
Heermann, P.D., Khazenie, N.: Classification of multispectral remote sensing data using a back-propagation neural network. IEEE Trans. Geosci. Remote Sensing 30(1), 81–88 (1992). https://doi.org/10.1109/36.124218
Höfener, H., Homeyer, A., Weiss, N., Molin, J., Lundström, C.F., Hahn, H.K.: Deep learning nuclei detection: a simple approach can deliver state-of-the-art results. Comput. Med. Imaging Graph. 70, 43–52 (2018). https://doi.org/10.1016/j.compmedimag.2018.08.010, http://www.sciencedirect.com/science/article/pii/S0895611118300806
Hinton, G.E., Osindero, S., Teh, Y.W.: A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006)
Hnatushenko, V.V., Kavats, O.O., Shevchenko, V.Y.: Improvement the spatial resolution of multichannel aerospace high spatial resolution images on the base of hyperspherical transform. Radio Electron. Comput. Sci. Control (2014). https://doi.org/10.15588/1607-3274-2015-1-10
Hnatushenko, V., Zhernovyi, V.: Complex approach of high-resolution multispectral data engineering for deep neural network processing. In: Lytvynenko, V., Babichev, S., Wójcik, W., Vynokurova, O., Vyshemyrskaya, S., Radetskaya, S. (eds.) ISDMCI 2019. AISC, vol. 1020, pp. 659–672. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-26474-1_46
Hordiiuk, D.M., Hnatushenko, V.V.: Neural network and local laplace filter methods applied to very high resolution remote sensing imagery in urban damage detection. In: 2017 IEEE International Young Scientists Forum on Applied Physics and Engineering (YSF), pp. 363–366 (2017). https://doi.org/10.1109/ysf.2017.8126648
Hordiiuk, D., Oliinyk, I., Hnatushenko, V., Maksymov, K.: Semantic segmentation for ships detection from satellite imagery. In: 2019 IEEE 39th International Conference on Electronics and Nanotechnology (ELNANO), pp. 454–457. IEEE (2019). https://doi.org/10.1109/elnano.2019.87838220
Kashtan, V., Hnatushenko, V., Shedlovska, Y.: Processing technology of multispectral remote sensing images. In: 2017 IEEE International Young Scientists Forum on Applied Physics and Engineering (YSF), pp. 355–358. IEEE (2017). https://doi.org/10.1109/ysf.2017.8126647
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems 25, pp. 1097–1105. Curran Associates, Inc. (2012). http://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf
Kuchuk, H., Podorozhniak, A., Hlavcheva, D., Yaloveha, V.: Application of deep learning in the processing of the aerospace system’s multispectral images. In: Handbook of Research on Artificial Intelligence Applications in the Aviation and Aerospace Industries, pp. 134–147. IGI Global (2020). https://doi.org/10.4018/978-1-7998-1415-3.ch005
Lecun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998). https://doi.org/10.1109/5.726791
Lin, T.Y., et al. Microsoft coco: common objects in context (2014)
McCulloch, W.S.: From logical neurons to poetic embodiments of mind: Warrens. mcculloch’s project in neuroscience. Sci. Context 14(4), 591–614 (2001)
Paola, J.D., Schowengerdt, R.A.: A review and analysis of backpropagation neural networks for classification of remotely-sensed multi-spectral imagery. Int. J. Remote Sensing 16(16), 3033–3058 (1995). https://doi.org/10.1080/01431169508954607
Strachnyi, K.: Brief history of neural networks, January 2019. https://medium.com/analytics-vidhya/brief-history-of-neural-networks-44c2bf72eec
Yokoya, N., Grohnfeldt, C., Chanussot, J.: Hyperspectral and multispectral data fusion: a comparative review of the recent literature. IEEE Geosci. Remote Sensing Mag. 5(2), 29–56 (2017). https://doi.org/10.1109/MGRS.2016.2637824
Zhang, C.W.: EagleView Super-High-Resolution Image Segmentation with Deeplabv3+/Mask-RCNN using Keras/ArcGIS, August 2020. https://towardsdatascience.com/eagleview-super-high-resolution-image-segmentation-with-deeplabv3-mask-rcnn
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Hnatushenko, V., Zhernovyi, V. (2020). Method of Improving Instance Segmentation for Very High Resolution Remote Sensing Imagery Using Deep Learning. In: Babichev, S., Peleshko, D., Vynokurova, O. (eds) Data Stream Mining & Processing. DSMP 2020. Communications in Computer and Information Science, vol 1158. Springer, Cham. https://doi.org/10.1007/978-3-030-61656-4_21
Download citation
DOI: https://doi.org/10.1007/978-3-030-61656-4_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-61655-7
Online ISBN: 978-3-030-61656-4
eBook Packages: Computer ScienceComputer Science (R0)