Abstract
Hurricanes are tropical storms that cause immense damage to human life and property. Rapid assessment of damage caused by hurricanes is extremely important for the first responders. But this process is usually slow, expensive, labor intensive and prone to errors. The advancements in remote sensing and computer vision help in observing Earth at a different scale. In this paper, a new Convolutional Neural Network model has been designed with the help of satellite images captured from the areas affected by hurricanes. The model will be able to assess the damage by detecting damaged and undamaged buildings based upon which the relief aid can be provided to the affected people on an immediate basis. The model is composed of five convolutional layers, five pooling layers, one flattening layer, one dropout layer and two dense layers. Hurricane Harvey dataset consisting of 23,000 images of size 128 × 128 pixels has been used in this paper. The proposed model is simulated on 5750 test images at a learning rate of 0.00001 and 30 epochs with the Adam optimizer obtaining an accuracy of 0.95 and precision of 0.97. The proposed model will help the emergency responders to determine whether there has been damage or not due to the hurricane and also help those to provide relief aid to the affected people.
Similar content being viewed by others
Data availability statement
The data has been taken from Kaggle https://www.kaggle.com/kmader/satellite-images-of-hurricane-damage.
References
Alyami H, Alharbi A, Irfan Uddin M (2020) Lifelong machine learning for regional-based image classification in open datasets. Symmetry 12(12):2094–3011
Aziz F, Ahmad T, Malik AH, Irfan Uddin M, Ahmad S, Sharaf M (2020) Reversible data hiding techniques with high message embedding capacity in images. PLoS ONE 15(5):1–24
Ba JL, Kiros JR, Hinton GE (2016) Layer normalization. arXiv preprint arXiv:1607.06450
Betz JM, Brown PN, Roman MC (2011) Accuracy, precision, and reliability of chemical measurements in natural products research. Fitoterapia 82(1):44–52
Boussioux L, Zeng C, Guénais T, Bertsimas D (2020) Hurricane forecasting: a novel multimodal machine learning framework. arXiv preprint arXiv:2011.06125.
Cao QD, Choe Y (2020) Building damage annotation on post-hurricane satellite imagery based on convolutional neural networks. Nat Hazards 103(3):3357–3376
Chen SA, Escay A, Haberland C, Schneider T, Staneva V, Choe Y (2018) Benchmark dataset for automatic damaged building detection from post-hurricane remotely sensed imagery. arXiv preprint arXiv:1812.05581.
Choi D, Shallue CJ, Nado Z, Lee J, Maddison CJ, Dahl GE (2019) On empirical comparisons of optimizers for deep learning. arXiv preprint arXiv:1910.05446
Dawood M, Asif A (2019) Deep-PHURIE: deep learning based hurricane intensity estimation from infrared satellite imagery. Neural Comput Appl pp. 1–9
Denil M, Shakibi B, Dinh L, Ranzato MA, De Freitas N (2013) Predicting parameters in deep learning. arXiv preprint arXiv:1306.0543.
Doshi J, Basu S, Pang G (2018) From satellite imagery to disaster insights. arXiv preprint, arXiv:1812.07033
Dotel S, Shrestha A, Bhusal A, Pathak R, Shakya A, Panday SP (2020) Disaster assessment from satellite imagery by analysing topographical features using deep learning. In: Proceedings of the 2020 2nd International Conference on Image, Video and Signal Processing (pp. 86–92)
Dotel S, Shrestha A, Bhusal A, Pathak R, Shakya A, Panday SP (2020) Disaster assessment from satellite imagery by analysing topographical features using deep learning. In: Proceedings of the 2020 2nd International Conference on Image, Video and Signal Processing, pp. 86–92
Duarte D, Nex F, Kerle N, Vosselman G (2018) Satellite image classification of building damages using airborne and satellite image samples In: A Deep Learning Approach. ISPRS Ann Photogrammet, Remote Sens & Spatial Inform Sci, 4(2)
Duda J (2019) SGD momentum optimizer with step estimation by online parabola model. arXiv preprint arXiv:1907.07063
El Naqa I, Li R, Murphy MJ eds (2015) Machine learning in radiation oncology: theory and applications. Springer
Fürnkranz J, Flach PA (2003) An analysis of rule evaluation metrics. In: Proceedings of the 20th international conference on machine learning (ICML-03) (pp. 202–209)
Gazzea M, Karaer A, Ghorbanzadeh M, Balafkan N, Abichou T, Ozguven EE, Arghandeh R (2021) Automated satellite-based assessment of hurricane impacts on roadways. IEEE Trans Ind Inform
Handelman GS, Kok HK, Chandra RV, Razavi AH, Huang S, Brooks M, Lee MJ, Asadi H (2019) Peering into the black box of artificial intelligence: evaluation metrics of machine learning methods. Am J Roentgenol 212(1):38–43
Hossin M, Sulaiman MN (2015) A review on evaluation metrics for data classification evaluations. Int J Data Mining & Knowl Manag Process 5(2):1
Kaur S, Gupta S, Singh S, Gupta I (2021) Detection of Alzheimer’s disease using deep convolutional neural network. Int J Image and Graph. https://doi.org/10.1142/S021946782140012X
Kumar A, Sarkar S, Pradhan C (2020) Malaria disease detection using cnn technique with sgd, rmsprop and adam optimizers. In: Deep Learning Techniques for Biomedical and Health Informatics (pp. 211–230). Springer, Cham
Lee IK, Shamsoddini A, Li X, Trinder JC, Li Z (2016) Extracting hurricane eye morphology from spaceborne SAR images using morphological analysis. ISPRS J Photogramm Remote Sens 117:115–125
Li Z, Gong B, Yang T (2016) Improved dropout for shallow and deep learning. Adv Neural Inf Process Syst 29:2523–2531
Li Y, Ye S, Bartoli I (2018) Semisupervised classification of hurricane damage from postevent aerial imagery using deep learning. J Appl Remote Sens 12(4):045008
Li Y, Hu W, Dong H, Zhang X (2019) Building damage detection from post-event aerial imagery using single shot multibox detector. Appl Sci 9(6):1128
Lydia A, Francis S (2019) Adagrad—an optimizer for stochastic gradient descent. Int. J. Inf. Comput. Sci, 6(5)
Naz N, Malik AH, Khurshid AB, Aziz F, Bader Alouffi M, Uddin I, AlGhamdi A (2020) Efficient processing of image processing applications on CPU/GPU. Math Problem Eng 2020(10):1–14
Ng B, Quinete N, Gardinali PR (2020) Assessing accuracy, precision and selectivity using quality controls for non-targeted analysis. Sci Total Environ 713:136568
Nia KR, Mori G (2017) Building damage assessment using deep learning and ground-level image data. In: 2017 14th conference on computer and robot vision (CRV) (pp. 95–102). IEEE
Perez L, Wang J (2017) The effectiveness of data augmentation in image classification using deep learning. arXiv preprint arXiv:1712.04621
Phung VH, Rhee EJ (2019) A high-accuracy model average ensemble of convolutional neural networks for classification of cloud image patches on small datasets. Appl Sci 9(21):4500
Pi Y, Nath ND, Behzadan AH (2020) Convolutional neural networks for object detection in aerial imagery for disaster response and recovery. Adv Eng Inform 43:101009
Pradhan R, Aygun RS, Maskey M, Ramachandran R, Cecil DJ (2017) Tropical cyclone intensity estimation using a deep convolutional neural network. IEEE Trans Image Process 27(2):692–702
Pritt M, Chern G (2017) Satellite image classification with deep learning. In: 2017 IEEE Applied Imagery Pattern Recognition Workshop (AIPR) pp. 1–7. IEEE
Robertson BW, Johnson M, Murthy D, Smith WR, Stephens KK (2019) Using a combination of human insights and ‘deep learning’for real-time disaster communication. Prog Dis Sci, 2, p.100030
Scannell CM, Veta M, Villa AD, Sammut EC, Lee J, Breeuwer M, Chiribiri A (2020) Deep-learning-based preprocessing for quantitative myocardial perfusion MRI. J Magn Reson Imaging 51(6):1689–1696
Shin HC, Roth HR, Gao M, Lu L, Xu Z, Nogues I, Yao J, Mollura D, Summers RM (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35(5):1285–1298
Wichrowska O, Maheswaranathan N, Hoffman MW, Colmenarejo SG, Denil M, Freitas N, Sohl-Dickstein J (2017) Learned optimizers that scale and generalize. In: International Conference on Machine Learning (pp. 3751–3760). PMLR
Zheng X, Wang M, Ordieres-Meré J (2018) Comparison of data preprocessing approaches for applying deep learning to human activity recognition in the context of industry 4. 0. Sensors 18(7):2146
Zhou J, Gandomi AH, Chen F, Holzinger A (2021) Evaluating the quality of machine learning explanations: a survey on methods and metrics. Electronics 10(5):593
Acknowledgements
This work was supported by Taif University Researchers Supporting Project Number (TURSP-2020/114), Taif University, Taif, Saudi Arabia.
Funding
This work was supported by Taif university Researchers Supporting Project Number (TURSP-2020/114), Taif University, Taif, Saudi Arabia.
Author information
Authors and Affiliations
Contributions
SK -idea for the article, performed the literature search, prepared the dataset, design the CNN model, conceived the experiment, wrote the Paper. SG, AZ and SS – Conceptualization, drafted and critically revised the work, formal analysis, analyzing and interpretation of data, supervision. DK, AZ—Formal analysis, drafted and critically revised the work, supervision.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflicts of interest to report regarding the present study.
Ethical approval
Ethical approval is not applicable to manuscript.
Informed consent
Informed Consent is not applicable to manuscript.
Additional information
Communicated by Irfan Uddin.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kaur, S., Gupta, S., Singh, S. et al. Convolutional neural network based hurricane damage detection using satellite images. Soft Comput 26, 7831–7845 (2022). https://doi.org/10.1007/s00500-022-06805-6
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-022-06805-6