Classification of Post-earthquake High Resolution Image Using Adaptive Dynamic Region Merging and Gravitational Self-Organizing Maps

  • Aizhu Zhang
  • Yanling Hao
  • Genyun Sun
  • Jinchang RenEmail author
  • Huimin Zhao
  • Sophia Zhao
  • Tariq S. Durrani
Part of the Springer Natural Hazards book series (SPRINGERNAT)


Post-earthquake high resolution image classification has opened up the possibility for rapid damage mapping, which is crucial for damage assessments and emergency rescue. However, the classification accuracy is challenged by the diversity of disaster types as well as the lack of uniform statistical characteristics in post-earthquake high resolution images. In this paper, combining adaptive dynamic region merging (ADRM) and gravitational self-organizing map (gSOM), we propose a novel object-based classification framework. This approach consists of two parts: the segmentation by ADRM and the classification by gSOM. The ADRM produces the homogeneous regions by integrating an adaptive spectral-texture descriptor with a dynamic merging strategy. The gSOM regards the regions as basic unit and characterized them explicitly by fractal texture to adapt to various disaster types. Subsequently, these regions are represented by neurons in a self-organizing map and clustered by adjacency gravitation. By moving the neurons around the gravitational space and merging them according to the gravitation, the gSOM is able to find arbitrary shape and determine the class number automatically. To confirm the validity of the presented approach, three aerial seismic images in Wenchuan covering several disaster types are utilized. The obtained quantitative and qualitative experimental results demonstrated the feasibility and accuracy of the proposed seismic image classification method.


Earthquake High resolution image classification Gravitational self-organizing map Adaptive dynamic region merging 



This study was funded by the National Natural Science Foundation of China (41471353,61672008), the Natural Science Foundation of Shandong Province (ZR201709180096, ZR201702100118), the Fundamental Research Funds for the Central Universities (18CX05030A, 18CX02179A), the Postdoctoral Application and Research Projects of Qingdao (BY20170204), and Guangdong Provincial Application-oriented Technical Research and Development Special fund project (2016B010127006, 2017A050501039).


  1. 1.
    Abdi H, Williams LJ (2010) Principal component analysis. Wiley Interdiscip Rev Comput Stat 2(4):433–459. Scholar
  2. 2.
    Baatz M, Schäpe A (2000) Multiresolution segmentation: an optimization approach for high quality multi-scale image segmentation. Angewandte Geographische Informationsverarbeitung XII:12–23Google Scholar
  3. 3.
    Backes AR, Casanova D, Bruno OM (2012) Color texture analysis based on fractal descriptors. Pattern Recogn 45(5):1984–1992. Scholar
  4. 4.
    Benz UC, Hofmann P, Willhauck G, Lingenfelder I, Heynen M (2004) Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information. ISPRS J Photogramm Remote Sens 58(3–4):239–258. Scholar
  5. 5.
    Bhagavathy S, Manjunath BS (2005) Modeling and detection of geospatial objects using texture motifs. Geosci Remote Sens IEEE Trans 44(12):3706–3715. Scholar
  6. 6.
    Blaschke T (2010) Object based image analysis for remote sensing. ISPRS J Photogramm Remote Sens 65(1):2–16. Scholar
  7. 7.
    Campsvalls G, Bruzzone L (2009) Kernel methods for remote sensing data analysis.
  8. 8.
    Casanova D, Florindo JB, Falvo M, Bruno OM (2016) Texture analysis using fractal descriptors estimated by the mutual interference of color channels. Inf Sci 346–347:58–72. Scholar
  9. 9.
    Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24(5):603–619. Scholar
  10. 10.
    Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. IEEE Trans Pattern Anal Mach Intell 25(5):564–577. Scholar
  11. 11.
    Cooner A, Shao Y, Campbell J (2016) Detection of urban damage using remote sensing and machine learning algorithms: Revisiting the 2010 Haiti earthquake. Remote Sens 8(10):2072–4292. Scholar
  12. 12.
    Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297zbMATHGoogle Scholar
  13. 13.
    Deng Y, Manjunath B (2001) Unsupervised segmentation of color-texture regions in images and video. Pattern Anal Machine Intell IEEE Trans 23(8):800–810. Scholar
  14. 14.
    Dong L, Shan J (2013) A comprehensive review of earthquake-induced building damage detection with remote sensing techniques. ISPRS J Photogramm Remote Sens 84(7):85–99. Scholar
  15. 15.
    Fang L, Li S, Duan W, Ren J, Benediktsson JA (2015) Classification of hyperspectral images by exploiting spectral–spatial information of superpixel via multiple kernels. IEEE Trans Geosci Remote Sens 53(12):6663–6674. Scholar
  16. 16.
    Felzenszwalb PF, Huttenlocher DP (2004) Efficient graph-based image segmentation. Int J Comput Vision 59(2):167–181. Scholar
  17. 17.
    Freixenet J, Muñoz X, Raba D, Martí J, Cufí X (2002) Yet another survey on image segmentation: region and boundary information integration. In: Proceedings ECCV 2002, vol 2352, pp 408–422.
  18. 18.
    Gaetano R, Masi G, Poggi G, Verdoliva L, Scarpa G (2015) Marker-controlled watershed-based segmentation of multiresolution remote sensing images. IEEE Trans Geosci Remote Sens 53(6):2987–3004. Scholar
  19. 19.
    Gamba P (1998) GIS and image understanding for near-real-time earthquake damage assessment. Photogramm Eng Remote Sens 64(10):987–994.
  20. 20.
    Geiß C, Pelizari PA, Marconcini M, Sengara W, Edwards M, Lakes T, Taubenböck H (2015) Estimation of seismic building structural types using multi-sensor remote sensing and machine learning techniques. Isprs J Photogramm Remote Sens 104:175–188. Scholar
  21. 21.
    Han J, Zhang D, Cheng G, Guo L, Ren J (2015) Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning. IEEE Trans Geosci Remote Sens 53(6):3325–3337. Scholar
  22. 22.
    Hao Y, Sun G (2016) Gravitational self-organizing map-based seismic image classification with an adaptive spectral-textural descriptor. SPIE Remote Sensing. doi 10(1117/12):2241272Google Scholar
  23. 23.
    Hay GJ, Blaschke T, Marceau DJ, Bouchard A (2003) A comparison of three image-object methods for the multiscale analysis of landscape structure. ISPRS J Photogramm Remote Sens 57(5–6):327–345. Scholar
  24. 24.
    Hwang B, Renn J, McCormack S, Berry C, Ben Ayed I, Graber HC, Aptoula E (2017) A practical algorithm for the retrieval of floe size distribution of Arctic sea ice from high-resolution satellite synthetic aperture radar imagery. Elem Sci Anth 5:38.
  25. 25.
    Ilc N, Dobnikar A (2012) Generation of a clustering ensemble based on a gravitational self-organising map. Neurocomputing 96:47–56. Scholar
  26. 26.
    Jiangye Y, Wang DL, Li X (2014) Remote sensing image segmentation by combining spectral and texture features. IEEE Trans Geosci Remote Sens 52(1):16–24. Scholar
  27. 27.
    Kailath T (1967) The divergence and Bhattacharyya distance measures in signal selection. IEEE Trans commun Technol 15(1):52–60. Scholar
  28. 28.
    Kiranyaz S, Birinci M, Gabbouj M (2010) Perceptual color descriptor based on spatial distribution: a top-down approach. Image Vis Comput 28(8):1309–1326. Scholar
  29. 29.
    Lang F, Yang J, Li D, Zhao L, Shi L (2014) Polarimetric SAR image segmentation using statistical region merging. IEEE Geosci Remote Sens Lett 11(2):509–513. Scholar
  30. 30.
    Li P, Song B, Xu H (2011) Urban building damage detection from very high resolution imagery by one-class SVM and shadow information. In: IEEE international geoscience and remote sensing symposium, Igarss 2011, Vancouver, Bc, Canada, July, 2011. pp 1409–1412.
  31. 31.
    Liu J, Li P, Wang X (2015) A new segmentation method for very high resolution imagery using spectral and morphological information. ISPRS J Photogramm Remote Sens 101:145–162. Scholar
  32. 32.
    Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Computer vision, 2001. ICCV 2001. Proceedings. Eighth IEEE international conference on, 2001. vol. 412, pp 416–423.
  33. 33.
    Meilă M (2007) Comparing clusterings—an information based distance. J Multivar Anal 98(5):873–895. Scholar
  34. 34.
    Ming D, Ci T, Cai H, Li L, Qiao C, Du J (2012) Semivariogram-based spatial bandwidth selection for remote sensing image segmentation with mean-shift algorithm. Geosci Remote Sens Lett IEEE 9(5):813–817. Scholar
  35. 35.
    Nex F, Rupnik E, Toschi I, Remondino F (2014) Automated processing of high resolution airborne images for earthquake damage assessment. ISPRS Int Arch Photogramm Remote Sens Spatial Inf Sci XL-1(1):315–321.
  36. 36.
    Pudil P, Somol P, Haindl M (1972) Introduction to statistical pattern recognition. Acad Press. Scholar
  37. 37.
    Qiao T, Ren J, Wang Z, Zabalza J, Sun M, Zhao H, Li S, Yuen P, Zhao H, Benediktsson JA, Dai Q, Marshall S (2017) Effective denoising and classification of hyperspectral images using curvelet transform and singular spectrum analysis. IEEE Trans Geosci Remote Sens 55(1):119–133. Scholar
  38. 38.
    Qiao T, Yang Z, Ren J, Yuen P, Zhao H, Sun G, Marshall S, Benediktsson JA (2017) Joint bilateral filtering and spectral similarity-based sparse representation: a generic framework for effective feature extraction and data classification in hyperspectral imaging. Pattern Recogn 77:316–328. Scholar
  39. 39.
    Ren J, Zabalza J, Marshall S, Zheng J (2014) Effective feature extraction and data redution in remote sensing using hyperspectral imaging. IEEE Signal Process Mag 31(4):149–154. Scholar
  40. 40.
    Richard N, Frank N (2004) Statistical region merging. IEEE Trans Pattern Anal Mach Intell 26(11):1452–1458. Scholar
  41. 41.
    Sabuncu A, Avci ZDU, Sunar F (2016) Preliminary results of earthquake-induced building damage detection with object-based image classification. ISPRS Int Arch Photogramm Remote Sens Spatial Inf Sci 2016:347–350. Scholar
  42. 42.
    Strehl A, Ghosh J (2003) Cluster ensembles—a knowledge reuse framework for combining multiple partitions. J Machine Learn Res 3(3):583–617. Scholar
  43. 43.
    Sumengen B (2004) Variational image segmentation and curve evolution on natural images. University of California, Santa BarbaraGoogle Scholar
  44. 44.
    Sun G, Hao Y, Chen X, Ren J, Zhang A, Huang B, Zhang Y, Jia X (2017) Dynamic post-earthquake image segmentation with an adaptive spectral-spatial descriptor. Remote Sens 9(9):899. Scholar
  45. 45.
    Sun G, Ma P, Ren J, Li X, Zhang A, Jia X (2018) A stability constrained adaptive alpha for gravitational search algorithm. Knowl Based Syst 139:200–213. Scholar
  46. 46.
    Tiede D, Lang S, Füreder P, Hölbling D, Hoffmann C, Zeil P (2011) Automated damage indication for rapid geospatial reporting. An operational object-based approach to damage density mapping following the 2010 Haiti earthquake. Photogramm Eng Remote Sens 77 (9):933–942.
  47. 47.
    Vetrivel A, Gerke M, Kerle N, Nex F, Vosselman G (2017) Disaster damage detection through synergistic use of deep learning and 3D point cloud features derived from very high resolution oblique aerial images, and multiple-kernel-learning. ISPRS J Photogramm Remote Sens. Scholar
  48. 48.
    Wang Z, Ren J, Zhang D, Sun M, Jiang J (2018) A deep-learning-based feature hybrid framework for spatiotemporal saliency detection inside videos. Neurocomputing 287:68–83. Scholar
  49. 49.
    Witharana C, Civco DL, Meyer TH (2014) Evaluation of data fusion and image segmentation in earth observation based rapid mapping workflows. ISPRS J Photogramm Remote Sens 87:1–18. Scholar
  50. 50.
    Yan Y, Ren J, Sun G, Zhao H, Han J, Li X, Marshall S, Zhan J (2018) Unsupervised image saliency detection with Gestalt-laws guided optimization and visual attention based refinement. Pattern Recogn 79:65–78. Scholar
  51. 51.
    Yang M, Zhang L, Shiu CK, Zhang D (2012) Monogenic binary coding: an efficient local feature extraction approach to face recognition. IEEE Trans Inf Forensics Secur 7(6):1738–1751. Scholar
  52. 52.
    Zabalza J, Ren J, Yang M, Zhang Y, Wang J, Marshall S, Han J (2014) Novel Folded-PCA for improved feature extraction and data reduction with hyperspectral imaging and SAR in remote sensing. ISPRS J Photogramm Remote Sens 93:112–122. Scholar
  53. 53.
    Zabalza J, Ren J, Zheng J, Han J, Zhao H, Li S, Marshall S (2015) Novel two-dimensional singular spectrum analysis for effective feature extraction and data classification in hyperspectral imaging. IEEE Trans Geosci Remote Sens 53(8):4418–4433. Scholar
  54. 54.
    Zhang A, Sun G, Ren J, Li X, Wang Z, Jia X (2018) A dunamic neighborhood learning-based gravitational search algorithm. IEEE Trans Cybern 48(1):436–447. Scholar
  55. 55.
    Zhao W, Du S (2016) Learning multiscale and deep representations for classifying remotely sensed imagery. ISPRS J Photogramm Remote Sens 113:155–165. Scholar
  56. 56.
    Zhou C, Wu D, Qin W, Liu C (2015) An efficient two-stage region merging method for interactive image segmentation. Comput Electr Eng 54:220–229. Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Aizhu Zhang
    • 1
  • Yanling Hao
    • 1
  • Genyun Sun
    • 1
  • Jinchang Ren
    • 2
    Email author
  • Huimin Zhao
    • 3
    • 4
  • Sophia Zhao
    • 2
  • Tariq S. Durrani
    • 2
  1. 1.School of GeosciencesChina University of PetroleumQingdaoChina
  2. 2.Department of Electronic and Electrical EngineeringUniversity of StrathclydeGlasgowUK
  3. 3.School of ComputersGuangdong Polytechnic Normal UniversityGuangzhouChina
  4. 4.Guangzhou Key Lab Digital Contents and SecurityGuangzhouChina

Personalised recommendations