Skip to main content
Log in

Urban areas extraction from multi sensor data based on machine learning and data fusion

  • Applied Problems
  • Published:
Pattern Recognition and Image Analysis Aims and scope Submit manuscript

Abstract

Accurate urban areas information is important for a variety of applications, especially city planning and natural disaster prediction and management. In recent years, extraction of urban structures from remotely sensed images has been extensively explored. The key advantages of this imaging modality are reduction of surveying expense and time. It also elevates restrictions on ground surveys. Thus far, much research typically extracts these structures from very high resolution satellite imagery, which are unfortunately of relatively poor spectral resolution, resulting in good precision yet moderate accuracy. Therefore, this paper investigates extraction of buildings from middle and high resolution satellite images by using spectral indices (Normalized Difference Building Index: NDBI, Normalized Difference Vegetation Index: NDVI, Soil Adjustment Vegetation Index: SAVI, Modified Normalized Difference Index: MNDWI, and Global Environment Monitoring Index: GEMI) by means of various Machine Learning methods (Artificial Neural Network: ANN, K-Nearest Neighbor: KNN, and Support Vector Machine: SVM) and Data Fusion (i.e., Majority Voting). Herein empirical results suggested that suitable learning methods for urban areas extraction are in preferring order Data Fusion, SVM, KNN, and ANN. Their accuracies were 85.46, 84.86, 84.66, and 84.91%, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. X. Huang, L. Zhang, and T. Zhu, “Building change detection from multitemporal high-resolution remotely sensed images based on a morphological building index,” IEEE J. Select. Topics Appl. Earth Observ. Remote Sensing 7 (1), 105–115 (2014).

    Article  Google Scholar 

  2. A. Blanco-Vogt, N. Haala, and J. Schanze, “Building parameters extraction from remote-sensing data and GIS analysis for the derivation of a building taxonomy of settlements: A contribution to flood building susceptibility assessment,” Int. J. Image Data Fusion 6 (1), 22–41 (2015).

    Article  Google Scholar 

  3. S. Ahadzadeh, M. Valadanzouj, S. Sadeghian, and S. Ahmadi, “Detection of damaged buildings after an earthquake using artificial neural network algorithm,” in Proc. 21st. Silk Road for Information from Imagery ISPRS (Beijing, 2008).

    Google Scholar 

  4. W. H. Cui, X. Feng, and K. Qin, “The pixel rectangle index used in object based building extraction from high resolution images,” in IOP Conf. Series: Earth and Environmental Science (2014), p. 012233.

    Google Scholar 

  5. X. Jin, and C.H. Davis, “Automated building extraction from high-resolution satellite imagery in urban areas using structural, contextual, and spectral information,” EURASIP J. Appl. Signal Processing 14, 2196–2206 (2005).

    Article  MATH  Google Scholar 

  6. Z. Liu, S. Cui, and Q. Yan, “Building extraction from high resolution satellite imagery based on multi-scale image segmentation and model matching,” in Proc. Conf. on Earth Observation and Remote Sensing Applications (Beijing, 2008), pp. 1–7.

    Google Scholar 

  7. W. M. Muhammad, M. J. Fatimah, M. Fafia, and H. Ejaz, “Development of new indices for extraction of built-up area and bare soil from Landsat data,” Open Access Sci. Rep. 1, 1–4 (2012).

    Google Scholar 

  8. M. Uzar, and N. Yastikli, “Automatic building extraction using LiDAR and aerial photographs,” Boletim de ciencias geodesicas. 19 (2), 153–171 (2013).

    Article  Google Scholar 

  9. M. Awrangjeb, G. Lu, and C. Fraser, “Automatic building extraction from LIDAR data covering complex urban scenes,” ISPRS-Int. Archives Photogrammetry, Remote Sensing Spatial Inf. Sci. 1, 25–32 (2014).

    Article  Google Scholar 

  10. H. Sportouche, F. Tupin, and L. Denise, “Building extraction and 3D reconstruction in urban areas from high-resolution optical and SAR imagery,” in Proc. Joint Conf. on Urban Remote Sensing Event2009 (Shanghai, 2009), pp. 1–11.

    Google Scholar 

  11. S. D. Jawak, and A. J. Luis, “A rapid extraction of water body features from Antarctic coastal oasis using very high-resolution satellite remote sensing data,” Aquatic Proc. 4, 125–132 (2015).

    Article  Google Scholar 

  12. W. Ye, X. Li, X. Chen, and G. Zhang, “A spectral index for highlighting forest cover from remotely sensed imagery,” in SPIE Asia Pacific Remote Sensing (2014), pp. 92601L–92601L.

    Google Scholar 

  13. K. Shahi, H.Z. Shafri, E. Taherzadeh, S. Mansor, and R. Muniandy, “A novel spectral index to automatically extract road networks from WorldView-2 satellite imagery,” Egypt. J. Remote Sensing Space Sci. 18 (1), 27–33 (2015).

    Article  Google Scholar 

  14. Y. Zha, S. X. Ni, and S. Yang, “An effective approach to automatically extract urban land-use from TM imagery,” J. Remote Sens. 7, 37–40 (2003).

    Google Scholar 

  15. J. W. Rouse, R. H. Haas, J. A. Schell, and D. W. Deering, “Monitoring vegetation systems in the Great Plains with ERTS,” in Proc. 3rd ERTS Symp. (Washington, 1973), pp. 309–317.

    Google Scholar 

  16. A. R. Huete, “A soil-adjusted vegetation index (SAVI),” Remote Sens. Environ. 25 (3), 295–309 (1988).

    Article  Google Scholar 

  17. H. Xu, “Modification of normalised difference water index (NDWI) to enhance open water features in remotely sensed imagery,” Int. J. Remote Sens. 27, 3025–3033 (2006).

    Article  Google Scholar 

  18. B. Pinty, and M. M. Verstraete, “GEMI: a non-linear index to monitor global vegetation from satellites,” Vegetatio 101 (1), 15–20 (1992).

    Article  Google Scholar 

  19. H. Xu, “A new index for delineating built-up land features in satellite imagery,” Int. J. Remote Sens. 29 (14), 4269–4276 (2008).

    Article  Google Scholar 

  20. L. Ying and L. Huiping, “Regional urban area extraction using MODIS data and DMSP/OLS data,” in Proc. Int. Conf. on Remote Sensing, Environment, and Transportation Engineering (Nanjing, 2013).

    Google Scholar 

  21. J. Lee, S. S. Lee, and K. H. Chi, “Development of an urban classification method using a built-up index,” in Proc. 6th WSEAS Int. Conf. on Remote Sensing (Iwate, 2010), pp. 39–43.

    Google Scholar 

  22. A. Carleer, and E. Wolff, “The VHR data region-based classification possibilities in the framework of control with remote sensing of European CAP,” in Proc. 31st Int. Symp. of Remote Sensing on Environment (St. Petersburg, 2005).

    Google Scholar 

  23. M. Herold, M. E. Gardner, and D. Roberts, “Spectral resolution requirements for mapping urban areas,” IEEE Trans. Geosci. Remote Sensing 41 (9), 1907–1919 (2003).

    Article  Google Scholar 

  24. D. P. Roy, J. Ju, C. Mbow, P. Frost, and T. Loveland, “Accessing free Landsat data via the Internet: Africa’s challenge,” Remote Sensing Lett. 1 (2), 111–117 (2010).

    Article  Google Scholar 

  25. J. Ju, and D. P. Roy, “The availability of cloud-free Landsat ETM+ data over the conterminous United States and globally,” Remote Sensing Environ. 112 (3), 1196–1211 (2008).

    Article  Google Scholar 

  26. M. Erdogan, H. H. Maras, A. Yilmaz, and O. T. Ozerbil, “Resolution merge of 1: 35000 scale aerial photographs with Landsat 7 ETM imagery,” Int. Archives Photogrammetry, Remote Sensing, Spatial Inf. Sci. 37, 1281–1285 (2008).

    Google Scholar 

  27. Q. Yu, P. Gong, N. Clinton, G. Biging, M. Kelly, and D. Schirokauer, “Object-based detailed vegetation classification with airborne high spatial resolution remote sensing imagery,” Photogrammetric Eng. Remote Sensing 72 (7), 799–811 (2006).

    Article  Google Scholar 

  28. H. Xu, “Extraction of urban built-up land features from Landsat imagery using a thematic oriented index combination technique,” Photogrammetric Eng. Remote Sensing 73 (12), 1381–1391 (2007).

    Article  Google Scholar 

  29. J. Wang, “Detection of buildings from Landsat-7 ETM+ and SPOT panchromatic data in Beijing, China,” in Proc. IEEE Int. Geoscience and Remote Sensing Symp. (2002), pp. 2977–2979.

    Google Scholar 

  30. L. Hua, W. Man, Q. Wang, and X. Zhao, “A new decision tree classification approach for extracting urban land from Landsat TM in a coastal city, China,” in Proc. Int. Symp. on Information Science and Engineering (ISISE) (Toronto, 2012), pp. 282–286.

    Google Scholar 

  31. Y. Qiao, H. Liu, M. Bai, X. Wang, and X. Zhou, “The decision tree algorithm of urban extraction from multisource image data,” in Proc. ISPRS Workshop Virtual Changing Globe for Visualization and Analysis (Wuhan, 2009).

    Google Scholar 

  32. N. Patel, and R. Mukherjee, “Extraction of impervious features from spectral indices using artificial neural network,” Arabian J. Geosci. 8 (6), 3729–3741 (2014).

    Article  Google Scholar 

  33. C. He, P. Shi, D. Xie, and Y. Zhao, “Improving the normalized difference built-up index to map urban built-up areas using a semiautomatic segmentation approach,” Remote Sensing Lett. 1 (4), 213–221 (2010).

    Article  Google Scholar 

  34. D. Singh, R. Maurya, A. S. Shukla, M. K. Sharma, and P. R. Gupta, “Building extraction from very high resolution multispectral images using NDVI based segmentation and morphological operators,” in Proc. Conf. on Engineering and Systems (SCES) (Busan, 2012), pp. 1–5.

    Google Scholar 

  35. V. Pandit, S. Gupta, and K. S. Rajan, “Color based urban scene classification using high resolution satellite imagery,” in Proc. Int. Conf. on Image Processing, Computer Vision, and Pattern Recognition (IPCV’09) (Las Vegas, 2009), pp. 13–16.

    Google Scholar 

  36. Y. H. Lu, J. Trunder, and K. Kubik, “Automatic building extraction for 3D terrain reconstruction using interpretation techniques,” in Proc. School of Surveying and Spatial Information Systems (University of New South Wales, 2002).

    Google Scholar 

  37. B. Rami, F. XueZhi, X. Pengfeng, and Z. Shuhe, “Avoiding the blue roof data during extracting vegetation from high resolution images,” in Proc. Int. Conf. on Geo-Spatial Solutions for Emergency Management and the 50th Anniversary of the Chinese Academy of Surveying and Mapping (Beijing, 2009), pp 88–91.

    Google Scholar 

  38. C. Puente, G. Olague, S. V. Smith, S. H. Bullock, A. Hinojosa-Corona, and M. A. González-Botello, “A genetic programming approach to estimate vegetation cover in the context of soil erosion assessment,” Photogrammetric Eng. Remote Sensing 77 (4), 363–376 (2011).

    Article  Google Scholar 

  39. A. H. Souri, A. Mohammadi, and M. A. Sharifi, “A new prompt for building extraction in high resolution remotely sensed imagery,” in Proc. Int. Archives of the Photogrammetry, Remote Sensing, and Spatial Information Sciences (2013), pp. 405–408.

    Google Scholar 

  40. Y. Song and J. Shan, “Building extraction from high resolution color imagery based on edge flow driven active contour and JSEG,” IAPRSIS 37, 185–190 (2008).

    Google Scholar 

  41. Z. Lari, and H. Ebadi, “Automated building extraction from high-resolution satellite imagery using spectral and structural information based on artificial neural networks,” in Proc. ISPRS Workshop (Hannover, 2007).

    Google Scholar 

  42. L. Sahar, S. Muthukumar, and S. P. French, “Using highresolution aerial photography and neural networks to inventory properties at risk of earthquakes,” in Proc. MAPPS/ASPRS Fall Conf. (San Antonio, TX, 2006).

    Google Scholar 

  43. A. M. Ramiya, R. R. Nidamanuri, and R. Krishnan, “Semantic labelling of urban point cloud data,” ISPRS-Int. Archives Photogrammetry, Remote Sensing Spatial Inf. Sci. 1, 907–911 (2014).

    Article  Google Scholar 

  44. L. G. Palamuleni, and N. N. Ndou, “Developing remote sensing methodology to distinguish urban builtup areas and bare land in Mafikeng town, South Africa,” in Proc. IEEE Int. Geoscience and Remote Sensing Symp. (IGARSS) (Quebec, 2014), pp. 2205–2208.

    Google Scholar 

  45. D. Mammass, A. Elhassouny, and D. Ducrot, “SVM classification of urban high-resolution imagery using composite kernels and contour information,” Statistics 4 (7), 126–141 (2013).

    Google Scholar 

  46. M. Turker, and K. San, “Building detection from pansharpened Ikonos imagery through support vector machines classification,” in Proc. 8th ISPRS Technical Com. Symp. (Kyoto, 2010), pp. 841–846.

    Google Scholar 

  47. M. Turker, and D. Koc-San, “Building extraction from high-resolution optical spaceborne images using the integration of support vector machine (SVM) classification, Hough transformation and perceptual grouping,” Int. J. Appl. Earth Observ. Geoinf. 34, 58–69 (2015).

    Article  Google Scholar 

  48. T. M. Cover and P. E. Hart, “Nearest neighbor pattern classification,” IEEE Trans. Inf. Theory 13 (1), 21–27 (1967).

    Article  MATH  Google Scholar 

  49. E. Shahkooeei, S. Arekhi, and A. N. Kani, “Remote sensing and GIS for mapping and monitoring land cover and land use changes using support vector machine algorithm (Case study: Ilam dam watershed),” Int. Res. J. Appl. Basic Sci. 8 (4), 464–473 (2014).

    Google Scholar 

  50. Q. Z. Ge, Z. C. Ling, L. Qiong, X. X. Hui, and G. Zhang, “High efficient classification on remote sensing images based on SVM,” in Proc. Int. Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (2008), pp. 1011–1014.

    Google Scholar 

  51. B. C. Kuo, H. H. Ho, C. H. Li, C. C. Hung, and J. S. Taur, “A kernel-based feature selection method for SVM with RBF kernel for hyperspectral image classification,” IEEE J. Selected Topics Appl. Earth Observ. Remote Sensing 7 (1), 317–326 (2014).

    Article  Google Scholar 

  52. P. Horkaew, S. Puttinaovarat, and K. Khaimook, “River boundary delineationfrom remotely sensed imagery based on SVM and relaxation labeling of water index and DSM,” J. Theor. Appl. Inform. Technol. 71 (3), 376–386 (2015).

    Google Scholar 

  53. H. Elmannai, M. A. Loghmari, and M. S. Naceur, “Support vector machine for remote sensing image classification,” in Proc. Int. Conf. on Control, Engineering, and Information Technology (Sousse, 2013), pp. 68–72.

    Google Scholar 

  54. H. Fadaei, R. Suzuki, and R. Avtar, “Estimation tree density as object-based in arid and semi-arid regionsusing ALOS,” in Proc. 4th GEOBIA (Ghent, 2010), pp. 668–671.

    Google Scholar 

  55. Z. Hannv, J. Qigang, and X. Jiang, “Coastline extraction using support vector machine from remote sensing image,” J. Multimedia 8 (2), 175–182 (2013).

    Article  Google Scholar 

  56. L. Lam, and C. Y. Suen, “Application of majority voting to pattern recognition: an analysis of its behavior and performance,” IEEE Trans. Syst., Man Cybernet., Part A: Syst. Humans 27 (5), 553–568 (1997).

    Article  Google Scholar 

  57. L. Hégarat-Mascle, I. Bloch, and D. Vidal-Madjar, “Application of Dempster-Shafer evidence theory to unsupervised classification in multisource remote sensing,” in Proc. IEEE Trans. Geosci. Remote Sensing 35 (4), 1018–1031 (1997).

    Article  Google Scholar 

  58. Y. H. Lu, J. C. Trinder, and K. Kubik, “Automatic building detection using the Dempster-Shafer algorithm,” Photogrammetric Eng. Remote Sensing 72 (4), 395–403 (2006).

    Article  Google Scholar 

  59. U. Kumar, C. Milesi, R. R. Nemani, and S. Basu, “Multi-sensor multi-resolution image fusion for improved vegetation and urban area classification,” in Proc. Int. Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (2015), pp. 51–58.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to S. Puttinaovarat.

Additional information

The article is published in the original.

Supattra Puttinaovarat was born in 1983. Received her B.B.A. (Second Class Honors) in Business Computer and M.S. degree in Management of Information Technology from Prince of Songkla University, Thailand in 2007 and 2010, respectively. She is a lecturer at Faculty of Science and Industrial Technology, Prince of Songkla University, Suratthani Campus, Thailand. Her research interest includes Flood Modeling and Geographic Information System. She has published 10 scientific peer reviewed journal and conference paper.

Paramate Horkaew was born in 1978. Received his B.Eng. (First Class Honors) in Telecommunication Engineering (1999) from King Mongkut’s Institute of Technology, Ladkrabang, Thailand and Ph.D. in Computer Science from Imperial College London, University of London, London, United Kingdom (2004). He is an assistant professor at the School of Computer Engineering, Suranaree University of Technology, Thailand. His main research interests include Computational Anatomy, Digital Geometry Processing, Computer Vision and Graphics. He is the author of more than 30 peer reviewed journal and conference.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Puttinaovarat, S., Horkaew, P. Urban areas extraction from multi sensor data based on machine learning and data fusion. Pattern Recognit. Image Anal. 27, 326–337 (2017). https://doi.org/10.1134/S1054661816040131

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S1054661816040131

Keywords

Navigation