Skip to main content
SpringerLink
Log in

RS-MSSF Frame: Remote Sensing Image Classification Based on Extraction and Fusion of Multiple Spectral-Spatial Features

  • Conference paper
  • First Online:
Advances in Multimedia Information Processing – PCM 2018 (PCM 2018)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11165))

Included in the following conference series:

Abstract

Classifying remote sensing images with high spectral and spatial resolution became an important topic and challenging task in computer vision and remote sensing (RS) fields because of their huge dimensionality and computational complexity. Recently, many studies have already demonstrated the efficiency of employing spatial information where a combination of spectral and spatial information in a single classification framework have attracted special attention because of their capability to improve the classification accuracy. Shape and texture features are considered as two important types of spatial features in various applications of image processing. In this study, we extracted multiple features from spectral and spatial domains where we utilized texture and shape features, as well as spectral features, in order to obtain high classification accuracy. The spatial features considered in this study are produced by Gray Level Co-occurrence Matrix (GLCM) and Extended Multi-Attribute Profiles (EMAP), while, the extraction of deep spectral features is done by Stacked Sparse Autoencoders. The obtained spectral-spatial features are concatenated directly as a simple feature fusion and are fed into the Support Vector Machine (SVM) classifier. We tested the proposed method on hyperspectral (HS) and multispectral (MS) images where the experiments demonstrated significantly the efficiency of the proposed framework in comparison with some recent spectral-spatial classification methods and with different classification frameworks based on the used extractors.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Zhao, W., Guo, Z., Yue, J., Zhang, X., Luo, L.: On combining multiscale deep learning features for the classification of hyperspectral remote sensing imagery. Int. J. Remote Sens. 36(13), 3368–3379 (2015)

    Article  Google Scholar 

  2. Huang, X., Zhang, L.: An SVM ensemble approach combining spectral, structural, and semantic features for the classification of high-resolution remotely sensed imagery. IEEE Trans. Geosci. Remote Sens. 51(1), 257–272 (2013)

    Article  Google Scholar 

  3. Agüera, F., Aguilar, F.J., Aguilar, M.A.: Using texture analysis to improve per-pixel classification of very high-resolution images for mapping plastic Greenhouses. ISPRS J. Photogrammetry Remote Sens. 63(6), 635–646 (2008)

    Article  Google Scholar 

  4. Reis, S., Taş Demir, K.: Identification of hazelnut fields using spectral and gabor textural features. ISPRS J. Photogrammetry Remote Sens. 66(5), 652–661 (2011)

    Article  Google Scholar 

  5. Benediktsson, J.A., Palmason, J.A., Sveinsson, J.R.: Classification of hyperspectral data from urban areas based on extended morphological profiles. IEEE Trans. Geosci. Remote Sens. 43(3), 480–491 (2005)

    Article  Google Scholar 

  6. Dalla Mura, M., Benediktsson, J.A., Bruzzone, L.: Classification of hyperspectral images with extend attribute profiles and feature extraction techniques. In: IEEE Geosciences and Remote Sensing Symposium, pp. 76–79 (2010)

    Google Scholar 

  7. Ghamisi, P., Dalla Mura, M., Benediktsson, J.A.: A survey on spectral-spatial classification techniques based on attribute profiles. IEEE Trans. Geosci. Remote Sens. 53(5), 2335–2353 (2015)

    Article  Google Scholar 

  8. Ghamisi, P., Souza, R., Benediktsson, J.A., Zhu, X.X., Rittner, L., Lotufo, R.A.: Extinction profiles for the classification of remote sensing data. IEEE Trans. Geosci. Remote Sens. 54(10), 5631–5645 (2016)

    Article  Google Scholar 

  9. Chen, Y., Lin, Z., Zhao, X., Wang, G., Gu, Y.: Deep learning-based classification of hyperspectral data. IEEE J. Sel. Topics Appl. Earth Obs. Remote Sens. 7(6), 2094–2107 (2014)

    Article  Google Scholar 

  10. Tao, C., Pan, H., Li, Y., Zou, Z.: Unsupervised spectral-spatial feature learning with stacked sparse autoencoder for hyperspectral imagery classification. IEEE Geosci. Remote Sens. Lett. 12(12), 2438–2442 (2015)

    Article  Google Scholar 

  11. Wang, L., Zhang, J., Liu, P., Choo, K.K.R., Huang, F.: Spectral-spatial multi feature-based deep learning for hyperspectral remote sensing image classification. Soft Comput. 21(1), 213–221 (2016)

    Article  Google Scholar 

  12. Shao, Z., Zhang, L., Wang, L.: Stacked sparse autoencoder modelling using the synergy of airborne LiDAR and satellite optical and SAR data to map forest above-ground biomass. IEEE J. Sel. Topics Appl. Earth Observations Remote Sens. 10(12) (2017)

    Article  Google Scholar 

  13. Zhao, W., Du, S.: Spectral-spatial feature extraction for hyperspectral image classification: a dimension reduction and deep learning approach. IEEE Trans. Geosci. Remote Sens. 54(8), 4544–4554 (2016)

    Article  Google Scholar 

  14. Chen, Y., Li, C., Ghamisi, P., Jia, X., Gu, Y.: Deep fusion of remote sensing data for accurate classification. IEEE Geosci. Remote Sens. Lett. 14(8), 1253–1257 (2017)

    Article  Google Scholar 

  15. Wang, A., He, X., Ghamisi, P., Chen, Y.: LiDAR data classification using morphological profiles and convolutional neural networks. IEEE Geosci. Remote Sens. Lett. 15(5), 774–778 (2018)

    Article  Google Scholar 

  16. Mirzapour, F., Ghassemian, H.: Fast GLCM and gabor filters for texture classification of very high-resolution remote sensing images. Int. J. Inf. Commun. Technol. Res. 7(3), 21–30 (2015)

    Google Scholar 

  17. Abdi, G., Samadzadegan, F., Reinartz, P.: Spectral-spatial feature learning for hyperspectral imagery classification using deep stacked sparse autoencoder. J. Appl. Remote Sens. 11(4), 1–15 (2017)

    Google Scholar 

  18. LeCun, Y., Bengio, Y., Hinton, G.E.: Deep learning. Nat. Int. Weekly J. Sci. 521, 436–444 (2015)

    Google Scholar 

  19. Vincent, P., Larochelle, H., Bengio, Y., Manzagol, P.A.: Extracting and composing robust features with denoising autoencoder. In: The 25th International Conference on Machine Learning, pp. 1096–1103 (2008)

    Google Scholar 

  20. Ng, A.: “Sparse autoencoder”, CS294A Lecture notes, Stanford University (2010)

    Google Scholar 

  21. Teffahi, H., Yao, H., Belabid, N., Chaib, S.: Feature extraction based on extend multi-attribute profiles and sparse autoencoder for remote sensing image classification. In: MIPPR 2017: Multispectral Image Acquisition, Processing, and Analysis, Proceedings of SPIE, vol. 10607 (2018)

    Google Scholar 

  22. Wan, X., Zhao, C., Wang, Y., Liu, W.: Stacked sparse autoencoder in hyperspectral data classification using spectral-spatial, higher order statistics and multifractal spectrum features. Infrared Phys. Technol. 86, 77–89 (2017)

    Article  Google Scholar 

  23. Song, B., et al.: Remotely sensed image classification using sparse representations of morphological attribute profiles. IEEE Trans. Geosci. Remote Sens. 52(8), 5122–5136 (2014)

    Article  Google Scholar 

  24. Mirzapour, F., Ghassemian, H.: Improving hyperspectral image classification by combining spectral, texture, and shape features. Int. J. Remote Sens. 36(4), 1070–1096 (2015)

    Google Scholar 

  25. Mirzapour, F., Ghassemian, H.: Using GLCM and Gabor filters for classification of PAN images. In: IEEE 21st Iranian Conference on Electrical Engineering (ICEE), pp. 1–6 (2013)

    Google Scholar 

  26. Aferi, F.D., Purboyo, T.W., Saputra, R.E.: Cotton texture segmentation based on image texture analysis using Gray Level Co-occurrence Matrix (GLCM) and euclidean distance. Int. J. Appl. Eng. Res. 13(1), 449–455 (2018)

    Google Scholar 

  27. Haralick, R.M., Shanmugam, K., Dinstein, I.H.: Textural features for image classification. IEEE Trans. Syst. Man Cybern. 3(6), 610–621 (1973)

    Article  Google Scholar 

  28. Teffahi, H., Yao, H., Belabid, N., Chaib, S.: A Novel Spectral-Spatial Classification Technique of Multispectral Images Using Extend Multi-Attribute Profiles and Sparse Autoencoder, December 2017. (Accepted, Submitted to Remote Sensing Letters)

    Google Scholar 

Download references

Acknowledgments

This work is supported by the National Natural Science Foundation of China (61472103) (61772158).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China

    Hanane Teffahi & Hongxun Yao

  2. Algerian Space Agency, Algiers, Algeria

    Hanane Teffahi

Authors
  1. Hanane Teffahi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hongxun Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hongxun Yao .

Editor information

Editors and Affiliations

  1. Hefei University of Technology, Hefei, China

    Richang Hong

  2. National Chiao Tung University, Hsinchu, Taiwan

    Wen-Huang Cheng

  3. University of Tokyo, Tokyo, Japan

    Toshihiko Yamasaki

  4. Hefei University of Technology, Hefei, China

    Meng Wang

  5. City University of Hong Kong, Hong Kong, Hong Kong

    Chong-Wah Ngo

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Teffahi, H., Yao, H. (2018). RS-MSSF Frame: Remote Sensing Image Classification Based on Extraction and Fusion of Multiple Spectral-Spatial Features. In: Hong, R., Cheng, WH., Yamasaki, T., Wang, M., Ngo, CW. (eds) Advances in Multimedia Information Processing – PCM 2018. PCM 2018. Lecture Notes in Computer Science(), vol 11165. Springer, Cham. https://doi.org/10.1007/978-3-030-00767-6_54

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-00767-6_54

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-00766-9

  • Online ISBN: 978-3-030-00767-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation