Advertisement

Cluster Computing

, Volume 21, Issue 1, pp 741–754 | Cite as

DeepSIC: a deep model

For satellite image classification
  • Muhammad AminEmail author
  • Tamleek Ali Tanveer
  • Shakirullah Shah
  • Muhammad Abdullah
  • Muhammad Shafi
Article

Abstract

Satellite Image Classification is the problem of classifying satellite images into their corresponding classes. Using supervised deep learning, we provide an efficient classification mechanism of earth observation imagery captured by satellite. Promising classification results were obtained through Convolution Neural Network. Two sets of experiments were carried out. In the first set, the traditional pre-deep learning era approach was followed: features were extracted first which were then given as input to Support Vector Machines (SVM). In the second set of experiments, the images were directly provided as input to Convolution Neural Networks and the output features were then used as input to the SVM. The proposed schemes were tested on satellite images datasets AID, UC-merced and WHU-RS, having varied classes and heterogeneous image dimensions. We show that our model, with Convolution Neural Network, achieves 92% accuracy on the AID dataset and outperforms the previously reported best accuracy of 89.64% (Xia et al. in CoRR, arXiv:1608.05167, 2016).

Keywords

Deep leaning Satellite images Classification Transfer learning 

References

  1. 1.
  2. 2.
    Bay, H., Tuytelaars, T., Van Gool, L.: Surf: speeded up robust features. In: European Conference on Computer Vision, pp. 404–417. Springer (2006)Google Scholar
  3. 3.
    Bosch, A., Muñoz, X., Martí, R.: Which is the best way to organize/classify images by content? Image Vis. Comput. 25(6), 778–791 (2007)CrossRefGoogle Scholar
  4. 4.
    Boureau, Y.-L., Bach, F., LeCun, Y., Ponce, J.: Learning mid-level features for recognition. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2559–2566. IEEE (2010)Google Scholar
  5. 5.
    Caffe, J.Y.: An open source convolutional architecture for fast feature embedding. In: ACM International Conference on Multimedia, ACMGoogle Scholar
  6. 6.
    Chen, S., Tian, Y.L.: Pyramid of spatial relatons for scene-level land use classification. IEEE Trans. Geosci. Remote Sens. 53(4), 1947–1957 (2015)CrossRefGoogle Scholar
  7. 7.
    Cheriyadat, A.M.: Unsupervised feature learning for aerial scene classification. IEEE Trans. Geosci. Remote Sens. 52(1), 439–451 (2014)CrossRefGoogle Scholar
  8. 8.
    Coates, A., Lee, H., Ng, A.Y.: An analysis of single-layer networks in unsupervised feature learning. Ann Arbor 1001(48109), 2 (2010)Google Scholar
  9. 9.
    Donaldson, D., Storeygard, A.: The view from above: applications of satellite data in economics. J. Econ. Perspect. 30(4), 171–198 (2016)CrossRefGoogle Scholar
  10. 10.
    Gao, M.-L., Zhao, W.-J., Gong, Z.-N., Gong, H.-L., Chen, Z., Tang, X.-M.: Topographic correction of zy-3 satellite images and its effects on estimation of shrub leaf biomass in mountainous areas. Remote Sens. 6(4), 2745–2764 (2014)CrossRefGoogle Scholar
  11. 11.
    Guenther, N., Schonlau, M., et al.: Support vector machines. Stata J. 16(4), 917–937 (2016)Google Scholar
  12. 12.
    Guo, M., Yi, Y., Liu, J., Li, Y.: Scene text segmentation method based on mser and mlbp. In: China Academic Conference on Printing & Packaging and Media Technology, pp. 305–310. Springer (2016)Google Scholar
  13. 13.
    Saxena, R., Mukherjee, S.: Application of remote sensing technology for land use/land cover change analysis. J. Indian Soc. Remote Sens. 27(2), 123–128 (1999)CrossRefGoogle Scholar
  14. 14.
    Ketkar, N.: Convolutional neural networks. In: Deep Learning with Python, pp. 61–76. Springer (2017)Google Scholar
  15. 15.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  16. 16.
    Law, M.T., Thome, N., Cord, M.: Bag-of-words image representation: key ideas and further insight. In: Fusion in Computer Vision, pp. 29–52. Springer (2014)Google Scholar
  17. 17.
    Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 2169–2178. IEEE (2006)Google Scholar
  18. 18.
    LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRefGoogle Scholar
  19. 19.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRefGoogle Scholar
  20. 20.
    Nguyen, A., Dosovitskiy, A., Yosinski, J., Brox, T., Clune, J.: Synthesizing the preferred inputs for neurons in neural networks via deep generator networks. In: Advances in Neural Information Processing Systems, pp. 3387–3395 (2016)Google Scholar
  21. 21.
    Ren, J.S.J., Xu, L.: On vectorization of deep convolutional neural networks for vision tasks. arXiv preprint arXiv:1501.07338 (2015)
  22. 22.
    Rogan, J., Chen, D.M.: Remote sensing technology for mapping and monitoring land-cover and land-use change. Prog. Plan. 61(4), 301–325 (2004)CrossRefGoogle Scholar
  23. 23.
    Schultz, L., Molthan, A., Burks, J.E., Bell, J., McGrath, K., Cole, T.: Applications of earth remote sensing for identifying tornado and severe weather damage (2016)Google Scholar
  24. 24.
    Shao, W., Yang, W., Xia, G.-S.: Extreme value theory-based calibration for the fusion of multiple features in high-resolution satellite scene classification. Int. J. Remote Sens. 34(23), 8588–8602 (2013)CrossRefGoogle Scholar
  25. 25.
    Sheng, G., Yang, W., Tao, X., Sun, H.: High-resolution satellite scene classification using a sparse coding based multiple feature combination. Int. J. Remote Sens. 33(8), 2395–2412 (2012)CrossRefGoogle Scholar
  26. 26.
    Shin, H.-C., Roth, H.R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., Summers, R.M.: Deep convolutional neural networks for computer-aided detection: Cnn architectures, dataset characteristics and transfer learning. IEEE Trans. Med. Imaging 35(5), 1285–1298 (2016)CrossRefGoogle Scholar
  27. 27.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
  28. 28.
    Sivic, J., Zisserman, A., et al.: Video google: a text retrieval approach to object matching in videos. In: iccv vol. 2, 1470–1477 (2003)Google Scholar
  29. 29.
    Vaudour, E., Gilliot, J.-M., Bel, L., Brechet, L., Hamiache, J., Hadjar, D., Lemonnier, Y.: Uncertainty of soil reflectance retrieval from spot and rapideye multispectral satellite images using a per-pixel bootstrapped empirical line atmospheric correction over an agricultural region. Int. J. Appl. Earth Obs. Geoinf. 26, 217–234 (2014)CrossRefGoogle Scholar
  30. 30.
    Xia, G.-S., Hu, J., Hu, F., Shi, B., Bai, X., Zhong, Y., Zhang, L.: AID: a benchmark dataset for performance evaluation of aerial scene classification. CoRR (2016). arXiv:1608.05167
  31. 31.
    Xia, G.-S., Yang, W., Delon, J., Gousseau, Y., Sun, H., Maître, H.: Structural high-resolution satellite image indexing. In: ISPRS TC VII Symposium-100 Years ISPRS, vol. 38, pp. 298–303 (2010)Google Scholar
  32. 32.
    Yong, X.U., Bo, H.U.A.N.G.: Spatial and temporal classification of synthetic satellite imagery: land cover mapping and accuracy validation. Geo-spat. Inf. Sci. 17(1), 1–7 (2014)CrossRefGoogle Scholar
  33. 33.
    Yang, W., Yin, X., Xia, G.-S.: Learning high-level features for satellite image classification with limited labeled samples. IEEE Trans. Geosci. Remote Sens. 53(8), 4472–4482 (2015)CrossRefGoogle Scholar
  34. 34.
    Yang, Y., Newsam, S.: Bag-of-visual-words and spatial extensions for land-use classification. In: Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 270–279. ACM (2010)Google Scholar
  35. 35.
    Yang, Y., Newsam, S.: Spatial pyramid co-occurrence for image classification. In: 2011 IEEE International Conference on Computer Vision (ICCV)Google Scholar
  36. 36.
    Yeom, J.-M., Hwang, J., Jung, J.-H., Lee, K.-H., Lee, C.-S.: Initial radiometric characteristics of kompsat-3a multispectral imagery using the 6s radiative transfer model, well-known radiometric tarps, and mfrsr measurements. Remote Sens. 9(2), 130 (2017)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2017

Authors and Affiliations

  • Muhammad Amin
    • 1
    Email author
  • Tamleek Ali Tanveer
    • 2
  • Shakirullah Shah
    • 1
  • Muhammad Abdullah
    • 1
  • Muhammad Shafi
    • 3
  1. 1.National University of Computer & Emerging SciencesIslamabadPakistan
  2. 2.Institute of Management SciencesPeshawarPakistan
  3. 3.Faculty of Computer and Information SystemsIslamic University in MadinahMedinaSaudi Arabia

Personalised recommendations