Boosting, Bagging, and Consensus Based Classification of Multisource Remote Sensing Data

  • Gunnar Jakob Briem
  • Jon Atli Benediktsson
  • Johannes R. Sveinsson
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2096)

Abstract

The need to optimize the classification accuracy of remotely sensed imagery has led to an increasing use of Earth observation data with different characteristics collected from a variety of sensors from different parts of the electromagnetic spectrum. Combining multisource data is believed to offer enhanced capabilities for the classification of target surfaces. In the paper several single and multiple classifiers which are appropriate for classification of multisource remote sensing and geographic data are considered. The focus is on multiple classifiers: bagging algorithms, boosting algorithms, and consensus theoretic classifiers. These multiple classifiers have different characteristics. The performance of the algorithms in terms of accuracies is compared for a multisource remote sensing and geographic data set.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Wolpert, D. H.: Stacked generalization. Neural Networks 5 (1992) 241–259.CrossRefGoogle Scholar
  2. 2.
    Tumer, K., Ghosh, J.: Analysis of decision boundaries in linearly combined neural classifiers. Pattern Recognition 29 (1996) 341–348.CrossRefGoogle Scholar
  3. 3.
    Hansen, L. K., Salamon, P.: Neural network ensembles, IEEE Transactions on Pattern Analysis and Machine Intelligence 12 (1990) 993–1001.CrossRefGoogle Scholar
  4. 4.
    Benediktsson, J.A. Sveinsson, J.R., Swain, P.H.: Hybrid consensus theoretic classification. IEEE Transactions on Geoscience and Remote Sensing. 35 (1997) 833–843.CrossRefGoogle Scholar
  5. 5.
    Benediktsson, J.A., Sveinsson, J.R., Ersoy, O.K., Swain, P.H.: Parallel Consensual Neural Networks. IEEE Transactions on Neural Networks. 8 (1997) 54–65.CrossRefGoogle Scholar
  6. 6.
    Ho, T.K.: A Theory of Multiple Classifier Systems And Its Application to Visual Word Recognition, PhD dissertation, State University of New York at Buffalo (1992).Google Scholar
  7. 7.
    Wilson, S.W., and D.E. Goldberg: A Critical Review of Classifier Systems, Proceedings of the Third International Conference on Genetic Algorithms, Morgan Kaufmann, Palo Alto (1989).Google Scholar
  8. 8.
    Schapire, R.E.: A Brief Introduction to Boosting, Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence (1999).Google Scholar
  9. 9.
    Freund, Y., and R.E. Schapire: Experiments with a New Boosting Algorithm, Machine Learning: Proceedings of the Thirteenth International Conference (1996).Google Scholar
  10. 10.
    Breiman, L.: Bagging Predictors, Technical Report No. 421, September 1994, Department of Statistics, University of California, Berkeley, California 94720.Google Scholar
  11. 11.
    Benediktsson, J.A., Swain, P.H.: Consensus theoretic classification methods. IEEE Transactions on Systems Man and Cybernetics. 22 (1992) 688–704.MATHCrossRefGoogle Scholar
  12. 12.
    D.G. Goodenough, M. Goldberg, G. Plunkett and J. Zelek, “The CCRS SAR/MSS Anderson River Data Set,” IEEE Transactions on Geoscience and Remote Sensing, 25 (1987) 360–367.CrossRefGoogle Scholar
  13. 13.
    Richards, J.A., Jia, X.: Remote Sensing Digital Image Analysis, An Introduction. Third, Revised and Enlarged Edition. Springer-Verlag, Berlin (1999).Google Scholar
  14. 14.
    Kohavi, R.: The Power of Decision Tables, Proceedings of the European Conference on Machine Learning (ECML), (1995).Google Scholar
  15. 15.
    Witten, I.H. et al: Weka 3.2–Machine Learning Software in Java, http://www.cs.waikato.ac.nz/~ml/weka/ (2001).
  16. 16.
    Quinlan, J.R.: C4.5, Programs for Machine Learning, Morgan Kaufmann, San Francisco (1993).Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Gunnar Jakob Briem
    • 1
  • Jon Atli Benediktsson
    • 1
  • Johannes R. Sveinsson
    • 1
  1. 1.Department of Electrical and Computer EngineeringUniversity of IcelandReykjavikIceland

Personalised recommendations