Decision Fusion of Multiple Classifiers for Vegetation Mapping and Monitoring Applications by Means of Hyperspectral Data

  • Karoly Livius Bakos
  • Prashanth Reddy Marpu
  • Paolo Gamba
Part of the Augmented Vision and Reality book series (Augment Vis Real, volume 3)


In this chapter, we introduce methodologies for fusion of multiple classifiers and a neural network architecture for mapping vegetation by means of remote sensing imagery. It is very normal that different classification schemes yield slightly different results for different classes. This effect is even more prominent in vegetation mapping applications due to the inconsistent spectral signatures of the vegetation classes. We study the possibility of combining the results of different classifiers by considering the best results for individual classes to produce an improved classification result. We propose two types of methodologies, one which uses only the classification result and the other which uses the class membership values produced by the weak classifiers. A comparison is also done with the simple majority voting scheme of the multiple classifiers. Our experiments clearly show the improvement of classification accuracy using the proposed fusion techniques.


Hyperspectral Classification Neural Network Decision tree Ensemble 



The authors would like to acknowledge that this research was carried out within the Marie-Curie founded Hyper-I-Net Research Training Network. We also would like to thank Antonio J. Plaza and Alberto Villa the help and support which they provided.


  1. 1.
    Gamba, P., Plaza, A., Benediktsson, A.J., Chanussot, J.: European perspectives in hyperspectral data analysis. In: Proceedings of 2007 IEEE Geoscience and Remote Sensing Symposium (IGARSS 2007), pp. 4794–4797 (2007)Google Scholar
  2. 2.
    Richards, J.A.: Analysis of remotely sensed data: the formative decades and the future. IEEE Trans. Geosci. Remote Sens. 43, 422–432 (2005)CrossRefGoogle Scholar
  3. 3.
    Bakos, K.L., Gamba, P.: Potential of hyperspectral remote sensing for vegetation mapping in high mountain ecosystems. In: Proceedings of 6th EarSEL SIG IS Workshop 2009, Unformatted CD-ROM (2009)Google Scholar
  4. 4.
    Bruzzone, L., Prieto, D.F., Serpico, S.B.: A neural statistical approach to multitemporal and multisensor and multisource remote sensing image classification. IEEE Trans. Geosci. Remote Sens. 37, 1350–1359 (1999)CrossRefGoogle Scholar
  5. 5.
    Vapnik, V., Vashist, A.: A new learning paradigm: learning using privileged information. Neural Netw. 22, 544–557 (2009)CrossRefGoogle Scholar
  6. 6.
    Pearson, K.: On lines and planes of closest fit to systems of points in space. Philos. Mag. 2, 559–572 (1901)Google Scholar
  7. 7.
    Green, A.A., Berman, M., Switzer, P., Craig, M.D.: A transformation for ordering multispectral data in terms of image quality with implications for noise removal. IEEE Geosci. Remote Sens. 26, 65–74 (1988)CrossRefGoogle Scholar
  8. 8.
    Richards, J.A.: Remote Sensing Digital Image Analysis. Springer-Verlag, Berlin (1999)Google Scholar
  9. 9.
    Tadjudin, S., Landgrebe, D.A.: Classification of high dimensional data with limited training samples. Technical Report TR-ECE 98-8, Purdue University (1998)Google Scholar
  10. 10.
    Ho, T.H., Hull, J.J., Srihari, S.N.: Decision combination in multiple classifier system. IEEE Trans. Pattern Anal. Mach. Intell. 16, 66–75 (1994)CrossRefGoogle Scholar
  11. 11.
    Kuncheva, L.I., Bezdek, J.C., Sutton, M.A.: On combining multiple classifiers by fuzzy templates. In: Proceedings of NAFIPS Conference EDS, pp. 193–197 (1998)Google Scholar
  12. 12.
    Woods, K., Kegelmeyer, W.P., Bowyer, K.: Combination of multiple classifiers using local accuracy estimates. IEEE Trans. Pattern Anal. Mach. Intell. 19, 405–410 (1997)CrossRefGoogle Scholar
  13. 13.
    Kittler, J., Hatef, M., Duin, R.P.W., Matas, J.: On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20, 226–239 (1998)CrossRefGoogle Scholar
  14. 14.
    Liu, W.G., Gopal, S., Woodcock, C.E.: Uncertainty and confidence in land cover classification using a hybrid classifier approach. Photogramm. Eng. Remote Sens. 70, 963–971 (2004)Google Scholar
  15. 15.
    Schwenk, H., Bengio, Y.: Boosting neural networks. Neural Comput. 12, 1869–1887 (2000)CrossRefGoogle Scholar
  16. 16.
    Breiman, L.: Bagging predictors. Mach. Learn. 24, 123–140 (1996)zbMATHMathSciNetGoogle Scholar
  17. 17.
    Polikar, R.: Ensemble-based systems in decision making. IEEE Circuits and Systems Magazine 6(3), 21–45 (2006)CrossRefGoogle Scholar
  18. 18.
    Roli, F., Giacinto, G., Vernazza, G.: Methods for designing multiple classifier systems. In: Proceedings of MCS, pp. 78–87 (2001)Google Scholar
  19. 19.
    Gabrys, B., Dymitr, R.: Genetic algorithms in classifier fusion. Appl. Soft Comput. 6, 337–347 (2006)CrossRefGoogle Scholar
  20. 20.
    Sinha, A., Chen, H., Danu, D.G., Kirubarajan, T., Farooq, M.: Estimation and decision fusion: a survey. Neurocomputing 71, 2650–2656 (2008)CrossRefGoogle Scholar
  21. 21.
    Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, Berlin (2006)zbMATHGoogle Scholar
  22. 22.
    Canty, M.J.: Image Analysis, Classification and Change Detection in Remote Sensing, with Algorithms for ENVI/IDL. CRC Press, Boca Raton (2007)Google Scholar
  23. 23.
    Marpu, P.R., Gamba, P., Niemeyer, I.: Hyperspectral data classification using an ensemble of class-dependent neural networks. In: Proceedings of IEEE GRSS Workshop on Hyperspectral Image and Signal Processing Conference (WHISPERS), Unformatted CD-ROM (2009)Google Scholar
  24. 24.
    Hughes, G.F.: On the mean accuracy of statistical pattern recognizers. IEEE Trans. Inf. Theory 14, 55–63 (1968)CrossRefGoogle Scholar
  25. 25.
    Lillesand, T., Kiefer, R.: Remote Sensing and Image Processing. Wiley, New York (1978)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Karoly Livius Bakos
    • 1
  • Prashanth Reddy Marpu
    • 1
  • Paolo Gamba
    • 1
  1. 1.Department of Electronics, Telecommunication and Remote Sensing LaboratoryUniversity of PaviaPaviaItaly

Personalised recommendations