Advertisement

A Kernel-Based Extreme Learning Machine Framework for Classification of Hyperspectral Images Using Active Learning

  • Monoj K. PradhanEmail author
  • Sonajharia Minz
  • Vimal K. Shrivastava
Research Article
  • 59 Downloads

Abstract

The rapid development of advanced remote sensing technology with multichannel imaging sensors has increased its potential opportunity in the utilization of hyperspectral data for various applications. For supervised classification of hyperspectral data, obtaining suitable training set is essential for ensuring good performance. However, obtaining labeled training sample is often difficult, expensive, and time consuming in hyperspectral images (HSIs) and other image analysis applications. To overcome this problem, active learning (AL) technique plays a crucial role in the image analysis framework. As per literature, classification of HSI using AL has been focused in terms of accuracy, but learning rate in terms of computation time has not been focused yet. In this paper, multiview-based AL technique has been integrated with kernel-based extreme learning machine (KELM) classifier. Further, we have compared our approach with popularly used kernel-based support vector machine (KSVM). To validate our study, experiments were conducted on two Hyperspectral Images: Kennedy Space Centre (KSC) and Botswana (BOT) datasets. The proposed approach (KELM-AL) achieved the classification accuracy up to 91.15% in KSC dataset while 95.02% in case of BOT dataset with computation time of 149.78 s and 104.98 s, respectively. While KSVM-AL achieved the classification accuracy up to 91.59% in KSC dataset while 95.96% in case of BOT dataset with computation time of 7532.25 s and 6863.60 s, respectively. This shows that classification accuracy obtained by KELM-AL is comparable to KSVM-AL approach but significantly reduces the computational time. Thus, the proposed system shows the promising results with adequate classification accuracy while reducing the computation time drastically.

Keywords

Active learning Extreme learning machine Hyperspectral image classification Kernel parameter Multiview Uncertainty sampling 

Notes

References

  1. Bajwa, S., Bajcsy, P., Groves, P., & Tian, L. (2004). Hyperspectral image data mining for band selection in agricultural applications. Transactions of the American Society of Agricultural Engineers, 47(3), 895–908.Google Scholar
  2. Camps-Valls, G., Tuia, D., Bruzzone, L., & Benediktsson, J. A. (2014). Advances in hyperspectral image classification: Earth monitoring with statistical learning methods. IEEE Signal Processing Magazine, 31(1), 45–54.Google Scholar
  3. Chang, C.-C., & Lin, C.-J. (2011). LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2, 27:1–27:27. [Online]. http://www.csie.ntu.edu.tw/~cjlin/libsvm. Accessed 22 October, 2017.
  4. Chen, Q., & Sun, S. (2009). Hierarchical multi-view fisher discriminant analysis. In International conference on neural information processing (pp. 289–298). Springer, Berlin, Heidelberg.Google Scholar
  5. Copa, L., Tuia, D., Volpi, M., & Kanevski, M. (2010). Unbiased query-by-bagging active learning for VHR image classification. Proceedings of Image and Signal Processing for Remote Sensing, XVI, 78300K.Google Scholar
  6. Crawford, M. M., Tuia, D., & Yang, H. L. (2013). Active learning: Any value for classification of remotely sensed data. Proceedings of IEEE, 101(3), 593–608.Google Scholar
  7. Demir, B., Persello, C., & Bruzzone, L. (2011). Batch-mode active-learning methods for the interactive classification of remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 49(3), 1014–1031.Google Scholar
  8. Di, W., & Crawford, M. M. (2012). View generation for multiview maximum disagreement based active learning for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 50(5), 1942–1954.Google Scholar
  9. Fauvel, M., Tarabalka, Y., Benediktsson, J. A., Chanussot, J., & Tilton, J. C. (2013). Advances in spectral-spatial classification of hyperspectral images. Proceedings of the IEEE, 101(3), 652–675.Google Scholar
  10. Govender, M., Chetty, K., & Bulcock, H. (2007). A review of hyperspectral remote sensing and its application in vegetation and water resource studies. Water SA, 33(2), 145–152.Google Scholar
  11. Huang, G. B. (2014). An insight into extreme learning machines: Random neurons, random features and kernels. Cognitive Computation, 6(3), 376–390.Google Scholar
  12. Huang, G. B., Wang, D. H., & Lan, Y. (2011). Extreme learning machine: A survey. International Journal of Machine Learning Cybernetics, 2(2), 107–122.Google Scholar
  13. Huang, G. B., Zhou, H., Ding, X., & Zhang, R. (2012). Extreme learning machine for regression and multiclass classification. IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics, 42(2), 513–529.Google Scholar
  14. Huang, G. B., Zhu, Q. Y., & Siew, C. K. (2006). Extreme learning machine: Theory and applications. Neurocomputing, 70(1–3), 489–501.Google Scholar
  15. Khosravi, I., & Mohammad-Beigi, M. (2014). Multiple classifier systems for hyperspectral remote sensing data classification. Journal of the Indian Society of Remote Sensing, 42(2), 423–428.Google Scholar
  16. Kuo, B., Ho, H., Li, C., Hung, C., & Taur, J. (2014). A kernel-based feature selection method for SVM with RBF kernel for hyperspectral image classification. IEEE Journal of Selected Topics Applied Earth Observations and Remote Sensing, 7(1), 317–3226.Google Scholar
  17. Li, M., & Sethi, I. K. (2006). Confidence-based active learning. IEEE Transactions on Pattern Anaysisand Machine Intelligence, 28(8), 1251–1261.Google Scholar
  18. Luo, T., Kramer, K., Goldgof, D. B., Hall, L.O., Samson, S., Remsen, A., et al. (2004). Active learning to recognize multiple types of plankton. In IEEE Proceedings of the 17th international conference on pattern recognition (Vol. 3, pp. 478–48).Google Scholar
  19. Marir, B., Kalla, M., Douak, F., & Daamouche, A. (2018). A modular support vector machine for active learning of urban remote sensing images classification in Algeria. Journal of the Indian Society of Remote Sensing, 46(4), 515–529.Google Scholar
  20. Melgani, F., & Bruzzone, L. (2004). Classification of hyperspectral remote sensing images with support vector machines. IEEE Transactions on Geoscience and RemoteSensing, 42(8), 1778–1790.Google Scholar
  21. Mitra, P., Murthy, C. A., & Pal, S. K. (2004). A probabilistic active support vector learning algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(3), 413–418.Google Scholar
  22. Muslea, I., Minton, S., & Knoblock, C. A. (2006). Active learning with multiple views. Journal of Artificial Intelligence Research, 27, 203–233.Google Scholar
  23. Neuenschwander, A. L. (2007). Remote sensing of vegetation dynamics in response to flooding and fire in the Okavango Delta, Botswana. Ph.D. dissertation, Univ. Texas at Austin, Austin, TX.Google Scholar
  24. Neville, R., Staenz, K., Szeredi, T., Lefebvre, J., & Hauff, P. (1999). Automatic end member extraction from hyperspectral data for mineral exploration. In Proceedings of 21st Canadian symposium on remote sensing (pp. 21–24).Google Scholar
  25. Pasolli, E., Lexie, H. Y., & Crawford, M. M. (2016). Active-metric learning for classification of remotely sensed hyperspectral images. IEEE Transactions on Geoscience and Remote Sensing, 54(4), 1925–1939.Google Scholar
  26. Pasolli, E., Melgani, F., & Bazi, Y. (2011). Support vector machine active learning through significance space construction. IEEE Geoscience on Remote Sensing Letters, 8(3), 431–435.Google Scholar
  27. Patra, S., Bhardwaj, K., & Bruzzone, L. (2017). A spectral-spatial multicriteria active learning technique for hyperspectral image classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 10(12), 5213–5227.Google Scholar
  28. Plaza, A., Benediktsson, J. A., BoardmanJ, W., Brazile, J., Bruzzone, L., Camps-Valls, G., et al. (2009). Recent advances in techniques for hyperspectral image processing. Remote Sensing of Environment, 113, S110–S122.Google Scholar
  29. Pradhan, M. K., Minz, S., Shrivastava, V. K. (2018). Fisher discriminant ratio based multiview active learning for the classification of remote sensing images. In 4th international conference on recent advances in information technology (RAIT), 2018 (pp. 1–6).Google Scholar
  30. Rajan, S., Ghosh, J., & Crawford, M. M. (2008). An active learning approach to hyperspectral data classification. IEEE Transactions on Geoscience and Remote Sensing, 46(4), 1231–1242.Google Scholar
  31. Tuia, D., & Muñoz-Marí, J. (2011–2013). MATLAB active learning toolbox for remote sensing. GitHub repository. https://github.com/IPL-UV/altoolbox. Accessed 22 Oct 2017.
  32. Tuia, D., Muñoz-Marí, J., Kanevski, M., & Camps-Valls, G. (2010). Cluster based active learning for compact image classification. In Proceedings of IEEE international geoscience and remote sensing symposium, IGARSS, Honolulu, HI (pp. 2827–2827).Google Scholar
  33. Tuia, D., Pasolli, E., & Emery, W. J. (2011a). Using active learning to adapt remote sensing image classifiers. Remote Sensing of Environment, 115(9), 2232–2242.Google Scholar
  34. Tuia, D., Ratle, F., Pacifici, F., Kanevski, M. F., & Emery, W. J. (2009). Active learning methods for remote sensing image classification. IEEE Transactions on Geoscience and Remote Sensing, 47(7), 2218–2232.Google Scholar
  35. Tuia, D., Volpi, M., Copa, L., Kanevski, M., & Munoz-Mari, J. (2011b). A survey of active learning algorithms for supervised remote sensing image classification. IEEE Journal of Selected Topics in Signal Processing, 5(3), 606–617.Google Scholar
  36. Wan, L., Tang, K., Li, M., Zhong, Y., & Qin, A. K. (2015). Collaborative active and semisupervised learning for hyperspectral remote sensing image classification. IEEE Transactions on Geoscience and Remote Sensing, 53(5), 2386–2396.Google Scholar
  37. Wang, Z., Du, B., Zhang, L., Zhang, L., & Jia, X. (2017). A novel semi supervised active-learning algorithm for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 55(6), 3071–3083.Google Scholar
  38. Xu, X., Li, J., & Li, S. (2018). Multiview intensity-based active learning for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 56(2), 669–680.Google Scholar
  39. Xu, Z., & Sun, S. (2010). An algorithm on multi-view adaboost. In International conference on neural information processing (pp. 355–362). Springer, Berlin, Heidelberg.Google Scholar
  40. Xu, C., Tao, D., & Xu, C. (2013). A survey on multi-view learning. Unpublished paper, 2013. [Online]. https://arxiv.org/abs/1304.5634.
  41. Xu, Z., Yu, K., Tresp, V., Xu, X., & Wang, J. (2003). Representative sampling for text classification using support vector machines. In Proceedings of European conference in information retrieval (pp. 393–407).Google Scholar
  42. Ye, X., Sakai, L. K., Garciano, O., Asada, S. I., & Sasao, A. (2006). Estimation of citrus yield from airborne hyperspectral images using a neural network model. Ecological Modelling, 198(3/4), 426–432.Google Scholar
  43. Zhou, Y., Peng, J., & Philip Chen, C. L. (2014a). Extreme learning machine with composite kernels for hyperspectral image classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8(6), 2351–2360.Google Scholar
  44. Zhou, X., Prasad, S., & Crawford, M. M. (2014b). Wavelet domain multi-view active learning for hyperspectral image analysis. In Proceedings of 6th IEEE workshop hyperspectral image signal processing: Evolution in remote sensing. Google Scholar

Copyright information

© Indian Society of Remote Sensing 2019

Authors and Affiliations

  • Monoj K. Pradhan
    • 1
    Email author
  • Sonajharia Minz
    • 1
  • Vimal K. Shrivastava
    • 2
  1. 1.School of Computer and Systems SciencesJawaharlal Nehru UniversityNew DelhiIndia
  2. 2.School of Electronics EngineeringKalinga Institute of Industrial TechnologyBhubaneswarIndia

Personalised recommendations