Skip to main content
SpringerLink
Log in

Hyperspectral image classification based on multiple reduced kernel extreme learning machine

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

This paper presents an efficient hyperspectral images classification method based on multiple reduced kernel extreme learning machine (MRKELM). The MRKELM model is developed on the basis of the multiple kernel leaning method and the reduced kernel extreme learning machine method. In the presented MRKELM, the kernel function are not fixed anymore, multiple kernels are adaptively trained as a hybrid kernel and the optimal kernel combination weights are jointly optimized. Finally, two simulation examples, classification of benchmark datasets and classification of hyperspectral images including Indian Pines, University of Pavia, and Salinas respectively, are used testify the performance of the proposed MRKELM method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  1. Bach FR, Lanckriet GR, Jordan MI (2004) Multiple kernel learning, conic duality, and the smo algorithm. In: Proceedings of the twenty-first international conference on Machine learning, ACM, p 6

  2. Bazi Y, Alajlan N, Melgani F, AlHichri H, Malek S, Yager RR (2014) Differential evolution extreme learning machine for the classification of hyperspectral images. Geosci Remote Sens Lett IEEE 11(6):1066–1070

    Article  Google Scholar 

  3. Bellocchio F, Ferrari S, Piuri V, Borghese NA (2012) Hierarchical approach for multiscale support vector regression. IEEE Trans Neural Netw Learn Syst 23(9):1448–1460

    Article  Google Scholar 

  4. Bencherif M, Bazi Y, Guessoum A, Alajlan N, Melgani F, AlHichri H (2015) Fusion of extreme learning machine and graph-based optimization methods for active classification of remote sensing images. Geosci Remote Sens Lett IEEE 12(3):527–531

    Article  Google Scholar 

  5. Camps-Valls G, Bruzzone L (2005) Kernel-based methods for hyperspectral image classification. IEEE Trans Geosci Remote Sens 43(6):1351–1362

    Article  Google Scholar 

  6. Cao W, Wang X, Ming Z, Gao J (2018) A review on neural networks with random weights. Neurocomputing 275:278–287

    Article  Google Scholar 

  7. Chen X, Guo N, Ma Y, Chen G (2012) More efficient sparse multi-kernel based least square support vector machine. Springer, Berlin Heidelberg, Berlin, Heidelberg, pp 70–78

    Google Scholar 

  8. Deng WY, Ong YS, Zheng QH (2016) A fast reduced kernel extreme learning machine. Neural Netw 76:29–38

    Article  MATH  Google Scholar 

  9. Duan L, Tsang IW, Xu D (2012) Domain transfer multiple kernel learning. IEEE Trans Patt Anal Mach Intell 34(3):465–479

    Article  Google Scholar 

  10. Gnen M, Alpaydn E (2011) Multiple kernel learning algorithms. J Mach Learn Res 12:2211–2268

    MathSciNet  Google Scholar 

  11. Grigorievskiy A, Miche Y, Ventel AM, Sverin E, Lendasse A (2014) Long-term time series prediction using op-elm. Neural Netw 51:50–56

    Article  MATH  Google Scholar 

  12. Gu Y, Wang C, You D, Zhang Y, Wang S, Zhang Y (2012) Representative multiple kernel learning for classification in hyperspectral imagery. IEEE Trans Geosci Remote Sens 50(7):2852–2865

    Article  Google Scholar 

  13. Gu Y, Liu T, Jia X, Benediktsson JA, Chanussot J (2016) Nonlinear multiple kernel learning with multiple-structure-element extended morphological profiles for hyperspectral image classification. IEEE Trans Geosci Remote Sens 54(6):3235–3247

    Article  Google Scholar 

  14. Huang G, Zhu Q, Siew C (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501

    Article  Google Scholar 

  15. Huang G, Wang D, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122

    Article  Google Scholar 

  16. Huang GB, Zhou H, Ding X, Zhang R (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern Part B Cybern 42(2):513–529

    Article  Google Scholar 

  17. Huang Z, Wang X (2018) Sensitivity of data matrix rank in non-iterative training. Neurocomputing 313:386–391

    Article  Google Scholar 

  18. Iosifidis A, Tefas A, Pitas I (2013) Minimum class variance extreme learning machine for human action recognition. IEEE Trans Circ Syst Video Technol 23(11):1968–1979

    Article  Google Scholar 

  19. Jaeger H, Haas H (2004) Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304(5667):78

    Article  Google Scholar 

  20. Kourentzes N, Petropoulos F, Trapero JR (2014) Improving forecasting by estimating time series structural components across multiple frequencies. Int J Forecast 30(2):291–302

    Article  Google Scholar 

  21. Li J, Huang X, Gamba P, Bioucas-Dias JM, Zhang L, Benediktsson JA, Plaza A (2015) Multiple feature learning for hyperspectral image classification. IEEE Trans Geosci Remote Sens 53(3):1592–1606

    Article  Google Scholar 

  22. Lichman M (2013) UCI machine learning repository. http://archive.ics.uci.edu/ml

  23. Liu X, Gao C, Li P (2012) A comparative analysis of support vector machines and extreme learning machines. Neural Netw 33:58–66

    Article  MATH  Google Scholar 

  24. Lorente D, Aleixos N, Gómez-Sanchis J, Cubero S, Blasco J (2013) Selection of optimal wavelength features for decay detection in citrus fruit using the roc curve and neural networks. Food Bioproc Technol 6(2):530–541

    Article  Google Scholar 

  25. Miche Y, Sorjamaa A, Bas P, Simula O, Jutten C, Lendasse A (2010) Op-elm: optimally pruned extreme learning machine. IEEE Trans Neural Netw 21(1):158–162

    Article  Google Scholar 

  26. Mohammed A, Minhas R, Jonathan WuQ, Sid-Ahmed M (2011) Human face recognition based on multidimensional pca and extreme learning machine. Patt Recognit 44(10–11):2588–2597

    Article  MATH  Google Scholar 

  27. Nizar A, Dong Z, Wang Y (2008) Power utility nontechnical loss analysis with extreme learning machine method. IEEE Trans Power Syst 23(3):946–955

    Article  Google Scholar 

  28. Orabona F, Jie L, Caputo B (2012) Multi kernel learning with online-batch optimization. J Mach Learn 13:227–253

    MathSciNet  MATH  Google Scholar 

  29. Plaza J, Plaza A, Perez R, Martinez P (2009) On the use of small training sets for neural network-based characterization of mixed pixels in remotely sensed hyperspectral images. Patt Recognit 42(11):3032–3045

    Article  MATH  Google Scholar 

  30. Qiu S, Lane T (2009) A framework for multiple kernel support vector regression and its applications to sirna efficacy prediction. IEEE/ACM Trans Comput Biol Bioinf 6(2):190–199

    Article  Google Scholar 

  31. Rakotomamonjy A, Bach F, Canu S (2007) More efficiency in multiple kernel learning. In: International conference on machine learning, pp 775–782

  32. Rakotomamonjy A, Bach F, Canu S, Grandvalet Y (2008) Simplemkl. J Mach Learn Res 9:2491–2521

    MathSciNet  MATH  Google Scholar 

  33. Rong H, Huang G, Sundararajan N, Saratchandran P (2009) Online sequential fuzzy extreme learning machine for function approximation and classification problems. IEEE Trans Syst Man Cybern Part B Cybern 39(4):1067–1072

    Article  Google Scholar 

  34. Samat A, Du P, Liu S, Li J, Cheng L (2014) E2lm: ensemble extreme learning machines for hyperspectral image classification. IEEE J Select Topics Appl Earth Observ Remote Sens 7(4):1060–1069

    Article  Google Scholar 

  35. Shi Z, Han M (2009) \(\gamma\)-c plane and robustness in static reservoir for nonlinear regression estimation. Neurocomputing 72(7):1732–1743

    Article  Google Scholar 

  36. Smola AJ, Schölkopf B (2004) A tutorial on support vector regression. Stat Comput 14(3):199–222

    Article  MathSciNet  Google Scholar 

  37. Song Y, Zheng YT, Tang S, Zhou X, Zhang Y, Lin S, Chua TS (2011) Localized multiple kernel learning for realistic human action recognition in videos. IEEE Trans Circ Syst Video Technol 21(9):1193–1202

    Article  Google Scholar 

  38. Subrahmanya N, Shin YC (2010) Sparse multiple kernel learning for signal processing applications. IEEE Trans Patt Anal Mach Intell 32(5):788–798

    Article  Google Scholar 

  39. Wang X, Cao W (2018) Non-iterative approaches in training feed-forward neural networks and their applications. Soft Comput 22(11):3473–3476

    Article  MATH  Google Scholar 

  40. Wang X, Zhang T, Wang R (2018a) Noniterative deep learning: incorporating restricted Boltzmann machine into multilayer random weight neural networks. IEEE Trans Syst Man Cybern Syst 1–10

  41. Wang XZ, Wang R, Xu C (2018b) Discovering the relationship between generalization and uncertainty by incorporating complexity of classification. IEEE Trans Cybern 48(2):703–715

    Article  MathSciNet  Google Scholar 

  42. Wang Z, Wang X (2018) A deep stochastic weight assignment network and its application to chess playing. J Parallel Distrib Comput 117:205–211

    Article  Google Scholar 

  43. Widodo A, Budi I (2012) Multi layer kernel learning for time series forecasting. In: 2012 international conference on advanced computer science and information systems (ICACSIS), IEEE, pp 313–318

  44. Wilamowski B, Yu H (2010) Neural network learning without backpropagation. IEEE Trans Neural Netw 21(11):1793–1803

    Article  Google Scholar 

  45. Xue J, Liu Q, Li M, Liu X, Ye Y, Wang S, Yin J (2018) Incremental multiple kernel extreme learning machine and its application in robo-advisors. Soft Comput 22(11):3507–3517

    Article  Google Scholar 

  46. Yang S, Jin H, Yang L, Xu W, Jiao L (2014) Compressive sensing-inspired dual-sparse slfnn for hyperspectral imagery classification. Geosci Remote Sens Lett IEEE 11(1):220–224

    Article  Google Scholar 

  47. Ye Y, Squartini S, Piazza F (2012) On-line extreme learning machine for training time-varying neural networks. Bio-Inspired Comput Appl 6840:49–54

    Article  Google Scholar 

  48. Yu S, Falck T, Daemen A, Tranchevent LC, Suykens JA, De Moor B, Moreau Y (2010) L2-norm multiple kernel learning and its application to biomedical data fusion. BMC Bioinf 11(1):309

    Article  Google Scholar 

  49. Yu S, Tranchevent LC, De Moor B, Moreau Y (2011) L n-norm multiple kernel learning and least squares support vector machines. Springer, Berlin Heidelberg, Berlin, Heidelberg, pp 39–88

    Google Scholar 

  50. Zhang L, He Z, Liu Y (2017a) Deep object recognition across domains based on adaptive extreme learning machine. Neurocomputing 239:194–203

    Article  Google Scholar 

  51. Zhang L, Liu Y, Deng P (2017b) Odor recognition in multiple e-nose systems with cross-domain discriminative subspace learning. IEEE Trans Instrum Meas 66(7):1679–1692

    Article  Google Scholar 

  52. Zhang L, Wang X, Huang GB, Liu T, Tan X (2018a) Taste recognition in e-tongue using local discriminant preservation projection. IEEE Trans Cybern 1–14

  53. Zhang Y, Wang Y, Zhou G, Jin J, Wang B, Wang X, Cichocki A (2018b) Multi-kernel extreme learning machine for eeg classification in brain-computer interfaces. Expert Syst Appl 96:302–310

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by National Natural Science Foundation of China under Grant no. 61374154 and the National Basic Research Program of China under Grant no. 2013CB430403.

Author information

Authors and Affiliations

  1. Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology, Dalian, Liaoning, China

    Fei Lv & Min Han

Authors
  1. Fei Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Min Han
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fei Lv.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lv, F., Han, M. Hyperspectral image classification based on multiple reduced kernel extreme learning machine. Int. J. Mach. Learn. & Cyber. 10, 3397–3405 (2019). https://doi.org/10.1007/s13042-019-00926-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-019-00926-5

Keywords

Search

Navigation