Advertisement

Dendrite Ellipsoidal Neuron Trained by Stochastic Gradient Descent for Motor Imagery Classification

  • Fernando ArceEmail author
  • Omar Mendoza-Montoya
  • Erik Zamora
  • Javier M. Antelis
  • Humberto Sossa
  • Jessica Cantillo-Negrete
  • Ruben I. Carino-Escobar
  • Luis G. Hernández
  • Luis Eduardo Falcón
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11524)

Abstract

Dendrite ellipsoidal neurons are a novel and different alternative for classification tasks, giving competitive results compared with typical classification methods. Based on k-means++ algorithm, the network allows each dendrite to build a hyperellipsoidal in order to assign each incoming pattern \(x_{i}=(x_{1},x_{2},\ldots ,x_{n})^{T}\) to its respective C class. The main disadvantage of this training algorithm is the lack of accuracy in high dimensional datasets. In this research, we solved this problem by training the dendrite ellipsoidal neuron using stochastic gradient descent. Furthermore, electroencephalography data were acquired during two mental conditions (imaginary movements of the left and right hand) in order to test the new training algorithm. The proposed algorithm outperformed the accuracy acquired by a dendrite ellipsoidal neuron based on k-means++ obtaining 76.02% and 62.77%, respectively. Also, the algorithm was compared with multilayer perceptrons and support vector machines which are some of the most common classifiers used to detect motor-related information in brain signals. These achieved an accuracy of 72.38% and 65.81%, respectively.

Keywords

Dendrite Ellipsoidal Neuron Motor Imagery Electroencephalography Multilayer perceptrons Support vector machines Stochastic Gradient Descent k-means++ 

Notes

Acknowledgments

H. Sossa and E. Zamora would like to acknowledge the support provided by CIC-IPN and M. Antelis to Tecnológico de Monterrey, in carrying out this research. This work was economically supported by SIP-IPN (grant numbers 20180180, 20180730, 20190007 and 20190166) and CONACYT grant numbers 65 (Frontiers of Science), 268958 and PN2015-873. F. Arce and O. Mendoza-Montoya acknowledge CONACYT for the scholarship granted towards pursuing their PhD and post-PhD studies, respectively.

References

  1. 1.
    Leshno, M., Lin, V.Y., Pinkus, A., Schocken, S.: Multilayer feedforward networks with a nonpolynomial activation function can approximate any function. Neural Netw. 6(6), 861–867 (1993)CrossRefGoogle Scholar
  2. 2.
    Arce, F., Zamora, E., Sossa, H.: Dendrite ellipsoidal neuron. In: 2017 International Joint Conference on Neural Networks (IJCNN), pp. 795–802, May 2017Google Scholar
  3. 3.
    Arce, F., Zamora, E., Fócil-Arias, C., Sossa, H.: Dendrite ellipsoidal neurons based on k-means optimization. Evolving Syst. 1–16 (2018). https://app.dimensions.aion2019/02/18
  4. 4.
    Montavon, G., Müller, K.-R.: Big learning and deep neural networks. In: Montavon, G., Orr, G.B., Müller, K.-R. (eds.) Neural Networks: Tricks of the Trade. LNCS, vol. 7700, pp. 419–420. Springer, Heidelberg (2012).  https://doi.org/10.1007/978-3-642-35289-8_24CrossRefGoogle Scholar
  5. 5.
    Chollet, F., et al.: Keras (2015). https://keras.io
  6. 6.
    Ritter, G.X., Li, D., Wilson, J.N.: Image algebra and its relationship to neural networks (1989)Google Scholar
  7. 7.
    Davidson, J.L., Ritter, G.X.: Theory of morphological neural networks (1990)Google Scholar
  8. 8.
    Davidson, J.L., Sun, K.: Template learning in morphological neural nets (1991)Google Scholar
  9. 9.
    Davidson, J.L., Hummer, F.: Morphology neural networks: an introduction with applications. Circ. Syst. Sig. Process. 12(2), 177–210 (1993)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Segev, I.: The Handbook of Brain Theory and Neural Networks, pp. 282–289. MIT Press, Cambridge (1998)Google Scholar
  11. 11.
    Ritter, G.X., Iancu, L., Urcid, G.: Morphological perceptrons with dendritic structure. In: The 12th IEEE International Conference on Fuzzy Systems, FUZZ 2003, vol. 2., pp. 1296–1301, May 2003Google Scholar
  12. 12.
    Mahalanobis, P.C.: On the generalised distance in statistics. Proc. Natl. Inst. Sci. India 2(1), 49–55 (1936)MathSciNetzbMATHGoogle Scholar
  13. 13.
    Arthur, D., Vassilvitskii, S.: K-means++: the advantages of careful seeding. In: Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2007, pp. 1027–1035. Society for Industrial and Applied Mathematics, Philadelphia (2007)Google Scholar
  14. 14.
    Sung, K.-K., Poggio, T.: Learning human face detection in cluttered scenes. In: Hlaváč, V., Šára, R. (eds.) CAIP 1995. LNCS, vol. 970, pp. 432–439. Springer, Heidelberg (1995).  https://doi.org/10.1007/3-540-60268-2_326CrossRefGoogle Scholar
  15. 15.
    Sung, K.K., Poggio, T.: Example-based learning for view-based human face detection. IEEE Trans. Pattern Anal. Mach. Intell. 20(1), 39–51 (1998)CrossRefGoogle Scholar
  16. 16.
    Bishop, C.M.: Pattern Recognition and Machine Learning. Information Science and Statistics. Springer, New York (2006)zbMATHGoogle Scholar
  17. 17.
    Rall, L.B.: Automatic computation of gradients, Jacobians, Hessians, and applications to optimization. In: Rall, L.B. (ed.) Automatic Differentiation: Techniques and Applications. LNCS, vol. 120, pp. 91–111. Springer, Heidelberg (1981).  https://doi.org/10.1007/3-540-10861-0_6CrossRefzbMATHGoogle Scholar
  18. 18.
    Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)zbMATHGoogle Scholar
  19. 19.
    Lotte, F., Congedo, M., Lécuyer, A., Fabrice, L., Arnaldi, B.: A review of classification algorithms for EEG-based brain-computer interfaces. J. Neural Eng. 4, R1 (2007)Google Scholar
  20. 20.
    Ali, A.B.M.S., Abraham, A.: An empirical comparison of kernel selection for support vector machines. In: Soft Computing Systems: Design, Management and Applications, pp. 321–330 (2002)Google Scholar
  21. 21.
    Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1, pp. 318–362. MIT Press, Cambridge (1986)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Fernando Arce
    • 1
    Email author
  • Omar Mendoza-Montoya
    • 2
  • Erik Zamora
    • 1
  • Javier M. Antelis
    • 2
  • Humberto Sossa
    • 1
    • 2
  • Jessica Cantillo-Negrete
    • 3
  • Ruben I. Carino-Escobar
    • 3
  • Luis G. Hernández
    • 2
  • Luis Eduardo Falcón
    • 2
  1. 1.Instituto Politécnico Nacional - CICMexico CityMexico
  2. 2.Tecnológico de Monterrey Campus GuadalajaraZapopanMexico
  3. 3.Division of Medical Engineering ResearchInstituto Nacional de RehabilitaciónMexico CityMexico

Personalised recommendations