Abstract
Self-Organizing Maps (SOM) are well-known unsupervised neural networks able to perform vector quantization while mapping an underlying regular neighbourhood structure onto the codebook. They are used in a wide range of applications. As with most properly trained neural networks models, increasing the number of neurons in a SOM leads to better results or new emerging properties. Therefore highly efficient algorithms for learning and evaluation are key to improve the performance of such models. In this paper, we propose a faster alternative to compute the Winner Takes All component of SOM that scales better with a large number of neurons. We present our algorithm to find the so-called best matching unit (BMU) in a SOM, and we theoretically analyze its computational complexity. Statistical results on various synthetic and real-world datasets confirm this analysis and show an even more significant improvement in computing time with a minimal degradation of performance. With our method, we explore a new approach for optimizing SOM that can be combined with other optimization methods commonly used in these models for an even faster computation in both learning and recall phases.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abadi, M., Jovanovic, S., Khalifa, K.B., Weber, S., Bedoui, M.H.: A scalable and adaptable hardware NoC-based self organizing map. Microprocess. Microsyst. 57, 1–14 (2018)
Amerijckx, C., Legat, J.D., Verleysen, M.: Image compression using self-organizing maps. Syst. Anal. Modell. Simul. 43(11), 1529–1543 (2003)
Cottrell, M., Olteanu, M., Rossi, F., Villa-Vialaneix, N.N.: Self-OrganizingMaps, theory and applications. Revista de Investigacion Operacional 39(1), 1–22 (2018)
Fiannaca, A., Di Fatta, G., Rizzo, R., Urso, A., Gaglio, S.: Simulated annealing technique for fast learning of SOM networks. Neural Comput. Appl. 22(5), 889–899 (2013). https://doi.org/10.1007/s00521-011-0780-6
Fritzke, B.: A growing neural gas network learns topologies. In: Advances in Neural Information Processing Systems, vol. 7. pp. 625–632. MIT Press (1995)
Huang, Z., et al.: A hardware-efficient vector quantizer based on self-organizing map for high-speed image compression. Appl. Sci. 7(11), 1106 (2017)
Jackson, Z., Souza, C., Flaks, J., Pan, Y., Nicolas, H., Thite, A.: Jakobovski/free-spoken-digit-dataset: v1.0.8, August 2018
Kohonen, T.: Self-organized formation of topologically correct feature maps. Biol. Cybern. 43(1), 59–69 (1982). https://doi.org/10.1007/BF00337288
Kohonen, T.: The self-organizing map. Neurocomputing 21(1–3), 1–6 (1998)
Kohonen, T.: Essentials of the self-organizing map. Neural Netw. 37, 52–65 (2013)
Kohonen, T., Honkela, T.: Kohonen network. Scholarpedia 2(1), 1568 (2007)
MacQueen, J.: Some methods for classification and analysis of multivariate observations. The Regents of the University of California (1967)
Martinetz, T.M., Berkovich, S.G., Schulten, K.J.: Neural-gas network for vector quantization and its application to time-series prediction. IEEE Trans. Neural Netw. 4(4), 558–569 (1993)
Oyana, T.J., Achenie, L.E., Heo, J.: The new and computationally efficient MIL-SOM algorithm: potential benefits for visualization and analysis of a large-scale high-dimensional clinically acquired geographic data. Comput. Math. Methods Med. 2012, 14 (2012)
Vasuki, A., Vanathi, P.: A review of vector quantization techniques. IEEE Potentials 25(4), 39–47 (2006)
Yin, H.: The self-organizing maps: background, theories, extensions and applications. In: Fulcher, J., Jain, L.C. (eds.) Computational Intelligence: A Compendium. Studies in Computational Intelligence, vol. 115. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-78293-3_17
Acknowledgements
The authors thank the French AID agency (Agence de l’Innovation pour la Défense) for funding the DGA-2018 60 0017 contract. The code is available at github.com/yabernar/FastBMU.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Bernard, Y., Hueber, N., Girau, B. (2020). A Fast Algorithm to Find Best Matching Units in Self-Organizing Maps. In: Farkaš, I., Masulli, P., Wermter, S. (eds) Artificial Neural Networks and Machine Learning – ICANN 2020. ICANN 2020. Lecture Notes in Computer Science(), vol 12397. Springer, Cham. https://doi.org/10.1007/978-3-030-61616-8_66
Download citation
DOI: https://doi.org/10.1007/978-3-030-61616-8_66
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-61615-1
Online ISBN: 978-3-030-61616-8
eBook Packages: Computer ScienceComputer Science (R0)