Abstract
Hubel Weisel models of pattern recognition are thought to be anatomically and physiologically faithful models of information representation in the cortex. They describe sensory information as being encoded in a hierarchy of increasingly sophisticated representations across the layers of the cortex. They have been shown in previous studies as robust models of object recognition. In a previous work, we have also shown Hubel Weisel models as being capable of representing a hierarchy of concepts. In this paper, we explore incremental learning with respect to Hubel Weisel models of concept representation. The challenges of incremental learning in the Hubel Weisel model are discussed. We then compare the use of variably dense self organizing maps to perform incremental learning against the original implementation using growing self organizing maps. The use of variable density self organizing maps shows better results in terms of the percentage of documents correctly clustered. The percentage improvement in clustering accuracy is in some cases up to 50% over the original GSOM implementation for the incrementally learnt module. However, we also highlight the issues that make the evaluation of such a model a challenging one.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cadieu, C., Kouh, M., Pasupathy, A., Conner, C., Riesenhuber, M., Poggio, T.A.: A Model of V4 Shape Selectivity and Invariance. Journal of Neurophysiology 98, 1733–1750 (2007)
George, D., Hawkins, J.: A hierarchical Bayesian Model of Invariant Pattern Recognition in the Visual Cortex. In: International Joint Conference on Neural Networks, vol. 3, pp. 1812–1817 (2005)
Farahmand, N., Dezfoulian, M., GhiasiRad, H., Mokhtari, A., Nouri, A.: Online Temporal Pattern Learning. In: IJCNN 2009 (2009)
Fukushima, K.: Neocognitron capable of incremental learning. Neural networks 17, 37–46 (2004)
Mountcastle, V.: An Organizing Principle for Cerebral Function: The Unit Model and the Distributed System. In: Edelman, G.M., Mountcastle, V.B. (eds.) The Mindful Brain, MIT Press, Cambridge (1978)
Hubel, D., Weisel, T.: Receptive fields and functional architecture in two non striate visual areas (18 and 19) of a cat. Journal of NeuroPhysiology 28, 229–289 (1965)
Fukushima, K.: Neocognitron for handwritten digit recognition 1. Neurocomputing 51C, 161–180 (2003)
Alahakhoon, D., Halgamuge, S.K., Srinivasan, B.: Dynamic Self Organizing maps with controlled growth for Knowledge discovery. IEEE Transactions on Neural Networks 11(3), 601–614 (2000)
Lagus, K.: Text retrieval using self-organized document maps. Neural Processing Letters 15(1), 21–29 (2002)
Fellbaum, C.: Wordnet: An electronic lexical database. MIT Press, Cambridge (1998)
Mc Clelland, J.L., Rogers, T.T.: The parallel distributed processsing approach to semantic cognition. Nature Reviews Neuroscience 4(4), 310–322 (2003)
Sloutsky, V.M.: The role of similarity in the development of categorization. Trends in Cognitive Sciences 7, 246–251 (2003)
Sloutsky, V.M., Kloos, H., Fisher, A.: When looks are everything – appearance similarity versus kind information in early induction. Psychological Science 18(2), 179–185 (2007)
Rauber, A., Merkl, D., Dittenbach, M.: The growing hierarchical self organizing map, exploratory analysis of high dimensional data. IEEE Transactions on Neural Networks 13(6), 1331–1341 (2002)
Rogers, T.T., McClelland, J.L.: Precis of Semantic Cognition, a Parallel distributed Processing approach. Brain and Behavioral Sciences 31, 689–749 (2008)
Ramanathan, K., Shi, L., Chong, T.C.: A Hubel Weisel model for hierarchical representation of concepts in textual documents. In: The Annual Congress of the Cognitive Science Society (2010) (accepted)
Quillian, M.R.: Semantic Information Processing, pp. 227–270. MIT Press, Cambridge (1965)
Shimada, A., Kanouchi, M., Arita, D., Tanuguchi, R.: Robust estimation of human posture using incremental learning self organizing Map. In: IJCNN 2008 (2008)
Widrow, B., Etemadi, M.: Cognitive memory: human and machine. In: IJCNN 2009, pp. 3516–523 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Daniel, N.C.k., Ramanathan, K., Luping, S., Vadakkepat, P. (2010). A Comparison between Growing and Variably Dense Self Organizing Maps for Incremental Learning in Hubel Weisel Models of Concept Representation. In: Vadakkepat, P., et al. Trends in Intelligent Robotics. FIRA 2010. Communications in Computer and Information Science, vol 103. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15810-0_36
Download citation
DOI: https://doi.org/10.1007/978-3-642-15810-0_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15809-4
Online ISBN: 978-3-642-15810-0
eBook Packages: Computer ScienceComputer Science (R0)