Abstract
Our recently introduced Neocortex-Inspired Locally Recurrent Neural Network is a machine learning system that is able to learn feature extraction functions from sequential data in an unsupervised way. While it was designed with the main purpose of feature learning, its structure and desired functioning is highly inspired by models of the feedforward circuits in the neocortex. In this work, we study the behavior of our system when it takes shifting images as input, and we compare it with known behavior of the primary visual cortex. The results show that some of the best-known emerging properties in the primary visual cortex, such as the emergence of simple and complex cells as well as orientation maps, also occur in our system, indicating that also their behaviors can be considered analogous. This validates our system as a potential model of the primary visual cortex that may contribute to further understanding of its functioning. In addition, considering that most areas in the neocortex show similarities in terms of structure and operation, future studies of our system over inputs other than images may also bring new insights about other neocortical areas.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Antolik, J., Bednar, J.A.: Development of maps of simple and complex cells in the primary visual cortex. Front. Comput. Neurosci. 5, 17 (2011)
Blasdel, G.G.: Orientation selectivity, preference, and continuity in monkey striate cortex. J. Neurosci. 12(8), 3139–3161 (1992)
Burgess, N.: Computational models of the spatial and mnemonic functions of the hippocampus. In: Andersen, P., Morris, R., Amaral, D., Bliss, T., O’Keefe, J. (eds.) The Hippocampus Book, pp. 715–750. Oxford University Press (2007)
Choe, Y.: Hebbian learning. In: Jaeger, D., Jung, R. (eds.) Encyclopedia of Computational Neuroscience, pp. 1305–1309. Springer, New York (2015)
Cohen, M.X., Frank, M.J.: Neurocomputational models of basal ganglia function in learning, memory and choice. Behav. Brain Res. 199(1), 141–156 (2009)
Gilbert, C.D.: Laminar differences in receptive field properties of cells in cat primary visual cortex. J. Physiol. 268(2), 391–421 (1977)
Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press (2016). http://www.deeplearningbook.org
Graham, D.J., Field, D.J.: Sparse coding in the neocortex. Evol. Nervous Syst. 3, 181–187 (2006)
Hubel, D.H., Wiesel, T.N.: Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex. J. Physiol. 160(1), 106–154 (1962)
Hubel, D.H., Wiesel, T.N.: Sequence regularity and geometry of orientation columns in the monkey striate cortex. J. Compar. Neurol. 158(3), 267–293 (1974)
Lindsay, G.W.: Convolutional neural networks as a model of the visual system: past, present, and future. J. Cogn. Neurosci. 33(10), 2017–2031 (2021)
Liu, Z., Gaska, J.P., Jacobson, L.D., Pollen, D.A.: Interneuronal interaction between members of quadrature phase and anti-phase pairs in the cat’s visual cortex. Vision. Res. 32(7), 1193–1198 (1992)
Lukatela, K., Swadlow, H.A.: Neocortex. The corsini encyclopedia of psychology, pp. 1–2 (2010)
Martinez, L.M., Alonso, J.M.: Complex receptive fields in primary visual cortex. Neuroscientist 9(5), 317–331 (2003)
McClelland, J.L.: How far can you go with hebbian learning, and when does it lead you astray. Processes of change in brain and cognitive development: attention and performance xxi, vol. 21, pp. 33–69 (2006)
Mesulam, M.M.: From sensation to cognition. Brain J. Neurol. 121(6), 1013–1052 (1998)
Mountcastle, V.B.: The columnar organization of the neocortex. Brain J. Neurol. 120(4), 701–722 (1997)
Narayanan, R.T., Udvary, D., Oberlaender, M.: Cell type-specific structural organization of the six layers in rat barrel cortex. Front. Neuroanat. 11, 91 (2017)
Ng, A.: Deep learning and unsupervised feature learning handouts (2011). https://web.stanford.edu/class/cs294a/handouts.html
Ringach, D.L., Shapley, R.M., Hawken, M.J.: Orientation selectivity in macaque v1: diversity and laminar dependence. J. Neurosci. 22(13), 5639–5651 (2002)
Tong, F.: Primary visual cortex and visual awareness. Nat. Rev. Neurosci. 4(3), 219–229 (2003)
Van-Horenbeke, F.A., Peer, A.: Nilrnn: a neocortex-inspired autoencoder-like locally recurrent neural network for unsupervised feature learning in sequential data (2022). (manuscript in preparation)
Wiskott, L.: Slow feature analysis: a theoretical analysis of optimal free responses. Neural Comput. 15(9), 2147–2177 (2003)
Acknowledgements
This research was supported by the Euregio project OLIVER (Open-Ended Learning for Interactive Robots) with grant agreement IPN86, funded by the EGTC Europaregion Tirol-Südtirol-Trentino within the framework of the third call for projects in the field of basic research.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 IFIP International Federation for Information Processing
About this paper
Cite this paper
Van-Horenbeke, F.A., Peer, A. (2022). The Neocortex-Inspired Locally Recurrent Neural Network (NILRNN) as a Model of the Primary Visual Cortex. In: Maglogiannis, I., Iliadis, L., Macintyre, J., Cortez, P. (eds) Artificial Intelligence Applications and Innovations. AIAI 2022. IFIP Advances in Information and Communication Technology, vol 646. Springer, Cham. https://doi.org/10.1007/978-3-031-08333-4_24
Download citation
DOI: https://doi.org/10.1007/978-3-031-08333-4_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-08332-7
Online ISBN: 978-3-031-08333-4
eBook Packages: Computer ScienceComputer Science (R0)
