Abstract
Insects, despite relatively small brains, can perform complex navigation tasks such as memorising a visual route. The exact format of visual memory encoded by neural systems during route learning and following is still unclear. Here we propose that interconnections between Kenyon cells in the Mushroom Body (MB) could encode spatio-temporal memory of visual motion experienced when moving along a route. In our implementation, visual motion is sensed using an event-based camera mounted on a robot, and learned by a biologically constrained spiking neural network model, based on simplified MB architecture and using modified leaky integrate-and-fire neurons. In contrast to previous image-matching models where all memories are stored in parallel, the continuous visual flow is inherently sequential. Our results show that the model can distinguish learned from unlearned route segments, with some tolerance to internal and external noise, including small displacements. The neural response can also explain observed behaviour taken to support sequential memory in ant experiments. However, obtaining comparable robustness to insect navigation might require the addition of biomimetic pre-processing of the input stream, and determination of the appropriate motor strategy to exploit the memory output.
Supported by China Scholarships Council (Grant No.201808060165).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Ardin, P., Peng, F., Mangan, M., Lagogiannis, K., Webb, B.: Using an insect mushroom body circuit to encode route memory in complex natural environments. PLOS Comput. Biol. 12(2), 1–22 (2016). https://doi.org/10.1371/journal.pcbi.1004683
Baddeley, B., Graham, P., Philippides, A., Husbands, P.: Holistic visual encoding of ant-like routes: Navigation without waypoints. Adapt. Behav. 19(1), 3–15 (2011). https://doi.org/10.1177/1059712310395410
Blanchard, M., Rind, F.C., Verschure, P.F.: Collision avoidance using a model of the locust LGMD neuron. Robot. Auton. Syst. 30(1–2), 17–38 (2000)
Cope, A.J., Sabo, C., Gurney, K., Vasilaki, E., Marshall, J.A.: A model for an angular velocity-tuned motion detector accounting for deviations in the corridor-centering response of the bee. PLoS Comput. Biol. 12(5), e1004887 (2016)
Cope, A.J., Vasilaki, E., Minors, D., Sabo, C., Marshall, J.A., Barron, A.B.: Abstract concept learning in a simple neural network inspired by the insect brain. PLoS Comput. Biol. 14(9), e1006435 (2018)
Eichler, K., et al.: The complete connectome of a learning and memory centre in an insect brain. Nature 548(7666), 175 (2017)
Graham, P., Mangan, M.: Insect navigation: do ants live in the now? J. Exp. Biol. 218(6), 819–823 (2015). https://doi.org/10.1242/jeb.065409. https://jeb.biologists.org/content/218/6/819
Groh, C., Rössler, W.: Analysis of synaptic microcircuits in the mushroom bodies of the honeybee. Insects 11(1), 43 (2020)
Ito, I., Ong, R.C., Raman, B., Stopfer, M.: Sparse odor representation and olfactory learning. Nat. Neurosci. 11(10), 1177 (2008)
Kodzhabashev, A., Mangan, M.: Route following without scanning. In: Wilson, S.P., Verschure, P.F.M.J., Mura, A., Prescott, T.J. (eds.) LIVINGMACHINES 2015. LNCS (LNAI), vol. 9222, pp. 199–210. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22979-9_20
Kropf, J., Rössler, W.: In-situ recording of ionic currents in projection neurons and kenyon cells in the olfactory pathway of the honeybee. PloS One 13(1), e0191425 (2018)
Lehrer, M., Srinivasan, M.V., Zhang, S.W., Horridge, G.A.: Motion cues provide the bee’s visual world with a third dimension. Nature 332(6162), 356–357 (1988)
Lowry, S., et al.: Visual place recognition: a survey. IEEE Trans. Robot. 32(1), 1–19 (2015)
Milford, M.: Vision-based place recognition: how low can you go? Int. J. Robot. Res. 32(7), 766–789 (2013)
Milford, M.J., Wyeth, G.F.: SeqSLAM: visual route-based navigation for sunny summer days and stormy winter nights. In: 2012 IEEE International Conference on Robotics and Automation, pp. 1643–1649. IEEE (2012)
Perez-Orive, J., Mazor, O., Turner, G.C., Cassenaer, S., Wilson, R.I., Laurent, G.: Oscillations and sparsening of odor representations in the mushroom body. Science 297(5580), 359–365 (2002)
Posch, C., Serrano-Gotarredona, T., Linares-Barranco, B., Delbruck, T.: Retinomorphic event-based vision sensors: bioinspired cameras with spiking output. Proc. IEEE 102(10), 1470–1484 (2014). https://doi.org/10.1109/JPROC.2014.2346153
Ramos-Traslosheros, G., Henning, M., Silies, M.: Motion detection: cells, circuits and algorithms. Neuroforum 24(2), A61–A72 (2018)
Schwarz, S., et al.: Route-following ants respond to alterations of the view sequence. https://jeb-biologists-org.ezproxy.is.ed.ac.uk/content/223/14/jeb218701
Srinivasan, M.V., Poteser, M., Kral, K.: Motion detection in insect orientation and navigation. Vis. Res. 39(16), 2749–2766 (1999)
Stone, T., Mangan, M., Ardin, P., Webb, B., et al.: Sky segmentation with ultraviolet images can be used for navigation. In: Robotics: Science and Systems (2014)
Tabuchi, M., Inoue, S., Kanzaki, R., Nakatani, K.: Whole-cell recording from kenyon cells in silkmoths. Neurosci. Lett. 528(1), 61–66 (2012)
Walker, C., Graham, P., Philippides, A.: Using deep autoencoders to investigate image matching in visual navigation. In: Mangan, M., Cutkosky, M., Mura, A., Verschure, P.F.M.J., Prescott, T., Lepora, N. (eds.) Living Machines 2017. LNCS (LNAI), vol. 10384, pp. 465–474. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-63537-8_39
Wystrach, A., Schwarz, S.: Ants use a predictive mechanism to compensate for passive displacements by wind. Curr. Biol. 23(24), R1083–R1085 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhu, L., Mangan, M., Webb, B. (2020). Spatio-Temporal Memory for Navigation in a Mushroom Body Model. In: Vouloutsi, V., Mura, A., Tauber, F., Speck, T., Prescott, T.J., Verschure, P.F.M.J. (eds) Biomimetic and Biohybrid Systems. Living Machines 2020. Lecture Notes in Computer Science(), vol 12413. Springer, Cham. https://doi.org/10.1007/978-3-030-64313-3_39
Download citation
DOI: https://doi.org/10.1007/978-3-030-64313-3_39
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-64312-6
Online ISBN: 978-3-030-64313-3
eBook Packages: Computer ScienceComputer Science (R0)