Neuro-robotics study on integrative learning of proactive visual attention and motor behaviors
- 280 Downloads
The current paper proposes a novel model for integrative learning of proactive visual attention and sensory-motor control as inspired by the premotor theory of visual attention. The model is characterized by coupling a slow dynamics network with a fast dynamics network and by inheriting our prior proposed multiple timescales recurrent neural networks model (MTRNN) that may correspond to the fronto-parietal networks in the cortical brains. The neuro-robotics experiments in a task of manipulating multiple objects utilizing the proposed model demonstrated that some degrees of generalization in terms of position and object size variation can be achieved by organizing seamless integration of the proactive object-related visual attention and the related sensory-motor control into a set of action primitives in the distributed neural activities appearing in the fast dynamics network. It was also shown that such action primitives can be combined in compositional ways in acquiring novel actions in the slow dynamics network. The experimental results presented substantiate the premotor theory of visual attention.
KeywordsProactive visual attention Multiple time recurrent neural networks Premotor theory of visual attention Multiple objects manipulation task
This research was supported by the Ministry of Education, Culture, Sports, Science and Technology of Japan, Grants-in-Aid for Scientific Research on Innovative Areas (No. 22120523, 2010) (50%), the Korea-Japan Collaboration Core Project on Neuroinformatics (10%) and the Converging Research Center Program (40%) through the National Research Foundation (NRF) of Korea funded by the Ministry of Education, Science and Technology (2009-0082262).
- Doya K, Yoshizawa S (1989) Memorizing oscillatory patterns in the analog neuron network. In: Proceedings of 1989 international joint conference on neural networks, vol I, Washington, DC, pp 27–32Google Scholar
- Furneaux S, Land MF (1999) The effects of skill on the eye-hand span during musical sight-reading. In: Proceeding of Royal Society, vol 266, pp 2435–2440Google Scholar
- Fuster JM (2008) The prefrontal cortex, 4th edn. Academic Press, LondonGoogle Scholar
- Kohonen T (2001) Self-organizing maps. Springer Series in Information Sciences, vol 30, SpringerGoogle Scholar
- McCallum AK (1996) Learning to use selective attention and short-term memory in sequential tasks. In: Proceedings of the fourth international conference on simulation of adaptive behavior, (SAB’96), pp 315–324Google Scholar
- Prablanc C, Echallier JF, Komilis E, Jeannerod M (1979) Optimal response of eye and hand motor systems in pointing at a visual target. I. Spatio-temporal characteristics of eye and hand movements and their relationships when varying the amount of visual information. Biol Cybern 35:113–124PubMedCrossRefGoogle Scholar
- Rizzolatti G, Craighero L (1998) Spatial attention: mechanisms and theories. In: Sabourin M, Craik F, Robert M (eds) Advances in psychological science, 2, biological and cognitive aspects. Psychology Press, East Sussex, pp 171–198Google Scholar
- Rizzolatti G, Riggio L, Sheliga BM (1994) Space and selective attention. In: Umiltà C, Moscovitch M (eds) Attention and performance XV. MIT Press, Cambridge, pp 231–265Google Scholar
- Rumelhart DE, Hinton GE, Williams RJ (1986) Learning internal representations by error propagation. Parallel distributed processing, explorations in the microstructure of cognition, 1st edn. MIT Press, CambridgeGoogle Scholar
- Varela FJ, Thompson E, Rosch E (1991) The embodied mind. MIT Press, CambridgeGoogle Scholar