Multimodal Attention System for an Interactive Robot

  • Oscar Déniz
  • Modesto Castrillón
  • Javier Lorenzo
  • Mario Hernández
  • Juan Méndez
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2652)


Social robots are receiving much interest in the robotics community. The most important goal for such robots lies in their interaction capabilities. An attention system is crucial, both as a filter to center the robot’s perceptual resources and as a mean of letting the observer know that the robot has intentionality. In this paper a simple but flexible and functional attentional model is described. The model, which has been implemented in an interactive robot currently under development, fuses both visual and auditive information extracted from the robot’s environment, and can incorporate knowledge-based influences on attention.


Sound Source Humanoid Robot Joint Attention Social Robot Interactive Robot 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Breazeal, C.L.: Designing social robots. MIT Press, Cambridge (2002)Google Scholar
  2. 2.
    Corbetta, M., Shulman, G.L.: Control of goal-directed and stimulus-driven attention in the brain. Nature reviews neuroscience 3, 201–215 (2002)CrossRefGoogle Scholar
  3. 3.
    Van de Laar, P., Heskes, T., Gielen, S.: Taks-dependent learning of attention. Neural networks 10(6), 981–992 (1997)CrossRefGoogle Scholar
  4. 4.
    Déniz, O., Cabrera, J., Hernández, M.: Building a sound localization system for a robot head. Inteligencia Artificial. Revista Iberoamericana de Inteligencia Artificial (2003) (to appear)Google Scholar
  5. 5.
    Driscoll, J.A., Peters II, R.A., Cave, K.R.: A visual attention network for a humanoid robot. In: IEEE/RSJ International Conference on Intelligent Robotic Systems, Victoria, B.C., Canada (1998)Google Scholar
  6. 6.
    Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robotics and Autonomous Systems 42(3-4) (March 2003)Google Scholar
  7. 7.
    Grove, T.D., Fisher, R.B.: Attention in iconic object matching. In: Procs. of British Machine Vision Conference, Edinburgh, September 1996, pp. 293–302 (1996)Google Scholar
  8. 8.
    Heinke, D., Humphreys, G.W.: Computational models of visual selective attention: A review. In: Houghton, G. (ed.) Connectionist models in psychology (2001)Google Scholar
  9. 9.
    Itti, L.: Modeling primate visual attention. In: Feng, J. (ed.) Computational Neuroscience: A Comprehensive Approach. CRC Press, Boca RatónGoogle Scholar
  10. 10.
    Itti, L., Koch, C.: Computational modeling of visual attention. Nature reviews neuroscience 2(3), 194–203 (2001)CrossRefGoogle Scholar
  11. 11.
    Kopp, L., Gärdenfors, P.: Attention as a Minimal Criterion of Intentionality in Robots. Lund University Cognitive Studies, vol. 89 (2001)Google Scholar
  12. 12.
    Metta, G.: An attentional system for a humanoid robot exploiting space variant vision. In: IEEE-RAS International Conference on Humanoid Robots, Tokyo, November 2001, pp. 359–366 (2001)Google Scholar
  13. 13.
    Milanese, R., Wechsler, H., Gil, S., Bost, J.M., Pun, T.: Integration of bottomup and top-down cues for visual attention using non-linear relaxation. In: Procs. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 781–785 (1994)Google Scholar
  14. 14.
    Scassellati, B.: Foundations for a Theory of Mind for a Humanoid Robot. PhD thesis, MIT Department of Computer Science and Electrical Engineering (May 2001)Google Scholar
  15. 15.
    Wolfe, J.M.: Guided search 2.0: A revised model of visual search. Psychonomic Bulletin and Review 1(2), 202–238 (1994)CrossRefGoogle Scholar
  16. 16.
    Wolfe, J.M., Gancarz, G.: Guided Search 3.0. Basic and Clinical Applications of Vision Science, pp. 189–192. Kluwer Academic, Netherlands (1996)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Oscar Déniz
    • 1
  • Modesto Castrillón
    • 1
  • Javier Lorenzo
    • 1
  • Mario Hernández
    • 1
  • Juan Méndez
    • 1
  1. 1.Instituto Universitario de Sistemas Inteligentes (IUSIANI)Univ. Las Palmas de Gran CanariaLas PalmasSpain

Personalised recommendations