Computational Modeling of Visual Selective Attention Based on Correlation and Synchronization of Neural Activity

  • Kleanthis C. Neokleous
  • Marios N. Avraamides
  • Christos N. Schizas
Conference paper
Part of the IFIP International Federation for Information Processing book series (IFIPAICT, volume 296)


Within the broad area of computational intelligence, it is of great importance to develop new computational models of human behaviour aspects. In this report we look into the recently suggested theory that neural synchronization of activity in different areas of the brain occurs when people attend to external visual stimuli. Furthermore, it is suspected that this cross-area synchrony may be a general mechanism for regulating information flow through the brain. We investigate the plausibility of this hypothesis by implementing a computational model of visual selective attention that is guided by endogenous and exogenous goals (i.e., what is known as top down and bottom-up attention). The theoretical structure of this model is based on the temporal correlation of neural activity that was initially proposed by Niebur and Koch (1994). While a saliency map is created in the model at the initial stages of processing visual input, at a later stage of processing, neural activity passes through a correlation control system which comprises of coincidence detector neurons. These neurons measure the degree of correlation between endogenous goals and the presented visual stimuli and cause an increase in the synchronization between the brain areas involved in vision and goal maintenance. The model was able to simulate with success behavioural data from the “at-tentional blink” paradigm (Raymond and Sapiro, 1992). This suggests that the temporal correlation idea represents a plausible hypothesis in the quest for understanding attention.


Visual Stimulus Stimulus Onset Asynchrony Neural Activity Attentional Blink Rapid Serial Visual Presentation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Bowman H.,Wyble S.(2007). “The Simultaneous Type, Serial Token Model of Temporal Attention and Working Memory.” Psy. Re., Vol. 114Google Scholar
  2. 2.
    Buehlmann A., Deco G (2008). “The Neuronal Basis of Attention: Rate versus Synchronization Modulation”. The Jour. of Neuros. 28(30)Google Scholar
  3. 3.
    Corbetta, M., Shulman, G.L. (2002).“Control of goal-directed and stimulus-driven attention in the brain”. Nature R. Neuroscience 3:201–215.Google Scholar
  4. 4.
    Deco G, Rolls ET (2005). “Neurodynamics of biased competition and cooperation for attention: a model with spiking neurons”. J. Neurophysi.94Google Scholar
  5. 5.
    Engel A. K., Fries P., Singer W.(2001) “Dynamic predictions: Oscillations and synchrony in top—down processing” Nature, Volume 2 pp.704–716Google Scholar
  6. 6.
    Fries P, Reynolds JH, Rorie AE, Desimone R (2001). “Modulation of oscillatory neuronal synchronization by selective visual attention”. Science 291:1560–1563.CrossRefGoogle Scholar
  7. 7.
    Grossberg, S. (1999). “The link between brain learning, attention, and consciousness”. Conscious. Cogn 8, 1–44CrossRefGoogle Scholar
  8. 8.
    Gross J., Schmitz F., Schnitzler I. et al (2004). “Modulation of long-range neural synchrony reflects temporal limitations of visual attention in humans.” PNAS August 31, 2004 vol. 101 no. 35 pp13050–13055CrossRefGoogle Scholar
  9. 9.
    Gruber T, Muller MM, Keil A, Elbert T (1999). “Selective visual-spatial attention alters induced gamma band responses in the human EEG”. Clin Neurophysiol 110:2074–2085.CrossRefGoogle Scholar
  10. 10.
    Hopf, J.-M., Luck, S.J., Girelli, M., Hagner, T., Mangun, G.R., Scheich, H., Heinze, H.-J., (2000). “Neural sources of focused attention in visual Search”. Cereb. Cortex 10, 1233–1241.CrossRefGoogle Scholar
  11. 11.
    Ioannides, A.A., Taylor, J.G., (2003). “Testing models of attention with MEG”. In: Proceedings IJCNN'03. pp. 287–297.Google Scholar
  12. 12.
    Mikula S., Niebur E., (2008). “Exact Solutions for Rate and Synchrony in Recurrent Networks of Coincidence Detectors.” Neural Computation.20Google Scholar
  13. 13.
    Moran J, Desimone R (1985). “Selective attention gates visual processing in the extrastri-ate cortex”. Science 229:782–784.CrossRefGoogle Scholar
  14. 14.
    Niebur E., Hsiao S.S., Johnson K.O., (2002) “Synchrony: a neuronal mechanism for at-tentional selection?” Cur.Op. in Neurobio., 12:190–194CrossRefGoogle Scholar
  15. 15.
    Niebur E, Koch C (1994). “A Model for the Neuronal Implementation of Selective Visual Attention Based on Temporal Correlation Among Neurons”. Journal of Computational Neuroseience 1, 141–158.CrossRefGoogle Scholar
  16. 16.
    Raymond JE, Shapiro KL, Arnell KM (1992). “Temporary suppression of visual processing in an RSVP task: an attentional blink?”. J.of exp. psyc. Human perc, and performance 18 (3): 849–60CrossRefGoogle Scholar
  17. 17.
    Saalmann Y.B., Pigarev I.N., et al. (2007). “Neural Mechanisms of Visual Attention: How Top-Down Feedback Highlights Relevant Locations” Science 316 1612CrossRefGoogle Scholar
  18. 18.
    Sergent C., Baillet S. & Dehaene S. (2005). “Timing of the brain events underlying access to consiousness during the attentional blink.” Nat Neurosci, Volume 8, Number 10, page 1391–1400.CrossRefGoogle Scholar
  19. 19.
    Steinmetz PN, Roy A, et al.(2000). “Attention modulates synchronized neuronal firing in primate somatosensory Cortex”. Nature 404:187–190.CrossRefGoogle Scholar
  20. 20.
    Taylor J.G., Rogers M. (2002). “A control model of the movement of attention”. Neural Networks 15:309–326CrossRefGoogle Scholar
  21. 21.
    Treisman, A., & Gelade, G. (1980). “A feature-integration theory of attention”. Cognitive Psychology, 12, 97–136.CrossRefGoogle Scholar
  22. 22.
    Vogel E.K., Luck S.J., Shapiro K.L., (1998). “Electrophysiological evidence for a post-perceptual locus of suppression during the attentional blink.” J. Exp. Psychol. Hum. Percept. Perform. 24 pp.1656–1674.CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2009

Authors and Affiliations

  • Kleanthis C. Neokleous
    • 2
  • Marios N. Avraamides
    • 1
  • Christos N. Schizas
    • 2
  1. 1.Department of PsychologyUniversity of CyprusNicosiaCyprus
  2. 2.Department of Computer ScienceUniversity of CyprusNicosiaCyprus

Personalised recommendations