Skip to main content

A neural network model for selective attention in visual pattern recognition


A neural network model of the mechanism of selective attention in visual pattern recognition is proposed and simulated on a digital computer.

When a complex figure consisting of two patterns or more is presented to the model, it is segmented into individual patterns, and each pattern is recognized separately. Even if one of the patterns to which the model is paying selective attention is affected by noise or defects, the model can recall the complete pattern from which the noise has been eliminated and the defects corrected. It is not necessary for perfect recall that the stimulus pattern should be identical in shape to the training pattern. Even though the pattern is distorted in shape or changed in size, it can be correctly recognized and the missing portions restored.

The model consists of a hierarchical neural network which has efferent as well as afferent connections between cells. The afferent and the efferent signals interact with each other in the network: the efferent signals, that is, the signals for selective attention, have a facilitating effect on the afferent ones, and, at the same time, the afferent signals gate efferent signal flow. When some feature in the stimulus is not extracted in the afferent paths, the threshold for detection of that feature is automatically lowered by decreasing the efficiency of inhibition, and the model tries to extract even vague traces of the undetected feature.

This is a preview of subscription content, access via your institution.


  • Castelluci ER, Kandel ER (1976) Presynaptic facilitation as a mechanism for behavioral sensitization in Aplysia. Science 194:1176–1178

    Google Scholar 

  • Fukushima K (1980) Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol Cybern 36:193–202

    Google Scholar 

  • Fukushima K (1981) Cognitron: a self-organizing multilayered neural network model. NHK Technical Monograph No. 30. NHK Tech Res Labs, Tokyo

    Google Scholar 

  • Fukushima K (1984) A hierarchical neural network model for associative memory. Biol Cybern 50:105–113

    Google Scholar 

  • Fukushima K, Miyake S (1982) Neocognitron: a new algorithm for pattern recognition tolerant of deformations and shifts in position. Pattern Recognition 15:455–469

    Google Scholar 

  • Gabor D (1969) Associative holographic memories. IBM J Res Dev 13:156–159

    Google Scholar 

  • Kohonen T (1972) Correlation matrix memories. IEEE Trans Comput C-21:353–359

    Google Scholar 

  • Moran J, Desimone R (1985) Selective attention gates visual processing in the extrastriate cortex. Science 229:782–784

    Google Scholar 

  • Moray N (1969) Attention: selective process in vision and hearing. Hutchinson Educational, London

    Google Scholar 

  • Nakano K (1972) Associatron—a model of associative memory. IEEE Trans SMC-2:380–388

    Google Scholar 

  • Norman DA (1976) Memory and attention: an introduction to human information processing, 2nd edn. Wiley, New York London Sydney Toronto

    Google Scholar 

Download references

Author information

Authors and Affiliations


Rights and permissions

Reprints and Permissions

About this article

Cite this article

Fukushima, K. A neural network model for selective attention in visual pattern recognition. Biol. Cybern. 55, 5–15 (1986).

Download citation

  • Received:

  • Issue Date:

  • DOI:


  • Neural Network
  • Neural Network Model
  • Selective Attention
  • Complex Figure
  • Signal Flow