A recurrent neural model for proto-object based contour integration and figure-ground segregation
Visual processing of objects makes use of both feedforward and feedback streams of information. However, the nature of feedback signals is largely unknown, as is the identity of the neuronal populations in lower visual areas that receive them. Here, we develop a recurrent neural model to address these questions in the context of contour integration and figure-ground segregation. A key feature of our model is the use of grouping neurons whose activity represents tentative objects (“proto-objects”) based on the integration of local feature information. Grouping neurons receive input from an organized set of local feature neurons, and project modulatory feedback to those same neurons. Additionally, inhibition at both the local feature level and the object representation level biases the interpretation of the visual scene in agreement with principles from Gestalt psychology. Our model explains several sets of neurophysiological results (Zhou et al. Journal of Neuroscience, 20(17), 6594–6611 2000; Qiu et al. Nature Neuroscience, 10(11), 1492–1499 2007; Chen et al. Neuron, 82(3), 682–694 2014), and makes testable predictions about the influence of neuronal feedback and attentional selection on neural responses across different visual areas. Our model also provides a framework for understanding how object-based attention is able to select both objects and the features associated with them.
KeywordsRecurrent processing Shape perception Feedback Grouping Perceptual organization Contour processing
We would like to thank Justin Killebrew for his help in using the computational cluster in order to run the simulations. We would also like to thank Rüdiger von der Heydt for sharing his deep insights on vision with us.
Compliance with Ethical Standards
Conflict of interests
The authors declare that they have no conflict of interest.
- Ardila, D, Mihalas, S, von der Heydt, R, & Niebur, E (2012). Medial axis generation in a model of perceptual organization. In IEEE CISS-2012 46th Annual conference on information sciences and systems (pp. 1–4). NJ: IEEE, Princeton University.Google Scholar
- Green, DM, & Swets, JA. (1966). Signal detection theory and psychophysics. New York: Wiley.Google Scholar
- Hu, B, von der Heydt, R, & Niebur, E (2015). A neural model for perceptual organization of 3D surfaces. In IEEE CISS-2015 49th Annual Conference on Information Sciences and Systems. https://doi.org/10.1109/CISS.2015.7086906 (pp. 1–6). Baltimore: IEEE Information Theory Society.
- Kikuchi, M, & Akashi, Y (2001). A model of border-ownership coding in early vision. In Dorffner, G, Bischof, H, & Hornik, K (Eds.) ICANN (Vol. 2001, pp. 1069–1074).Google Scholar
- Koffka, K. (1935). Principles of Gestalt psychology. New York: Harcourt-Brace.Google Scholar
- Pao, HK, Geiger, D, & Rubin, N (1999). Measuring convexity for figure/ground separation. In 7th international conference on computer vision. Kerkyra.Google Scholar
- Stemmler, M, Usher, M, & Niebur, E (1995). Lateral cortical connections may contribute to both contour completion and redundancy reduction in visual processing. Society for Neuroscience Abstracts, 21(1), 510.Google Scholar
- Tsotsos, JK (2011). A computational perspective on visual attention. MIT Press.Google Scholar