How Is Scene Recognition in a Convolutional Network Related to that in the Human Visual System?

Conference paper

DOI: 10.1007/978-3-319-44778-0_33

Part of the Lecture Notes in Computer Science book series (LNCS, volume 9886)
Cite this paper as:
Sharma S., Tripp B. (2016) How Is Scene Recognition in a Convolutional Network Related to that in the Human Visual System?. In: Villa A., Masulli P., Pons Rivero A. (eds) Artificial Neural Networks and Machine Learning – ICANN 2016. ICANN 2016. Lecture Notes in Computer Science, vol 9886. Springer, Cham

Abstract

This study is an analysis of scene recognition in a pre-trained convolutional network, to evaluate the information the network uses to distinguish scene categories. We are particularly interested in how the network is related to various areas in the human brain that are involved in different modes of scene recognition. Results of several experiments suggest that the convolutional network relies heavily on objects and fine features, similar to the lateral occipital complex (LOC) in the brain, but less on large-scale scene layout. This suggests that future scene-processing convolutional networks might be made more brain-like by adding parallel components that are more sensitive to arrangement of simple forms.

Keywords

Convolutional neural networks (CNNs) Scene recognition Human visual system 

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Centre for Theoretical NeuroscienceUniversity of WaterlooWaterlooCanada

Personalised recommendations