Chapter

Brain, Vision, and Artificial Intelligence

Volume 3704 of the series Lecture Notes in Computer Science pp 177-186

An LGN Inspired Detect/Transmit Framework for High Fidelity Relay of Visual Information with Limited Bandwidth

  • Nicholas A. LesicaAffiliated withDivision of Engineering and Applied Sciences, Harvard University
  • , Garrett B. StanleyAffiliated withDivision of Engineering and Applied Sciences, Harvard University

* Final gross prices may vary according to local VAT.

Get Access

Abstract

The mammalian visual system has developed complex strategies to optimize the allocation of its limited attentional resources for the relay of behaviorally relevant visual information. Here, we describe a framework for the relay of visual information that is based on the tonic and burst properties of the LGN. The framework consists of a multi-sensor transmitter and receiver that are connected by a channel with limited total bandwidth. Each sensor in the transmitter has two states, tonic and burst, and the current state depends on the salience of the recent visual input. In burst mode, a sensor transmits only one bit of information corresponding to the absence or presence of a salient stimulus, while in tonic mode, a sensor attempts to faithfully relay the input with as many bits as are available. By comparing video reconstructed from the signals of detect/transmit sensors with that reconstructed from the signals of transmit only sensors, we demonstrate that the detect/transmit framework can significantly improve relay by dynamically allocating bandwidth to the most salient areas of the visual field.