Abstract
Shannon’s seminal approach to estimating information capacity is widely used to quantify information processing by biological systems. However, the Shannon information theory, which is based on power spectrum estimation, necessarily contains two sources of error: time delay bias error and random error. These errors are particularly important for systems with relatively large time delay values and for responses of limited duration, as is often the case in experimental work. The window function type and size chosen, as well as the values of inherent delays cause changes in both the delay bias and random errors, with possibly strong effect on the estimates of system properties. Here, we investigated the properties of these errors using white-noise simulations and analysis of experimental photoreceptor responses to naturalistic and white-noise light contrasts. Photoreceptors were used from several insect species, each characterized by different visual performance, behavior, and ecology. We show that the effect of random error on the spectral estimates of photoreceptor performance (gain, coherence, signal-to-noise ratio, Shannon information rate) is opposite to that of the time delay bias error: the former overestimates information rate, while the latter underestimates it. We propose a new algorithm for reducing the impact of time delay bias error and random error, based on discovering, and then using that size of window, at which the absolute values of these errors are equal and opposite, thus cancelling each other, allowing minimally biased measurement of neural coding.
Similar content being viewed by others
References
Anderson JC, Laughlin SB (2000) Photoreceptor performance and the co-ordination of achromatic and chromatic inputs in the fly visual system. Vis Res 40:13–31
Antoni J, Schoukens J (2007) A comprehensive study of the bias and variance of frequency-response-function measurements: optimal window selection and overlapping strategies. Automatica 43:1723–1736
Antoni J, Schoukens J (2009) Optimal settings for measuring frequency response functions with weighted overlapped segment averaging. IEEE Trans Instrum Meas 58:3276–3287
Bendat JS (1978) Statistical errors in measurement of coherence functions and input/output quantities. J Sound Vib 59:405–421
Bendat JS, Piersol AG (2010) Random data: analysis and measurement procedures. Wiley, New York
Bendat JS, Piersol AG (1980) Engineering applications of correlation and spectral analysis. Wiley, New York
Blazej J, Prochazka I, Kodet J (2012) Optical to electrical detection delay in avalanche photodiode based detector and its interpretation. In: Proceedings of science
Borst A, Egelhaaf M (1989) Principles of visual motion detection. Trends Neurosci 12:297–306
Brandt A (2011) Noise and vibration analysis: signal analysis and experimental procedures. Wiley, New York
Carter GC (1987) Coherence and time delay estimation. Proc IEEE 75:236–255
Cook EP, Maunsell JH (2002) Dynamics of neuronal responses in macaque MT and VIP during motion detection. Nat Neurosci 5:985–994
de Ruyter van Steveninck RR, Laughlin SB (1996) Light adaptation and reliability in blowfly photoreceptors. Int J Neural Syst 7:437–444
DiCaprio R (2004) Information transfer rate of nonspiking afferent neurons in the crab. J Neurophysiol 92:302–310
Douce JL, Widanage WD, Godfrey KR (2009) Errors in frequency response estimates using overlapping blocks with random inputs. In: Preprints of the 15th IFAC symposium on system identification, Saint-Malo, France, July 6–8, 2009
Faivre O, Juusola M (2008) Visual coding in locust photoreceptors. PLoS One 3:e2173
French AS (1980a) The linear dynamic properties of phototransduction in the fly compound eye. J Physiol 308:385–401
French AS (1980b) Phototransduction in the fly compound eye exhibits temporal resonances and a pure time delay. Nature 283:200–202
French AS (2009) The systems analysis approach to mechanosensory coding. Biol Cybern 100:417–426
Fuortes MG, Hodgkin AL (1964) Changes in time scale and sensitivity in the ommatidia of Limulus. J Physiol 172:239–263
Halvorsen WG, Bendat JS (1975) Noise source identification using coherent output power spectra. Sound Vib 9:15–24
Hardie RC (1991) Voltage-sensitive potassium channels in Drosophila photoreceptors. J Neurosci 11:3079–3095
Harris RA, O’Carroll DC, Laughlin SB (1999) Adaptation and the temporal delay filter of fly motion detectors. Vis Res 39:2603–2613
Juusola M, de Polavieja GG (2003) The rate of information transfer of naturalistic stimulation by graded potentials. J Gen Physiol 122:191–206
Juusola M, French AS (1997) The efficiency of sensory information coding by mechanoreceptor neurons. Neuron 18:959–968
Juusola M, Hardie RC (2001) Light adaptation in Drosophila photoreceptors: I. Response dynamics and signaling efficiency at 25 \(^{\circ }\)C. J Gen Physiol 117:3–25
Kouvalainen E, Weckström M, Juusola M (1994) A method for determining photoreceptor signal-to-noise ratio in the time and frequency domains with a pseudorandom stimulus. Vis Neurosci 11:1221–1225
Krause Y, Krause S, Huang J, Liu CH, Hardie RC, Weckström M (2008) Light-dependent modulation of Shab channels via phosphoinositide depletion in Drosophila photoreceptors. Neuron 59:596–607
Liu B (2008) Uniform stability of discrete delay systems and synchronization of discrete delay dynamical networks via Razumikhin technique. IEEE Trans Circuits Syst I Regul Papers 55:2795–2805
Niven JE, Vähäsöyrinki M, Juusola M, French AS (2004) Interactions between light-induced currents, voltage-gated currents, and input signal properties in Drosophila photoreceptors. J Neurophysiol 91:2696–2706
Nuttall A, Carter C (1982) Spectral estimation using combined time and lag weighting. Proc IEEE 70:1115–1125
O’Carroll DC, Bidwell NJ, Laughlin SB, Warrant EJ (1996) Insect motion detectors matched to visual ecology. Nature 382:63–66
Randall RB, Tech BA (1987) Frequency analysis. Brüel & Kjær, Nærum, Denmark
Schmidt H (1985) Resolution bias errors in spectral density, frequency response and coherence function measurements, IV: time delay bias errors. J Sound Vib 101:405–412
Seybert AF, Hamilton JF (1978) The delay bias errors in estimating frequency response and coherence functions. J Sound Vib 60:1–9
Shannon CE (1948) A mathematical theory of communication. Bell Syst Tech J 27:379–423
Song Z, Postma M, Billings SA, Coca D, Hardie RC, Juusola M (2012) Stochastic, adaptive sampling of information by microvilli in fly photoreceptors. Curr Biol 22:1371–1380
Thomson DJ (1982) Spectrum estimation and harmonic analysis. Proc IEEE 70(9):1055–1096
Takalo J, Ignatova I, Weckström M, Vähäsöyrinki M (2011) A novel estimator for the rate of information transfer by continuous signals. PLoS One 6:e18792
Trethewey MW, Evensen HA (1984) Time-delay bias errors in estimating frequency response and coherence functions from windowed samples of continuous and transient signals. J Sound Vib 97:531–540
van Hateren JH (1997) Processing of natural time series of intensities by the visual system of the blowfly. Vis Res 37:3407–3416
van Hateren JH, van der Schaaf A (1998) Independent component filters of natural images compared with simple cells in primary visual cortex. Proc Biol Sci 265:359–366
Welch PD (1967) The use of fast fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Trans Audio Electroacoust 15:70–73
Widanage W, Douce J, Godfrey K (2009) Effects of overlapping and windowing on frequency response function estimates of systems with random inputs. IEEE Trans Instrum Meas 58:214–220
Acknowledgments
We thank Jouni Takalo for help with programming. The work was supported by grants from The Academy of Finland to M.W., and R.F, and by Sigrid Juselius Foundation to M.W. and A.S.F.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ignatova, I., French, A.S., Immonen, EV. et al. Equilibrating errors: reliable estimation of information transmission rates in biological systems with spectral analysis-based methods. Biol Cybern 108, 305–320 (2014). https://doi.org/10.1007/s00422-014-0598-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00422-014-0598-2