Skip to main content
Log in

Equilibrating errors: reliable estimation of information transmission rates in biological systems with spectral analysis-based methods

  • Original Paper
  • Published:
Biological Cybernetics Aims and scope Submit manuscript

Abstract

Shannon’s seminal approach to estimating information capacity is widely used to quantify information processing by biological systems. However, the Shannon information theory, which is based on power spectrum estimation, necessarily contains two sources of error: time delay bias error and random error. These errors are particularly important for systems with relatively large time delay values and for responses of limited duration, as is often the case in experimental work. The window function type and size chosen, as well as the values of inherent delays cause changes in both the delay bias and random errors, with possibly strong effect on the estimates of system properties. Here, we investigated the properties of these errors using white-noise simulations and analysis of experimental photoreceptor responses to naturalistic and white-noise light contrasts. Photoreceptors were used from several insect species, each characterized by different visual performance, behavior, and ecology. We show that the effect of random error on the spectral estimates of photoreceptor performance (gain, coherence, signal-to-noise ratio, Shannon information rate) is opposite to that of the time delay bias error: the former overestimates information rate, while the latter underestimates it. We propose a new algorithm for reducing the impact of time delay bias error and random error, based on discovering, and then using that size of window, at which the absolute values of these errors are equal and opposite, thus cancelling each other, allowing minimally biased measurement of neural coding.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  • Anderson JC, Laughlin SB (2000) Photoreceptor performance and the co-ordination of achromatic and chromatic inputs in the fly visual system. Vis Res 40:13–31

    Article  CAS  PubMed  Google Scholar 

  • Antoni J, Schoukens J (2007) A comprehensive study of the bias and variance of frequency-response-function measurements: optimal window selection and overlapping strategies. Automatica 43:1723–1736

    Article  Google Scholar 

  • Antoni J, Schoukens J (2009) Optimal settings for measuring frequency response functions with weighted overlapped segment averaging. IEEE Trans Instrum Meas 58:3276–3287

    Article  Google Scholar 

  • Bendat JS (1978) Statistical errors in measurement of coherence functions and input/output quantities. J Sound Vib 59:405–421

    Article  Google Scholar 

  • Bendat JS, Piersol AG (2010) Random data: analysis and measurement procedures. Wiley, New York

    Book  Google Scholar 

  • Bendat JS, Piersol AG (1980) Engineering applications of correlation and spectral analysis. Wiley, New York

    Google Scholar 

  • Blazej J, Prochazka I, Kodet J (2012) Optical to electrical detection delay in avalanche photodiode based detector and its interpretation. In: Proceedings of science

  • Borst A, Egelhaaf M (1989) Principles of visual motion detection. Trends Neurosci 12:297–306

    Article  CAS  PubMed  Google Scholar 

  • Brandt A (2011) Noise and vibration analysis: signal analysis and experimental procedures. Wiley, New York

    Book  Google Scholar 

  • Carter GC (1987) Coherence and time delay estimation. Proc IEEE 75:236–255

    Article  Google Scholar 

  • Cook EP, Maunsell JH (2002) Dynamics of neuronal responses in macaque MT and VIP during motion detection. Nat Neurosci 5:985–994

    Article  CAS  PubMed  Google Scholar 

  • de Ruyter van Steveninck RR, Laughlin SB (1996) Light adaptation and reliability in blowfly photoreceptors. Int J Neural Syst 7:437–444

  • DiCaprio R (2004) Information transfer rate of nonspiking afferent neurons in the crab. J Neurophysiol 92:302–310

    Article  PubMed  Google Scholar 

  • Douce JL, Widanage WD, Godfrey KR (2009) Errors in frequency response estimates using overlapping blocks with random inputs. In: Preprints of the 15th IFAC symposium on system identification, Saint-Malo, France, July 6–8, 2009

  • Faivre O, Juusola M (2008) Visual coding in locust photoreceptors. PLoS One 3:e2173

    Article  PubMed Central  PubMed  Google Scholar 

  • French AS (1980a) The linear dynamic properties of phototransduction in the fly compound eye. J Physiol 308:385–401

    CAS  PubMed Central  PubMed  Google Scholar 

  • French AS (1980b) Phototransduction in the fly compound eye exhibits temporal resonances and a pure time delay. Nature 283:200–202

    Article  CAS  PubMed  Google Scholar 

  • French AS (2009) The systems analysis approach to mechanosensory coding. Biol Cybern 100:417–426

    Article  PubMed  Google Scholar 

  • Fuortes MG, Hodgkin AL (1964) Changes in time scale and sensitivity in the ommatidia of Limulus. J Physiol 172:239–263

    CAS  PubMed Central  PubMed  Google Scholar 

  • Halvorsen WG, Bendat JS (1975) Noise source identification using coherent output power spectra. Sound Vib 9:15–24

    Google Scholar 

  • Hardie RC (1991) Voltage-sensitive potassium channels in Drosophila photoreceptors. J Neurosci 11:3079–3095

    CAS  PubMed  Google Scholar 

  • Harris RA, O’Carroll DC, Laughlin SB (1999) Adaptation and the temporal delay filter of fly motion detectors. Vis Res 39:2603–2613

    Article  CAS  PubMed  Google Scholar 

  • Juusola M, de Polavieja GG (2003) The rate of information transfer of naturalistic stimulation by graded potentials. J Gen Physiol 122:191–206

    Article  PubMed Central  PubMed  Google Scholar 

  • Juusola M, French AS (1997) The efficiency of sensory information coding by mechanoreceptor neurons. Neuron 18:959–968

    Article  CAS  PubMed  Google Scholar 

  • Juusola M, Hardie RC (2001) Light adaptation in Drosophila photoreceptors: I. Response dynamics and signaling efficiency at 25 \(^{\circ }\)C. J Gen Physiol 117:3–25

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Kouvalainen E, Weckström M, Juusola M (1994) A method for determining photoreceptor signal-to-noise ratio in the time and frequency domains with a pseudorandom stimulus. Vis Neurosci 11:1221–1225

    Article  CAS  PubMed  Google Scholar 

  • Krause Y, Krause S, Huang J, Liu CH, Hardie RC, Weckström M (2008) Light-dependent modulation of Shab channels via phosphoinositide depletion in Drosophila photoreceptors. Neuron 59:596–607

    Article  CAS  PubMed  Google Scholar 

  • Liu B (2008) Uniform stability of discrete delay systems and synchronization of discrete delay dynamical networks via Razumikhin technique. IEEE Trans Circuits Syst I Regul Papers 55:2795–2805

    Article  Google Scholar 

  • Niven JE, Vähäsöyrinki M, Juusola M, French AS (2004) Interactions between light-induced currents, voltage-gated currents, and input signal properties in Drosophila photoreceptors. J Neurophysiol 91:2696–2706

    Article  PubMed  Google Scholar 

  • Nuttall A, Carter C (1982) Spectral estimation using combined time and lag weighting. Proc IEEE 70:1115–1125

    Article  Google Scholar 

  • O’Carroll DC, Bidwell NJ, Laughlin SB, Warrant EJ (1996) Insect motion detectors matched to visual ecology. Nature 382:63–66

    Article  PubMed  Google Scholar 

  • Randall RB, Tech BA (1987) Frequency analysis. Brüel & Kjær, Nærum, Denmark

  • Schmidt H (1985) Resolution bias errors in spectral density, frequency response and coherence function measurements, IV: time delay bias errors. J Sound Vib 101:405–412

    Article  Google Scholar 

  • Seybert AF, Hamilton JF (1978) The delay bias errors in estimating frequency response and coherence functions. J Sound Vib 60:1–9

    Google Scholar 

  • Shannon CE (1948) A mathematical theory of communication. Bell Syst Tech J 27:379–423

    Article  Google Scholar 

  • Song Z, Postma M, Billings SA, Coca D, Hardie RC, Juusola M (2012) Stochastic, adaptive sampling of information by microvilli in fly photoreceptors. Curr Biol 22:1371–1380

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Thomson DJ (1982) Spectrum estimation and harmonic analysis. Proc IEEE 70(9):1055–1096

    Article  Google Scholar 

  • Takalo J, Ignatova I, Weckström M, Vähäsöyrinki M (2011) A novel estimator for the rate of information transfer by continuous signals. PLoS One 6:e18792

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Trethewey MW, Evensen HA (1984) Time-delay bias errors in estimating frequency response and coherence functions from windowed samples of continuous and transient signals. J Sound Vib 97:531–540

    Google Scholar 

  • van Hateren JH (1997) Processing of natural time series of intensities by the visual system of the blowfly. Vis Res 37:3407–3416

    Article  PubMed  Google Scholar 

  • van Hateren JH, van der Schaaf A (1998) Independent component filters of natural images compared with simple cells in primary visual cortex. Proc Biol Sci 265:359–366

    Article  PubMed Central  PubMed  Google Scholar 

  • Welch PD (1967) The use of fast fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Trans Audio Electroacoust 15:70–73

    Article  Google Scholar 

  • Widanage W, Douce J, Godfrey K (2009) Effects of overlapping and windowing on frequency response function estimates of systems with random inputs. IEEE Trans Instrum Meas 58:214–220

    Article  Google Scholar 

Download references

Acknowledgments

We thank Jouni Takalo for help with programming. The work was supported by grants from The Academy of Finland to M.W., and R.F, and by Sigrid Juselius Foundation to M.W. and A.S.F.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matti Weckström.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ignatova, I., French, A.S., Immonen, EV. et al. Equilibrating errors: reliable estimation of information transmission rates in biological systems with spectral analysis-based methods. Biol Cybern 108, 305–320 (2014). https://doi.org/10.1007/s00422-014-0598-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00422-014-0598-2

Keywords

Navigation