Advertisement

Journal of Comparative Physiology A

, Volume 191, Issue 12, pp 1143–1155 | Cite as

Responses of blowfly motion-sensitive neurons to reconstructed optic flow along outdoor flight paths

  • N. BoeddekerEmail author
  • J. P. Lindemann
  • M. Egelhaaf
  • J. Zeil
Original Paper

Abstract

The retinal image flow a blowfly experiences in its daily life on the wing is determined by both the structure of the environment and the animal’s own movements. To understand the design of visual processing mechanisms, there is thus a need to analyse the performance of neurons under natural operating conditions. To this end, we recorded flight paths of flies outdoors and reconstructed what they had seen, by moving a panoramic camera along exactly the same paths. The reconstructed image sequences were later replayed on a fast, panoramic flight simulator to identified, motion sensitive neurons of the so-called horizontal system (HS) in the lobula plate of the blowfly, which are assumed to extract self-motion parameters from optic flow. We show that under real life conditions HS-cells not only encode information about self-rotation, but are also sensitive to translational optic flow and, thus, indirectly signal information about the depth structure of the environment. These properties do not require an elaboration of the known model of these neurons, because the natural optic flow sequences generate—at least qualitatively—the same depth-related response properties when used as input to a computational HS-cell model and to real neurons.

Keywords

Optic flow Natural stimuli Motion detection Active vision Behaviour 

Notes

Acknowledgements

The research project was initially supported by a travel grant of the German Science Foundation (DFG) to M.E. and a Visiting Fellowship by the Centre for Visual Sciences (CVS), Australian National University, to N.B. One of the high-speed cameras used in the behavioural experiments was financed by the DFG. The work was subsequently continued with the help of funds from an Emmy-Noether Grant to N.B. (DFG BO 2478/1-1). J.Z. acknowledges initial support from Defence Science and Technology Organization (Eglin Airforce Base) and a Human Frontier Science Project grant (HFSP 84/97). We thank Katharina Siebke for her help as gantry operator and Roland Kern for sharing his expertise in electrophysiological recording techniques and in operating FliMax. We are grateful to Jan Hemmi, Roland Kern, and Mandyam Srinivasan for their constructive comments on an earlier version of the manuscript.

References

  1. Betsch BY, Einhauser W, Kording KP, König P (2004) The world from a cat’s perspective—statistics of natural videos. Biol Cybern 90:41–50CrossRefPubMedGoogle Scholar
  2. Blaj G, van Hateren JH (2004) Saccadic head and thorax movements in freely walking blowflies. J Comp Physiol A 190:861–868Google Scholar
  3. Boeddeker N, Kern R, Egelhaaf M (2003) Chasing a dummy target: smooth pursuit and velocity control in male blowflies. Proc R Soc Lond B 270:393–399CrossRefGoogle Scholar
  4. Borst A, Egelhaaf M (1989) Principles of visual motion detection. Trends Neurosci 12:297–306CrossRefPubMedGoogle Scholar
  5. Borst A, Haag J (2002) Neural networks in the cockpit of the fly. J Comp Physiol A 188:419–437CrossRefGoogle Scholar
  6. Borst A, Egelhaaf M, Haag J (1995) Mechanisms of dendritic integration underlying gain control in fly motion-sensitive interneurons. J Comput Neurosci 2:5–18CrossRefPubMedGoogle Scholar
  7. Borst A, Reisenman C, Haag J (2003) Adaptation of response transients in fly motion vision. II: Model studies. Vision Res 43:1309–1322CrossRefPubMedGoogle Scholar
  8. Burton BG, Laughlin SB (2003) Neural images of pursuit targets in the photoreceptor arrays of male and female houseflies Musca domestica. J Exp Biol 206:3963–3977PubMedCrossRefGoogle Scholar
  9. Chahl JS, Srinivasan MV (1997) Reflective surface for panoramic imaging. J Appl Opt 36:8275–8285Google Scholar
  10. Collett TS (1980) Some operating rules for the optomotor system of a hoverfly during voluntary flight. J Comp Physiol A 138:271–282CrossRefGoogle Scholar
  11. Collett TS, Land MF (1975) Visual control of flight behaviour in the hoverfly Syritta pipiens L. J Comp Physiol 99:1–66CrossRefGoogle Scholar
  12. Dahmen HJ, Wüst RM, Zeil J (1997) Extracting egomotion parameters from optic flow: principal limits for animals and machines. In: Srinivasan MV, Venkatesh S (eds) From living eyes to seeing machines. Oxford University Press, New York, pp 174–198Google Scholar
  13. Dahmen HJ, Franz MO, Krapp HG (2001) Extracting egomotion from optic flow: limits of accuracy and neural matched filters. In: Zanker JM, Zeil J (eds) Motion vision: computational, neural, and ecological constraints. Springer, Berlin Heidelberg New York, pp 143–168Google Scholar
  14. Dror RO, O’Carroll DC, Laughlin SB (2001) Accuracy of velocity estimation by Reichardt correlators. J Opt Soc Am A 18:241–252CrossRefGoogle Scholar
  15. Eckert MP, Zeil J (2001) Towards an ecology of motion vision. In: Zanker JM, Zeil J (eds) Motion vision: computational, neural, and ecological constraints. Springer, Berlin Heidelberg New York, pp 333–369Google Scholar
  16. Egelhaaf M, Borst A (1989a) Transient and steady-state response properties of movement detectors. J Opt Soc Am A 6:116–127CrossRefGoogle Scholar
  17. Egelhaaf M, Borst A, Reichardt W (1989b) The nonlinear mechanism of direction selectivity in the fly motion detection system. Naturwissenschaften 76:32–35CrossRefGoogle Scholar
  18. Egelhaaf M, Reichardt W (1987) Dynamic response properties of movement detectors: theoretical analysis and electrophysiological investigation in the visual system of the fly. Biol Cybern 56:69–87CrossRefGoogle Scholar
  19. Egelhaaf M, Grewe J, Kern R, Warzecha AK (2001) Outdoor performance of a motion-sensitive neuron in the blowfly. Vision Res 41:3627–3637CrossRefPubMedGoogle Scholar
  20. Egelhaaf M, Kern R, Krapp HG, Kretzberg J, Kurtz R, Warzecha AK (2002) Neural encoding of behaviourally relevant visual-motion information in the fly. Trends Neurosci 25:96–102CrossRefPubMedGoogle Scholar
  21. Franceschini N (1975) Sampling of the visual environment by the compound eye of the fly: fundamentals and applications. In: Snyder AW, Menzel R (eds) Photoreceptor optics. Springer, Berlin Heidelberg New York, pp 98–125Google Scholar
  22. Gibson JJ (1950) The perception of the visual world. Houghton Mifflin, BostonGoogle Scholar
  23. Gronenberg W, Strausfeld NJ (1990) Descending neurons supplying the neck and flight motor of Diptera: physiological and anatomical characteristics. J Comp Neurol 302:973–991CrossRefPubMedGoogle Scholar
  24. Haag J, Borst A (1997) Encoding of visual motion information and reliability in spiking and graded potential neurons. J Neurosci 17:4809–4819PubMedGoogle Scholar
  25. Haag J, Borst A (2001) Recurrent network interactions underlying flow-field selectivity of visual interneurons. J Neurosci 21:5685–5692PubMedGoogle Scholar
  26. van Hateren JH (1997) Processing of natural time series of intensities by the visual system of the blowfly. Vision Res. 37:3407–3416CrossRefPubMedGoogle Scholar
  27. van Hateren JH, Schilstra C (1999) Blowfly flight and optic flow. II. Head movements during flight. J Exp Biol 202:1491–1500PubMedGoogle Scholar
  28. van Hateren JH, Kern R, Schwerdtfeger G, Egelhaaf M (2005) Function and coding in the blowfly H1 neuron during naturalistic optic flow. J Neurosci 25:4343–4352CrossRefPubMedGoogle Scholar
  29. Hausen K (1982a) Motion sensitive interneurons in the optomotor system of the fly. I. The Horizontal cells: structure and signals. Biol Cybern 45:143–156CrossRefGoogle Scholar
  30. Hausen K (1982b) Motion sensitive interneurons in the optomotor system of the fly. II. The horizontal cells: receptive field organization and response characteristics. Biol Cybern 46:67–79CrossRefGoogle Scholar
  31. Hausen K, Egelhaaf M (1989) Neural mechanisms of visual course control in insects. In: Stavenga D, Hardie R (eds) Facets of vision. Springer, Berlin Heidelberg New York, pp 391–424Google Scholar
  32. Heisenberg M, Wolf R (1979) On the fine structure of yaw torque in visual flight orientation of Drosophila melanogaster. J Comp Physiol A 130:113–130CrossRefGoogle Scholar
  33. Heisenberg M, Wolf R (1993) The sensory-motor link in motion-dependent flight control of flies. In: Miles FA, Wallman J (eds) Visual motion and its role in the stabilization of gaze. Elsevier, Amsteram, pp 265–283Google Scholar
  34. Hengstenberg R (1991) Gaze control in the blowfly Calliphora: a multisensory, two-stage integration process. Sem Neurosci 3:19–29CrossRefGoogle Scholar
  35. Horstmann W, Egelhaaf M, Warzecha AK (2000) Synaptic interactions increase optic flow specificity. Eur J Neurosci 12:2157–2165CrossRefPubMedGoogle Scholar
  36. James AC (1992) Nonlinear operator network models of processing in the fly lamina. In: Nabet B (eds) Nonlinear vision. CRC Press, Boca Raton, pp 39–74Google Scholar
  37. Kayser C, Kording KP, König P (2004) Processing of complex stimuli and natural scenes in the visual cortex. Curr Opin Neurobiol 14:468–473CrossRefPubMedGoogle Scholar
  38. Kern R, Lutterklas M, Egelhaaf M (2000) Neuronal representation of optic flow experienced by unilaterally blinded flies on their mean walking trajectories. J Comp Physiol A 186:467–479CrossRefPubMedGoogle Scholar
  39. Kern R, Lutterklas M, Petereit C, Lindemann JP, Egelhaaf M (2001a) Neuronal processing of behaviourally generated optic flow: experiments and model simulations. Network 12:351–369Google Scholar
  40. Kern R, Petereit C, Egelhaaf M (2001b) Neural processing of naturalistic optic flow. J Neurosci 21:1–5Google Scholar
  41. Kern R, Dittmar L, Schwerdtfeger G, Boeddeker N, Egelhaaf M (2005a) Blowflies exhibit saccadic flight style under various free flight conditions. In: Zimmermann H, Krieglstein K (eds) Proceedings of the 6th meeting of the German Neuroscience Society. Neuroforum 2005, 1 Suppl.:22BGoogle Scholar
  42. Kern R, van Hateren JH, Michaelis C, Lindemann JP, Egelhaaf M (2005b) Function of a fly motion-sensitive neuron matches eye movements during free flight. PLoS Biol 3:1130–1138CrossRefGoogle Scholar
  43. Kimmerle B, Egelhaaf M (2000a) Detection of object motion by a fly neuron during simulated flight. J Comp Physiol A 186:21–31CrossRefGoogle Scholar
  44. Kimmerle B, Egelhaaf M (2000b) Performance of fly visual interneurons during object fixation. J Neurosci 20:6256–6266Google Scholar
  45. Kimmerle B, Srinivasan MV, Egelhaaf M (1996) Object detection by relative motion in freely flying flies. Naturwissenschaften 83:380–381CrossRefGoogle Scholar
  46. Koenderink JJ (1986) Optic flow. Vision Res 26:161–180CrossRefPubMedGoogle Scholar
  47. Koenderink JJ, van Doorn A (1987) Facts on optic flow. Biol Cybern 56:247–254CrossRefPubMedGoogle Scholar
  48. Kral K, Poteser M (1997) Motion parallax as a source of distance information in locusts and mantids. J Insect Behav 10:145–163CrossRefGoogle Scholar
  49. Krapp HG (2000) Neuronal matched filters for optic flow processing in flying insects. Int Rev Neurobiol 44:93–120PubMedGoogle Scholar
  50. Krapp HG, Hengstenberg R, Egelhaaf M (2001) Binocular contributions to optic flow processing in the fly visual system. J Neurophysiol 85:724–734PubMedGoogle Scholar
  51. Land MF (1973) Head movements of flies during visually guided flight. Nature 243:299–300CrossRefGoogle Scholar
  52. Land MF, Collett TS (1997) A survey of active vision in invertebrates. In: Srinivasan MV, Venkatesh S (eds) From living eyes to seeing machines. Oxford University Press, Oxford, pp 16–36Google Scholar
  53. Lappe M (2000) Neuronal processing of optic flow. Academic Press, San DiegoGoogle Scholar
  54. Laughlin SB (1994) Matching coding, circuits, cells, and molecules to signals: General principles of retinal design in the fly’s eye. Progr Ret Eye Res 13: 165–196CrossRefGoogle Scholar
  55. Lehrer M, Srinivasan MV (1994) Active vision in honeybees: task-oriented suppression of an innate behaviour. Vis Res 4:511–516CrossRefGoogle Scholar
  56. Lehrer M, Srinivasan MV, Zhang SW, Horridge GA (1988) Motion cues provide the bee’s visual world with a third dimension. Nature 332:356–357CrossRefGoogle Scholar
  57. Lewen GD, Bialek W, de Ruyter van Steveninck RR (2001) Neural coding of naturalistic motion stimuli. Network 12:317–329PubMedGoogle Scholar
  58. Lindemann JP, Boeddeker N, Egelhaaf M (2003a) 3D-Reconstruction of insect flight trajectories from 2D image sequences. In: Elsner N, Zimmerman H (eds) Proceedings of the 5th Meeting of the German Neuroscience society. Thieme, Stuttgart, p 1053Google Scholar
  59. Lindemann JP, Kern R, Michaelis C, Meyer P, van Hateren JH, Egelhaaf M (2003b) FliMax, a novel stimulus device for panoramic and highspeed presentation of behaviourally generated optic flow. Vision Res 43:779CrossRefGoogle Scholar
  60. Lindemann JP, Kern R, van Hateren JH, Ritter M, Egelhaaf M (2005) On the computations analysing natural optic flow: quantitative model analysis of the blowfly motion vision pathway. J Neurosci 2005 25(27):6435–6448CrossRefGoogle Scholar
  61. Olshausen BA, Field DJ (1996) Natural image statistics and efficient coding. Netw Comput Neural Syst 7:333–339CrossRefGoogle Scholar
  62. Passaglia C, Dodge F, Herzog E, Jackson S, Barlow R (1997) Deciphering a neural code for vision. Proc Natl Acad Sci USA 94:12649–12654CrossRefPubMedGoogle Scholar
  63. Prazdny K (1980) Egomotion and relative depth map from optical flow. Biol Cybern 36:87–102CrossRefPubMedGoogle Scholar
  64. Reichardt W (1987) Evaluation of optical motion information by movement detectors. J Comp Physiol A 161:533–547CrossRefPubMedGoogle Scholar
  65. Reinagel P (2001) How do visual neurons respond in the real world? Curr Opin Neurobiol 11:437–442CrossRefPubMedGoogle Scholar
  66. Schilstra C, van Hateren JH (1998) Stabilizing gaze in flying blowflies. Nature 395:654CrossRefPubMedGoogle Scholar
  67. Schilstra C, van Hateren JH (1999) Blowfly flight and optic flow. I. Thorax kinematics and flight dynamics. J Exp Biol 202:1481–1490PubMedGoogle Scholar
  68. Simoncelli EP (2003) Vision and the statistics of the visual environment. Curr Opin Neurobiol 13:144–149CrossRefPubMedGoogle Scholar
  69. Simoncelli EP, Olshausen BA (2001) Natural image statistics and neural representation. Annu Rev Neurosci 24:1193–1215CrossRefPubMedGoogle Scholar
  70. Srinivasan M (1993) How insects infer range from visual motion. In: Miles FA, Wallman J (eds) Visual motion and its role in the stabilization of gaze. Elsevier, Amsterdam, pp 139–156Google Scholar
  71. Srinivasan MV, Lehrer M, Zhang SW, Horridge GA (1989) How honeybees measure their distance from objects of unknown size. J Comp Physiol A 165:605–613CrossRefGoogle Scholar
  72. Strausfeld NJ, Gronenberg W (1990) Descending neurons supplying the neck and flight motor of Diptera: organization and neuroanatomical relationships with visual pathways. J Comp Neurol 302:954–972CrossRefPubMedGoogle Scholar
  73. Tammero LF, Dickinson MH (2002) The influence of visual landscape on the free flight behavior of the fruit fly Drosophila melanogaster. J Exp Biol 205:327–343PubMedGoogle Scholar
  74. Voss R, Zeil J (1998) Active vision in insects: an analysis of object-directed zig-zag flights in a ground-nesting wasp (Odynerus spinipes, Eumenidae). J Comp Physiol A182:377–387CrossRefGoogle Scholar
  75. Wagner H (1986) Flight performance and visual control of flight of the free-flying housefly (Musca domestica L.). I. Organization of the flight motor. Phil Trans R Soc Lond B 312:527–551CrossRefGoogle Scholar
  76. Warzecha AK, Egelhaaf M (1996) Intrinsic properties of biological movement detectors prevent the optomotor control system from getting unstable. Phil Trans R Soc Lond B 351:1579–1591CrossRefGoogle Scholar
  77. Warzecha AK, Egelhaaf M (1997) How reliably does a neuron in the visual motion pathway of the fly encode behaviourally relevant information? Eur J Neurosci 9:1365–1374PubMedCrossRefGoogle Scholar
  78. Warzecha A-K, Egelhaaf M, Borst A (1993) Neural circuit tuning fly visual interneurons to motion of small objects. I. Dissection of the circuit by pharmacological and photoinactivation techniques. J Neurophysiol 69(2):329–339PubMedGoogle Scholar
  79. Warzecha A, Horstmann W, Egelhaaf M (1999) Temperature-dependence of neuronal performance in the motion pathway of the blowfly Calliphora erythrocephala. J Exp Biol 202:3161–3170PubMedGoogle Scholar
  80. Webb B (2004) Neural mechanisms for prediction: do insects have forward models? Trends Neurosci 27: 278–282CrossRefPubMedGoogle Scholar
  81. Zanker JM, Zeil J (2001) Motion vision: computational, neural, and ecological constraints. Springer, Berlin Heidelberg New YorkGoogle Scholar
  82. Zanker JM, Zeil J (2005) Movement-induced motion signal distributions in outdoor scenes. Network: Computation in Neural Systems (in press)Google Scholar
  83. Zeil J (1983) Sexual dimorphism in the visual system of flies: the free flight behaviour of male Bibionidae (Diptera). J Comp Physiol A 150:395–412CrossRefGoogle Scholar
  84. Zeil J (1986) The territorial flight of male houseflies (Fannia canicularis). Behav Ecol Sociobiol 19:213–219Google Scholar
  85. Zeil J, Zanker JM (1997) A glimpse into crabworld. Vision Res 37:3417–3426CrossRefPubMedGoogle Scholar
  86. Zeil J, Kelber A, Voss R (1996) Structure and function of learning flights in ground-nesting bees and wasps. J Exp Biol 199: 245–252PubMedGoogle Scholar
  87. Zeil J, Hofmann MI, Chahl JS (2003) Catchment areas of panoramic snapshots in outdoor scenes. J Opt Soc Am A 20:450–469CrossRefGoogle Scholar

Copyright information

© Springer-Verlag 2005

Authors and Affiliations

  • N. Boeddeker
    • 1
    • 2
    Email author
  • J. P. Lindemann
    • 1
  • M. Egelhaaf
    • 1
  • J. Zeil
    • 2
  1. 1.Lehrstuhl NeurobiologieUniversität BielefeldBielefeldGermany
  2. 2.Centre for Visual Sciences, Research School of Biological SciencesAustralian National UniversityCanberraAustralia

Personalised recommendations