On the Computation of Optical Flow using the 3-D Gabor Transform

  • Todd R. Reed
Chapter

Abstract

The motion of brightness patterns in an image sequence (optical flow) is most intuitively considered as a spatiotemporal phenomenon. It has been shown, however, that motion has a characteristic signature in the spatiotemporal-frequency (Fourier) domain. This fact can be exploited for the computation of optical flow. However, for cases which involve a number of regions in a sequence with different motions, as in scenes with one or more objects moving against a stationary or moving background, the global nature of the Fourier transform makes it unsuitable for this task. The signatures of the different motions cannot be resolved in the Fourier domain, nor associated with their respective regions in the image sequence. Local frequency representations provide a means to address this problem. In this paper, we consider the application of a 3-D version of the widely used Gabor transform to the computation of optical flow.

Key Words

motion estimation optical flow Gabor transform local frequency representations 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    B. K. P. Horn, and B. G. Schunk, “Determining Optical Flow,” Artificial Intelligence, vol. 17, no. 1–3, 1981, pp. 185–203.CrossRefGoogle Scholar
  2. 2.
    A. B. Watson, and A. J. Ahumada, “A Look at Motion in the Frequency Domain,” SIGGRAPH/SIGART Interdisciplinary Workshop MOTION: Representation and Perception, Toronto, Canada, April 4–6 1983, pp. 1–10.Google Scholar
  3. 3.
    G. Cortelazzo, and M. Balanza, “Frequency Domain Analysis of Translations with Piecewise Cubic Trajectories,” IEEE Trans. PAMI, vol. 15, no. 4, 1993, pp. 411–416.CrossRefGoogle Scholar
  4. 4.
    H. Gafni, and Y. Y. Zeevi, “A Model for Separation of Spatial and Temporal Information in the Visual System,” Biol. Cybern., vol. 28, 1977, pp. 73–82.MATHCrossRefGoogle Scholar
  5. 5.
    B. Porat, and B. Friedlander, “A Frequency Domain Algorithm for Multiframe Detection and Estimation of Dim Targets,” IEEE Trans. PAMI, vol. 12, no. 4, 1990, pp. 398–401.CrossRefGoogle Scholar
  6. 6.
    A. Kojima, N. Sakurai, and J. Kishigami, “Motion Detection Using 3D-FFT Spectrum,” Proc. of IEEE ICASSP ‘83, Minneapolis, Minnesota, April 27–30, pp. 213–216.Google Scholar
  7. 7.
    H. Gafni, and Y. Y. Zeevi, “A Model for Processing of Movement in the Visual System,” Biol. Cybern., vol. 32, 1979, pp. 165–173.MATHCrossRefGoogle Scholar
  8. 8.
    H. Jacobson, and H. Wechsler, “Derivation of Optical Flow Using a Spatiotemporal-Frequency Approach,” Computer Vision, Graphics, and Image Processing, vol. 38, 1987, pp. 29–65.Google Scholar
  9. 9.
    D. Gabor, “Theory of Communication,” Proc. of the Inst. of Elec. Eng., vol. 93, no. 26, 1946, pp. 429–457.Google Scholar
  10. 10.
    T. Ebrahimi, T. R. Reed, and M. Kunt, “Video Coding Using a Pyramidal Gabor Expansion,” Proc. of VCIP ‘80, Lausanne, Switzerland, October 2–4, pp. 489–502.Google Scholar

Copyright information

© Springer Science+Business Media New York 1998

Authors and Affiliations

  • Todd R. Reed
    • 1
  1. 1.Department of Electrical and Computer EngineeringUniversity of CaliforniaDavisUSA

Personalised recommendations