Abstract
A novel Fourier-based technique for local motion detection from image sequences is proposed. In this method, the instantaneous velocities of local image points are inferred directly from the global 3D Fourier components of the image sequence. This is done by selecting those velocities for which the superposition of the corresponding Fourier gratings leads to constructive interference at the image point. Hence, image velocities can be assigned locally even though position is computed from the phases and amplitudes of global Fourier components (spanning the whole image sequence) that have been filtered based on the motion-constraint equation, reducing certain aperture effects typically arising from windowing in other methods. Regularization is introduced for sequences having smooth flow fields. Aperture effects and their effect on optic-flow regularization are investigated in this context. The algorithm is tested on both synthetic and real image sequences and the results are compared to those of other local methods. Finally, we show that other motion features, i.e. motion direction, can be computed using the same algorithmic framework without requiring an intermediate representation of local velocity, which is an important characteristic of the proposed method.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Aach, T., Mota, C., Stuke, I., Muhlich, M., & Barth, E. (2006). Analysis of superimposed oriented patterns. IEEE Transactions on Image Processing, 15(12), 3690–3700.
Adelson, E. H., & Bergen, J. R. (1985). Spatiotemporal energy models for the perception of motion. Journal of Optical Society of America A, 2, 284–299.
Anandan, P. (1987). A computational framework and an algorithm for the measurement of visual motion. International Journal of Computer Vision, 2, 283–310.
Baker, S., Scharstein, D., Lewis, J. P., Roth, S., Black, M., & Szeliski, R. (2007). A database and evaluation methodology for optical flow. In ICCV 2007.
Barron, J. L., Fleet, D. J., Beauchemin, S., & Burkitt, T. (1994). Performance of optical flow techniques. International Journal of Computer Vision, 12(1), 43–77.
Boykov, Y., Veksler, O., & Zabih, R. (2001). Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(11), 1222–1239.
Briassouli, A., & Narendra, A. (2006). Spatial and Fourier error minimization for motion estimation and segmentation. In Proceedings of the 18th international conference on pattern recognition, ICPR 2006, 20–24 August 2006, Hong Kong.
Bruhn, A., Weickert, J., & Schnörr, C. (2005). Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods. International Journal of Computer Vision, 61(3), 211–231.
Cooke, T. (2008). Two applications of graph cuts to image processing. In DICTA 2008.
Dellen, B. K., Clark, J. W., & Wessel, R. (2007). The brain’s view of the natural world in motion: Computing structure from function using directional Fourier transformations. International Journal of Modern Physics B, 21(13–14), 2493–2504.
Dellen, B., & Wörgötter, F. (2008). A local algorithm for the computation of optic flow via constructive interference of global Fourier components. In Proceedings of the British machine vision conference.
Felzenszwalb, P. F., & Huttenlocher, D. P. (2006). Efficient belief propagation for early vision. International Journal of Computer Vision, 70(1).
Fleet, D. J., & Jepson, A. D. (1990). Computation of component image velocity from local phase information. International Journal of Computer Vision, 5, 77–104.
Galvin, B., McCane, B., Novins, K., & Mills, S. (1998). Recovering motion fields: An evaluation of eight optical flow algorithms. In Proc. British machine vision conf (pp. 195–204).
Gautama, T., & Van Hulle, M. (2003). A phase-based approach to the estimation of the optical flow field using spatial filtering. IEEE Transactions on Neural Networks, 13, 1127–1136.
Heeger, D. J. (1987). Model for the extraction of image flow. Journal of Optical Society of America A, 4, 1455–1471.
Horn, B. K. P., & Schunck, B. G. (1981). Determining optic flow. AI, 17, 185–204.
Lucas, B. D., & Kanade, T. (1981). An iterative image registration technique with an application to stereo vision. In Proc. DARPA IU workshop (pp. 121–130).
Mota, C., Stuke, I., & Barth, E. (2001). Analytic solutions for multiple motions. In Proc. IEEE ICIP (pp. 917–920). Thessaloniki.
Nagel, H. H. (1987). Displacement vectors derived from second-order intensity variations in image sequences. In CGIP (Vol. 21, pp. 85–117).
Papenberg, N., Bruhn, A., Brox, T., Didas, S., & Weickert, J. (2006). Highly accurate optic flow computation with theoretically justified warping. International Journal of Computer Vision, 67(2), 141–158.
Shizawa, M., & Mase, K. (1990). Simultaneous multiple optic flow estimation. In Proc. IEEE ICVPR.
Simoncelli, E. P. (1993). Distributed representation and analysis of visual motion. PhD Thesis, Dept. of Electrical Engineering and Computer Science, MIT.
Singh, A. (1990). An estimation-theoretic framework for image-flow computation. In Proc. IEEE ICCV (Osaka) (pp. 168–177).
Vernon, D. (1998). Decoupling Fourier components of dynamic image sequences: a theory of signal separation, image segmentation, and optical flow estimation. In Lecture notes in computer science. Computer vision—ECCV’98 (p. 69). Berlin: Springer.
Weickert, J., & Schnörr, C. (2001). A theoretical framework for convex regularizers in PDE-based computation of image motion. International Journal of Computer Vision, 14(3), 245–264.
Weiss, Y., & Freeman, W. T. (2001). On the optimality of solutions of the max-product belief propagation algorithm in arbitrary graphs. IEEE Transactions on Information Theory, 47(2), 723–735.
Wilson, R., & Granlund, G. H. (1984). The uncertainty principle in signal processing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Dellen, B., Wörgötter, F. A Local Algorithm for the Computation of Image Velocity via Constructive Interference of Global Fourier Components. Int J Comput Vis 92, 53–70 (2011). https://doi.org/10.1007/s11263-010-0402-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11263-010-0402-2