Optical flow using spatiotemporal filters
- David J. Heeger
- … show all 1 hide
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
A model is presented, consonant with current views regarding the neurophysiology and psychophysics of motion perception, that combines the outputs of a set of spatiotemporal motion-energy filters to estimate image velocity. A parallel implementation computes a distributed representation of image velocity. A measure of image-flow uncertainty is formulated; preliminary results indicate that this uncertainty measure may be used to recognize ambiguity due to the aperture problem. The model appears to deal with the aperture problem as well as the human visual system since it extracts the correct velocity for some patterns that have large differences in contrast at different spatial orientations.
- Barnard, S.T., Thomson, W.B. (1980) Disparity analysis of images. IEEE Trans. Pami 2: pp. 333-340
- Horn, B.K.P., Schunk, B.G. (1981) Determining optical flow. Artificial Intelligence 17: pp. 185-203
- Kearney, J.K., Thompson, W.B. (1987) An error analysis of gradient-based methods for optical flow estimation. IEEE Trans. Pami 9: pp. 229-244
- Gafni, H., Zeevi, Y. (1977) A model for separation of spatial and temporal information in the visual system. Biological Cybernetics 28: pp. 73-82
- Gafni, H., Zeevi, Y. (1979) A model for processing of movement in the visual system. Biological Cybernetics 32: pp. 165-173
- Fahle, M., Poggio, T. (1981) Visual hyperacuity: Spatiotemporal interpolation in human vision. Proc. R. Soc. (London) 213: pp. 451-477
- A.B. Watson and A.J. Ahumada, “A look at motion in the frequency domain,” Tech. Rep. 84352, NASA-Ames Research Center, 1983.
- Watson, A.B., Ahumada, A.J. (1985) Model of human visual-motion sensing. J. Opt. Soc. Amer. 2: pp. 322-342
- Adelson, E.H., Bergen, J.R. (1985) Spatiotemporal energy models for the perception of motion. J. Opt. Soc. Amer. 2: pp. 284-299
- Santen, J.P.H., Sperling, G. (1985) Elaborated reichardt detectors. J. Opt. Soc. Amer. 2: pp. 300-321
- D.J. Fleet, The early processing of spatio-temporal visual information, Master's thesis, Dept. of Computer Science, Univ. of Toronto, 1984. (available as Tech. Report RBCVTR-84-7.)
- D.J. Fleet and A.D. Jepson, “A cascaded filter approach to the construction of velocity selective mechanisms,” Tech. Report RBCV-TR-84-6, Dept. of Computer Science, Univ. Toronto, 1984.
- Hildreth, E.C. (1984) Computations underlying the measurement of visual motion. Artificial Intelligence 23: pp. 309-355
- Gabor, D. (1946) Theory of communication. J. IEE (London) 93: pp. 429-457
- Daugman, J.G. (1980) Two-dimensional analysis of cortical receptive field profiles. Vision Research 20: pp. 846-856
- Daugman, J.G. (1985) Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. J. of the Opt. Soc. of Amer. 2: pp. 1160-1169
- Heeger, David J. (1987) A model for the extraction of image flow. J. Opt. Soc. Amer. 4: pp. 1455-1471
- David J. Heeger, “Models for motion perception,” Ph.D. thesis, CIS Department, Univ. of Pennsylvania, 1987. (Available as technical report MS-CIS-87-91.)
- Mallat, S.G. (1987) Scale change versus scale space representation. Proc. First Int Conf. on Computer Vision. IEEE, London, pp. 592-596
- Burt, P. (1983) Fast algorithms for estimating local image properties. Computer Vision, Graphics, and Image Processing 21: pp. 368-382
- Burr, D.C., Ross, J. (1982) Contrast sensitivity at high velocities. Vision Research 22: pp. 479-484
- Gill, P.E., Murray, W., Wright, M.H. (1981) Practical Optimization. Academic Press, New York
- Hummel, R.A., Zucker, S.W. (1983) On the foundations of relaxing labelling processes. IEEE Pami 5: pp. 267-287
- Terzopoulos, D. (1986) Regularization of inverse visual problems involving discontinuities. IEEE Pami 8: pp. 413-424
- Poggio, T., Torre, V., Koch, C. (1985) Computational vision and regularization theory. Nature 317: pp. 314-319
- Marr, D., Hildreth, E. (1980) Theory of edge detection. Proc. Roy. Soc. (London) 207: pp. 187-217
- Rummelhart, D.E., McClelland, J.L. eds. (1986) Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Mit Press, Cambridge, Mass.
- Mandlebrot, B.B. (1983) The Fractal Geometry of Nature. W.H. Freeman, New York
- DeGroot, M.H. (1975) Probability and Statistics. Addison-Wesley, Menlo Park, Calif.
- Melsa, J., Cohn, D. (1978) Decision and Estimation Theory. McGraw-Hill, New York
- Adelson, E.H., Movshon, J.A. (1982) Phenomenal coherence of moving visual patterns. Nature 300: pp. 523-525
- E.H. Adelson, Media-Technology Laboratory, MIT, personal communication.
- doCarmo, M.P. (1976) Differential Geometry of Curves and Surfaces. Prentice-Hall, Englewood Cliffs, N.J.
- E.H. Adelson and E. Simonelli, “Orthogonal pyramid transfers for image coding,” in PROC. SPIE, VISUAL COMMUN. and IMAGE PROC. II, pp. 50–58, Cambridge, MA, 1987.
- Optical flow using spatiotemporal filters
International Journal of Computer Vision
Volume 1, Issue 4 , pp 279-302
- Cover Date
- Print ISSN
- Online ISSN
- Kluwer Academic Publishers
- Additional Links
- Industry Sectors
- David J. Heeger (1)
- Author Affiliations
- 1. Vision Sciences Group, Media Laboratory, Massachusetts Institute of Technology, 02139, Cambridge, Massachusetts