Time-Recursive Velocity-Adapted Spatio-Temporal Scale-Space Filters

  • Tony Lindeberg
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2350)


This paper presents a theory for constructing and computing velocity-adapted scale-space filters for spatio-temporal image data. Starting from basic criteria in terms of time-causality, time-recursivity, locality and adaptivity with respect to motion estimates, a family of spatio-temporal recursive filters is proposed and analysed. An important property of the proposed family of smoothing kernels is that the spatio-temporal covariance matrices of the discrete kernels obey similar transformation properties under Galilean transformations as for continuous smoothing kernels on continuous domains. Moreover, the proposed theory provides an efficient way to compute and generate non-separable scale-space representations without need for explicit external warping mechanisms or keeping extended temporal buffers of the past. The approach can thus be seen as a natural extension of recursive scale-space filters from pure temporal data to spatio-temporal domains.


Galilean Transformation Invariant Texture Discrete Kernel Wide Baseline Stereo Discrete Delta Function 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Adelson, E. & Bergen, J. (1985), ‘Spatiotemporal energy models for the perception of motion’, JOSA A 2, 284–299.Google Scholar
  2. Almansa, A. & Lindeberg, T. (2000), ‘Fingerprint enhancement by shape adaptation of scale-space operators with automatic scale-selection’, IEEE-TIP 9(12), 2027–2042.zbMATHMathSciNetGoogle Scholar
  3. Ballester, C. & Gonzalez, M. (1998), ‘Affine invariant texture segmentation and shape from texture by variational methods’, J. Math. Im. Vis. 9, 141–171.zbMATHCrossRefMathSciNetGoogle Scholar
  4. Burt, P. J. (1981), ‘Fast filter transforms for image processing’, CVGIP 16, 20–51.Google Scholar
  5. Crowley, J. L. (1981), A Representation for Visual Information, PhD thesis, Carnegie-Mellon University, Pittsburgh, Pennsylvania.Google Scholar
  6. DeAngelis, G. C., Ohzawa, I. & Freeman, R. D. (1995), ‘Receptive field dynamics in the central visual pathways’, Trends in Neuroscience 18(10), 451–457.CrossRefGoogle Scholar
  7. Deriche, R. (1987), ‘Using Canny’s criteria to derive a recursively implemented optimal edge detector’, IJCV 1, 167–187.CrossRefGoogle Scholar
  8. Fleet, D. J. & Langley, K. (1995), ‘Recursive filters for optical flow’, IEEE-PAMI 17(1), 61–67.Google Scholar
  9. Florack, L. M. J. (1997), Image Structure, Kluwer, Netherlands.Google Scholar
  10. Florack, L., Niessen, W. & Nielsen, M. (1998), ‘The intrinsic structure of optic flow incorporating measurement duality’, IJCV 27(3), 263–286.CrossRefGoogle Scholar
  11. Freeman, W. T. & Adelson, E. H. (1991), “The design and use of steerable filters’, IEEE-PAMI 13(9), 891–906.Google Scholar
  12. Guichard, F. (1998), ‘A morphological, affine, and galilean invariant scale-space for movies’, IEEE Trans. Image Processing 7(3), 444–456.CrossRefGoogle Scholar
  13. Heeger, D. (1988), ‘Optical flow using spatiotemporal filters’, IJCV 1, 279–302.CrossRefGoogle Scholar
  14. Koenderink, J. J. (1984), ‘The structure of images’, Biol. Cyb. 50, 363–370.zbMATHCrossRefMathSciNetGoogle Scholar
  15. Koenderink, J. J. (1988), ‘Scale-time’, Biol. Cyb. 58, 159–162.zbMATHCrossRefMathSciNetGoogle Scholar
  16. Laptev, I. & Lindeberg, T. (2002), Velocity-adaption for direct recognition of activities using multi-scale spatio-temporal receptive field responses. Technical report ISRN KTH/NA/P-02/04-SE, KTH, Stockholm, Sweden.Google Scholar
  17. Lindeberg, T. (1994), Scale-Space Theory in Computer Vision, Kluwer, Netherlands.Google Scholar
  18. Lindeberg, T. (1997), Linear spatio-temporal scale-space, in ‘Proc. Scale-Space’97’, Utrecht, Netherlands, Vol. 1252 of Springer LNCS, pp. 113–127.Google Scholar
  19. Lindeberg, T. (2001), Linear spatio-temporal scale-space, report, ISRN KTH/NA/P-01/22-SE, KTH, Stockholm, Sweden.Google Scholar
  20. Lindeberg, T. & Fagerström, D. (1996), Scale-space with causal time direction, in ‘ECCV’96’, Vol. 1064, pp. 229–240.Google Scholar
  21. Lindeberg, T. & Gårding, J. (1997), ‘Shape-adapted smoothing in estimation of 3-D depth cues from affine distortions of local 2-D structure’, IVC 15, 415–434.Google Scholar
  22. Nagel, H. & Gehrke, A. (1998), Spatiotemporal adaptive filtering for estimation and segmentation of optical flow fields, in ECCV’98, Freiburg, Germany, pp. 86–102.Google Scholar
  23. Schaffalitzky, F. & Zisserman, A. (2001), Viewpoint invariant texture matching and wide baseline stereo, in Proc. ICCV’01, Vancouver, Canada.Google Scholar
  24. Simoncelli, E. & Heeger, D. (1998), ‘A model of neuronal responses in visual area MT’, Vis. Res. 38(5).Google Scholar
  25. ter Haar Romeny, B., Florack, L. & Nielsen, M. (2001), Scale-time kernels and models, in Scale-Space’01, Vancouver, Canada.Google Scholar
  26. Valois, R. L. D., Cottaris, N. P., Mahon, L. E., Elfer, S. D. & Wilson, J. A. (2000), ‘Spatial and temporal receptive fields of geniculate and cortical cells and directional selectivity’, Vis. Res. 40(2), 3685–3702.CrossRefGoogle Scholar
  27. Watson, A. & Ahumada, A. (1985), ‘Model of human visual-motion sensing’, JOSA 2(2), 322–341.Google Scholar
  28. Weickert, J. (1998), Anisotropic Diffusion in Image Processing, Teubner-Verlag.Google Scholar
  29. Witkin, A. P. (1983), Scale-space filtering, in ‘8th IJCAI’, Karlsruhe, Germany, pp. 1019–1022.Google Scholar
  30. Young, R. A. (1987), ‘The Gaussian derivative model for spatial vision: I. Retinal mechanisms’, Spatial Vision 2, 273–293.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Tony Lindeberg
    • 1
  1. 1.Department of Numerical Analysis and Computer Science KTHComputational Vision and Active Perception Laboratory (CVAP)StockholmSweden

Personalised recommendations