Optical flow using overlapped basis functions for solving global motion problems

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1407)


Motion problems in which the scene motion largely conforms to a low order global motion model are called global motion problems, examples of which are stabilization, mosaicking and motion superresolution. In this paper, we propose a two-step solution for robustly estimating the global motion parameters that characterize global motion problems. Our primary contribution is an improved estimation algorithm for modeling the optical flow field of a sequence using overlapped basis functions. Moreover, we show that the parametrized flow estimates can be consolidated through an iterative process that estimates global deformation while ensuring robustness to systematic errors such as those caused by moving foreground objects or occlusion. We demonstrate the validity of our model and accuracy of the algorithm on synthetic and real data. Our technique is computationally efficient, and is ideally suited for the application areas discussed here, viz. stabilization, mosaicking and super-resolution.


Optical Flow Global Motion Less Square Solution Total Little Square Optical Flow Field 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    G. Adiv, “Determining 3-D Motion and Structure from Optical Flow Generated by Several Moving Objects”, IEEE PAMI, vol. 7, no. 4, 1985.Google Scholar
  2. 2.
    M. S. Alam et. al., “High-resolution Infrared Image Reconstruction using Multiple Randomly Shifted Low-resolution Aliased Frames”, Proc. SPIE 3063, 1997.Google Scholar
  3. 3.
    P Anandan, “Measuring Visual Motion from Image Sequences”, Ph. D. dissertation, University of Massachusetts, Amherst, 1987.Google Scholar
  4. 4.
    P. Anandan et. al., “Real-time Scene Stabilization and Mosaic Construction”, ARPA Image Understanding Workshop, 1994.Google Scholar
  5. 5.
    O. Axelsson, Iterated Solution Methods, Cambridge University Press, 1994.Google Scholar
  6. 6.
    J. L. Barron, D. J. Fleet and S. S. Beauchemin, “Performance of Optical Flow Techniques”, Int. Jour. of Comp. Vision, vol. 12:1, pp. 43–77.Google Scholar
  7. 7.
    P. J. Burt and P. Anandan, “Image Stabilization by Registration to a Reference Mosaic”, ARPA Image Understanding Workshop, 1994.Google Scholar
  8. 8.
    D. J. Heeger, “Model for the Extraction of Image Flow”, Jour. Opt. Soc. Amer., vol. 4, pp. 1455–1471.Google Scholar
  9. 9.
    B. K. P. Horn and B. G. Schunck, “Determining Optical Flow”, Artificial Intelligence, vol. 17, pp. 185–204, 1981.CrossRefGoogle Scholar
  10. 10.
    D. J. Fleet and A. D. Jepson, “Computation of Component Image Velocity from Local Phase Information”, Int. Jour. Comp. Vision, vol. 5, pp. 77–104.Google Scholar
  11. 11.
    N. Gupta and L. Kanal, “Recovering 3-D motion from a Motion Field”, Special Issue on Computer Vision, 1995.Google Scholar
  12. 12.
    S. V. Huffel and J. Vandewalle, The Total Least Squares Problem — Computational Aspects and Analysis, SIAM, 1991.Google Scholar
  13. 13.
    M. Irani and S. Peleg, “Improving Resolution by Image Registration”, Comp. Vision Graphics Image Proc., vol. 53, pp. 231–239.Google Scholar
  14. 14.
    H. Liu, “A General Motion Model and Spatio-Temporal Filters for 3-D Motion Interpretations”, Ph. D. dissertation, Univ. of Maryland, 1995.Google Scholar
  15. 15.
    B. D. Lucas and T. Kanade, “An Iterative Image Registration Technique with an Application to Stereo Vision”, Proc. DARPA IUW, 1991.Google Scholar
  16. 16.
    C. H. Morimoto and R. Chellappa, “Fast Electronic Digital Image Stabilization”, Proc. of IEEE ICPR, 1996.Google Scholar
  17. 17.
    H. H. Nagel, “On the Estimation of Optical Flow”, Artificial Intelligence, vol. 33, pp. 299–324, 1987.CrossRefGoogle Scholar
  18. 18.
    S. Negahdaripour and B. K. P. Horn, “Direct Passive Navigation”, IEEE PAMI, vol. 9, no. 1, pp. 168–176, 1987.zbMATHGoogle Scholar
  19. 19.
    W. H. Press et. al., Numerical Recipes in C (2 ed.), Cambridge University Press, 1992.Google Scholar
  20. 20.
    S. Rakshit and C. H. Anderson, “Computation of Optical Flow Using Basis Functions”, IEEE IP, vol. 6, no. 9, pp. 1246–1254, 1997.Google Scholar
  21. 21.
    A. Singh, “An Estimation-Theoretic Framework for Image-Flow Computation”, Proc. IEEE ICCV, 1990.Google Scholar
  22. 22.
    S. Srinivasan and R. Chellappa, “Robust Modeling and Estimation of Optical Flow with Overlapped Basis Functions”, CAR-TR-845, Univ. of Maryland, 1996.Google Scholar
  23. 23.
    R. Szeliski and J. Coughlan, “Spline-Based Image Registration”, DEC-TR-CRL-94/1, Cambridge Research Laboratory, 1994.Google Scholar
  24. 24.
    S. Uras et. al., “A Computational Approach to Motion Perception”, Biological Cybernetics, vol. 60, pp. 79–97, 1988.CrossRefGoogle Scholar
  25. 25.
    Y. S. Yao, “Electronic Stabilization and Feature Tracking in Long Image Sequences”, Ph. D. dissertation CAR-TR-790, Univ. of Maryland, 1996.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1998

Authors and Affiliations

  1. 1.Department of Electrical Engineering and Center for Automation ResearchUniversity of MarylandCollege ParkUSA

Personalised recommendations