International Journal of Computer Vision

, Volume 33, Issue 1, pp 29–49 | Cite as

Non Uniform Multiresolution Method for Optical Flow and Phase Portrait Models: Environmental Applications

  • Isaac Cohen
  • Isabelle Herlin
Article

Abstract

In this paper we define a complete framework for processing large image sequences for a global monitoring of short range oceanographic and atmospheric processes. This framework is based on the use of a non quadratic regularization technique for optical flow computation that preserves flow discontinuities. We also show that using an appropriate tessellation of the image according to an estimate of the motion field can improve optical flow accuracy and yields more reliable flows. This method defines a non uniform multiresolution approach for coarse to fine grid generation. It allows to locally increase the resolution of the grid according to the studied problem. Each added node refines the grid in a region of interest and increases the numerical accuracy of the solution in this region. We make use of such a method for solving the optical flow equation with a non quadratic regularization scheme allowing the computation of optical flow field while preserving its discontinuities. The second part of the paper deals with the interpretation of the obtained displacement field. For this purpose a phase portrait model used along with a new formulation of the approximation of an oriented flow field allowing to consider arbitrary polynomial phase portrait models for characterizing salient flow features. This new framework is used for processing oceanographic and atmospheric image sequences and presents an alternative to complex physical modeling techniques.

non uniform multiresolution optical flow non quadratic regularization finite element method adaptive mesh phase portrait flow pattern classification ocean and atmospheric circulation 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barron, J.L., Fleet, D.J., and Beauchemin, S.S. 1994. Performance of optical flowtechniques. International Journal of Computer Vision, 12(1):43–77.Google Scholar
  2. Berroir, J.-P., Herlin, I.L., and Cohen, I. 1995. Tracking highly deformable structures: a surface model applied to vortex evolution within satellite oceanographic images. EOS-SPIE Satellite Remote Sensing II.Google Scholar
  3. Black, M.J. 1994. Recursive non-linear estimation of discontinuous flow fields. In Third European Conference on Computer Vision, Springer-Verlag: Sweden, pp. 138–145.Google Scholar
  4. Black, M.J. and Anandan, P. 1991. Robust dynamic motion estimation over time. In IEEE Proceedings of Computer Vision and Pattern Recognition, pp. 296–302.Google Scholar
  5. Ciarlet, P.G. 1987. The Finite Element Methods for Elliptic Problems. North-Holland: Amsterdam.Google Scholar
  6. Cohen, I. and Herlin, I. 1996. Optical flow and phase portrait methods for environmental satellite image sequences. In Proceedings of the Fourth European Conference on Computer Vision 1996, Cambridge.Google Scholar
  7. Cohen, I. and Herlin, I. 1998. Tracking meteorological structures through curves matching using geodesic paths. In IEEE Proceedings of the Sixth International Conference on Computer Vision, Bombay, India, pp. 396–401.Google Scholar
  8. Cohen, I. and Herlin, I. 1998a. Curves matching using geodesic paths. In IEEE Proceedings of Computer Vision and Pattern Recognition, Santa Barbara.Google Scholar
  9. Ford, R.M. and Strickland, R.N. 1993. Nonlinear phase portrait models for oriented textures. In IEEE Proceedings of Computer Vision and Pattern Recognition, New York, pp. 644–645.Google Scholar
  10. Ford, R.M., Strickland, R.N., and Thomas, B.A. 1994. Image models for 2-D flow visualization and compression. CVGIP: Graphical Models and Image Processing, 56(1):75–93.Google Scholar
  11. Glowinski, R. 1984. Numerical Methods for Nonlinear Variational Problems. Springer-Verlag: New York. Springer Series in Computational Physics.Google Scholar
  12. Golub, G.H. and Van Loan, C.F. 1989. Matrix Computations. 2nd edition, The Johns Hopkins University Press: London.Google Scholar
  13. Herlin, I., Cohen, I., and Bouzidi, S. 1996. Image processing for sequence of oceanographic images. The Journal of Visualization and Computer Animation, to appear.Google Scholar
  14. Horn, B.K.P. and Schunck, G. 1981. Determining optical flow. Arti-ficial Intelligence, 17:185–203.Google Scholar
  15. Irani, M., Rousso, B., and Peleg, S. 1992. Detecting and tracking multiple moving objects using temporal integration. In Proceedings of the Second European Conference on Computer Vision 1992, pp. 282–287.Google Scholar
  16. Kimia, B.B. and Siddiqi, K. 1994. Geometric heat equation and nonlinear diffusion of shapes and images. In IEEE Proceedings of Computer Vision and Pattern Recognition, pp. 113–120.Google Scholar
  17. Lefschetz, S. 1976. Differential Equations: Geometric Theory. 2nd edition, New York: Dover Publications.Google Scholar
  18. Lions, P.L., Morel, J.M., and Alvarez, L. 1990. Image selective smoothing and edge detection by nonlinear diffusion. Technical Report 9046, CEREMADE, U.R.A. CNRS 749, Université Paris IX-Dauphine. Cahiers de Mathématiques de la Décision.Google Scholar
  19. Mémin, E. and Perez, P. 1998. A multigrid approach for hierarchical motion estimation. In IEEE Proceedings of the Sixth International Conference on Computer Vision, Bombay, India, pp. 933–938.Google Scholar
  20. Muller, J.R., Anandan, P., and Bergen, J.R. 1994. Adaptive-complexity registration of images. In IEEE Proceedings of Computer Vision and Pattern Recognition, pp. 953–957.Google Scholar
  21. Nagel, H.H. and Enkelmann, W. 1986. An investigation of smoothness constraints for the estimation of displacement vector fields from image sequence. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8(5):565–593.Google Scholar
  22. Nemytskii, V.V. and Stepanov, V.V. 1989. Qualitative Theory of Differential Equations. Dover Publications: New York.Google Scholar
  23. Niessen, W.J. and Florack, L.M.J., Salden, A.H., Romeny, B.M. 1994. Nonlinear diffusion of scalar images using well-posed differential operators. In IEEE Proceedings of Computer Vision and Pattern Recognition, pp. 92–97.Google Scholar
  24. Otte, M. and Nagel, H.-H. 1994. Optical flow estimation: Advances and comparisons. In Proceedings of the Third European Conference on Computer Vision 1994, pp. 51–60.Google Scholar
  25. Rao, A.R. and Jain, R.C. 1992. Computerized flow field analysis: Oriented textures fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(7):693–709.Google Scholar
  26. Rosen, J.B. 1960. The gradient projection method for nonlinear programming. Part I: Linear constraints. J. Soc. Indust. Appl. Math., 8(1):181–217.Google Scholar
  27. Rudin, L.I., Osher, S., and Fatemi, E. 1992. Nonlinear total variation based noise removal algorithms. In Ecoles CEA-EDF-INRIA; Problèmes Non Linéaires Appliqués: Modélisation Mathématique pour le traitement d'images, pp. 149–179.Google Scholar
  28. Samet, H. 1989. The Design and Analysis of Spatial Data Structures. Addison-Wesley.Google Scholar
  29. Schnorr, C. 1992. Computation of discontinuous optical flow by domain decomposition and shape optimization. IJCV, 8(2):153–165.Google Scholar
  30. Shu, C.-F. and Jain, R.C. 1992. Vector field analysis for oriented patterns. In IEEE Proceedings of Computer Vision and Pattern Recognition, Urbana Champaign: Illinois, pp. 673–676.Google Scholar
  31. Szeliski, R. and Shum, H.Y. 1995. Motion estimation with quadtree splines. Technical report, DEC Cambridge Research Lab.Google Scholar
  32. Vasilescu, M. and Terzopoulos, D. 1992. Adaptive meshes and shells: Irregular triangulation, discontinuities, and hierarchical subdivision. In IEEE Proceedings of Computer Vision and Pattern Recognition, pp. 829–832.Google Scholar
  33. Verri, A. and Poggio, T. 1989. Motion field and optical flow: Qualitative properties. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11(5):490–498.Google Scholar
  34. Yahia, H., Herlin, I., and Vogel, L. 1995. Temporal tracking with implicit templates. Technical Report 2701, INRIA Rocquencourt.Google Scholar
  35. Zhong, J., Huang, T.S., and Adrian, R.J. 1994. Salient structure analysis of fluid flow. In IEEE Proceedings of Computer Vision and Pattern Recognition, pp. 310–315, Seattle, Washington.Google Scholar

Copyright information

© Kluwer Academic Publishers 1999

Authors and Affiliations

  • Isaac Cohen
    • 1
  • Isabelle Herlin
    • 2
  1. 1.Institute for Robotics and Intelligent SystemsUniversity of Southern CaliforniaLos Angeles
  2. 2.Institut National de Recherche en Informatique et AutomatiqueProjet AIRLe Chesnay CEDEXFrance

Personalised recommendations