Abstract
We describe the implementation of a 2D optical flow algorithm published in the European Conference on Computer Vision (ECCV 2004) by Brox et al. [1] (best paper award) and a qualitative and quantitative evaluation of it for a number of synthetic and real image sequences. Their optical flow method combines three assumptions: a brightness constancy assumption, a gradient constancy assumption and a spatio-temporal smoothness constraint. A numerical scheme based on fixed point iterations is used. Their method uses a coarse-to-fine warping strategy to measure larger optical flow vectors. We have investigated the algorithm in detail and our evaluation of the method demonstrates that it produces very accurate optical flow fields from only 2 input images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3021, pp. 25–36. Springer, Heidelberg (2004)
Papenberg, N., Bruhn, A., Brox, T., Didas, S., Weickert, J.: Highly accurate optic flow computation with theoretically justified warping. International Journal of Computer Vision 67(2), 141–158 (2006)
Black, M., Anandan, A.: The robust estimation of multiple motions: Parametric and picewise smooth flows. Computer Vision and Image Understanding 64(1), 71–104 (1996)
Longuet-Higgins, H.C., Prazdny, K.: The interpretation of a moving retinal image. In: Proc. Royal Society London, vol. B208, pp. 385–397 (1980)
Horn, B., Schunck, B.: Determining optical flow. Artificial Intelligence 17(1-3), 185–203 (1981)
Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: International Joint Conference on Artificial Intelligence, pp. 674–679 (1981), (DARPA Image Understanding Workshop, pp. 121–130)
Ju, S.X., Black, M.J., Jepson, A.D.: Skin and bones: Multi-layer, locally affine, optical flow and regularization with transparency. In: Proceedings of Computer Vision and Pattern Recognition Conference, San Francisco, June 1996, pp. 307–314 (1996)
Lai, S.H., Vemuri, B.C.: Reliable and efficient computation of optical flow. International Journal of Computer Vision 29(2), 87–105 (2005)
Bab-Hadiashar, A., Suter, D.: Robust optic flow computation. International Journal of Computer Vision 29(1), 59–77 (1998)
Alvarez, L., Weickert, J., Sanchez, J.: Reliable estimation of dense optical flow fields with large displacements. International Journal of Computer Vision 39(1), 41–56 (2000)
Nagel, H.H., Enkelmann, W.: An investigation of smoothness constraints for the estimation of displacement vector fields from image sequences. IEEE Trans. Pattern Analysis and Machine Intelligence 1, 523–530 (1986)
Färneback, G.: Very high accuracy velocity estimation using orientation tensors, parametric motion, and simultaneous segmentation of the motion field. In: Proceedings of the Eighth IEEE International Conference on Computer Vision, Vancouver, Canada, July 2001, vol. I, pp. 171–177. IEEE Computer Society Press, Los Alamitos (2001)
Mémin, E., Pérez, P.: Hierarchical estimation and segmentation of dense motion fields. International Journal Computer Vision 46(2), 129–155 (2002)
Weickert, J., Bruhn, A., Schnörr, C.: Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods. Technical report, Dept. of Mathematics, Saarland University, Saarbrücken, Germany (April 2003)
Bruhn, A., Weickert, J., Schnörr, C.: Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods. International Journal of Computer Vision 61(3), 1–21 (2005)
Barron, J., Fleet, D., Beauchemin, S.: Performance of optical flow techniques. International Journal of Computer Vision 12(1), 43–77 (1994)
Brox, T.: From Pixels to Regions: Partial Differential Equations in Image Analysis. Ph.d thesis, Mathematical Image Analysis Group, Dept. of Mathematics and Computer Science, Sarrland University, Saarbrückem, Germany (April 2005)
Pollard, S., Porrill, J., Thacker, N.: Tina programmer’s guide. Technical report, Medical Biophysics and Clinical Radiology, University of Manchester (1999), www.niac.man.ac.uk/Tina/docs/programmers/programmers_guide.html
Barron, J.: The integration of optical flow into tinatool. Technical report, Dept. of Computer Science, The Univ. of Western Ontario. TR601 (report for OSMIA (Open Source Medical Image Analysis, a EU 5th Framework Programme project)) (2003)
Simoncelli, E.: Design of multi-dimensional derivative filters. In: IEEE Int. Conf. Image Processing, pp. 790–793. IEEE Computer Society Press, Los Alamitos (1994)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Faisal, M., Barron, J. (2007). High Accuracy Optical Flow Method Based on a Theory for Warping: Implementation and Qualitative/Quantitative Evaluation. In: Kamel, M., Campilho, A. (eds) Image Analysis and Recognition. ICIAR 2007. Lecture Notes in Computer Science, vol 4633. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74260-9_46
Download citation
DOI: https://doi.org/10.1007/978-3-540-74260-9_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74258-6
Online ISBN: 978-3-540-74260-9
eBook Packages: Computer ScienceComputer Science (R0)