Abstract
In this paper, orthogonal moment invariant-based features are used to compute 2D optical flow from sequence of images. The gray level of pixel is described in terms of its local neighborhood using Tchebichef moment invariants rather than its individual intensity value. The description is then normalized in order to make it insensitive to intensity fluctuations due to noise or other perturbations such as varying illumination conditions. The principle of conservation of moment invariance is used to derive overdetermined system of 2D motion constraint equations in local neighborhood of each pixel. The velocity field is then estimated using the least square method. Experimental results are performed on sequential video and thermal image frames under varying environmental conditions. The run time, robustness against noisy and varying illumination conditions and rotation invariance of proposed method are compared with already existing moment and non-moment-based techniques.
Similar content being viewed by others
References
Horn, B.K.P.: Robot Vision. MIT Press, Cambridge (1986)
Horn, B.K.P.; Schunck, B.G.: Determining optical flow. Artif. Intell. 17(1–3), 185–203 (1981)
Nagel, H.H.: Displacement vectors derived from second order intensity variations in image sequence. Comput. Vis. Gr. Image Process. 21(1), 85–117 (1983)
Haralick, R.M.; Lee, J. S.: The facet approach to optic flow. In: Proceedings of lmage Understanding Workshop, Arlington, pp. 84–93 (1983)
Tretiak, O.; Pastor, L.: Velocity estimates from image sequences with second-order differential operators. In: Proceedings of IEEE International Conference on Pattern Recognition, pp. 16–19 (1984)
Campani, M.; Verri, A.: Computing optic flow from an overconstrained system of linear algebraic equations. In: Proceedings of IEEE International Conference on Computer Vision, pp. 22–26 (1987)
Black, M.J.; Fleet, D.J.; Yacoob, Y.: Robustly estimating changes in image appearance. Comput. Vis. Image Underst. 78(1), 8–31 (2000)
Haussecker, H.W.; Fleet, D.J.: Computing optical flow with physical models of brightness variation. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 671–673 (2001)
Kim, Y.-H.; Martinez, A.M.; Kak, A.C.: Robust motion estimation under varying illumination. Image Vis. Comput. 23(4), 365–375 (2005)
Ghosal, S.; Mehrotra, R.: Robust optical-flow estimation using semi-invariant local features. Pattern Recognit. 30(2), 229–237 (1997)
Liang, M.; Du, J.; Li, X.; Xu, L.; Liu, H.; Li, Y.: Spatio-temporal super-resolution reconstruction based on robust optical flow and Zernike moment for dynamic image sequences. In: 2013 IEEE International Symposium on Industrial Electronics, Taipei, pp. 1–6 (2013)
Tavakoli, V.; Sahba, N.; Ahmadian, A.; Alirezaie, J.: An evaluation of different optical flow techniques for myocardial motion analysis in B-Mode echocardiography images. In: Abu Osman, N.A., Ibrahim, F., Wan Abas, W.A.B., Abdul Rahman, H.S., Ting, H.N. (eds.) 4th Kuala Lumpur International Conference on Biomedical Engineering 2008. IFMBE Proceedings, vol. 21, Springer, Berlin, Heidelberg (2008)
Clawson, K.; Jing, M.; Scotney, B.; Wang, H.; Liu, J.: Human action recognition in video via fused optical flow and moment features towards a hierarchical approach to complex scenario recognition. In: Gurrin, C., Hopfgartner, F., Hurst, W., Johansen, H., Lee, H., OConnor, N. (eds.) MultiMedia Modeling. MMM 2014. Lecture Notes in Computer Science, vol. 8326. Springer, Cham (2014)
Kharbat, M.; Aouf, N.; Tsourdos, A.; White, B.: Robust brightness description for computing optical flow. In: Proceedings of of the British Machine Vision Conference, Sept 2008, pp. 1–10. BMVA Press (2008)
Qiuying, Y.; Ying, W.: Zernike moments descriptor matching based symmetric optical flow for motion estimation and image registration. In: Proceedings of International Joint Conference on Neural Networks (IJCNN), Beijing, 6–11 July 2014, pp. 350–357 (2014)
Lucas, B.D.; Kanade, T.: An iterative image registration technique with an application in stereo vision. In: Seventh International Joint Conference on Artificial Intelligence (IJCAI-81), Vancouver, pp. 674–679 (1981)
Mukundan, R.; Ramakrishnan, K.R.: Moment Functions in Image Analysis-Theory and Applications. World Scientific, Singapore (1998)
Mukundan, R.: A new class of rotational invariants using discrete orthogonal moments. In: Proceedings of 6th IASTED Conference on Signal and Image Processing—SIP 2004, Honolulu, Aug 2004, pp. 80–84 (2004)
Khotanzad, A.; Yaw, H.H.: Invariant image recognition by Zernike moments. IEEE Trans. Pattern Anal. Mach. Intell. 12(5), 489–497 (1990)
https://www.cs.utexas.edu/~chaoyeh/web_action_data/dataset_list.html. Accessed 05 Apr 2017
OTCBVS Benchmark Dataset: http://vcipl-okstate.org/pbvs/bench/. Accessed 24 Sept 2018
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pandey, V.K., Saxena, V. & Singh, J. Robust Optical Flow Estimation Using Tchebichef Moment Invariant Feature. Arab J Sci Eng 44, 6911–6921 (2019). https://doi.org/10.1007/s13369-018-03704-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13369-018-03704-7