Skip to main content
SpringerLink
Log in

Artificially Intelligent Adaptive Search Fast Motion Estimation Algorithm for HD Video

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

This paper presents a new Machine Learning based approach to video Fast Motion Estimation, which improves quality, minimizes power consumption and provides control over the performance vs power balance, rendering it very suitable for hardware implementation into a motion co-processor. Many mobile and hand-held devices today deploy such hardware accelerators. The main goal of the presented algorithm is to achieve maximum quality Motion Estimation per unit of consumed power by minimizing the number of search points and also providing an optional mechanism for finding an optimal early termination point. The paper presents the creation of a dictionary of adaptively pre-learned fixed search patterns along with a pre-trained neural network to adaptively help select the most adequate search pattern from a dictionary according to the dynamics of the motion within a specific region of the video frame, not the frame or scene as a whole. There are often motions in various directions within the same scene or frame and the ability to focus on a local region within the frame improves quality significantly. Full Search represents the quality goal and upper boundary for any integer Fast Motion Estimation. The presented algorithm adds about 1 dB of PSNR to state-of-the-art fixed search patterns. There is only about 0.5 dB of PSNR remaining between our algorithm and Full Search.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24

Similar content being viewed by others

References

  1. Wiegand, T., Sullivan, G. J., Bjøntegaard, G., & Luthra, A. (2003). Overview of the H.264/AVC video coding standard. IEEE Transactions on Circuits and Systems for Video Technology, 13(7), 560–576.

    Article  Google Scholar 

  2. Sullivan, G. J., Ohm, J.-R., Han, W.-J., & Wiegand, T. (2012). Overview of the high efficiency video coding (HEVC) standard. IEEE Transactions on Circuits and Systems for Video Technology, 22(12), 1648–1667.

    Article  Google Scholar 

  3. Li, R., Zeng, B., & Liou, M. L. (1994). A new three-step search algorithm for block motion estimation. IEEE Transactions on Circuits and Systems for Video Technology, 4(4), 438–482, Aug.

    Article  Google Scholar 

  4. Jing, X., & Chau, L.-P. (2004). An efficient three-step search algorithm for block motion estimation. IEEE Transactions on Multimedia, 6(3), 435–438.

    Article  Google Scholar 

  5. Po, L.-M., & Ma, W.-C. (1996). A novel four-step search algorithm for fast block motion estimation. IEEE Transactions on Circuits and Systems for Video Technology, 6(3), 313–317.

    Article  Google Scholar 

  6. Ndili, O., & Ogunfunmi, T. (2010). Hardware-oriented modified diamond search for motion estimation in H.264/AVC. Proc. IEEE ICIP, Sep., 749–752.

  7. Ndili, O., & Ogunfunmi, T. (2011). Algorithm and architecture co-Design of Hardware-Oreinted Modified Diamond Search for fast motion estimation in H.264/AVC. IEEE Transactions on Circuits and Systems for Video Technology, 21(9), 1214–1227.

    Article  Google Scholar 

  8. Tham, J. Y., Ranganath, S., Ranganath, M., & Kassim, A. A. (1998). A novel unrestricted center-biased diamond search algorithm for block motion estimation. IEEE Transactions on Circuits and Systems for Video Technology, 8(4), 369–377.

    Article  Google Scholar 

  9. Zhu, S., & Ma, K. K. (2000). A new diamond search algorithm for fast block-matching motion estimation. IEEE Trans. Image Processing, 9, 287–290.

    Article  Google Scholar 

  10. Cheung, C. H., & Po, L. M. (2005). Novel cross-diamond-hexagonal search algorithm for fast block motion estimation. IEEE Transactions on Multimedia, 7(1), 16–22.

    Article  Google Scholar 

  11. Zhu, S., & Ma, K.-K. (2000). A new diamond search algorithm for fast-block matching motion estimation. IEEE Transactions on Image Processing, 9(2), 287–290.

    Article  Google Scholar 

  12. N. Parmar, M. H Sunwoo, (2014). Enhanced test zone search motion estimation algorithm for HEVC, Proc. IEEE Int. SoC Des. Conf., pp. 260–261.

  13. J. H. Jeong, N. Parmar, M. H. Sunwoo. (2015). Enhanced test zone search algorithm with rotating pentagon search", Proc. IEEE Int. SoC Des. Conf., pp. 275–276.

  14. Nam, K. M., Kim, J.-S., Park, R.-H., & Shim, Y. S. (1995). A fast hierarchical motion vector estimation algorithm using mean pyramid. IEEE Transactions on Circuits and Systems for Video Technology, 5(4), 344–351.

    Article  Google Scholar 

  15. N. Al-Najdawi, M. N. Al-Najdawi, and S. Tedmori (2014) “Employing a novel crossdiamond search in a modified hierarchical search motion estimation algorithm for video compression,” Information Sciences, vol. 268, pp. 425–435, , new Sensing and Processing Technologies for Hand-based Biometrics Authentication. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S0020025513005690.

  16. Cheng, Y., Chen, Z., Chang, P., “An H.264 spatio-temporal hierarchical fast motion estimation algorithm for high definition video,” 2009 IEEE international symposium on circuits and systems, pp. 880–883eigcccfnunkebbtklvdjfitvfjvhubcevvvuhblctnni.

  17. P.I. Hosur, K.K. Ma, Motion vector field adaptive fast motion estimation, Second international conference on information, communications and signal processing (ICICS ‘99), Singapore, 7–10 Dec’99.

  18. Song, X., Chiang, T., Zhang, Y.Q. (1998) A scalable hierarchical motion estimation algorithm for MPEG-2, Circuits and systems, 1998. ISCAS '98. Proceedings of the 1998 IEEE international symposium on, Monterey, CA, pp. 126–129 vol.4

  19. Tourapis, A. M., Au, O. C., & Liou, M. L. (2002). Highly efficient predictive zonal algorithms for fast block-matching motion estimation. IEEE Transactions on Circuits and Systems for Video Technology, 12(10), 934–947.

    Article  Google Scholar 

  20. Tourapis, H.Y.C., Tourapis, A.M.. (2003) Fast motion estimation within the H.264 codec, Multimedia and Expo, 2003. ICME '03. Proceedings. 2003 International Conference on, pp. III-517-20 vol.3.

  21. Arnaudov, P., Ogunfunmi, T., (2017) Adaptive search pattern for fast motion estimation in HD video” in 51st Asilomar conference on signals, systems and computers, pp. 173–177

  22. Arnaudov, P., Ogunfunmi, T. (2017) Low power HD video fast motion estimation algorithm based on signatures” in 10thIntern. Conf. on Ubi-media computing and Workshops, pp. 1–6.

  23. Arnaudov, P., Ogunfunmi, T., (2017) “A CAM enabled fast video motion estimation based on locality”, ISCAS Conf. pp. 1–4

  24. Arnaudov, P., Ogunfunmi, T. An Enhanced fractional Motion Estimation algorithm for HD video. ICCE’17, pp.221–2

  25. Arnaudov, P., Ogunfunmi, T. (2016) “Architecture and implementation of a simplified locality sensitive hashed signatures ” intern. Workshop on SiPS, pp. 11–16.

  26. Xipg.org Video Test Media [derf’s collection]. https://media.xiph.org/video/derf/ (HD Content and above).

Download references

Author information

Authors and Affiliations

  1. Santa Clara University, Santa Clara, CA, USA

    Pavel Arnaudov & Tokunbo Ogunfunmi

Authors
  1. Pavel Arnaudov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tokunbo Ogunfunmi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tokunbo Ogunfunmi.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Arnaudov, P., Ogunfunmi, T. Artificially Intelligent Adaptive Search Fast Motion Estimation Algorithm for HD Video. J Sign Process Syst 92, 389–408 (2020). https://doi.org/10.1007/s11265-019-01466-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-019-01466-5

Keywords

Search

Navigation