Advertisement

Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Fast Multi-Hypothesis Motion Compensated Filter for Video Denoising

Abstract

Multi-Hypothesis motion compensated filter (MHMCF) utilizes a number of hypotheses (temporal predictions) to estimate the current pixel which is corrupted with noise. While showing remarkable denoising results, MHMCF is computationally intensive as full search is employed in the expectation of finding good temporal predictions in the presence of noise. In the frame of MHMCF, a fast denoising algorithm FMHMCF is proposed in this paper. With edge preserved low-pass prefiltering and noise-robust fast multihypothesis search, FMHMCF could find reliable hypotheses while checking very few search locations, so that the denoising process can be dramatically accelerated. Experimental results show that FMHMCF can be 10 to 14 times faster than MHMCF, while achieving the same or even better denoising performance with up to 1.93 dB PSNR (peak-signal-noise-ratio) improvement.

This is a preview of subscription content, log in to check access.

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9

References

  1. 1.

    Donoho, D. L. (1995). Denoising by soft-thresholding. IEEE Transactions on Information Theory, 41, 613–627.

  2. 2.

    Zhang, S., & Salari, E. (2005). Image denoising using a neural network based non-linear filter in wavelet domain. In Proc. IEEE international conference on acoustic, speech and signal Processing (pp. 989–992), March.

  3. 3.

    Tschumperle, D., & Deriche, R. (2005). Vector-valued image regularization with PDEs: A common framework for different applications. IEEE Transactions on Pattern Analalysis and Machine Intelligence, 27, 506–517.

  4. 4.

    Buades, A., Coll, B., & Morel, J. M. (2005). A non-local algorithm for image denoising. In Proc. IEEE computer society conference on computer vision and pattern recognition (pp. 60–65), June.

  5. 5.

    Woods, J., & Radewan, C. (1977). Kalman filtering in two dimensions. IEEE Transactions on Information Theory, 23, 473–482.

  6. 6.

    Woods, J., & Ingle, V. (1981). Kalman filter in two dimensions: Further results. IEEE Transactions on Acoustics, Speech, and Signal Processing, 29, 188–197.

  7. 7.

    Jin, F., Fieguth, P., Winger, L., & Jernigan, E. (2003). Adaptive Wiener filtering of noisy images and image sequences. In Proc. IEEE international conference on image processing (pp. 349–352), September.

  8. 8.

    Dubois, E., & Sabri, S. (1984). Noise reduction in image sequences using motion-compensated temporal filtering. IEEE Transactions on Communications, 32, 826–831.

  9. 9.

    Patti, A. J., Tekalp, A. M., & Sezan, M. I. (1998). A new motion-compensated reduce-order model Kalman filter for space-varying restoration of progressive and interlaced video. IEEE Transactions on Image Processing, 7, 543–554.

  10. 10.

    Balster, E. J., Zheng, Y. F., & Ewing, R. L. (2006). Combined spatial and temporal domain wavelet shrinkage algorithm for video denoising. IEEE Transactions on Circuits and Systems for Video Technology, 16, 220–230.

  11. 11.

    Buades, A., Coll, B., & Morel, J. M. (2005). Denoising image sequences does not require motion estimation. In Proc. IEEE international conference on advanced video and signal based surveillance (pp. 70–74), September.

  12. 12.

    Zlokolica, V., Pitirica, A., & Philips, W. (2004). Recursive temporal denoising and motion estimation of video. In Proc. IEEE international conference on image processing (pp. 1465–1468), October.

  13. 13.

    Dugad, R., & Ahuja, N. (1999). Video denoising by combining Kalman and Wiener estimates. In Proc. IEEE international conference on image processing (pp. 152–156), October.

  14. 14.

    Chan, T. W., Au, O. C., Chong, T. S., & Chau, W. S. (2005). A novel content-adaptive video denoising filter. In Proc. IEEE international symposium on circuits and systems (pp. 6060–6283), May.

  15. 15.

    Mahbubur Rahman, S. M., Omair Ahmad, M., & Swamy, M. N. S. (2007). Video denoising based on inter-frame statistical modeling of wavelet coefficients. IEEE Transactions on Circuits and Systems for Video Technology, 17, 187–198.

  16. 16.

    Zlokolica, V., Pizurica, A., & Philips, W. (2006). Wavelet-domain video denoising based on reliability measures. IEEE Transactions on Circuits and Systems for Video Technology, 16, 993–1008.

  17. 17.

    Cheong, H. Y., Tourapis, A. M., Llach, J., & Boyce, J. (2004). Adaptive spatio-temporal filtering for video de-noising. In Proc. IEEE international conference on image processing (pp. 965–968).

  18. 18.

    Mahmoudi, M., & Sapiro, G. (2005). Fast image and video denoising via nonlocal means of similar neighborhoods. IEEE Signal Processing Letters, 16, 839–843.

  19. 19.

    Rajpoot, N., Yao, Z., & Wilson, R. (2004) Adaptive wavelet restoration of noisy video sequences. In Proc. IEEE international conference on image processing (pp. 24–27).

  20. 20.

    Yin, H. B., Fang, X. Z., Wei, Z., & Yang, X. (2007). An improved motion-compensated 3-d llmmse filter with spatioctemporal adaptive filtering support. IEEE Transactions on Circuits and Systems for Video Technology, 17(12), 1714–1727.

  21. 21.

    Sendur, L., & Selesnick, I. W. (2004). Bivariate shrinkage with local variance estimation. IEEE Signal Processing Letters, 9(12), 438–441.

  22. 22.

    Sendur, L., & Selesnick, I. W. (2002). Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency. IEEE Transactions on Signal Processing, 50, 2744–2756.

  23. 23.

    Boo, K. J., & Bose, N. K. (1998). A motion-compensated spatio-temporal filter for image sequences with signal-dependent noise. IEEE Transactions on Circuits and Systems for Video Technology, 8, 287–298.

  24. 24.

    Brailean, J. C., Kleihorst, R. P., Efstratiadis, S., Katsaggelos, A. K., & Lagendijk, R. L., (1995) Noise reduction filter for dynamic image sequences: A review. In Proc. IEEE (Vol. 83), September.

  25. 25.

    Flierl, M., & Girod, B. (2004). Video coding with superimposed motion compensation video signals. Boston: Kluwer Academic.

  26. 26.

    Guo, L. W., Au, O. C., Ma, M. M., Liang, Z. Q., & Yuk, C. (2006). A multihypothesis motion-compensated temporal filter for video denoising. In Proc. Int. Conf. on Image Processing (pp. 1417–1420), October.

Download references

Acknowledgements

This work has been supported in part by the Innovation and Technology Commission of the Hong Kong Special Administrative Region, China (project no GHP/048/08) and the Hong Kong Applied Science and Technology Research Institute (ASTRI).

Author information

Correspondence to Liwei Guo.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Guo, L., Au, O.C., Ma, M. et al. Fast Multi-Hypothesis Motion Compensated Filter for Video Denoising. J Sign Process Syst 60, 273–290 (2010). https://doi.org/10.1007/s11265-009-0365-0

Download citation

Keywords

  • Motion compensation
  • Spatial filtering
  • Temporal filtering
  • White noise
  • Video signal processing