Skip to main content
Log in

A new video magnification technique using complex wavelets with Radon transform application

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Magnifying micro-movements of natural videos that are undetectable by human eye has recently received considerable interests, due to its impact in numerous applications. In this paper, we use dual tree complex wavelet transform (DT-CWT), to analyze video frames in order to detect and magnify micro-movements to make them visible. We use DT-CWT, due to its excellent edge-preserving and nearly-shift invariant features. In order to detect any minor change in object’s spatial position, the paper proposes to modify the phases of the CWT coefficients decomposition of successive video frames. Furthermore, the paper applies Radon transform to track frame micro-movements without any temporal band-pass filtering. The paper starts by presenting a simple technique to design orthogonal filters that construct this CWT system. Next, it is shown that modifying the phase differences between the CWT coefficients of arbitrary frame and a reference one results in image spatial magnification. This in turn, makes these micro-movements seen and observable. Several simulation results are given, to show that the proposed technique competes very well to the existing micro-magnification approaches. In fact, as it manages to yield superior video quality in far less computation time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Wang, J., Drucker, S.M., Agrawala, M., Cohen, M.F.: The cartoon animation filter. ACM Trans. Graph. 25, 1169–1173 (2006)

    Article  Google Scholar 

  2. Poh, M.Z., McDuff, D.J., Picard, R.W.: Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt. Express 18(10), 10762–10774 (2010)

    Article  Google Scholar 

  3. Fuchs, M., Chen, T., Wang, O., Raskar, R., Seidel, H.P., Lensch, H.P.: Real-time temporal shaping of high-speed video streams. Comput. Graph, 34(5), 575–584 (2010)

    Article  Google Scholar 

  4. Liu, C., Torralba, A., Freeman, W.T., Durand, F., Adelson, E.H.: Motion magnification. ACM Trans. Graph. 24(3), 519–526 (2005)

    Article  Google Scholar 

  5. Wu, H.Y., Rubinstein, M., Shih, E., Guttag, J., Durand, F., Freeman, W.: Eulerian video magnification for revealing subtle changes in the world. ACM Trans. Graph. 31(4), 1 (2012)

    Article  Google Scholar 

  6. Wadhwal, N., Rubinstein, M., Durand, F., Freeman, W.T.: Phase-based video motion processing. ACM Trans. Graph. 32(4), 80 (2013)

    Google Scholar 

  7. Simoncelli, P.E., Freeman, W.T.: The steerable pyramid: a flexible architecture for multi-scae derivative computation. IEEE Int. Conf. Image Proces. 3, 444–447 (1995)

    Article  Google Scholar 

  8. Freeman, W.T., Adelson, E.H., et al.: The design and use of steerable filters. IEEE Trans. Pattern Anal. Mach. Intell. 13(9), 891–906 (1991)

    Article  Google Scholar 

  9. Fahmy, G., Fahmy, O.M., Fahmy, M.F.: Micro movement magnification in video signals using complex wavelet analysis. IET Image Process. 11(11), 986–993 (2017)

    Article  Google Scholar 

  10. Kingsbury, N.: A dual-tree complex wavelet transform with improved orthogonality and symmetry properties. IEEE Int. Conf. Image Proces. 2, 375–378 (2000)

    Google Scholar 

  11. Kingsbury, N.G.: Complex wavelets for shift invariant analysis and filtering of signals. Appl. Comput. Harmonic Anal. 10(3), 234–253 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  12. Selesnick, I.W., Baraniuk, R., Kingsbury, N.G.: The dual-tree complex wavelet transform. IEEE Signal Process. Mag. 22(6), 123–151 (2005)

    Article  Google Scholar 

  13. Smith, M.J., Docef, A.: A Study Guide for Digital Image Processing. Scientific Publishers, Jodhpur (1997)

    Google Scholar 

  14. Kingston, A.: Orthogonal discrete Radon transform over pn \(\times \) PN images. Signal Process. 86(8), 2040–2050 (2006)

    Article  MATH  Google Scholar 

  15. Fahmy, O.M., Fahmy, M.F.: An enhanced denoising technique using dual tree complex wavelet transform. In: National Radio Science Conference NRSC, AASRT, Aswan, Egypt (2016)

  16. Fahmy, O.M., Fahmy, M.F.: An efficient bivariate image denoising technique using new orthogonal CWT filters. IET Image Process. J. 10(1049), 1117 (2018)

    Google Scholar 

  17. Vaidyanathan, P.: Multirate Systems and Filter Banks. Pearson Education India, London (1993)

    MATH  Google Scholar 

  18. Abdelnour, A.F., Selesnick, I.W.: Nearly symmetric orthogonal wavelet bases. In: IEEE International Conference on Acoustics, Speech, Signal Processing (ICASSP) (2001 May)

  19. Kingsbury, N.G.: Complex wavelets for shift invariant analysis and filtering of signals. J. Appl. Comput. Harmonic Anal. 10(3), 234–253 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  20. Miller, M.A., Kingsbury, N.G.: Image modeling using inter scale phase properties of complex wavelet coefficients. IEEE Trans. Image Process. 17(9), 1491–99 (2008)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

Funding was provided by Deanship of Scientific Research, Prince Sattam Bin abdul Aziz University (Grant No. Project 2017/01/7140).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Omar M. Fahmy.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (avi 20349 KB)

Supplementary material 2 (avi 29122 KB)

Supplementary material 3 (avi 27495 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fahmy, O.M., Fahmy, G. & Fahmy, M.F. A new video magnification technique using complex wavelets with Radon transform application. SIViP 12, 1505–1512 (2018). https://doi.org/10.1007/s11760-018-1306-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-018-1306-9

Keywords

Navigation