Skip to main content
Book cover

Asian Conference on Computer Vision

ACCV 2010: Computer Vision – ACCV 2010 pp 282–292Cite as

Spatial-Temporal Motion Compensation Based Video Super Resolution

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNIP,volume 6493)

Abstract

Due to the arbitrary motion patterns in practical video, annoying artifacts cased by the registration error often appears in the super resolution outcome. This paper proposes a spatial-temporal motion compensation based super resolution fusion method (STMC) for video after explicit motion estimation between a few neighboring frames. We first register the neighboring low resolution frames to proper positions in the high resolution frame, and then use the registered low resolution information as non-local redundancy to compensate the surrounding positions which have no or a few registered low resolution pixels. Experimental results indicate the proposed method can effectively reduce the artifacts cased by the motion estimation error with obvious performance improvement in both PSNR and visual effect.

Keywords

  • Super resolution
  • Motion compensation
  • Non-Local
  • Video fusion

This is a preview of subscription content, access via your institution.

eBook
EUR   16.99
Price includes VAT (Finland)
  • ISBN: 978-3-642-19309-5
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
EUR   109.99
Price includes VAT (Finland)
  • ISBN: 978-3-642-19308-8
  • Dispatched in 3 to 5 business days
  • Exclusive offer for individuals only
  • Free shipping worldwide
    See shipping information.
  • Tax calculation will be finalised during checkout
Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction: A technical overview. IEEE Signal Process Magazine 20, 21–36 (2003)

    CrossRef  Google Scholar 

  2. Schultz, R.R., Stevenson, R.L.: Extraction of high resolution frames from video sequences. IEEE Transactions on Signal Processing 5, 996–1011 (1996)

    Google Scholar 

  3. Jiang, Z., Wong, T., Bao, H.: Practical Super-Resolution from Dynamic Video Sequences. In: CVPR 2003, vol. 2, pp. 549–554 (2003)

    Google Scholar 

  4. Simonyan, K., Grishin, S., Vatolin, D., Popov, D.: Fast video super-resolution via classification. In: ICIP 2008, pp. 349–352 (2008)

    Google Scholar 

  5. Liu, F., Wang, J., Zhu, S., Gleicher, M., Gong, Y.: Noisy Video Super-Resolution. In: ACM Multimedia 2008, pp. 713–716 (2008)

    Google Scholar 

  6. Hung, K.W., Siu, W.C.: New Motion Compensation Model Via Frequency Classification For Fast Video Super-Resolution. In: ICIP 2009, pp. 1193–1196 (2009)

    Google Scholar 

  7. Omer, O.A., Tanaka, T.: Region-based weighted-norm approach to video super-resolution with adaptive regularization. In: ICASSP 2009, pp. 833–836 (2009)

    Google Scholar 

  8. Zach, C., Pock, T., Bischof, H.: A duality based approach for realtime TV-L1 optical flow. In: Hamprecht, F.A., Schnörr, C., Jähne, B. (eds.) DAGM 2007. LNCS, vol. 4713, pp. 214–223. Springer, Heidelberg (2007)

    CrossRef  Google Scholar 

  9. Wedel, A., Pock, T., Zach, C., Bischof, H., Cremers, D.: An Improved Algorithm for TV-L1 Optical Flow. Statistical and Geometrical Approaches to Visual Motion Analysis, 23–45 (2008)

    Google Scholar 

  10. Mitzel, D., Pock, T., Schoenemann, T., Cremers, D.: Video Super Resolution using Duality Based TV-L1 Optical Flow. In: Denzler, J., Notni, G., Süße, H. (eds.) Pattern Recognition. LNCS, vol. 5748, pp. 432–441. Springer, Heidelberg (2009)

    CrossRef  Google Scholar 

  11. Buades, A., Coll, B., Morel, J.M.: A non-local algorithm for image denoising. In: CVPR 2005, vol. 2, pp. 60–65 (2005)

    Google Scholar 

  12. Dong, W., Zhang, L., Shi, G., Wu, X.: Nonlocal Back-Projection For Adaptive Image Enlargement. In: ICIP 2009, pp. 349–352 (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Beijing Laboratory of Intelligent Information Technology, School of Computer Science and Technology, Beijing Institute of Technology, Beijing, 100081, China

    Yaozu An, Yao Lu & Ziye Yan

Authors
  1. Yaozu An
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yao Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ziye Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science, Technion, Israel Institute of Technology, 32000, Haifa, Israel

    Ron Kimmel

  2. The University of Auckland, 37 Kohimarama Road, Mission Bay, 1071, Auckland, New Zealand

    Reinhard Klette

  3. National Institute of Informatics, 1018430, Chiyoda, Tokyo, Japan

    Akihiro Sugimoto

Rights and permissions

Reprints and Permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

An, Y., Lu, Y., Yan, Z. (2011). Spatial-Temporal Motion Compensation Based Video Super Resolution. In: Kimmel, R., Klette, R., Sugimoto, A. (eds) Computer Vision – ACCV 2010. ACCV 2010. Lecture Notes in Computer Science, vol 6493. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19309-5_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-19309-5_22

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-19308-8

  • Online ISBN: 978-3-642-19309-5

  • eBook Packages: Computer ScienceComputer Science (R0)