Video Synthesis with High Spatio-temporal Resolution Using Spectral Fusion

  • Kiyotaka Watanabe
  • Yoshio Iwai
  • Hajime Nagahara
  • Masahiko Yachida
  • Toshiya Suzuki
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4105)


We propose a novel strategy to obtain a high spatio-temporal resolution video. To this end, we introduce a dual sensor camera that can capture two video sequences with the same field of view simultaneously. These sequences record high resolution with low frame rate and low resolution with high frame rate. This paper presents an algorithm to synthesize a high spatio-temporal resolution video from these two video sequences by using motion compensation and spectral fusion. We confirm that the proposed method improves the resolution and frame rate of the synthesized video.


Video Sequence Discrete Cosine Transform High Resolution Image High Frame Rate Super Resolution 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Altunbasak, Y., Patti, A.J., Mersereau, R.M.: Super-resolution still and video reconstruction from MPEG-coded video. IEEE Trans. Circuits and Systems for Video Technology 12(4), 217–226 (2002)CrossRefGoogle Scholar
  2. 2.
    Bugwadia, K.A., Petajan, E.D., Puri, N.N.: Progressive-scan rate up-conversion of 24/30 source materials for HDTV. IEEE Trans. Consumer Electron. 42(3), 312–321 (1996)CrossRefGoogle Scholar
  3. 3.
    Choi, B.T., Lee, S.H., Ko, S.J.: New frame rate up-conversion using bi-directional motion estimation. IEEE Trans. Consumer Electron. 46(3), 603–609 (2000)CrossRefGoogle Scholar
  4. 4.
    Girod, B.: Motion-compensating prediction with fractional-pel accuracy. IEEE Trans. Communications 41(4), 604–612 (1993)CrossRefGoogle Scholar
  5. 5.
    Ha, T., Lee, S., Kim, J.: Motion compensated frame interpolation by new block-based motion estimation algorithm. IEEE Trans. Consumer Electron. 50(2), 752–759 (2004)CrossRefGoogle Scholar
  6. 6.
    Lee, S.H., Kwon, O., Park, R.H.: Weighted-adaptive motion-compensated frame rate up-conversion. IEEE Trans. Consumer Electron. 49(3), 485–492 (2003)CrossRefGoogle Scholar
  7. 7.
    Nagahara, H., Hoshikawa, A., Shigemoto, T., Iwai, Y., Yachida, M., Tanaka, H.: Dual-sensor camera for acquiring image sequences with different spatio-temporal resolution. In: Proc. IEEE Int. Conf. Advanced Video and Signal based Surveillance (September 2005)Google Scholar
  8. 8.
    Park, S.C., Kang, M.K., Kang, M.G.: Super-resolution image reconstruction: A technical overview. IEEE Signal Processing Mag. 20(3), 21–36 (2003)CrossRefGoogle Scholar
  9. 9.
    Shechtman, E., Caspi, Y., Irani, M.: Space-time super-resolution. IEEE Trans. Pattern Analysis and Machine Intelligence 27(4), 531–545 (2005)CrossRefGoogle Scholar
  10. 10.
    Shekarforoush, H., Chellappa, R.: Data-driven multi-channel super-resolution with application to video sequences. J. Opt. Soc. Am. A 16(3), 481–492 (1999)CrossRefGoogle Scholar
  11. 11.
    Tom, B.C., Katsaggelos, A.K.: Resolution enhancement of monochrome and color video using motion compensation. IEEE Trans. Image Processing 10(2), 278–287 (2001)MATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Kiyotaka Watanabe
    • 1
  • Yoshio Iwai
    • 1
  • Hajime Nagahara
    • 1
  • Masahiko Yachida
    • 1
  • Toshiya Suzuki
    • 2
  1. 1.Graduate School of Engineering ScienceOsaka UniversityToyonaka, OsakaJapan
  2. 2.Eizoh Co. LTD.Suminoe, OsakaJapan

Personalised recommendations