A Framelet-Based Algorithm for Video Enhancement

  • Raymond H. Chan
  • Yiqiu Dong
  • Zexi Wang
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 80)


Video clips are made up of many still frames. Most of the times, the frames are small perturbations of their neighboring frames. Recently, we proposed a framelet-based algorithm to enhance the resolution of any frames in a video clip by solving it as a super-resolution image reconstruction problem. In this paper, we extend the algorithm to video enhancement, where we compose a high-resolution video from a low-resolution one. An experimental result of our algorithm on a real video clip is given to illustrate the performance.


Video Clip Video Stream Sensor Position Bilinear Interpolation Displacement Error 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Bose N, Boo K (1998) Highresolution image reconstruction with multisensors. Int J Imag Syst Technol 9:294–304CrossRefGoogle Scholar
  2. 2.
    Cai J-F, Chan RH, Shen ZW (2008) A framelet-based image inpainting algorithm. Appl Comput Harmon Anal 24:131–149MathSciNetzbMATHCrossRefGoogle Scholar
  3. 3.
    Cain S, Hardie RC, Armstrong EE (1996) Restoration of aliased video sequences via a maximum-likelihood approach. Infrared Inf Symp (IRIS) Passive Sens 1:377–390Google Scholar
  4. 4.
    Capel D, Zisserman A (2003) Computer vision applied to superresolution. IEEE Signal Process Mag 20:72–86CrossRefGoogle Scholar
  5. 5.
    Chan HR, Riemenschneider SD, Shen LX, Shen ZW (2004) Tight frame: the efficient way for highresolution image reconstruction. Appl Comput Harmon Anal 17:91–115MathSciNetzbMATHCrossRefGoogle Scholar
  6. 6.
    Chan HR, Riemenschneider SD, Shen LX, Shen ZW (2004) Highresolution image reconstruction with displacement errors: a framelet approach. Int J Imag Syst Technol 14:91–104MathSciNetCrossRefGoogle Scholar
  7. 7.
    Chan HR, Shen ZW, Xia T (2007) A framelet algorithm for enhancing video stills. Appl Comput Harmon Anal 23:153–170MathSciNetzbMATHCrossRefGoogle Scholar
  8. 8.
    Donoho D (1995) De-noising by soft-thresholding. IEEE Trans Inf Theory 41:613–627MathSciNetzbMATHCrossRefGoogle Scholar
  9. 9.
    Eren PE, Sezan MI, Tekalp AM (1997) Robust, object-based high-resolution image reconstruction from low-resolution video. IEEE Trans Image Process 6:1446–1451CrossRefGoogle Scholar
  10. 10.
    Hardie RC, Barnard KJ, Bognar JG, Armstrong EE, Watson EA (1998) High-resolution image reconstruction from a sequence of rotated and translated frames and its application to an infrared imaging system. Opt Eng 37:247–260CrossRefGoogle Scholar
  11. 11.
    Kim SP, Su W-Y (1993) Recursive high-resolution reconstruction of blurred multiframe images. IEEE Trans Image Process 2:534–539CrossRefGoogle Scholar
  12. 12.
    Lillesand MT, Kiefer WR, Chipman WJ (2000) Remote sensing and image interpretation. 4th edn. John Wiley & Sons, New YorkGoogle Scholar
  13. 13.
    Mateos J, Molina R, Katsaggelos AK (2003) Bayesian high resolution image reconstruction with incomplete multisensor low resolution systems. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing Hong Kong, pp 705–708Google Scholar
  14. 14.
    Mather P (2004) Computer processing of remotely-sensed images: an introduction. 3rd edn. John Wiley & Sons, ChichesterGoogle Scholar
  15. 15.
    Nakazawa Y, Komatsu T, Saito T (1995) High-resolution image acquisition based on temporal integration with hierarchical estimation of image warping. In: Proceedings of IEEE International Conference on Image Processing. Washington, DC, pp 244–247Google Scholar
  16. 16.
    Ron A, Shen ZW (1997) Affine system in L 2(R d): the analysis of the analysis operator. J Funct Anal 148:408–447MathSciNetzbMATHCrossRefGoogle Scholar
  17. 17.
    Schultz RR, Stevenson RL (1996) Extraction of high-resolution frames from video sequences. IEEE Trans Image Process 5:996–1011CrossRefGoogle Scholar
  18. 18.
    Szeliski R (1996) Video mosaics for virtual environments. IEEE Comput Graph Appl 16:22–30CrossRefGoogle Scholar
  19. 19.
    Video clip and full results at∼rchan/paper/cdw
  20. 20.
    Yang Q, Parvin B (2003) High-resolution reconstruction of sparse data from dense low-resolution spatio-temporal data. IEEE Trans Image Process 12:671–677CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  1. 1.Department of MathematicsThe Chinese University of Hong KongShatin, N.T.Hong Kong
  2. 2.Institute of Mathematics and Scientific ComputingUniversity of GrazGrazAustria
  3. 3.Department of Finance and Management ScienceNorwegian School of Economics and Business AdministrationBergenNorway

Personalised recommendations