Abstract
Super-resolution (SR) for video sequences is a technique to obtain a higher resolution image by fusing multiple low-resolution (LR) frames of the same scene. In a typical super-resolution algorithm, image registration is one of the most affective steps. The difficulty of this step results in the fact that most of the existing SR algorithms can not cope with local motions because they assume global motion. In this paper, we propose a SR algorithm that takes into account inaccurate estimates of the registration parameters and the point spread function. When frames obey the assumed global motion model, these inaccurate estimates, along with the additive Gaussian noise in the low-resolution image sequence, result in different noise level for each frame. However, in case of existence of local motion and/or occlusion, regions that have local motion and/or occlusion have different noise level. To cope with this problem, we propose to adaptively weight each segment according to its reliability. The segments are generated by segmenting the reference frame using watershed segmentation. The experimental results using real video sequences show the effectiveness of the proposed algorithm compared to three state-of-the-art SR algorithms.
Chapter PDF
Similar content being viewed by others
Keywords
References
Bergen, J.R., Anandan, P., Hanna, K.J., Hingorani, R.: Hierarchical model-based motion estimation. In: Sandini, G. (ed.) ECCV 1992. LNCS, vol. 588, pp. 237–252. Springer, Heidelberg (1992)
Lucas, B., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proceedings of the International Joint Conference on Artificial Intelligence (1981)
Elad, M., Hel-Or, Y.: A fast super-resolution reconstruction algorithm for pure transnational motion and common space invariant blur. IEEE Trans. on Image Processing 10(8), 1187–1193 (2001)
Farsiu, S., Robinson, D., Elad, M., Milanfar, P.: Fast and robust multi-frame super-resolution. IEEE Trans. on Image Processing 13(10), 1327–1344 (2004)
Farsiu, S., Robinson, D., Elad, M., Milanfar, P.: Robust shift-and-add approach to super-resolution. In: Proc. of the 2003 SPIE Conf. on Applications of Digital Signal and Image Processing, San Diego, California (August 2003)
Lee, E.S., Kang, M.G.: Regularized adaptive high-resolution image reconstruction considering inaccurate subpixel registration. IEEE Trans. on Image Processing 12(7) (July 2003)
He, H., Kondi, L.P.: An image super-resolution algorithm for different error levels per frame. IEEE Trans. on Image Processing 15(3), 592–603 (2006)
Park, M.K., Kang, M.G., Katsaggelos, A.K.: Regularized Super-Resolution Image Reconstruction Considering Inaccurate Motion Information. SPIE Optical Engineering 46(11), 117004-1–117004-12 (2007)
Trimeche, M., Ciprian Bilcu, R., Yrjanainen, J.: Adaptive outlier rejection in image super-resolution. EURASIP Journal on Applied Signal Processing 2006, Article ID 38052 (2006)
Omer, O.A., Tanaka, T.: Multiframe image and video super-resolution algorithm with inaccurate motion registration errors rejection. In: Proc. of the 2008 SPIE Conf. on Visual Communication and Image Processing, San Jose, California (January 2008)
Ivanovski, Z.A., Panovski, L., Karam, L.J.: Robust super-resolution based on pixel-level selectivity. In: Proceedings of SPIE, vol. 6077 (2006)
Schultz, R.R., Stevenson, R.t.L.: Extraction of high-resolution frames from video sequences. IEEE Trans. on Image Processing 5(6) (June 1996)
Zhao, W.Y., Sawhney, S.: Is super-resolution with optical flow feasible? In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 599–613. Springer, Heidelberg (2002)
Andrew, J., Patti, M.I.: Robust methods for high-quality stills from interlaced video in the presence of dominant motion. IEEE Trans. on Circuits and Systems for Video Technology 7(2) (April 1997)
Choi, B., Ra, J.B.: Region-based super-resolution using multiple blurred and noisy undersampled images. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 2, pp. 609–612 (2006)
Choi, B., Kim, S.D., Ra, J.B.: Region-based super-resolution using adaptive diffusion regularization. Optical Engineering 47(2), 027006 (February 2008)
Qiao, J., Liu, J.: HOS-based image super-resolution reconstruction. In: Sebe, N., Liu, Y., Zhuang, Y.-t., Huang, T.S. (eds.) MCAM 2007. LNCS, vol. 4577, pp. 213–222. Springer, Heidelberg (2007)
van Eekeren, A., Schutte, K., Dijk, J., de Lange, D.J.J., van Vliet, L.J.: Super-resolution on moving objects and background. In: Proc. Int. Conf. Image Processing (ICIP 2006), vol. 2, pp. 2709–2712 (2006)
Hardie, R.C., Barnard, K.J., Bognar, J.G., Armstrong, E., Watson, E.A.: High-resolution image reconstruction from a sequence of rotated and translated frames and its application to an infrared imaging system. Optical Engineering 37(1), 247–260 (1998)
De Smet, P., De Vleschauwer, D.: Performance and scalability of highly optimized rainfalling watershed algorithm. In: Proc. Int. Conf. on Imaging Science, Systems and Technology, CISST 1998, Las Vegas, NV, USA, pp. 266–273 (July 1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Omer, O.A., Tanaka, T. (2009). Region-Based Super Resolution for Video Sequences Considering Registration Error. In: Wada, T., Huang, F., Lin, S. (eds) Advances in Image and Video Technology. PSIVT 2009. Lecture Notes in Computer Science, vol 5414. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92957-4_82
Download citation
DOI: https://doi.org/10.1007/978-3-540-92957-4_82
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92956-7
Online ISBN: 978-3-540-92957-4
eBook Packages: Computer ScienceComputer Science (R0)