A Super-Resolution Imaging Method Based on Dense Subpixel-Accurate Motion Fields
A super-resolution imaging method suitable for imaging objects moving in a dynamic scene is described. The primary operations are performed over three threads: the computation of a dense inter-frame 2-D motion field induced by the moving objects at a sub-pixel resolution in the first thread. Concurrently, each video image frame is enlarged by the cascode of an ideal low-pass filter and a higher rate sampler, essentially stretching each image onto a larger grid. Then, the main task is to synthesize a higher resolution image from the stretched image of the first frame and that of the subsequent frames subject to a suitable motion compensation. A simple averaging process and/or a simplified Kalman filter may be used to minimize the spatio-temporal noise, in the aggregation process. The method is simple and can take advantage of common MPEG-4 encoding tools. A few experimental cases are presented with a basic description of the key operations performed in the over all process.
KeywordsSuper-resolution motion compensation optical flow
Unable to display preview. Download preview PDF.
- 1.R.Y. Tsai and T.S. Huang, “Multiframe Image Restoration and Registration,” in Advances in Computer Vision and Image Processing, R.Y. Tsai and T.S. Huang (Eds.), vol. 1, 1984, JAI Press Inc. pp. 317–339.Google Scholar
- 3.A.M. Tekalp, M.K. Ozkan, and M.I. Sezan, “High Resolution Image Reconstruction from Low Resolution Image Sequences, and Space Varying Image Restoration,” in Proceedings of the IEEE Conference on Acoustics, Speech, and Signal Processing, San Francisco, CA, vol. 3, 1992, pp. 169–172.Google Scholar
- 15.S. Guha, “An Optimal Mesh Computer Algorithm for Constrained Delaunay Triangulation,” in Proceedings of the International Parallel Processing Symposium, Cancun, Mexico, 1994, pp. 102–109.Google Scholar
- 18.B.D. Lucas and T. Kanade, “An Iterative Image Registration Technique with an Application to Stereo Vision,” in Proceedings of the DARPA Image Understanding Workshop, 1981, pp. 121–130.Google Scholar