International Journal of Computer Vision

, Volume 96, Issue 3, pp 335–352

Efficient Video Rectification and Stabilisation for Cell-Phones

Authors

    • Department of Electrical EngineeringLinköping University
  • Per-Erik Forssén
    • Department of Electrical EngineeringLinköping University
Article

DOI: 10.1007/s11263-011-0465-8

Cite this article as:
Ringaby, E. & Forssén, P. Int J Comput Vis (2012) 96: 335. doi:10.1007/s11263-011-0465-8

Abstract

This article presents a method for rectifying and stabilising video from cell-phones with rolling shutter (RS) cameras. Due to size constraints, cell-phone cameras have constant, or near constant focal length, making them an ideal application for calibrated projective geometry. In contrast to previous RS rectification attempts that model distortions in the image plane, we model the 3D rotation of the camera. We parameterise the camera rotation as a continuous curve, with knots distributed across a short frame interval. Curve parameters are found using non-linear least squares over inter-frame correspondences from a KLT tracker. By smoothing a sequence of reference rotations from the estimated curve, we can at a small extra cost, obtain a high-quality image stabilisation. Using synthetic RS sequences with associated ground-truth, we demonstrate that our rectification improves over two other methods. We also compare our video stabilisation with the methods in iMovie and Deshaker.

Keywords

Cell-phoneRolling shutterCMOSVideo stabilisation

Supplementary material

View video

(MPG 2.76 MB)

View video

(MPG 2.76 MB)

View video

(MPG 2.72 MB)

View video

(MPG 2.77 MB)

View video

(MPG 2.71 MB)

View video

(MPG 2.79 MB)

View video

(MPG 2.76 MB)

View video

(MPG 3.27 MB)

View video

(MPG 3.25 MB)

View video

(MPG 3.24 MB)

View video

(MPG 3.26 MB)

View video

(MPG 3.92 MB)

View video

(MPG 3.50 MB)

View video

(MPG 3.49 MB)

View video

(MPG 3.49 MB)

View video

(MPG 4.18 MB)

View video

(MPG 3.27 MB)

Copyright information

© Springer Science+Business Media, LLC 2011