A Novel Fast Full Frame Video Stabilization via Three-Layer Model

  • Wei Long
  • Jie Yang
  • Dacheng Song
  • Xiaogang Chen
  • Xiangjian He
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8935)


Video stabilization is an important video enhancement technology which aims at removing undesired shaking from input videos. A challenging task in stabilization is to inpaint the missing pixels of undefined areas in the motion-compensated frames. This paper describes a new video stabilization method. It adopts a multi-layer model to improve the efficiency of the video stabilization. The undefined areas can be inpainted in real-time. Compared with traditional methods, our proposed algorithm only need maintain a single updated mosaic image for video completion, while previous methods require to store all neighboring frames and then registered with the current frame. The experimental results demonstrated the effectiveness of the proposed approach.


Video stabilization motion compensation video completion global motion estimation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ratakonda, K.: Real-time digital video stabilization for multi-media applications. In: IEEE Proceedings of the 1998 IEEE International Symposium on Circuits and Systems, vol. 4, pp. 69–72 (1998)Google Scholar
  2. 2.
    Censi, A., Fusiello, A., Roberto, V.: Image stabilization by features tracking. In: IEEE Proceedings of the 9th International Conference on Image Analysis and Processing, Venice, Italy, pp. 665–667 (September 1999)Google Scholar
  3. 3.
    Kurz, C., Thormahlen, T., Seidel, H.: scene-aware video stabilization by visual fixation. In: IEEE Conference for Visual Media Production, CVMP 2009, pp. 1–6 (2009)Google Scholar
  4. 4.
    Lee, K., Chuang, Y., Chen, B.Y., Ouhyoung, M.: Video Stabilization using Robust Feature Trajectories. In: IEEE 12th International Conference on Computer Vision, ICCV 2009, pp. 1397–1404 (2009)Google Scholar
  5. 5.
    Matsushita, Y., Ofek, E., Tang, X., Shum, H.: Full-frame Video Stabilization. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, pp. 50–57 (2005)Google Scholar
  6. 6.
    Hu, R., Shi, R., Shen, F., Chen, W.: Video Stabilization Using Scale-Invariant Features. In: IEEE Proceedings of 11th International Conference on Information Visualization, IV 2007, pp. 871–877 (2007)Google Scholar
  7. 7.
    Tico, M., Vehvilainen, M.: Constraint motion filtering for video stabilization. In: IEEE International Conference on Image Processing, pp. 569–576 (2005)Google Scholar
  8. 8.
    Marcenaro, L., Vernazza, G., Regazzoni, C.: Image stabilization algorithms for video-surveillance applications. In: IEEE Proc. of International Conference on Image Processing, ICIP 2001, vol. 1, pp. 349–352 (2001)Google Scholar
  9. 9.
    Litvin, A., Konrad, J., Karl, W.: Probabilistic Video Stabilization using Kalman Filtering and Mosaicking. International Society for Optics and Photonics: Electronic Imaging 5022, 663–674 (2003)Google Scholar
  10. 10.
    Bombini, L., Cerri, P., Grisleri, P., Scaffardi, S., Zani, P.: An evaluation of monocular image stabilization algorithms for automotive applications. In: IEEE Intelligent Transporta-tion Systems Conference, ITSC 2006, pp. 1562–1567 (2006)Google Scholar
  11. 11.
    Broggi, A., Grisleri, P., Graf, T., Meinecke, M.: A software video stabilization system for automotive oriented applications. In: IEEE 61st Vehicular Technology Conference, VTC 2005, pp. 2760–2764 (2005)Google Scholar
  12. 12.
    Xu, L., Lin, X.: Digital image stabilization based on circular block matching. IEEE Transactions on Consumer Electronics, 566–574 (2006)Google Scholar
  13. 13.
    Chang, H., Lai, S., Lu, K.: A robust real-time video stabilization algorithm. Journal of Visual Communication and Image Representation 17, 659–673 (2006)CrossRefGoogle Scholar
  14. 14.
    Niskanen, M., Silven, O., Tico, M.: Video Stabilization Performance Assessment. In: IEEE International Conference on Multimedia and Expo, ICME 2006, pp. 405–408 (2006)Google Scholar
  15. 15.
    Zhang, G., Hua, W., Qin, X., Shao, Y., Bao, H.: Video stabilization based on a 3D perspec-tive camera model. J. The Visual Computer Visual Computer 25, 997–1008 (2009)CrossRefGoogle Scholar
  16. 16.
    Kwon, O., Shin, J., Paik, J.: Video Stabilization Using Kalman Filter and Phase Correlation Matching. Image Analysis and Recognition, 141–148 (2005)Google Scholar
  17. 17.
    Bhat, P., Zitnick, C., Snavely, N., Agarwala, A., Agrawala, M., Cohen, M., Curless, B., Kang, S.: Using photographs to enhance videos of a static scene. In: Proceedings of the 18th Eurographics conference on Rendering Techniques, pp. 327–338 (2007)Google Scholar
  18. 18.
    Buehler, C., Bosse, M., McMillan, L.: Non-metric image based rendering for video stabilization. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, pp. 609–614 (2001)Google Scholar
  19. 19.
    Fitzgibbon, A., Wexler, Y., Zisserman, A.: Image-based rendering using image-based priors. International Journal of Computer Vision 63, 141–151 (2005)CrossRefGoogle Scholar
  20. 20.
    Liu, F., Gleicher, M., Jin, H., Agarwala, A.: Contentpreserving warps for 3d video stabi-lization. ACM Transactions on Graphics 28, Article: 44 (2009)Google Scholar
  21. 21.
    Liu, F., Gleicher, M., Wang, J., Jin, H., Agarwala, A.: Subspace video stabilization. ACM Transactions on Graphics 30(1), 4 (2011)CrossRefGoogle Scholar
  22. 22.
    Zhou, Z., Jin, H., Ma, Y.: Plane-Based Content Preserving Warps for Video Stabilization. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2013, pp. 2299–2306 (2013)Google Scholar
  23. 23.
    Yan, W., Kankanhalli, M.: Detection and removal of lighting & shaking artifacts in home videos. In: Proceedings of the Tenth ACM International Conference on Multimedia, pp. 107–116 (2002)Google Scholar
  24. 24.
    Song, D., Chen, X., Yang, J.: Real-time full frame video stabilization. In: Proceeding of the International conference on Applied Informatics and Communication, ICAIC 2012 (2012)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Wei Long
    • 1
  • Jie Yang
    • 1
  • Dacheng Song
    • 1
  • Xiaogang Chen
    • 2
  • Xiangjian He
    • 3
  1. 1.Institute of Image Processing and Pattern RecognitionShanghai Jiao Tong UniversityShanghaiChina
  2. 2.University of Shanghai for Science and TechnologyShanghaiChina
  3. 3.School of Computing and CommunicationsUniversity of TechnologySydneyAustralia

Personalised recommendations