Skip to main content
SpringerLink
Log in

Feature-based real-time video stabilization for vehicle video recorder system

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents a fast and effective method based on features to obtain real-time video stabilization for vehicle video recorder system. The corresponding feature points are first obtained from two consecutive frames and then optical flows are calculated based on these points. Next, the obtained optical flows are mapped to polar coordinates to obtain clusters and remove incorrect optical flows. These obtained clusters are used to evaluate the global motion and rotation angle. Finally, the obtained global motion and rotation angle are smoothed and then compensated to obtain the stabilized video. Experimental results show that the proposed method has good performance for video stabilization.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

References

  1. Aguilar WG, Angulo C (2014) Real-time video stabilization without phantom movements for micro aerial vehicles. EURASIP Journal on Image and Video Processing 2014:46. doi:10.1186/1687-5281-2014-46

  2. Buehler C, Bosse M, Mcmillan L (2001) Non-metric image-based rendering for video stabilization. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p 609–614. doi:10.1109/CVPR.2001.991019

  3. Choi W, Pantofaru C, Savarese S (2013) A general framework for tracking multiple people from a moving camera. IEEE Trans Pattern Anal Mach Intell 35(7):1577–1591

    Article  Google Scholar 

  4. Duda RO, Hart PE (1972) Use of the Hough transformation to detect lines and curves in pictures. Commun ACM 15(1):11–15

    Article  MATH  Google Scholar 

  5. Ester M, Kriegel HP, Sander J, Xu X (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96), Portland, Oregon, p 226–231

  6. Ghosh A, Subudhi BN, Ghosh S (2012) Object detection from videos captured by moving camera by fuzzy edge incorporated Markov random field and local histogram matching. IEEE Trans Circuits Syst Video Technol 22(8):1127–1135

    Article  Google Scholar 

  7. Hu W, Tan T, Wang L, Maybank S (2004) A survey on visual surveillance of object motion and behavior. IEEE Trans Sys Man Cybern—Part C: Appl Rev 34(3):334–352

    Article  Google Scholar 

  8. Hu W-C, Yang C-Y, Huang D-Y (2011) Robust real-time ship detection and tracking for visual surveillance of cage aquaculture. J Vis Commun Image Represent 22(6):543–556

    Article  Google Scholar 

  9. Hu W-C, Chen C-H, Chen C-M, Chen T-Y (2014) Effective moving object detection from videos captured by a moving camera. In: Proceedings of the First Euro-China Conference on Intelligent Data Analysis and Applications 1:343–353

  10. Hu W-C, Chen C-H, Chen T-Y, Huang D-Y, Wu Z-C (2015) Moving object detection and tracking from video captured by moving camera. J Vis Commun Image Represent 30:164–180

    Article  Google Scholar 

  11. Huang D-Y, Chen C-H, Hu W-C, Yi S-C, Lin Y-F (2012) Feature-based vehicle flow analysis and counting for a real-time traffic surveillance system. Journal of Information Hiding and Multimedia Signal Processing 3(3):282–296

    Google Scholar 

  12. Jia C, Evans B (2014) Constrained 3D rotation smoothing via global manifold regression for video stabilization. IEEE Trans Signal Process 62(13):3293–3304

    Article  MathSciNet  Google Scholar 

  13. Kalman RE (1960) A new approach to linear filtering and prediction problems. Transactions of the ASME-Journal of Basic Engineering 82:35–45

    Article  Google Scholar 

  14. Kim SK, Kang SJ, Wang TS, Ko SJ (2013) Feature point classification based global motion estimation for video stabilization. IEEE Trans Consum Electron 59(1):267–272

    Article  Google Scholar 

  15. Lee T-H, Lee Y-G, Song B-C (2014) Fast 3D video stabilization using ROI-based warping. J Vis Commun Image Represent 25(5):943–950

    Article  Google Scholar 

  16. Liu F, Gleicher M, Jin H, Agarwala A (2009) Content-preserving warps for 3D video stabilization. ACM Trans Graph 28(3):44:1–44:9

    Google Scholar 

  17. Liu F, Gleicher M, Wang J, Jin H, Agarwala A (2011) Subspace video stabilization. ACM Trans Graph 30(1):4:1–4:10

    Article  Google Scholar 

  18. Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  19. Lucas BD, Kanade T (1981) An iterative image registration technique with an application to stereo vision. In: Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI), Vancouver, British Columbia, p 674–679

  20. Marcenaro L, Vernazza G, Regazzoni CS (2001) Image stabilization algorithm for video-surveillance applications. In: Proceedings of the International Conference on Image Processing, 1, p 349–352

  21. Matsushita Y, Ofek E, Ge W, Tang X, Shum H (2006) Full-frame video stabilization with motion inpainting. IEEE Trans Pattern Anal Mach Intell 28(7):1150–1163

    Article  Google Scholar 

  22. Nicolescu M, Medioni G (2005) A voting-based computational framework for visual motion analysis and interpretation. IEEE Trans Pattern Anal Mach Intell 27(5):739–758

    Article  Google Scholar 

  23. Shen Y, Guturu P, Damarla T, Buckles BP, Namuduri KR (2009) Video stabilization using principal component analysis and scale invariant feature transform in particle filter framework. IEEE Trans Consum Electron 55(3):1714–1721

    Article  Google Scholar 

  24. Shi J, Tomasi C (1994) Good features to track. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). EEE Computer Society, Los Alamitos, p 593–600

  25. Wang Y-S, Liu F, Hsu P-S, Lee T-Y (2013) Spatially and temporally optimized video stabilization. IEEE Trans Vis Comput Graph 19(1):1354–1361

    Article  Google Scholar 

  26. Xu J, Chang H-W, Yang S, Wang M (2012) Fast feature-based video stabilization without accumulative global motion estimation. IEEE Trans Consum Electron 58(3):993–999

    Article  Google Scholar 

  27. Yeh C-H, Lin C-Y, Muchtar K, Knag L-W (2014) Real-time background modeling based on a multi-level texture description. Inf Sci 269:106–127

    Article  MathSciNet  Google Scholar 

  28. Zhang G, Hua W, Qin X, Shao Y, Bao H (2009) Video stabilization based on a 3D perspective camera model. Vis Comput 25(11):997–1008

    Article  Google Scholar 

  29. Zhou X, Yang C, Yu W (2014) Moving object detection by detecting contiguous outliers in the low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(3):597–610

    Article  Google Scholar 

Download references

Acknowledgements

This work was partly supported by the Ministry of Science and Technology, Taiwan, under grants MOST105-2221-E-346-009 and MOST104-2221-E-151-008. The authors would like to thank Mr. Jhih-Bin Guo for his help with the experiments. The authors also gratefully acknowledge the helpful comments and suggestions of reviewers, which have improved the quality and presentation.

Author information

Authors and Affiliations

  1. Department of Computer Science and Information Engineering, National Penghu University of Science and Technology, Penghu, Taiwan, Republic of China

    Wu-Chih Hu

  2. Department of Electronic Engineering, National Kaohsiung University of Applied Sciences, Kaohsiung, Taiwan, Republic of China

    Chao-Ho Chen & Tzu-Hsing Chang

  3. Department of Computer Science and Information Engineering, Shu-Te University, Kaohsiung, Taiwan, Republic of China

    Yi-Jen Su

Authors
  1. Wu-Chih Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chao-Ho Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yi-Jen Su
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tzu-Hsing Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chao-Ho Chen.

Additional information

Highlights

•The proposed video stabilization method is aimed at real-time processing and acceptable stabilization result.

•The proposed method has good performance for video stabilization without additional sensors.

•The polar coordinate mapping is used to reduce a lot of computations to achieve real-time stabilization.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hu, WC., Chen, CH., Su, YJ. et al. Feature-based real-time video stabilization for vehicle video recorder system. Multimed Tools Appl 77, 5107–5127 (2018). https://doi.org/10.1007/s11042-017-4369-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4369-7

Keywords

Search

Navigation