Skip to main content
SpringerLink
Log in

High-speed real-time augmented reality tracking algorithm model of camera based on mixed feature points

  • Special Issue Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

At this stage of augmented reality, simple feature descriptions are mainly used in camera real-time motion tracking, but this is prone to the problem of unstable camera motion tracking. Aiming at the balance between real-time performance and stability, a new method model of real-time camera motion tracking based on mixed features was proposed. By comprehensively using feature points and feature lines as scene features, feature extraction, optimization, and fusion are used to construct hybrid features, and the hybrid features are unified for real-time camera parameter estimation. An image feature optimization method based on scene structure analysis is proposed to meet the computing constraints of mobile terminals. An iterative feature line-screening method is proposed to calculate a stable feature line set, and based on the scene feature composition and feature geometry, a hybrid feature is adaptively constructed to improve the tracking stability of the camera. Based on improved SIFT feature matching target detection and tracking algorithm, a hybrid feature point detection operator detection algorithm is used to achieve rapid feature point extraction, and the speed of descriptor generation is reduced by reducing the feature descriptor vector dimension. The experimental results prove that the proposed target detection and tracking algorithm has good real-time and robustness, and improves the success rate of target detection and tracking.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Peng, L.I., Yanjiang, W.A.N.G.: Multi-target tracking algorithm based on ORB feature points matching. J. Hunan Univ. 44(10), 139–149 (2017)

    Google Scholar 

  2. Yan, J., Wang, S., Huang, W.: Real-time moving object detection based on regional background modeling under a moving camera. J. Imaging Sci. Technol. 61(4), 358–369 (2017)

    Article  Google Scholar 

  3. Fang, W., Zheng, L., Xiangyong, Wu.: Multi-sensor based real-time 6-DoF pose tracking for wearable augmented reality. Comput. Ind. 92–93, 91–103 (2017)

    Article  Google Scholar 

  4. Wenyi, Z., Decun, D.: Embedded tracking algorithm based on multi-feature crowd fusion and visual object compression. Eurasip J. Embed. Syst. 2016(1), 16–28 (2017)

    Article  Google Scholar 

  5. Koh, H.E., Oh, J., Mackert, M.: Predictors of playing augmented reality mobile games while walking based on the theory of planned behavior: web-based survey. JMIR Mhealth Uhealth 5(12), 191–203 (2017)

    Article  Google Scholar 

  6. Ahn, E., Lee, S., Kim, G.J.: Real-time adjustment of contrast saliency for improved information visibility in mobile augmented reality. Virtual Real. 22(7), 321–334 (2017)

    Google Scholar 

  7. Kim, G.W., Kim, Y.C., Ko, I.J.: High-performance electrochromic optical shutter based on fluoran dye for visibility enhancement of augmented reality display. Adv. Opt. Mater. 6(11), 17013–17028 (2018)

    Google Scholar 

  8. Liou, H.-H., Yang, S.J.H., Chen, S.Y.: The influences of the 2D image-based augmented reality and virtual reality on student learning. Educ. Technol. Soc. 20(3), 110–121 (2017)

    Google Scholar 

  9. Lee, Y.-H., Yin, K., Shin-Tson, Wu.: Reflective polarization volume gratings for high efficiency waveguide-coupling augmented reality displays. Opt. Express 25(22), 27008–27028 (2017)

    Article  Google Scholar 

  10. Lee, J., Yoo, H.N., Lee, B.H.: Effects of augmented reality-based Otago exercise on balance, gait, and physical factors in elderly women to prevent falls: a randomized controlled trial. J. Phys. Therapy Sci. 29(9), 1586–1589 (2017)

    Article  Google Scholar 

  11. Huang, H., Hua, H.: High-performance integral-imaging-based light field augmented reality display using freeform optics. Opt. Express 26(13), 17578–17598 (2018)

    Article  Google Scholar 

  12. Manrique-Juan, C., Grostieta-Dominguez, Z.V.E., Rojas-Ruiz, R.: A portable augmented-reality anatomy learning system using a depth camera in real time. Am. Biol. Teach. 79(3), 176–183 (2017)

    Article  Google Scholar 

  13. Lee, W., Chabot, S., Braasch, J.: Using visual cues to perceptually extract sonified data in collaborative, immersive big-data display systems. J. Acoust. Soc. Am. 141(5), 3896–3896 (2017)

    Article  Google Scholar 

  14. Wei, T., Yuan, L.: Highly real-time blind sidewalk recognition algorithm based on boundary tracking. Guangdian Gongcheng Opto-Electron. Eng. 44(7), 676–684 (2017)

    Google Scholar 

  15. Song, C., Zhang, B., Song, Y.: T–S tracking algorithm based on context auxiliary feature. Guangxue Jingmi Gongcheng Opt. Precis. Eng. 26(8), 2122–2130 (2018)

    Article  Google Scholar 

  16. Zehao, H.E., Xiaomeng, S.U.I., Yan, Z.H.A.O.: The development trend of virtual reality and augmented reality technology based on holographic optics. Sci. Technol. Rev. 36(9), 8–17 (2018)

    Google Scholar 

  17. Doshi, A., Smith, R.T., Thomas, B.H.: Use of projector based augmented reality to improve manual spot-welding precision and accuracy for automotive manufacturing. Int. J. Adv. Manuf. Technol. 89(5–8), 1279–1293 (2017)

    Article  Google Scholar 

  18. Bourdel, N., Collins, T., Pizarro, D.: Augmented reality in gynecologic surgery: evaluation of potential benefits for myomectomy in an experimental uterine model. Surg. Endosc. 31(1), 21–26 (2017)

    Article  Google Scholar 

  19. Pedersen, I., Gale, N., Mirza-Babaei, P.: More than meets the eye: the benefits of augmented reality and holographic displays for digital cultural heritage. J. Comput. Cult. Herit. 10(2), 31–45 (2017)

    Article  Google Scholar 

  20. Chen, L., Tang, W., John, N.W.: Real-time geometry-aware augmented reality in minimally invasive surgery. Healthc. Technol. Lett. 4(5), 163–167 (2017)

    Article  Google Scholar 

  21. Zhou, C., Zhu, M., Shi, Y.: Robot-assisted surgery for mandibular angle split osteotomy using augmented reality: preliminary results on clinical animal experiment. Aesthet. Plast. Surg. 41(3), 1228–1236 (2017)

    Article  Google Scholar 

  22. Tang, R., Ma, L., Xiang, C.: Augmented reality navigation in open surgery for hilar cholangiocarcinoma resection with hemihepatectomy using video-based in situ three-dimensional anatomical modeling: a case report. Medicine 96(37), 8083–8095 (2017)

    Article  Google Scholar 

  23. Noll, C., von Jan, U., Raap, U.: Mobile augmented reality as a feature for self-oriented, blended learning in medicine: randomized controlled trial. JMIR Mhealth Uhealth 5(9), 139–158 (2017)

    Article  Google Scholar 

  24. Führ, G., Jung, C.R.: Camera self-calibration based on nonlinear optimization and applications in surveillance systems. IEEE Trans. Circuits Syst. Video Technol. 27(5), 1132–1142 (2017)

    Article  Google Scholar 

  25. Youm, DongHyun, Seo, SangHyun, Kim, J.-Y.: Design and development methodologies of Kkongalmon, a location-based augmented reality game using mobile geographic information. EURASIP J. Image Video Process. 2019(1), 167–189 (2019)

    Article  Google Scholar 

  26. Rodriguez y Baena, F., Liu, H.: Letter to the Editor on “Augmented reality based navigation for computer assisted hip resurfacing: a proof of concept study.” Ann. Biomed. Eng. 47(11), 221–236 (2019)

    Article  Google Scholar 

  27. Ren, J., He, Y., Huang, G.: An edge-computing based architecture for mobile augmented reality. IEEE Netw. 33(4), 162–169 (2019)

    Article  Google Scholar 

  28. Guoqiang, Z., Zhiping, Z.: Improved augmented reality registration method based on VSLAM. Laser Optoelectron. Prog. 56(6), 61501–61521 (2019)

    Article  Google Scholar 

  29. Brengman, M., Willems, K., Van Kerrebroeck, H.: Can’t touch this: the impact of augmented reality versus touch and non-touch interfaces on perceived ownership. Virtual Real. 1, 211–232 (2018)

    Google Scholar 

  30. Taira, G.M.N., Sementille, A.C., Sanches, S.R.R.: Influence of the camera viewpoint on augmented reality interaction. IEEE Latin Am. Trans. 16(1), 260–264 (2018)

    Article  Google Scholar 

  31. Lamberti, F., Pescador, F.: Advanced interaction and virtual\/augmented reality: making interaction with machines more natural and effective. IEEE Consum. Electron. Mag. 7(2), 62–63 (2018)

    Article  Google Scholar 

  32. Soomro, S.R., Ulusoy, E., Urey, H.: Decoupling of real and digital content in projection-based augmented reality systems using time multiplexed image capture. J. Imaging Sci. Technol. 61(1), 10406–10401 (2017)

    Article  Google Scholar 

  33. Lin, Y., Yang, J., Lv, Z., et al.: A self-assessment stereo capture model applicable to the internet of things. Sensors 15(8), 20925–20944 (2015)

    Article  Google Scholar 

  34. Li, J., Feng, G., Wei, W., et al.: PSOTrack: A RFID-based system for random moving objects tracking in unconstrained indoor environment. IEEE Int. Things J. 5(6), 4632–4641 (2018)

    Article  Google Scholar 

  35. Wei, W., Guizani, M., Ahmed, S.H., et al.: Guest editorial: special section on integration of big data and artificial intelligence for internet of things. IEEE Trans. Ind. Inf. 16(4), 2562–2565 (2020)

    Article  Google Scholar 

  36. Wang, W., Xia, F., Nie, H., et al.: Vehicle trajectory clustering based on dynamic representation learning of internet of vehicles. IEEE Trans. Intell. Transp. Syst. (2020). https://doi.org/10.1109/TITS.2020.2995856

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Literature and Journalism, Hunan University of Technology and Business, Changsha, 410205, China

    Wei Sun

  2. School of Cinema and Television, Sichuan University of Media and Communications, Chengdu, 611745, Sichuan, China

    Chengcheng Mo

Authors
  1. Wei Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chengcheng Mo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chengcheng Mo.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, W., Mo, C. High-speed real-time augmented reality tracking algorithm model of camera based on mixed feature points. J Real-Time Image Proc 18, 249–259 (2021). https://doi.org/10.1007/s11554-020-01032-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-020-01032-4

Keywords

Search

Navigation