Skip to main content
Log in

Fingertip interactive tracking registration method for AR assembly system

  • Review Article
  • Published:
Advances in Computational Intelligence Aims and scope Submit manuscript

Abstract

Aiming at the problems of single input mode and lack of naturalness in the assembly process of existing AR systems, a tracking registration method of mobile AR assembly system is proposed based on multi-quantity and multi-degree of freedom natural fingertip interaction. Firstly, the real-time and stable tracking of hand area in complex environment is realized based on the hand region tracking; secondly, the fingertip detection and recognition based on K-COS and parallel vector is used to improve the precision and stability of fingertip recognition; thirdly, the special movement track of fingertip is recognized based on improved DTW algorithm, which has strong compatibility and feature gradient transformation for complex fingertip trajectory recognition; finally, through the real-time transformation of projection relationship between fingertip and virtual object, the interaction between fingertip and virtual object is made more natural and realistic. The experimental results show that in the complex environment of background, illumination, scale and rotation, the precision of fingertip detection and recognition is about 93%, and the precision of fingertip motion template matching is about 91%. The translation error of the registration method based on visual feature recognition is reduced by about 100pix compared with fingertip tracking registration method, and the efficiency of mobile AR-guided assembly method is improved by about 24.77% compared with the traditional manual assisted assembly method. These data verifies the strong interaction and practicability of the fingertips based on the user's multi-quantity and multi-degree of freedom features in the process of mobile AR guided assembly.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23

Similar content being viewed by others

References

Download references

Acknowledgements

This work was financially supported by the National Natural Science Foundation of China (62067006), The Ministry of education of Humanities and Social Science project(21YJC880085), Gansu Province Science and technology plan project (20JR10RA250,21JR7RA713,21YF5FA009), Gansu University Innovation Fund Project (2021B-092), Project supported by the Young Scholars Science Foundation of Lanzhou Jiaotong University (2021006), Open fund project of Key Laboratory of four power BIM engineering and intelligent application railway industry(BIMKF-2021-05), and China University industry university research innovation fund.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yong Jiu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiu, Y., Jianguo, W., Yangping, W. et al. Fingertip interactive tracking registration method for AR assembly system. Adv. in Comp. Int. 2, 19 (2022). https://doi.org/10.1007/s43674-021-00025-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s43674-021-00025-5

Keywords

Navigation