Skip to main content

Adaptive Grasping and Adjusting Method of Virtual Hand Gestures with Semantics Information for Virtual Assembly

  • Conference paper
  • First Online:
Proceedings of the 23rd International Conference on Industrial Engineering and Engineering Management 2016

Abstract

To improve the grasping efficiency and posture fidelity of virtual hands in virtual assembly processes, a novel adaptive grasping and adjusting method is presented. The attributes and information of assembly parts and assembly gesture of virtual hands are described completely with semantic description models in advance. Basic gestures model base and gestures knowledge base are established to facilitate the generation of hand gestures. According to the spatial relationship between a part and a virtual hand and the semantic description model of the part, the transitions from initial gesture to basic gesture can be calculated. Grasping rules are defined and used to adaptively obtain the final gesture and grasping position of virtual hand. Based on the constraints dynamic-solving algorithm and reasoning of semantic information, the virtual hand is adjusted to the appropriate grasping posture automatically. The validity of this method is verified by the virtual assembly of a reducer.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. L. Figueiredo, R. D. Anjos, J. Lindoso, “Bare hand natural interaction with augmented objects”, IEEE International Symposium on Mixed & Augmented Reality, Adelaide, SA, 2013.

    Google Scholar 

  2. M. Prachyabrued, C. W. Borst, “Virtual grasp release method and evaluation”, Int. J. Human-Computer Studies, vol. 70, no. 11, pp. 828–848, 2012.

    Google Scholar 

  3. M. Prachyabrued, C. W. Borst, “Effects and optimization of visual-proprioceptive discrepancy reduction for virtual grasping”, IEEE Symposium on 3D User Interfaces, Orlando, FL, pp. 11–14, 2013.

    Google Scholar 

  4. S. Li, Y. Liu, N. D. Wang, “Research on multi-finger grasping in virtual environment” (in Chinese). Journal of Computer-Aided Design&Computer Graphics, vol.22, no. 10, pp. 1728–1733, 2010.

    Google Scholar 

  5. S. Li, J. Liang, G. Liu, “Combining analytical inverse kinematics with example postures to generate virtual human whole body reaching postures”, IEEE Asia Simulation Conference-7th International Conference on System Simulation and Scientific Computing, Beijing, pp. 45–52, 2008.

    Google Scholar 

  6. J. S. Kim, J. M. Park, “Physics-based hand interaction with virtual objects” IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, pp. 3814–3819, 2015.

    Google Scholar 

  7. S. L. Li, J. H. Liang, B. Wu, “Survey of virtual character motion generation and control”, (in Chinese), Journal of System Simulation, vol. 23, no. 29. pp. 1758–1771, 2011.

    Google Scholar 

  8. M. Billinghurst, T. Piumsomboon, H. Bai, “Hands in Space: Gesture Interaction with Augmented-Reality Interfaces”, IEEE Computer Graphics & Applications, vol. 34, no. 1, pp. 3814–3819, 2014.

    Google Scholar 

  9. X. J. CAI, C. CHENG, A. Marwah, “Research on Behavior Simulation of Virtual Hand in Virtual Manufacturing Environment” (in Chinese), Journal of Computer-Aided Design & Computer Graphics, vol. 27, no.3, pp. 499–507, 2015.

    Google Scholar 

  10. H, LIU, X. X. LI, “Design and Implementation of Virtual Human Grasp Motion in Jack” (in Chinese), Computer Engineering, vol. 33, no. 3, pp. 213–217, 2007.

    Google Scholar 

  11. Z. X. Xia, H. M. Zhu, D. L. Wu, “Reasoning method based on semantics for virtual assembly operation”, (in Chinese) Computer Integrated Manufacturing Systems, vol. 15, no. 8, pp. 1606–1613, 2009.

    Google Scholar 

  12. R. D. Yang, X. M. Fan, D. L. Wu, “Virtual Assembly Technologies Based on Constraint and Dof Analysis”, Robotics and Computer-integrated Manufacturing, vol. 23, no. 4, pp. 447–456, 2007.

    Google Scholar 

  13. H. M. Zhu, D. L. Wu, X. M. Fan, “Assembly Semantics Modeling for Assembling Process Planning in Virtual Environment”, Assembly Automation, vol.30 , no.3, pp. 257–267, 2010.

    Google Scholar 

  14. S. G. Qiu, X. M. Fan, D. L. Wu, “Virtual human modeling for interactive assembly and disassembly operation in virtual reality environment”,International Journal of Advanced Manufacturing Technology,vol.69, no.9, pp. 2355–2372, 2013.

    Google Scholar 

  15. L. Tian, X. M. Fan, K. Y. Liu, “Semantic Modeling and Reasoning Method for Dynamic Generation of Assembly Relationship”, (in Chinese), Journal of System Simulation, vol.26 , no.9, pp. 1901–1906, 2014.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiu-min FAN .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Atlantis Press and the author(s)

About this paper

Cite this paper

ZHU, Wm., FAN, Xm., WU, Zh. (2017). Adaptive Grasping and Adjusting Method of Virtual Hand Gestures with Semantics Information for Virtual Assembly. In: Qi, E., Shen, J., Dou, R. (eds) Proceedings of the 23rd International Conference on Industrial Engineering and Engineering Management 2016. Atlantis Press, Paris. https://doi.org/10.2991/978-94-6239-255-7_11

Download citation

  • DOI: https://doi.org/10.2991/978-94-6239-255-7_11

  • Published:

  • Publisher Name: Atlantis Press, Paris

  • Print ISBN: 978-94-6239-254-0

  • Online ISBN: 978-94-6239-255-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics