A new type haptics-based virtual environment system for assembly training of complex products

  • PingJun XiaEmail author
  • António M. Lopes
  • Maria Teresa Restivo
  • YingXue Yao


Virtual reality (VR)-based assembly training has been an interesting topic for the last decades. Generally, there are two shortcomings for nowadays virtual assembly training systems. One is that the operators cannot move around the virtual environment in a natural way as people activity in the real world: they are constrained in a fixed position or can only move in a limited space. The other is that most of the virtual assembly training systems are based on geometry constraint modeling only, which lacks haptics feedback. A new type haptics-based virtual environment system for assembly training of complex products is described in this paper. A new low-cost motion simulator is designed and integrated with the virtual environment to realize free walking by human. An automatic data integration interface is developed to transfer geometry, topology, assembly, and physics information from a computer-aided design system to a VR application, and a hierarchical constraint-based data model is rebuilt to construct the virtual assembly environment. Physics-based modeling and haptics feedback are undertaken to simulate the realistic assembly operations. The application examples and evaluation experiments demonstrate that both motion simulator and haptics have great value for training of assembly processes.


Virtual reality Haptics Assembly training Motion simulator Physics-based modeling 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Li JR, Khoo LP, Tor SB (2003) Desktop virtual reality for maintenance training: an object oriented prototype system (V-REALISM). Comput Ind 52:109–125CrossRefGoogle Scholar
  2. 2.
    Gaoliang P, Haiquin Y, Xinhua L, Yang J, He X (2010) A desktop virtual reality-based integrated system for complex product maintainability design and verification. Assem Autom 30(4):112–122CrossRefGoogle Scholar
  3. 3.
    Kashiwa K, Mitani T, Tezura T, Yoshikawa TH (1995) Development of machine-maintenance training system in virtual environment. Proceedings of the 4th IEEE international workshop on robot and human communication (ROMAN ‘95), Tokyo, Japan, pp. 295–300Google Scholar
  4. 4.
    Holt P, O’B RJM, Day PN et al (2004) Immersive virtual reality in cable and pipe routing: design metaphors and cognitive ergonomics. J Comput Inf Sci Eng 4:161–170CrossRefGoogle Scholar
  5. 5.
    Johnson TC, Vance JM (2001) The use of the Voxmap pointshell method of collision detection in virtual assembly methods planning. Proceedings of the ASME design engineering technical conference, Pittsburgh, PA, pp. 1169–1176Google Scholar
  6. 6.
    Wan H, Gao S, Peng Q, Dai G, Zhang F (2004) MIVAS: a multi-modal immersive virtual assembly system. Proceedings of the ASME Design Engineering Technical Conference, Salt Lake City, UT, pp. 113–122Google Scholar
  7. 7.
    Fernandes KJ, Rajaa VH, Eyreb J (2003) Immersive learning system for manufacturing industries. Comput Ind 51:31–40CrossRefGoogle Scholar
  8. 8.
    Jayaram S, Jayaram U, Wang Y, Tirumali H, Lyons K, Hart P (1999) VADE: a virtual assembly design environment. IEEE Comput Graph Appl 19(6):44–50CrossRefGoogle Scholar
  9. 9.
    Ritchie JM, Dewar RG, Simmons JEL (1999) The generation and practical use of plans for manual assembly using immersive virtual reality. Proc Inst Mech Engr B 213:461–470CrossRefGoogle Scholar
  10. 10.
    Chryssolouris G, Mavrikios D, Fragos D et al (2000) A virtual reality-based experimentation environment for the verification of human-related factors in assembly processes. Robot Comput-Integr Manuf 16:267–276CrossRefGoogle Scholar
  11. 11.
    Shuyou Z, Zhan G, Jianrong T, Zhenyu L (2002) Research of movement navigation based on assembly constraint recognition. Chin J Mech Eng (Engl Ed) 15(3):6–10Google Scholar
  12. 12.
    Marcelino L, Murray N, Fernando T (2003) A constraint manager to support virtual maintainability. Comput Graph 27:19–26CrossRefGoogle Scholar
  13. 13.
    Abate AF, Guida M, Leoncini P, Nappi M, Ricciardi S (2009) A haptics-based approach to virtual training for aerospace industry. J Vis Lang Comput 20:318–325CrossRefGoogle Scholar
  14. 14.
    Bhatti A, Creighton D, Nahavandi S, Khoo YB, Anticev J, Zhou M (2009) Haptically enabled interactivity and immersive virtual assembly. Cooperative Research Centre for Advanced Automotive Technology, Melbourne, pp 1–10Google Scholar
  15. 15.
    Seth A, Su HJ, Vance JM (2006) SHARP: a system for haptic assembly and realistic prototyping. ASME Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Philadelphia, PA, USA, pp. 1045–1053Google Scholar
  16. 16.
    Vo DM, Judy M. Vance, Mervyn G. Marasinghe (2009) Assessment of haptics-based interaction for assembly tasks in virtual reality. Third Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. Salt Lake City, UT, USA, pp. 494–499Google Scholar
  17. 17.
    Iwata H, Fuji T (1996) Virtual Perambulator: a novel interface device for locomotion in virtual environment. Proceedings of VRAIS’96, pp. 60–65Google Scholar
  18. 18.
    Yano H, Noma H, Iwata H (2000) Tsutomu Miyasato: shared walk environment using locomotion interfaces. Proceedings of CSCW 2000:163–170CrossRefGoogle Scholar
  19. 19.
    Iwata H (1999) The Torus Treadmill: realizing locomotion in VEs. IEEE Comput Graph Appl 19(6):30–35CrossRefGoogle Scholar
  20. 20.
    Liu Guohua (2006) Study on human-computer interaction technology for virtual assembly of large-scale complex products. Dissertation, Harbin Institute of Technology, ChinaGoogle Scholar
  21. 21.
    Borst CW, Indugula AP (2006) A spring model for whole-hand virtual grasping. Presence Teleoperators Virtual Environ 15(1):47–61CrossRefGoogle Scholar
  22. 22.
    Yingxue Y, Pingjun X, Jiangsheng L, Jianguang L (2006) A pragmatic system to support interactive assembly planning and training in immersive virtual environment (I-VAPTS). Int J Adv Manuf Technol 30(9):959–967CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  • PingJun Xia
    • 1
    Email author
  • António M. Lopes
    • 1
  • Maria Teresa Restivo
    • 1
  • YingXue Yao
    • 2
  1. 1.IDMEC-Polo FEUPFaculty of Engineering, Porto UniversityPortoPortugal
  2. 2.School of Mechanical and Electrical EngineeringHarbin Institute of TechnologyHarbinChina

Personalised recommendations