Assembly validation in virtual reality—a demonstrative case

  • R. D. M. D. Jayasekera
  • X. XuEmail author


Assembly validation is a key part of product design. Current methods, such as physical prototyping are time-consuming and do not offer immediate validation results. Assembly motion simulation systems have been proposed as a solution to this problem. However, widespread adoption of such systems is hindered due to their ties to proprietary computer aided design (CAD) software or expensive and often cumbersome hardware. Recently, virtual/augmented reality (VR/AR) technologies and simulation have been heralded as two of the key enabling factors of Industry 4.0. Collective interests in these technologies by industry and community have brought many low-cost software and hardware tools to the market, which opens a gateway to achieving assembly validation at a much lower cost. This paper presents an assembly validation system that is independent of CAD packages, interoperable and implemented using relatively low-cost and commercially available hardware and software tools. The system features intuitive bare-hand manipulation of part models through a virtual hand model that tracks the hands. Collision detection and physics modelling allow for hand-part and part-part interactions to be natural, thus validating assembly interactions. An assembly feature extraction algorithm has also been implemented to analyse the planar face features of the part models to detect possible mating assembly features between parts concerned. A constraint management system considers identified mating features and determines the allowable motion of parts once constraints are applied and removed. Pulling force is used to facilitate the removal of constraints.


Virtual reality Assembly simulation Assembly validation Feature extraction Industry 4.0 



  1. 1.
    productivity-boostcom Betriebs UG (haftungsbeschraenkt) & Co KG (2017) Non-convex mesh collider., Accessed on 02/14/2018
  2. 2.
    Boonbrahm P, Kaewrat C (2014) Assembly of the virtual model with real hands using augmented reality technology. In: Virtual, augmented and mixed reality. Designing and developing virtual and augmented environments: 6th international conference, VAMR 2014, Held as Part of HCI International 2014, Heraklion, Crete, Greece, June 22-27, 2014, Proceedings, Part I, pp 329– 338Google Scholar
  3. 3.
    Boothroyd GG (2002) Product design for manufacture and assembly, 2nd edn. Manufacturing engineering and materials processing ; 58 M. Dekker, New YorkGoogle Scholar
  4. 4.
    Hormann K, Agathos A (2001) The point in polygon problem for arbitrary polygons. Comput Geom 20 (3):131–144. MathSciNetCrossRefGoogle Scholar
  5. 5.
    ISO (1994) ISO 10303-203:1994: industrial automation systems and integration — product data representation and exchange — Part 203: application protocol: configuration controlled 3D designs of mechanical parts and assemblies. International Organization for Standardization, Geneva.
  6. 6.
    ISO (1994) ISO 10303-21:1994: industrial automation systems and integration — product data representation and exchange — Part 21: implementation methods: clear text encoding of the exchange structure. International Organization for Standardization, Geneva.
  7. 7.
    ISO (1994) ISO 10303-42: industrial automation systems and integration — product data representation and exchange — Part 42: integrated generic resources: geometric and topological representation. International Organization for Standardization, Geneva.
  8. 8.
    Jayaram S, Connacher HI, Lyons KW (1997) Virtual assembly using virtual reality techniques. Comput Aided Des 29(8):575–584. CrossRefGoogle Scholar
  9. 9.
    Jayaram S, Jayaram U, Kim YJ, DeChenne C, Lyons KW, Palmer C, Mitsui T (2007) Industry case studies in the use of immersive virtual assembly. Virtual Real 11(4):217–228. CrossRefGoogle Scholar
  10. 10.
    Leap Motion (2015) Leap motion cable door mount for oculus dk2., Accessed on 02/14/2018
  11. 11.
    Leap Motion (2018) Leap motion unity modules., Accessed on 02/14/2018
  12. 12.
    Liu Z, Tan J (2007) Constrained behavior manipulation for interactive assembly in a virtual environment. Int J Adv Manuf Technol 32(7):797–810. CrossRefGoogle Scholar
  13. 13.
    Marcelino L, Murray N, Fernando T (2003) A constraint manager to support virtual maintainability. Comput Graph 27(1):19–26. CrossRefGoogle Scholar
  14. 14.
    Mok SM, Ong K, Wu CH (2001) Automatic generation of assembly instructions using step. In: Proceedings 2001 ICRA. IEEE International conference on robotics and automation (Cat. No.01CH37164), vol 1, pp 313–318.
  15. 15.
    O’Rourke J (1998) Computational geometry in C, 2nd edn. Cambridge University Press, chap 7.4, p 239Google Scholar
  16. 16.
    Ou LM, Xu X (2013) Relationship matrix based automatic assembly sequence generation from a cad model. Comput Aided Des 45(7):1053–1067. CrossRefGoogle Scholar
  17. 17.
    Pan C, Smith S (2003) Extracting geometrical data from CAD Step files. In: ASME 2003 International design engineering technical conferences and computers and information in engineering conference. American Society of Mechanical Engineers, pp 503–509, DOI, (to appear in print)
  18. 18.
    Rüßmann M, Lorenz M, Gerbert P, Waldner M, Justus J, Engel P, Harnisch M (2015) Industry 4.0: the future of productivity and growth in manufacturing industries. Boston Consulting Group 9Google Scholar
  19. 19.
    Seth A, Su HJ, Vance JM (2006) SHARP: a system for haptic assembly and realistic prototyping. In: ASME 2006 international design engineering technical conferences and computers and information in engineering conference. American Society of Mechanical Engineers, pp 905–912, DOI, (to appear in print)
  20. 20.
    Seth A, Vance JM, Oliver JH (2011) Virtual reality for assembly methods prototyping: a review. Virtual Real 15(1):5–20. CrossRefGoogle Scholar
  21. 21.
    Sunday D (2012) Inclusion of a point in a polygon.
  22. 22.
    Wang QH, Li JR, Gong HQ (2006) A CAD-linked virtual assembly environment. Int J Prod Res 44 (3):467–486. CrossRefGoogle Scholar
  23. 23.
    Wang X, Ong S, Nee A (2015) Real-virtual interaction in AR assembly simulation based on component contact handling strategy. Assem Autom 35(4):376–394. CrossRefGoogle Scholar
  24. 24.
    Wang X, Ong S, Nee A (2016) Real-virtual components interaction for assembly simulation and planning. Robot Comput Integr Manuf 41(Supplement C):102–114. CrossRefGoogle Scholar
  25. 25.
    Wang Z, Shen Y, Ong SK, Nee AYC (2009) Assembly design and evaluation based on bare-hand interaction in an augmented reality environment. In: 2009 International conference on CyberWorlds, pp 21–28.
  26. 26.
    Wang ZB, Ong SK, Nee AYC (2013) Augmented reality aided interactive manual assembly design. Int J Adv Manuf Technol 69(5):1311–1321. CrossRefGoogle Scholar
  27. 27.
    Zhong Y, Shirinzadeh B, Ma W (2005) Solid modelling in a virtual reality environment. Vis Comput 21(1):17–40. CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  1. 1.Laboratory for Industry 4.0 Smart Manufacturing Systems, Department of Mechanical EngineeringUniversity of AucklandAucklandNew Zealand

Personalised recommendations