Skip to main content

A comprehensive survey of augmented reality assembly research

Abstract

In the past two decades, augmented reality (AR) has received a growing amount of attention by researchers in the manufacturing technology community, because AR can be applied to address a wide range of problems throughout the assembly phase in the lifecycle of a product, e.g., planning, design, ergonomics assessment, operation guidance and training. However, to the best of authors’ knowledge, there has not been any comprehensive review of AR-based assembly systems. This paper aims to provide a concise overview of the technical features, characteristics and broad range of applications of AR-based assembly systems published between 1990 and 2015. Among these selected articles, two thirds of them were published between 2005 and 2015, and they are considered as recent pertinent works which will be discussed in detail. In addition, the current limitation factors and future trends in the development will also be discussed.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

References

  1. Whitney DE (2004) Mechanical assemblies: their design, manufacture, and role in product development. Oxford University Press, Oxford

    Google Scholar 

  2. Zhou F, Duh H-L, Billinghurst M (2008) Trends in augmented reality tracking, interaction and display: a review of ten years of ISMAR. Proceedings of the 7th IEEE international symposium on mixed and augmented reality (ISMAR 2008), Cambridge, pp 193–202

  3. Sielhorst T, Feuerstein M, Navab N (2008) Advanced medical displays: a literature review of augmented reality. J Disp Technol 4(4):451–467

    Article  Google Scholar 

  4. Henderson SJ, Feiner SK (2011) Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Trans Vis Comput Graph 17(10):1355–1368

    Article  Google Scholar 

  5. Ridel B, Reuter P, Laviole J et al (2014) The revealing flashlight: interactive spatial augmented reality for detail exploration of cultural heritage artifacts. J Comput Cult Herit 7(2):1–18

    Article  Google Scholar 

  6. Bower M, Howe C, McCredie N et al (2014) Augmented reality in education-cases, places and potentials. Educ Media Int 51(1):1–15

    Article  Google Scholar 

  7. Google Glass. http://www.google.com/glass/start/. Accessed 10 July 2015)

  8. Nee AYC, Ong SK, Chryssolouris G et al (2012) Augmented reality applications in design and manufacturing. CIRP Annal Manuf Technol 61(2):657–679

    Article  Google Scholar 

  9. Ong SK, Yuan ML, Nee AYC (2008) Augmented reality applications in manufacturing: a survey. Int J Prod Res 46(10):2707–2742

    Article  MATH  Google Scholar 

  10. Fite-Georgel P (2011) Is there a reality in industrial augmented reality? In: Proceedings of the 10th IEEE international symposium on mixed and augmented reality (ISMAR 2011), Basel, pp 201–210

  11. Leu MC, ElMaraghy HA, Nee AYC et al (2013) CAD model based virtual assembly simulation, planning and training. CIRP Annal Manuf Technol 62(2):799–822

    Article  Google Scholar 

  12. Boothroyd G, Dewhurst P, Knight WA (2011) Product design for manufacture and assembly. CRC Press, Boca Raton

    Google Scholar 

  13. Seth A, Vance JM, Oliver JH (2011) Virtual reality for assembly methods prototyping: a review. Virtual Reality 15(1):5–20

    Article  Google Scholar 

  14. Cruz-Neira C, Sandin DJ, DeFanti TA et al (1992) The CAVE: audio visual experience automatic virtual environment. Commun ACM 35(6):64–72

    Article  Google Scholar 

  15. Cruz-Neira C, Sandin DJ, DeFanti TA (1993) Surround-screen projection-based virtual reality: the design and implementation of the CAVE. Proceedings of the 20th annual conference on computer graphics and interactive techniques, Anaheim, California, pp 135–142

  16. Kuehne R, Oliver J (1995) A virtual environment for interactive assembly planning and evaluation. Proceedings of ASME design automation conference

  17. Pere E, Langrana N, Gomez D et al (1996) Virtual mechanical assembly on a PC-based system. Proceedings of ASME design engineering technical conferences and computers and information in engineering conference, Irvine, pp 18–22

  18. Jayaram S, Connacher HI, Lyons KW (1997) Virtual assembly using virtual reality techniques. Computer Aided Design 29(8):575–584

    Article  Google Scholar 

  19. Jayaram S, Jayaram U, Wang Y et al (1999) VADE: a virtual assembly design environment. Comput Graph Appl 19(6):44–50

    Article  Google Scholar 

  20. Jayaram S, Jayaram U, Wang Y et al (2000) CORBA-based collaboration in a virtual assembly design environment. Proceedings of ASME design engineering technical conferences and computers and information in engineering conference

  21. Jayaram U, Tirumali H, Jayaram S (2000) A tool/part/human interaction model for assembly in virtual environments. Proceedings of ASME design engineering technical conferences

  22. Taylor F, Jayaram S, Jayaram U (2000) Functionality to facilitate assembly of heavy machines in a virtual environment. Proceedings of ASME design engineering technical conferences

  23. Coutee AS, McDermott SD, Bras B (2001) A haptic assembly and disassembly simulation environment and associated computational load optimization techniques. J Comput Inform Sci Eng 1(2):113–122

    Article  Google Scholar 

  24. Coutee AS, Bras B (2002) Collision detection for virtual objects in a haptic assembly and disassembly simulation environment. ASME design engineering technical conferences and computers and information in engineering conference, Montreal, pp 11–20

  25. Seth A, Su HJ, Vance JM (2005) A desktop networked haptic VR interface for mechanical assembly. ASME 2005 International mechanical engineering congress & exposition, Orlando, pp 173–180

  26. Seth A, Su HJ, Vance JM (2006) SHARP: a system for haptic assembly & realistic prototyping. ASME 2006 international design engineering technical conferences and computers and information in engineering conference in Philadelphia, Pennsylvania, pp 905–912

  27. Graphics Processing Unit (GPU). http://www.nvidia.com. Accessed 10 July 2015

  28. Caudell TP, Mizell DW (1992) Augmented reality: an application of heads-up display technology to manual manufacturing processes. Proceedings of the 25th Hawaii international conference on system sciences, Hawaii, pp 659–669

  29. Sims D (1994) New realities in aircraft design and manufacture. Comput Graph Appl 14(2):91

    Article  Google Scholar 

  30. Mizell D (2001) Boeing’s wire bundle assembly project. In: Barfield W, Caudell T (eds) Fundamentals of wearable computers and augmented reality. CRC Press, Mahwah, pp 447–467

    Google Scholar 

  31. Feiner S, Macintyre B, Seligmann D (1993) Knowledge-based augmented reality. Commun ACM 36(7):53–62

    Article  Google Scholar 

  32. Webster A, Feiner S, Maclntyre B et al (1996) Augmented reality in architectural construction, inspection and renovation. In: Proceedings of ASCE 3rd congress on computing in civil engineering, Anaheim, pp 913–919

  33. Curtis D, Mizell D, Gruenbaum P et al (1998) Several devils in the details: making an AR application work in the airplane factory. In: Proceedings of the International Workshop Augmented Reality in San Francisco, California, pp 47–60

  34. Schwald B, Figue J, Chauvineau E et al (2001) STARMATE: using augmented reality technology for computer guided maintenance of complex mechanical elements. In: Stanford-Smith B, Chiozza E (eds) E-work and e-commerce-novel solutions and practices for a global networked economy. IOS Press, Amsterdam, pp 196–202

    Google Scholar 

  35. Syberfeldt A, Danielsson O, Holm M et al (2015) Visual assembling guidance using augmented reality. In: International manufacturing research conference 2015, Charlotte, pp 1–12

  36. Molineros J, Sharma R (2001) Computer vision for guiding manual assembly. In: Proceedings of the 2001 IEEE international symposium on assembly and task planning (ISATP 2001), Fukuoka, pp 362–368

  37. Schwald B, Laval BD (2003) An augmented reality system for training and assistance to maintenance in the industrial context. In: International conference in central Europe on computer graphics, visualization and computer vision (WSCG), Plzen, pp 425–432

  38. Regenbrecht H, Baratoff G, Wilke W (2005) Augmented reality projects in the automotive and aerospace industries. IEEE Comput Graph Appl 25(6):48–56

    Article  Google Scholar 

  39. Saaski J, Salonen T, Hakkarainen M et al (2008) Integration of design and assembly using augmented reality. In: Ratchev S, Koelemeijer S (eds) Micro-assembly technologies and applications. Springer, London, pp 395–404

    Chapter  Google Scholar 

  40. Salonen T, Saaski J (2008) Dynamic and visual assembly instruction for configurable products using augmented reality techniques. In: Yan XT, Jiang C, Eynard B (eds) Advanced design and manufacture to gain a competitive edge. Springer, London, pp 23–32

    Chapter  Google Scholar 

  41. Salonen T, Saaski J, Hakkarainen M et al (2007) Demonstration of assembly work using augmented reality. In: Proceedings of the 6th ACM international conference on image and video retrieval (CIVR 2007), Amsterdam, pp 120–123

  42. Salonen T, Saaski J, Woodward C (2009) Data pipeline from CAD to AR based assembly instructions. In: Proceedings of the ASME-AFM 2009 world conference of innovative virtual reality (WINVR09), Mediapole, pp 165–168

  43. Tumkor S, Aziz ES, Esche SK et al (2013) Integration of augmented reality into the CAD process. In: Proceedings of the ASEE annual conference and exposition, Atlanta

  44. Makris S, Pintzos G, Rentzos L et al (2013) Assembly support using AR technology based on automatic sequence generation. CIRP Annal Manuf Technol 62(1):9–12

    Article  Google Scholar 

  45. Sanna A, Manuri F, Lamberti F et al (2015) Using handheld devices to support augmented reality based maintenance and assembly tasks. In: 2015 IEEE international conference on consumer electronics (ICCE), Berlin, pp 178–179

  46. Kollatsch C, Schumann M, Klimant P et al (2014) Mobile augmented reality based monitoring of assembly lines. Procedia CIRP 23:246–251

    Article  Google Scholar 

  47. Yuan ML, Ong SK, Nee AYC (2008) Augmented reality for assembly guidance using a virtual interactive tool. Int J Prod Res 46(7):1745–1767

    Article  MATH  Google Scholar 

  48. Sukan M, Elvezio C, Oda O et al (2014) ParaFrustum: visualization techniques for guiding a user to a constrained set of viewing positions and orientations. In: Proceedings of the 27th annual ACM symposium on user interface software and technology, Honolulu, pp 331–340

  49. Posada J, Toro C, Barandiaran I et al (2015) Visual computing as a key enabling technology for industry 4.0 and industrial internet. IEEE Comput Graph Appl 35(2):26–40

    Article  Google Scholar 

  50. Zhang J, Ong SK, Nee AYC (2011) RFID-assisted assembly guidance system in an augmented reality environment. Int J Prod Res 49(13):3919–3938

    Article  Google Scholar 

  51. Henderson SJ, Feiner SK (2011) Augmented reality in the psychomotor phase of a procedural task. In: Proceedings of the 10th IEEE international symposium on mixed and augmented reality (ISMAR 2011), Basel, pp 191–200

  52. Neumann U, Majoros A (1998) Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance. In: Proceedings of IEEE virtual reality (VR 1998), San Francisco, pp 4–11

  53. Andersen M, Andersen R, Larsen C et al (2009) Interactive assembly guide using augmented reality. In: Proceedings of the 5th international symposium on advances in visual computing: Part I, Las Vegas, pp 999–1008

  54. Khuong BM, Kiyokawa K, Miller A et al (2014) The effectiveness of an AR-based context-aware assembly support system in object assembly. In: Proceedings of IEEE virtual reality, Minneapolis, pp 57–62

  55. Friedrich W (2002) ARVIKA augmented reality for development, production, and service. In: Proceedings of the 1st IEEE international symposium on mixed and augmented reality (ISMAR 2002), Darmstadt, pp 3–4

  56. Rentzos L, Papanastasiou S, Papakostas N et al (2013) Augmented reality for human-based assembly: using product and process semantics. In: Analysis, design and evaluation of human-machine systems, Las Vegas, pp 98–101

  57. Zhu Z, Branzoi V, Wolverton M et al (2014) AR-Mentor: augmented reality based mentoring system. In: Proceedings of the 13rd IEEE international symposium on mixed and augmented reality (ISMAR 2014), Munich, pp 17–22

  58. Radkowski R, Oliver J (2013) Natural feature tracking augmented reality for on-site assembly assistance systems. In: Shumaker R (ed) Virtual, augmented and mixed reality, systems and applications. Springer, Berlin, pp 281–290

    Chapter  Google Scholar 

  59. Lowe DG (1999) Object recognition from local scale-invariant features. In: Proceedings of the 1999 international conference on computer vision, Kerkyra, pp 1150–1157

  60. Chen CJ, Hong J, Wang SF (2015) Automated positioning of 3D virtual scene in AR-based assembly and disassembly guiding system. Int J Adv Manuf Technol 76(5–8):753–764

    Article  Google Scholar 

  61. Damen D, Gee A, Mayol-Cuevas W et al (2012) Egocentric real-time workspace monitoring using a rgb-d camera. In: 2012 IEEE/RSJ international conference on intelligent robots and systems (IROS), Vilamoura, pp 1029–1036

  62. Vignais N, Miezal M, Bleser G et al (2013) Innovative system for real-time ergonomic feedback in industrial manufacturing. Appl Ergon 44(4):566–574

    Article  Google Scholar 

  63. Haringer M, Regenbrecht H (2002) A pragmatic approach to augmented reality authoring. In: Proceedings of IEEE 1st international symposium on mixed and augmented reality (ISMAR 2002), Darmstadt, pp 237–245

  64. Zauner J, Haller M, Brandl A et al (2003) Authoring of a mixed reality assembly instructor for hierarchical structures. In: Proceedings of the 2nd IEEE international symposium on mixed and augmented reality (ISMAR 2003), Tokyo, pp 237–246

  65. Servan J, Mas F, Menendez JL et al (2012) Using augmented reality in AIRBUS A400M shop floor assembly work instructions. In: The 4th manufacturing engineering society international conference, Cadiz, pp 633–640

  66. Petersen N, Stricker D (2012) Learning task structure from video examples for workflow tracking and authoring. In: Proceedings of the 11th IEEE international symposium on mixed and augmented reality (ISMAR 2012), Atlanta, pp 237–246

  67. Mura K, Petersen N, Huff M et al (2013) IBES: a tool for creating instructions based on event segmentation. Front Psychol 4:1–14

    Article  Google Scholar 

  68. Petersen N, Pagani A, Stricker D (2013) Real-time modeling and tracking manual workflows from first-person vision. In: Proceedings of the 12th IEEE international symposium on mixed and augmented reality (ISMAR 2013), Adelaide, pp 117–124

  69. Bhattacharva B, Winer E (2015) A method for real-time generation of augmented reality work instructions via expert movements. IS&T/SPIE Electronic Imaging: 93920G-1-93920G-13

  70. Mohr P, Kerbl B, Donoser M et al (2015) Retargeting technical documentation to augmented reality. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems, Seoul, pp 3337–3346

  71. Hou L, Wang X (2013) A study on the benefits of augmented reality in retaining working memory in assembly tasks: a focus on differences in gender. Autom Constr 32:38–45

    Article  Google Scholar 

  72. Odenthal B, Mayer MP, Kabub W et al (2014) A comparative study of head-mounted and table-mounted augmented vision systems for assembly error detection. Hum Fact Ergon Manuf Serv Ind 24(1):105–123

    Article  Google Scholar 

  73. Hou L, Wang X, Truijens M (2013) Using augmented reality to facilitate piping assembly: an experiment-based evaluation. J Comput Civil Eng 29(1):05014007

    Article  Google Scholar 

  74. Baird KM, Barfield W (1999) Evaluating the effectiveness of augmented reality displays for a manual assembly task. Virtual Reality 4(4):250–259

    Article  Google Scholar 

  75. Tang A, Owen C, Biocca F et al (2003) Comparative effectiveness of augmented reality in object assembly. In: Proceedings of the SIGCHI conference on Human factors in computing systems (CHI 03), Fort Lauderdale, pp 73–80

  76. Wiedenmaier S, Oehme O, Schmidt L et al (2003) Augmented reality (AR) for assembly processes design and experimental evaluation. Int J Hum Comput Interact 16(3):497–514

    Article  Google Scholar 

  77. Odenthal B, Mayer MP, Kabub W et al (2011) An empirical study of disassembling using an augmented vision system. In: Proceedings of the 3rd international conference on digital human modeling (ICDHM’11), Orlando, pp 399–408

  78. Boud AC, Haniff DJ, Baber C et al (1999) Virtual reality and augmented reality as a training tool for assembly tasks. In: Proceedings of 1999 IEEE international conference on information visualization, London, pp 32–36

  79. Rios H, Hincapie M, Caponio A et al (2011) Augmented reality: an advantageous option for complex training and maintenance operations in aeronautic related processes. In: Proceedings of 2011 international conference on virtual and mixed reality—Part 1, Orlando, pp 87–96

  80. Suarez-Warden F, Cervantes-Gloria Y, Gonzalez-Mendivil E (2011) Sample size estimation for statistical comparative test of training by using augmented reality via theoretical formula and OCC graphs: aeronautical case of a component assemblage. In: Proceedings of 2011 international conference on virtual and mixed reality-systems and applications—Part II, Orlando, pp 80–89

  81. Gavish N, Gutierrez T, Webel S et al (2013) Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks. Interact Learn Environ. doi:10.1080/10494820.2013.815221

    Google Scholar 

  82. Radkowski R, Herrema J, Oliver J (2015) Augmented reality-based manual assembly support with visual features for different degrees of difficulty. Int J Hum Comput Interact 31(5):337–349

    Article  Google Scholar 

  83. Henderson SJ, Feiner SK (2009) Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret. In: Proceedings of the 8th IEEE international symposium on mixed and augmented reality (ISMAR 2009), Orlando, pp 135–144

  84. Gattullo M, Uva AE, Fiorentino M et al (2015) Legibility in industrial AR: text style, color coding, and illuminance. IEEE Comput Graph Appl 35(2):52–61

    Article  Google Scholar 

  85. Hou L, Wang X (2011) Experimental framework for evaluating cognitive workload of using AR system for general assembly task. In: Proceedings of the 28th international symposium on automation and robotics in construction, Seoul, pp 625–630

  86. Hou L, Wang X, Bernold L et al (2013) Using animated augmented reality to cognitively guide assembly. J Comput Civil Eng 27(5):439–451

    Article  Google Scholar 

  87. Stork S, Schubo A (2010) Human cognition in manual assembly: theories and applications. Adv Eng Inform 24(3):320–328

    Article  Google Scholar 

  88. Reiners D, Stricker D, Klinker G et al (1998) Augmented reality for construction tasks: door lock assembly. In: Proceedings of the 1st international workshop on augmented reality (IWAR98), San Francisco, pp 31–46

  89. Boulanger P (2004) Application of augmented reality to industrial teletraining. In: Proceedings of the 1st Canadian conference on computer and robot vision, Ontario, pp 320–328

  90. Horejsi P (2015) Augmented reality system for virtual training of parts assembly. Proc Eng 100:699–706

    Article  Google Scholar 

  91. Simon V, Baglee D, Garfield S et al (2014) The development of an advanced maintenance training programme utilizing augmented reality. In: Proceedings of the 27th international congress of condition monitoring and diagnostic engineering, Brisbane

  92. Peniche A, Treffetz H, Diaz C et al (2012) Combining virtual and augmented reality to improve the mechanical assembly training process in manufacturing. In: Proceedings of the 2012 American conference on applied mathematics, pp 292–297

  93. Fiorentino M, Uva AE, Gattullo M et al (2014) Augmented reality on large screen for interactive maintenance instructions. Comput Ind 65(2):270–278

    Article  Google Scholar 

  94. Liu Y, Li SQ, Wang JF et al (2015) A computer vision-based assistant system for the assembly of narrow cabin products. Int J Adv Manuf Technol 76(1–4):281–293

    MathSciNet  Article  Google Scholar 

  95. Raczynski A, Gussmann P (2004) Services and training through augmented reality. In: The 1st European conference on visual media production (CVMP 2004), pp 263–271

  96. Gorecky D, Worgan SF, Meixner G (2011) COGNITO:a cognitive assistance and training system for manual tasks in industry. In: Proceedings of the 29th annual European conference on cognitive ergonomics, Rostock, pp 53–56

  97. Matsas E, Vosniakos GC (2015) Design of a virtual reality training system for human-robot collaboration in manufacturing tasks. Int J Interact Desig Manuf. doi:10.1007/s12008-015-0259-2

    Google Scholar 

  98. Pathomaree N, Charoenseang S (2005) Augmented reality for skill transfer in assembly task. In: 2005 IEEE international workshop on robot and human interactive communication in Nashville, Tennessee, pp 500–504

  99. Kreft S, Gausemeier J, Matysczok C (2009) Towards wearable augmented reality in automotive assembly training. In: ASME international design engineering technical conferences and computers and information in engineering conference, San Diego, pp 1537–1547

  100. Charoenseang S, Panjan S (2011) 5-finger exoskeleton for assembly training in augmented reality. In: Shumaker R (ed) Virtual and mixed reality-new trends. Springer, Berlin, pp 30–39

    Chapter  Google Scholar 

  101. Re GM, Bordegoni M (2014) An augmented reality framework for supporting and monitoring operators during maintenance tasks. In: Shumaker R, Lackey S (eds) Virtual, augmented and mixed reality applications of virtual and augmented reality. Springer, Berlin, pp 443–454

    Google Scholar 

  102. Kruger J, Nguyen TD (2015) Automated vision-based live ergonomics analysis in assembly operations. CIRP Annal Manuf Technol 64(1):9–12

    Article  Google Scholar 

  103. Webel S, Bockholt U, Engelke T et al (2013) An augmented reality training platform for assembly and maintenance skills. Robot Autonom Syst 61(4):398–403

    Article  Google Scholar 

  104. Westerfield G, Mitrovic A, Billinghurst M (2013) Intelligent augmented reality training for assembly tasks. In: Lane HC, Yacef K, Mostow J et al (eds) Artificial intelligence in education. Springer, Berlin, pp 542–551

    Chapter  Google Scholar 

  105. Westerfield G, Mitrovic A, Billinghurst M (2015) Intelligent augmented reality training for motherboard assembly. Int J Artificial Intell Educ 25(1):157–172

    Article  Google Scholar 

  106. Chimienti V, Iliano S, Dassisti M et al (2010) Guidelines for implementing augmented reality procedures in assisting assembly operations. In: Ratchev S (ed) Precision assembly technologies and systems. Springer, Berlin, pp 174–179

    Chapter  Google Scholar 

  107. Webel S, Bockholt U, Engelke T et al (2011) Design recommendations for augmented reality based training of maintenance skills. In: Alem L, Huang WD (eds) Recent trends of mobile collaborative augmented reality systems. Springer, New York, pp 69–82

    Chapter  Google Scholar 

  108. Webel S, Bockholt U, Keil J (2011) Design criteria for AR-based training of maintenance and assembly tasks. In: Proceedings of the 2011 international conference on virtual and mixed reality: new trends - volume part 1, Orlando, pp 123–132

  109. Gavish N, Gutierrez T, Webel S et al (2011) Design guidelines for the development of virtual reality and augmented reality training systems for maintenance and assembly tasks. In: BIO web of conferences, 00029

  110. Billinghurst M, Hakkarainen M, Woodward C (2008) Augmented assembly using a mobile phone. In: Proceedings of the 7th international conference on mobile and ubiquitous multimedia, Umea, pp 84–87

  111. Wu CL, Wang H (2011) A multi-modal augmented reality based virtual assembly system. In: Proceedings of the 6th international conference on embedded and multimedia computing, Enshi, pp 65–72

  112. Marcinčin JN, Barna J, Janak M et al (2011) Utilization of open source tools in assembling process with application of elements of augmented reality. In: Proceedings of the 10th international conference on virtual reality continuum and its applications in industry, Hong Kong, pp 427–430

  113. Marcinčin JN, Barna J, Torok J (2014) Precision assembly process with augmented reality technology support. Key Eng Mater 581:106–111

    Article  Google Scholar 

  114. Woll R, Damerau T, Wrasse K et al (2011) Augmented reality in a serious game for manual assembly processes. In: IEEE international symposium on mixed and augmented reality: arts, media, and humanities (ISMAR-AMH11), Basel, pp 37–39

  115. Wang X, Kotranza A, Quarles J et al (2005) A pipeline for rapidly incorporating real objects into a mixed environment. In: Proceedings of the 4th IEEE international symposium on mixed and augmented reality (ISMAR 2005), Vienna, pp 170–173

  116. Wang YT, Shen Y, Liu D et al (2010) Key technique of assembly system in an augmented reality environment. In: The 2nd international conference on computer modeling and simulation, Sanya, pp 133–137

  117. Velaz Y, Arce JR, Gutierrez T et al (2014) The influence of interaction technology on the learning of assembly tasks using virtual reality. J Comput Inform Sci Eng 14(4):041007

    Article  Google Scholar 

  118. Theis S, Mertens A, Wille M et al (2015) Effects of data glasses on human workload and performance during assembly and disassembly tasks. In: Proceedings of the 19th triennial congress of the IEA, Melbourne, pp 1–8

  119. Valentini PP (2009) Interactive virtual assembling in augmented reality. Int J Interact Desig Manuf 3(2):109–119

    Article  Google Scholar 

  120. Wei W, Chen G (2010) Research on interaction in virtual assembly based on augmented reality. In: The 2nd international conference on computer engineering and technology, Chengdu, pp 341–345

  121. Lee H, Billinghurst M, Woo W (2011) Two-handed tangible interaction techniques for composing augmented blocks. Virtual Reality 15(2–3):133–146

    Article  Google Scholar 

  122. He HW, Wu YM, Zheng DT et al (2010) Computer vision-based augmented reality system for assembly interaction. Appl Mech Mater 37:263–269

    Article  Google Scholar 

  123. Boonbrahm P, Kaewrat C (2014) Assembly of the virtual model with real hands using augmented reality technology. In: Shumaker R, Lackey S (eds) Virtual, augmented and mixed reality, designing and developing virtual and augmented environments. Springer International Publishing, Cham, pp 329–338

    Google Scholar 

  124. Arroyave-Tobon S, Osorio-Gomez G, Cardona-McCormick JF (2015) AIR-MODELLING: a tool for gesture-based solid modeling in context during early design stages in AR environments. Comput Ind 66:73–81

    Article  Google Scholar 

  125. Radkowski R, Stritzke C (2012) Interactive hand gesture-based assembly for augmented reality applications. In: The 5th international conference on advances in computer-human interactions, Valencia, pp 303–308

  126. Ong SK, Wang ZB (2011) Augmented assembly technologies based on 3D bare-hand interaction. CIRP Annal Manuf Technol 60(1):1–4

    Article  Google Scholar 

  127. Wang ZB, Shen Y, Ong SK et al (2009) Assembly design and evaluation based on bare-hand interaction in an augmented reality environment. In: 2009 international conference on cyberworlds (CW), Bradford, pp 21–28

  128. Wang ZB, Ong SK, Nee AYC (2013) Augmented reality aided interactive assembly design. Int J Adv Manuf Technol 69(5–8):1311–1321

    Article  Google Scholar 

  129. Piumsomboon T, Clark A, Billinghurst M et al (2013) User-defined gestures for augmented reality. In: Kotze P, Marsden G, Lindgaard G et al (eds) Human-computer interaction-INTERACT 2013. Springer, Berlin, pp 282–299

    Chapter  Google Scholar 

  130. Raghavan V, Molineros J, Sharma R (1999) Interactive evaluation of assembly sequences using augmented reality. IEEE Trans Robot Autom 15(3):435–449

    Article  Google Scholar 

  131. Liverani A, Amati G, Caligiana G (2004) A CAD-augmented reality integrated environment for assembly sequence check and interactive validation. Concurr Eng 12(1):67–77

    Article  Google Scholar 

  132. Pan W, Wang Y, Du P (2014) Automatic disassembly navigation for accurate virtual assembly path planning. Assem Autom 34(3):244–254

    Article  Google Scholar 

  133. Reinhart G, Patron C (2003) Integrating augmented reality in the assembly domain fundamentals, benefits and applications. CIRP Annal Manuf Technol 52(1):5–8

    Article  Google Scholar 

  134. Zhang FQ, Zhao L, Liang XH et al (2010) The augmented reality research progress in collaboration environment of CAR-CA. In: Proceedings of the 9th ACM SIGGRAPH conference on virtual reality continuum and its applications in industry, Seoul, pp 229–236

  135. Ong SK, Pang Y, Nee AYC (2007) Augmented reality aided assembly design and planning. CIRP Annal Manuf Technol 56(1):49–52

    Article  Google Scholar 

  136. Pang Y, Nee AYC, Ong SK et al (2006) Assembly feature design in an augmented reality environment. Assembl Autom 26(1):34–43

    Article  Google Scholar 

  137. Fiorentino M, Monno G, Uva AE (2009) Tangible digital master for product lifecycle management in augmented reality. Int J Interact Desig Manuf 3(2):121–129

    Article  Google Scholar 

  138. Fiorentino M, Monno G, Uva AE (2010) Tangible interfaces for augmented engineering data management. In: Maad S (ed) Augmented reality. Tech Open Access Publisher, Taipei, pp 113–128

    Google Scholar 

  139. Fiorentino M, Uva AE, Monno G (2012) Augmented technical drawings: a novel technique for natural interactive visualization of computer-aided design models. J Comput Inform Sci Eng 12(2):024503

    Article  Google Scholar 

  140. Fiorentino M, Radkowski R, Stritzke C et al (2013) Design review of CAD assemblies using bimanual natural interface. Int J Interact Desig Manuf 7(4):249–260

    Article  Google Scholar 

  141. Wang ZB, Ng LX, Ong SK et al (2013) Assembly planning and evaluation in an augmented reality environment. Int J Prod Res 51(23–24):7388–7404

    Article  Google Scholar 

  142. Ng LX, Wang ZB, Ong SK et al (2013) Integrated product design and assembly planning in an augmented reality environment. Assembl Autom 33(4):345–359

    Article  Google Scholar 

  143. Wang X, Ong SK, Nee AYC (2014) Augmented reality interfaces for industrial assembly design and planning. In: Proceedings of the 8th international conference on interfaces and human computer interaction, Lisbon, pp 83–90

  144. Engelke T, Keil J, Rojtberg P et al (2013) Content first: a concept for industrial augmented reality maintenance applications using mobile devices. In: Proceedings of the 12th IEEE international symposium on mixed and augmented reality (ISMAR 2013), Adelaide, pp. 251–252

  145. Tan W, Liu H, Dong Z et al (2013) Robust monocular SLAM in dynamic environments. In: Proceedings of the 12th IEEE international symposium on mixed and augmented reality (ISMAR 2013), Adelaide, pp 209–218

  146. Alvarez H, Aguinaga I, Borro D (2011) Providing guidance for maintenance operations using automatic markerless augmented reality system. In: Proceedings of the 10th IEEE international symposium on mixed and augmented reality (ISMAR 2011), Basel, pp 181–190

  147. Yang X, Cheng KT (2012) LDB: an ultra-fast feature for scalable augmented reality on mobile devices. In: Proceedings of the 11th IEEE international symposium on mixed and augmented reality (ISMAR 2012), Atlanta, pp 49–57

  148. Calonder M, Lepetit V, Strecha C et al (2010) BRIEF: binary robust independent elementary features. In: Proceedings of 11th European conference of computer vision (ECCV), Crete, pp 778–792

  149. Petit A, Marchand E, Kanani K (2013) Augmenting markerless complex 3D objects by combining geometrical and color edge information. In: Proceedings of the 12th IEEE international symposium on mixed and augmented reality (ISMAR 2013), Adelaide, pp 287–288

  150. Dong S, Kamat VR (2010) Robust mobile computing framework for visualization of simulated processes in augmented reality. In: Proceedings of the 2010 winter simulation conference (WSC 2010), Baltimore, pp 3111–3122

  151. Zheng F, Schubert R, Welch G (2012) A general approach for closed-loop registration in AR. In: Proceedings of the 11th IEEE international symposium on mixed and augmented reality (ISMAR 2012), Atlanta, pp 335–336

  152. Yang J, Dai Y, Li H et al (2013) Single-shot extrinsic calibration of a generically configured RGB-D camera rig from scene constraints. In: Proceedings of the 12th IEEE international symposium on mixed and augmented reality (ISMAR 2013), Adelaide, pp 181–188

  153. Waegel K, Brooks FP (2013) Filling the gaps: hybrid vision and inertial tracking. In: Proceedings of the 12th IEEE international symposium on mixed and augmented reality (ISMAR 2013), Adelaide, pp 1–4

  154. Szalavári Z, Schmalstieg D, Fuhrmann A et al (1998) Studierstube: an environment for collaboration in augmented reality. Virtual Reality 3(1):37–48

    Article  Google Scholar 

  155. Billinghurst M, Weghorst S, Furness T (1998) Shared space: an augmented reality approach: for computer supported collaborative work. Virtual Real 3(1):25–36

    Article  Google Scholar 

  156. Shen Y, Ong SK, Nee AYC (2008) AR-assisted product information visualization in collaborative design. Comput Aided Des 40(9):963–974

    Article  Google Scholar 

  157. Ong SK, Shen Y (2009) A mixed reality environment for collaborative product design and development. CIRP Annal Manuf Technol 58(1):139–142

    Article  Google Scholar 

  158. Oda O, Feiner S (2012) 3D referencing techniques for physical objects in shared augmented reality. In: Proceedings of the 11th IEEE international symposium on mixed and augmented reality (ISMAR 2012), Atlanta, pp 207–215

  159. Ranatunga D, Adcock M, Feng D et al (2013) Towards object based manipulation in remote guidance. In: Proceedings of the 12th international symposium on mixed and augmented reality (ISMAR 2013), Adelaide, pp 1–6

  160. Newcombe RA, Izadi S, Hilliges O et al (2011) KinectFusion: real-time dense surface mapping and tracking. In: Proceedings of the 10th IEEE international symposium on mixed and augmented reality (ISMAR 2011), Basel, pp 127–136

  161. Jancosek M, Pajdla T (2011) Multi-view reconstruction preserving weakly-supported surfaces. In: Proceedings of 2011 IEEE conference of computer vision and pattern recognition, Colorado, pp 3121–3128

  162. Dou M, Fuchs H, Frahm JM (2013) Scanning and tracking dynamic objects with commodity depth cameras. In: Proceedings of the 12th IEEE international symposium on mixed and augmented reality (ISMAR 2013), Adelaide, pp 99–106

  163. Zhong Y, Qin Y, Huang M et al (2013) Automatically generating assembly tolerance types with an ontology-based approach. Comput Aided Des 45(11):1253–1275

    Article  Google Scholar 

  164. Gorti S, Gupta A, Kim G et al (1998) An object-oriented representation for product and design processes. Comput Aided Des 30(7):489–501

    Article  MATH  Google Scholar 

  165. Rachuri S, Baysal M, Roy U et al (2005) Information models for product representation: core and assembly models. Int J Prod Dev 2(3):207–235

    Article  Google Scholar 

  166. Lee JY, Rhee G (2008) Context-aware 3D visualization and collaboration services for ubiquitous cars using augmented reality. Int J Adv Manuf Technol 37(5–6):431–442

    Article  Google Scholar 

  167. Zhu J, Ong SK, Nee AYC (2013) An authorable context-aware augmented reality system to assist the maintenance technicians. Int J Adv Manuf Technol 66(9–12):1699–1714

    Google Scholar 

  168. Chandrasegaran SK, Ramani K, Sriram RD et al (2013) The evolution, challenges, and future of knowledge representation in product design systems. Comput Aided Des 45(2):204–228

    Article  Google Scholar 

  169. Hervas R, Bravo J, Fontecha J (2014) An assistive navigation system based on augmented reality and context awareness for people with mild cognitive impairments. J Biomed Health Inform 18(1):368–374

    Article  Google Scholar 

  170. Schaumloffel P, Talha M, Gorecky D et al (2011) Augmented reality applications for future manufacturing. In: International conference on manufacturing science and education (MSE-11), pp 2–5

  171. Hakkarainen M, Woodward C, Billinghurst M (2008) Augmented assembly using a mobile phone. In: Proceedings of the 7th IEEE international symposium on mixed and augmented reality (ISMAR 2008), Cambridge, pp 167–168

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to A. Y. C. Nee.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Wang, X., Ong, S.K. & Nee, A.Y.C. A comprehensive survey of augmented reality assembly research. Adv. Manuf. 4, 1–22 (2016). https://doi.org/10.1007/s40436-015-0131-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40436-015-0131-4

Keywords

  • Augmented reality (AR)
  • Assembly process
  • Assembly guidance
  • Assembly systems