Skip to main content

Advertisement

SpringerLink
Log in

An interactive extended reality-based tutorial system for fundamental manual metal arc welding training

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

Extended reality (XR) technology has been proven an effective human–computer interaction tool to increase the perception of presence. The purpose of this study is to develop an interactive XR-based welding tutorial system to enhance the learning and hands-on skills of novice welders. This study is comprised of two parts: (1) fundamental manual metal arc welding (MMAW) science and technology tutoring in a virtual reality (VR)-based environment, and (2) hands-on welding training in a mixed reality (MR)-based environment. Using the developed tutorial system, complicated welding process and the effects of welding process parameters on weld bead geometry can be clearly observed and comprehended by using a 3D interactive user interface. Visual aids and quantitative guidance are displayed in real time to guide novice welders through the correct welding procedure and help them to maintain a proper welding position. A user study was conducted to evaluate the learnability, workload, and usability of the system. Results show that users obtained significantly better performance by using the XR-based welding tutorial system, compared to those who were trained using the conventional classroom training method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  • Ahmed AN, Noor CM, Allawi MF, El-Shafie A (2018) RBF-NN-based model for prediction of weld bead geometry in shielded metal arc welding (SMAW). Neural Comput Appl 29:889–899

    Article  Google Scholar 

  • Andrews C, Southworth MK, Silva JN, Silva JR (2019) Extended reality in medical practice. Curr Treat Options Cardiovasc Med 21:1–12

    Article  Google Scholar 

  • Arvanitis TN, Petrou A, Knight JF, Savas S, Sotiriou S, Gargalakos M, Gialouri E (2009) Human factors and qualitative pedagogical evaluation of a mobile augmented reality system for science education used by learners with physical disabilities. Pers Ubiquit Comput 13:243–250

    Article  Google Scholar 

  • Boob AN, Gattani G (2013) Study on effect of manual metal arc welding process parameters on width of heat affected zone (HAZ) for Ms 1005 steel. Int J Mod Eng Res 3:1493–1500

    Google Scholar 

  • Brooke J (1996) Usability evaluation in industry. CRC Press, London

    Google Scholar 

  • Byrd A, Anderson R, Stone R (2015) The use of virtual welding simulators to evaluate experienced welders. Weld J 94:389

    Google Scholar 

  • Cardoso OIH, Kus A, Unver E, Aslan R, Dawood M, Kofoglu M, Ivanov V (2019) A design-based approach to enhancing technical drawing skills in design and engineering education using VR and AR tools. In: 14th international joint conference on computer vision, imaging and computer graphics theory and applications, pp.306-313. Science and Technology Publications, Lda

  • Clark J (1985) Manual metal arc weld modelling: part 1 Effect of process parameters on dimensions of weld bead and heat-affected zone. Mater Sci Technol 1:1069–1080

    Article  Google Scholar 

  • Cohen J (1988) Statistical power analysis for the behavioral sciences. Routledge, London

    MATH  Google Scholar 

  • Derisma D (2020) The usability analysis online learning site for supporting computer programming course using system usability scale (SUS) in a university. Int J Interact Mob Technol 14:14

    Article  Google Scholar 

  • Di Natale AF, Repetto C, Riva G, Villani D (2020) Immersive virtual reality in K-12 and higher education: a 10-year systematic review of empirical research. Br J Edu Technol 51:2006–2033

    Article  Google Scholar 

  • Doolani S, Wessels C, Kanal V, Sevastopoulos C, Jaiswal A, Nambiappan H, Makedon F (2020) A review of extended reality (XR) technologies for manufacturing training. Technologies 8:77

    Article  Google Scholar 

  • Ejaz A, Ali SA, Ejaz MY, Siddiqui FA (2019) Graphic user interface design principles for designing augmented reality applications. Int J Adv Comput Sci Appl (IJACSA) 10:209–216

    Google Scholar 

  • Eyres DJ, Bruce GJ (2012) Ship construction. Butterworth-Heinemann, Oxford

    Google Scholar 

  • Feier AI, Banciu FV (2021) Ergonomic aspects of real and virtual welding tools. ACTA Technica Napocensis, Ser Appl Math Mech Eng 64:117–126

    Google Scholar 

  • Gonzalez-Franco M, Pizarro R, Cermeron J, Li K, Thorn J, Hutabarat W, Tiwari A, Bermell-Garcia P (2017) Immersive mixed reality for manufacturing training. Front Rob AI 4:3

    Google Scholar 

  • Hart SG (2006) Nasa-task load index (NASA-TLX); 20 years later. Proc Hum Fact Ergon Soc Ann Meet 50:904–908

    Google Scholar 

  • Heirman J, Selleri S, De Vleeschauwer T, Hamesse C, Bellemans M, Schoofs E, Haelterman R (2020) Exploring the possibilities of extended reality in the world of firefighting. In: 2020 IEEE international conference on artificial intelligence and virtual reality (AIVR), pp.266–273

  • Hietanen A, Pieters R, Lanz M, Latokartano J, Kämäräinen J-K (2020) AR-based interaction for human-robot collaborative manufacturing. Rob Comput Integr Manuf 63:101891

    Article  Google Scholar 

  • Huang T-K, Yang C-H, Hsieh Y-H, Wang J-C, Hung C-C (2018) Augmented reality (AR) and virtual reality (VR) applied in dentistry. Kaohsiung J Med Sci 34:243–248

    Article  Google Scholar 

  • Jeffus L (2020) Welding: principles and applications. Cengage Learning, Boston

    Google Scholar 

  • Kaplan AD, Cruit J, Endsley M, Beers SM, Sawyer BD, Hancock P (2021) The effects of virtual reality, augmented reality, and mixed reality as training enhancement methods: a meta-analysis. Hum Factors 63:706–726

    Article  Google Scholar 

  • Karadeniz E, Ozsarac U, Yildiz C (2007) The effect of process parameters on penetration in gas metal arc welding processes. Mater Des 28:649–656

    Article  Google Scholar 

  • Kuo C-Y, Huang C-C, Tsai C-H, Shi Y-S, Smith S (2021) Development of an immersive SLAM-based VR system for teleoperation of a mobile manipulator in an unknown environment. Comput Ind 132:103502

    Article  Google Scholar 

  • Lavrentieva OO, Arkhypov IO, Kuchma OI, Uchitel AD (2019) Use of simulators together with virtual and augmented reality in the system of welders' vocational training: past, present, and future. In: proceedings of the 2nd international workshop on augmented reality in education, Kryvyi Rih, Ukraine, pp.201–216

  • Lenin N, Sivakumar M, Vigneshkumar D (2010) Process parameter optimization in arc welding of dissimilar metals. Sci Technol Asia 15(3):1–7

    Google Scholar 

  • Lewis J, Sauro J (2009) The factor structure of the system usability scale. In: Kurosu M (ed) Human centered design. HCD 2009. Lecture Notes in Computer Science. Springer, Berlin, pp 94–103

    Google Scholar 

  • Loureiro SMC, Bilro RG, de Aires Angelino FJ (2020) Virtual reality and gamification in marketing higher education: a review and research agenda. Span J Market ESIC 25:179–214

    Article  Google Scholar 

  • Maas MJ, Hughes JM (2020) Virtual, augmented and mixed reality in K–12 education: a review of the literature. Technol Pedagog Educ 29:231–249

    Article  Google Scholar 

  • Macariu C, Iftene A, Gîfu D (2020) Learn chemistry with augmented reality. Procedia Comput Sci 176:2133–2142

    Article  Google Scholar 

  • Mandal NR (2001) Aluminum welding. Woodhead Publishing, Sawston

    Google Scholar 

  • Mandal NR (2009) Welding techniques, distortion control and line heating. Alpha Science International Limited, Oxford

    Google Scholar 

  • Matsas E, Vosniakos G-C, Batras DJR, Manufacturing C-I (2018) Prototyping proactive and adaptive techniques for human-robot collaboration in manufacturing using virtual reality. Rob Comput Integr Manuf 50:168–180

    Article  Google Scholar 

  • Mavrikios D, Karabatsou V, Fragos D, Chryssolouris G (2006) A prototype virtual reality-based demonstrator for immersive and interactive simulation of welding processes. Int J Comput Integr Manuf 19:294–300

    Article  Google Scholar 

  • Milovanovic J, Moreau G, Siret D, Miguet F (2017) Virtual and augmented reality in architectural design and education. In: 17th international conference, CAAD Futures 2017

  • Nagesh D, Datta G (2002) Prediction of weld bead geometry and penetration in shielded metal-arc welding using artificial neural networks. J Mater Process Technol 123:303–312

    Article  Google Scholar 

  • Okimoto MLL, Okimoto PC, Goldbach CE (2015) User experience in augmented reality applied to the welding education. Procedia Manuf 3:6223–6227

    Article  Google Scholar 

  • Omajene JE, Martikainen J, Kah P (2014) Effect of welding parameters on weld bead shape for welds done underwater. Int J Mech Eng Appl 2:128–134

    Google Scholar 

  • Pomerantz J (2019) Teaching and learning with extended reality technology. In: proceedings of the BOBCATSSS 2019 Conference Osijek, Croatia, pp.138–146

  • Regazzoni D, Rizzi C, Vitali A (2018) Virtual reality applications: guidelines to design natural user interface. In: international design engineering technical conferences and computers and information in engineering conference. American Society of Mechanical Engineers

  • Roldán JJ, Crespo E, Martín-Barrio A, Peña-Tapia E, Barrientos A (2019) A training system for industry 4.0 operators in complex assemblies based on virtual reality and process mining. Rob Comput Integr Manuf 59:305–316

    Article  Google Scholar 

  • Saha A, Mondal SC (2017) Multi-objective optimization of manual metal arc welding process parameters for nano-structured hardfacing material using hybrid approach. Measurement 102:80–89

    Article  Google Scholar 

  • Taggart R (1980) Ship design and construction. Society of Naval Architects and Marine Engineers, New Jersey

    Google Scholar 

  • Tang YM, Au KM, Lau HCW, Ho GTS, Wu CH (2020) Evaluating the effectiveness of learning design with mixed reality (MR) in higher education. Virtual Real 24:797–807

    Article  Google Scholar 

  • Tewari S, Gupta A, Prakash J (2010) Effect of welding parameters on the weldability of material. Int J Eng Sci Technol 2:512–516

    Google Scholar 

  • Wu H-K, Lee SW-Y, Chang H-Y, Liang J-C (2013) Current status, opportunities and challenges of augmented reality in education. Comput Educ 62:41–49

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the Ministry of Science and Technology of Taiwan for financially supporting this research under contract MOST 108-2221-E-002-161-MY2.

Author information

Authors and Affiliations

  1. Department of Mechanical Engineering, National Taiwan University, Taipei, Taiwan

    Kalpana Shankhwar & Shana Smith

Authors
  1. Kalpana Shankhwar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shana Smith
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shana Smith.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shankhwar, K., Smith, S. An interactive extended reality-based tutorial system for fundamental manual metal arc welding training. Virtual Reality 26, 1173–1192 (2022). https://doi.org/10.1007/s10055-022-00626-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-022-00626-6

Keywords

Search

Navigation