Abstract
Manufacturing applications of virtual reality (VR) technology are growing. The challenge is to design, integrate, and evaluate VR simulation for manufacturing Systems that improves the effectiveness of the planning process. In this paper, we discuss the technical infrastructure necessary to design a collaborative virtual manufacturing planning system. We describe the VR system setup and the integration of hardware and software to produce high-fidelity virtual simulation for manufacturing planning purposes. The designing guidelines are demonstrated by a high-fidelity VR simulation of a stamping process. The VR simulation also presents a method of visualizing computer-aided engineering content. Also, this paper assesses the factors that affect overall fidelity of the VR simulation. Objective evaluation of the VR simulation was conducted using the fidelity framework and the scales, whereas the subjective evaluation methods used were VR-simulation-driven data interpretation. The VR simulation was evaluated by a selective sample of 33 senior engineering students using a highly reliable scale (Cronbach’s Alpha = .93) questionnaire that was designed to evaluate functionality, performance, and experience. The results of the subjective evaluation validate the evaluation of objective scales to be high-medium for the VR system used (M = 5.24, M = 5.11) respectively. Significant positive relationships were found between all factors, except distraction, which had a significant negative relationship with fidelity. Overall, the realism and sensory systems factors were found to be the main significant factors affecting the fidelity of the VR system.
Similar content being viewed by others
References
Abidi MH, Al-Ahmari A, Ahmad A, Ameen W, Alkhalefah H (2019) Assessment of virtual reality-based manufacturing assembly training system. Inter J Adv Manufact Technol 105(9):3743–3759
Akpan IJ, Shanker M (2017) The confirmed realities and myths about the benefits and costs of 3D visualization and virtual reality in discrete event modeling and simulation: A descriptive meta-analysis of evidence from research and practice. Comput Ind Eng 112:197–211. https://doi.org/10.1016/j.cie.2017.08.020
Alcácer V, Cruz-Machado V (2019) Scanning the industry 4.0: a literature review on technologies for manufacturing systems. Eng Sci Technol Inter J 22(3):899–919. https://doi.org/10.1016/j.jestch.2019.01.006
Al-Jundi H, Tanbour E (2021) Virtual reality applications in manufacturing planning: a review of the literature. Unpublished manuscript. VIRE-D-20–00236R3
Al-Jundi HA, Tanbour EY (2022) A framework for fidelity evaluation of immersive virtual reality systems. Virtual Reality 6:1–20
Azizi A, Ghafoorpoor Yazdi P, Hashemipour M (2018) Interactive design of storage unit utilizing virtual reality and ergonomic framework for production optimization in manufacturing industry. Int J Interact Des Manufact (IJIDeM) 13(1):373–381. https://doi.org/10.1007/s12008-018-0501-9
Bendul JC, Blunck H (2019) The design space of production planning and control for industry 4.0. Comput Ind 105:260–272. https://doi.org/10.1016/j.compind.2018.10.010
Büttner, S., Mucha, H., Funk, M., Kosch, T., Aehnelt, M., Robert, S., & Röcker C (2017) The design space of augmented and virtual reality applications for assistive environments in manufacturing: a visual approach. In Proceedings of the 10th International Conference on Pervasive Technologies Related to Assistive Environments. 433–440
Cabrera ME, Wachs JP (2017) A human-centered approach to one-shot gesture learning. Front Robot AI. https://doi.org/10.3389/frobt.2017.00008
Cecil ., Albuhamood S, Cecil-Xavier A, Ramanathan P, (2017) An advanced cyber physical framework for micro devices assembly, special issue on "advanced CPS for industry 40 - enabling technologies, real-world implementations, and impact assessments", IEEE Transactions on Systems, Man, and Cybernetics: Systems. pp. 1–15
Cecil J, Kanchanapiboon A (2007) Virtual engineering approaches in product and process design. Int J Adv Manuf Technol 31(9):846–856. https://doi.org/10.1007/s00170-005-0267-7
Chung C, Peng Q (2003) The development of a web-centered VR-CAPP system. In: proceedings of the international conference on agile manufacturing (ICAM 2003), Beijing, China. pp 369–376
Cipresso P, Giglioli IAC, Raya MA, Riva G (2018) The past, present, and future of virtual and augmented reality research: a network and cluster analysis of the literature. Front Psychol 9:2086–2086. https://doi.org/10.3389/fpsyg.2018.02086
Cooper N, Milella F, Pinto C, Cant I, White M, Meyer G (2018) The effects of substitute multisensory feedback on task performance and the sense of presence in a virtual reality environment. PLoS ONE 13(2):e0191846. https://doi.org/10.1371/journal.pone.0191846
Damiani L, Demartini M, Guizzi G, Revetria R, Tonelli F (2018) Augmented and virtual reality applications in industrial systems: A qualitative review towards the industry 4.0 era. IFAC-PapersOnLine 51(11):624–630
Elor A, Powell M, Mahmoodi E, Hawthorne N, Teodorescu M, Kurniawan S (2020) On shooting stars: comparing CAVE and HMD immersive virtual reality exergaming for adults with mixed ability. ACM Trans Comput Healthc 1(4):1–22. https://doi.org/10.1145/3396249
Franzluebbers A, Johnsen K (2018) Performance benefits of high-fidelity passive haptic feedback in virtual reality training. In: proceedings of the Symposium on spatial user interaction. Association for computing machinery. pp 16–24. https://doi.org/10.1145/3267782.3267790
Ghafoorpoor Yazdi P, Azizi A, Hashemipour M (2018) An empirical investigation of the relationship between overall equipment efficiency (OEE) and manufacturing sustainability in industry 40 with time study approach. Sustainability 10(9):3031
Ghafoorpoor Yazdi P, Azizi A, Hashemipour M (2019) A hybrid methodology for validation of optimization solutions effects on manufacturing sustainability with time study and simulation approach for SMEs. Sustainability (basel, Switzerland) 11(5):1454. https://doi.org/10.3390/su11051454
Ghobakhloo M (2018) The future of manufacturing industry: a strategic roadmap toward industry 40. J Manufact Technol Manag 29(6):910–936. https://doi.org/10.1108/JMTM-02-2018-0057
Grieve RJ (1995) Computerised manufacturing process planning systems: Hong-Chao Zhang and Leo Alting. Chapman & Hall, London (1994) 336pp. Elsevier, ISBN 0 412 413000 0
Groover MP, Groover MP (2015) Automation, production systems, and computer-integrated manufacturing, 4th edn. Prentice Hall, Hoboken
Guo Z, Zhou D, Zhou Q, Mei S, Zeng S, Yu D, Chen J (2020) A hybrid method for evaluation of maintainability towards a design process using virtual reality. Comput Ind Eng 140:106227. https://doi.org/10.1016/j.cie.2019.106227
Hart SG, Staveland LE (1988) Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology. Elsevier, North-Holland, pp 139–183
Hoogenes J (2018) Surgical education: development of curricula to optimize training and evaluate competency, [Doctoral dissertation, Manchester Metropolitan University]. ProQuest Dissertations & Theses Global.
Jain S, Shao G, Shin SJ (2017) Manufacturing data analytics using a virtual factory representation. Int J Prod Res 55(18):5450–5464. https://doi.org/10.1080/00207543.2017.1321799
Jayaram S, Jayaram U, Wang Y, Tirumali H, Lyons K, Hart P (1999) VADE: a virtual assembly design environment. IEEE Comput Graphics Appl 19(6):44–50
Jones A (2021) Use of virtual reality for hazard safety training to reduce high risk and significant safety incidents and increase training engagement. Springer Inter Publish. https://doi.org/10.1007/978-3-030-72781-9_10
Kern AC, Ellermeier W (2020) Audio in VR: Effects of a soundscape and movement-triggered step sounds on presence. Front Robot AI 7:20–20. https://doi.org/10.3389/frobt.2020.00020
Kesavadas T, Ernzer M (1999a) Design of virtual factory using cell formation methodologies. In: industrial virtual reality: manufacturing and design tool for the next millennium, proceedings of the asme symposium on virtual reality environment for manufacturing (pp. 14–19).
Kesavadas, T., & Ernzer, M. (1999b). Design of virtual factory using cell formation methodologies. In: industrial virtual reality: manufacturing and design tool for the next millennium, proceedings of the asme symposium on virtual reality environment for manufacturing. pp 14–19
Lindquist M, Maxim B, Proctor J, Dolins F (2020) The effect of audio fidelity and virtual reality on the perception of virtual greenspace. Landsc Urban Plan 202:103884. https://doi.org/10.1016/j.landurbplan.2020.103884
Liu H, Zhang Z, Xie X, Zhu Y, Liu Y, Wang Y, Zhu SC (2019) High-fidelity grasping in virtual reality using a glove-based system. In 2019 international conference on robotics and automation (ICRA; pp. 5180–5186). IEEE.
Loannidis C, Boutsi A (2020) Multithreaded rendering for cross-platform 3d visualization based on vulkan api. International archives of the photogrammetry, remote sensing and spatial information sciences, XLIV-4-W1-2020, 57-62. https://doi.org/10.5194/isprs-archives-XLIV-4-W1-2020-57-2020
Malik AA, Masood T, Bilberg A (2020) Virtual reality in manufacturing: immersive and collaborative artificial-reality in design of human-robot workspace. Int J Comput Integr Manuf 33(1):22–37
Massoth C, Röder H, Ohlenburg H, Hessler M, Zarbock A, Pöpping DM, Wenk M (2019) High-fidelity is not superior to low-fidelity simulation but leads to overconfidence in medical students. BMC Med Educ 19(1):1–8. https://doi.org/10.1186/s12909-019-1464-7
Menzies RJ, Rogers SJ, Phillips AM, Chiarovano E, De Waele C, Verstraten FA, MacDougall H (2016) An objective measure for the visual fidelity of virtual reality and the risks of falls in a virtual environment. Virtual Reality 20(3):173–181. https://doi.org/10.1007/s10055-016-0288-6
Mourtzis D (2020) Simulation in the design and operation of manufacturing systems: state of the art and new trends. Int J Prod Res 58(7):1927–1949. https://doi.org/10.1080/00207543.2019.1636321
Nåfors D, Johansson B (2021) Virtual engineering using realistic virtual models in brownfield factory layout planning. Sustainability 13(19):11102. https://doi.org/10.3390/su131911102
Nunnally JC (1978) Psychometric theory, 2nd edn. McGraw-Hill, New York
Oyekan JO, Hutabarat W, Tiwari A, Grech R, Aung MH, Mariani MP, López-Dávalos L, Ricaud T, Singh S, Dupuis C (2019) The effectiveness of virtual environments in developing collaborative strategies between industrial robots and humans. Robot Comput-Integr Manuf 55:41–54
Pala P, Cavallo V, Dang NT, Granié M, Schneider S, Maruhn P, Bengler K (2021) Is the street-crossing behavior with a head-mounted display different from that behavior in a CAVE? A study among young adults and children. Transportation research. Part f, Traffic Psychology Behaviour 82:15–31. https://doi.org/10.1016/j.trf.2021.07.016
Paritala PK, Manchikatla S, Yarlagadda PKDV (2017) Digital manufacturing- Applications past, current, and future trends. Procedia Eng 174:982–991. https://doi.org/10.1016/j.proeng.2017.01.250
Pérez L, Diez E, Usamentiaga R, García DF (2019) Industrial robot control and operator training using virtual reality interfaces. Comput Ind 109:114–120. https://doi.org/10.1016/j.compind.2019.05.001
Project management institute. (2017). A guide to the project management body of knowledge (PMBOK guide) (6th ed.). In: project management institute.
Ragan ED, Bowman DA, Kopper R, Stinson C, Scerbo S, McMahan RP (2015) Effects of field of view and visual complexity on virtual reality training effectiveness for a visual scanning task. IEEE Trans Visual Comput Graph 21(7):794–807. https://doi.org/10.1109/TVCG.2015.2403312
Rosa E, Dahlstrom N, Knez I, Ljung R, Cameron M, Willander J (2021) Dynamic decision-making of airline pilots in low-fidelity simulation. Theor Issues Ergon Sci 22(1):83–102. https://doi.org/10.1080/1463922X.2020.1758830
Schubert T, Friedmann F, Regenbrecht H (2001) The experience of presence: factor analytic insights. Presence: Teleoperators Virtual Environ 10(3):266–281. https://doi.org/10.1162/105474601300343603
Slater M (2009) Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos Trans Royal Socb: Biolog Sci 364(1535):3549–3557
Slater M, Sanchez-Vives MV (2016) Enhancing our lives with immersive virtual reality. Front Robot AI 3:74. https://doi.org/10.3389/frobt.2016.00074
Slater M, Spanlang B, Corominas D (2010) Simulating virtual environments within virtual environments as the basis for a psychophysics of presence. ACM Trans Graph (TOG) 29(4):1–9. https://doi.org/10.1145/1778765.1778829
Smith RP, Heim JA (1999) Virtual facility layout design: The value of an interactive three-dimensional representation. Int J Prod Res 37(17):3941–3957
Söderberg R, Wärmefjord K, Carlson JS, Lindkvist L (2017) Toward a digital twin for real-time geometry assurance in individualized production. CIRP Ann Manuf Technol 66(1):137–140
Srinivasan H, Figueroa R, Gadh R (1999) Selective disassembly for virtual prototyping as applied to de-manufacturing. Robot Comput-Integr Manuf 15(3):231–245
Tabachnick BG, Fidell LS (1996) Using multivariate statistics. Harper Collins, Northridge, CA
Tao F, Sui F, Liu A, Qi Q, Zhang M, Song B, Guo Z, Lu SC, Nee AY (2019) Digital twin-driven product design framework. Int J Prod Res 57(12):3935–3953. https://doi.org/10.1080/00207543.2018.1443229
Taylor, F., Jayaram, S., Jayaram, U., & Mitsui, T. (2000, September). Functionality to facilitate assembly of heavy machines in a virtual environment. In International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. American Society of Mechanical Engineers. 35111, pp 737–745
Tseng MM, Jiao J, Su CJ (1998) Virtual prototyping for customized product development. Integr Manuf Syst 6(6):334–343
Usoh M, Catena E, Arman S, Slater M (2000) Using presence questionnaires in reality. Presence 9(5):497–503. https://doi.org/10.1162/105474600566989
Volonte M, Anaraky RG, Venkatakrishnan R, Venkatakrishnan R, Knijnenburg BP, Duchowski AT, Babu SV (2021) Empirical evaluation and pathway modeling of visual attention to virtual humans in an appearance fidelity continuum. J Multimodal User Interfaces 15(2):109–119. https://doi.org/10.1007/s12193-020-00341-z
Witmer BG, Singer MJ (1998) Measuring presence in virtual environments: a presence questionnaire. Presence 7(3):225–240
Zizza C, Starr A, Hudson D, Nuguri SS, Calyam P, He Z (2018) Towards a social virtual reality learning environment in high fidelity. In: 2018 15th IEEE annual consumer communications & networking conference. IEEE. CCNC. pp. 1–4. https://doi.org/10.1109/CCNC.2018.8319187
Zotter F, Frank M (2019) Auditory events of multi-loudspeaker playback. Ambisonics. Springer, New Jersey, pp 23–40
Funding
This work was funded by Eastern Michigan University.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
There are no conflict of interest that exists in this work.
Consent of publications
We declare that the work described in this paper has not been published before and it is not under consideration for publication anywhere else. Also, the work in this publication has been approved by all co-authors and the responsible authorities at Eastern Michigan University.
Ethics approvals
This study was approved by the institutional review board (IRB) at the Eastern Michigan University human subject review committee (UHSRC-FY20-21–191).
Intellectual property
We confirm that we have given due consideration to the protection of intellectual property associated with this work and that there are no impediments to publication, including the timing of publication, with respect to intellectual property. In so doing, we confirm that we have followed the regulations of our institutions concerning intellectual property.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Al-Jundi, H.A., Tanbour, E.Y. Design and evaluation of a high− fidelity virtual reality manufacturing planning system. Virtual Reality 27, 677–697 (2023). https://doi.org/10.1007/s10055-022-00683-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-022-00683-x