Skip to main content

Augmented Reality Towards Industry 5.0: Improving Voice and Tap Interaction Based on User Experience Feedback

  • Conference paper
  • First Online:
Progressive and Integrative Ideas and Applications of Engineering Systems Under the Framework of IOT and AI (ISDEA 2023)

Abstract

EXtended Reality (XR) has numerous applications in industrial contexts, including to assist in activities such as preventive maintenance and/or reactive interventions in machinery, wherein time-effectiveness is required to mitigate the costs of inactive production lines or the need to subcontract specialized technicians to perform those operations. However, developing an Augmented Reality (AR) application capable of being user-friendly and truly serviceable for aiding in the referred context requires keeping in mind human factors as key aspects and, as such, interaction must be a concern to address, namely, considering user feedback. Therefore, starting from a previous AR system oriented to industrial interventions that was developed and assessed with users and considering the feedback of the participant, the duly alterations were done and a new test was conducted, with a total of 27 participants, divided into 2 groups: 11 users who participated in the first experience and 16 general users who had never contacted with the solution before. A qualitative improvement in the user experience was noticed from the questionnaires feedback. Points such as fluidity, responsiveness, ease, speed, and intuitiveness were highlighted. Voice commands matched the tap commands in terms of user preferences.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Masood, T., Egger, J.: Augmented reality in support of Industry 4.0—implementation challenges and success factors. Robot. Comput. Integr. Manufac. 58, 181–195 (2019)

    Google Scholar 

  2. Lodetti, P.Z., dos Santos, A.B., Hattori, L.T., Carvalho, E.G., Martins, M.A.I.: Mobile remote assistance with augmented reality applied in a power distribution utility: a qualitative study. In Intermountain Engineering, Technology and Computing (IETC), pp. 1–6. IEEE, Orem (2022)

    Google Scholar 

  3. Tang, A., Owen, C., Biocca, F., Mou, W.: Comparative effectiveness of augmented reality in object assembly. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 73–80 (2003)

    Google Scholar 

  4. Fiorentino, M., Uva, A.E., Gattullo, M., Debernardis, S., Monno, G.: Augmented reality on large screen for interactive maintenance instructions. Comput. Ind. 65(2), 270–278 (2014)

    Article  Google Scholar 

  5. Mourtzis, D., Zogopoulos, V., Vlachou, E.: Augmented reality application to support remote maintenance as a service in the robotics industry. Procedia Cirp 63, 46–51 (2017)

    Article  Google Scholar 

  6. Serván, J., Mas, F., Menéndez, J. L., Ríos, J.: Assembly work instruction deployment using augmented reality. In: Key Engineering Materials, vol. 502, pp. 25–30. Trans Tech Publications Ltd. (2012)

    Google Scholar 

  7. Gavish, N., et al.: Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks. Interact. Learn. Environ. 23(6), 778–798 (2015)

    Article  Google Scholar 

  8. Wolf, J., Luchmann, D., Lohmeyer, Q., et al.: How different augmented reality visualizations for drilling affect trajectory deviation, visual attention, and user experience. Int. J. CARS (2023)

    Google Scholar 

  9. Dorloh, H., Li, K.-W., Khaday, S.: Presenting job instructions using an augmented reality device, a printed manual, and a video display for assembly and disassembly tasks: what are the differences? Appl. Sci. 13(4), 2186 (2023)

    Article  Google Scholar 

  10. Kern, F., Niebling, F., Latoschik, M.E.: Text input for non-stationary XR workspaces: investigating tap and word-gesture keyboards in virtual and augmented reality. IEEE Trans. Visual. Comput. Graph. 29(5), 2658–2669 (2023)

    Article  Google Scholar 

  11. Margolis, I., Carrança, J.A., Sousa, N., et al.: UX and Industry 5.0: a study in repairing equipment using augmented reality. In: 2nd International Conference on Intelligent Systems Design and Engineering Application (ISDEA). Okayama (2023)

    Google Scholar 

  12. Hurt, H.T., Joseph, K., Cook, C.D.: Scales for the measurement of innovativeness. Hum. Commun. Res. 4, 58–65 (1977)

    Article  Google Scholar 

  13. Minge, M., Thüring, M.: The meCUE questionnaire (2.0): Meeting five basic requirements for lean and standardized UX assessment. In: Marcus, A., Wang, W. (eds.) DUXU 2018. LNCS, vol. 10918, pp. 451–469. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91797-9_33

  14. Thüring, M., Mahlke, S.: Usability, aesthetics and emotions in human–technology interaction. Int. J. Psychol. 42, 253–264 (2007)

    Google Scholar 

Download references

Acknowledgment

This work was supported by the European Structural and Investment Funds in the FEDER Component through the Operational Programme for Competitiveness and internationalization (COMPETE 2020) under Advanced Decision Making in productive systems through Intelligent Networks (ADM.IN) Project 055087 (POCI-01-0247-FEDER-055087).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexandre Carrança .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Carrança, A. et al. (2024). Augmented Reality Towards Industry 5.0: Improving Voice and Tap Interaction Based on User Experience Feedback. In: Ma, Y. (eds) Progressive and Integrative Ideas and Applications of Engineering Systems Under the Framework of IOT and AI. ISDEA 2023. Lecture Notes in Electrical Engineering, vol 1076. Springer, Singapore. https://doi.org/10.1007/978-981-99-6303-4_13

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-6303-4_13

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-6302-7

  • Online ISBN: 978-981-99-6303-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics