Skip to main content
SpringerLink
Log in

Do Users Tolerate Errors? Effects of Observed Failures on the Subjective Evaluation of a Gesture-Based Virtual Reality Application

  • Conference paper
  • First Online:
Computer-Human Interaction Research and Applications (CHIRA 2023)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1996))

  • 124 Accesses

Abstract

Recently, virtual reality (VR) has received increasing attention in science, research, and industry, as well as in consumer electronics. Together with this hardware, innovative interaction modes such as mid-air gestures are being developed and employed. Because these setups are complex and less established than traditional buttons and touch-based interfaces, there is a higher risk that users will perceive errors, failures, and technical malfunctions. This raises the question of how popular, accepted, and trusted such systems are among users and whether observed errors influence this subjective assessment. Previous studies have shown that trust typically increases with usage duration and may decay after system failures. We conducted a study using an HTC Vive headset on which we mounted a Leap Motion device for gesture detection. Participants performed basic tasks with a “blocks” application using a set of gestures. Afterwards, they were asked to rate their levels of trust in and acceptance of the system. We investigated the correlation between the number of observed errors and reported levels of trust and acceptance to determine whether malfunctions directly influence subjective assessment. We found no effect of errors on acceptance but a significant correlation between number of errors and overall trust score.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Bolt, R.A.: “Put-That-There”: Voice and gesture at the graphics interface. ACM SIGGRAPH Comput. Graph. 14(3), 262–270 (1980). https://doi.org/10.1145/965105.807503

    Article  MathSciNet  Google Scholar 

  2. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Taylor and Francis. http://gbv.eblib.com/patron/FullRecord.aspx?p=1192162

  3. Cronbach, L.J.: Coefficient alpha and the internal structure of tests. Psychometrika 16(3), 297–334 (1951). https://doi.org/10.1007/BF02310555

    Article  Google Scholar 

  4. Dorton, S.L., Harper, S.B.: Self-Repairing and/or buoyant trust in artificial Intelligence. Proc. Hum. Factors Ergonomics Soc. Annu. Meet. 66(1), 162–166 (2022). https://doi.org/10.1177/1071181322661098

    Article  Google Scholar 

  5. Dorton, S.L., Harper, S.B., Neville, K.J.: Adaptations to trust incidents with artificial intelligence. Proc. Hum. Factors Ergonomics Soc. Annu. Meet. 66(1), 95–99 (2022). https://doi.org/10.1177/1071181322661146

    Article  Google Scholar 

  6. Esterwood, C., Robert, L. P. (2022). A literature review of trust repair in HRI. : In 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 1641–1646. IEEE. https://doi.org/10.1109/RO-MAN53752.2022.9900667

  7. Graichen, L., Graichen, M., Krems, J.F.: Evaluation of gesture-based in-vehicle interaction: user experience and the potential to reduce driver distraction. Hum. Factors: J. Hum. Factors Ergonomics Soc. 61(5), 774–792 (2019). https://doi.org/10.1177/0018720818824253

    Article  Google Scholar 

  8. He, S., Yang, C., Wang, M., Cheng, L., Hu, Z. (2017). Hand gesture recognition using MYO armband. : In 2017 Chinese Automation Congress (CAC), pp. 4850–4855. IEEE. https://doi.org/10.1109/CAC.2017.8243637

  9. Kao, H.L., Dementyev, A., Paradiso, J. A., Schmandt, C. (2015). NailO: Fingernails as an input surface. : In B. Begole, J. Kim, K. Inkpen, W. Woo (Eds.), Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 3015–3018. ACM. https://doi.org/10.1145/2702123.2702572

  10. Körber, M.: Theoretical considerations and development of a questionnaire to measure trust in automation. In: Bagnara, S., Tartaglia, R., Albolino, S., Alexander, T., Fujita, Y. (eds.) IEA 2018. AISC, vol. 823, pp. 13–30. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-96074-6_2

    Chapter  Google Scholar 

  11. Kraus, J., Scholz, D., Stiegemeier, D., Baumann, M.: The more you know: trust dynamics and calibration in highly automated driving and the effects of take-overs, system malfunction, and system transparency. Hum. Factors: J. Hum. Factors Ergonomics Soc. 62(5), 718–736 (2020). https://doi.org/10.1177/0018720819853686

    Article  Google Scholar 

  12. Lee, J., Abe, G., Sato, K., Itoh, M.: Developing human-machine trust: Impacts of prior instruction and automation failure on driver trust in partially automated vehicles. Transport. Res. F: Traffic Psychol. Behav. 81, 384–395 (2021). https://doi.org/10.1016/j.trf.2021.06.013

    Article  Google Scholar 

  13. Leng, H. Y., Norowi, N. M., Jantan, A. H. (2017). A user-defined gesture set for music interaction in immersive virtual environment. : In E. Sari A. B. Tedjasaputra (Eds.), Proceedings of the 3rd International Conference on Human-Computer Interaction and User Experience in Indonesia, pp. 44–51. ACM. https://doi.org/10.1145/3077343.3077348

  14. Loehmann, S., Knobel, M., Lamara, M., Butz, A.: Culturally independent gestures for in-car interactions. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) Human-Computer Interaction – INTERACT 2013: 14th IFIP TC 13 International Conference, Cape Town, South Africa, September 2-6, 2013, Proceedings, Part III, pp. 538–545. Springer Berlin Heidelberg, Berlin, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40477-1_34

    Chapter  Google Scholar 

  15. Mishler, S., Chen, J.: Effect of automation failure type on trust development in driving automation systems. Appl. Ergon. 106, 103913 (2023). https://doi.org/10.1016/j.apergo.2022.103913

    Article  Google Scholar 

  16. Narayana, P., et al.: Cooperating with avatars through gesture, language and action. In: Arai, K., Kapoor, S., Bhatia, R. (eds.) Intelligent Systems and Applications: Proceedings of the 2018 Intelligent Systems Conference (IntelliSys) Volume 1, pp. 272–293. Springer International Publishing, Cham (2019). https://doi.org/10.1007/978-3-030-01054-6_20

    Chapter  Google Scholar 

  17. O’hara, K., Harper, R., Mentis, H., Sellen, A., Taylor, A.: On the naturalness of touchless: Putting the “interaction” back into NUI. ACM Trans. Comput.-Hum. Interact. 20(1), 1–25 (2013). https://doi.org/10.1145/2442106.2442111

    Article  Google Scholar 

  18. Pfeiffer, T.: 54. Documentation of gestures with data gloves. In: Müller, C., Cienki, A., Fricke, E., Ladewig, S., McNeill, D., Tessendorf, S. (eds.) Handbücher zur Sprach- und Kommunikationswissenschaft / Handbooks of Linguistics and Communication Science (HSK) 38/1:, pp. 868–879. DE GRUYTER (2013). https://doi.org/10.1515/9783110261318.868

    Chapter  Google Scholar 

  19. Pfeiffer, T. (2013b). Documentation of gestures with motion capture. In C. Müller, A. Cienki, E. Fricke, S. Ladewig, D. McNeill, S. Teßendorf (Eds.), Handbücher zur Sprachund Kommunikationswissenschaft: Band 38.2. Body - Language - Communication: An International Handbook on Multimodality In Human Interaction. Volume 1, pp. 857–867. Walter de Gruyter GmbH

    Google Scholar 

  20. Piumsomboon, T., Clark, A., Billinghurst, M., Cockburn, A. (2013). User-defined gestures for augmented reality. In: W. Mackay, S. Brewster, S. Bødker, & W. E. Mackay (Eds.), Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘13). Extended Abstracts. 27 April - 2 May 2013, Paris, France, p. 955. ACM. https://doi.org/10.1145/2468356.2468527

  21. Premaratne, P.: Human computer interaction using hand gestures. Springer Singapore, Singapore (2014)

    Book  Google Scholar 

  22. Pustejovksy, J., et al.: Interpreting and generating gestures with embodied. Hum. Comput. Interact. (2020). https://doi.org/10.5281/zenodo.4088625

    Article  Google Scholar 

  23. Rakkolainen, I., et al.: Technologies for multimodal interaction in extended reality - A scoping review. Multimodal Technol. Interact. 5(12), 81 (2021). https://doi.org/10.3390/mti5120081

    Article  Google Scholar 

  24. Rodriguez, G., Jofre, N., Alvarado, Y., Fernández, J., Guerrero, R.: Gestural interaction for virtual reality environments through data gloves. Adv. Sci., Technol. Eng. Syst. J. 2(3), 284–290 (2017). https://doi.org/10.25046/aj020338

    Article  Google Scholar 

  25. Saffer, D. (2008). Designing gestural interfaces. O’Reilly Media, Inc.

    Google Scholar 

  26. Seeling, T., Dittrich, F., Bullinger, A. C. (2018). Digitales Gestenmanual zur Gestaltung einer natürlichen gestenbasierten Interaktion zwischen Mensch und Maschine. In Gesellschaft für Arbeitswissenschaft (Chair), Frühjahrskongress 2018, Frankfurt am Main

    Google Scholar 

  27. Seeling, T., Fricke, E., Lynn, U., Schöller, D., Bullinger, A.C. (2016). Gestenbasierte Google-Earth-Bedienung: Implikationen für ein natürliches Gesten-Set am Beispiel einer 3D-Topographieanwendung. In Gesellschaft für Arbeitswissenschaft (Ed.), Dokumentation des 62. Arbeitswissenschaftlichen Kongresses: Arbeit in komplexen Systemen - Digital, vernetzt, human?!. GfA-Press

    Google Scholar 

  28. Tolmeijer, S., Gadiraju, U., Ghantasala, R., Gupta, A., Bernstein, A. (2021). Second chance for a first impression? Trust development in intelligent system interaction. In: J. Masthoff, E. Herder, N. Tintarev, & M. Tkalčič (Eds.), Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization, pp. 77–87. ACM. https://doi.org/10.1145/3450613.3456817

  29. LaanVan der, J.D., Heino, A., de Waard, D.: A simple procedure for the assessment of acceptance of advanced transport telematics. Transp. Res. Part C: Emerg. Technol. 5(1), 1 (1997). https://doi.org/10.1016/S0968-090X(96)00025-3

    Article  Google Scholar 

  30. Wigdor, D., Wixon, D. (Eds.). (2011). Safari Tech Books Online. Brave NUI world: Designing natural user interfaces for touch and gesture. Morgan Kaufmann/Elsevier

    Google Scholar 

  31. Kun, Y., Berkovsky, S., Conway, D., Taib, R., Zhou, J., Chen, F.: Do I Trust a Machine? Differences in User Trust Based on System Performance. In: Zhou, J., Chen, F. (eds.) Human and Machine Learning, pp. 245–264. Springer International Publishing, Cham (2018). https://doi.org/10.1007/978-3-319-90403-0_12

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. TU Berlin, Berlin, Germany

    Lisa Graichen

  2. Independent Researcher, Munich, Germany

    Matthias Graichen

Authors
  1. Lisa Graichen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matthias Graichen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lisa Graichen .

Editor information

Editors and Affiliations

  1. Instituto Superior Técnico, IT - Institute of Telecommunications, Lisbon, Portugal

    Hugo Plácido da Silva

  2. University of Turin, Turin, Italy

    Pietro Cipresso

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Graichen, L., Graichen, M. (2023). Do Users Tolerate Errors? Effects of Observed Failures on the Subjective Evaluation of a Gesture-Based Virtual Reality Application. In: da Silva, H.P., Cipresso, P. (eds) Computer-Human Interaction Research and Applications. CHIRA 2023. Communications in Computer and Information Science, vol 1996. Springer, Cham. https://doi.org/10.1007/978-3-031-49425-3_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-49425-3_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-49424-6

  • Online ISBN: 978-3-031-49425-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation