Skip to main content
SpringerLink
Log in

Robot-Generated Mixed Reality Gestures Improve Human-Robot Interaction

  • Conference paper
  • First Online:
Social Robotics (ICSR 2021)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13086))

Included in the following conference series:

Abstract

We investigate the effectiveness of robot-generated mixed reality gestures. Our findings demonstrate how these gestures increase user effectiveness by decreasing user response time, and that robots can pair long referring expressions with mixed reality gestures without cognitively overloading users.

This work was funded by NSF grants IIS-1909864 and CNS-1823245.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Hart, S., Staveland, L.: Development of NASA-TLX (task load index): results of empirical and theoretical research. In: Human Mental Workload (1988)

    Google Scholar 

  2. Hirshfield, L., Williams, T., Sommer, N., Grant, T., Gursoy, S.V.: Workload-driven modulation of mixed-reality robot-human communication. In: Proceedings of the Workshop on Modeling Cognitive Processes from Multimodal Data (2018)

    Google Scholar 

  3. Lavie, N.: The role of perceptual load in visual awareness. Brain Res. 1080, 91–100 (2006)

    Article  Google Scholar 

  4. Matuszek, C., Bo, L., Zettlemoyer, L., Fox, D.: Learning from unscripted deictic gesture and language for human-robot interactions. In: Proceedings of AAAI (2014)

    Google Scholar 

  5. Salem, M., Kopp, S., Wachsmuth, I., Rohlfing, K., Joublin, F.: Generation and evaluation of communicative robot gesture. Int. J. Soc. Robot. 4(2), 201–221 (2012)

    Article  Google Scholar 

  6. Sauppé, A., Mutlu, B.: Robot deictics: how gesture and context shape referential communication. In: Proceeding of HRI (2014)

    Google Scholar 

  7. Wickens, C.D.: Processing resources and attention. In: Multiple-task Performance (1991)

    Google Scholar 

  8. Wickens, C.D.: Multiple resources and mental workload. Hum. Factors 50(3), 449–555 (2008)

    Article  Google Scholar 

  9. Williams, T., Bussing, M., Cabrol, S., Lau, I., Boyle, E., Tran, N.: Investigating the potential effectiveness of allocentric mixed reality deictic gesture. In: Chen, J.Y.C., Fragomeni, G. (eds.) HCII 2019. LNCS, vol. 11575, pp. 178–198. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-21565-1_12

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Colorado School of Mines, Golden, CO, 80401, USA

    Nhan Tran, Thao Phung & Tom Williams

  2. Institute for Cognitive Science, University of Colorado Boulder, Boulder, CO, 80309, USA

    Trevor Grant & Leanne Hirshfield

  3. Department of Psychology, Colorado State University, Fort Collins, CO, 80523, USA

    Christopher Wickens

Authors
  1. Nhan Tran
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Trevor Grant
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Thao Phung
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Leanne Hirshfield
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Christopher Wickens
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Tom Williams
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Nhan Tran or Tom Williams .

Editor information

Editors and Affiliations

  1. Department of Electronic and Communication Engineering, National University of Singapore, Faculty of Engineering, Singapore, Singapore

    Haizhou Li

  2. The National University of Singapore, Singapore, Singapore

    Shuzhi Sam Ge

  3. A*STAR Institute for Infocomm Research, Singapore, Singapore

    Yan Wu

  4. Center for Human Technologies, Istituto Italiano Tecnologia, Genoa, Italy

    Agnieszka Wykowska

  5. Department of Electrical Engineering and Computer Science, Wichita State University, Wichita, KS, USA

    Hongsheng He

  6. Qingdao University, Qingdao, China

    Xiaorui Liu

  7. School of Cyber Science and Technology, Beihang University, Beijing, Beijing, China

    Dongyu Li

  8. Social Cognition Human-Robot Interaction, Istituto Italiano di Tecnologia, Genoa, Italy

    Jairo Perez-Osorio

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tran, N., Grant, T., Phung, T., Hirshfield, L., Wickens, C., Williams, T. (2021). Robot-Generated Mixed Reality Gestures Improve Human-Robot Interaction. In: Li, H., et al. Social Robotics. ICSR 2021. Lecture Notes in Computer Science(), vol 13086. Springer, Cham. https://doi.org/10.1007/978-3-030-90525-5_69

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90525-5_69

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90524-8

  • Online ISBN: 978-3-030-90525-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation