Skip to main content

Design and evaluation of a multimodal human-multirobot interface

  • Conference paper
Book cover Ergonomie und Mensch-Maschine-Systeme

Abstract

Supervisory control of mobile multi-robot systems often forces the operator to concurrently process information of multiple visual displays under different task conditions. The approach of this paper is to design and evaluate a multimodal human-robot interface to support the processing of dual tasks. The main innovation of the multimodal interface is the binaural auditory information renderer which allows shifting of state information from the visual to the auditory channel of the operator. The multimodal interface was evaluated in a laboratory study with 20 participants. Dependent variables were human performance and workload. Independent variables were the interface modality (monomodal vs. multimodal) and the number of robots to be supervised (1 or 2 robots). The results show that the binaural information fusion significantly improves human performance and also significantly lowers the subjective workload (α = 0,05).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 179.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Literatur

  • Adamczyk PD, Bailey BP (2004) If Not Now, When? The Effects of Interruption at Different Moments within Task Execution. In: Proceedings of the Conference on Human Factors in Computing Systems, Vienna, pp 271–278

    Google Scholar 

  • Adams JA (2002) Critical Considerations for Human-Robot Interface Development, AAAI Fall Symposium on Human-Robot Interaction, North Falmouth

    Google Scholar 

  • Burgard W, Moors M, Fox D, Simmons R, Thrun S (2000) Collaborative multirobot exploration. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), San Francisco

    Google Scholar 

  • Crandall JW, Goodrich MA, Olsen Jr. DR, Nielsen CW (2005) Validating Human-Robot Interaction Schemes in Multitasking Environments. IEEE Trans. on Systems, Man, and Cybernetics-Part A: Systems and Humans, Vol. 35, No.4

    Google Scholar 

  • Dixon SR, Wickens CD (2003) Control of Multiple-UAVs: A Workload Analysis, 12th International Symposium on Aviation Psychology, Dayton

    Google Scholar 

  • Goodrich MA, Olsen Jr. DR, Crandall JW, Palmer TJ (2001) Experiments in Adjustable Autonomy. In: Proceedings of IJCAI01 Workshop on Autonomy, Delegation, and Control: Interacting with Autonomous Agents, Seattle

    Google Scholar 

  • Goodrich MR, Olsen Jr. DR (2003) Seven Principles of Efficient Human Robot Interaction. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Washington, DC, pp 3943–3948

    Google Scholar 

  • Hart SG, Staveland LE (1988) Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Human Mental Workload, pp. 139–183

    Google Scholar 

  • Helleberg J, Wickens CD, Goh J (2003) Traffic and Data Link Displays: Auditory? Visual? Or Redundant? A Visual Scanning Analysis. 12th International Symposium on Aviation Psychology, Dayton

    Google Scholar 

  • Miller SR (2002) Window of Opportunity: Using the Interruption Lag to Manage Disruption in Complex Tasks. In: Proceedings. of the Human Factors and Ergonomics Society 46th Annual Meeting, Santa Monica, pp 245–249

    Google Scholar 

  • Nielsen CW, Goodrich MA, Crandall JW (2003) Experiments in Human-Robot Teams. In: Proceedings of the 2003 Int. Workshop on Multi-Robot Systems: From Swarms to Intelligent Automata, Volume II, Dordrecht, pp 241–252

    Google Scholar 

  • Olsen DR, Goodrich MA (2003) Metrics for Evaluating Human-Robot Interactions. In: Proceedings of the Performance Metrics for Intelligent Systems Workshop, Gaithersburg

    Google Scholar 

  • Sheridan TB (1992) Telerobotics, Automation, and Human Supervisory Control. MIT Press, Cambridge

    Google Scholar 

  • Trouvain B, Schlick C., Mevert, M (2003) Comparison for a Map-vs. Camerabased User Interface in a Multi-Robot Navigation Task. In: Proceedings of the SMC, Washington, DC

    Google Scholar 

  • Trouvain B, Schlick C (2004) A Study of Audio and Visual Context Switch Indicators in a Multirobot Navigation Task. In: Proceedings of the Conference of Systems, Man, and Cybernetics, The Hague

    Google Scholar 

  • Wickens CD (1991) Processing resources and attention. In: D Damos (Ed.), Multiple Task Performance. Taylor & Francis, London, pp. 3–34

    Google Scholar 

  • Wickens CD, Dixon S, Chang D (2003) Using Interference Models to Predict Performance in a Multiple-Task UAV Environment — 2 UAVs, Technical Report AHFD-03-9/MAAD-03-1, AHFD

    Google Scholar 

  • Wickens CD, Liu Y (1988) Codes and modalities in multiple resources: A success and a qualification. Human Factors, vol. 30, 599–616

    Google Scholar 

  • Wickens CD (1980) The Structure of attentional resources. In: RS Nickerson (Ed.), Attention and performance VIII (pp. 239–257). Erlbaum, Englewood Cliffs

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Trouvain, B., Schlick, C.M. (2008). Design and evaluation of a multimodal human-multirobot interface. In: Schmidt, L., Grosche, J., Schlick, C.M. (eds) Ergonomie und Mensch-Maschine-Systeme. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78331-2_16

Download citation

Publish with us

Policies and ethics