Human-Robot Mutual Trust in (Semi)autonomous Underwater Robots

Part of the Studies in Computational Intelligence book series (SCI, volume 554)


It is envisioned that a human operator is able to monitor and control one or more (semi)autonomous underwater robots simultaneously in future marine operations. To enable such operations, a human operator must trust the capability of a robot to perform tasks autonomously, and the robot must establish its trust to the human operator based on human performance and follow guidance accordingly. Therefore, we seek to i model the mutual trust between humans and robots (especially (semi)autonomous underwater robots in this chapter), and ii) develop a set of trust-based algorithms to control the human-robot team so that the mutual trust level can be maintained at a desired level. We propose a time series based mutual trust model that takes into account robot performance, human performance and overall human-robot system fault rates. The robot performance model captures the performance evolution of a robot under autonomous mode and teleoperated mode, respectively. Furthermore, we specialize the robot performance model of a YSI EcoMapper autonomous underwater robot based on its distance to a desired waypoint. The human performance model is inspired by the Yerkes-Dodson law in psychology, which describes the relationship between human arousal and performance. Based on the mutual trust model, we first study a simple case of one human operator controlling a single robot and propose a trust-triggered control strategy depending on the limit conditions of the desired trust region. The method is then enhanced for the case of one human operator controlling a swarm of robots. In this framework, a periodic trust-based control strategy with a highest-trust-first scheduling algorithm is proposed. Matlab simulation results are provided to validate the proposed model and control strategies that guarantee effective real-time scheduling of teleoperated and autonomous controls in both one human one underwater robot case and one human multiple underwater robots case.


Human-Robot Interaction Mutual Trust Real-Time Scheduling (Semi) autonomous Underwater Robots 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication, Paris, France (September 2012)Google Scholar
  2. 2.
    Arzen, K.E., Cervin, A., Eker, J., Sha, L.: An introduction to control and scheduling co-design. In: Proceedings of IEEE Conference on Decision and Control, pp. 4865–4870 (2000)Google Scholar
  3. 3.
    Bainbridge, W.A., Hart, J., Kim, E.S., Scassellati, B.: Fan-out: Measuring human control of multiple robots. In: The 17th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN, pp. 701–706 (August 2008)Google Scholar
  4. 4.
    Balch, T., Arkin, R.: Behavior-based formation control for multirobot teams. IEEE Transactions on Robotics and Automation 14(6), 926–939 (1998)CrossRefGoogle Scholar
  5. 5.
    Bertrand, J.W.M., van Ooijen, H.P.G.: Workload based order release and productivity: a missing link. Production Planning and Control 13(7), 665–678 (2002)CrossRefGoogle Scholar
  6. 6.
    Billings, D.R., Schaefer, K.E., Chen, J.Y., Kocsis, V., Barrera, M., Cook, J., Ferrer, M., Hancock, P.A.: Human-animal trust as an analog for human-robot trust: A review of current evidence. Technical report, DTIC Document (2012)Google Scholar
  7. 7.
    Naval Studies Board. Autonomous vehicles in support of naval operations. National Research Council, Washington, DC (2005)Google Scholar
  8. 8.
    Bruemmer, D.J., Marble, J.L., Dudenhoeffer, D.D.: Mutual initiative in human-machine teams. In: Proceedings of the 2002 IEEE 7th Conference on Human Factors and Power Plants, pp. 7–22. IEEE (2002)Google Scholar
  9. 9.
    Cao, M., Stewart, A., Leonard, N.E.: Integrating human and robot decision-making dynamics with feedback: Models and convergence analysis. In: 47th IEEE Conference on Decision and Control, pp. 1127–1132 (December 2008)Google Scholar
  10. 10.
    Coeckelbergh, M.: Humans, animals, and robots: A phenomenological approach to human-robot relations. International Journal of Social Robotics 3(2), 197–204 (2011)CrossRefGoogle Scholar
  11. 11.
    Crandall, J.W., Goodrich, M.A., Olsen Jr., D.R., Nielsen, C.W.: Validating human-robot interaction schemes in multitasking environments. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 35(4), 438–449 (2005)CrossRefGoogle Scholar
  12. 12.
    Cummings, M.: Human supervisory control of swarming networks. In: 2nd Annual Swarming: Autonomous Intelligent Networked Systems Conference (2004)Google Scholar
  13. 13.
    Ding, X., Powers, M., Egerstedt, M., Young, S., Balch, T.: Executive decision support: Single-agent control of multiple uavs. IEEE Robotics & Automation Magazine 16(2), 73–81 (2009)CrossRefGoogle Scholar
  14. 14.
    Freedy, A., DeVisser, E., Weltman, G., Coeyman, N.: Measurement of trust in human-robot collaboration. In: International Symposium on Collaborative Technologies and Systems, pp. 106–114 (2007)Google Scholar
  15. 15.
    Ge, S.S., Khatib, O., Cabibihan, J.-J., Simmons, R., Williams, M.-A. (eds.): ICSR 2012. LNCS (LNAI), vol. 7621. Springer, Heidelberg (2012)Google Scholar
  16. 16.
    Goodrich, M.A., Schultz, A.C. (eds.): Human-Robot Interaction: A Survey (Foundations and Trends(r) in Human-Computer Interaction). Now Publishers Inc. (2008)Google Scholar
  17. 17.
    Hancock, P.A., Billings, D.R., Schaefer, K.E., Chen, J.Y.C., de Visser, E.J., Parasuraman, R.: A meta-analysis of factors affecting trust in human-robot interaction. Human Factors: The Journal of the Human Factors and Ergonomics Society 53, 517–527 (2011)CrossRefGoogle Scholar
  18. 18.
    Hanheide, M., Lohse, M., Zender, H.: Special issue on expectations, intentions & actions in human-robot interaction. International Journal of Social Robotics 4(2) (April 2012)Google Scholar
  19. 19.
    John, L., Moray, N.: Trust, control strategies and allocation of function in human-machine systems. Ergonomics 35(10), 1243–1270 (1992)CrossRefGoogle Scholar
  20. 20.
    Karwowski, W., Rahimi, M. (eds.): Human-Robot Interaction. Taylor & Francis (1992)Google Scholar
  21. 21.
    Kuzuoka, H., Evers, V., Imai, M., Forlizzi, J.: In: Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction, Tokyo, Japan (March 2013)Google Scholar
  22. 22.
    Lamers, M.H., Verbeek, F.J.: HRPR 2010. Revised Selected Papers Series: LNICST, vol. 59 (June 2010)Google Scholar
  23. 23.
    Laschi, C., Breazeal, C., Nakauchi, Y.: Guest editorial special issue on human-robot interaction. IEEE Transactions on Robotics 23(5) (2007)Google Scholar
  24. 24.
    Lee, J.D., See, K.A.: Trust in automation: Designing for appropriate reliance. Human Factors 46, 50–80 (2004)CrossRefGoogle Scholar
  25. 25.
    Lewandowsky, S., Mundy, M., Tan, G.: The dynamics of trust: Comparing humans to automation. Journal of Experimental Psychology: Applied 6(2), 104 (2000)Google Scholar
  26. 26.
    Liu, C.L., Layland, J.W.: Scheduling algorithms for multiprogramming in a hard- real-time environment scheduling algorithms for multiprogramming. Journal of the Association for Computing Machinery 20, 46–61 (1973)CrossRefMATHMathSciNetGoogle Scholar
  27. 27.
    Majji, M., Rai, R.: Autonomous task assignment of multiple operators for human robot interaction. In: American Control Conference, pp. 6454–6459 (June 2013)Google Scholar
  28. 28.
    Mendl, M.: Performing under pressure: stress and cognitive function. Applied Animal Behaviour Science 65(3), 221–244 (1999)CrossRefGoogle Scholar
  29. 29.
    Moray, N., Inagaki, T., Itoh, M.: Adaptive automation, trust, and self-confidence in fault management of time-critical tasks. Journal of Experimental Psychology: Applied 6(1), 44 (2000)Google Scholar
  30. 30.
    Murphy, R.R., Steimle, E., Hall, M., Lindemuth, M., Trejo, D., Hurlebaus, S., Medina-Cetina, Z., Slocum, D.: Multi-robot port-controlled hamiltonian systems under quantization. In: IEEE International Workshop on Safety, Security & Rescue Robotics (SSRR) (2009)Google Scholar
  31. 31.
    Sha, L., Arzen, K.E., Abdelzaher, T., Cervin, A., Baker, T., Burns, A., Buttazzo, G., Caccamo, M., Lehoczky, J., Mokd, A.K.: Real time scheduling theory: A historical perspective. Real-Time Systems 28, 101–155 (2004)CrossRefMATHGoogle Scholar
  32. 32.
    Sheridan, T.B.: Telerobotics, Automation, and Human Supervisory Control. The MIT Press (1992)Google Scholar
  33. 33.
    Sheridan, T.B. (ed.): Humans and automation: System design and research issues. Wiley (2002)Google Scholar
  34. 34.
    Sheridan, T.B.: Supervisory control of remote manipulators, vehicles and dynamic processes: Experiments in command and display aiding. Technical report, DTIC Document (1983)Google Scholar
  35. 35.
    Shi, Z., Zhang, F.: Predicting time-delays under real-time scheduling for linear model predictive control. In: International Conference on Computing, Networking and Communications. Workshops Cyber Physical System, pp. 205–209 (2013)Google Scholar
  36. 36.
    Wang, C., Zhang, F., Schaefer, D.: Dynamic modeling of an autonomous underwater vehicle: the ecomapper. In: Journal of Marine Science and Technology (2013) (under review)Google Scholar
  37. 37.
    Whetten, J., Goodrich, M., Guo, Y.: Beyond robot fan-out: Towards multioperator supervisory control. In: IEEE International Conference on Systems Man and Cybernetics (SMC), pp. 2008–2015 (2010)Google Scholar
  38. 38.
    Yerkes, R.M., Dodson, J.D.: The relation of strength of stimulus to rapidity of habit-formation. Journal of Comparative Neurology and Psychology 18(5), 459–482 (2004)CrossRefGoogle Scholar
  39. 39.
    Zhang, F., Shi, Z., Mukhopadhyay, S.: Robustness analysis for battery supported cyber-physical systems. ACM Transactions in Embedded Computing Systems 12(3), Article 6 (27 pages) (2013)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Yue Wang
    • 1
  • Zhenwu Shi
    • 2
  • Chuanfeng Wang
    • 3
  • Fumin Zhang
    • 2
  1. 1.Department of Mechanical EngineeringClemson UniversityClemsonUSA
  2. 2.School of Electrical and Computer EngineeringGeorgia Institute of TechnologyAtlantaUSA
  3. 3.George W. Woodruff School of Mechanical EngineeringGeorgia Institute of TechnologyAtlantaUSA

Personalised recommendations