Skip to main content

Workers’ Trust in Collaborative Construction Robots: EEG-Based Trust Recognition in an Immersive Environment

  • Chapter
  • First Online:
Automation and Robotics in the Architecture, Engineering, and Construction Industry

Abstract

Today, advances in robotics and autonomous systems enable construction workers to collaboratively work with robots, assigning physically demanding tasks to them. However, working alongside an industrial robot is a novel experience that may take a heavy toll on workers’ bodies and minds, particularly in dynamic and uncertain environments, such as construction sites. Given that trust is identified as a critical element for successful cooperation between humans and robots, effective measurement of workers’ trust in collaborative robots can lead to practical evaluation of human-robot partnership. In this context, most studies of trust have relied on self-reports. Nevertheless, questionnaires are unable to determine the trust promptly, impeding early preventive interventions. Furthermore, they are invasive, interfering with workers’ daily operations. To address these issues, this study proposes a procedure to non-invasively and continuously recognize workers’ trust in collaborative construction robots using electroencephalogram (EEG) signals. To that end, an experiment was conducted in which human workers performed a collaborative construction task (i.e., handling materials) with a virtual robot in an immersive environment. Meanwhile, workers’ EEG signals were recorded using a wearable sensor. Subsequently, the level of trust of the workers in collaborative robots was measured using the Trust Perception Scale-HRI. By analyzing acquired signals and applying different machine learning algorithms, it was found that EEG signals can be implemented to differentiate levels of trust of construction workers in their robotic counterparts. These findings suggest the feasibility of using workers’ EEG signals as a reliable, real-time indicator of trust in collaborative construction robots, which can be regarded as a practical approach for evaluating human-robot collaboration.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. C.-J. Liang, V.R. Kamat, C.C. Menassa, Teaching robots to perform quasi-repetitive construction tasks through human demonstration. Autom. Constr. 120, 103370 (2020). https://doi.org/10.1016/j.autcon.2020.103370

    Article  Google Scholar 

  2. S. You, J.-H. Kim, S. Lee, V. Kamat, L.P. Robert, Enhancing perceived safety in human–robot collaborative construction using immersive virtual environments. Autom. Constr. 96, 161–170 (2018). https://doi.org/10.1016/j.autcon.2018.09.008

    Article  Google Scholar 

  3. R.E. Yagoda, D.J. Gillan, You want me to trust a ROBOT? The development of a human–robot interaction trust scale. Int. J. Soc. Robot. 4, 235–248 (2012). https://doi.org/10.1007/s12369-012-0144-0

    Article  Google Scholar 

  4. B.C. Kok, H. Soh, Trust in Robots: Challenges and opportunities. Curr. Robot. Rep. 1, 297–309 (2020). https://doi.org/10.1007/s43154-020-00029-y

    Article  Google Scholar 

  5. M. Chen, S. Nikolaidis, H. Soh, D. Hsu, S. Srinivasa, Trust-aware decision making for human-robot collaboration. ACM Trans. Hum. Robot Inter. 9, 1–23 (2020). https://doi.org/10.1145/3359616

    Article  Google Scholar 

  6. J.-Y. Jian, A.M. Bisantz, C.G. Drury, Foundations for an empirically determined scale of trust in automated systems. Int. J. Cogn. Ergon. 4, 53–71 (2000). https://doi.org/10.1207/S15327566IJCE0401_04

    Article  Google Scholar 

  7. D. Miller, M. Johns, B. Mok, N. Gowda, D. Sirkin, K. Lee, W. Ju, Behavioral measurement of trust in automation. Proc. Hum. Fact. Ergonom. Soc. Ann. Meet. 60, 1849–1853 (2016). https://doi.org/10.1177/1541931213601422

    Article  Google Scholar 

  8. I.B. Ajenaghughrure, S.C. Sousa, I.J. Kosunen, D. Lamas, Predictive Model to Assess User Trust, in: Proceedings of the 10th Indian Conference on Human-Computer Interaction, ACM, New York, 2019: pp. 1–10. https://doi.org/10.1145/3364183.3364195

  9. K. Gupta, R. Hajika, Y.S. Pai, A. Duenser, M. Lochner, M. Billinghurst, Measuring human trust in a virtual assistant using physiological sensing in virtual reality. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), IEEE, 2020: pp. 756–765. https://doi.org/10.1109/VR46266.2020.00099

  10. K.E. Schaefer, Measuring trust in human robot interactions: Development of the “Trust Perception Scale-HRI,” in: Robust Intelligence and Trust in Autonomous Systems, Springer US, Boston, 2016: pp. 191–218. https://doi.org/10.1007/978-1-4899-7668-0_10

  11. Y. Lu, N. Sarter, Eye tracking: A process-oriented method for inferring Trust in Automation as a function of priming and system reliability. IEEE Trans Hum Mach Syst 49, 560–568 (2019). https://doi.org/10.1109/THMS.2019.2930980

    Article  Google Scholar 

  12. S. Shahrdar, L. Menezes, M. Nojoumian, A survey on trust in autonomous systems. In: 2019: pp. 368–386. https://doi.org/10.1007/978-3-030-01177-2_27

  13. W.-L. Hu, K. Akash, N. Jain, T. Reid, Real-time sensing of trust in human-machine interactions. IFAC-PapersOnLine 49, 48–53 (2016)

    Article  MathSciNet  Google Scholar 

  14. F. Ekman, M. Johansson, J. Sochor, Creating appropriate Trust in Automated Vehicle Systems: A framework for HMI design. IEEE Trans. Hum.-Mach. Syst. 48, 95–101 (2018). https://doi.org/10.1109/THMS.2017.2776209

    Article  Google Scholar 

  15. A.L. Baker, E.K. Phillips, D. Ullman, J.R. Keebler, Toward an understanding of trust repair in human-robot interaction. ACM Trans Interact. Intell. Syst. 8, 1–30 (2018). https://doi.org/10.1145/3181671

    Article  Google Scholar 

  16. K. Akash, W.-L. Hu, N. Jain, T. Reid, A classification model for sensing human trust in machines using EEG and GSR. ACM Trans. Interact. Intell. Syst. 8, 1–20 (2018). https://doi.org/10.1145/3132743

    Article  Google Scholar 

  17. M. Natarajan, M. Gombolay, Effects of Anthropomorphism and Accountability on Trust in Human Robot Interaction, in: Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, ACM, New York, 2020: pp. 33–42. https://doi.org/10.1145/3319502.3374839

  18. P.A. Hancock, D.R. Billings, K.E. Schaefer, J.Y.C. Chen, E.J. de Visser, R. Parasuraman, A meta-analysis of factors affecting Trust in Human-Robot Interaction, human factors. J. Hum. Fact. Ergonom. Soc. 53, 517–527 (2011). https://doi.org/10.1177/0018720811417254

    Article  Google Scholar 

  19. R. Riedl, A. Javor, The biology of trust: Integrating evidence from genetics, endocrinology, and functional brain imaging. J. Neurosci. Psychol. Econ. 5, 63–91 (2012). https://doi.org/10.1037/a0026318

    Article  Google Scholar 

  20. A. Freedy, E. DeVisser, G. Weltman, N. Coeyman, Measurement of trust in human-robot collaboration. In: 2007 International Symposium on Collaborative Technologies and Systems, IEEE, 2007: pp. 106–114. https://doi.org/10.1109/CTS.2007.4621745

  21. M. Salem, G. Lakatos, F. Amirabdollahian, K. Dautenhahn, Would You Trust a (Faulty) Robot?, in: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction, ACM, New York, 2015: pp. 141–148. https://doi.org/10.1145/2696454.2696497

  22. A. Khawaji, J. Zhou, F. Chen, N. Marcus, Using Galvanic Skin Response (GSR) to Measure Trust and Cognitive Load in the Text-Chat Environment, in: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA ‘15, ACM Press, New York, 2015: pp. 1989–1994. https://doi.org/10.1145/2702613.2732766

  23. C. Boudreau, M.D. McCubbins, S. Coulson, Knowing when to trust others: An ERP study of decision making after receiving information from unknown people. Soc. Cogn. Affect. Neurosci. 4, 23–34 (2009). https://doi.org/10.1093/scan/nsn034

    Article  Google Scholar 

  24. M. Soleymani, S. Asghari-Esfeden, M. Pantic, Y. Fu, Continuous emotion detection using EEG signals and facial expressions, Proceedings - IEEE International Conference on Multimedia and Expo. 2014-Septe (2014) 1–6. https://doi.org/10.1109/ICME.2014.6890301

  25. S. Hwang, A.M. Asce, H. Jebelli, S.M. Asce, B. Choi, M. Choi, S. Lee, M. Asce, Measuring workers’ emotional state during construction tasks using wearable EEG. J. Constr. Eng. Manag. 144 (2018). https://doi.org/10.1061/(ASCE)CO.1943-7862.0001506

  26. H. Jebelli, S. Hwang, S.H. Lee, EEG-based workers’ stress recognition at construction sites. Autom. Constr. 93, 315–324 (2018). https://doi.org/10.1016/j.autcon.2018.05.027

    Article  Google Scholar 

  27. H. Jebelli, M.M. Khalili, S. Lee, Mobile EEG-based workers’ stress recognition by applying deep neural network, in Advances in Informatics and Computing in Civil and Construction Engineering, (Springer, 2019), pp. 173–180. https://doi.org/10.1007/978-3-030-00220-6_21

    Chapter  Google Scholar 

  28. Y. Liu, M. Habibnezhad, H. Jebelli, Brain-computer interface for hands-free teleoperation of construction robots. Autom. Constr. 123, 103523 (2021). https://doi.org/10.1016/j.autcon.2020.103523

    Article  Google Scholar 

  29. Y. Liu, M. Habibnezhad, H. Jebelli, Brainwave-driven human-robot collaboration in construction. Autom. Constr. 124, 103556 (2021). https://doi.org/10.1016/j.autcon.2021.103556

    Article  Google Scholar 

  30. N.S. Altman, An introduction to kernel and nearest-neighbor nonparametric regression. Am. Stat. 46, 175 (1992). https://doi.org/10.2307/2685209

    Article  MathSciNet  Google Scholar 

  31. K. Beyer, J. Goldstein, R. Ramakrishnan, U. Shaft, When is “nearest neighbor” meaningful? in International Conference on Database Theory, (1999), pp. 217–235. https://doi.org/10.1007/3-540-49257-7_15

    Chapter  Google Scholar 

  32. L. Changchun, P. Rani, N. Sarkar, An empirical study of machine learning techniques for affect recognition in human-robot interaction, in 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, (IEEE, 2005), pp. 2662–2667. https://doi.org/10.1109/IROS.2005.1545344

    Chapter  Google Scholar 

  33. D.R. Edla, K. Mangalorekar, G. Dhavalikar, S. Dodia, Classification of EEG data for human mental state analysis using random Forest classifier. Procedia Comp. Sci. 132, 1523–1532 (2018). https://doi.org/10.1016/j.procs.2018.05.116

    Article  Google Scholar 

  34. M. Habibnezhad, S. Shayesteh, H. Jebelli, J. Puckett, T. Stentz, Comparison of ironworker’ fall risk assessment systems using an immersive biofeedback simulator. Autom. Constr. 103471 (2020). https://doi.org/10.1016/j.autcon.2020.103471

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Houtan Jebelli .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Shayesteh, S., Ojha, A., Jebelli, H. (2022). Workers’ Trust in Collaborative Construction Robots: EEG-Based Trust Recognition in an Immersive Environment. In: Jebelli, H., Habibnezhad, M., Shayesteh, S., Asadi, S., Lee, S. (eds) Automation and Robotics in the Architecture, Engineering, and Construction Industry. Springer, Cham. https://doi.org/10.1007/978-3-030-77163-8_10

Download citation

Publish with us

Policies and ethics