Abstract
Today, advances in robotics and autonomous systems enable construction workers to collaboratively work with robots, assigning physically demanding tasks to them. However, working alongside an industrial robot is a novel experience that may take a heavy toll on workers’ bodies and minds, particularly in dynamic and uncertain environments, such as construction sites. Given that trust is identified as a critical element for successful cooperation between humans and robots, effective measurement of workers’ trust in collaborative robots can lead to practical evaluation of human-robot partnership. In this context, most studies of trust have relied on self-reports. Nevertheless, questionnaires are unable to determine the trust promptly, impeding early preventive interventions. Furthermore, they are invasive, interfering with workers’ daily operations. To address these issues, this study proposes a procedure to non-invasively and continuously recognize workers’ trust in collaborative construction robots using electroencephalogram (EEG) signals. To that end, an experiment was conducted in which human workers performed a collaborative construction task (i.e., handling materials) with a virtual robot in an immersive environment. Meanwhile, workers’ EEG signals were recorded using a wearable sensor. Subsequently, the level of trust of the workers in collaborative robots was measured using the Trust Perception Scale-HRI. By analyzing acquired signals and applying different machine learning algorithms, it was found that EEG signals can be implemented to differentiate levels of trust of construction workers in their robotic counterparts. These findings suggest the feasibility of using workers’ EEG signals as a reliable, real-time indicator of trust in collaborative construction robots, which can be regarded as a practical approach for evaluating human-robot collaboration.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
C.-J. Liang, V.R. Kamat, C.C. Menassa, Teaching robots to perform quasi-repetitive construction tasks through human demonstration. Autom. Constr. 120, 103370 (2020). https://doi.org/10.1016/j.autcon.2020.103370
S. You, J.-H. Kim, S. Lee, V. Kamat, L.P. Robert, Enhancing perceived safety in human–robot collaborative construction using immersive virtual environments. Autom. Constr. 96, 161–170 (2018). https://doi.org/10.1016/j.autcon.2018.09.008
R.E. Yagoda, D.J. Gillan, You want me to trust a ROBOT? The development of a human–robot interaction trust scale. Int. J. Soc. Robot. 4, 235–248 (2012). https://doi.org/10.1007/s12369-012-0144-0
B.C. Kok, H. Soh, Trust in Robots: Challenges and opportunities. Curr. Robot. Rep. 1, 297–309 (2020). https://doi.org/10.1007/s43154-020-00029-y
M. Chen, S. Nikolaidis, H. Soh, D. Hsu, S. Srinivasa, Trust-aware decision making for human-robot collaboration. ACM Trans. Hum. Robot Inter. 9, 1–23 (2020). https://doi.org/10.1145/3359616
J.-Y. Jian, A.M. Bisantz, C.G. Drury, Foundations for an empirically determined scale of trust in automated systems. Int. J. Cogn. Ergon. 4, 53–71 (2000). https://doi.org/10.1207/S15327566IJCE0401_04
D. Miller, M. Johns, B. Mok, N. Gowda, D. Sirkin, K. Lee, W. Ju, Behavioral measurement of trust in automation. Proc. Hum. Fact. Ergonom. Soc. Ann. Meet. 60, 1849–1853 (2016). https://doi.org/10.1177/1541931213601422
I.B. Ajenaghughrure, S.C. Sousa, I.J. Kosunen, D. Lamas, Predictive Model to Assess User Trust, in: Proceedings of the 10th Indian Conference on Human-Computer Interaction, ACM, New York, 2019: pp. 1–10. https://doi.org/10.1145/3364183.3364195
K. Gupta, R. Hajika, Y.S. Pai, A. Duenser, M. Lochner, M. Billinghurst, Measuring human trust in a virtual assistant using physiological sensing in virtual reality. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), IEEE, 2020: pp. 756–765. https://doi.org/10.1109/VR46266.2020.00099
K.E. Schaefer, Measuring trust in human robot interactions: Development of the “Trust Perception Scale-HRI,” in: Robust Intelligence and Trust in Autonomous Systems, Springer US, Boston, 2016: pp. 191–218. https://doi.org/10.1007/978-1-4899-7668-0_10
Y. Lu, N. Sarter, Eye tracking: A process-oriented method for inferring Trust in Automation as a function of priming and system reliability. IEEE Trans Hum Mach Syst 49, 560–568 (2019). https://doi.org/10.1109/THMS.2019.2930980
S. Shahrdar, L. Menezes, M. Nojoumian, A survey on trust in autonomous systems. In: 2019: pp. 368–386. https://doi.org/10.1007/978-3-030-01177-2_27
W.-L. Hu, K. Akash, N. Jain, T. Reid, Real-time sensing of trust in human-machine interactions. IFAC-PapersOnLine 49, 48–53 (2016)
F. Ekman, M. Johansson, J. Sochor, Creating appropriate Trust in Automated Vehicle Systems: A framework for HMI design. IEEE Trans. Hum.-Mach. Syst. 48, 95–101 (2018). https://doi.org/10.1109/THMS.2017.2776209
A.L. Baker, E.K. Phillips, D. Ullman, J.R. Keebler, Toward an understanding of trust repair in human-robot interaction. ACM Trans Interact. Intell. Syst. 8, 1–30 (2018). https://doi.org/10.1145/3181671
K. Akash, W.-L. Hu, N. Jain, T. Reid, A classification model for sensing human trust in machines using EEG and GSR. ACM Trans. Interact. Intell. Syst. 8, 1–20 (2018). https://doi.org/10.1145/3132743
M. Natarajan, M. Gombolay, Effects of Anthropomorphism and Accountability on Trust in Human Robot Interaction, in: Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, ACM, New York, 2020: pp. 33–42. https://doi.org/10.1145/3319502.3374839
P.A. Hancock, D.R. Billings, K.E. Schaefer, J.Y.C. Chen, E.J. de Visser, R. Parasuraman, A meta-analysis of factors affecting Trust in Human-Robot Interaction, human factors. J. Hum. Fact. Ergonom. Soc. 53, 517–527 (2011). https://doi.org/10.1177/0018720811417254
R. Riedl, A. Javor, The biology of trust: Integrating evidence from genetics, endocrinology, and functional brain imaging. J. Neurosci. Psychol. Econ. 5, 63–91 (2012). https://doi.org/10.1037/a0026318
A. Freedy, E. DeVisser, G. Weltman, N. Coeyman, Measurement of trust in human-robot collaboration. In: 2007 International Symposium on Collaborative Technologies and Systems, IEEE, 2007: pp. 106–114. https://doi.org/10.1109/CTS.2007.4621745
M. Salem, G. Lakatos, F. Amirabdollahian, K. Dautenhahn, Would You Trust a (Faulty) Robot?, in: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction, ACM, New York, 2015: pp. 141–148. https://doi.org/10.1145/2696454.2696497
A. Khawaji, J. Zhou, F. Chen, N. Marcus, Using Galvanic Skin Response (GSR) to Measure Trust and Cognitive Load in the Text-Chat Environment, in: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA ‘15, ACM Press, New York, 2015: pp. 1989–1994. https://doi.org/10.1145/2702613.2732766
C. Boudreau, M.D. McCubbins, S. Coulson, Knowing when to trust others: An ERP study of decision making after receiving information from unknown people. Soc. Cogn. Affect. Neurosci. 4, 23–34 (2009). https://doi.org/10.1093/scan/nsn034
M. Soleymani, S. Asghari-Esfeden, M. Pantic, Y. Fu, Continuous emotion detection using EEG signals and facial expressions, Proceedings - IEEE International Conference on Multimedia and Expo. 2014-Septe (2014) 1–6. https://doi.org/10.1109/ICME.2014.6890301
S. Hwang, A.M. Asce, H. Jebelli, S.M. Asce, B. Choi, M. Choi, S. Lee, M. Asce, Measuring workers’ emotional state during construction tasks using wearable EEG. J. Constr. Eng. Manag. 144 (2018). https://doi.org/10.1061/(ASCE)CO.1943-7862.0001506
H. Jebelli, S. Hwang, S.H. Lee, EEG-based workers’ stress recognition at construction sites. Autom. Constr. 93, 315–324 (2018). https://doi.org/10.1016/j.autcon.2018.05.027
H. Jebelli, M.M. Khalili, S. Lee, Mobile EEG-based workers’ stress recognition by applying deep neural network, in Advances in Informatics and Computing in Civil and Construction Engineering, (Springer, 2019), pp. 173–180. https://doi.org/10.1007/978-3-030-00220-6_21
Y. Liu, M. Habibnezhad, H. Jebelli, Brain-computer interface for hands-free teleoperation of construction robots. Autom. Constr. 123, 103523 (2021). https://doi.org/10.1016/j.autcon.2020.103523
Y. Liu, M. Habibnezhad, H. Jebelli, Brainwave-driven human-robot collaboration in construction. Autom. Constr. 124, 103556 (2021). https://doi.org/10.1016/j.autcon.2021.103556
N.S. Altman, An introduction to kernel and nearest-neighbor nonparametric regression. Am. Stat. 46, 175 (1992). https://doi.org/10.2307/2685209
K. Beyer, J. Goldstein, R. Ramakrishnan, U. Shaft, When is “nearest neighbor” meaningful? in International Conference on Database Theory, (1999), pp. 217–235. https://doi.org/10.1007/3-540-49257-7_15
L. Changchun, P. Rani, N. Sarkar, An empirical study of machine learning techniques for affect recognition in human-robot interaction, in 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, (IEEE, 2005), pp. 2662–2667. https://doi.org/10.1109/IROS.2005.1545344
D.R. Edla, K. Mangalorekar, G. Dhavalikar, S. Dodia, Classification of EEG data for human mental state analysis using random Forest classifier. Procedia Comp. Sci. 132, 1523–1532 (2018). https://doi.org/10.1016/j.procs.2018.05.116
M. Habibnezhad, S. Shayesteh, H. Jebelli, J. Puckett, T. Stentz, Comparison of ironworker’ fall risk assessment systems using an immersive biofeedback simulator. Autom. Constr. 103471 (2020). https://doi.org/10.1016/j.autcon.2020.103471
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Shayesteh, S., Ojha, A., Jebelli, H. (2022). Workers’ Trust in Collaborative Construction Robots: EEG-Based Trust Recognition in an Immersive Environment. In: Jebelli, H., Habibnezhad, M., Shayesteh, S., Asadi, S., Lee, S. (eds) Automation and Robotics in the Architecture, Engineering, and Construction Industry. Springer, Cham. https://doi.org/10.1007/978-3-030-77163-8_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-77163-8_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77162-1
Online ISBN: 978-3-030-77163-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)