Analysis of Trust in Automation Survey Instruments Using Semantic Network Analysis
This study analyzed existing survey instruments to provide an integrated list of keywords/constructs to measure the various perceptions of trust building in automation. While the trust between users and automated functions or systems has been an area of substantial research interest to understand the interactions between human and automation, research efforts to measure the trust to date have led to inconclusive and mixed outcomes. Of the existing scales for measuring trust in automation, inadequate development of constructs and the lack of reliability and validity have been identified as major causes for such outcomes. To develop a scale in a more objective and systematic approach, 86 keywords from existing 9 survey instruments were identified. The keyword network was developed based on the semantic textural similarity, and the network centrality analysis provided total 14 keywords with high centrality and degree matrics. The results can suggest some potential solutions about the lack of consistency and the wide array of constructs without adequate analytic justification in prior survey instruments. The outcomes will be utilized to develop a new integrated scale that can be generally applicable to a wide variety of automation adoption or, with slight modifications, in most trust in automation applications.
KeywordsTrust in automation Natural language processing Network analysis Semantic textural similarity
- 3.Jeong, H., Park, J., Park, J., Lee, B.C.: Inconsistent work performance in automation, can we measure trust in automation. Int. Robot. Autom. J. 3, 00075 (2017)Google Scholar
- 17.Madsen, M., Gregor, S.: Measuring human-computer trust. In: 11th Australasian Conference on Information Systems, pp. 6–8. Citeseer (2000)Google Scholar
- 18.Chien, S.-Y., Semnani-Azad, Z., Lewis, M., Sycara, K.: Towards the development of an inter-cultural scale to measure trust in automation. In: International Conference on Cross-Cultural Design, pp. 35–46. Springer (2014)Google Scholar
- 22.Mcknight, D.H., Carter, M., Thatcher, J.B., Clay, P.F.: Trust in a specific technology: an investigation of its components and measures. ACM Trans. Manag. Inf. Syst. TMIS 2, 12 (2011)Google Scholar
- 23.Han, L., Kashyap, A.L., Finin, T., Mayfield, J., Weese, J.: UMBC_EBIQUITY-CORE: semantic textual similarity systems. In: * SEM@ NAACL-HLT, pp. 44–52 (2013)Google Scholar