Effect of Speech Display on Team Mutual Awareness and Diagnosis Performance

  • Yingzhi ZhangEmail author
  • Zhizhong Li
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9736)


In many complex industrial systems, a team works together on digital systems. Team members need to gather information efficiently to maintain mutual awareness and do well in dealing with what may happen in the system. This research studies the effect of speech display in mutual awareness tools on team mutual awareness, individual performance, mental workload and team performance in simulated emergent diagnosis tasks of nuclear power plants at different task complexity levels. An experiment was conducted with 48 subjects (24 teams). Every team completed two scenarios. The results showed that speech display improved team mutual awareness in the low-complexity scenario. However, the teams without speech display did better in analyzing the accident than the teams with speech display in the low-complexity scenario. Furthermore, the teams with speech display were under higher workload.


Speech display Mutual awareness Team performance Complex industrial system 



This work was supported by the National Natural Science Foundation of China (Grant No. 71371104) and the Open Funding Project of National Key Laboratory of Human Factors Engineering (Grant No. HF2012-K-02).


  1. 1.
    Gutwin, C., Greenberg, S.: Effects of awareness support on groupware usability. In: Proceedings of International Conference on Human Factors in Computing System, pp. 511–518 (1998)Google Scholar
  2. 2.
    Schmidt, K.: Some notes on mutual awareness, COTCOS-Report, Universidade Técnica da Dinamarca, disponıvel em, último acesso em Jan 1998
  3. 3.
    Oviatt, S., Coulston, R., Lunsford, R.: When do we interact multimodally? cognitive load and multimodal communication pattern. In: Proceedings of the 6th International Conference on Multimodal Interfaces, pp. 129–136 (2004)Google Scholar
  4. 4.
    Sarter, N.: B,: Multimodal information presentation in support of human-automation communication and coordination. Adv. Hum. Perform. Cogn. Eng. Res. 2, 13–35 (2002)CrossRefGoogle Scholar
  5. 5.
    Dowell, J., Shmueli, Y., Kingdom, U.: Blending speech output and visual text in the multimodal. Interface 50(5), 782–788 (2008)Google Scholar
  6. 6.
    Kalyuga, U., Chandler, P., Sweller, J.: cc in Multimedia Instruction, vol. 371, April 1998, pp. 351–372 (1999)Google Scholar
  7. 7.
    Moreno, R., Mayer, R.E.: Learning science in virtual reality multimedia environments: role of methods and media. J. Educ. Psychol. 94(3), 598 (2002)CrossRefGoogle Scholar
  8. 8.
    Wickens, C.D.: Multiple resources and performance prediction. Ergon. Psychol. Mech. Model. Ergon. 83 (2005)Google Scholar
  9. 9.
    Wickens, C.D., Liu, Y.: Codes and modalities in multiple resources: a success and a qualification. Hum. Factors J. Hum. Factors Ergon. Soc. 30(5), 599–616 (1988)Google Scholar
  10. 10.
    Horrey, W.J., Wickens, C.D.: Driving and side task performance: the effects of display. Hum. Factors. 46(4), 611–624 (2004)CrossRefGoogle Scholar
  11. 11.
    Xihui, Y., Zhizhong, L.: Effects of mutual awareness on team performance in accident diagnosis under computerized working environment. Dept. of Industrial engineering, Tsinghua University (2015)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Department of Industrial EngineeringTsinghua UniversityBeijingPeople’s Republic of China

Personalised recommendations