Sensitivity, Bias, and Mental Workload in a Multitasking Environment

  • Monika Putri
  • Xiaonan Yang
  • Jung Hyup KimEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9736)


In this paper, we used signal detection theory (SDT) as a tool to evaluate human performance in a multitasking environment. The primary objective of using SDT is to assess an operator’s sensitivity (d’) and bias (β). In addition, NASA-TLX was used to measure participants’ workload under different complexity scenarios. During the experiment, participants were asked to detect abnormal and alarm signals on a gauge monitoring display. They also needed to perform multi-attribute task battery (MATB) tasks at the same time. The gauge-monitoring screen contains total 52 gauges (flow, level, temperature, and pressure). The MATB consists of system monitoring, target tracking, and dynamic resource management. The results of this study demonstrate that participants showed various levels of sensitivity (d’) in the gauge-monitoring task based on the degree of task complexity.


Signal detection theory Human-in-the-loop simulation Mental workload 


  1. Bullemer, P., Reising, D.V., Jones, M.: ASM® Consortium White Paper (2009)Google Scholar
  2. Cao, A., Chintamani, K.K., Pandya, A.K., Ellis, R.D.: NASA TLX: software for assessing subjective mental workload. Behav. Res. Methods 41(1), 113–117 (2009)CrossRefGoogle Scholar
  3. García-Pérez, M.A., Alcalá-Quintana, R.: Interval bias in 2AFC detection tasks: sorting out the artifacts. Atten. Percept. Psychophys. 73(7), 2332–2352 (2011)CrossRefGoogle Scholar
  4. Hancock, P., Williams, G., Manning, C.: Influence of task demand characteristics on workload and performance. Int. J. Aviat. Psychol. 5(1), 63–86 (1995)CrossRefGoogle Scholar
  5. Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. Adv. Psychol. 52, 139–183 (1988)CrossRefGoogle Scholar
  6. Kim, J.H., Rothrock, L., Laberge, J.: Using Signal Detection Theory and Time Window-based Human-In-The-Loop simulation as a tool for assessing the effectiveness of different qualitative shapes in continuous monitoring tasks. Applied ergonomics 45(3), 693–705 (2014)CrossRefGoogle Scholar
  7. Kim, J.H., Rothrock, L., Laberge, J.: Arousal and performance in a process monitoring task using signal detection theory. In: Paper presented at the Proceedings of the Human Factors and Ergonomics Society Annual Meeting (2015)Google Scholar
  8. Lerman, D.C., Tetreault, A., Hovanetz, A., Bellaci, E., Miller, J., Karp, H., Keyl, A.: Applying signal-detection theory to the study of observer accuracy and bias in behavioral assessment. J. Appl. Behav. Anal. 43(2), 195–213 (2010)CrossRefGoogle Scholar
  9. Noah, B., Kim, J.-H., Rothrock, L., Tharanathan, A.: Evaluating alternate visualization techniques for overview displays in process control. IIE Trans. Occup. Ergonomics Hum. Factors 2(3–4), 152–168 (2014)CrossRefGoogle Scholar
  10. Pashler, H.: Dual-task interference in simple tasks: data and theory. Psychol. Bull. 116(2), 220 (1994)CrossRefGoogle Scholar
  11. Ratwani, R.M., McCurry, J.M., Trafton, J.G.: Single operator, multiple robots: an eye movement based theoretic model of operator situation awareness. In: Paper presented at the Proceedings of the 5th ACM/IEEE International Conference on Human-Robot Interaction (2010)Google Scholar
  12. Santiago-Espada, Y., Myer, R.R., Latorella, K. A., Comstock Jr., J.R.: The Multi-Attribute Task Battery II (MATB-II) software for human performance and workload research: a user’s guide. NASA Tech Memorandum, 217164 (2011)Google Scholar
  13. Singh, I.L., Singh, A.L., Tiwari, T., Saha, P.K.: Multi-task performance in computer-aided systems: an appraisal. J. Indian Acad. Appl. Psychol. 34(1), 115–125 (2008)Google Scholar
  14. Spector, A., Biederman, I.: Mental set and ental shift revisited. Am. J. Psychol. 669–679 (1976)Google Scholar
  15. Walker, A., Brewster, S.: Spatial audio in small screen device displays. Pers. Technol. 4(2–3), 144–154 (2000)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Department of Industrial and Manufacturing Systems EngineeringUniversity of MissouriColumbiaUSA

Personalised recommendations