A Method to Monitor Operator Overloading

  • Dvijesh Shastri
  • Ioannis Pavlidis
  • Avinash Wesley
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5610)


This paper describes research that aims to quantify stress levels of operators who perform multiple tasks. The proposed method is based on the thermal signature of the face. It measures physiological function from a stand-off distance and therefore, it can unobtrusively monitor a machine operator. The method was tested on 11 participants. The results show that multi-tasking elevates metabolism in the supraorbital area, which is an indirect indication of increased mental load. This local metabolic change alters heat dissipation and thus, it can be measured through thermal imaging. The methodology could serve as a benchmarking tool in scenarios where an operator’s divided attention may cause harmful outcomes. A classic example is the case of a vehicle driver who talks on the cell phone. This stress measurement method when combined with user performance metrics can delineate optimal operational envelopes.


Human-Machine Interaction divided attention stress thermal imaging 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Puri, C., Olson, L., Pavlidis, I., Levine, J., Starren, J.: StressCam: Non-contact measurement of users’ emotional states through thermal imaging. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems, pp. 1725–1728 (2005)Google Scholar
  2. 2.
    Palvidis, I., Eberhardt, N.L., Levine, J.: Human behavior: Seeing through the face of deception. Nature 415, 35 (2002)Google Scholar
  3. 3.
    Palvidis, I., Levine, J.: Thermal image analysis for polygraph testing. IEEE Engineering in Medicine and Biology Magazine 21(6), 56–64 (2002)CrossRefGoogle Scholar
  4. 4.
    Dowdall, J., Pavlidis, I., Tsiamyrtzis, P.: Coalitional tracking. Computer Vision and Image Understanding 106, 205–219 (2007)CrossRefGoogle Scholar
  5. 5.
    Tsiamyrtzis, P., Dowdall, J., Shastri, D., Pavlidis, I., Frank, M.G., Ekman, P.: Imaging facial physiology for the detection of deceit. International Journal of Computer Vision 71(2), 197–214 (2006)CrossRefGoogle Scholar
  6. 6.
    Standage, D.I., Trappenberg, T.P., Klein, R.M.: A continuous attractor neural network model of divided visual attention. In: Processing of IEEE international Joint Conference on Neural Networks, vol. 5, pp. 2897–2902 (2005)Google Scholar
  7. 7.
    Yamakoshi, T., Yamakoshi, K., Tanaka, S., Nogawa, M., Shibata, M., Sawada, Y., Rolfe, P., Hirose, Y.: A Preliminary Study on Driver’s Stress Index Using a New Method Based on Differential Skin Temperature Measurement. In: 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 722–725 (2007)Google Scholar
  8. 8.
    Yamaguchi, M., Wakasugi, J., Sakakima, J.: Evaluation of Driver Stress using Biomarker in Motor-vehicle Driving Simulator. In: 28th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 1834–1837 (2006)Google Scholar
  9. 9.
    Yili, L.: A queuing network model of human performance of concurrent spatial and verbal tasks. IEEE Transactions on Systems, Man and Cybernetics 27(2), 195–207 (1997)CrossRefGoogle Scholar
  10. 10.
    Kenmochi, A., Takaki, Y., Fukuzumi, S.: Psychological tension estimation during the use of a driving simulator: A finger and ear pulse volume study. In: Proceedings of the 18th Annual International Conference of the IEEE Bridging Disciplines for Biomedicine, vol. 5, pp. 1804–1805 (1996)Google Scholar
  11. 11.
    Healey, J.A., Picard, R.W.: Detecting stress during real-world driving tasks using physiological sensors. IEEE Transactions on Intelligent Transportation Systems 6, 156–166 (2005)CrossRefGoogle Scholar
  12. 12.
    FLIR Systems, 70 Castilian Dr., Goleta, California 93117,

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Dvijesh Shastri
    • 1
  • Ioannis Pavlidis
    • 1
  • Avinash Wesley
    • 1
  1. 1.Computational Physiology Lab, Department of Computer ScienceUniversity of HoustonHoustonUSA

Personalised recommendations