Abstract
Fatigue is an important factor in aviation accidents and incidents. Since fatigue cannot always be prevented, it needs to be detected in real time so that countermeasures can be taken. This study researches whether vocal changes (in vocal intensity and fundamental frequency) can be used as a measure for fatigue in an operational aviation setting. Sixteen participants were measured two times. Before the first test moment, they were asked to sleep eight hours or more and before the second test moment six hours or less. During each test moment, they performed a PVT, filled in the KSS, and did two speech tasks. One task was aimed at free speech and one task was aimed at procedural speech. Pre-processing included segmentation of the speech into words and extracting fundamental frequency (f0) and intensity values. An overall mean of both variables was calculated for both free and procedural speech. Speech, PVT reaction time, PVT lapses and KSS scores were analyzed in SPSS using Paired Samples t-Tests and Wilcoxon Signed Ranks Tests. Participants slept significantly less during the night before the second test moment and scored significantly higher on the KSS. For the PVT, no differences in both reaction time and lapses were found. No significant differences in average f0 and intensity for both free and procedural speech were found either. The results did not show a significant relationship between fundamental frequency, intensity and fatigue. Further research is needed to examine if vocal changes can be used as a reliable fatigue measure.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Roelen, A.L.C., Stuut, R.: Association of sleep deprivation with speech volume and pitch. In: Ergonomics & Human Factors 2016, Daventry, United Kingdom, pp. 19–21 (2016)
de Vasconcelos, C.A., Vieira, M.N., Kecklund, G., Yehia, H.C.: Speech analysis for fatigue and sleepiness detection of a pilot. Aerosp. Med. Hum. Perform. 90(4), 415–418 (2019)
Caldwell, J.A.: Fatigue in aviation. Travel Med. Infect. Dis. 3(2), 85–96 (2005)
Ruudin-Brown, C., Rosberg, A., Krukowski, D.: If we’d only listen! What can tell us about aircrew fatigue. In: 20th International Symposium on Aviation Psychology, pp. 319–324 (2019)
Boksem, M.A.S., Meijman, T.F., Lorist, M.M.: Effects of mental fatigue on attention: An ERP study. Cogn. Brain Res. 25(1), 107–116 (2005)
van der Linden, D., Frese, M., Meijman, T.F.: Mental fatigue and the control of cognitive processes: effects on perseveration and planning. Acta Psychol. 113(1), 45–65 (2003)
Lorist, M.M., Boksem, M.A.S., Ridderinkhof, K.R.: Impaired cognitive control and reduced cingulate activity during mental fatigue. Cogn. Brain Res. 24(2), 199–205 (2005)
Lee, I., Bardwell, W.A., Ancoli-Israel, S., Dimsdale, J.E.: Number of lapses during the psychomotor vigilance task as an objective measure of fatigue. J. Clin. Sleep Med. 6(2), 163–168 (2010)
Zhang, C., Yu, X.: Estimating mental fatigue based on electroencephalogram and heart rate variability. Pol. J. Med. Phys. Eng. 16(2), 67–84 (2010)
Aalto University Wiki: Fundamental frequency (F0) - Introduction to Speech Processing, https://wiki.aalto.fi/display/ITSP/Introduction+to+Speech+Processing. Accessed 2019
Intro 4.2. Configuring the pitch contour. https://www.fon.hum.uva.nl/praat/manual/Intro_4_2__Configuring_the_pitch_contour.html. Accessed 2019
Baykaner, K., Huckvale, M., Whiteley, I., Ryumin, O., Andreeva, S.: The prediction of fatigue using speech as a biosignal. In: Dediu, A.H., MartÃn-Vide, C., Vicsi, K. (eds.) Statistical Language and Speech Processing. SLSP. Lecture Notes in Computer Science, vol. 9449, pp. 8–17. Springer, Cham (2015)
Krajewski, J., Batliner, A., Golz, M.: Acoustic sleepiness detection: framework and validation of a speech-adapted pattern recognition approach. Behav. Res. Methods 41(3), 795–804 (2009)
Krajewski, J., Trutschel, U., Golz, M., Sommer, D., Edwards, D.: Estimating fatigue from predetermined speech samples transmitted by operator communication systems. In: Proceedings of the 5th International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design : Driving Assessment 2009, pp. 468–474 (2009)
Ruiz, R., Legros, C., Guell, A.: Voice analysis to predict the psychological or physical state of a speaker. Aviat. Space Environ. Med. 61, 266–271 (1990)
Alhola, P., Polo-Kantola, P.: Sleep deprivation: Impact on cognitive performance. Neuropsychiatric Dis. Treat. 3(5), 553–567 (2007)
Psychlab 101 (Version 2.1.0) [Software]: Neurobehavioral Systems. https://www.neurobs.com. Accessed 2020
Anderson, C., Wales, A.W.J., Home, J.A.: PVT lapses differ according to eyes open, closed, or looking away. Sleep 33(2), 197–204 (2010)
NASA: The Multi-Attribute Task Battery II (MATB-II) software for human performance and workload research: a user’s guide (NASA/TM–2011–217164) (2011)
Shahid, A., Wilkinson, K., Marcu, S., Shapiro, C.M.: Karolinska sleepiness scale (KSS). In: STOP, THAT and One Hundred Other Sleep Scales, pp. 209–210. Springer (2012)
Boersma, P., Weenink, D.: Praat (Version 6.1.08): doing phonetics by computer [Computer program]. https://www.praat.org/. Accessed 2019
Script for analysing pitch with a TextGrid. (2014). https://www.fon.hum.uva.nl/praat/manual/Script_for_analysing_pitch_with_a_TextGrid.html
Microsoft Corporation: Microsoft Excel (2018)
Vandekerckhove, M., Cluydts, R.: The emotional brain and sleep: an intimate relationship. Sleep Med. Rev. 14(4), 219–226 (2010)
Švec, J.G., Granqvist, S.: Guidelines for selecting microphones for human voice production research. Am. J. Speech-Lang. Pathol. 19(4), 356–368 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Diepeveen, H., van Miltenburg, M., van Drongelen, A., van den Oever, F., van Dijk, H. (2021). Fatigue-Indicator in Operational Settings: Vocal Changes. In: Black, N.L., Neumann, W.P., Noy, I. (eds) Proceedings of the 21st Congress of the International Ergonomics Association (IEA 2021). IEA 2021. Lecture Notes in Networks and Systems, vol 221. Springer, Cham. https://doi.org/10.1007/978-3-030-74608-7_17
Download citation
DOI: https://doi.org/10.1007/978-3-030-74608-7_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-74607-0
Online ISBN: 978-3-030-74608-7
eBook Packages: EngineeringEngineering (R0)