Advertisement

Behavior Research Methods

, Volume 39, Issue 3, pp 610–619 | Cite as

Fatigue estimation using voice analysis

  • Harold P. GreeleyEmail author
  • Joel Berg
  • Eric Friets
  • John Wilson
  • Glen Greenough
  • Joseph Picone
  • Jeff rey Whitmore
  • Thomas Nesthus
Article

Abstract

In the present article, we present a means to remotely and transparently estimate an individual’s level of fatigue by quantifying changes in his or her voice characteristics. Using Voice analysis to estimate fatigue is unique from established cognitive measures in a number of ways: (1) speaking is a natural activity requiring no initial training or learning curve, (2) voice recording is a unobtrusive operation allowing the speakers to go about their normal work activities, (3) using telecommunication infrastructure (radio, telephone, etc.) a diffuse set of remote populations can be monitored at a central location, and (4) often, previously recorded voice data are available for post hoc analysis. By quantifying changes in the mathematical coefficients that describe the human speech production process, we were able to demonstrate that for speech sounds requiring a large average air flow, a speaker’s voice changes in synchrony with both direct measures of fatigue and with changes predicted by the length of time awake.

Keywords

Fatigue Speech Signal Nonparametric Model Sleep Onset Latency Multiple Sleep Latency Test 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. Arand, D., Bonnet, M., Hurwitz, T., Mitler, M., Rosa, R., &Sangal, R. B. (2005). The clinical use of the MSLT and MWT.Sleep,28, 123–144.PubMedGoogle Scholar
  2. Barth, J., Holding, D. H., &Stamford, B. A. (1976). Risk versus effort in the assessment of motor fatigue.Journal of Motor Behavior,8, 189–194.Google Scholar
  3. Brenner, M., &Cash, J. R. (1991). Speech analysis as an index of alcohol intoxication-The Exxon Valdez accident.Aviation, Space, & Environmental Medicine,62, 893–898.Google Scholar
  4. Colquhoun, P. (1976). Psychological and psychophysiological aspects of work and fatigue.Activitas Nervosa Superior,18, 257–263.PubMedGoogle Scholar
  5. Gregory, J. M., Xie, X., &Mengel, S. A. (2004, March). SLEEP (sleep loss effects on everyday performance) model.Aviation, Space, & Environmental Medicine,75, A125-A133.Google Scholar
  6. Hursh, S. R., Redmond, D. P., Johnson, M. L., Thorne, D. R., Belenky, G., Balkin, T. J., et al. (2004, March). Fatigue models for applied research in warfighting.Aviation, Space, & Environmental Medicine,75, A44-A53.Google Scholar
  7. Krüger, H. P., &Vollrath, M. (1996). Temporal analysis of speech patterns in the real world using LOGOPORT. In J. Fahrenberg & M. Myrtek (Eds.),Ambulatory assessment (pp. S101-S113). Seattle: Hogrefe & Huber.Google Scholar
  8. Lyman, E. G., &Orlady, H. W. (1981, March).Fatigue and associated performance decrements in air transport operations (NASA Contractor Report 166167). Moffett Field, CA: NASA Ames Research Center.Google Scholar
  9. Mohler, S. R. (1966). Fatigue in aviation activities.Aerospace Medicine,37, 722–732.PubMedGoogle Scholar
  10. Nesthus, T. E., Scarborough, A. L., & Schroeder, D. J. (1998). Changes in the performance of a synthetic work task as a function of age, gender, and sleep deprivation. InProceedings of the Human Factors and Ergonomics Society, 42nd Annual Meeting (pp. 181-185).Google Scholar
  11. Roth, T., Roehrs, T. A., Carskadon, M. A., &Dement, W. C. (1989). Daytime sleepiness and alertness. In M. H. Kryger, T. Roth, & W. C. Dement (Eds.),Principles and practice of sleep medicine (2nd ed., pp. 14–23). Philadelphia: Saunders.Google Scholar
  12. Saito, I., Fujiwara, O., Utsuki, N., Mizumoto, C., &Arimori, T. (1980). Hypoxia-induced fatal aircraft accident revealed by voice analysis.Aviation, Space, & Environmental Medicine,51, 402–406.Google Scholar
  13. Shingledecker, C. A., &Holding, D. H. (1974). Risk and effort measures of fatigue.Journal of Motor Behavior,6, 17–25.Google Scholar
  14. Vollrath, M. (1994). Automatic measurement of aspects of speech reflecting motor coordination.Behavior Research Methods, Instruments, & Computers,26, 35–40.CrossRefGoogle Scholar
  15. Whitmore, J., &Fisher, S. (1996). Speech during sustained operations.Speech Communication,20, 55–70.CrossRefGoogle Scholar

Copyright information

© Psychonomic Society, Inc. 2007

Authors and Affiliations

  • Harold P. Greeley
    • 1
    Email author
  • Joel Berg
    • 1
  • Eric Friets
    • 1
  • John Wilson
    • 1
  • Glen Greenough
    • 2
  • Joseph Picone
    • 3
  • Jeff rey Whitmore
    • 4
  • Thomas Nesthus
    • 5
  1. 1.Creare IncorporatedHanover
  2. 2.Dartmouth-Hitchcock Medical CenterLebanon
  3. 3.University of MississippiStarksville
  4. 4.Air Force Research LaboratoryBrooks City-Base
  5. 5.FAA Civil Aerospace Medical InstituteOklahoma City

Personalised recommendations