Advances in Speech Recognition

pp 305-322


“You’re as Sick as You Sound”: Using Computational Approaches for Modeling Speaker State to Gauge Illness and Recovery

  • Julia HirschbergAffiliated withDepartment of Computer Science, Columbia University Email author 
  • , Anna Hjalmarsson
  • , Noémie Elhadad

* Final gross prices may vary according to local VAT.

Get Access


Recently, researchers in computer science and engineering have begun to explore the possibility of finding speech-based correlates of various medical ­conditions using automatic, computational methods. If such language cues can be identified and quantified automatically, this information can be used to support diagnosis and treatment of medical conditions in clinical settings and to further ­fundamental research in understanding cognition. This chapter reviews ­computational approaches that explore communicative patterns of patients who suffer from medical conditions such as depression, autism spectrum disorders, schizophrenia, and cancer. There are two main approaches discussed: research that explores features extracted from the acoustic signal and research that focuses on lexical and semantic features. We also present some applied research that uses computational methods to develop assistive technologies. In the final sections we discuss issues related to and the future of this emerging field of research.


Modeling speaker state using computational methods Speech ­processing Medical disabilities Depression Suicide Autism spectrum disorder Schizophrenia Cancer Aphasia Acoustic signals Lexical and semantic features Mapping language cues to medical conditions