Abstract
This paper investigates whether and how depressive disorders affect speech and in particular timing strategies for speech pauses (empty and filled pauses, as well as, phoneme lengthening). The investigation is made exploiting read and spontaneous narratives . The collected data are from 24 subjects, divided into two groups (depressed and control) asked to read a tale, as well as, spontaneously report on their daily activities. Ten different frequency and duration measures for pauses and clauses are proposed and have been collected using the PRAAT software on the speech recordings produced by the participants. A T-Student test for independent samples was applied on the collected frequency and duration measures in order to ascertain whether significant differences between healthy and depressed speech measures are observed. In the “spontaneous narrative” condition, depressed patients exhibited significant differences in: the average duration of their empty pauses, the average frequency, and the average duration of their clauses. In the read narratives, only the average pause’s frequency of the clauses was significantly lower in the depressed subjects with respect to the healthy ones. The results suggest that depressive disorders affect speech quality and speech production through pause and clause durations, as well as, clause quantities. In particular, the significant differences in clause quantities (observed both in the read and spontaneous narratives), suggest a strong general effect of depressive symptoms on cognitive and psychomotor functions. Depressive symptoms produce changes in the planned timing of pauses, even when reading, modifying the timing of pausing strategies.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alpert, M., Pouget, E.R., Silva, R.R.: Reflection of depression in acoustic measures of the patient’s speech. J. Affect. Disord. 66, 59–69 (2001)
Alghowinem, S., et al.: Detecting depression: a comparison between spontaneous and read speech. In: IEEE 3 International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 7547–7551 (2013)
Beck, A.T., Steer, R.A., Brown, G.K.: Manual for the Beck Depression Inventory-II. Psychological Corporation, San Antonio, TX (1996)
Benus, S., Enos, F., Hirschberg, J., Shriberg, E.: Pauses in Deceptive Speech, Prosody 2006, Dresden. http://www1.cs.columbia.edu/nlp/papers/2006/benus_al_06.pdf (2010)
Boonla, T., Yingthawornsuk, T.: Assessment of vocal correlates of clinical depression in female subjects with probabilistic mixture modeling of speech cepstrum. In: IEEE 11th International Conference on Control, Automation and Systems (ICCAS 2011), 26–29 Oct 2011
Bouhuys, A.L., et al.: Speech timing measures of severity, psychomotor retardation, and agitation in endogenously depressed patients. J. Common Disord. 17, 277–288 (1984)
Butterworth, B.L.: Evidence for pauses in speech. In: Butterworth, B.L. (ed.) Language Production: Speech and Talk, vol. 1, pp. 155–176. London Academic Press (1980)
Caligiuri, M.P., Ellwanger, J.: Motor and cognitive aspects of motor retardation in depression. J. Affect. Disord. 57, 83–93 (2000)
Campine, E., Véronis, J.: Pauses and hesitations in french spontaneous speech. In: Disfuency in Spontaneous Speech. Workshop in International Speech Communication Association, pp. 43–46 (2005)
Chafe, W.: Cognitive constraint on information flow. In: Tomlin, R. (ed.) Coherence and Grounding in Discourse John Benjamins, pp. 20–51 (1987)
Clark, H.H., Fox Tree, J.E.: Using uh and um in spontaneous speaking. Cognition 84, 73–111 (2002). Goldman-Eisler, F.: Sequential temporal patterns and cognitive processes in speech. Lang. Speech 10(2), 122 (1967)
Cohn, J.F., et al.: Detecting Depression from Facial Actions and Vocal Prosody. In: 3rd International Conference on Affective Computing and Intelligent Interaction (ACII 2009) (2009)
Daniel, J., et al.: Acoustical properties of speech as indicators of depression and suicidal risk. IEEE Trans. Biomed. Eng. 47(7), 829–837 (2000)
Esposito, A.: On vowel height and consonantal voicing effects: data from Italian. Phonetica 59(4), 197–231 (2002)
Esposito, A.: Pausing strategies in children. In: Proceedings of NOLISP05, International Conference in Nonlinear Speech Processing, pp. 42–48. Cargraphics, Barcelona, Spain, 19–22 April 2005
Esposito, A.: Children’s organization of discourse structure through pausing means. In: Faundez-Zanuy, M., et al. (ed.), Nonlinear Analyses and Algorithms for Speech Processing, Lecture Notes in Computer Science (LCNS), vol. 3817, pp. 108–115, Springer-Verlag, Berlin Heidelberg (2006)
Esposito, A., Stejskal, V., Smékal, Z., Bourbakis, N.: The significance of empty speech pauses: cognitive and algorithmic issues. In: Mele, F., et al. (eds.) Brain Vision Artificial Intelligence, LCNS, vol. 4729, pp. 542–554. Springer, Berlin Heidelberg (2007)
Esposito, A., Marinaro, M.: What pauses can tell us about speech and gesture partnership. In: Esposito, A., Bratanic, M., Keller, E., Marinaro, M. (Eds.), Fundamentals of Verbal and Nonverbal Communication and the Biometric Issue, NATO Publishing Series, Sub-Series E: Human and Societal Dynamics, vol. 18, pp. 45–57. IOS press, The Netherlands (2007)
Esposito, A., Esposito, A.M.: On speech and gesture synchrony. In: Esposito, A. et al. (Eds), Analysis of Verbal and Nonverbal Communication and Enactment: The Processing Issue. LNCS 6800, pp. 252–272. ISBN 978-3-642-25774-2, Springer-Verlag, Berlin Heidelberg (2011)
Ghisi, M., Flebus, G.B., Montano, A., Sanavio, E., Sica, C.: Beck Depression Inventory-II. Manuale italiano. Organizzazioni Speciali, Firenze (2006)
Helfer, B.S., et al.: Classification of depression state based on articulatory precision. In: 14th Annual Conference of the International Speech Communication Association, pp. 1–5 (2013)
Hewlett Sanchez, M., et al. Using prosodic and spectral parameters in detecting depression in elderly males. In: INTERSPEECH 2011, pp. 3001–3004. Florence, Italy, 27–31 Aug 2011
Maclay, H., Osgood, C.E.: Hesitation phenomena in spontaneous english speech. Word 15, 19–44 (1959)
MacNeilage, P.: The motor control of the serial ordering of the speech. Psychol. Ref. 77(3), 182 (1970)
Marazziti, D., Consoli, G., Picchetti, M., Carlini, M., Faravelli, L.: Cognitive impairment in major depression. Eur. J. Pharmacol. 626, 83–86 (2010)
Moore, E., Clements, M., Peifer, J., Weisser, L.: Investigating the role of glottal parameters in classifying clinical depression. In: Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society IEEE 25th, vol. 3, pp. 2849–2852 (2003)
Mundt, J.C., Snyder, P.J., Cannizzaro, M.S., Chappie, K., Geralts, D.S.: Voice acoustic measures of depression severity and treatment response collected via interactive voice response (IVR) technology. J. Neurolinguistics 20, 50–64 (2007)
Oliveira, M.: Prosodic Features in Spontaneous Narratives, Ph.D. Thesis, Simon Fraser University (2000)
Oliveira, M.: Pausing strategies as means of information processing narratives. In: Proceeding of the International Conference on Speech Prosody, Ain-en-Provence, pp. 539–542 (2002)
O’Shaughnessy, D.: Timing patterns in fluent and disfluent spontaneous speech. In: Proceedings of ICASSP Conference, pp. 600–603. Detroit (1995)
Porter, R.J., Gallagher, P., Thompson, J.M., Young, A.H.: Neurocognitive impairment in drug free patients with major depressive disorder. Br. J. Psychiatry 182, 214–220 (2003)
Richmond, V., Payne, McCroskey J., Payne, S.: Nonverbal Behavior in Interpersonal Relations. Prentice Hall, Upper Saddle River (1991)
Rochester, S.R.: The significance of pauses in spontaneous speech. J. Psycholinguist. Res. 2(1), 51 (1973)
Sabbe, B., et al.: Retardation in depression: assessment by means of simple motor tasks. J. Affect. Disord. 55, 39–44 (1999)
Szabadi, E., Bradshaw, C.M., Besson, A.O.: Elongation of pause-time in speech: a simple, objective measure of motor retardation in depression. Br. J. psychiatry 129, 7–592 (1976)
Tsourtos, G., Thompson, J.C., Stough, C.: Evidence of an early information processing speed deficit in unipolar major depression. Psychol. Med. 32, 259–265 (2002)
Vinciarelli, A., Chatziioannou, P., Esposito, A.: When the words are not everything: the use of laughter, fillers, back-channel, silence, and overlapping speech in phone calls. Frontiers in ICT, vol. 4, article 4, pp. 1–11 (2015). doi:10.3389/fict.2015.00004
Yingthawornsuk, T., et al.: Characterizing sub-band spectral entropy based acoustics as assessment of vocal correlate of depression. In: IEEE 10th International Conference on Control Automation and Systems (ICCAS 2010), p. 1183, 27–30 Oct 2010
Acknowledgments
This work contributes to the research developed in the European Space Agency (ESA) project: Psychological Status Monitoring by Computerised Analysis of Language phenomena (COALA, AO-11-Concordia).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Esposito, A., Esposito, A.M., Likforman-Sulem, L., Maldonato, M.N., Vinciarelli, A. (2016). On the Significance of Speech Pauses in Depressive Disorders: Results on Read and Spontaneous Narratives. In: Esposito, A., et al. Recent Advances in Nonlinear Speech Processing. Smart Innovation, Systems and Technologies, vol 48. Springer, Cham. https://doi.org/10.1007/978-3-319-28109-4_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-28109-4_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-28107-0
Online ISBN: 978-3-319-28109-4
eBook Packages: EngineeringEngineering (R0)