Abstract
Somniloquy is a parasomnia that refers to talking aloud while sleep. This parasomnia usually happens during transitory arousals from NREM sleep. The recording of these parasomnias could be useful to help in the diagnosis of certain psychological pathologies given that they can reflect a state of anxiety or some behaviors which could be identified as psychological diagnosis criteria. In this work-in-progress paper, a mobile platform which only records sleep-talking (excluding other noises or sounds) and analyze them to identify the main emotion in the voice, allowing making a transcription of the conversation, is presented.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
American Academy of Sleep Medicine: International Classification of Sleep Disorders: Diagnostic and Coding Manual. American Academy of Sleep Medicine, Westchester, Illinois, 2nd edn. (ICSD-2) (2015)
Chokroverty, S., Allen, R.P., Walters, A.S., Montagna, P.: Sleep and Movement Disorders. Oxford University Press, New York (2012)
Shneerson, J.M.: Sleep Medicine: A Guide to Sleep and Its Disorders. Wiley, New York (2009)
Thorpy, M.J., Plazzi, G.: The Parasomnias and Other Sleep-Related Movement Disorders. Cambridge University Press, New York (2010)
Arkin, A.M., Toth, M.F., Baker, J., Hastey, J.M.: The frequency of sleep talking in the laboratory among chronic sleep talkers and good dream recallers. J. Nerv. Mental Dis. 151(6), 369–374 (1970)
Rechtschaffen, A., Goodenough, D.R., Shapiro, A.: Patterns of sleep talking. Arch. Gen. Psychiatry 7(6), 418–426 (1962)
Andriani, G.: Fisiología psicológica del sonniloquio. Ann. Neurol. 10, 299–308 (1892)
Arkin, A.M.: Sleep-Talking: Psychology and Psychophysiology. Lawrence Erlbaum Associates, Hillsdale (1981)
Darwin, C.: The Expression of the Emotions in Man and Animals. Oxford University Press, Oxford (1998)
Fairbanks, G., Pronovost, W.: An experimental study of the pitch characteristics of the voice during the expression of emotion. Commun. Monogr. 6(1), 87–104 (1939)
Fairbanks, G.: Recent experimental investigations of vocal pitch in speech. J. Acoust. Soc. Am. 11(4), 457–466 (1940)
Fairbanks, G., Hoaglin, L.W.: An experimental study of the durational characteristics of the voice during the expression of emotion. Commun. Monogr. 8(1), 85–90 (1941)
Skinner, E.R.: A calibrated recording and analysis of the pitch, force and quality of vocal tones expressing happiness and sadness; and a determination of the pitch and force of the subjective concepts of ordinary, soft, and loud tones. Commun. Monogr. 2(1), 81–137 (1935)
Williams, C.E., Stevens, K.N.: Emotions and speech: some acoustical correlates. J. Acoust. Soc. Am. 52(4B), 1238–1250 (1972)
Williams, C.E., Stevens, K.N.: Vocal correlates of emotional states. In: Speech Evaluation in Psychiatry, pp. 221–240 (1981)
Levin, H., Lord, W.: Speech pitch frequency as an emotional state indicator. IEEE Trans. Syst. Man Cybern. 2, 259–273 (1975)
France, D.J., Shiavi, R.G., Silverman, S., Silverman, M., Wilkes, M.: Acoustical properties of speech as indicators of depression and suicidal risk. IEEE Trans. Biomed. Eng. 47(7), 829–837 (2000)
Zuckerman, M., Lipets, M.S., Koivumaki, J.H., Rosenthal, R.: Encoding and decoding nonverbal cues of emotion. J. Pers. Soc. Psychol. 32(6), 1068 (1975)
van Bezooijen, R.: The characteristics and recognizability of vocal expression of emotions (1984)
Buckley, C.: Dreamcatcher. Version 1.2 (2011). https://market.android.com/details?id=com.buck.SleepTalker&hl=es
MobiUtil: Dream talk recorder. Android version (2016). https://play.google.com/store/apps/developer?id=MobiUtil&hl=en, Version 3.6. iOS version. https://itunes.apple.com/us/app/dream-talk-recorder/id445472628?mt%3D8, Version 7.0
Asleroid: Sleep recorder (2017). https://www.microsoft.com/en-us/store/p/sleep-recorder/9wzdncrfhmw3
MadinSweden: Dreamcatcher (2011). http://www.sleeptalkrecorder.com. https://itunes.apple.com/WebObjects/MZStore.woa/wa/viewSoftware?id=391767653, Version 2.1.2
Corominas, R.: Audio digital: amplitud, frecuencia, ruido y normalización (2005)
Fontes, S., Fontes, A.: Consideraciones teóricas sobre las leyes psicofísicas. Revista de psicología general y aplicada: Revista de la Federación Española de Asociaciones de Psicología (Internet) 47(4), 391–395 (1994)
Instituto de Salud Pública. Gobierno de Chile: Instructivo para la aplicación del d. s n\(^{\circ }\) 594/99 del minsal, título iv, parrafo 3\(^{\circ }\) agentes fisicos - ruido (1999)
Reynoso, C., Kicillof, N.: Estilos y patrones en la estrategia de arquitectura de microsoft. Universidad de Buenos Aires, Buenos Aires (2004)
Android Developers: android.media.audiorecord (2009). http://developer.android.com/reference/android/media/AudioRecord.html
Rodríguez Bravo, Á., Lázaro Pernias, P., Montoya Vilar, N., Blanco Pont, J.M., Bernadas Suñé, D., Oliver, J.M., Longhi, L.: Modelización acústica de la expresión emocional en el español. Procesamiento del lenguaje natural, no. 25 (Septiembre 1999), pp. 159–166 (1999)
GilMartín, V.F., Gómez-Navarro, P.G., Ballesteros, R.H.: Análisis y síntesis de expresión emocional en cuentos leídos en voz alta. Procesamiento del lenguaje natural 35, 293–300 (2005)
Zaykovskiy, D., Minker, W.: Speech recognition for mobile phones. Int. J. Speech Technol. 11(2), 63–72 (2012). Springer
Wells, J., Barry, W., Grice, M., Fourcin, A., Gibbon, D.: Standard computer-compatible transcription. Esprit project 2589 (SAM), Doc. no. SAM-UCL 37 (1992)
Project by Carnegie Mellon University: Cmusphinx - open source toolkit for speech recognition (2017). https://cmusphinx.github.io
Speech Vision, Robotics Group of the Cambridge University Engineering Department: The hidden Markov model toolkit (htk) (2017). http://htk.eng.cam.ac.uk
Sun Microsystems: Java speech API (2017). http://www.oracle.com/technetwork/java/speech-138007.html
Google: Cloud speech API (2017). https://cloud.google.com/speech
IBM: Watson developer cloud (2017). https://www.ibm.com/watson/developercloud/speech-to-text.html
Acknowledgements
This paper is supported by European Union’s Horizon 2020 research and innovation programme under grant agreement No. 727658, project IASIS (Integration and analysis of heterogeneous big data for precision medicine and suggested treatments for different types of patients). The paper is also supported by the Spanish Ministry of Economy, Industry and Competitiveness under the grant agreement No, RTC-2016-4922-1 project NDMonitor (Plataforma Integral de bajo coste para la monitorización y ayuda de pacientes de enfermedades neurodegenerativas graves en capacidades mentales).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Aparicio-Paniagua, V. et al. (2017). Automatic Recording and Analysis of Somniloquy Through the Use of Mobile Devices to Support the Diagnosis of Psychological Pathologies. In: Valencia-García, R., Lagos-Ortiz, K., Alcaraz-Mármol, G., Del Cioppo, J., Vera-Lucio, N., Bucaram-Leverone, M. (eds) Technologies and Innovation. CITI 2017. Communications in Computer and Information Science, vol 749. Springer, Cham. https://doi.org/10.1007/978-3-319-67283-0_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-67283-0_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-67282-3
Online ISBN: 978-3-319-67283-0
eBook Packages: Computer ScienceComputer Science (R0)