Skip to main content

Advertisement

SpringerLink
Log in

Decoding depressive disorder using computer vision

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper intends to decode depressive disorder using computer vision. Facial expressions rendered by a depressive and non-depressive person were studied against a given stimulus. A survey was conducted using Attention Deficit Hyperactivity Disorder (ADHD) questionnaire on a group of four hundred one volunteers between age group of nineteen to twenty-three years. A total of 254 male and 147 female volunteers participated in survey. Three hundred and eighty-seven responses were actually received and seventy-two respondents were identified as potential patients of depressive disorder. Amongst these anticipated depressive patients, thirty-eight were called for a personal assessment/ interview by practicing psychologists as per DSM-V standards. Data collected from these respondents were used to train a Convolutional Neural Network model, so as to classify a person as depressed or not depressed. The proposed system attained a precision of 74 in the identification of depressive patients. This study concludes to the fact that facial expressions rendered by a patient suffering from the depressive disorder are different from that of non-depressive person against any given psychological stimulus. Further, it was also concluded that facial expressions rendered by a respondent against any annotated quality stimulus like ADFES dataset could provide results comparable to that of ADHD questionnaire. The outcome of this research intends to facilitate doctors to identify potential depressive patients and make an early diagnosis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Adorni R, Gatti A, Brugnera A, Sakatani K, Compare A (2016) Frontiers in psychology. Front Psychol 7. https://psycnet.apa.org/record/2016-16013-001 (August 7, 2019)

  2. Alghowinem S et al (2013) Eye movement analysis for depression detection. In: 2013 IEEE International Conference on Image Processing. http://ieeexplore.ieee.org/document/6738869/ (August 8, 2019). IEEE, pp 4220–4224

  3. Alghowinem S, Goecke R, Cohn JF, Wagner M, Parker G, Breakspear M (2019) Cross-cultural detection of depression from nonverbal behaviour. In: 2015 11th IEEE international conference and workshops on automatic face and gesture recognition (FG). http://ieeexplore.ieee.org/document/7163113/ (August 8, 2019). IEEE, pp 1–8

  4. American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders. American Psychiatric Association. https://psychiatryonline.org/doi/book/10.1176/appi.books.9780890425596 (August 5, 2019)

  5. Amsterdam Interdisciplinary Centre for Emotion (AICE) (2019) https://aice.uva.nl/research-tools/adfes-stimulus-set/adfes-stimulus-set.htm

  6. Arbabshirani MR, Plis S, Sui J, Calhoun VD (2017) Single subject prediction of brain disorders in neuroimaging: promises and pitfalls. NeuroImage 145(Pt B):137–165. http://www.ncbi.nlm.nih.gov/pubmed/27012503 (August 6, 2019)

    Google Scholar 

  7. Automatic audiovisual behavior descriptors for psychological disorder analysis. Image Vis Comput 32(10):648–658. https://www.sciencedirect.com/science/article/pii/S0262885614001000?via%3Dihub (August 8, 2019)

  8. Automatic nonverbal behavior indicators of depression and PTSD: the effect of gender. J Multimodal User Interfaces 9(1):17–29. http://link.springer.com/10.1007/s12193-014-0161-4 (August 7, 2019)

  9. Bennett K, Bennett AJ, Griffiths KM (2010) Security considerations for E-Mental health interventions. J Med Internet Res 12 (5):e61. http://www.ncbi.nlm.nih.gov/pubmed/21169173 (August 5, 2019)

    Google Scholar 

  10. Beyond group differences. In: Proceedings of the 3rd ACM international workshop on audio/visual emotion challenge - AVEC ’13. ACM Press, New York, 1–2. http://dl.acm.org/citation.cfm?doid=2512530.2512537 (August 7, 2019)

  11. Bittner A et al (2007) What do childhood anxiety disorders predict? J Child Psychol Psychiatry 48(12):1174–1183. http://www.ncbi.nlm.nih.gov/pubmed/18093022 (August 5, 2019)

    Google Scholar 

  12. Bohannon J (2015) The synthetic therapist. Science 349 (6245):250–251. http://www.ncbi.nlm.nih.gov/pubmed/26185240 (August 6, 2019)

    MathSciNet  Google Scholar 

  13. Bufferd SJ, Dougherty LR, Carlson GA, Klein DN (2011) Parent-reported mental health in preschoolers: findings using a diagnostic interview. Compr Psychiatry 52(4):359–369. https://www.sciencedirect.com/science/article/abs/pii/S0010440X10001446 (August 2, 2019)

    Google Scholar 

  14. Carcione A et al (2008) An intensive case analysis of client metacognition in a good-outcome psychotherapy: Lisa’s case. Psychother Res 18(6):667–676. http://www.ncbi.nlm.nih.gov/pubmed/18815952 (August 5, 2019)

    Google Scholar 

  15. Chandra GS et al (2017) Detecting depression and mental illness on social media: an integrative review. Curr Opin Behav Sci 18:43–49. https://doi.org/10.1016/j.cobeha.2017.07.005 (August 6, 2019)

    Google Scholar 

  16. Chandrashekar P (2018) Do mental health mobile apps work: evidence and recommendations for designing high-efficacy mental health mobile apps. mHealth 4. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5897664/ (August 5, 2019)

  17. Chiarugi F et al (2014) Facial signs and psycho-physical status estimation for well-being assessment. In: Proceedings of the international conference on health informatics, SCITEPRESS—science and and technology publications. http://www.scitepress.org/DigitalLibrary/Link.aspx?doi=10.5220/0004934405550562 (August 7, 2019), pp 555–562

  18. Cohn JF (2010) Social signal processing in depression. In: Proceedings of the 2nd international workshop on social signal processing—SSPW ’10. http://portal.acm.org/citation.cfm?doid=1878116.1878118 (August 7, 2019). ACM Press, New York

  19. Cohn JF et al (2009) Detecting depression from facial actions and vocal prosody. In: 2009 3rd International conference on affective computing and intelligent interaction and workshops. http://ieeexplore.ieee.org/document/5349358/ (August 7, 2019). IEEE, pp 1–7

  20. Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20(3):273–297

    MATH  Google Scholar 

  21. Coryell W et al (1993) The enduring psychosocial consequences of mania and depression. Am J Psychiatry 150(5):720–727. http://www.ncbi.nlm.nih.gov/pubmed/8480816 (August 5, 2019)

    Google Scholar 

  22. Craske MG, Stein MB (2016) Anxiety. Lancet (London England) 388(10063):3048–3059. http://www.ncbi.nlm.nih.gov/pubmed/27349358 (August 5, 2019)

    Google Scholar 

  23. Csernansky JG et al (2004) Abnormalities of thalamic volume and shape in Schizophrenia. Am J Psychiatry 161(5):896–902. http://www.ncbi.nlm.nih.gov/pubmed/15121656 (August 6, 2019)

    Google Scholar 

  24. Cummins N et al (2015) A review of depression and suicide risk assessment using speech analysis. Speech Commun 71(C):10–49. https://linkinghub.elsevier.com/retrieve/pii/S0167639315000369 (August 8, 2019)

    Google Scholar 

  25. Davatzikos C et al (2008) Detection of prodromal Alzheimer’s disease via pattern classification of magnetic resonance imaging. Neurobiol Aging 29 (4):514–523. http://www.ncbi.nlm.nih.gov/pubmed/17174012 (August 6, 2019)

    Google Scholar 

  26. Egger HL, Angold A (2006) Common emotional and behavioral disorders in preschool children: presentation, nosology, and epidemiology. J Child Psychol Psychiatry 47(3–4):313–337. http://doi.wiley.com/10.1111/j.1469-7610.2006.01618.x (August 2, 2019)

    Google Scholar 

  27. Eichstaedt JC et al (2015) Psychological language on twitter predicts county-level heart disease mortality. Psychol Sci 26(2):159–169. http://www.ncbi.nlm.nih.gov/pubmed/25605707 (August 6, 2019)

    Google Scholar 

  28. Ekman P, Friesen WV (1976) Pictures of facial affect. Consulting Psychologists Press

  29. Ekman P, Friesen WV, Hager JC (2002) Facial action coding system. Manual and investigator’s guide UT. Salt Lake City, Research Nexus

    Google Scholar 

  30. Ellgring H (2007) Non-verbal communication in depression. Cambridge University Press, Cambridge. https://www.bookdepository.com/European-Monographs-Social-Psychology-Non-verbal-Communication-Depression-Heiner-Ellgring/9780521047562 (August 7, 2019)

    Google Scholar 

  31. Ellgring H (2008) Non-verbal communication in depression. Cambridge University Press, Cambridge

    Google Scholar 

  32. Epstein J, Klinkenberg WD (2001) From Eliza to Internet: a brief history of computerized assessment. Comput Hum Behav 17(3):295–314. https://www.sciencedirect.com/science/article/pii/S0747563201000048 (August 5, 2019)

    Google Scholar 

  33. Fajutrao L, Locklear J, Priaulx J, Heyes A (2009) A systematic review of the evidence of the burden of bipolar disorder in Europe. Clinical practice and epidemiology in mental health: CP & EMH 5:3. http://www.ncbi.nlm.nih.gov/pubmed/19166608 (August 6, 2019)

  34. Firth J et al (2017) The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry 16(3):287–298. http://www.ncbi.nlm.nih.gov/pubmed/28941113 (August 5, 2019)

    Google Scholar 

  35. Fiske ST, Taylor SE (1991) Social cognition, 2nd edn. McGraw-Hill. https://psycnet.apa.org/record/1991-97723-000 (August 5, 2019)

  36. Fu CHY et al (2008) Pattern classification of sad facial processing: toward the development of neurobiological markers in depression. Biol Psychiatry 63 (7):656–662. http://www.ncbi.nlm.nih.gov/pubmed/17949689 (August 6, 2019)

    Google Scholar 

  37. Ghosh S, Chatterjee M, Morency L -P (2014) A multimodal context-based approach for distress assessment. In: Proceedings of the 16th international conference on multimodal interaction—ICMI ’14. http://dl.acm.org/citation.cfm?doid=2663204.2663274 (August 7, 2019). ACM Press, New York, pp 240–246

  38. Girard JM et al (2013) Social risk and depression: evidence from manual and automatic facial expression analysis. In: 2013 10th IEEE international conference and workshops on automatic face and gesture recognition (FG). http://ieeexplore.ieee.org/document/6553748/ (August 7, 2019). IEEE, pp 1–8

  39. Gould MS et al (1998) Psychopathology associated with suicidal ideation and attempts among children and adolescents. J Am Acad Child Adolesc Psychiatry 37(9):915–923. http://www.ncbi.nlm.nih.gov/pubmed/9735611 (August 5, 2019)

    Google Scholar 

  40. Gratch J et al (2014) The distress analysis interview corpus of human and computer interviews. In: European languages resources association (ELRA). https://aclweb.org/anthology/papers/L/L14/L14-1421/ (August 8, 2019), pp 3123–3128

  41. Griffiths KM, Christensen H (2000) Quality of web based information on treatment of depression: cross sectional survey. BMJ 321(7275):1511–1515. http://www.ncbi.nlm.nih.gov/pubmed/11118181 (August 5, 2019)

    Google Scholar 

  42. Gupta R et al (2014) Multimodal prediction of affective dimensions and depression in human-computer interactions. In: Proceedings of the 4th international workshop on audio/visual emotion challenge—AVEC ’14. http://dl.acm.org/citation.cfm?doid=2661806.2661810 (August 8, 2019). ACM Press, New York, pp 33–40

  43. Hess U, Blairy S, Kleck RE (2000) The influence of facial emotion displays, gender, and ethnicity on judgments of dominance and affiliation. J Nonverbal Behav 24(4):265–283. http://link.springer.com/10.1023/A:1006623213355 (August 5, 2019)

    Google Scholar 

  44. Hess U, Adams R, Kleck R (2005) Who may frown and who should smile? Dominance, affiliation, and the display of happiness and anger. Cognit Emot 19(4):515–536. http://www.tandfonline.com/doi/abs/10.1080/02699930441000364 (August 5, 2019)

    Google Scholar 

  45. Hirschfeld RM et al (2000) Social functioning in depression: a review. J Clin Psychiatry 61(4):268–275. http://www.ncbi.nlm.nih.gov/pubmed/10830147 (August 5, 2019)

    Google Scholar 

  46. Hirschfeld RMA, Lewis L, Vornik LA (2003) Perceptions and impact of bipolar disorder: how far have we really come? Results of the national depressive and manic-depressive association 2000 survey of individuals with bipolar disorder. J Clin Psychiatry 64(2):161–174. http://www.ncbi.nlm.nih.gov/pubmed/12633125 (August 6, 2019)

    Google Scholar 

  47. Hosseinifard B, Moradi MH, Rostami R (2013) Classifying depression patients and normal subjects using machine learning techniques and nonlinear features from EEG signal. Comput Methods Progr Biomed 109(3):339–345. http://www.ncbi.nlm.nih.gov/pubmed/23122719 (August 7, 2019)

    Google Scholar 

  48. Jans M, Soffer P, Jouck T (2019) Building a valuable event log for process mining: an experimental exploration of a guided process. Enterprise Inf Syst 1–30. https://www.tandfonline.com/doi/full/10.1080/17517575.2019.1587788

  49. Jones NP, Siegle GJ, Mandell D (2015) Motivational and emotional influences on cognitive control in depression: a pupillometry study. Cognit Affect Behav Neurosci 15(2):263–275. http://www.ncbi.nlm.nih.gov/pubmed/25280561 (August 7, 2019)

    Google Scholar 

  50. Judd LL et al (2000) Psychosocial disability during the long-term course of unipolar major depressive disorder. Arch Gen Psychiatry 57(4):375. http://www.ncbi.nlm.nih.gov/pubmed/10768699 (August 5, 2019)

    Google Scholar 

  51. Kambeitz J et al (2017) Detecting neuroimaging biomarkers for depression: a meta-analysis of multivariate pattern recognition studies. Biol Psychiatry 82(5):330–338. http://www.ncbi.nlm.nih.gov/pubmed/28110823 (August 6, 2019)

    Google Scholar 

  52. Khazaal Y et al (2008) Quality of web-based information on social phobia: a cross-sectional study. Depress Anxiety 25(5):461–465. http://www.ncbi.nlm.nih.gov/pubmed/17960640 (August 5, 2019)

    Google Scholar 

  53. King DE (2009) Dlib-Ml: a machine learning toolkit. J Mach Learn Res 10:1755–1758. http://jmlr.csail.mit.edu/papers/v10/king09a.html

    Google Scholar 

  54. Kloppel S et al (2008) Accuracy of dementia diagnosis—a direct comparison between radiologists and a computerized method. Brain 131(11):2969–2974. https://academic.oup.com/brain/article-lookup/doi/10.1093/brain/awn239 (August 6, 2019)

    Google Scholar 

  55. Knutson B (1996) Facial expressions of emotion influence interpersonal trait inferences. J Nonverbal Behav 20(3):165–182. http://link.springer.com/10.1007/BF02281954 (August 5, 2019)

    Google Scholar 

  56. Kosinski M, Stillwell D, Graepel T (2013) Private traits and attributes are predictable from digital records of human behavior. Proc Natl Acad Sci 110(15):5802–5805. http://www.pnas.org/cgi/doi/10.1073/pnas.1218772110 (August 6, 2019)

    Google Scholar 

  57. Koutsouleris N et al (2015) Individualized differential diagnosis of schizophrenia and mood disorders using neuroanatomical biomarkers. Brain 138 (7):2059–2073. http://www.ncbi.nlm.nih.gov/pubmed/25935725 (August 6, 2019)

    Google Scholar 

  58. Kudinova AY et al (2016) Pupillary reactivity to negative stimuli prospectively predicts recurrence of major depressive disorder in women. https://binghamton.edu/psychology/labs/mood/pdfs/2016_kudinova_pupilpredicts_mddrecurrence_inwomen.pdf (August 7, 2019)

  59. Ladegaard N, Larsen ER, Videbech P, Lysaker PH (2014) Higher-order social cognition in first-episode major depression. Psychiatry Res 216 (1):37–43. http://www.ncbi.nlm.nih.gov/pubmed/24524945 (August 5, 2019)

    Google Scholar 

  60. Ladegaard N, Lysaker PH, Larsen ER, Videbech P (2014) A comparison of capacities for social cognition and metacognition in first episode and prolonged depression. Psychiatry Res 220(3):883–889. http://www.ncbi.nlm.nih.gov/pubmed/25453639 (August 5, 2019)

    Google Scholar 

  61. Lavagnino L et al (2015) Identifying neuroanatomical signatures of anorexia nervosa: a multivariate machine learning approach. Psychol Med 45 (13):2805–2812. https://www.cambridge.org/core/product/identifier/S0033291715000768/type/journal_article (August 6, 2019)

    Google Scholar 

  62. Li M et al (2016) Alleviated negative rather than positive attentional bias in patients with depression in remission: an eye-tracking study. J Int Med Res 44 (5):1072–1086. http://journals.sagepub.com/doi/10.1177/0300060516662134 (August 7, 2019)

    Google Scholar 

  63. Lindefors N, Andersson G (2016) Guided internet-based treatments in psychiatry

  64. Luby JL et al (2009) The clinical significance of preschool depression: impairment in functioning and clinical markers of the disorder. J Affect Disord 112(1–3):111–119. https://www.sciencedirect.com/science/article/abs/pii/S0165032708001481 (August 5, 2019)

    Google Scholar 

  65. Lucas GM et al (2015) Towards an affective interface for assessment of psychological distress. In: 2015 International conference on affective computing and intelligent interaction (ACII). http://ieeexplore.ieee.org/document/7344622/ (August 8, 2019). IEEE, pp 539–545

  66. Lueken U et al (2015) Separating depressive comorbidity from panic disorder: a combined functional magnetic resonance imaging and machine learning approach. J Affect Disord 184:182–192. http://www.ncbi.nlm.nih.gov/pubmed/26093832 (August 6, 2019)

    Google Scholar 

  67. Marquand AF, Rezek I, Buitelaar J, Beckmann CF (2016) Understanding heterogeneity in clinical cohorts using normative models: beyond case-control studies. Biol Psychiatry 80(7):552–561. http://www.ncbi.nlm.nih.gov/pubmed/26927419 (August 6, 2019)

    Google Scholar 

  68. Matsumoto D, Ekman P (2008) Facial expression analysis. Scholarpedia 3(5):4237. http://www.scholarpedia.org/article/Facial_expression_analysis (August 5, 2019)

    Google Scholar 

  69. McIntyre GJ (2010) The computer analysis of facial expressions: on the example of depression and anxiety. http://users.cecs.anu.edu.au/~gmcintyr/thesis.pdf (August 7, 2019)

  70. McIntyre G, Goecke R, Breakspear M, Parker G (2011) Facial response to video content in depression 1–2. https://researchprofiles.canberra.edu.au/en/publications/facial-response-to-video-content-in-depression(August 7, 2019)

  71. Mehrabian A, Russell JA (1974) An approach to environmental psychology. PsycNET. The MIT Press, Cambridge. https://psycnet.apa.org/record/1974-22049-000 (August 5, 2019)

    Google Scholar 

  72. Mohr DC, Zhang M, Schueller SM (2017) Personal sensing: understanding mental health using ubiquitous sensors and machine learning. Annu Rev Clin Psychol 13(1):23–47. http://www.ncbi.nlm.nih.gov/pubmed/28375728 (August 5, 2019)

    Google Scholar 

  73. Morency L -P et al (2015) SimSensei demonstration: a perceptive virtual human interviewer for healthcare applications. In: Proceedings of the twenty-ninth AAAI conference on artificial intelligence, pp 4307–4308

  74. Nielssen O et al (2015) Procedures for risk management and a review of crisis referrals from the MindSpot Clinic, a national service for the remote assessment and treatment of anxiety and depression. BMC Psychiatry 15(1):304. http://www.ncbi.nlm.nih.gov/pubmed/26626712 (August 5, 2019)

    Google Scholar 

  75. Nonverbal social withdrawal in depression: evidence from manual and automatic analyses. Image Vis Comput 32(10):641–647. https://linkinghub.elsevier.com/retrieve/pii/S0262885613001790 (August 7, 2019)

  76. Orrù G et al (2012) Using support vector machine to identify imaging biomarkers of neurological and psychiatric disease: a critical review. Neurosci Biobehav Rev 36(4):1140–1152. http://www.ncbi.nlm.nih.gov/pubmed/22305994 (August 6, 2019)

    Google Scholar 

  77. Pampouchidou A et al (2017) Automatic assessment of depression based on visual cues: a systematic review. IEEE Transactions on Affective Computing 1–1. http://ieeexplore.ieee.org/document/8052569/ (August 2, 2019)

  78. Park G et al (2015) Automatic personality assessment through social media language. J Person Social Psychol 108(6):934–952. http://www.ncbi.nlm.nih.gov/pubmed/25365036 (August 6, 2019)

    Google Scholar 

  79. Pediaditis M et al (2015) Extraction of facial features as indicators of stress and anxiety. In: 2015 37th annual international conference of the IEEE Engineering in Medicine and Biology Society (EMBC). http://ieeexplore.ieee.org/document/7319199/ (August 7, 2019). IEEE, pp 3711–3714

  80. Poria S, Mondal A, Mukhopadhyay P (2015) Evaluation of the intricacies of emotional facial expression of psychiatric patients using computational models. In: Understanding facial expressions in communication. http://link.springer.com/10.1007/978-81-322-1934-7_10 (August 7, 2019). Springer India, New Delhi, pp 199–226

  81. Redlich R et al (2014) Brain morphometric biomarkers distinguishing unipolar and bipolar depression. JAMA Psychiatry 71(11):1222. http://www.ncbi.nlm.nih.gov/pubmed/25188810 (August 6, 2019)

    Google Scholar 

  82. Russell JA, Bullock M (1985) Multidimensional scaling of emotional facial expressions: similarity from preschoolers to adults. J Personal Social Psychol 48(5):1290–1298. http://doi.apa.org/getdoi.cfm?doi=10.1037/0022-3514.48.5.1290 (August 5, 2019)

    Google Scholar 

  83. Saragih JM, Lucey S, Cohn JF (2009) Face alignment through subspace constrained mean-shifts. In: 2009 IEEE 12th international conference on computer vision. http://ieeexplore.ieee.org/document/5459377/ (August 8, 2019). IEEE, pp 1034–1041

  84. Scherer S et al (2013) Automatic behavior descriptors for psychological disorder analysis. In: 2013 10th IEEE international conference and workshops on automatic face and gesture recognition (FG). http://ieeexplore.ieee.org/document/6553789/ (August 8, 2019). IEEE, pp 1–8

  85. Scherer S, Stratou G, Morency L-P (2013) Audiovisual behavior descriptors for depression assessment. In: Proceedings of the 15th ACM on international conference on multimodal interaction—ICMI ’13. http://dl.acm.org/citation.cfm?doid=2522848.2522886 (August 8, 2019). ACM Press, New York, pp 135–140

  86. Siegle GJ et al (2011) Remission prognosis for cognitive therapy for recurrent depression using the pupil: utility and neural correlates. Biol Psychiatry 69(8):726–733. http://www.ncbi.nlm.nih.gov/pubmed/21447417 (August 7, 2019)

    Google Scholar 

  87. Silk JS et al (2007) Pupillary reactivity to emotional information in child and adolescent depression: links to clinical and ecological measures. Am J Psychiatry 164(12):1873–1880. http://www.ncbi.nlm.nih.gov/pubmed/18056243 (August 7, 2019)

    Google Scholar 

  88. Stratou G, Scherer S, Gratch J, Morency L-P (2013) Automatic nonverbal behavior indicators of depression and PTSD: exploring gender differences. In: 2013 Humaine association conference on affective computing and intelligent interaction. http://ieeexplore.ieee.org/document/6681422/ (August 7, 2019). IEEE, pp 147–152

  89. Suto T et al (2004) Multichannel near-infrared spectroscopy in depression and Schizophrenia: cognitive brain activation study. Biol Psychiatry 55 (5):501–511. http://www.ncbi.nlm.nih.gov/pubmed/15023578 (August 7, 2019)

    Google Scholar 

  90. Valstar M et al (2016) AVEC 2016—depression, mood, and emotion recognition workshop and challenge. 1605.01600 (August 7, 2019)

  91. van der Schalk J, Hawk ST, Fischer AH, Doosje B (2011) Moving faces, looking places: validation of the amsterdam dynamic facial expression set (ADFES). Emotion 11(4):907–920. http://doi.apa.org/getdoi.cfm?doi=10.1037/a0023853 (August 8, 2019)

    Google Scholar 

  92. Visser RM et al (2016) First steps in using multi-voxel pattern analysis to disentangle neural processes underlying generalization of spider fear. Front Hum Neurosci 10:222. http://www.ncbi.nlm.nih.gov/pubmed/27303278 (August 6, 2019)

    Google Scholar 

  93. Vlaescu G et al (2016) Features and functionality of the Iterapi platform for internet-based psychological treatment. Internet Interv 6:107–114. http://www.ncbi.nlm.nih.gov/pubmed/30135819 (August 5, 2019)

    Google Scholar 

  94. Wang Y, Kosinski M (2018) Deep neural networks are more accurate than humans at detecting sexual orientation from facial images. J Personal Social Psychol 114(2):246–257. http://doi.apa.org/getdoi.cfm?doi=10.1037/pspa0000098 (August 6, 2019)

    Google Scholar 

  95. Wang J et al (2014) Pupillometry in Chinese female patients with depression: a pilot study. Int J Environ Res Public Health 11 (2):2236–2243. http://www.mdpi.com/1660-4601/11/2/2236 (August 7, 2019)

    Google Scholar 

  96. Wang Q, Yang H, Yu Y (2018) Facial expression video analysis for depression detection in Chinese patients. J Vis Commun Image Represent 57:228–233. https://doi.org/10.1016/j.jvcir.2018.11.003

    Google Scholar 

  97. Watson D, Clark LA, Carey G (1988) Positive and negative affectivity and their relation to anxiety and depressive disorders. J Abnorm Psychol 97 (3):346–353. http://www.ncbi.nlm.nih.gov/pubmed/3192830 (August 5, 2019)

    Google Scholar 

  98. Waxer PH (1974) Therapist training in nonverbal communication I: nonverbal cues for depression. J Clin Psychol 30(2):215–218. http://doi.wiley.com/10.1002/1097-4679%28197404%2930%3A2%3C215%3A%3AAID-JCLP2270300229%3E3.0.CO%3B2-Q (August 7, 2019)

    Google Scholar 

  99. Whalen DJ, Sylvester CM, Luby JL (2017) Depression and anxiety in preschoolers: a review of the past 7 years. Child Adolesc Psychiatr Clin North America 26(3):503–522. http://www.ncbi.nlm.nih.gov/pubmed/28577606 (August 5, 2019)

    Google Scholar 

  100. Whelan R, Garavan H (2014) When optimism hurts: inflated predictions in psychiatric neuroimaging. Biol Psychiatry 75(9):746–748. http://www.ncbi.nlm.nih.gov/pubmed/23778288 (August 6, 2019)

    Google Scholar 

  101. Williamson JR et al (2014) Vocal and facial biomarkers of depression based on motor incoordination and timing. In: Proceedings of the 4th international workshop on audio/visual emotion challenge—AVEC ’14. http://dl.acm.org/citation.cfm?doid=2661806.2661809 (August 7, 2019). ACM Press, New York, pp 65–72

  102. Winograd-Gurvich C et al (2006) Ocular motor differences between melancholic and non-melancholic depression. J Affect Disord 93(1–3):193–203. https://www.sciencedirect.com/science/article/abs/pii/S0165032706001431 (August 7, 2019)

    Google Scholar 

  103. Winograd-Gurvich C et al (2006) Self-paced and reprogrammed saccades: differences between melancholic and non-melancholic depression. Neurosci Res 56(3):253–260. http://www.ncbi.nlm.nih.gov/pubmed/16914221 (August 7, 2019)

    Google Scholar 

  104. Wittchen H-U, Sonntag H (2000) Nicotine consumption in mental disorders: a clinical epidemiological perspective. Eur Neuropsychopharmacol 10:119. https://linkinghub.elsevier.com/retrieve/pii/S0924977X00800140 (August 5, 2019)

    Google Scholar 

  105. World Health Organization (2017) Depression and other common mental disorders. Institutes Health of National (1):1–22

  106. Yaden DB et al (2018) The language of religious affiliation. Social Psychol Personal Sci 9 (4):444–452. http://journals.sagepub.com/doi/10.1177/1948550617711228 (August 6, 2019)

    Google Scholar 

  107. Yang T-H, Wu C-H, Huang K -Y, Su M-H (2017) Coupled HMM-based multimodal fusion for mood disorder detection through elicited audio–visual signals. J Ambient Intell Humaniz Comput 8(6):895–906. http://link.springer.com/10.1007/s12652-016-0395-y (August 7, 2019)

    Google Scholar 

  108. Women are warmer but no less assertive than men: gender and language on Facebook ed. Christopher M. Danforth. PLOS ONE 11(5): e0155885. http://dx.plos.org/10.1371/journal.pone.0155885 (August 6, 2019)

  109. Wu Y, Kosinski M, Stillwell D (2015) Computer-based personality judgments are more accurate than those made by humans. Proc Natl Acad Sci USA 112(4):1036–1040. http://www.ncbi.nlm.nih.gov/pubmed/25583507 (August 6, 2019)

    Google Scholar 

  110. Yu Z et al (2013) Multimodal prediction of psychological disorders: learning verbal and nonverbal commonalities in adjacency pairs. https://www.semanticscholar.org/paper/Multimodal-Prediction-of-Psychological-Disorders%3A-Yu-Scherer/4a797110c9fbf8a05f0b5747402bc85d583a864e (August 8, 2019)

  111. Zhou D, Luo J, Silenzio V, Zhou Y, Hu J, Currier G, Kautz H (2015) Tackling mental health by integrating unobtrusive multimodal sensing. In: Proceedings of the twenty-ninth AAAI conference on artificial intelligence. https://dl.acm.org/citation.cfm?id=2887201 (August 8, 2019), p 1034

Download references

Author information

Authors and Affiliations

  1. Chitkara University Institute of Engineering & Technology, Chitkara University, Punjab, India

    Jaiteg Singh & Gaurav Goyal

Authors
  1. Jaiteg Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gaurav Goyal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jaiteg Singh.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, J., Goyal, G. Decoding depressive disorder using computer vision. Multimed Tools Appl 80, 8189–8212 (2021). https://doi.org/10.1007/s11042-020-10128-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10128-9

Keywords

Search

Navigation