Diagnostic classification of unipolar depression based on resting-state functional connectivity MRI: effects of generalization to a diverse sample
- 792 Downloads
In small, selected samples, an approach combining resting-state functional connectivity MRI and multivariate pattern analysis has been able to successfully classify patients diagnosed with unipolar depression. Purposes of this investigation were to assess the generalizability of this approach to a large clinically more realistic sample and secondarily to assess the replicability of previously reported methodological feasibility in a more homogeneous subgroup with pronounced depressive symptoms. Two independent subsets were drawn from the depression and control cohorts of the BiDirect study, each with 180 patients with and 180 controls without depression. Functional connectivity either among regions covering the gray matter or selected regions with known alterations in depression was assessed by resting-state fMRI. Support vector machines with and without automated feature selection were used to train classifiers differentiating between individual patients and controls in the entire first subset as well as in the subgroup. Model parameters were explored systematically. The second independent subset was used for validation of successful models. Classification accuracies in the large, heterogeneous sample ranged from 45.0 to 56.1% (chance level 50.0%). In the subgroup with higher depression severity, three out of 90 models performed significantly above chance (60.8–61.7% at independent validation). In conclusion, common classification methods previously successful in small homogenous depression samples do not immediately translate to a more realistic population. Future research to develop diagnostic classification approaches in depression should focus on more specific clinical questions and consider heterogeneity, including symptom severity as an important factor.
KeywordsfMRI Functional connectivity Classification MVPA Depression
The authors thank all study participants and the entire team of the BiDirect study, including collaborators in associated institutions. Thanks also go to Jens Bode for support with the execution of data analyses.
Compliance with ethical standards
Conflicts of interest
The following authors declared additional financial relationships not directly related to this work: BP has received grants from EU European Social Fund and the German Ministry of Education and Research. VA is board member for Lundbeck, Otsuka, Servier and Tromsdorff and has received honoraria from Lundbeck, Otsuka and Servier.
BiDirect is funded by a research Grant (FZK: 01ER0816) from the German Federal Ministry of Education and Research (BMBF). This analysis was additionally supported by BMBF Grant 01ER1205.
The study was approved by the ethics committee of the University of Münster and the Westphalian Chamber of Physicians in Münster. All procedures were done in accordance with the Helsinki Declaration.
Written informed consent for participation in the study was obtained from all participants.
- Ackenheil M, Stotz-Ingenlath G, Dietz-Bauer R, Vossen A (1999) Mini International Neuropsychiatric Interview (German version 5.0.0, DSM-IV). Psychiatric University Clinic, MunichGoogle Scholar
- Alpaydin E (2010) Introduction to machine learning. The MIT Press, CambridgeGoogle Scholar
- Andrade L, Caraveo-Anduaga JJ, Berglund P, Bijl RV, De Graaf R, Vollebergh W, Dragomirecka E, Kohn R, Keller M, Kessler RC, Kawakami N, Kilic C, Offord D, Ustun TB, Wittchen HU (2003) The epidemiology of major depressive episodes: results from the International Consortium of Psychiatric Epidemiology (ICPE) Surveys. Int J Methods Psychiatr Res 12:3–21CrossRefPubMedGoogle Scholar
- Arbabshirani MR, Plis S, Sui J, Calhoun VD (2017) Single subject prediction of brain disorders in neuroimaging: promises and pitfalls. Neuroimage 145 (part B):137–165. doi: 10.1016/j.neuroimage.2016.02.079
- Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B (Methodol) 57:289–300Google Scholar
- Bhaumik R, Jenkins LM, Gowins JR, Jacobs RH, Barba A, Bhaumik DK, Langenecker SA (2016) Multivariate pattern analysis strategies in detection of remitted major depressive disorder using resting state functional connectivity. Neuroimage Clin. doi: 10.1016/j.nicl.2016.02.018
- Chu C, Hsu AL, Chou KH, Bandettini P, Lin C, Alzheimer’s Disease Neuroimaging Initiative (2012) Does feature selection improve classification accuracy? Impact of sample size and feature selection on classification using anatomical magnetic resonance images. Neuroimage 60:59–70CrossRefPubMedGoogle Scholar
- Dannlowski U, Ohrmann P, Konrad C, Domschke K, Bauer J, Kugel H, Hohoff C, Schoning S, Kersting A, Baune BT, Mortensen LS, Arolt V, Zwitserlood P, Deckert J, Heindel W, Suslow T (2009) Reduced amygdala-prefrontal coupling in major depression: association with MAOA genotype and illness severity. Int J Neuropsychopharmacol 12:11–22CrossRefPubMedGoogle Scholar
- Dosenbach NU, Nardos B, Cohen AL, Fair DA, Power JD, Church JA, Nelson SM, Wig GS, Vogel AC, Lessov-Schlaggar CN, Barnes KA, Dubis JW, Feczko E, Coalson RS, Pruett JR Jr, Barch DM, Petersen SE, Schlaggar BL (2010) Prediction of individual brain maturity using fMRI. Science 329:1358–1361CrossRefPubMedPubMedCentralGoogle Scholar
- Douaud G, Groves AR, Tamnes CK, Westlye LT, Duff EP, Engvig A, Walhovd KB, James A, Gass A, Monsch AU, Matthews PM, Fjell AM, Smith SM, Johansen-Berg H (2014) A common brain network links development, aging, and vulnerability to disease. Proc Natl Acad Sci USA 111:17648–17653CrossRefPubMedPubMedCentralGoogle Scholar
- Douaud G, Menke RA, Gass A, Monsch AU, Rao A, Whitcher B, Zamboni G, Matthews PM, Sollberger M, Smith S (2013) Brain microstructure reveals early abnormalities more than two years prior to clinical progression from mild cognitive impairment to Alzheimer’s disease. J Neurosci 33:2147–2155CrossRefPubMedGoogle Scholar
- Dunlop BW, Binder EB, Cubells JF, Goodman MM, Kelley ME, Kinkead B, Kutner M, Nemeroff CB, Newport DJ, Owens MJ, Pace TW, Ritchie JC, Rivera VA, Westen D, Craighead WE, Mayberg HS (2012) Predictors of remission in depression to individual and combined treatments (PReDICT): study protocol for a randomized controlled trial. Trials 13:106CrossRefPubMedPubMedCentralGoogle Scholar
- Grieve SM, Korgaonkar MS, Etkin A, Harris A, Koslow SH, Wisniewski S, Schatzberg AF, Nemeroff CB, Gordon E, Williams LM (2013) Brain imaging predictors and the international study to predict optimized treatment for depression: study protocol for a randomized controlled trial. Trials 14:224CrossRefPubMedPubMedCentralGoogle Scholar
- Hahn T, Kircher T, Straube B, Wittchen HU, Konrad C, Strohle A, Wittmann A, Pfleiderer B, Reif A, Arolt V, Lueken U (2015) Predicting treatment response to cognitive behavioral therapy in panic disorder with agoraphobia by integrating local neural information. JAMA Psychiatry 72(1):68–74CrossRefPubMedGoogle Scholar
- Krishnan R (2014) Unipolar depression in adults: epidemiology, pathogenesis, and neurobiology. In: Solomon D (ed) UpToDate. Wolters Kluwer Health, Alphen aan de RijnGoogle Scholar
- Mierswa I, Wurst M, Klinkenberg R, Scholz M, Euler T (2006) YALE: rapid prototyping for complex data mining tasks. In: Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 935–940Google Scholar
- Sarraf S, Tofighi G (2016) Classification of Alzheimer’s disease using fMRI data and deep learning convolutional neural networks. arXiv 1603.08631Google Scholar
- Schmaal L, Marquand AF, Rhebergen D, van Tol M, Ruhe HG, van der Wee NJ, Veltman DJ, Penninx BWJH (2014) Predicting the naturalistic course of major depressive disorder using clinical and multimodal neuroimaging information: a multivariate pattern recognition study. Biol Psychiatry 78(4):278–286CrossRefPubMedGoogle Scholar
- Schouten TM, Koini M, de Vos F, Seiler S, van der Grond J, Lechner A, Hafkemeijer A, Moller C, Schmidt R, de Rooij M, Rombouts SA (2016) Combining anatomical, diffusion, and resting state functional magnetic resonance imaging for individual classification of mild and moderate Alzheimer’s disease. Neuroimage Clin 11:46–51CrossRefPubMedPubMedCentralGoogle Scholar
- Schowe B (2011) Feature selection for high-dimensional data with RapidMiner. In: Proceedings of the 2nd RapidMIner Community Meeting and Conferenc (RCOMM 2011)Google Scholar
- Teismann H, Wersching H, Nagel M, Arolt V, Heindel W, Baune BT, Wellmann J, Hense HW, Berger K (2014) Establishing the bidirectional relationship between depression and subclinical arteriosclerosis–rationale, design, and characteristics of the BiDirect Study. BMC Psychiatry 14:174CrossRefPubMedPubMedCentralGoogle Scholar
- Teuber A, Sundermann B, Kugel H, Schwindt W, Heindel W, Minnerup J, Dannlowski U, Berger K, Wersching H (2017) MR imaging of the brain in large cohort studies—feasibility report of the population- and patient-based BiDirect study. Eur Radiol 27:231–238Google Scholar
- Trivedi M, McGrath PJ, Fava M, Parsey RV, Kurian BT, Phillips ML, Oquendo M, Bruder G, Pizzagalli DA, Toups M, Cooper C, Adams P, Weyandt S, Morris DW, Grannemann BD, Ogden RT, Bucker R, McInnis M, Kramer HC, Petkova E, Carmody T, Weissmann MM (2016) Establishing moderators and biosignatures of antidepressant response in clinical care (EMBARC): rationale and design. J Psychiatr Res 78:11–23. doi: 10.1016/j.jpsychires.2016.03.001
- Ugurbil K, Xu J, Auerbach EJ, Moeller S, Vu AT, Duarte-Carvajalino JM, Lenglet C, Wu X, Schmitter S, Van de Moortele PF, Strupp J, Sapiro G, De Martino F, Wang D, Harel N, Garwood M, Chen L, Feinberg DA, Smith SM, Miller KL, Sotiropoulos SN, Jbabdi S, Andersson JL, Behrens TE, Glasser MF, Van Essen DC, Yacoub E, WU-Minn HCP Consortium (2013) Pushing spatial and temporal resolution for functional and diffusion MRI in the human connectome project. Neuroimage 80:80–104CrossRefPubMedPubMedCentralGoogle Scholar