Abstract
Making an accurate diagnosis of schizophrenia and related psychoses early in the course of the disease is important for initiating treatment and counseling patients and families. In this study, we developed classification models for early disease diagnosis using structural MRI (sMRI) and neuropsychological (NP) testing. We used sMRI measurements and NP test results from 28 patients with recent-onset schizophrenia and 47 healthy subjects, drawn from the larger sample of the Mind Clinical Imaging Consortium. We developed diagnostic models based on Linear Discriminant Analysis (LDA) following two approaches; namely, (a) stepwise (STP) LDA on the original measurements, and (b) LDA on variables created through Principal Component Analysis (PCA) and selected using the Humphrey-Ilgen parallel analysis. Error estimation of the modeling algorithms was evaluated by leave-one-out external cross-validation. These analyses were performed on sMRI and NP variables separately and in combination. The following classification accuracy was obtained for different variables and modeling algorithms. sMRI only: (a) STP-LDA: 64.3% sensitivity and 76.6% specificity, (b) PCA-LDA: 67.9% sensitivity and 72.3% specificity. NP only: (a) STP-LDA: 71.4% sensitivity and 80.9% specificity, (b) PCA-LDA: 78.5% sensitivity and 91.5% specificity. Combined sMRI-NP: (a) STP-LDA: 64.3% sensitivity and 83.0% specificity, (b) PCA-LDA: 89.3% sensitivity and 93.6% specificity. (i) Maximal diagnostic accuracy was achieved by combining sMRI and NP variables. (ii) NP variables were more informative than sMRI, indicating that cognitive deficits can be detected earlier than volumetric structural abnormalities. (iii) PCA-LDA yielded more accurate classification than STP-LDA. As these sMRI and NP tests are widely available, they can increase accuracy of early intervention strategies and possibly be used in evaluating treatment response.
Similar content being viewed by others
References
Ambroise, C., & McLachlan, G. J. (2002). Selection bias in gene extraction on the basis of microarray gene-expression data. Proceedings of the National Academy of Sciences of the United States of America, 99, 6562–6566.
Andreasen, N. C., Ehrhardt, J. C., Swayze, V. W., 2nd, Alliger, R. J., Yuh, W. T., Cohen, G., et al. (1990). Magnetic resonance imaging of the brain in schizophrenia. The pathophysiologic significance of structural abnormalities. Archives of General Psychiatry, 47, 35–44.
Andreasen, N. C., Flaum, M., & Arndt, S. (1992). The Comprehensive Assessment of Symptoms and History (CASH). An instrument for assessing diagnosis and psychopathology. Archives of General Psychiatry, 49, 615–623.
Annett, M. (1970). A classification of hand preference by association analysis. British Journal of Psychology (London, England: 1953), 61, 303–321.
Baaré, W. F., van Oel, C. J., Hulshoff Pol, H. E., Schnack, H. G., Durston, S., Sitskoorn, M. M., et al. (2001). Volumes of brain structures in twins discordant for schizophrenia. Archives of General Psychiatry, 58, 33–40.
Ballmaier, M., Schlagenhauf, F., Toga, A. W., Gallinat, J., Koslowski, M., Zoli, M., et al. (2008). Regional patterns and clinical correlates of basal ganglia morphology in non-medicated schizophrenia. Schizophrenia Research, 106, 140–147.
Borgwardt, S. J., Riecher-Rossler, A., Dazzan, P., Chitnis, X., Aston, J., Drewe, M., et al. (2007). Regional gray matter volume abnormalities in the at risk mental state. Biological Psychiatry, 61, 1148–1156.
Brandt, J. (1991). The Hopkins verbal learning test: development of a new memory test with six equivalent forms. Clinical Neuropsychologist, 5, 125–142.
Delis, D. C., Kaplan, E., & Kramer, J. H. (2001). Delis-Kaplan Executive Function System (DKEFS): Examiner’s manual. San Antonio, TX: The Psychological Corporation.
Dixon, W. J. (1992). BMDP statistical software manual. Berkley: University of California Press.
Duda, R. O., Hart, P. E., & Stork, D. G. (2001). Pattern classification (p. 654). New York: Wiley.
First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. (2001). Structural clinical interview for DSM-IV-TR axis I disorders, research version, patient edition with psychotic screen (SCID-I/P W/PSY SCREEN). New York: New York State Psychiatric Institute, Biometrics Research.
Fischl, B., Salat, D. H., Busa, E., Albert, M., Dieterich, M., Haselgrove, C., et al. (2002). Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron, 33, 341–355.
Georgopoulos, A. P., Karageorgiou, E., Leuthold, A. C., Lewis, S. M., Lynch, J. K., Alonso, A. A., et al. (2007). Synchronous neural interactions assessed by magnetoencephalography: a functional biomarker for brain disorders. Journal of Neural Engineering, 4, 349–355.
Glenthoj, A., Glenthoj, B. Y., Mackeprang, T., Pagsberg, A. K., Hemmingsen, R. P., Jernigan, T. L., et al. (2007). Basal ganglia volumes in drug-naive first-episode schizophrenia patients before and after short-term treatment with either a typical or an atypical antipsychotic drug. Psychiatry Research, 154, 199–208.
Green, P. E. (1978). Analyzing multivariate data. Hinsdale: The Dryden.
Harrigan, S. M., McGorry, P. D., & Krstev, H. (2003). Does treatment delay in first-episode psychosis really matter? Psychological Medicine, 33, 97–110.
Harrison, P. J. (1999). The neuropathology of schizophrenia. A critical review of the data and their interpretation. Brain: A Journal of Neurology, 122(Pt 4), 593–624.
Hawkins, K. A. (1999). Memory deficits in patients with schizophrenia: preliminary data from the Wechsler Memory Scale-Third Edition support earlier findings. Journal of Psychiatry & Neuroscience: JPN, 24, 341–347.
Hazlett, E. A., Buchsbaum, M. S., Haznedar, M. M., Newmark, R., Goldstein, K. E., Zelmanova, Y., et al. (2008). Cortical gray and white matter volume in unmedicated schizotypal and schizophrenia patients. Schizophrenia Research, 101, 111–123.
Hollingshead, A. B., & Redlich, F. C. (1958). Social class and mental illness; a community study (p. 442). New York: Wiley.
Hulshoff Pol, H. E., & Kahn, R. S. (2008). What happens after the first episode? A review of progressive brain changes in chronically ill patients with schizophrenia. Schizophrenia Bulletin, 34, 354–366.
Jovicich, J., Czanner, S., Greve, D., Haley, E., van der Kouwe, A., Gollub, R., et al. (2006). Reliability in multi-site structural MRI studies: effects of gradient non-linearity correction on phantom and human data. NeuroImage, 30, 436–443.
Jovicich, J., Czanner, S., Han, X., Salat, D., van der Kouwe, A., Quinn, B., et al. (2009). MRI-derived measurements of human subcortical, ventricular and intracranial brain volumes: reliability effects of scan sessions, acquisition sequences, data analyses, scanner upgrade, scanner vendors and field strengths. NeuroImage, 46, 177–192.
Kawasaki, Y., Suzuki, M., Nohara, S., Hagino, H., Takahashi, T., Matsui, M., et al. (2004). Structural brain differences in patients with schizophrenia and schizotypal disorder demonstrated by voxel-based morphometry. European Archives of Psychiatry and Clinical Neuroscience, 254, 406–414.
Keshavan, M. S., Anderson, S., & Pettegrew, J. W. (1994). Is schizophrenia due to excessive synaptic pruning in the prefrontal cortex? The Feinberg hypothesis revisited. Journal of Psychiatric Research, 28, 239–265.
Leeson, V. C., Barnes, T. R., Harrison, M., Matheson, E., Harrison, I., Mutsatsa, S. H., et al. (2008). The relationship between IQ, memory, executive function, and processing speed in recent-onset psychosis: 1-year stability and clinical outcome. Schizophrenia bulletin, [epub ahead of print]
Midorikawa, A., Hashimoto, R., Noguchi, H., Saitoh, O., Kunugi, H., & Nakamura, K. (2008). Impairment of motor dexterity in schizophrenia assessed by a novel finger movement test. Psychiatry Research, 159, 281–289.
Miller, E. N. (1990). California computerized assessment battery (CalCAP) manual. Los Angeles: Norland Software.
O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers: A Journal of the Psychonomic Society, Inc, 32, 396–402.
Pardo, P. J., Georgopoulos, A. P., Kenny, J. T., Stuve, T. A., Findling, R. L., & Schulz, S. C. (2006). Classification of adolescent psychotic disorders using linear discriminant analysis. Schizophrenia Research, 87, 297–306.
Pepe, M. S. (2005). Evaluating technologies for classification and prediction in medicine. Statistics in Medicine, 24, 3687–3696.
Reitan, R. M. (1958). Validity of the trail making test as indicator of organic brain damage. Perceptual and Motor Skills, 8, 271–276.
Roberts, R. C., Roche, J. K., & Conley, R. R. (2008). Differential synaptic changes in the striatum of subjects with undifferentiated versus paranoid schizophrenia. Synapse (New York, N.Y.), 62, 616–627.
Robins, E., & Guze, S. B. (1970). Establishment of diagnostic validity in psychiatric illness: its application to schizophrenia. The American Journal of Psychiatry, 126, 983–987.
Ruff, R. M., & Parker, S. B. (1993). Gender- and age-specific changes in motor speed and eye-hand coordination in adults: normative values for the Finger Tapping and Grooved Pegboard Tests. Perceptual and Motor Skills, 76, 1219–1230.
Segall, J. M., Turner, J. A., van Erp, T. G., White, T., Bockholt, H. J., Gollub, R. L., et al. (2009). Voxel-based morphometric multisite collaborative study on schizophrenia. Schizophrenia Bulletin, 35, 82–95.
Selemon, L. D. (2001). Regionally diverse cortical pathology in schizophrenia: clues to the etiology of the disease. Schizophrenia Bulletin, 27, 349–377.
Shallice, T. (1982). Specific impairments of planning. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 298, 199–209.
Sponheim, S. R., Jung, R. E., Seidman, L. J., Mesholam-Gately, R. I., Manoach, D. S., O’Leary, D. S., et al. (2009). Cognitive deficits in recent-onset and chronic schizophrenia. Journal of Psychiatric Research, 44, 421–8.
Szeszko, P. R., Bilder, R. M., Lencz, T., Pollack, S., Alvir, J. M., Ashtari, M., et al. (1999). Investigation of frontal lobe subregions in first-episode schizophrenia. Psychiatry Research, 90, 1–15.
Velakoulis, D., Wood, S. J., Smith, D. J., Soulsby, B., Brewer, W., Leeton, L., et al. (2002). Increased duration of illness is associated with reduced volume in right medial temporal/anterior cingulate grey matter in patients with chronic schizophrenia. Schizophrenia Research, 57, 43–49.
Wang, L., Mamah, D., Harms, M. P., Karnik, M., Price, J. L., Gado, M. H., et al. (2008). Progressive deformation of deep brain nuclei and hippocampal-amygdala formation in schizophrenia. Biological Psychiatry, 64, 1060–1068.
Watson, C. G., Gasser, B., Schaefer, A., Buranen, C., & Wold, J. (1981). Separation of brain-damaged from psychiatric patients with ability and personality measures. Journal of Clinical Psychology, 37, 347–353.
Wechsler, D. (1997a). Wechsler adult intelligence scale. San Antonio: Psychological Corporation.
Wechsler, D. (1997b). Wechsler memory scale. San Antonio: Psychological Corporation.
Wilkinson, G. (1993). Wide range achievement test. Wilmington: Wide Range, Inc.
World Medical Association General Assembly. (2004). World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. Journal International de Bioéthique, 15, 124–129.
Acknowledgments
Supported by the United States Department of Energy under Award Number DE-FG02-99ER62764 to The Mind Research Network (formerly The Mental Illness and Neuroscience Discovery [MIND] Institute), the Department of Veterans Affairs, the American Legion Brain Sciences Chair, and the Stanley Medical Research Institute.
The authors thank Dr. Christopher Bingham for advice on the PCA, and Mary A. Jacintha and Kathleen E. Kelly for help in study coordination.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Karageorgiou, E., Schulz, S.C., Gollub, R.L. et al. Neuropsychological Testing and Structural Magnetic Resonance Imaging as Diagnostic Biomarkers Early in the Course of Schizophrenia and Related Psychoses. Neuroinform 9, 321–333 (2011). https://doi.org/10.1007/s12021-010-9094-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12021-010-9094-6