Skip to main content

Advertisement

Log in

Neuropsychological Testing and Structural Magnetic Resonance Imaging as Diagnostic Biomarkers Early in the Course of Schizophrenia and Related Psychoses

  • Published:
Neuroinformatics Aims and scope Submit manuscript

Abstract

Making an accurate diagnosis of schizophrenia and related psychoses early in the course of the disease is important for initiating treatment and counseling patients and families. In this study, we developed classification models for early disease diagnosis using structural MRI (sMRI) and neuropsychological (NP) testing. We used sMRI measurements and NP test results from 28 patients with recent-onset schizophrenia and 47 healthy subjects, drawn from the larger sample of the Mind Clinical Imaging Consortium. We developed diagnostic models based on Linear Discriminant Analysis (LDA) following two approaches; namely, (a) stepwise (STP) LDA on the original measurements, and (b) LDA on variables created through Principal Component Analysis (PCA) and selected using the Humphrey-Ilgen parallel analysis. Error estimation of the modeling algorithms was evaluated by leave-one-out external cross-validation. These analyses were performed on sMRI and NP variables separately and in combination. The following classification accuracy was obtained for different variables and modeling algorithms. sMRI only: (a) STP-LDA: 64.3% sensitivity and 76.6% specificity, (b) PCA-LDA: 67.9% sensitivity and 72.3% specificity. NP only: (a) STP-LDA: 71.4% sensitivity and 80.9% specificity, (b) PCA-LDA: 78.5% sensitivity and 91.5% specificity. Combined sMRI-NP: (a) STP-LDA: 64.3% sensitivity and 83.0% specificity, (b) PCA-LDA: 89.3% sensitivity and 93.6% specificity. (i) Maximal diagnostic accuracy was achieved by combining sMRI and NP variables. (ii) NP variables were more informative than sMRI, indicating that cognitive deficits can be detected earlier than volumetric structural abnormalities. (iii) PCA-LDA yielded more accurate classification than STP-LDA. As these sMRI and NP tests are widely available, they can increase accuracy of early intervention strategies and possibly be used in evaluating treatment response.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Ambroise, C., & McLachlan, G. J. (2002). Selection bias in gene extraction on the basis of microarray gene-expression data. Proceedings of the National Academy of Sciences of the United States of America, 99, 6562–6566.

    Article  PubMed  CAS  Google Scholar 

  • Andreasen, N. C., Ehrhardt, J. C., Swayze, V. W., 2nd, Alliger, R. J., Yuh, W. T., Cohen, G., et al. (1990). Magnetic resonance imaging of the brain in schizophrenia. The pathophysiologic significance of structural abnormalities. Archives of General Psychiatry, 47, 35–44.

    PubMed  CAS  Google Scholar 

  • Andreasen, N. C., Flaum, M., & Arndt, S. (1992). The Comprehensive Assessment of Symptoms and History (CASH). An instrument for assessing diagnosis and psychopathology. Archives of General Psychiatry, 49, 615–623.

    PubMed  CAS  Google Scholar 

  • Annett, M. (1970). A classification of hand preference by association analysis. British Journal of Psychology (London, England: 1953), 61, 303–321.

    Article  CAS  Google Scholar 

  • Baaré, W. F., van Oel, C. J., Hulshoff Pol, H. E., Schnack, H. G., Durston, S., Sitskoorn, M. M., et al. (2001). Volumes of brain structures in twins discordant for schizophrenia. Archives of General Psychiatry, 58, 33–40.

    Article  PubMed  Google Scholar 

  • Ballmaier, M., Schlagenhauf, F., Toga, A. W., Gallinat, J., Koslowski, M., Zoli, M., et al. (2008). Regional patterns and clinical correlates of basal ganglia morphology in non-medicated schizophrenia. Schizophrenia Research, 106, 140–147.

    Article  PubMed  Google Scholar 

  • Borgwardt, S. J., Riecher-Rossler, A., Dazzan, P., Chitnis, X., Aston, J., Drewe, M., et al. (2007). Regional gray matter volume abnormalities in the at risk mental state. Biological Psychiatry, 61, 1148–1156.

    Article  PubMed  Google Scholar 

  • Brandt, J. (1991). The Hopkins verbal learning test: development of a new memory test with six equivalent forms. Clinical Neuropsychologist, 5, 125–142.

    Article  Google Scholar 

  • Delis, D. C., Kaplan, E., & Kramer, J. H. (2001). Delis-Kaplan Executive Function System (DKEFS): Examiner’s manual. San Antonio, TX: The Psychological Corporation.

    Google Scholar 

  • Dixon, W. J. (1992). BMDP statistical software manual. Berkley: University of California Press.

    Google Scholar 

  • Duda, R. O., Hart, P. E., & Stork, D. G. (2001). Pattern classification (p. 654). New York: Wiley.

    Google Scholar 

  • First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. (2001). Structural clinical interview for DSM-IV-TR axis I disorders, research version, patient edition with psychotic screen (SCID-I/P W/PSY SCREEN). New York: New York State Psychiatric Institute, Biometrics Research.

    Google Scholar 

  • Fischl, B., Salat, D. H., Busa, E., Albert, M., Dieterich, M., Haselgrove, C., et al. (2002). Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron, 33, 341–355.

    Article  PubMed  CAS  Google Scholar 

  • Georgopoulos, A. P., Karageorgiou, E., Leuthold, A. C., Lewis, S. M., Lynch, J. K., Alonso, A. A., et al. (2007). Synchronous neural interactions assessed by magnetoencephalography: a functional biomarker for brain disorders. Journal of Neural Engineering, 4, 349–355.

    Article  PubMed  Google Scholar 

  • Glenthoj, A., Glenthoj, B. Y., Mackeprang, T., Pagsberg, A. K., Hemmingsen, R. P., Jernigan, T. L., et al. (2007). Basal ganglia volumes in drug-naive first-episode schizophrenia patients before and after short-term treatment with either a typical or an atypical antipsychotic drug. Psychiatry Research, 154, 199–208.

    Article  PubMed  CAS  Google Scholar 

  • Green, P. E. (1978). Analyzing multivariate data. Hinsdale: The Dryden.

    Google Scholar 

  • Harrigan, S. M., McGorry, P. D., & Krstev, H. (2003). Does treatment delay in first-episode psychosis really matter? Psychological Medicine, 33, 97–110.

    Article  PubMed  CAS  Google Scholar 

  • Harrison, P. J. (1999). The neuropathology of schizophrenia. A critical review of the data and their interpretation. Brain: A Journal of Neurology, 122(Pt 4), 593–624.

    Article  Google Scholar 

  • Hawkins, K. A. (1999). Memory deficits in patients with schizophrenia: preliminary data from the Wechsler Memory Scale-Third Edition support earlier findings. Journal of Psychiatry & Neuroscience: JPN, 24, 341–347.

    CAS  Google Scholar 

  • Hazlett, E. A., Buchsbaum, M. S., Haznedar, M. M., Newmark, R., Goldstein, K. E., Zelmanova, Y., et al. (2008). Cortical gray and white matter volume in unmedicated schizotypal and schizophrenia patients. Schizophrenia Research, 101, 111–123.

    Article  PubMed  Google Scholar 

  • Hollingshead, A. B., & Redlich, F. C. (1958). Social class and mental illness; a community study (p. 442). New York: Wiley.

    Book  Google Scholar 

  • Hulshoff Pol, H. E., & Kahn, R. S. (2008). What happens after the first episode? A review of progressive brain changes in chronically ill patients with schizophrenia. Schizophrenia Bulletin, 34, 354–366.

    Article  PubMed  Google Scholar 

  • Jovicich, J., Czanner, S., Greve, D., Haley, E., van der Kouwe, A., Gollub, R., et al. (2006). Reliability in multi-site structural MRI studies: effects of gradient non-linearity correction on phantom and human data. NeuroImage, 30, 436–443.

    Article  PubMed  Google Scholar 

  • Jovicich, J., Czanner, S., Han, X., Salat, D., van der Kouwe, A., Quinn, B., et al. (2009). MRI-derived measurements of human subcortical, ventricular and intracranial brain volumes: reliability effects of scan sessions, acquisition sequences, data analyses, scanner upgrade, scanner vendors and field strengths. NeuroImage, 46, 177–192.

    Article  PubMed  Google Scholar 

  • Kawasaki, Y., Suzuki, M., Nohara, S., Hagino, H., Takahashi, T., Matsui, M., et al. (2004). Structural brain differences in patients with schizophrenia and schizotypal disorder demonstrated by voxel-based morphometry. European Archives of Psychiatry and Clinical Neuroscience, 254, 406–414.

    Article  PubMed  Google Scholar 

  • Keshavan, M. S., Anderson, S., & Pettegrew, J. W. (1994). Is schizophrenia due to excessive synaptic pruning in the prefrontal cortex? The Feinberg hypothesis revisited. Journal of Psychiatric Research, 28, 239–265.

    Article  PubMed  CAS  Google Scholar 

  • Leeson, V. C., Barnes, T. R., Harrison, M., Matheson, E., Harrison, I., Mutsatsa, S. H., et al. (2008). The relationship between IQ, memory, executive function, and processing speed in recent-onset psychosis: 1-year stability and clinical outcome. Schizophrenia bulletin, [epub ahead of print]

  • Midorikawa, A., Hashimoto, R., Noguchi, H., Saitoh, O., Kunugi, H., & Nakamura, K. (2008). Impairment of motor dexterity in schizophrenia assessed by a novel finger movement test. Psychiatry Research, 159, 281–289.

    Article  PubMed  Google Scholar 

  • Miller, E. N. (1990). California computerized assessment battery (CalCAP) manual. Los Angeles: Norland Software.

    Google Scholar 

  • O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers: A Journal of the Psychonomic Society, Inc, 32, 396–402.

    Article  Google Scholar 

  • Pardo, P. J., Georgopoulos, A. P., Kenny, J. T., Stuve, T. A., Findling, R. L., & Schulz, S. C. (2006). Classification of adolescent psychotic disorders using linear discriminant analysis. Schizophrenia Research, 87, 297–306.

    Article  PubMed  Google Scholar 

  • Pepe, M. S. (2005). Evaluating technologies for classification and prediction in medicine. Statistics in Medicine, 24, 3687–3696.

    Article  PubMed  CAS  Google Scholar 

  • Reitan, R. M. (1958). Validity of the trail making test as indicator of organic brain damage. Perceptual and Motor Skills, 8, 271–276.

    Google Scholar 

  • Roberts, R. C., Roche, J. K., & Conley, R. R. (2008). Differential synaptic changes in the striatum of subjects with undifferentiated versus paranoid schizophrenia. Synapse (New York, N.Y.), 62, 616–627.

    Article  CAS  Google Scholar 

  • Robins, E., & Guze, S. B. (1970). Establishment of diagnostic validity in psychiatric illness: its application to schizophrenia. The American Journal of Psychiatry, 126, 983–987.

    PubMed  CAS  Google Scholar 

  • Ruff, R. M., & Parker, S. B. (1993). Gender- and age-specific changes in motor speed and eye-hand coordination in adults: normative values for the Finger Tapping and Grooved Pegboard Tests. Perceptual and Motor Skills, 76, 1219–1230.

    Article  PubMed  CAS  Google Scholar 

  • Segall, J. M., Turner, J. A., van Erp, T. G., White, T., Bockholt, H. J., Gollub, R. L., et al. (2009). Voxel-based morphometric multisite collaborative study on schizophrenia. Schizophrenia Bulletin, 35, 82–95.

    Article  PubMed  Google Scholar 

  • Selemon, L. D. (2001). Regionally diverse cortical pathology in schizophrenia: clues to the etiology of the disease. Schizophrenia Bulletin, 27, 349–377.

    PubMed  CAS  Google Scholar 

  • Shallice, T. (1982). Specific impairments of planning. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 298, 199–209.

    Article  PubMed  CAS  Google Scholar 

  • Sponheim, S. R., Jung, R. E., Seidman, L. J., Mesholam-Gately, R. I., Manoach, D. S., O’Leary, D. S., et al. (2009). Cognitive deficits in recent-onset and chronic schizophrenia. Journal of Psychiatric Research, 44, 421–8.

    Article  PubMed  Google Scholar 

  • Szeszko, P. R., Bilder, R. M., Lencz, T., Pollack, S., Alvir, J. M., Ashtari, M., et al. (1999). Investigation of frontal lobe subregions in first-episode schizophrenia. Psychiatry Research, 90, 1–15.

    Article  PubMed  CAS  Google Scholar 

  • Velakoulis, D., Wood, S. J., Smith, D. J., Soulsby, B., Brewer, W., Leeton, L., et al. (2002). Increased duration of illness is associated with reduced volume in right medial temporal/anterior cingulate grey matter in patients with chronic schizophrenia. Schizophrenia Research, 57, 43–49.

    Article  PubMed  Google Scholar 

  • Wang, L., Mamah, D., Harms, M. P., Karnik, M., Price, J. L., Gado, M. H., et al. (2008). Progressive deformation of deep brain nuclei and hippocampal-amygdala formation in schizophrenia. Biological Psychiatry, 64, 1060–1068.

    Article  PubMed  Google Scholar 

  • Watson, C. G., Gasser, B., Schaefer, A., Buranen, C., & Wold, J. (1981). Separation of brain-damaged from psychiatric patients with ability and personality measures. Journal of Clinical Psychology, 37, 347–353.

    Article  PubMed  CAS  Google Scholar 

  • Wechsler, D. (1997a). Wechsler adult intelligence scale. San Antonio: Psychological Corporation.

    Google Scholar 

  • Wechsler, D. (1997b). Wechsler memory scale. San Antonio: Psychological Corporation.

    Google Scholar 

  • Wilkinson, G. (1993). Wide range achievement test. Wilmington: Wide Range, Inc.

    Google Scholar 

  • World Medical Association General Assembly. (2004). World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. Journal International de Bioéthique, 15, 124–129.

    Article  Google Scholar 

Download references

Acknowledgments

Supported by the United States Department of Energy under Award Number DE-FG02-99ER62764 to The Mind Research Network (formerly The Mental Illness and Neuroscience Discovery [MIND] Institute), the Department of Veterans Affairs, the American Legion Brain Sciences Chair, and the Stanley Medical Research Institute.

The authors thank Dr. Christopher Bingham for advice on the PCA, and Mary A. Jacintha and Kathleen E. Kelly for help in study coordination.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Apostolos P. Georgopoulos.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Karageorgiou, E., Schulz, S.C., Gollub, R.L. et al. Neuropsychological Testing and Structural Magnetic Resonance Imaging as Diagnostic Biomarkers Early in the Course of Schizophrenia and Related Psychoses. Neuroinform 9, 321–333 (2011). https://doi.org/10.1007/s12021-010-9094-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12021-010-9094-6

Keywords

Navigation