Accuracy and generalization capability of an automatic method for the detection of typical brain hypometabolism in prodromal Alzheimer disease
The aim of this study was to verify the reliability and generalizability of an automatic tool for the detection of Alzheimer-related hypometabolic pattern based on a Support-Vector-Machine (SVM) model analyzing 18F-fluorodeoxyglucose (FDG) PET data.
The SVM model processed metabolic data from anatomical volumes of interest also considering interhemispheric asymmetries. It was trained on a homogeneous dataset from a memory clinic center and tested on an independent multicentric dataset drawn from the Alzheimer’s Disease Neuroimaging Initiative. Subjects were included in the study and classified based on a diagnosis confirmed after an adequate follow-up time.
The accuracy of the discrimination between patients with Alzheimer Disease (AD), in either prodromal or dementia stage, and normal aging subjects was 95.8%, after cross-validation, in the training set. The accuracy of the same model in the testing set was 86.5%. The role of the two datasets was then reversed, and the accuracy was 89.8% in the multicentric training set and 88.0% in the monocentric testing set. The classification rate was also evaluated in different subgroups, including non-converter mild cognitive impairment (MCI) patients, subjects with MCI reverted to normal conditions and subjects with non-confirmed memory concern. The percent of pattern detections increased from 77% in early prodromal AD to 91% in AD dementia, while it was about 10% for healthy controls and non-AD patients.
The present findings show a good level of reproducibility and generalizability of a model for detecting the hypometabolic pattern in AD and confirm the accuracy of FDG-PET in Alzheimer disease.
KeywordsAlzheimer disease MCI due to AD FDG-PET Discriminant analysis Neuroimage classification Classification and prediction Neurodegenerative disorders Support vector machine
Data collection and sharing for this project was partly funded by the Alzheimer’s Disease Neuroimaging Initiative (ADNI) (National Institutes of Health Grant U01 AG024904) and DOD ADNI (Department of Defense award number W81XWH-12-2-0012). ADNI is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering, and through contributions from the following: AbbVie, Alzheimer’s Association; Alzheimer’s Drug Discovery Foundation; Araclon Biotech; BioClinica, Inc.; Biogen; Bristol-Myers Squibb Company; CereSpir, Inc.; Cogstate; Eisai Inc.; Elan Pharmaceuticals, Inc.; Eli Lilly and Company; EuroImmun; F. Hoffmann-La Roche Ltd. and its affiliated company Genentech, Inc.; Fujirebio; GE Healthcare; IXICO Ltd.; Janssen Alzheimer Immunotherapy Research&Development, LLC.; Johnson & Johnson Pharmaceutical Research&Development LLC.; Lumosity; Lundbeck; Merck&Co., Inc.; Meso Scale Diagnostics, LLC.; NeuroRx Research; Neurotrack Technologies; Novartis Pharmaceuticals Corporation; Pfizer Inc.; Piramal Imaging; Servier; Takeda Pharmaceutical Company; and Transition Therapeutics. The Canadian Institutes of Health Research provides funds to support ADNI clinical sites in Canada. Private sector contributions are facilitated by the Foundation for the National Institutes of Health (www.fnih.org). The grantee organization is the Northern California Institute for Research and Education, and the study is coordinated by the Alzheimer’s Therapeutic Research Institute at the University of Southern California. ADNI data are disseminated by the Laboratory for Neuro Imaging at the University of Southern California.
A substantial part of data used in preparation of this article were obtained from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database (adni.loni.usc.edu). As such, the investigators within the ADNI contributed to the design and implementation of ADNI and/or provided data but did not participate in analysis or writing of this report. A complete listing of ADNI investigators can be found at: http://adni.loni.usc.edu/wp-content/uploads/how_to_apply/ADNI_Acknowledgement_List.pdf
Compliance with ethical standards
Conflict of interest
F.N.: received personal fees and nonfinancial support from GE Healthcare, non-financial support from Eli-Lilly and grants from Chiesi Farmaceutici; D.A. received speaking honoraria from Fidia s.p.a.; S.M. acted as a consultant for Eli Lilly in 2014 and for Avid Radiopharmaceuticals in 2016. All other authors have no potential conflicts to declare.
The institutional review board of the University of Genoa approved the recording and data treatment procedures involving human participants in this study and all procedures were in accordance with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
- 4.Signorini M, Paulesu E, Friston K, Perani D, Colleluori A, Lucignani G, et al. Rapid assessment of regional cerebral metabolic abnormalities in single subjects with quantitative and nonquantitative [18F]FDG PET: a clinical validation of statistical parametric mapping. NeuroImage. 1999;9:63–80.CrossRefGoogle Scholar
- 6.Perani D, Della Rosa PA, Cerami C, Gallivanone F, Fallanca F, Vanoli EG, et al. Validation of an optimized SPM procedure for FDG-PET in dementia diagnosis in a clinical setting. NeuroImage Clin [Internet]. Elsevier B.V. 2014;6:445–54. Available from: https://doi.org/10.1016/j.nicl.2014.10.009.
- 9.Chen K, Ayutyanont N, Langbaum JBS, Fleisher AS, Reschke C, Lee W, et al. Characterizing Alzheimer’s disease using a hypometabolic convergence index. NeuroImage [Internet]. Elsevier Inc. 2011;56:52–60. Available from: https://doi.org/10.1016/j.neuroimage.2011.01.049.
- 11.Pagani M, De Carli F, Morbelli S, Öberg J, Chincarini A, Frisoni GB, et al. Volume of interest-based [18F]fluorodeoxyglucose PET discriminates MCI converting to Alzheimer’s disease from healthy controls. A European Alzheimer’s disease consortium (EADC) study. NeuroImage Clin [Internet]. 2015;7:34–42. Available from: http://europepmc.org/abstract/med/25610765.
- 13.Smailagic N, Vacante M, Hyde C, Martin S, Ukoumunne O, Sachpekidis C. F-FDG-PET for the early diagnosis of Alzheimer ’ s disease dementia and other dementias in people with mild cognitive impairment ( MCI ) (review). Cochrane Database Syst Rev. 2015:1–104.Google Scholar
- 15.Morbelli S, Drzezga A, Perneczky R, Frisoni GB, Caroli A, Van Berckel BNM, et al. Resting metabolic connectivity in prodromal Alzheimer’s disease. A European Alzheimer disease consortium (EADC) project. Neurobiol Aging [Internet]. Elsevier Inc. 2012;33:2533–50. Available from: https://doi.org/10.1016/j.neurobiolaging.2012.01.005.
- 17.Herholz K, Westwood S, Haense C, Dunn G. Evaluation of a calibrated 18F-FDG PET score as a biomarker for progression in Alzheimer disease and mild cognitive impairment. J Nucl Med [Internet]. 2011;52:1218–26. Available from: http://jnm.snmjournals.org/cgi/doi/10.2967/jnumed.111.090902.
- 18.Caroli A, Prestia A, Chen K, Ayutyanont N, Landau SM, Madison CM, et al. Summary metrics to assess Alzheimer disease-related hypometabolic pattern with 18F-FDG PET: head-to-head comparison. J Nucl Med [Internet]. 2012;53:592–600. Available from: http://jnm.snmjournals.org/cgi/doi/10.2967/jnumed.111.094946.
- 19.Pagani M, De Carli F, Morbelli S, Öberg J, Chincarini A, Frisoni GB, et al. Volume of interest-based [18F]fluorodeoxyglucose PET discriminates MCI converting to Alzheimer’s disease from healthy controls. A European Alzheimer’s disease consortium (EADC) study. NeuroImage Clin [Internet]. Elsevier B.V. 2015;7:34–42. Available from: https://doi.org/10.1016/j.nicl.2014.11.007.
- 20.Pagani M, Giuliani A, Öberg J, De Carli F, Morbelli S, Girtler N, et al. Progressive disintegration of brain networking from Normal aging to Alzheimer disease: analysis of independent components of 18 F-FDG PET data. J Nucl Med [Internet]. 2017;58:1132–9. Available from: http://jnm.snmjournals.org/lookup/doi/10.2967/jnumed.116.184309.
- 22.Albert MS, DeKosky ST, Dickson D, Dubois B, Feldman HH, Fox NC, et al. The diagnosis of mild cognitive impairment due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimer’s Dement [Internet]. Elsevier Ltd. 2011;7:270–9. Available from: https://doi.org/10.1016/j.jalz.2011.03.008.
- 23.McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack CR, Kawas CH, et al. The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimer’s Dement [Internet]. Elsevier Ltd. 2011;7:263–9. Available from: https://doi.org/10.1016/j.jalz.2011.03.005.
- 28.Morbelli S, Brugnolo A, Bossert I, Buschiazzo A, Frisoni GB, Galluzzi S, et al. Visual versus semi-quantitative analysis of18F-FDG-PET in amnestic MCI: an European Alzheimer’s disease consortium (EADC) project. J Alzheimer’s Dis [Internet]. 2015;44:815–26. Available from: http://europepmc.org/abstract/med/25362041.
- 29.Zahn R, Juengling F, Bubrowski P, Jost E, Dykierek P, Talazko J, et al. Hemispheric asymmetries of hypometabolism associated with semantic memory impairment in Alzheimer’s disease: a study using positron emission tomography with fluorodeoxyglucose-F18. Psychiatry Res Neuroimaging. 2004;132:159–72.CrossRefGoogle Scholar
- 30.Brown LD, Cai TT, Dasgupta A. Interval estimation for a binomial. Stat Sci. 2001;16:101–33.Google Scholar
- 31.Simel DL, Samsa GP, Matchar DB. Likelihood ratios with confidence: sample size estimation for diagnostic test studies. J Clin Epidemiol [Internet]. 1991;44:763–70. Available from: http://www.sciencedirect.com/science/article/pii/089543569190128V.
- 34.Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology [Internet]. Radiological Society of North America. 1982;143:29–36. Available from: https://doi.org/10.1148/radiology.143.1.7063747.
- 35.Landau SM, Mintun MA, Joshi AD, Koeppe RA, Petersen RC, Aisen PS, et al. Amyloid deposition, hypometabolism, and longitudinal cognitive decline. Ann Neurol [Internet]. 2012;72:578–86. Available from: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3786871/.
- 36.Cabral C, Morgado PM, Campos Costa D, Silveira M. Predicting conversion from MCI to AD with FDG-PET brain images at different prodromal stages. Comput Biol Med [Internet]. Elsevier. 2015;58:101–9. Available from: https://doi.org/10.1016/j.compbiomed.2015.01.003.
- 37.Pagani M, Giuliani A, Öberg J, Chincarini A, Morbelli S, Brugnolo A, et al. Predicting the transition from normal aging to Alzheimer’s disease: a statistical mechanistic evaluation of FDG-PET data. Neuroimage [Internet]. Elsevier Inc. 2016;141:282–90. Available from: https://doi.org/10.1016/j.neuroimage.2016.07.043.
- 39.Kryscio RJ, Abner EL, Cooper GE, Fardo DW, Jicha GA, Nelson PT, et al. Self-reported memory complaints: implications from a longitudinal cohort with autopsies. Neurology. 2014;83(15):1359-65.Google Scholar
- 40.Rasmussen JM, Lakatos A, van Erp TGM, Kruggel F, Keator DB, Fallon JT, et al. Empirical derivation of the reference region for computing diagnostic sensitive18fluorodeoxyglucose ratios in Alzheimer’s disease based on the ADNI sample. Biochim Biophys Acta - Mol Basis Dis [Internet]. Elsevier B.V. 2012;1822:457–66. Available from: https://doi.org/10.1016/j.bbadis.2011.09.008.
- 42.Catafau AM, Bullich S, Seibyl JP, Barthel H, Ghetti B, Leverenz J, et al. Cerebellar amyloid- plaques: how frequent are they, and do they influence 18F-Florbetaben SUV ratios? J Nucl Med [Internet]. 2016;57:1740–5 Available from: http://jnm.snmjournals.org/cgi/doi/10.2967/jnumed.115.171652.CrossRefGoogle Scholar
- 43.Ishii K, Sasaki M, Kitagaki H, Yamaji S, Sakamoto S, Matsuda K, et al. Reduction of cerebellar glucose metabolism in advanced Alzheimer’s disease. J Nucl Med [Internet]. 1997;38:925–8 Available from: http://jnm.snmjournals.org/content/38/6/925.full.pdf.Google Scholar
- 44.Bocchetta M, Cardoso MJ, Cash DM, Ourselin S, Warren JD, Rohrer JD. Patterns of regional cerebellar atrophy in genetic frontotemporal dementia. NeuroImage Clin [Internet]. The Authors. 2016;11:287–90. Available from: https://doi.org/10.1016/j.nicl.2016.02.008.
- 45.Bauckneht M, Chincarini A, Piva R, Arnaldi D, Girtler N, Massa F, et al. Metabolic correlates of reserve and resilience in MCI due to Alzheimer’s disease (AD) Rik Ossenkoppele. Alzheimer’s Res Ther Alzheimer’s Research & Therapy. 2018;10:1–13.Google Scholar