Skip to main content

End-to-End Dementia Status Prediction from Brain MRI Using Multi-task Weakly-Supervised Attention Network

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11767))

Abstract

Computer-aided prediction of dementia status (e.g., clinical scores of cognitive tests) from brain MRI is of great clinical value, as it can help assess pathological stage and predict disease progression. Existing learning-based approaches typically preselect dementia-sensitive regions from the whole-brain MRI for feature extraction and prediction model construction, which might be sub-optimal due to potential heterogeneities between different steps. Also, based on anatomical prior knowledge (e.g., brain atlas) and time-consuming nonlinear registration, these preselected brain regions are usually the same across all subjects, ignoring their individual specificities in dementia progression. In this paper, we propose a multi-task weakly-supervised attention network (MWAN) to jointly predict multiple clinical scores from the baseline MRI data, by explicitly considering individual specificities of different subjects. Leveraging a fully-trainable dementia attention block, our MWAN method can automatically identify subject-specific discriminative locations from the whole-brain MRI for end-to-end feature learning and multi-task regression. We evaluated our MWAN method by cross-validation on two public datasets (i.e., ADNI-1 and ADNI-2). Experimental results demonstrate that the proposed method performs well in both the tasks of clinical score prediction and weakly-supervised discriminative localization in brain MR images.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://adni.loni.usc.edu.

References

  1. Baron, J., et al.: In vivo mapping of gray matter loss with voxel-based morphometry in mild Alzheimer’s disease. NeuroImage 14(2), 298–309 (2001)

    Article  Google Scholar 

  2. Frisoni, G.B., et al.: The clinical use of structural MRI in Alzheimer disease. Nat. Rev. Neurol. 6(2), 67 (2010)

    Article  Google Scholar 

  3. Jagust, W.: Vulnerable neural systems and the borderland of brain aging and neurodegeneration. Neuron 77(2), 219–234 (2013)

    Article  Google Scholar 

  4. Lian, C., et al.: Hierarchical fully convolutional network for joint atrophy localization and Alzheimer’s disease diagnosis using structural MRI. IEEE Trans. Pattern Anal. Mach. Intell. (2019, in press). https://doi.org/10.1109/TPAMI.2018.2889096

  5. Liu, M., et al.: Joint classification and regression via deep multi-taskmulti-channel learning for Alzheimer’s disease diagnosis. IEEE Trans. Biomed. Eng. 66, 1195–1206 (2018)

    Article  Google Scholar 

  6. Liu, M., et al.: Weakly supervised deep learning for brain disease prognosis using MRI and incomplete clinical scores. IEEE Trans. Cybern. (2019, in press). https://doi.org/10.1109/TCYB.2019.2904186

  7. O’Bryant, S.E., et al.: Staging dementia using clinical dementia rating scale sum of boxes scores: a Texas Alzheimer’s research consortium study. Arch. Neurol. 65(8), 1091–1095 (2008)

    Article  Google Scholar 

  8. Rathore, S., et al.: A review on neuroimaging-based classification studies and associated feature extraction methods for Alzheimer’s disease and its prodromal stages. NeuroImage 155, 530–548 (2017)

    Article  Google Scholar 

  9. Sabuncu, M.R., et al.: Clinical prediction from structural brain MRI scans: a large-scale empirical study. Neuroinformatics 13(1), 31–46 (2015)

    Article  Google Scholar 

  10. Yang, J., et al.: Weakly supervised coupled networks for visual sentiment analysis. In: CVPR, pp. 7584–7592 (2018)

    Google Scholar 

  11. Zhang, J., et al.: Detecting anatomical landmarks for fast Alzheimer’s disease diagnosis. IEEE Trans. Med. Imaging 35(12), 2524–2533 (2016)

    Article  Google Scholar 

  12. Zhou, B., et al.: Learning deep features for discriminative localization. In: CVPR, pp. 2921–2929. IEEE (2016)

    Google Scholar 

  13. Zhou, J., et al.: Modeling disease progression via multi-task learning. NeuroImage 78, 233–248 (2013)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by NIH grants (EB008374, AG041721, AG042599, and EB022880).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Mingxia Liu or Dinggang Shen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lian, C., Liu, M., Wang, L., Shen, D. (2019). End-to-End Dementia Status Prediction from Brain MRI Using Multi-task Weakly-Supervised Attention Network. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11767. Springer, Cham. https://doi.org/10.1007/978-3-030-32251-9_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32251-9_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32250-2

  • Online ISBN: 978-3-030-32251-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics