Advertisement

Image Augmentation Using a Task Guided Generative Adversarial Network for Age Estimation on Brain MRI

Conference paper
  • 156 Downloads
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12722)

Abstract

Brain age estimation based on magnetic resonance imaging (MRI) is an active research area in early diagnosis of some neurodegenerative diseases (e.g. Alzheimer, Parkinson, Huntington, etc.) for elderly people or brain underdevelopment for the young group. Deep learning methods have achieved the state-of-the-art performance in many medical image analysis tasks, including brain age estimation. However, the performance and generalisability of the deep learning model are highly dependent on the quantity and quality of the training data set. Both collecting and annotating brain MRI data are extremely time-consuming. In this paper, to overcome the data scarcity problem, we propose a generative adversarial network (GAN) based image synthesis method. Different from the existing GAN-based methods, we integrate a task-guided branch (a regression model for age estimation) to the end of the generator in GAN. By adding a task-guided loss to the conventional GAN loss, the learned low-dimensional latent space and the synthesised images are more task-specific. It helps to boost the performance of the down-stream task by combining the synthesised images and real images for model training. The proposed method was evaluated on a public brain MRI data set for age estimation. Our proposed method outperformed (statistically significant) a deep convolutional neural network based regression model and the GAN-based image synthesis method without the task-guided branch. More importantly, it enables the identification of age-related brain regions in the image space. The code is available on GitHub (https://github.com/ruizhe-l/tgb-gan).

Keywords

Generative adversarial network Brain age regression Data augmentation 

References

  1. 1.
    Shin, H.-C., et al.: Medical image synthesis for data augmentation and anonymization using generative adversarial networks. In: Gooya, A., Goksel, O., Oguz, I., Burgos, N. (eds.) SASHIMI 2018. LNCS, vol. 11037, pp. 1–11. Springer, Cham (2018).  https://doi.org/10.1007/978-3-030-00536-8_1CrossRefGoogle Scholar
  2. 2.
    Frid-Adar, M., Diamant, I., Klang, E., Amitai, M., Goldberger, J., Greenspan, H.: GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification. Neurocomputing (2018).  https://doi.org/10.1016/j.neucom.2018.09.013CrossRefGoogle Scholar
  3. 3.
    Pesteie, M., Abolmaesumi, P., Rohling, R.N.: Adaptive augmentation of medical data using independently conditional variational auto-encoders. IEEE Trans. Med. Imaging. (2019).  https://doi.org/10.1109/TMI.2019.2914656CrossRefGoogle Scholar
  4. 4.
    Goodfellow, I., et al.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)Google Scholar
  5. 5.
    Kingma, D.P., Welling, M.: Auto-encoding variational bayes. In: 2nd International Conference on Learning Representations, ICLR 2014 - Conference Track Proceedings (2014)Google Scholar
  6. 6.
    Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017 (2017).  https://doi.org/10.1109/CVPR.2017.632.
  7. 7.
    Mirza, M., Osindero, S.: Conditional generative adversarial nets. arXiv Prepr. arXiv:1411.1784 (2014)
  8. 8.
    Antipov, G., Baccouche, M., Dugelay, J.-L.: Face aging with conditional generative adversarial networks. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 2089–2093 (2017)Google Scholar
  9. 9.
    Wang, Z., Tang, X., Luo, W., Gao, S.: Face aging with identity-preserved conditional generative adversarial networks. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2018).  https://doi.org/10.1109/CVPR.2018.00828
  10. 10.
    Xia, T., Chartsias, A., Tsaftaris, S.A., Initiative, A.D.N., et al.: Consistent brain ageing synthesis. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 750–758 (2019)Google Scholar
  11. 11.
    Liu, X., et al.: Data augmentation via latent space interpolation for image classification. In: 2018 24th International Conference on Pattern Recognition (ICPR), pp. 728–733 (2018)Google Scholar
  12. 12.
    DeVries, T., Taylor, G.W.: Dataset augmentation in feature space. In: 5th International Conference on Learning Representations, ICLR 2017 - Workshop Track Proceedings (2019)Google Scholar
  13. 13.
    Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., Courville, A.: Improved training of wasserstein GANs. In: Advances in Neural Information Processing Systems (2017)Google Scholar
  14. 14.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv Prepr. arXiv:1409.1556 (2014)
  15. 15.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)Google Scholar
  16. 16.
    Di Martino, A., et al.: The autism brain imaging data exchange: towards a large-scale evaluation of the intrinsic brain architecture in autism. Mol. Psychiatry. 19, 659–667 (2014)CrossRefGoogle Scholar
  17. 17.
    Di Martino, A., et al.: Enhancing studies of the connectome in autism using the autism brain imaging data exchange II. Sci. Data 4, 1–15 (2017)Google Scholar
  18. 18.
    Alfaro-Almagro, F., et al.: Image processing and Quality Control for the first 10,000 brain imaging datasets from UK Biobank. Neuroimage 166, 400–424 (2018)CrossRefGoogle Scholar
  19. 19.
    Jenkinson, M., Bannister, P., Brady, M., Smith, S.: Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 17, 825–841 (2002)CrossRefGoogle Scholar
  20. 20.
    Andersson, J.L., Jenkinson, M., Smith, S.: Non-linear optimisation. FMRIB Analysis Group Technical Reports. TR07JA1 (2007)Google Scholar
  21. 21.
    Jenkinson, M., Beckmann, C.F., Behrens, T.E.J., Woolrich, M.W., Smith, S.M.: Fsl. Neuroimage. 62, 782–790 (2012)CrossRefGoogle Scholar
  22. 22.
    Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv Prepr. arXiv:1412.6980 (2014)
  23. 23.
    Sajedi, H., Pardakhti, N.: Age prediction based on brain MRI image: a survey. J. Med. Syst. 43, 279 (2019)CrossRefGoogle Scholar
  24. 24.
    He, S., et al.: Brain Age Estimation Using LSTM on Children’s Brain MRI. In: 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI), pp. 1–4 (2020)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2021

Authors and Affiliations

  1. 1.IMA/LUCID Group, School of Computer ScienceUniversity of NottinghamNottinghamUK
  2. 2.School of MedicineUniversity of NottinghamNottinghamUK

Personalised recommendations