Abstract
Using neural networks to explore spatial patterns and temporal dynamics of human brain activities has been an important yet challenging problem because it is hard to manually design the most optimal neural networks. There have been several promising deep learning methods that can decompose neuroscientifically meaningful spatial-temporal patterns from 4D fMRI data, e.g., the deep sparse recurrent auto-encoder (DSRAE). However, those previous studies still depend on hand-crafted neural network structures and hyperparameters, which are not optimal in various senses. In this paper, we employ evolutionary algorithms to optimize such DSRAE neural networks by minimizing the expected loss of the generated architectures on data reconstruction via the neural architecture search (NAS) framework, named NAS-DSRAE. The optimized NAS-DSRAE is evaluated by the publicly available human connectome project (HCP) fMRI datasets and our promising results showed that NAS-DSRAE has sufficient generalizability to model the spatial-temporal features and is better than the hand-crafted model. To our best knowledge, the proposed NAS-DSRAE is among the earliest NAS models that can extract connectome-scale meaningful spatial-temporal brain networks from 4D fMRI data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Logothetis, N.K.: What We Can Do and What We Cannot Do with fMRI. Nature 453, 869–878 (2008)
Hu, X., et al.: Latent source mining in fMRI via restricted boltzmann machine. Hum. Brain Mapp. 39, 2368–2380 (2018). https://doi.org/10.1002/hbm.24005
Zhao, Y., et al.: 4D Modeling of fMRI data via Spatio-Temporal Convolutional Neural Networks (ST-CNN). IEEE Trans. Cogn. Dev. Syst. 1–11 (2019). https://doi.org/10.1109/tcds.2019.2916916
Wang, H., et al.: Recognizing brain states using deep sparse recurrent neural network. IEEE Trans. Med. Imaging 38, 1058–1068 (2018). https://doi.org/10.1109/TMI.2018.2877576
Zoph, B., Le, Q.V: Neural architecture search with reinforcement learning. In: International Conference on Learning Representations - ICLR2017, pp. 1–16 (2017)
Elsken, T., Metzen, J.H., Hutter, F.: Neural architecture search: a survey. J. Mach. Learn. Res. 20, 1–21 (2019)
Bäck, T.: Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming. Genetic Algorithms. Oxford University Press Inc., New York (1996)
Zhang, W., et al.: Identify hierarchical structures from task-based fmri data via hybrid spatiotemporal neural architecture search net. In: Shen, D., Liu, T., Peters, Terry M., Staib, Lawrence H., Essert, C., Zhou, S., Yap, P.-T., Khan, A. (eds.) MICCAI 2019. LNCS, vol. 11766, pp. 745–753. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32248-9_83
Li, Q., et al.: Simultaneous spatial-temporal decomposition of connectome-scale brain networks by deep sparse recurrent auto-encoders. In: Chung, A.C.S., Gee, J.C., Yushkevich, P.A., Bao, S. (eds.) IPMI 2019. LNCS, vol. 11492, pp. 579–591. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-20351-1_45
Barch, D.M., et al.: Function in the human connectome: Task-fMRI and individual differences in behavior. Neuroimage 80, 169–189 (2013). https://doi.org/10.1016/j.neuroimage.2013.05.033
Fernandes Junior, F.E., Yen, G.G.: Particle swarm optimization of deep neural networks architectures for image classification. Swarm Evol. Comput. 49, 62–74 (2019). https://doi.org/10.1016/j.swevo.2019.05.010
Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B. 67, 301–320 (2005). https://doi.org/10.1037/h0100860
Acknowledgment
This work was supported by the General Program of National Natural Science Foundation of China (Grant No. 61876021), and the program of China Scholarships Council (No. 201806040083). We thank the HCP projects for sharing their valuable fMRI datasets.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, Q., Zhang, W., Lv, J., Wu, X., Liu, T. (2020). Neural Architecture Search for Optimization of Spatial-Temporal Brain Network Decomposition. In: Martel, A.L., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. MICCAI 2020. Lecture Notes in Computer Science(), vol 12267. Springer, Cham. https://doi.org/10.1007/978-3-030-59728-3_37
Download citation
DOI: https://doi.org/10.1007/978-3-030-59728-3_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59727-6
Online ISBN: 978-3-030-59728-3
eBook Packages: Computer ScienceComputer Science (R0)
