Abstract
If the development of machine learning and artificial intelligence plays a role in many fields of research and technology today, it has a special relationship with neurosciences. Indeed, historically inspired by our knowledge of the brain, deep learning shares some vocabularies with neurosciences and can sometimes be considered a brain’s model. Taking the particular example of seizure, which can develop in any biological neural tissue, we question if and how the models used for deep learning can capture or model these pathological events. This particular example is a starting point to discuss the nature, limits, and functions of these models, and we discuss what we expect from a model of the brain. Finally, we argue that a pluralistic approach leading to the integrated coexistence of different models is necessary to study the brain in all its complexity.
Similar content being viewed by others
Data Availability
The manuscript has no associated data.
References
Saxe A, Nelli S, Summerfield C. If deep learning is the answer, what is the question? Nat Rev Neurosci. 2020;22(1):55–67. Available from: https://doi.org/10.1038/s41583-020-00395-8.
Richards BA, Lillicrap TP, Beaudoin P, Bengio Y, Bogacz R, Christensen A, et al. A deep learning framework for neuroscience. Nat Neurosci. 2019;22(11):1761–70.
Marblestone AH, Wayne G, Kording KP. Toward an integration of deep learning and neuroscience. Front Comput Neurosci. 2016;10:94.
Yan LC, Yoshua B, Geoffrey H. Deep learning. Nature. 2015;521(7553):436–44.
Tang B, Pan Z, Yin K, Khateeb A. Recent advances of deep learning in bioinformatics and computational biology. Front Genet. 2019;10:214.
Schmidhuber J. Deep learning in neural networks: An overview. Neural Netw. 2015;61:85–117.
Reggia JA. The rise of machine consciousness: Studying consciousness with computational models. Neural Netw. 2013;44:112–31. Available from: https://www.sciencedirect.com/science/article/pii/S0893608013000968.
Rahwan I, Cebrian M, Obradovich N, Bongard J, Bonnefon JF, Breazeal C, et al. Machine behaviour. Nature. 2019 04;568(7753):477–86.
Jirsa VK, Stacey WC, Quilichini PP, Ivanov AI, Bernard C. On the nature of seizure dynamics. Brain J Neurol. 2014;8:137(Pt 8):2210–30. Available from: http://www.ncbi.nlm.nih.gov/pubmed/24919973. http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=PMC4107736.
Depannemaecker D, Destexhe A, Jirsa V, Bernard C. Modeling seizures: from single neurons to networks. Seizure. 2021. Available from: https://doi.org/10.1016/j.seizure.2021.06.015.
McCulloch WS, Pitts W. A logical calculus of the ideas immanent in nervous activity. The bulletin of mathematical biophysics. 1943;5(4):115–33.
Rumelhart DE, Hinton GE, Williams RJ. Learning representations by back-propagating errors. Nature. 1986;323(6088):533–6. Available from: https://doi.org/10.1038/323533a0.
Miikkulainen R, Liang J, Meyerson E, Rawal A, Fink D, Francon O, et al. Evolving deep neural networks. In: Artificial intelligence in the age of neural networks and brain computing. Elsevier; 2019. p. 293–312.
Nøkland A. Direct Feedback Alignment Provides Learning in Deep Neural Networks. arXiv. 2016.
Goodfellow I, Bengio Y, Courville A. Deep learning. MIT press; 2016. http://www.deeplearningbook.org.
Thangavel P, Thomas J, Peh WY, Jing J, Yuvaraj R, Cash SS, et al. Time-frequency decomposition of scalp electroencephalograms improves deep learning-based epilepsy diagnosis. Int J Neural Syst. 2021;31(08):2150032.
Ullah I, Hussain M, Aboalsamh H, et al. An automated system for epilepsy detection using EEG brain signals based on deep learning approach. Expert Syst Appl. 2018;107:61–71.
Sun M, Wang F, Min T, Zang T, Wang Y. Prediction for high risk clinical symptoms of epilepsy based on deep learning algorithm. IEEE Access. 2018;6:77596–605.
Pumain R, Menini C, Heinemann U, Louvel J, Silva-Barrat C. Chemical synaptic transmission is not necessary for epileptic seizures to persist in the baboon Papio papio. Exp Neurol. 1985;89(1):250–8. Available from: https://doi.org/10.1016/0014-4886(85)90280-8.
deAlmeida ACG, Rodrigues AM, Scorza FA, Cavalheiro EA, Teixeira HZ, Duarte MA, et al. Mechanistic hypotheses for nonsynaptic epileptiform activity induction and its transition from the interictal to ictal state-Computational simulation. Epilepsia. 2008 Nov;49(11):1908–24. Available from: https://doi.org/10.1111/j.1528-1167.2008.01686.x.
Depannemaecker D, Santos LEC, Rodrigues AM, Scorza CA, Scorza FA, deAlmeida ACG. Realistic spiking neural network: Non-synaptic mechanisms improve convergence in cell assembly. Neural Netw. 2020;122:420–33. Available from: https://doi.org/10.1016/j.neunet.2019.09.038.
Depannemaecker D, Ivanov A, Lillo D, Spek L, Bernard C, Jirsa V. A unified physiological framework of transitions between seizures, sustained ictal activity and depolarization block at the single neuron level. J Comput Neurosci. 2022;50(1):33–49. Available from: https://doi.org/10.1007/s10827-022-00811-1.
Tavanaei A, Ghodrati M, Kheradpisheh SR, Masquelier T, Maida A. Deep learning in spiking neural networks. Neural Netw. 2019;111:47–63. Available from: https://doi.org/10.1016/j.neunet.2018.12.002.
Nicola W, Clopath C. Supervised learning in spiking neural networks with FORCE training. Nat Commun. 2017;8(1). Available from: https://doi.org/10.1038/s41467-017-01827-3.
Kolb B, Whishaw IQ. Brain plasticity and behavior. Annu Rev Psychol. 1998;49(1):43–64. PMID: 9496621. Available from: https://doi.org/10.1146/annurev.psych.49.1.43.
Sapolsky R. Behave : the biology of humans at our best and worst. New York, New York: Penguin Press; 2017.
Kandel ER, Schwartz JH, Jessell TM, editors. Principles of neural science. 3rd ed. Elsevier; 1991.
Marr D. Vision. MIT Press: The MIT Press; 1982.
Vaughan J, Sudjianto A, Brahimi E, Chen J, Nair VN. Explainable neural networks based on additive index models; 2018.
Yang Z, Zhang A, Sudjianto A. Enhancing explainability of neural networks through architecture constraints. IEEE Trans Neural Netw Learn Syst. 2021;32(6):2610–21. Available from: https://doi.org/10.1109/tnnls.2020.3007259.
Wan A, Dunlap L, Ho D, Yin J, Lee S, Jin H, et al. NBDT: Neural-Backed Decision Trees; 2021.
Ruphy S. Scientific pluralism reconsidered: A new approach to the (dis)unity of science; 2016.
Varenne F. From models to simulations. Abingdon, Oxon New York, NY: Routledge; 2019.
Shrestha A, Mahmood A. Review of Deep Learning Algorithms and Architectures. IEEE Access. 2019;7:53040–65.
Rawat W, Wang Z. Deep convolutional neural networks for image classification: A comprehensive review. Neural Comput. 2017;29(9):2352–449.
Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, et al. Generative adversarial networks; 2014.
Lillicrap TP, Santoro A, Marris L, Akerman CJ, Hinton G. Backpropagation and the brain. Nat Rev Neurosci. 2020;21(6):335–46.
Whittington JC, Bogacz R. Theories of error back-propagation in the brain. Trends Cogn Sci. 2019;23(3):235–50.
Gauld C, Brun C, Boraud T, Carlu M, Depannemaecker D. Computational models in neurosciences between mechanistic and phenomenological characterizations; 2022. Available from: https://doi.org/10.20944/preprints202201.0206.v1.
Miłkowski M. Computation and Multiple Realizability. In: Fundamental Issues of Artificial Intelligence. Springer International Publishing; 2016. p. 29–41. Available from: https://doi.org/10.1007/978-3-319-26485-1_3.
Bickle J. Multiple Realizability. In: Zalta EN, editor. The Stanford Encyclopedia of Philosophy. Summer 2020 ed. Metaphysics Research Lab, Stanford University; 2020.
Levin M, Pezzulo G, Finkelstein JM. Endogenous bioelectric signaling networks: exploiting voltage gradients for control of growth and form. Annu Rev Biomed Eng. 2017;19:353–87.
Pezzulo G, Levin M. Re-membering the body: applications of computational neuroscience to the top-down control of regeneration of limbs and other complex organs. Integr Biol. 2015;7(12):1487–517.
Pezzulo G, Levin M. Top-down models in biology: explanation and control of complex living systems above the molecular level. J R Soc Interface. 2016;13(124):20160555.
Floridi L, Chiriatti M. GPT-3: Its nature, scope, limits, and consequences. Mind Mach. 2020;30(4):681–94.
Anderson JR, Matessa M, Lebiere C. ACT-R: A theory of higher level cognition and its relation to visual attention. Hum Comput Interact. 1997;12(4):439–62.
Gu J, Wang Z, Kuen J, Ma L, Shahroudy A, Shuai B, et al. Recent advances in convolutional neural networks. Pattern Recogn. 2018;77:354–77.
Hodgkin AL, Huxley AF. A quantitative description of membrane current and its application to conduction and excitation in nerve. J Physiol. 1952;117(4):500–44. Available from: https://doi.org/10.1113/jphysiol.1952.sp004764.
Izhikevich EM. Simple model of spiking neurons. IEEE Trans Neural Netw. 2003;14(6):1569–72.
Goldman JS, Kusch L, Yalcinkaya BH, Depannemaecker D, Nghiem TAE, Jirsa V, et al. Brain-scale emergence of slow-wave synchrony and highly responsive asynchronous states based on biologically realistic population models simulated in The Virtual Brain. bioRxiv. 2020. Available from: https://www.biorxiv.org/content/early/2020/12/29/2020.12.28.424574.
Friston K. The free-energy principle: a unified brain theory? Nat Rev Neurosci. 2010;11(2):127–38.
Ullman S. Using neuroscience to develop artificial intelligence. Science. 2019;363(6428):692–3.
Cuthbert BN. The RDoC framework: facilitating transition from ICD/DSM to dimensional approaches that integrate neuroscience and psychopathology. World Psychiatry. 2014;13(1):28–35.
Mayr E. Cause and effect in biology. Science. 1961;134(3489):1501–6. Available from: https://doi.org/10.1126/science.134.3489.1501.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
This article does not contain any studies with human participants or animals performed by any of the authors. No funds, grants, or other support were received. The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Depannemaecker, D., Pio-Lopez, L. & Gauld, C. Does Deep Learning Have Epileptic Seizures? On the Modeling of the Brain. Cogn Comput (2023). https://doi.org/10.1007/s12559-023-10113-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s12559-023-10113-y