Reconstructing gene regulatory networks (GRNs) from gene expression data is an important and challenging problem in system biology. In general, the problem of reconstructing GRNs can be modeled as an optimization problem. Recurrent neural network (RNN) has been widely used for GRNs. However, in a real GRN, the number of genes is very large and the relationships between genes are usually very sparse. In this paper, we design a memetic algorithm to learn partial parameters of RNN, and develop a framework based on the least absolute shrinkage and selection operator (LASSO) to reconstruct GRNs based on RNN, which is termed as MALASSORNN-GRN. In the LASSO, the task of reconstructing GRNs is decomposed into a sparse signal reconstructing problem. In the experiments, MALASSORNN-GRN is applied on synthetic data and well-known benchmark datasets DREAM3 and DREAM4. The effect of parameters on MALASSORNN-GRN is discussed, and MALASSORNN-GRN is compared with three other algorithms which are all state-of-the-art RNN learning algorithms. The results show that MALASSORNN-GRN performs best and is capable of reconstructing large-scale GRNs.
This is a preview of subscription content, log in to check access.
Buy single article
Instant unlimited access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Acampora G, Pedrycz W, Vitiello A (2015) A competent memetic algorithm for learning fuzzy cognitive maps. IEEE Trans Fuzzy Syst 23(6):2397–2411
Alex G, Aviv M, Harry O, Richard B (2010) DREAM4: combining genetic and dynamic information to identify biological networks and dynamical models. PLoS ONE 5(10):e13397
Alhindi A, Alhindi A, Alhejali A, Alsheddy A, Tairan N, Alhakami H (2018) MOEA/D-GLS: a multiobjective memetic algorithm using decomposition and guided local search. Soft Comput. https://doi.org/10.1007/s00500-018-3524-z
Aliev RA, Fazlollahi B, Aliev RR, Guirimov B (2008) Linguistic time series forecasting using fuzzy recurrent neural network. Soft Comput 12(2):183–190
Ao SI, Ng MK (2006) Gene expression time series modeling with principal component and neural network. Soft Comput 10(4):351–358
Chen J, Chaudhari NS (2006) Bidirectional segmented-memory recurrent neural network for protein secondary structure prediction. Soft Comput 10(4):315–324
Chen XS, Ong YS, Lim MH (2010) Research frontier: memetic computation—past, present & future. IEEE Comput Intell Mag 5(2):24–31
Chowdhury AR, Chetty M (2015) Network decomposition based large-scale reverse engineering of gene regulatory network. Neurocomputing 160(3):213–227
Daniel M, Thomas S, Claudio M, Dario F (2009) Generating realistic in silico gene networks for performance assessment of reverse engineering methods. J Comput Biol 16(2):229
D’Haeseleer P (2000) Reconstructing gene networks from large scale gene expression data. University of New Mexico, Albuquerque
Eriksson R, Olsson B (2004) Adapting genetic regulatory models by genetic programming. BioSyst 76(1):217–227
Faith JJ et al (2007) Large-scale mapping and validation of Escherichia coli transcriptional regulation from a compendium of expression profiles. PLoS Biol 5(1):e8
Fernando C, Sojakka S (2003) Pattern recognition in a bucket. Lect Notes Comput Sci 2801:588–597
Friedman N, Linial M, Nachman I, Pe’Er D (2000) Using Bayesian networks to analyze expression data. JCoB 7(3–4):601–620
Gerrard CE, Mccall J, Coghill GM, Macleod C (2014) Exploring aspects of cell intelligence with artificial reaction networks. Soft Comput 18(10):1899–1912
Hnxzswf H (2014) Oracle inequalities for lasso and Dantzig selector in high-dimensional linear regression. J Adv Math 9(7):2857–2868
Huang J, Ma S, Zhang CH (2008) Adaptive lasso for sparse high-dimensional regression. Stat Sin 18(4):1603–1618
Huynh-Thu VA, Sanguinetti G (2018) Gene regulatory network inference: an introductory survey. Springer Nature, Berlin
Khan A, Mandal S, Pal RK, Saha G (2016) Construction of gene regulatory networks using recurrent neural networks and swarm intelligence. Scientifica 3:1–14
Kolen JF (2001) A field guide to dynamical recurrent networks. Wiley, New York
Kwon YK, Cho KH (2007) Analysis of feedback loops and robustness in network evolution based on boolean models. BMC Bioinform 8(1):430
Liao CC, Ting CK (2018) A novel integer-coded memetic algorithm for the set k-cover problem in wireless sensor networks. IEEE Trans Cybernet 48(8):1–14
Liu J, Chi Y, Zhu C, Jin Y (2017) A time series driven decomposed evolutionary optimization approach for reconstructing large-scale gene regulatory networks based on fuzzy cognitive maps. BMC Bioinform 18(1):241
Mandal S (2016) A survey on recurrent neural network based modelling of gene regulatory network. MOJ Proteomics Bioinform 4(3):244–254
Mandal S, Khan A, Saha G (2016) Pal RK (2016) Large-scale recurrent neural network based modelling of gene regulatory network using cuckoo search-flower pollination algorithm. Adv Bioinform 9:1–9
Marbach D et al (2012) Wisdom of crowds for robust gene network inference. Nat Methods 9(8):796–804
Margolin AA, Nemenman I, Basso K, Wiggins C, Stolovitzky G, Favera RD, Califano A (2006) Aracne: an algorithm for the reconstruction of gene regulatory networks in a mammalian cellular context. BMC Bioinform 7(1):s7
Michalewicz Z (1996) Genetic algorithms + data structures = evolution programs. Comput Stat Data Anal 24(3):372–373
Mjolsness E, Mann T, Castaño R, Wold BJ (2000) From coexpression to coregulation: an approach to inferring transcriptional regulation among gene classes from large-scale expression data. Adv Neural Inf Process Syst 12(1):928–934
Molina D, Lozano M, Herrera F (2011) Memetic algorithms based on local search chains for large scale continuous optimisation problems: Ma-ssw-chains. Soft Comput 15(11):2201–2220
Mondal BS, Sarkar AK, Hasan MM, Noman N (2010) Reconstruction of gene regulatory networks using differential evolution. In: International conference on computer & information technology, pp 440–445
Noman N, Palafox L, Iba H (2013) Reconstruction of gene regulatory networks from gene expression data using decoupled recurrent neural network model. Springer, Tokyo
Ozsoy MG, Polat F, Alhajj R (2015) Inference of gene regulatory networks via multiple data sources and a recommendation method. In: IEEE international conference on bioinformatics & biomedicine, pp 661–664
Rakshit P, Das P, Konar A, Nasipuri M, Janarthanan R (2012) A recurrent fuzzy neural model of a gene regulatory network for knowledge extraction using invasive weed and artificial bee colony optimization algorithm. In: 2012 1st international conference on recent advances in information technology (RAIT), IEEE, pp 385–391
Ramteke M, Ghune N, Trivedi V (2015) Simulated binary jumping gene: a step towards enhancing the performance of real-coded genetic algorithm. Inf Sci 325:429–454
Re M (2011) Comparing early and late data fusion methods for gene expression prediction. Soft Comput 15(8):1497–1504
Reinhart RF, Steil JJ (2008) Recurrent neural associative learning of forward and inverse kinematics for movement generation of the redundant pa-10 robot. In: Ecsis symposium on learning & adaptive behaviors for robotic systems. IEEE, pp 35-40
Ristevski B (2013) A survey of models for inference of gene regulatory networks. Nonlinear Anal Model Control 18(4):444–465
Sakamoto E, Iba H (2001) Inferring a system of differential equations for a gene regulatory network by using genetic programming. In: Proceedings of the 2001 congress on evolutionary computation, vol 1. IEEE, pp 720–726
Someren EPV, Wessels LFA (2001) Genetic network models: a comparative study. Proc Spie 13(December):6
Stolovitzky G, Monroe D, Califano A (2007) Dialogue on reverse-engineering assessment and methods: the dream of high-throughput pathway inference. Ann N Y Acad Sci 1115(1):1–22
Taylor GW, Hinton GE, Roweis S (2006) Modeling human motion using binary latent variables. In: International conference on neural information processing systems, pp 1345–1352
Tibshirani R (1996) Regression shrinkage and selection via the lasso. J R Stat Soc 58(1):267–288
Van SEP, Wessels LF, Reinders MJ (2000) Linear modeling of genetic networks from experimental data. In: Eighth international conference on intelligent systems for molecular biology, pp 355–366
Verstraeten D, Schrauwen B, Stroobandt D (2006) Reservoir-based techniques for speech recognition. In: International joint conference on neural networks, pp 1050–1053
Vohradsky J (2001) Neural network model of gene expression. FASEB J 15(3):846–854
Wahde M, Hertz J (2000) Coarse-grained reverse engineering of genetic regulatory networks. BioSyst 55(1):129–136
Weaver DC, Workman CT, Stormo GD (1999) Modeling regulatory networks with weight matrices. Pac Symp Biocomput 4:112–123
Werbos PJ (1990) Backpropagation through time: what it does and how to do it. Proc IEEE 78(10):1550–1560
Xu R, Venayagamoorthy GK, Ii DCW (2007a) Modeling of gene regulatory networks with hybrid differential evolution and particle swarm optimization. Neural Net 20(8):917–927
Xu R, Wunsch ID, Frank R (2007b) Inference of genetic regulatory networks with recurrent neural network models using particle swarm optimization. IEEE/ACM Trans Comput Biol Bioinform 4(4):681–692
Ye C, Mazlack LJ, Lu LJ (2012) Inferring fuzzy cognitive map models for gene regulatory networks from gene expression data. In: IEEE international conference on bioinformatics & biomedicine, Philadelphia, PA, USA, pp 1–4
This work was supported in part by the General Program of National Natural Science Foundation of China (NSFC) under Grant 61773300 and in part by the Key Program of Fundamental Research Project of Natural Science of Shaanxi Province, China, under Grant 2017JZ017.
Conflict of interest
The authors declare that they have no conflict of interest.
This article does not contain any studies with human participants performed by any of the authors.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Communicated by V. Loia.
About this article
Cite this article
Liu, L., Liu, J. Reconstructing gene regulatory networks via memetic algorithm and LASSO based on recurrent neural networks. Soft Comput (2019). https://doi.org/10.1007/s00500-019-04185-y
- Gene regulatory networks
- Memetic algorithm
- Recurrent neural network