Time Course Gene Expression Classification with Time Lagged Recurrent Neural Network

Part of the Studies in Computational Intelligence book series (SCI, volume 94)


Heterogeneous types of gene expressions may provide a better insight into the biological role of gene interaction with the environment, disease development and drug effect at the molecular level. In this chapter for both exploring and prediction purposes a Time Lagged Recurrent Neural Network with trajectory learning is proposed for identifying and classifying the gene functional patterns from the heterogeneous nonlinear time series microarray experiments. The proposed procedures identify gene functional patterns from the dynamics of a state-trajectory learned in the heterogeneous time series and the gradient information over time. Also, the trajectory learning with Back-propagation through time algorithm can recognize gene expression patterns vary over time. This may reveal much more information about the regulatory network underlying gene expressions. The analyzed data were extracted from spotted DNA microarrays in the budding yeast expression measurements, produced by Eisen et al. The gene matrix contained 79 experiments over a variety of heterogeneous experiment conditions. The number of recognized gene patterns in our study ranged from two to ten and were divided into three cases. Optimal network architectures with different memory structures were selected based on Akaike and Bayesian information criteria using two-way factorial design. The optimal model performance was compared to other popular gene classification algorithms, such as Nearest Neighbor, Support Vector Machine, and Self-Organized Map. The reliability of the performance was verified with multiple iterated runs.


Support Vector Machine Gene Expression Data Hide Node Recurrent Neural Network Nonlinear Time Series 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Gasch AP, Spellman PT, Kao CM, Carmel-Harel O, Eisen MB, Storz G, Botstein D, and Brown PO (2000) Genomic Expression Programs in the Response of Yeast Cells to Environmental Changes. Mol. Biol. Cell 11: 4241–4257.Google Scholar
  2. 2.
    Holter N, Maritan A, Cieplak M, Fedoroff N, and Banavar J (2001) Dynamic modeling of gene expression data. PNAS, USA 98: 1693–1698.CrossRefGoogle Scholar
  3. 3.
    Ramoni M, Sebastiani P, and Kohane I (2002) Cluster analysis of gene expression dynamics. PNAS, 99, 9121– 9126.CrossRefMathSciNetGoogle Scholar
  4. 4.
    Yeung KY and Ruzzo WL (2001) Principal component analysis for clustering gene expression data. Bioinformatics, 17, 763–774.CrossRefGoogle Scholar
  5. 5.
    Yeung KY, Medvedovic M, and Bumgarner RE (2003) Clustering gene-expression data with repeated measurements. Genome Biology, 4, R34.1–R34.17.Google Scholar
  6. 6.
    Hastiel T, Tibshirani R, Eisen MB, Alizadeh A, Levy R, Staudt L, Chan WC, Botstein D, and Brown PO (2000) Gene shaving as a method for identifying distinct sets of genes with similar expression patterns. Genome Biology 1(2): research0003.1–0003.21.Google Scholar
  7. 7.
    Romualdi C, Campanaro S, Campagna D, Celegato B, Cannata N, Toppo S, Valle G, Lanfranchi G (2003) Pattern recognition in gene expression profiling using DNA array: a comparative study of different statistical methods applied to cancer classification. Human Molecular Genetics, Vol. 12, No. 8 pp. 823–836.CrossRefGoogle Scholar
  8. 8.
    Neal SH, Madhusmita M, Holter NS, Mitra M, Maritan A, Cieplak M, Banavar JR, and Fedoroff, VF (2000) Fundamental patterns underlying gene expression profiles: Simplicity from complexicity. PNAS, 97:8409–8414.CrossRefGoogle Scholar
  9. 9.
    Brown MP, Grundy WN, Lin D, Cristianini N, Sugnet CW, Furey TS, Junior MA, and Haussler D (2000) Knowledge-based analysis of microarray gene expression data by using supported vector machines. PNAS. USA vol. 97(1): 262–267.CrossRefGoogle Scholar
  10. 10.
    D’haeseleer P, Liang S, and Somogyi R (1999) Gene expression analysis and genetic networks modeling. Pacific Symposium on Biocomputing.Google Scholar
  11. 11.
    Herrero J, Valencia A, and Dopazo J (2001) A hierarchical unsupervised growing neural network for clustering gene expression patterns. Bioinformatics, 17:126–136.CrossRefGoogle Scholar
  12. 12.
    Raychaudhuri S, Sutphin PD, Stuart JM, and Altman RB (2000) CLEAVER: A publicly available web site for supervised analysis of microarray data.Google Scholar
  13. 13.
    Bishop CM (1995) Neural Networks for Pattern Recognition. Oxford University Press.Google Scholar
  14. 14.
    Haykin S (1999) Neural Networks. Prentice Hall Upper Saddle River, New Jersey.Google Scholar
  15. 15.
    Pearlmutter BA (1995) Gradient calculation for dynamic recurrent neural networks. IEEE Transactions on Neural Networks 6(5):1212–1228.CrossRefGoogle Scholar
  16. 16.
    Stornetta WS, Hogg T, and Huberman B (1988) A dynamic approach to temporal pattern processing, 750–759. In: Anderson DZ (Ed.) Neural information processing systems. Springer Verlag.Google Scholar
  17. 17.
    Werbos PJ (1993) Backpropagation Through Time: What it does and how to do it. Proc. of the ICNN, San Francisco, CA.Google Scholar
  18. 18.
    Chu S, DeRisi J, Eisen M, Mulholland J, Botstein D, and Brown PO (1998) The Transcriptional Program of Sporulation in Budding Yeast. Science 282, 699–705.CrossRefGoogle Scholar
  19. 19.
    Eisen MB, Spellman PT, Brown PO, and Botstein D (1998) Cluster analysis and display of genome-wide expression patterns. PNAS, Vol. 95, Issue 25, 14863–14868.CrossRefGoogle Scholar
  20. 20.
    Spellman PT, Sherlock G, Zhang MW, Iyer VR, Anders K, Eisen MB, Brown PO, and Futcher B (1998) Comprehensive identification of cell cycle regulated genes of the yeast Saccharomyces cerevisiae by microarray hybridization. Mol. Biol. Cell 9: 3273–3297.Google Scholar
  21. 21.
    Jansen R and Gerstein M (2000) Analysis of the yeast transcriptome with structural and functional categories: characterizing highly expressed proteins. Nucleic Acids Research, Vol. 28, No. 6 1481–1488.CrossRefGoogle Scholar
  22. 22.
    Miller DA and Zurada JM (1998) A dynamical system perspective of structural learning with forgetting. IEEE Transactions on Neural Networks, 9(3): 508–515.CrossRefGoogle Scholar
  23. 23.
    Akaike H (1974) A new look at the statistical model identification. IEEE Transactions on Automatic Control 19:716–723.CrossRefMathSciNetGoogle Scholar
  24. 24.
    Stone M (1974) Cross-validatory choice and assessment of statistical predictions (with discussion). Journal of the Royal Statistical Society, Series B, 36, 111–147.Google Scholar
  25. 25.
    Li W, Sherriff A, and Liu X (2000) Assessing risk factors of human complex diseases by Akaike and Bayesian information criteria (abstract). Am J Hum Genet 67(Suppl): S222.CrossRefGoogle Scholar
  26. 26.
    Golub TR, Slonim, DK, Tamayo P, Huard C, Gaasenbeek M, Mesirov JP, Coller H, Loh, ML, Downing JR, Caliguiri MA, Bloomfield CD, and Lander ES (1999) Molecular classification of cancer: Class Discovery and class prediction by gene expression monitoring. Science, 286: 531–537.CrossRefGoogle Scholar
  27. 27.
    Alter O, Brown PO, and Botstein D (2000) Singular value decomposition for genome-wide expression data processing and modeling. PNAS, 97, 10101–10106.CrossRefGoogle Scholar
  28. 28.
    Thieffry D and Thomas R (1998) Qualitative analysis of gene networks. Pacific Symp. Biocomp, 3:77–88.Google Scholar
  29. 29.
    Socci ND and Mitra P (1999) Time series analysis of yeast S. cerevisiae cell cycle expression data. In Bronberg-Bauer E, De Beucklaer A, Kummer U, and Rost U (eds) Proceedings of Workshop on computation of Biochemical Pathways and Genetic Networks, Heidelberg.Google Scholar
  30. 30.
    Azuaje F (2001) Unsupervised neural network for discovery of gene expression patterns in B-cell lymphoma. Online Journal of Bioinformatics, Vol 1: 26–41.Google Scholar
  31. 31.
    Bicciato S, Pandin M, Didone G, and Bello C (2001) Analysis of an Associative Memory neural Network for Pattern Identification in Gene expression data. BIOKDD01, Workshop on Data mining in Bioinformatics.Google Scholar
  32. 32.
    Khan J, Wei JS, Ringner M, Saal LH, Ladanyi M, Westermann F, Berthold F, Schwab M, Antonescu CR, Peterson C, and Meltzer PS (2001) Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks. Nature Med. Vol.7, No. 6. 673–679.CrossRefGoogle Scholar
  33. 33.
    Dudoit S, Fridlyand J, and Speed T (2002) Comparison of discrimination methods for the classification of tumors using gene expression data. JASA, 97 (457):77–87.MathSciNetGoogle Scholar
  34. 34.
    Liang, Y and Kelemen A (2005) Temporal Gene Expression Classification with Regularised Neural Network. International Journal of Bioinformatics Research and Applications, 1(4), pp. 399–413.CrossRefGoogle Scholar
  35. 35.
    Liang, Y and Kelemen A (2004) Hierarchical Bayesian Neural Network for Gene Expression Temporal Patterns. Journal of Statistical Applications in Genetics and Molecular Biology: Vol. 3: No. 1, Article 20.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  1. 1.Department of BiostatisticsUniversity at Buffalo the State University of New YorkBuffaloUSA
  2. 2.Department of Neurology, Buffalo Neuroimaging Analysis Center The Jacobs Neurological InstituteUniversity at Buffalo the State University of New YorkBuffaloUSA

Personalised recommendations