Gene Selection Based on Mutual Information for the Classification of Multi-class Cancer

  • Sheng-Bo Guo
  • Michael R. Lyu
  • Tat-Ming Lok
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4115)


With the development of mirocarray technology, microarray data are widely used in the diagnoses of cancer subtypes. However, people are still facing the complicated problem of accurate diagnosis of cancer subtypes. Building classifiers based on the selected key genes from microarray data is a promising approach for the development of microarray technology; yet the selection of non-redundant but relevant genes is complicated. The selected genes should be small enough to allow diagnosis even in regular laboratories and ideally identify genes involved in cancer-specific regulatory pathways. Instead of the traditional gene selection methods used for the classification of two categories of cancers, in the present paper, a novel gene selection algorithm based on mutual information is proposed for the classification of multi-class cancer using microarray data, and the selected key genes are fed into the classifier to classify the cancer subtypes. In our algorithm, mutual information is employed to select key genes related with class distinction. The application on the breast cancer data suggests that the present algorithm can identify the key genes to the BRCA1 mutations/BRCA2 mutations/the sporadic mutations class distinction since the result of our proposed algorithm is promising, because our method can perform the classification of the three types of breast cancer effectively and efficiently. And two more microarray datasets, leukemia and ovarian cancer data, are also employed to validate the performance of our method. The performances of these applications demonstrate the high quality of our method. Based on the present work, our method can be widely used to discriminate different cancer subtypes, which will contribute to the development of technology for the recovery of the cancer.


Microarray Data Mutual Information Gene Expression Data Class Label Gene Selection 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ben-Dor, A.: Tissue Classification with Gene Expression Profiles. Journal of Computational Biology 7, 559–583 (2000)CrossRefGoogle Scholar
  2. 2.
    Weston, J., Mukherjee, S., Chapelle, O., Pontil, M., Poggio, T., Vapnik, V.: 2001). In: Advances in Neural Information Processing Systems, vol. 13, MIT Press, Cambridge (2001)Google Scholar
  3. 3.
    Xing, E.P., Richard, M.K.: CLIFF: Clustering of High-Dimensional Microarray Data via Iterative Feature Filtering Using Normalized Cuts. Bioinformatics 17(1), 306–315 (2001)Google Scholar
  4. 4.
    Cover, T., Thomas, J.: Elements of Information Theory. John Wiley and Sons, Inc., Chichester (1991)MATHCrossRefGoogle Scholar
  5. 5.
    Hedenfalk, I., Duggan, D., Chen, Y., Radmacher, M., Bittner, M., Simon, R., Meltzer, P., Gusterson, B., Esteller, M., Raffeld, M.: Gene-Expression Profiles in Hereditary Breast Cancer. New Eng. J. Med. 344, 539–548 (2001)CrossRefGoogle Scholar
  6. 6.
    Nathalie, P., Frank, D.S., Johan, A.K.S., Bart, L.R.D.M.: Systematic Benchmarking of Microarray Data Classification: Assessing the Role of Non-linearity and Dimensionality Reduction. Bioinformatics 20(17), 3185–3195 (2004)CrossRefGoogle Scholar
  7. 7.
    Simon, R.: Supervised Analysis when The Number of Candidate Features Greatly Exceeds the Number of the Cases. SIGKDD Explorations 5(2), 31–36 (2003)CrossRefGoogle Scholar
  8. 8.
    Au, W.H., Keith, C.C.C., Andrew, K.C.W., Wang, Y.: Attribute Clustering for Grouping, Selection and Classification of Gene Expression Data. IEEE/ACM Transactions on computational biology and bioinformatics 2(2), 83–101 (2005)CrossRefGoogle Scholar
  9. 9.
    MacKay, D.J.C.: Information Theory, Inference, and Learning Algorithm. Cambridge Univ. Press, Cambridge (2003)Google Scholar
  10. 10.
    Chen, D.C., Liu, Z.Q., Ma, X.B., Hua, D.: Selecting Genes by Test Statistics. Journal of Biomedicine and Biotechnology 2, 132–138 (2005)CrossRefGoogle Scholar
  11. 11.
    Brown, M.B., Forsythe, A.B.: The Small Sample Behavior of Some Statistic which Test the Equality of Several Means. Technometrics, 129–132 (1974)Google Scholar
  12. 12.
    Welch, B.L.: On the Comparison of Several Mean Values: An Alternative Approach. Biometrika 38, 330–336 (1951)MATHMathSciNetGoogle Scholar
  13. 13.
    Chen, D.C., Hua, D., Jaques, R., Cheng, X.Z.: Gene Selection for Multi-class Prediction of Microarray Data. In: Bioinformatics Conference, 2003, CSB 2003, Proceedings of the 2003 IEEE, pp. 492–495 (2003)Google Scholar
  14. 14.
    Liu, L., Andrew, K.C.W., Wang, Y.: A Global Optimal Algorithm for Class-Dependent Discretization of Continuous Data  8(2), 151–170 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Sheng-Bo Guo
    • 1
    • 2
  • Michael R. Lyu
    • 3
  • Tat-Ming Lok
    • 4
  1. 1.Department of AutomationUniversity of Science and Technology of ChinaHefei, AnhuiChina
  2. 2.Intelligent Computation Lab, Hefei Institute of Intelligent MachinesChinese Academy of SciencesHefei, AnhuiChina
  3. 3.Computer Science & Engineering Dept.The Chinese University of Hong KongShatin, Hong Kong
  4. 4.Information Engineering Dept.The Chinese University of Hong KongShatin, Hong Kong

Personalised recommendations