Genes & Genomics

, Volume 41, Issue 11, pp 1301–1313 | Cite as

Improving classification accuracy of cancer types using parallel hybrid feature selection on microarray gene expression data

  • Lokeswari VenkataramanaEmail author
  • Shomona Gracia Jacob
  • Rajavel Ramadoss
  • Dodda Saisuma
  • Dommaraju Haritha
  • Kunthipuram Manoja
Research Article



Data mining techniques are used to mine unknown knowledge from huge data. Microarray gene expression (MGE) data plays a major role in predicting type of cancer. But as MGE data is huge in volume, applying traditional data mining approaches is time consuming. Hence parallel programming frameworks like Hadoop, Spark and Mahout are necessary to ease the task of computation.


Not all the gene expressions are necessary in prediction, it is very essential to select important genes for improving classification accuracy. So feature selection algorithms are parallelized and executed on Spark framework to eliminate unnecessary genes and identify only predictive genes in very less time without affecting prediction accuracy.


Parallelized hybrid feature selection (HFS) method is proposed to serve the purpose. This method includes parallelized correlation feature subset selection followed by rank-based feature selection methods. The selected subset of genes is evaluated using parallel classification algorithms. The accuracy values obtained are compared with existing rank-weight feature selection, parallelized recursive feature selection methods and also with the values obtained by executing parallelized HFS on DistributedWekaSpark.


The classification accuracy obtained with the proposed parallelized HFS method is 97% and 79% for gastric cancer and childhood leukemia respectively. The proposed parallelized HFS method produced ~ 4% to ~ 15% improvement in classification accuracy when compared with previous methods.


The results reveal the fact that the proposed parallelized feature selection algorithm is scalable to growing medical data and predicts cancer sub-types in lesser time with higher accuracy.


Parallelized hybrid feature selection Correlation feature subset selection Rank-based methods Parallel classification Spark DistributedWekaSpark 



This research work is part of project work funded by Science and Engineering Research Board (SERB), Department of Science and Technology (DST) funded project under Young Scientist Scheme—Early Start-up Research Grant- titled “Investigation on the effect of Gene and Protein Mutants in the onset of Neuro-Degenerative Brain Disorders (Alzheimer’s and Parkinson’s disease): A Computational Study” with Reference no-SERB—YSS/2015/000737/ES.

Compliance with ethical standards

Conflict of interest

Lokeswari Venkataramana, Shomona Gracia Jacob, Rajavel Ramadoss, Dodda Saisuma, Dommaraju Haritha and Kunthipuram Manoja declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Informed consent

Informed consent is not necessary as this article does not involve human or animal participants.


  1. Ali SI, Shahzad W (2012) A feature subset selection method based on symmetric uncertainty and ant colony optimization. In: IEEE international conference on technologies (ICET), pp 1–6Google Scholar
  2. Alshamlan HM, Badr GH, Alohali Y (2013) A study of cancer microarray gene expression prole: objectives and approaches. In: Proceedings of the world congress on engineering, vol 2, pp 1–6Google Scholar
  3. Bang MS, Kang K, Lee JJ, Lee YJ, Choi JE, Ban JY, Oh CH (2017) Transcriptome analysis of non-small cell lung cancer and genetically matched adjacent normal tissues identifies novel prognostic marker genes. Genes Genom 39(3):277–284CrossRefGoogle Scholar
  4. Bioinformatics Laboratory (2019). Accessed 20 July 2019
  5. Bolón-CanedoV V, Sánchez-Maroño N, Alonso-Betanzos A (2015) Distributed feature selection: an application to microarray data classification. Appl Soft Comput 30:136–150CrossRefGoogle Scholar
  6. Chuang LY, Yang CH, Wu KC, Yang CH (2011) A hybrid feature selection method for DNA microarray data. Comput Biol Med 41(4):228–237CrossRefGoogle Scholar
  7. Das AK, Goswami S, Chakrabarti A, Chakraborty B (2017) A new hybrid feature selection approach using feature association map for supervised and unsupervised classification. Expert Syst Appl 88:81–94CrossRefGoogle Scholar
  8. Eiras-Franco C, Bolón-Canedo V, Ramos S, González-Domínguez J, Alonso-Betanzos A, Touriño J (2016) Multithreaded and Spark parallelization of feature selection filters. J Comput Sci 17:609–619CrossRefGoogle Scholar
  9. Golub TR, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mesirov JP, Coller H, Loh ML, Downing JR, Caligiuri MA et al (1999) Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286(5439):531–537CrossRefGoogle Scholar
  10. Gracia Jacob S (2015) Discovery of novel oncogenic patterns using hybrid feature selection and rule mining. Ph.D. Thesis. Anna University. IndiaGoogle Scholar
  11. Hall MA (2000) Correlation-based feature selection for discrete and numeric class machine learning. In: Proceedings of the seventeenth international conference on machine learning, pp 359–366Google Scholar
  12. Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The WEKA data mining software: an update. SIGKDD Explor 11(1):10–18CrossRefGoogle Scholar
  13. Heo J, Lee JS, Leem SH (2013) Distinct gene expression signatures during development of distant metastasis. Genes Genom 35(4):511–522CrossRefGoogle Scholar
  14. Kang S, Hong S (2011) Prediction of personalized drugs based on genetic variations provided by DNA sequencing technologies. Genes Genom 33(6):591–603CrossRefGoogle Scholar
  15. Lee CP, Leu Y (2017) A novel hybrid feature selection method for microarray data analysis. Appl Soft Comput 11(1):208–213CrossRefGoogle Scholar
  16. Li J, Liu H (2017) Challenges of feature selection for big data analytics. IEEE Intell Syst 32(2):9–15CrossRefGoogle Scholar
  17. Lokeswari YV, Jacob SG, Ramadoss R (2019) Parallel prediction algorithms for heterogeneous data: a case study with real-time big datasets. In: Peter JD, Alavi AH, Javadi B (eds) Advances in big data and cloud computing. Springer, Singapore, pp 529–538CrossRefGoogle Scholar
  18. Lu H, Chen J, Yan K, Jin Q, Xue Y, Gao Z (2017) A hybrid feature selection algorithm for gene expression data classification. Neurocomputing 256:56–62CrossRefGoogle Scholar
  19. Peralta D, del Río S, Ramírez-Gallego S, Triguero I, Benitez JM (2015) Herrera F (2015) Evolutionary feature selection for big data classification: a Mapreduce approach. Math Probl Eng 2015(246139):1–11CrossRefGoogle Scholar
  20. Ramani RG, Jacob SG (2013) Benchmarking classification models for cancer prediction from gene expression data: a novel approach and new findings. Stud Inform Control 22(2):134–143CrossRefGoogle Scholar
  21. Ryza S, Laserson U, Owen S, Wills J (2017) Advanced analytics with Spark: patterns for learning from data at scale. O’Reilly Media Inc., Northern California, USAGoogle Scholar
  22. Singh RK, Sivabalakrishnan M (2015) Feature selection of gene expression data for cancer classification: a review. Procedia Comput Sci 50:52–57CrossRefGoogle Scholar
  23. Spark Release 2.2.1—Apache Spark (2019). Accessed 25 July 2019
  24. Venkataramana L, Jacob SG, Ramadoss R (2018) Parallelized classification of cancer sub-types from gene expression profiles using recursive gene selection. Stud Inform Control 27(1):215–224Google Scholar
  25. Waikato Environment for Knowledge Analysis (WEKA) (2019). Accessed 26 July 2019
  26. Wang X, Gotoh O (2010) A robust gene selection method for microarray-based cancer classification. Cancer Inform 9:CIN-S3794CrossRefGoogle Scholar
  27. Wang Z, Zhang Y, Chen Z, Yang H, Sun Y, Kang J, Yang Y, Liang X (2016) Application of ReliefF algorithm to selecting feature sets for classification of high resolution remote sensing image. In: 2016 IEEE international geoscience and remote sensing symposium (IGARSS), pp 755–758Google Scholar
  28. Yu JF, Guo J, Liu QB, Hou Y, Xiao K, Chen QL, Wang JH, Sun X (2015) A hybrid strategy for comprehensive annotation of the protein coding genes in prokaryotic genome. Genes Genom 37(4):347–355CrossRefGoogle Scholar
  29. Yuan M, Yang Z, Huang G, Ji G (2017) Feature selection by maximizing correlation information for integrated high-dimensional protein data. Pattern Recognit Lett 92:17–24CrossRefGoogle Scholar
  30. Zhang H, Li L, Luo C, Sun C, Chen Y, Dai Z, Yuan Z (2014) Informative gene selection and direct classification of tumor based on chi square test of pairwise gene interactions. Biomed Res Int 2014(589290):1–9Google Scholar

Copyright information

© The Genetics Society of Korea 2019

Authors and Affiliations

  1. 1.Department of CSESri Sivasubramaniya Nadar College of EngineeringChennaiIndia
  2. 2.MuscatOman
  3. 3.Department of ECESri Sivasubramaniya Nadar College of EngineeringChennaiIndia

Personalised recommendations