Skip to main content

Two Stages Feature Selection Based on Filter Ranking Methods and SVMRFE on Medical Applications

  • Conference paper
  • First Online:
Modelling and Implementation of Complex Systems

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 1))


This paper investigates feature selection stage applied to medical classification of disease on datasets from UCI repository. Feature selection methods based on minimum Redundancy Maximum Relevance (mRMR) filter and Ficher score were applied, each of them select a subset of features then the selection criteria is used to get the initial features subset. The second stage Support vector machine recursive feature elimination is performed to have the final subset. Experiments show that the proposed method provide an accuracy of 99.89 % on hepatitis dataset and 97.81 % on Wisconcin Breast cancer dataset and outperforms MRMR and Support vector machine recursive feature elimination SVM-RFE methods, as well as other popular methods on UCI database, and select features that are relevant in discriminating cancer class (malign/benign).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others


  1. Saeys, Y., Inza, I., Larranaga, P.: A review of feature selection technique in bioinformatics. J. Bioinform. Oxford university press, 1–10 (2005)

    Google Scholar 

  2. Ding, C., Peng, H., Long, F., Ding, C.: Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 27(8) (2005)

    Google Scholar 

  3. Yoon, S., Kim, S.: Mutual information-based SVM-RFE for diagnostic classification of digitized mammograms. J. Pattern Recognit. Lett. 30, 1489–1495 (2009)

    Article  Google Scholar 

  4. Mitra, S., Shankar, B.U.: Medical image analysis for cancer management in natural computing framework. Inf. Sci. 306, 111–131 (2015)

    Article  Google Scholar 

  5. Yang, F., Mao, K.Z.: Robust feature for microaccray data based on multicriterion fusion. IEEE/ACM trans. Comput. Biol. Bioinform. 8(4), 1080–1092 (2011).

    Google Scholar 

  6. Akay, M.F.: Support vector machines combined with feature selection for breast cancer diagnosis. J. Expert Syst. Appl. 36, 3240–3247 (2009)

    Article  Google Scholar 

  7. Yang, P., Bing B., Zhou, J.Y., Yang, A., Zomaya. Y.: Stability of feature selection algorithms and ensemble feature selection methods in bioinformatics, pp. 1–23 (2006).

    Google Scholar 

  8. Zhang, J., Hu, X., Li, P., He, W., Zhang H.Y.: A hybrid feature selection approach by correlation based filters and svm-rfe. In: International Conference on Pattern Recognition, 3684–3689 (2014).

    Google Scholar 

  9. Guyon, J., Weston, S., Barnhill, S., Vapnik, V.: Gene selection for cancer classification using support vector machines. Mach. Learn. 46(1–3), 389–422 (2002)

    Article  MATH  Google Scholar 

  10. Bolon Canedo, V., Sanchez Maono, N., Betanzos, A.: A review of feature selection methods on synthetic data. J. knowl. Inform. Syst. 34, 483–519 (2013).

    Google Scholar 

  11. Jirapech Umpai T., Aitken. S.: Feature selection and classification for microarray data analysis: Evolutionary methods for identifying predictive genes. BMC Bioinform. 6(1), 148 (2005)

    Google Scholar 

  12. Li, L., Weinberg, C.R., Darden, T.A., Pedersen, L.G.: Gene selection for sample classification based on gene expression data: study of sensitivity to choice of parameters of the ga/knn method. Bioinform. 17(12), 1131–1142 (2001)

    Article  Google Scholar 

  13. Umbach, D.M., Li L., Terry, P., Taylor. J. A.: Application of the ga/knn method to seldi proteomics data. Bioinform. 20(10) (2004)

    Google Scholar 

  14. Yan, K., Zhang, D.: Feature selection and analysis on correlated gas sensor data with recursive feature elimination. J. Sens. actuators B chem. 353–363 (2015).

    Google Scholar 

  15. Piyushkumar A.M., Rajapakse, J.C.: SVM-RFE with mrmr filter for gene selection, IEEE Trans. Nanobioscience 9(1) (2010)

    Google Scholar 

  16. Heath, M., Bowyer, K., Kopans, D., Moore, R., Kegelmeyer, W.: The digital database for screening mammography. In: Yaffe, M. (ed.), Proceeding 5th IWDM. Medical Physics Publishing, pp. 212–218 (2001).

    Google Scholar 

  17. Maka, M.W., Kung, S.Y.: Fusion of feature selection methods for pairwise scoring SVM. Neurocomputing 71, 3104–3113 (2008)

    Article  Google Scholar 

  18. Kai-Bo D., Rajapakse, H., Wang H., Azuaje F.: Multiple SVM-RFE for gene selection in cancer classification with expression data. IEEE Trans. Nanobioscience 4(3), 228–234 (2005).

    Google Scholar 

  19. Tang, Y.C., Zhang Y.Q., Huang, Z.: Development of two stage SVMRFE Gene selection strategy for microarray expression data analysis. IEEE ACM. Trans. Comput. Biol. Bioinform. 4(3), 365–381 (2007).

    Google Scholar 

  20. Zhang, Y., Ding, C., Li, T.: Gene selection algorithm by combining relief and mRMR. BMC Genom. 9(2), S27 (2008)

    Article  Google Scholar 

  21. Peng, Y., Wu, Z., Jiang, J.: A novel feature selection approach for biomedical data classification. J. Biomed. Inform. 43, 15–23 (2010)

    Article  Google Scholar 

  22. Vapnick, V.: Statistical learning theory, Wiley (1998)

    Google Scholar 


Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to Hayet Djellali .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Djellali, H., Zine, N.G., Azizi, N. (2016). Two Stages Feature Selection Based on Filter Ranking Methods and SVMRFE on Medical Applications. In: Chikhi, S., Amine, A., Chaoui, A., Kholladi, M., Saidouni, D. (eds) Modelling and Implementation of Complex Systems. Lecture Notes in Networks and Systems, vol 1. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-33409-7

  • Online ISBN: 978-3-319-33410-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics