Skip to main content

Advertisement

SpringerLink
Log in

Sequential multi-criteria feature selection algorithm based on agent genetic algorithm

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

A multi-criteria feature selection method-sequential multi-criteria feature selection algorithm (SMCFS) has been proposed for the applications with high precision and low time cost. By combining the consistency and otherness of different evaluation criteria, the SMCFS adopts more than one evaluation criteria sequentially to improve the efficiency of feature selection. With one novel agent genetic algorithm (chain-like agent GA), the SMCFS can obtain high precision of feature selection and low time cost that is similar as filter method with single evaluation criterion. Several groups of experiments are carried out for comparison to demonstrate the performance of SMCFS. SMCFS is compared with different feature selection methods using three datasets from UCI database. The experimental results show that the SMCFS can get low time cost and high precision of feature selection, and is very suitable for this kind of applications of feature selection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. De Stefano C, Fontanella F, Marrocco C (2008) A GA-based feature selection algorithm for remote sensing images. In: EvoWorkshops 2008. LNCS, vol 4974. Springer, Berlin, pp 285–294

    Google Scholar 

  2. Suzuki E (2005) Worst case and a distribution-based case analysis of sampling for rule discovery based on generality and accuracy. Appl Intell 22(1):29–36

    Article  MATH  Google Scholar 

  3. Eriksson T, Kim S, Kang H-G, Lee C (2005) An information-theoretic perspective on feature selection in speaker recognition. IEEE Signal Process Lett 12(7):500–503

    Article  Google Scholar 

  4. Cho BH, Yu H, Kim K-W, Kim TH, Kim IY, Kim SI (2008) Application of irregular and unbalanced data to predict diabetic nephropathy using visualization and feature selection methods. Artif Intell Med 42(1):37–53

    Article  Google Scholar 

  5. Yan J, Zhang B, Liu N, Yan S, Cheng Q, Fan W, Yang Q, Xi W, Chen Z (2006) Effective and efficient dimensionality reduction for large-scale and streaming data preprocessing. IEEE Trans Knowl Data Eng 18(3):320–333

    Article  Google Scholar 

  6. Su C-T, Yang C-H (2008) Feature selection for the SVM: an application to hypertension diagnosis. Expert Syst Appl 34(1):754–763

    Article  MathSciNet  Google Scholar 

  7. Liu H, Yu L (2005) Toward integrating feature selection algorithms for classification and clustering. IEEE Trans Knowl Data Eng 17(4):491–502

    Article  Google Scholar 

  8. Oh I-S, Lee J-S, Moon B-R (2004) Hybrid genetic algorithms for feature selection. IEEE Trans Pattern Anal Mach Intell 26(11):1424–1437

    Article  Google Scholar 

  9. Huang C-L, Wang C-J (2006) A GA-based feature selection and parameters optimization for support vector machines. Expert Syst Appl 31:231–240

    Article  Google Scholar 

  10. Kohavi R, John GH (1997) Wrappers for feature subset selection. Artif Intell 97(1):273–324

    Article  MATH  Google Scholar 

  11. Zhu Z, Ong Y-S, Dash M (2007) Wrapper–filter feature selection algorithm using a memetic framework. IEEE Trans Syst Man Cybern—Part B: Cybern 37(1):70–76

    Article  Google Scholar 

  12. Wang L (2008) Feature selection with kernel class separability. IEEE Trans Pattern Anal Mach Intell 30(9):1534–1546

    Article  Google Scholar 

  13. Gunal S, Edizkan R (2008) Subspace based feature selection for pattern recognition. Inf Sci 178(19):3716–3726

    Article  Google Scholar 

  14. Chen L-H, Hsiao H-D (2008) Feature selection to diagnose a business crisis by using a real GA-based support vector machine: an empirical study. Expert Syst Appl 35(3):1145–1155

    Article  Google Scholar 

  15. Jiang Z, Yamauchi K, Yoshioka K et al. (2006) Support vector machine-based feature selection for classification of liver fibrosis grade in chronic hepatitis C. J Med Syst 30(5):34–45

    Google Scholar 

  16. Pizzi NJ, Pedrycz W (2008) Effective classification using feature selection and fuzzy integration. Fuzzy Sets Syst 159(21):2859–2872

    Article  MathSciNet  Google Scholar 

  17. Yang Y, He GWK (2007) An approach for selective ensemble feature selection based on rough set theory. In: RSKT2007. LNAI, vol 4481. Springer, Berlin, pp 518–525

    Google Scholar 

  18. Yuan H, Tseng S-S, Gangshan W, Fuyan Z (1999) A two-phase feature selection method using both filter and wrapper. In: IEEE SMC’99 conference. IEEE Press, New York, pp 132–136

    Google Scholar 

  19. Li Y, Lu B-L, Wu Z-F (2006) A hybrid method of unsupervised feature selection based on ranking. In: The 18th international conference on pattern recognition (ICPR’06), vol 2. IEEE Press, New York, pp 687–690

    Google Scholar 

  20. Huang J, Cai Y, Xu X (2007) A hybrid genetic algorithm for feature selection wrapper based on mutual information. Pattern Recognit Lett 28(13):1825–1844

    Article  Google Scholar 

  21. Banerjee M, Mitra S, Banka H (2007) Evolutionary-rough feature selection in gene expression data. IEEE Trans Syst Man Cybern Part C: Appl Rev 37(4):622–632

    Article  Google Scholar 

  22. Mitra S, Banka H (2006) Multi-objective evolutionary biclustering of gene expression data. Pattern Recognit 39(12):2464–2477

    Article  MATH  Google Scholar 

  23. Wing WY, Yeung DS, Firth M et al. (2008) Feature selection using localized generalization error for supervised classification problems using RBFNN. Pattern Recognit 41(12):3706–3719

    Article  MATH  Google Scholar 

  24. Huang C-L, Tsai C-Y (2007) A hybrid SOFM-SVR with a filter-based feature selection for stock market forecasting. Expert Syst Appl, available online 15 December 2007

  25. Blazadonakis ME, Zervakis M (2008) Wrapper filtering criteria via linear neuron and kernel approaches. Comput Biol Med, available online 24 July 2008

  26. Doan S, Horiguchi S (2004) An efficient feature selection using multi-criteria in text categorization. In: Proceedings of the fourth international conference on hybrid intelligent systems (HIS’04)

  27. Peng H, Long F, Ding C (2005) Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans Pattern Anal Mach Intell 27(8):1226–1238

    Article  Google Scholar 

  28. Emmanouilidis C, Hunter A, Machtyre J, Cox C (1999) Multiple-criteria genetic algorithms for feature selection in neuro-fuzzy modeling. In: Proceeding of international joint conference on neural networks, IJCNN ’99, 10–16 July 1999, vol 6, pp 4387–4392

  29. Auarth B, L’opez M, Cerquides J (2008) Hopfield networks in relevance and redundancy feature selection applied to classification of biomedical high-resolution micro-CT images. In: ICDM 2008. LNAI, vol 5077. Springer, Berlin, pp 16–31

    Google Scholar 

  30. Zeng X-P, Li Y-M, Qin J (2008) A dynamic chain-like agent genetic algorithm for global numerical optimization and feature selection. Neurocomputing. doi:10.1016/j.neucom.2008.02.010. Available online at www.sciencedirect.com

    Google Scholar 

  31. Srinivas M, Patnaik LM (1994) Adaptive probabilities of crossover and mutation in genetic algorithms. IEEE Trans Syst Man Cybern 24(4):656–659

    Article  Google Scholar 

  32. Zhong W, Liu J, Xue M, Jiao L (2004) A multiagent genetic algorithm for global numerical optimization. IEEE Trans Syst Man Cybern—Part B: Cybern 34(2):1128–1141

    Article  Google Scholar 

  33. Gong D-W, Sun X-Y, Guo X-J (2002) Novel survival of the fittest genetic algorithm. Control Dec 17(6):908–911

    Google Scholar 

  34. Michalewicz Z, Fogel DB (2000) How to solve it: modern heuristics. Springer, Berlin, pp 83–234

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Communication Engineering, Chongqing University, Chongqing, 400030, China

    Yongming Li & Xiaoping Zeng

Authors
  1. Yongming Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaoping Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yongming Li.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Li, Y., Zeng, X. Sequential multi-criteria feature selection algorithm based on agent genetic algorithm. Appl Intell 33, 117–131 (2010). https://doi.org/10.1007/s10489-008-0153-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-008-0153-8

Keywords

Search

Navigation