Skip to main content
Log in

Membership evaluation and feature selection for fuzzy support vector machine based on fuzzy rough sets

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

A fuzzy support vector machine (FSVM) is an improvement in SVMs for dealing with data sets with outliers. In FSVM, a key step is to compute the membership for every training sample. Existing approaches of computing the membership of a sample are motivated by the existence of outliers in data sets and do not take account of the inconsistency between conditional attributes and decision classes. However, this kind of inconsistency can affect membership for every sample and has been considered in fuzzy rough set theory. In this paper, we develop a new method to compute membership for FSVMs by using a Gaussian kernel-based fuzzy rough set. Furthermore, we employ a technique of attribute reduction using Gaussian kernel-based fuzzy rough sets to perform feature selection for FSVMs. Based on these discussions we combine the FSVMs and fuzzy rough sets methods together. The experimental results show that the proposed approaches are feasible and effective.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Chen D, He Q, Wang X (2007) On linear separability of data sets in feature space. Neurocomputing 70(13–15):2441–2448

    Article  Google Scholar 

  • Dubois D, Prade H (1990) Rough fuzzy sets and fuzzy rough sets. Int J Gen Syst 17:191–209

    Article  MATH  Google Scholar 

  • Dubois D, Prade H (1992) Putting rough sets and fuzzy sets together. In: Slowinski R (ed) Intelligent decision support, handbook of applications and advances of the rough sets theory. Kluwer, Dordrecht

  • Fernandez S, Murakami S (2003) Rough set analysis of a general type of fuzzy data using transitive aggregations of fuzzy similarity relations. Fuzzy Sets Syst 139:635–660

    Article  MATH  Google Scholar 

  • Hassanien A (2007) Fuzzy rough sets hybrid scheme for breast cancer detection. Image Vis Comput 25(2):172–183

    Article  Google Scholar 

  • He Z (1983) Fuzzy mathematics and its applications. Tianjing Science Press, Tianjing

  • Hu Q, Yu D, Xie Z, Liu J (2006) Fuzzy probabilistic approximation spaces and their information measures. IEEE Trans Fuzzy Syst 14(2):191–201

    Article  Google Scholar 

  • Hu Q, Xie Z, Yu D (2007) Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation. Pattern Recogn 40:3509–3521

    Article  MATH  Google Scholar 

  • Huang H, Liu Y (2002) Fuzzy support vector machines for pattern recognition and data mining. Int J Fuzzy Syst 4:826–835

    MathSciNet  Google Scholar 

  • Jensen R, Shen Q (2004) Fuzzy-rough attributes reduction with application to web categorization. Fuzzy Sets Syst 141:469–485

    Article  MathSciNet  MATH  Google Scholar 

  • Lin C, Wang S (2003) Fuzzy support vector machine. IEEE Trans Neural Netw 13(2):464–471

    Google Scholar 

  • Liu S, Du Z (2007) An improved fuzzy support vector machine method. CAAI Trans Intell Syst 2(3):30–33

    Google Scholar 

  • Liu M, Chen D, Wu C, Li H (2006) Fuzzy reasoning based on a new fuzzy rough set and its application to scheduling problems. Comput Math Appl 51(9–10):1507–1518

    Article  MathSciNet  MATH  Google Scholar 

  • Mi J, Zhang W (2004) An axiomatic characterization of a fuzzy generalization of rough sets. Inf Sci 160(1–4):235–249

    Article  MathSciNet  MATH  Google Scholar 

  • Morsi N, Yakout M (1998) Axiomatics for fuzzy rough sets. Fuzzy Sets Syst 100:327–342

    Article  MathSciNet  MATH  Google Scholar 

  • Moser B (2006a) On the T-transitivity of kernels. Fuzzy Sets Syst 157:1787–1796

    Article  MATH  Google Scholar 

  • Moser B (2006b) On representing and generating kernels by fuzzy equivalence relations. J Mach Learn Res 7:2603–2620

    MathSciNet  Google Scholar 

  • Pawlak Z (1982) Rough sets. Int J Comput Inf Sci 11(5):341–356

    Article  MathSciNet  MATH  Google Scholar 

  • Radzikowska A, Kerre E (2002) A comparative study of fuzzy rough sets. Fuzzy Sets Syst 126:137–155

    Article  MathSciNet  MATH  Google Scholar 

  • Sarkar M (2006) Ruggedness measures of medical time series using fuzzy-rough sets and fractals. Pattern Recogn Lett 27(5):447–454

    Article  Google Scholar 

  • Scholkopf B, Smola A (2002) Learning with kernels. The MIT Press, London

    Google Scholar 

  • Vapnik V (1995) The nature of statistical learning theory. Springer, New York

    MATH  Google Scholar 

  • Wang X, Yang J (2006) Richard Jensen and Xiaojun Liu, rough set feature selection and rule induction for prediction of malignancy degree in brain glioma. Comput Methods Programs Biomed 83(2):147–156

    Article  Google Scholar 

  • Wang Y, Wang S, Lai K (2005) A new fuzzy support vector machine to evaluate credit risk. IEEE Trans Fuzzy Syst 13:820–831

    Article  Google Scholar 

  • Wu W, Zhang W (2004) Constructive and axiomatic approaches of fuzzy approximation operators. Inf Sci 159(3–4):233–254

    Article  MATH  Google Scholar 

  • Wu W, Mi J, Zhang W (2003) Generalized fuzzy rough sets. Inf Sci 151:263–282

    Article  MathSciNet  MATH  Google Scholar 

  • Yueng D, Chen D, Tsang EL et al (2005) On the generalization of fuzzy rough systems. IEEE Trans Fuzzy Syst 13:343–361

    Article  Google Scholar 

Download references

Acknowledgments

This paper is supported by NSFCs (70871036, 60773062, 60903088, 60903089), by the natural science foundation of Hebei Province (F2008000635, F2009000231, F2009000227) and by the Scientific Research Project of Department of Education of Hebei Province (2009410).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Qiang He.

Rights and permissions

Reprints and permissions

About this article

Cite this article

He, Q., Wu, C. Membership evaluation and feature selection for fuzzy support vector machine based on fuzzy rough sets. Soft Comput 15, 1105–1114 (2011). https://doi.org/10.1007/s00500-010-0577-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-010-0577-z

Keywords

Navigation