Abstract
Feature selection for the individuals of bagging is studied in this paper. Ensemble learning like bagging can effectively improve the performance of single learning machines, and so can feature selection, but few has studied whether feature selection could improve bagging of single learning machines. Therefore, two typical feature selection approaches namely the embedded feature selection model with the prediction risk criteria and the filter model with the mutual information criteria are used for the bagging of support vector machines respectively. Experiments performed on the UCI data sets show the effectiveness of feature selection for the bagging of support vector machines.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Dietterich, T.: Machine-learning research: Four current directions. The AI Magazine 18, 97–136 (1998)
Breiman, L.: Bagging predictors. machine learning 24, 123–140 (1996)
Bauer, E., Kohavi, R.: An empirical comparison of voting classification algorithms: Bagging, boosting, and variants. Machine learning 36, 105–139 (1999)
Yu, L., Liu, H.: Efficient feature selection via analysis of relevance and redundancy. Journal of Machine Learning Research 5, 1205–1224 (2004)
Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. Journal of machine learning research 3, 1157–1182 (2003)
Li, G.Z., Yang, J., Liu, G.P., Xue, L.: Feature selection for multi-class problems using support vector machines. In:LNAI, Auckland, New Zealand vol. 3173, pp. 292–300. Springer, Heidelberg (2004)
Zhou, Z.H., Wu, J.X., Tang, W.: Ensembling neural networks: many could be better than all. Artificial Intelligence 137, 239–263 (2002)
Valentini, G., Dietterich, T.: Bias-variance analysis of support vector machines for the development of svm-based ensemble methods. Journal of Machine Learning Research 5, 725–775 (2004)
Liu, H., Yu, L.: Toward integrating feature selection algorithms for classification and clustering. IEEE Trans. on Knowledge and Data Engineering 17(3), 1–12 (2005)
Moody, J., Utans, J.: Principled architecture selection for neural networks: Application to corporate bond rating prediction. In: NIPS 4, pp. 683–690. Morgan Kaufmann Publishers, Inc., San Francisco (1992)
Blake, C., Keogh, E., Merz, C.J.: UCI repository of machine learning databases. Technical report, Department of Information and Computer Science, University of California, Irvine, CA (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Li, GZ., Liu, TY. (2006). Feature Selection for Bagging of Support Vector Machines. In: Yang, Q., Webb, G. (eds) PRICAI 2006: Trends in Artificial Intelligence. PRICAI 2006. Lecture Notes in Computer Science(), vol 4099. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-36668-3_30
Download citation
DOI: https://doi.org/10.1007/978-3-540-36668-3_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-36667-6
Online ISBN: 978-3-540-36668-3
eBook Packages: Computer ScienceComputer Science (R0)