A Study on Feature Selection for Toxicity Prediction
The increasing amount and complexity of data used in predictive toxicology calls for efficient and effective feature selection methods in data pre-processing for data mining. In this paper, we propose a kNN model-based feature selection method (kNNMFS) aimed at overcoming the weaknesses of ReliefF method. It modifies the ReliefF method by: (1) using a kNN model as the starter selection aimed at choosing a set of more meaningful representatives to replace the original data for feature selection; (2) integration of the Heterogeneous Value Difference Metric to handle heterogeneous applications – those with both ordinal and nominal features; and (3) presenting a simple method of difference function calculation. The performance of kNNMFS was evaluated on a toxicity data set Phenols using a linear regression algorithm. Experimental results indicate that kNNMFS has a significant improvement in the classification accuracy for the trial data set.
KeywordsFeature Selection Feature Selection Method Feature Subset Selection Relative Absolute Error Toxicity Prediction
Unable to display preview. Download preview PDF.
- 1.Hall, M.A.: Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning. In: Proc. of ICML 2000. 17th International Conference on Machine Learning, pp. 359–366 (2000)Google Scholar
- 2.Kononenko, I.: Estimating attributes: Analysis and Extension of Relief. In: Bergadano, F., De Raedt, L. (eds.) ECML 1994. LNCS, vol. 784, pp. 171–182. Springer, Heidelberg (1994)Google Scholar
- 3.Guo, G., Wang, H., Bell, D., Bi, Y., Greer, K.: KNN Model-based Approach in Classification. In: CoopIS/DOA/ODBASE 2003, pp. 986–996. Springer, Heidelberg (2003)Google Scholar
- 6.Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools with Java Implementations. Morgan Kaufmann, San Francisco (2000)Google Scholar