An Eager Regression Method Based on Best Feature Projections
This paper describes a machine learning method, called Regression by Selecting Best Feature Projections (RSBFP). In the training phase, RSBFP projects the training data on each feature dimension and aims to find the predictive power of each feature attribute by constructing simple linear regression lines, one per each continuous feature and number of categories per each categorical feature. Because, although the predictive power of a continuous feature is constant, it varies for each distinct value of categorical features. Then the simple linear regression lines are sorted according to their predictive power. In the querying phase of learning, the best linear regression line and thus the best feature projection are selected to make predictions.
keywordsprediction feature projection regression
Unable to display preview. Download preview PDF.
- Breiman, L, Friedman, J H, Olshen, R A and Stone, C J ‘Classification and Regression Trees’ Wadsworth, Belmont, California (1984)Google Scholar
- Friedman, J H ‘Local Learning Based on Recursive Covering’ Department of Statistics, Stanford University (1996)Google Scholar
- Aha, D, Kibler, D and Albert, M ‘Instance-based Learning Algorithms’ Machine Learning Vol 6 (1991) pp 37–66Google Scholar
- Quinlan, J R ‘Learning with Continuous Classes’ Proceedings AI’92 Adams and Sterling (Eds) Singapore (1992) pp 343–348Google Scholar
- Karalic, A ‘Employing Linear Regression in Regression Tree Leaves’ Proceedings of ECAI’92 Vienna, Austria, Bernd Newmann (Ed.) (1992) pp 440–441Google Scholar
- Graybill, F, Iyer, H and Burdick, R ‘Applied Statistics’ Upper Saddle River, NJ (1998)Google Scholar
- Aydin, T ‘Regression by Selecting Best Feature(s)’ M.S.Thesis, Computer Engineering, Bilkent University, September, (2000)Google Scholar
- Aydin, T and Güvenir, H A ‘Regression by Selecting Appropriate Features’ Proceedings of TAINN’2000, Izmir, June 21-23, (2000), pp 73–82Google Scholar