Regression by Feature Projections

  • İlhan Uysal
  • H. Altay Güvenir
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1704)

Abstract

This paper describes a machine learning method, called Regression by Feature Projections (RFP), for predicting a real-valued target feature. In RFP training is based on simply storing the projections of the training instances on each feature separately. Prediction is computed through two approximation procedures. The first approximation process is to find the individual predictions of features by using the K-nearest neighbor algorithm (KNN). The second approximation process combines the predictions of all features. During the first approximation step, each feature is associated with a weight in order to determine the prediction ability of the feature at the local query point. The weights, found for each local query point, are used in the second step and enforce the method to have an adaptive or context-sensitive nature. We have compared RFP with the KNN algorithm. Results on real data sets show that RFP is much faster than KNN, yet its prediction accuracy is comparable with the KNN algorithm.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Güvenir, H.A., Sirin, İ.: Classification by Feature Partitioning. Machine Learning 23, 47–67 (1996)Google Scholar
  2. 2.
    Güvenir, H.A., Demiroz, G., Ilter, N.: Learning Differential Diagnosis of Erythemato Squamous Diseases using Voting Feature Intervals. Artificial Intelligence in Medicine 13, 147–165 (1998)CrossRefGoogle Scholar
  3. 3.
    Holte, R.C.: Very Simple Classification Rules Perform Well on Most Commonly Used Data Sets. Machine Learning 11, 63–91 (1993)MATHCrossRefGoogle Scholar
  4. 4.
    Mathews, J.H.: Numerical Methods for Computer Science, Engineering and Mathematics. Prentice-Hall, Englewood Cliffs (1987)Google Scholar
  5. 5.
    Mitchell, T.M.: Machine Learning. McGraw Hill, New York (1997)MATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1999

Authors and Affiliations

  • İlhan Uysal
    • 1
  • H. Altay Güvenir
    • 1
  1. 1.Department of Computer Engineering and Information SciencesBilkent UniversityAnkaraTurkey

Personalised recommendations