Locally Determining the Number of Neighbors in the k-Nearest Neighbor Rule Based on Statistical Confidence

  • Jigang Wang
  • Predrag Neskovic
  • Leon N. Cooper
Conference paper

DOI: 10.1007/11539087_9

Part of the Lecture Notes in Computer Science book series (LNCS, volume 3610)
Cite this paper as:
Wang J., Neskovic P., Cooper L.N. (2005) Locally Determining the Number of Neighbors in the k-Nearest Neighbor Rule Based on Statistical Confidence. In: Wang L., Chen K., Ong Y.S. (eds) Advances in Natural Computation. ICNC 2005. Lecture Notes in Computer Science, vol 3610. Springer, Berlin, Heidelberg

Abstract

The k-nearest neighbor rule is one of the most attractive pattern classification algorithms. In practice, the value of k is usually determined by the cross-validation method. In this work, we propose a new method that locally determines the number of nearest neighbors based on the concept of statistical confidence. We define the confidence associated with decisions that are made by the majority rule from a finite number of observations and use it as a criterion to determine the number of nearest neighbors needed. The new algorithm is tested on several real-world datasets and yields results comparable to those obtained by the k-nearest neighbor rule. In contrast to the k-nearest neighbor rule that uses a fixed number of nearest neighbors throughout the feature space, our method locally adjusts the number of neighbors until a satisfactory level of confidence is reached. In addition, the statistical confidence provides a natural way to balance the trade-off between the reject rate and the error rate by excluding patterns that have low confidence levels.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Jigang Wang
    • 1
  • Predrag Neskovic
    • 1
  • Leon N. Cooper
    • 1
  1. 1.Institute for Brain and Neural Systems, Department of PhysicsBrown UniversityProvidenceUSA

Personalised recommendations