Novel Applications of Intelligent Systems pp 105-122 | Cite as

# C × K-Nearest Neighbor Classification with Ordered Weighted Averaging Distance

## Abstract

In this study, OWA (Ordered Weighted Averaging) distance based *C* × *K*-nearest neighbor algorithm (*C* × *K*-NN) is considered. In this approach, from each class, where the number of classes is *C*, *K*-nearest neighbors are taken. The distance between the new sample and its *K*-nearest set is determined based on the OWA operator. It is shown that by adjusting the weights of the OWA operator, it is possible to obtain the results of various clustering strategies like single-linkage, complete-linkage, average-linkage, etc.

## Keywords

Membership Degree Order Weight Average Order Weight Average Operator Order Weight Average Order Weight Average Weight## Notes

### Acknowledgments

The authors would like to thank the anonymous reviewers for the constructive discussions and suggestions to improve the quality of this paper. This work is supported by TUBITAK (Scientific and Technological Research Council of Turkey) Grant No. 111T273.

## References

- 1.T.M. Cover, P.E. Hart, Nearest neighbor pattern classification. IEEE Trans. Inf. Theory
**13**, 21–27 (1967)CrossRefzbMATHGoogle Scholar - 2.T.M. Cover, Estimates by the nearest neighbor rule. IEEE Trans. Inf. Theory
**14**, 50–55 (1968)CrossRefzbMATHGoogle Scholar - 3.B.V. Dasarathy, Visiting nearest neighbor—a survey of nearest neighbor classification techniques, in
*Proceeding International Conference on Cybernetics Society*(1977), pp. 630–636Google Scholar - 4.R.O. Duda, P.E. Hart, D.G. Stork,
*Pattern Classification*(Wiley, New York, 2001)zbMATHGoogle Scholar - 5.J. Friedman, Flexible metric nearest neighbor classification, Technical Report 113, Stanford University, Statistics Department (1994)Google Scholar
- 6.K. Fukunaga, L.D. Hostetler, K-nearest-neighbor Bayes risk estimation. IEEE Trans. Inf. Theory
**21**(3), 285–293 (1975)CrossRefMathSciNetzbMATHGoogle Scholar - 7.R. Fuller, P. Majlender, On obtaining minimal variability OWA operator weights. Fuzzy Sets Syst.
**136**, 203–215 (2003)CrossRefMathSciNetzbMATHGoogle Scholar - 8.P. Hart, The condensed nearest neighbor rule. IEEE Trans. Inf. Theory
**14**, 515–516 (1968)CrossRefGoogle Scholar - 9.J. Keller, M.R. Gray, J.A. Givens, A Fuzzy K-nearest neighbor algorithm. IEEE Trans. Sys. Man Cybern. SMC
**15**(4), 580–585 (1985)CrossRefGoogle Scholar - 10.E. Nasibov, C. Kandemir-Cavas, OWA-based linkage method in hierarchical clustering: application on phylogenetic trees. Expert Syst. Appl.
**38**, 12684–12690 (2011)CrossRefGoogle Scholar - 11.R.A. Nasibova, E.N. Nasibov, Linear aggregation with weighted ranking. Autom. Control Comput. Sci.
**44**(2), 96–102 (2010)CrossRefGoogle Scholar - 12.M. Paik, Y. Yang, Combining nearest neighbor classifiers versus cross-validation selection. Stat. Appl. Genet. Mol. Biol.
**3**, 1–19 (2004)MathSciNetGoogle Scholar - 13.T.D. Pham, An optimally weighted fuzzy k-NN algorithm, in
*ICAPR’05 Proceedings of the Third international conference on Advances in Pattern Recognition,*vol. Part I, (Springer, Berlin, 2005), pp. 239–247Google Scholar - 14.B.W. Silverman,
*Density Estimation for Statistics and Data Analysis*(Chapman & Hall, UK, 1986)CrossRefzbMATHGoogle Scholar - 15.G. Ulutagay, E. Nasibov, A New C×K-nearest neighbor linkage approach to the classification problem, in
*Proceedings of the 10th International FLINS Conference*, vol. 1, eds. by C. Kahraman, E.K. Kerre, F.K. Bozbura (World Scientific Proceedings on Computer Engineering and Information Science, Istanbul, Turkey, 2012a) , pp. 471–476, ISBN 978-981-4417-73-0Google Scholar - 16.G. Ulutagay, E. Nasibov, OWA aggregation based C×K-nearest neighbor classification algorithm, in
*Proceedings of IEEE 6th International Conference Intelligent Systems,*vol. 1, ed. by R.R. Yager, V. Sgurev, M. Hadjiski (IEEE Catalog Number CFP12802-PRT, 2012b), pp. 219–224. ISBN 978-1-4673-2782-4Google Scholar - 17.V. Vapnik,
*Statistical Learning Theory*(Wiley, New York, 1998)zbMATHGoogle Scholar - 18.Z. Xu, An overview of methods determining OWA weights. Int. J. Intell. Syst.
**20**, 843–865 (2005)CrossRefzbMATHGoogle Scholar - 19.R. Yager, On ordered weighted averaging aggregation operators in multicriteria decision making. IEEE Trans. Syst. Man Cybern.
**18**, 183–190 (1988)CrossRefMathSciNetzbMATHGoogle Scholar - 20.R. Yager, Intelligent control of the hierarchical agglomerative clustering process. IEEE Trans. Syst. Man Cybern. Part B: Cybern.
**30**(6), 835–845 (2000)CrossRefMathSciNetGoogle Scholar