C × K-Nearest Neighbor Classification with Ordered Weighted Averaging Distance

  • Gozde Ulutagay
  • Efendi Nasibov
Part of the Studies in Computational Intelligence book series (SCI, volume 586)


In this study, OWA (Ordered Weighted Averaging) distance based C × K-nearest neighbor algorithm (C × K-NN) is considered. In this approach, from each class, where the number of classes is C, K-nearest neighbors are taken. The distance between the new sample and its K-nearest set is determined based on the OWA operator. It is shown that by adjusting the weights of the OWA operator, it is possible to obtain the results of various clustering strategies like single-linkage, complete-linkage, average-linkage, etc.


Membership Degree Order Weight Average Order Weight Average Operator Order Weight Average Order Weight Average Weight 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



The authors would like to thank the anonymous reviewers for the constructive discussions and suggestions to improve the quality of this paper. This work is supported by TUBITAK (Scientific and Technological Research Council of Turkey) Grant No. 111T273.


  1. 1.
    T.M. Cover, P.E. Hart, Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13, 21–27 (1967)CrossRefzbMATHGoogle Scholar
  2. 2.
    T.M. Cover, Estimates by the nearest neighbor rule. IEEE Trans. Inf. Theory 14, 50–55 (1968)CrossRefzbMATHGoogle Scholar
  3. 3.
    B.V. Dasarathy, Visiting nearest neighbor—a survey of nearest neighbor classification techniques, in Proceeding International Conference on Cybernetics Society (1977), pp. 630–636Google Scholar
  4. 4.
    R.O. Duda, P.E. Hart, D.G. Stork, Pattern Classification (Wiley, New York, 2001)zbMATHGoogle Scholar
  5. 5.
    J. Friedman, Flexible metric nearest neighbor classification, Technical Report 113, Stanford University, Statistics Department (1994)Google Scholar
  6. 6.
    K. Fukunaga, L.D. Hostetler, K-nearest-neighbor Bayes risk estimation. IEEE Trans. Inf. Theory 21(3), 285–293 (1975)CrossRefMathSciNetzbMATHGoogle Scholar
  7. 7.
    R. Fuller, P. Majlender, On obtaining minimal variability OWA operator weights. Fuzzy Sets Syst. 136, 203–215 (2003)CrossRefMathSciNetzbMATHGoogle Scholar
  8. 8.
    P. Hart, The condensed nearest neighbor rule. IEEE Trans. Inf. Theory 14, 515–516 (1968)CrossRefGoogle Scholar
  9. 9.
    J. Keller, M.R. Gray, J.A. Givens, A Fuzzy K-nearest neighbor algorithm. IEEE Trans. Sys. Man Cybern. SMC 15(4), 580–585 (1985)CrossRefGoogle Scholar
  10. 10.
    E. Nasibov, C. Kandemir-Cavas, OWA-based linkage method in hierarchical clustering: application on phylogenetic trees. Expert Syst. Appl. 38, 12684–12690 (2011)CrossRefGoogle Scholar
  11. 11.
    R.A. Nasibova, E.N. Nasibov, Linear aggregation with weighted ranking. Autom. Control Comput. Sci. 44(2), 96–102 (2010)CrossRefGoogle Scholar
  12. 12.
    M. Paik, Y. Yang, Combining nearest neighbor classifiers versus cross-validation selection. Stat. Appl. Genet. Mol. Biol. 3, 1–19 (2004)MathSciNetGoogle Scholar
  13. 13.
    T.D. Pham, An optimally weighted fuzzy k-NN algorithm, in ICAPR’05 Proceedings of the Third international conference on Advances in Pattern Recognition, vol. Part I, (Springer, Berlin, 2005), pp. 239–247Google Scholar
  14. 14.
    B.W. Silverman, Density Estimation for Statistics and Data Analysis (Chapman & Hall, UK, 1986)CrossRefzbMATHGoogle Scholar
  15. 15.
    G. Ulutagay, E. Nasibov, A New C×K-nearest neighbor linkage approach to the classification problem, in Proceedings of the 10th International FLINS Conference, vol. 1, eds. by C. Kahraman, E.K. Kerre, F.K. Bozbura (World Scientific Proceedings on Computer Engineering and Information Science, Istanbul, Turkey, 2012a) , pp. 471–476, ISBN 978-981-4417-73-0Google Scholar
  16. 16.
    G. Ulutagay, E. Nasibov, OWA aggregation based C×K-nearest neighbor classification algorithm, in Proceedings of IEEE 6th International Conference Intelligent Systems, vol. 1, ed. by R.R. Yager, V. Sgurev, M. Hadjiski (IEEE Catalog Number CFP12802-PRT, 2012b), pp. 219–224. ISBN 978-1-4673-2782-4Google Scholar
  17. 17.
    V. Vapnik, Statistical Learning Theory (Wiley, New York, 1998)zbMATHGoogle Scholar
  18. 18.
    Z. Xu, An overview of methods determining OWA weights. Int. J. Intell. Syst. 20, 843–865 (2005)CrossRefzbMATHGoogle Scholar
  19. 19.
    R. Yager, On ordered weighted averaging aggregation operators in multicriteria decision making. IEEE Trans. Syst. Man Cybern. 18, 183–190 (1988)CrossRefMathSciNetzbMATHGoogle Scholar
  20. 20.
    R. Yager, Intelligent control of the hierarchical agglomerative clustering process. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 30(6), 835–845 (2000)CrossRefMathSciNetGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Department of Industrial EngineeringIzmir UniversityIzmirTurkey
  2. 2.Department of Computer ScienceDokuz Eylul UniversityIzmirTurkey
  3. 3.Institute of Cybernetics Azerbaijan National Academy of SciencesBaku]

Personalised recommendations