Frontiers of Computer Science

, Volume 6, Issue 5, pp 568–580

The ClasSi coefficient for the evaluation of ranking quality in the presence of class similarities

  • Anca Maria Ivanescu
  • Marc Wichterich
  • Christian Beecks
  • Thomas Seidl
Research Article
  • 69 Downloads

Abstract

Evaluation measures play an important role in the design of new approaches, and often quality is measured by assessing the relevance of the obtained result set. While many evaluation measures based on precision/recall are based on a binary relevance model, ranking correlation coefficients are better suited for multi-class problems. State-of-the-art ranking correlation coefficients like Kendall’s τ and Spearman’s ρ do not allow the user to specify similarities between differing object classes and thus treat the transposition of objects from similar classes the same way as that of objects from dissimilar classes. We propose ClasSi, a new ranking correlation coefficient which deals with class label rankings and employs a class distance function to model the similarities between the classes. We also introduce a graphical representation of ClasSi which describes how the correlation evolves throughout the ranking.

Keywords

ranking quality measure class similarity ClasSi 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Higher Education Press and Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Anca Maria Ivanescu
    • 1
  • Marc Wichterich
    • 1
  • Christian Beecks
    • 1
  • Thomas Seidl
    • 1
  1. 1.Data Management and Data Exploration GroupRWTH Aachen UniversityAachenGermany

Personalised recommendations