The Scholarly Impact of CLEF (2000–2009)

  • Theodora Tsikrika
  • Birger Larsen
  • Henning Müller
  • Stefan Endrullis
  • Erhard Rahm
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8138)

Abstract

This paper assesses the scholarly impact of the CLEF evaluation campaign by performing a bibliometric analysis of the citations of the CLEF 2000–2009 proceedings publications collected through Scopus and Google Scholar. Our analysis indicates a significant impact of CLEF, particularly for its well-established Adhoc, ImageCLEF, and QA labs, and for the lab/task overview publications that attract considerable interest. Moreover, initial analysis indicates that the scholarly impact of ImageCLEF is comparable to that of TRECVid.

Keywords

Seco 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bar-Ilan, J.: Which h-index? A comparison of WoS, Scopus and Google Scholar. Scientometrics 74(2), 257–271 (2008)CrossRefGoogle Scholar
  2. 2.
    Harzing, A.-W.: Citation analysis across disciplines: The impact of different data sources and citation metrics (2010), http://www.harzing.com/data_metrics_comparison.htm (retrieved)
  3. 3.
    Hirsch, J.E.: An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences (PNAS) 102(46), 16569–16572 (2005)CrossRefGoogle Scholar
  4. 4.
    Jacsó, P.: Deflated, inflated and phantom citation counts. Online Information Review 30(3), 297–309 (2006)CrossRefGoogle Scholar
  5. 5.
    Rahm, E., Thor, A.: Citation analysis of database publications. SIGMOD Record 34, 48–53 (2005)CrossRefGoogle Scholar
  6. 6.
    Seglen, P.O.: The skewness of science. JASIS 43(9), 628–638 (1992)CrossRefGoogle Scholar
  7. 7.
    Thornley, C.V., Johnson, A.C., Smeaton, A.F., Lee, H.: The scholarly impact of TRECVid (2003–2009). JASIST 62(4), 613–627 (2011)CrossRefGoogle Scholar
  8. 8.
    Tsikrika, T., Seco de Herrera, A.G., Müller, H.: Assessing the scholarly impact of ImageCLEF. In: Forner, P., Gonzalo, J., Kekäläinen, J., Lalmas, M., de Rijke, M. (eds.) CLEF 2011. LNCS, vol. 6941, pp. 95–106. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  9. 9.
    Voorhees, E.M.: The philosophy of information retrieval evaluation. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds.) CLEF 2001. LNCS, vol. 2406, pp. 355–370. Springer, Heidelberg (2002)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Theodora Tsikrika
    • 1
  • Birger Larsen
    • 1
  • Henning Müller
    • 2
  • Stefan Endrullis
    • 3
  • Erhard Rahm
    • 3
  1. 1.Royal School of Library & Information ScienceUniversity of CopenhagenDenmark
  2. 2.University of Applied Sciences Western Switzerland (HES–SO)SierreSwitzerland
  3. 3.University of LeipzigGermany

Personalised recommendations