The “Nomenclature of Multidimensionality” in the Digital Libraries Evaluation Domain

  • Leonidas Papachristopoulos
  • Giannis Tsakonas
  • Michalis Sfakakis
  • Nikos Kleidis
  • Christos Papatheodorou
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9819)


Digital libraries evaluation is characterised as an interdisciplinary and multidisciplinary domain posing a set of challenges to the research communities that intend to utilise and assess criteria, methods and tools. The amount of scientific production, which is published on the field, hinders and disorientates the researchers who are interested in the domain. The researchers need guidance in order to exploit the considerable amount of data and the diversity of methods effectively as well as to identify new research goals and develop their plans for future works. This paper proposes a methodological pathway to investigate the core topics of the digital library evaluation domain, author communities, their relationships, as well as the researchers who significantly contribute to major topics. The proposed methodology exploits topic modelling algorithms and network analysis on a corpus consisting of the digital library evaluation papers presented in JCDL,ECDL/TDPL and ICADL conferences in the period 2001–2013.


Digital library evaluation Research communities Topic modelling Network analysis 


  1. 1.
    Borgman, C.L.: What are digital libraries? Competing Vis. Inf. Process. Manag. 35, 227–243 (1999)CrossRefGoogle Scholar
  2. 2.
    Saracevic, T.: Digital library evaluation: toward evolution of concepts. Libr. Trends. 49, 350–369 (2000)Google Scholar
  3. 3.
    Hoppe, B., Reinelt, C.: Social network analysis and the evaluation of leadership networks. Leadersh. Q. 21, 600–619 (2010)CrossRefGoogle Scholar
  4. 4.
    Sun, J., Xu, W., Ma, J., Sun, J.: Leverage RAF to find domain experts on research social network services: a big data analytics methodology with MapReduce framework. Int. J. Prod. Econ. 165, 185–193 (2015)CrossRefGoogle Scholar
  5. 5.
    Karimzadehgan, M., Zhai, C., Belford, G.: Multi-aspect expertise matching for review assignment. In: Proceeding of the 17th ACM Conference on Information and knowledge Mining - CIKM 2008, pp. 1113–1122. ACM, New York (2008)Google Scholar
  6. 6.
    Holland, G.A.: Information science: an interdisciplinary effort? J. Doc. 64, 7–23 (2008)CrossRefGoogle Scholar
  7. 7.
    Nguyen, S.H., Chowdhury, G.: Digital library research (1990–2010): a knowledge map of core topics and subtopics. In: Airong, J. (ed.) ICADL 2011. LNCS, vol. 7008, pp. 368–372. Springer, Heidelberg (2011)Google Scholar
  8. 8.
    Finlay, C.S., Sugimoto, C.R., Li, D., Russell, T.G.: LIS dissertation titles and abstracts (1930–2009): where have all the Librar* gone? Libr. Q. 82, 29–46 (2012)CrossRefGoogle Scholar
  9. 9.
    Bellotti, E.: Getting funded. multi-level network of physicists in Italy. Soc. Netw. 34, 215–229 (2012)CrossRefGoogle Scholar
  10. 10.
    Singh, V., Perdigones, A., Garcia, J.L., Cañas-Guerroro, I., Mazarrón, F.R.: Analyzing worldwide research in hardware architecture, 1997–2011. Commun. ACM 58, 76–85 (2014)CrossRefGoogle Scholar
  11. 11.
    Catala-López, F., Alonso-Arroyo, A., Aleixandre-Benavent, R., Ridao, M., Bolanos, M., García-Altes, A., Sanfelix-Gimeno, G., Peiro, S.: Coauthorship and institutional collaborations on cost-effectiveness analyses: a systematic network analysis. PLoS One 7, e38012 (2012)CrossRefGoogle Scholar
  12. 12.
    Yan, E., Ding, Y., Milojević, S., Sugimoto, C.R.: Topics in dynamic research communities: an exploratory study for the field of information retrieval. J. Informetr. 6, 140–153 (2012)CrossRefGoogle Scholar
  13. 13.
    Liu, X., Bollen, J., Nelson, M.L., de Sompel, H.: Co-authorship networks in the digital library research community. Inf. Process. Manag. 41, 1462–1480 (2005)CrossRefGoogle Scholar
  14. 14.
    Gollapalli, S. Das Mitra, P., Giles, C.L.: Ranking authors in digital libraries. In: 11th Annual International ACM/IEEE Joint Conference on Digital Libraries - JCDL 2011, pp. 251–254. ACM, New York (2011)Google Scholar
  15. 15.
    Papachristopoulos, L., Kleidis, N., Sfakakis, M., Tsakonas, G., Papatheodorou, C.: Discovering the topical evolution of the digital library evaluation community. In: Garoufallou, E., et al. (eds.) MTSR 2015. CCIS, vol. 544, pp. 101–112. Springer, Heidelberg (2015). doi:10.1007/978-3-319-24129-6_9 CrossRefGoogle Scholar
  16. 16.
    Afiontzi, E., Kazadeis, G., Papachristopoulos, L., Sfakakis, M., Tsakonas, G., Papatheodorou, C.: Charting the digital library evaluation domain with a semantically enhanced mining methodology. In: 13th Annual International ACM/IEEE Joint Conference on Digital Libraries - JCDL 2013, pp. 125–134. ACM, New York (2013)Google Scholar
  17. 17.
    Fox, C.: A stop list for general text. SIGIR Forum 24, 19–21 (1989)CrossRefGoogle Scholar
  18. 18.
    Mimno, D.: jsLDA: an implementation of latent Dirichlet allocation in javascript.
  19. 19.
    Church, K.W., Hanks, P.: Word association norms, mutual information, and lexicography. Comput. Linguist. 16, 22–29 (1990)Google Scholar
  20. 20.
    Freeman, L.C.: Centrality in social networks conceptual clarification. Soc. Netw. 1(3), 215–239 (1978)MathSciNetCrossRefGoogle Scholar
  21. 21.
    Mislove, A., Marcon, M., Gummadi, K.P., Druschel, P., Bhattacharjee, B.: Measurement and analysis of online social networks. In: Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement - IMC 2007, pp. 29–42. ACM (2007)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Leonidas Papachristopoulos
    • 1
    • 2
  • Giannis Tsakonas
    • 3
  • Michalis Sfakakis
    • 1
  • Nikos Kleidis
    • 4
  • Christos Papatheodorou
    • 1
    • 2
  1. 1.Department of Archives, Library Science and MuseologyIonian UniversityCorfuGreece
  2. 2.Digital Curation Unit, Institute for the Management of Information Systems‘Athena’ Research CentreAthensGreece
  3. 3.Library and Information Center University of PatrasPatrasGreece
  4. 4.Department of InformaticsAthens University of Economics and BusinessAthensGreece

Personalised recommendations