Taking scholarly books into account, part II: a comparison of 19 European countries in evaluation and funding
In May 2016, an article published in Scientometrics, titled ‘Taking scholarly books into account: current developments in five European countries’, introduced a comparison of book evaluation schemes implemented within five European countries. The present article expands upon this work by including a broader and more heterogeneous set of countries (19 European countries in total) and adding new variables for comparison. Two complementary classification models were used to point out the commonalities and differences between each country’s evaluation scheme. First, we employed a double-axis classification to highlight the degree of ‘formalization’ for each scheme, second, we classified each country according to the presence or absence of a bibliographic database. Each country’s evaluation scheme possesses its own unique merits and details; however the result of this study was the identification of four main types of book evaluation systems, leading to the following main conclusions. First, countries may be differentiated on the basis of those that use a formalized evaluation system and those that do not. Also, countries that do use a formalized evaluation system either have a supra-institutional database, quality labels for publishers and/or publisher rankings in place to harmonize the evaluations. Countries that do not use a formalized system tend to rely less on quantitative evaluation procedures. Each evaluation type has its advantages and disadvantages; therefore an exchange between countries might help to generate future improvements.
KeywordsScholarly books Book publishers Evaluation processes Classification Research evaluation Social sciences Humanities Book series
The authors want to thank all ENRESSH participants in the survey for their valuable contribution to this work: Croatia: Jadranka Stojanovski, Czech Republic: Jiří Kolman and Petr Kolman, France: Ioana Galleron, Israel : Judit Bar-Ilan, Saul Smiliansky and Sharon Link Italy: Ginevra Peruginelli, Latvia: Arnis Kokorevics and Linda Sīle, Lithuania: Aldis Gedutis, Montenegro: Sanja Pekovic, Portugal: Luisa Carvalho and Ana Ramos, Serbia: Dragan Ivanovic, Slovakia: Alexandra Bitusikova, Slovenia: Andreja Istenic Starcic, and Switzerland: Sven Hug.
This article is based upon work from ENRESSH (European Network for Research Evaluation in the Social Sciences and Humanities, COST Action (CA15137)), supported by COST (European Cooperation in Science and Technology).
- Camiz, S., & Gomes, G. C. (2013). Joint correspondence analysis versus multiple correspondence analysis: A solution to an undetected problem. In Classification and data mining (pp. 11–18). Berlin: Springer.Google Scholar
- Geuna, A., & Martin, B. R. (2003). University research evaluation and funding: An international comparison. Minerva, 41(4), 277–304.Google Scholar
- Giménez-Toledo, E., Mañana-Rodríguez, J., Engels, T. C. E., Ingwersen, P., Sivertsen, G., Verleysen, F. T., et al. (2016). Taking scholarly books into account: Current developments in five European countries. Scientometrics, 107(2), 685–699. https://doi.org/10.1007/s11192-016-1886-5.CrossRefGoogle Scholar
- Giménez-Toledo, E., Sivertsen, G., & Mañana-Rodríguez, J. (2017). Peer review as a delineation criterion in data sources for the assessment and measurement of scholarly book publishing in social sciences and humanities. In 16th International conference on scientometrics and informetrics. Wuhan.Google Scholar
- Michavila, F. (ed.). (2012). La Universidad española en cifras. Madrid: CRUE. http://www.crue.org/Publicaciones/Documents/UEC/LA_UNIVERSIDAD_ESPANOLA_EN_CIFRAS.pdf. Accessed Sept 2017.
- Sello de calidad en edición académica (CEA/APQ). http://www.selloceaapq.es/. Accessed Apr 2018.
- Sīle, L., Guns, R., Sivertsen, G., & Engels, T. C. E. (2017). European databases and repositories for social sciences and humanities research output. Antwerp: ECOOM & ENRESSH. https://doi.org/10.6084/m9.figshare.5172322sivertsen.
- Sivertsen, G. (2018). Why has no other European country adopted the Research Excellence Framework? Available at the London School of Economics and Political Science blog. http://blogs.lse.ac.uk/politicsandpolicy/why-has-no-other-european-country-adopted-the-research-excellence-framework/.
- Wilsdon, J. et al. (2015). Metric Tide: Report of the independent review of the role of metrics in research assessment and management. https://doi.org/10.13140/rg.2.1.4929.1363.