Abstract
Peer review is still used as the main tool for research evaluation, but its costly and time-consuming nature triggers a debate about the necessity to use, alternatively or jointly with it, bibliometric indicators. In this contribution we introduce an approach based on generalised linear models that jointly uses former peer-review and bibliometric indicators to predict the outcome of UK’s Research Excellence Framework (REF) 2014. We use the outcomes of the Research Assessment Exercise (RAE) 2008 as peer-review indicators and the departmental h-indices for the period 2008–2014 as bibliometric indicators. The results show that a joint use of bibliometric and peer-review indicators can be an effective tool to predict the research evaluation made by REF.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
HEIs with missing values have been removed from the data set.
References
Abramowitz, M., Stegun, I.A.: Gamma and related functions (Chapter 6). In: Handbook of Mathematical Functions. Dover, New York (1972)
Bertocchi, G., Gambardella, A., Jappelli, T., Nappi, C.A., Peracchi, F.: Bibliometric evaluation vs. informed peer-review: evidence from Italy. Res. Policy 44(2), 451–466 (2011)
Bezdek, J.C., Ehrlich, R., Full, W.: FCM: the fuzzy c-means clustering algorithm. Comput. Geol. 10(2–3), 191–203 (1984)
Bornmann, L.: The hawthorne effect in journal peer review. Scientometrics 91, 857–862 (2012)
Bornmann, L., Leydesdorff, I.: Scientometrics in a changing research landscape. EMBO Rep. 15(12), 1228–1232 (2014)
De Bellis, N.: Bibliometrics and Citation Analysis: From the Science Citation Index to Cybermetrics. The Scarecrow Press, Lanham (2009)
Engels, T.C.E., Goos, P., Dexters, N., Spruyt, E.H.J.: Group size, h-index, and efficiency in publishing in top journals explain expert panel assessments of research group quality and productivity. Res. Eval. 22(4), 224–236 (2013)
Evidence: The future of the UK university research base. Technical report, a Thomson Reuters business, Universities UK (2010)
Lawrance, P.: The politics of publications. Nature 422, 259–261 (2003)
MacRoberts, M.H., MacRoberts, B.R.: Problems of citation analysis: a critical review. J. Am. Soc. Inf. Sci. 40(5), 342–349 (1989)
Mryglod, O., Kenna, R., Holovatch, Y., Berche, B.: Absolute and specific measures of research group excellence. Scientometrics 95(1), 115–127 (2013)
Mryglod, O., Kenna, R., Holovatch, Yu., Berche, B.: Predicting results of the research excellence framework using departmental h-index. Scientometrics 102(3), 2165–2180 (2015)
Mryglod, O., Kenna, R., Holovatch, Yu., Berche, B.: Predicting results of the research excellence framework using departmental h-index: revisited. Scientometrics 104(3), 1013–1017 (2015)
Nelder, J., Wedderburn, R.: Generalized linear models. J. R. Stat. Soc. Ser. A 135(3), 370–384 (1972)
Wouters, P., Thelwall, M., Kousha, K., Waltman, L., de Rijcke, S., Rushforth, A., Franssen, T.: The metric tide: literature review. Technical report, Higher Education Funding Council for England (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this chapter
Cite this chapter
Basso, A., di Tollo, G. (2017). A Generalised Linear Model Approach to Predict the Result of Research Evaluation. In: Corazza, M., Legros, F., Perna, C., Sibillo, M. (eds) Mathematical and Statistical Methods for Actuarial Sciences and Finance . Springer, Cham. https://doi.org/10.1007/978-3-319-50234-2_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-50234-2_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-50233-5
Online ISBN: 978-3-319-50234-2
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)