A flexible approach for measuring author-level publishing performance
- 114 Downloads
We propose a framework to evaluate, in relative terms, author-level publishing performance. To that end we introduce the publishing performance index (PPI) and the publishing performance box (PPB), and discuss the associated publishing profiles. We illustrate our approach conducting an extensive empirical application covering 472 top economists and developing several robustness tests. Instead of using a pre-designed measure without flexibility to adjust to the circumstances of each specific case, our approach accommodates alternative evaluation criteria, as defined by the evaluators. Beyond this key characteristic, our approach has some other important advantages: (1) it is easy to apply; (2) it is sensitive to the full list of publications and citations; (3) it is able to include additional dimensions of scientific performance beyond papers and citations; (4) it is a high granularity measure, providing a complete ranking of the authors under analysis.
KeywordsResearch evaluation Scientific outputs Bibliometrics Selection criteria Evaluators
JEL ClassificationA11 A14 I23 M51
This work was supported by the Fundação para a Ciência e a Tecnologia under Grant UID/GES/00,315/2019. We are grateful to the two anonymous referees for their very useful comments. The usual disclaimer applies.
- Bornmann, Lutz, & Marx, Werner. (2011). The h index as a research performance indicator. European Science Editing, 37, 77–80.Google Scholar
- Bornmann, Lutz, Mutz, Rüdiger, & Daniel, Hans-Dieter. (2008). Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine. Journal of the American Society for Information Science and Technology, 59, 830–837.CrossRefGoogle Scholar
- Bornmann, Lutz, Thor, Andreas, Marx, Werner, & Schier, Hermann. (2016). The application of bibliometrics to research evaluation in the humanities and social sciences: An exploratory study using normalized google scholar data for the publications of a research institute. Journal of the Association for Information Science and Technology, 67, 2778–2789.CrossRefGoogle Scholar
- Hausken, Kjell. (2016). The ranking of researchers by publications and citations. Journal of Economics Bibliography, 3, 530–558.Google Scholar
- Mazurek, Jirí. (2018). A modification to Hirsch index allowing comparisons across different scientific fields. Current Science, 114, 2238–2239.Google Scholar
- Wouters, P., Thelwall, M., Kousha, K., Waltman, L, de Rijcke, S., Rushforth, A., & Franssen, T. (2015). The metric tide: Literature review (supplementary Report I to the independent review of the role of metrics in research assessment and management) Bristol: HEFCE.Google Scholar
- Wu, Qiang. (2010). The w-index: A measure to assess scientific impact by focusing on widely cited papers. Journal of the American Society for Information Science and Technology, 61, 609–614.Google Scholar