Skip to main content
Log in

Career advancement and scientific performance in universities

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

Many governments have placed priority on excellence in higher education as part of their policy agendas. Processes for recruitment and career advancement in universities thus have a critical role. The efficiency of faculty selection processes can be evaluated by comparing the subsequent performance of competition winners against that of the losers and the pre-existing staff of equal academic rank. Our study presents an empirical analysis concerning the recruitment procedures for associate professors in the Italian university system. The results of a bibliometric analysis of the hard science areas reveal that new associate professors are on average more productive than the incumbents. However a number of crucial concerns emerge, in particular concerning occurrence of non-winner candidates that are more productive than the winners over the subsequent triennium, and cases of winners that are completely unproductive. Beyond the implications for the Italian case, the analysis offers considerations for all decision-makers regarding the ex post evaluation of the efficiency of the recruitment process and the desirability of providing selection committees with bibliometric indicators in support of evaluation (i.e. informed peer review).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. The comparative evaluation of teaching activity is generally more difficult, although we can assume a significant correlation between teaching and research, particularly since quality in teaching will in part follow from scientific merit.

  2. This law was intended to grant increased autonomy and responsibility to the universities to establish their own organizational frameworks, including charters and regulations. Subsequently, Law 537 (Article 5) of 1993 and Decree 168 of 1996 provided further changes intended to increase university involvement in overall decision-making on use of resources, and to encourage individual institutions to operate on the market and reach their own economic and financial equilibrium.

  3. Researchers that we define “unproductive” may actually publish in international journals not indexed by Web of Science, or codify the new knowledge produced in different forms, such as books, patents, etc.

  4. The committees could also indicate a single winner, however in reality this occurred very rarely.

  5. The complete list is accessible on http://attiministeriali.miur.it/UserFiles/115.htm, last accessed on March 4, 2013.

  6. A typical example is statisticians, who may apply their theory to medicine, physics, social sciences, etc.

  7. For details, see Abramo et al. 2013b.

  8. If first and last authors belong to the same university, 40 % of the contribution is assigned to each of them; the remaining 20 % is divided among all other authors. If the first two and last two authors belong to different universities, 30 % of the contribution is assigned to first and last authors; 15 % is attributed to second and last author but one; the remaining 10 % is divided among all others. The weighting values were assigned following advice from senior Italian professors in the life sciences. The values could be changed to suit different practices in other national contexts.

  9. http://cercauniversita.cineca.it, last accessed on March 4, 2013.

  10. Retrieved from: http://reclutamento.murst.it/, the open Web site managed by the MIUR, titled “Comparative evaluation in the recruitment of University Professors and Researchers (Law 3, 3 July 1998, no. 210)”.

  11. At the time of the current research, eleven competitions had not been completed.

  12. M-PSI/01: General Psychology; M-PSI/02: Psychobiology and Physiological Psychology; M-PSI/03: Psychometrics; M-EDF/01: Teaching Methods for Physical Activities; M-EDF/02: Teaching Methods for Sport; SECS-P/05: Econometrics; SECS-S/01: Statistics; SECS-S/06: Mathematics for Economics, Actuarial Studies and Finance.

  13. In this UDA WoS coverage is quite limited, which shows in a very high number of non-productive (in bibliometric terms) professors. In this UDA, our findings need to be interpreted with additional special caution.

  14. The number of candidates that actually arrived at the stage of committee evaluation was consistently less than the initial applicants, especially in SDSs where many universities launched competitions. .

  15. For our own evaluation, there must be at least one non-winner who held the role of assistant professor over the subsequent triennium, for at least one year.

References

  • Abramo, G., Cicero, T., & D’Angelo, C. A. (2011). Assessing the varying level of impact measurement accuracy as a function of the citation window length. Journal of Informetrics, 5(4), 659–667.

    Article  Google Scholar 

  • Abramo, G., Cicero, T., & D’Angelo, C. A. (2012a). The dispersion of research performance within and between universities as a potential indicator of the competitive intensity in higher education systems. Journal of Informetrics, 6(2), 155–168.

    Article  Google Scholar 

  • Abramo, G., Cicero, T., & D’Angelo, C. A. (2013a). The impact of non-productive and top scientists on overall university research performance. Journal of Informetrics, 7(1), 166–175.

    Article  Google Scholar 

  • Abramo, G., Cicero, T., & D’Angelo, C. A. (2013b). Individual research performance: a proposal for comparing apples to oranges. Journal of Informetrics, 7(2), 528–529.

    Article  Google Scholar 

  • Abramo, G., D’Angelo, C. A., & Di Costa, F. (2010a). Citations vs journal impact factor as proxy of quality: could the latter ever be preferable? Scientometrics, 84(3), 821–833.

    Article  Google Scholar 

  • Abramo, G., D’Angelo, C.A., & Rosati, F. (2012a). Relatives in the same university faculty: nepotism or merit? Working paper LabTTI, http://www.disp.uniroma2.it/laboratoriortt/TESTI/Working%20paper/Nepostism.pdf. Accessed 4 Mar 2013.

  • Abramo, G., D’Angelo, C. A., & Rosati, F. (2013c). The importance of accounting for the number of co-authors and their order when assessing research performance at the individual level in the life sciences. Journal of Informetrics, 7(1), 198–208.

    Article  Google Scholar 

  • Abramo, G., D’Angelo, C. A., & Solazzi, M. (2010b). National research assessment exercises: A measure of the distortion of performance rankings when labor input is treated as uniform. Scientometrics, 84(3), 605–619.

    Article  Google Scholar 

  • Allen, N. (1988). Aspects of promotion procedures in Australian universities. Higher Education, 17(3), 267–280.

    Article  Google Scholar 

  • Allesina, S. (2011). Measuring nepotism through shared last names: The case of Italian academia. PLoS One, 6(8), e21160.

    Article  Google Scholar 

  • Auranen, O., & Nieminen, M. (2010). University research funding and publication performance: An international comparison. Research Policy, 39(6), 822–834.

    Article  Google Scholar 

  • Aydogan, I. (2012). The existence of favoritism in organizations. African Journal of Business Management, 6(12), 4577–4586.

    Google Scholar 

  • Cora-Bramble, D. (2006). Minority faculty recruitment, retention and advancement: Applications of a resilience-based theoretical framework. Journal of Health Care for the Poor and Underserved, 17(2), 251–255.

    Article  Google Scholar 

  • D’Angelo, C. A., Giuffrida, C., & Abramo, G. (2011). A heuristic approach to author name disambiguation in large-scale bibliometric databases. Journal of the American Society for Information Science and Technology, 62(2), 257–269.

    Article  Google Scholar 

  • Dunn, T., & Holtz Eakin, D. (2000). Financial capital, human capital, and the transition to self-employment: Evidence from intergenerational links. NBER Working Paper No. 5622.

  • Durante, R., Labartino, G., & Perotti, R. (2011). Academic dynasties: Decentralization and familism in the Italian academia. NBER Working Paper No. 17572.

  • Durante, R., Labartino, G., Perotti, R., & Tabellini, G., (2009). Academic Dynasties. Bocconi University Working Paper.

  • Evans, C. (1995). Choosing people: Recruitment and selection as leverage on subjects and disciplines. Studies in Higher Education, 20(3), 253–265.

    Article  Google Scholar 

  • Fogelberg, P., Hearn, J., Husu, L., & Mankkinnen, T. (1999). Hard work in the academy: Research and interventions on gender inequalities in higher education. Helsinki: Yliopistopaino Helsinki University Press.

  • Husu, L. (2000). Gender discrimination in the promised land of gender equality. Higher Education in Europe, 25(2), 221–228.

    Article  Google Scholar 

  • Ledwith, S., & Manfredi, S. (2000). Balancing gender in higher education: A study of the experience of senior women in a `New’ UK university. European Journal of Women’s Studies, 7(1), 7–33.

    Article  Google Scholar 

  • Lentz, B. F., & Laband, D. N. (1989). Why so many winners of doctors become doctors: nepotism vs. human capital transfers. The Journal of Human Resources, 24(3), 396–413.

    Article  Google Scholar 

  • Martin, B. (2009). Academic patronage. International Journal for Educational Integrity, 5(1), 3–19.

    Google Scholar 

  • Moed H.F., (2005). Citation Analysis in Research Evaluation. Dordrecht: Springer, ISBN: 978-1-4020-3713-9.

  • Mohrman, K., Ma, W., & Baker, D. (2008). The Research university in transition: The emerging global model. Higher Education Policy, 21(1), 5–27.

    Article  Google Scholar 

  • Perotti, R. (2008). L’università truccata. Torino: Einaudi.

    Google Scholar 

  • Price, E. G., Gozu, A., Kern, D. E., Powe, N. R., Wand, G. S & Golden, S., et al. (2005). The role of cultural diversity climate in recruitment, promotion, and retention of faculty in academic medicine. Journal of General Internal Medicine, 20(7), 565–571.

    Article  Google Scholar 

  • Rees, T. (2004). Measuring excellence in scientific research: The UK research assessment exercise. In European Commission (Hrsg): Gender and Excellence in the Making. Report of the Conference “Minimising gender bias in the definition and measurement of scientific excellence” Florence, 23–24 October 2003.

  • Salmi, J. (2009). The challenge of establishing world-class universities. World Bank, Washington, DC. ISBN 978-0-8213-7876-2.

  • Simon, R. J., Clark, S. M., & Tifft, L. L. (1966). Of nepotism, marriage, and the pursuit of an academic career. Sociology of Education, 39(4), 344–358.

    Article  Google Scholar 

  • Stanley, J. M., Capers, C. F., & Berlin, L. E. (2007). Changing the face of nursing faculty: Minority faculty recruitment and retention. Journal of Professional Nursing, 23(5), 253–261.

    Article  Google Scholar 

  • Trotman, C. A., Bennett, E., Scheffler, N., & Tulloch, J. C. (2002). Faculty recruitment, retention, and success in dental academia. American Journal of Orthodontics and Dentofacial Orthopedics, 122(1), 2–8.

    Article  Google Scholar 

  • Van den Brink, M., Benschop, Y., & Jansen, W. (2010). Transparency in academic recruitment: A problematic tool for gender equality? Organization Studies, 31(11), 1459–1483.

    Article  Google Scholar 

  • Veugelers, R., & van der Ploeg, F. (2008). Reforming European universities: Scope for an evidence-based process. In M. Dewatripont & F. Thys-Clement (Eds.), Governance of European universities. Brussels: Editions de l’Université de Bruxelles.

    Google Scholar 

  • Zagaria, C. (2007). Processo all’università, Cronache dagli atenei italiani tra inefficienze e malcostume. Bari: Dedalo.

    Google Scholar 

  • Ziegler, B. (2001). Some remarks on gender equality in higher education in Switzerland. International Journal of Sociology and Social Policy, 21(1/2), 44–49.

    Article  Google Scholar 

  • Zinovyeva, N., Bagues, M. (2012). The role of connections in academic promotions. Business Economics Working Papers from Universidad Carlos III, Instituto sobre Desarrollo Empresarial “Carmen Vidal Ballester”. Available at SSRN 2136888, http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2136888. Accessed 4 Mar 2013.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Giovanni Abramo.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Abramo, G., D’Angelo, C.A. & Rosati, F. Career advancement and scientific performance in universities. Scientometrics 98, 891–907 (2014). https://doi.org/10.1007/s11192-013-1075-8

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-013-1075-8

Keywords

Navigation