Skip to main content
Log in

Revisiting size effects in higher education research productivity

  • Published:
Higher Education Aims and scope Submit manuscript

Abstract

The potential occurrence of variable returns to size in research activity is a factor to be considered in choices about the size of research organizations and also in the planning of national research assessment exercises, so as to avoid favoring those organizations that would benefit from such occurrence. The aim of the current work is to improve on weaknesses in past inquiries concerning returns to size through application of a research productivity measurement methodology that is more accurate and robust. The method involves field-standardized measurements that are free of the typical distortions of aggregate measurement by discipline or organization. The analysis is conducted for 183 hard science fields in all 77 Italian universities (time period 2004–2008) and allows detection of potential differences by field.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. As an example of such style, Italy’s Triennial Research Evaluation exercise (2001–2003) subdivided research organizations into three groups based on size of their research staff (VTR 2006).

  2. Local regression (i.e. non-linear) method.

  3. Since MIUR financing composes 55.5% of the total, the share distributed on the basis of the VTR represents 3.9% of total income.

  4. The complete list is accessible on http://cercauniversita.cineca.it/php5/settori/index.php. Last accessed on July 20, 2011.

  5. http://cercauniversita.cineca.it/php5/docenti/cerca.php. Last accessed on July 20, 2011.

  6. www.orp.researchvalue.it. Last accessed on July 20, 2011.

  7. In the Italian academic system, the hard sciences are matched in nine UDAs: mathematics and computer sciences; physics; chemistry; earth sciences; biology; medicine; agricultural and veterinary sciences; civil engineering; industrial and information engineering.

  8. Observed as of June 30, 2009.

  9. Standardizing citations to the median value rather than to the average, as frequently observed in literature, is justified by the fact that distribution of citations is highly skewed (Lundberg 2007).

  10. The average number of publications per year by a physicist is 2.3 times what a mathematician produces.

  11. Although members of the same SDS may publish in different WoS subject categories their publication rate is not greatly affected by this. Differences in SS continue to reflect differences in productivity.

  12. Because in the life sciences, the different position in the authors’ list of publications reflects the different contribution of the authors to the work, the following algorithm has been proposed by Italian scientists in the life sciences. It can be adapted to reflect different national contexts. If first and last authors belong to the same university, 40% of citations are attributed to each of them; the remaining 20% are divided among all other authors. If the first two and last two authors belong to different universities, 30% of citations are attributed to first and last authors; 15% of citations are attributed to second and last author but one; the remaining 10% are divided among all others. This algorithm has been proposed by Italian scientists in the life sciences. It can be adapted to reflect different national contexts.

  13. With individual top scientists defined as those positioning above 80th percentile of national performance, a value of “top scientists” greater than 20% at a university indicates that their percentage in the staff is higher than the national average.

  14. Kendall’s τb assumes values between −1 (perfect inversion) and +1 (perfect concordance), with a value of 0 in cases of absence of association.

  15. DEA methodology seems particularly suited to comparing efficiency of research institutions, especially with the increasing availability of quantitative indicators for input and output. Abramo et al. (2011b) is an example of a field-standardized application to national assessment.

References

  • Abbott, M., & Doucouliagos, C. (2003). The efficiency of Australian universities: A data envelopment analysis. Economics of Education Review, 22, 89–97.

    Article  Google Scholar 

  • Abramo, G., Cicero, T., & D’Angelo, C. A. (2011a). The dangers of performance-based research funding in non-competitive higher education systems. Scientometrics (forthcoming). doi:10.1007/s11192-011-0355-4.

  • Abramo, G., Cicero, T., & D’Angelo, C. A. (2011b). A field-standardized application of DEA to national-scale research assessment. Journal of Informetrics (forthcoming). doi:10.1016/j.joi.2011.06.001.

  • Abramo, G., D’Angelo, C. A., & Caprasecca, A. (2009). Allocative efficiency in public research funding: Can bibliometrics help? Research Policy, 38(1), 206–215.

    Article  Google Scholar 

  • Abramo, G., D’Angelo, C. A., & Di Costa, F. (2008). Assessment of sectoral aggregation distortion in research productivity measurements. Research Evaluation, 17(2), 111–121.

    Article  Google Scholar 

  • Adams, J., Black, G., Clemmons, R., & Stephan, P. (2005). Scientific teams and institutional collaborations: Evidence from U.S. universities, 1981–1999. Research Policy, 34(3), 259–286.

    Article  Google Scholar 

  • Adams, J. D., & Griliches, Z. (1998). Research productivity in a system of universities. Annales d’economie et de statistique, 49/50.

  • Avrikan, N. K. (2001). Investigating technical and scale efficiencies of Australian Universities through data envelopment analysis. Socio-Economic Planning Sciences, 35, 57–80.

    Article  Google Scholar 

  • Bonaccorsi, A., & Daraio, C. (2005). Exploring size and agglomeration effects on public research productivity. Scientometrics, 63(1), 87–120.

    Article  Google Scholar 

  • Cohn, E., Rhine, S. L. W., & Santos, M. C. (1989). Institutions of higher education as multi-product firms: Economies of scale and scope. The Review of Economics and Statistics, 71(2), 284–290.

    Article  Google Scholar 

  • D’Angelo, C. A., Giuffrida, C., & Abramo, G. (2010). A heuristic approach to author name disambiguation in large-scale bibliometric databases. Journal of the American Society for Information Science and Technology, 62(2), 257–269.

    Article  Google Scholar 

  • Dundar, H., & Lewis, D. R. (1995). Departmental productivity in American Universities: Economies of scale and scope. Economics of Education Review, 14(2), 119–144.

    Article  Google Scholar 

  • Dutch-Brown, N., Parellada-Sabata, M., & Polo-Otero, J. (2010). Economies of scale and scope of university research and technology transfer: a flexible multi-product approach. Document de treball de Barcelona Institute of Economics, 2010/51.

  • Glänzel, W. (2008). Seven myths in bibliometrics. About facts and fiction in quantitative science studies. In H. Kretschmer & F. Havemann (eds) Proceedings of WIS fourth international conference on webometrics, informetrics and scientometrics & ninth COLLNET meeting, Berlin, Germany.

  • Golden, J., & Carstensen, F. V. (1992). Academic research productivity, department size and organization: Further results, comment. Economics of Education Review, 11(2), 169–171.

    Article  Google Scholar 

  • Hara, N., Solomon, P., Kim, S. L., & Sonnenwald, D. H. (2003). An emerging view of scientific collaboration: Scientists’ perspectives on collaboration and factors that impact collaboration. Journal of the American Society for Information Science and Technology, 54(10), 952–965.

    Article  Google Scholar 

  • Hashimoto, K., & Cohn, E. (1997). Economies of scale and scope in Japanese private universities. Education Economics, 5, 107–115.

    Article  Google Scholar 

  • Izadi, H., Johnes, G., Oskrochi, R., & Crouchley, R. (2002). Stochastic frontier estimation of a CES cost function: The case of higher education in Britain. Economics of Education Review, 21, 63–71.

    Article  Google Scholar 

  • Jordan, J., Meador, M., & Walters, S. J. K. (1988). Effects of department size and organization on the research productivity of academic economists. Economics of Education Review, 7(2), 251–255.

    Article  Google Scholar 

  • Jordan, J., Meador, M., & Walters, S. J. K. (1989). Academic research productivity, department size and organization: Further results. Economics of Education Review, 8(4), 345–352.

    Article  Google Scholar 

  • Koshal, R. K., & Koshal, M. (1999). Economies of scale and scope in higher education: A case of comprehensive universities. Economics of Education Review, 18, 269–277.

    Article  Google Scholar 

  • Laband, D. N., & Lentz, B. F. (2003). New estimates of economies of scale and scope in higher education. Southern Economic Journal, 70, 172–183.

    Article  Google Scholar 

  • Lewis, D., & Dundar, H. (1999). Cost productivity in higher education: Theory, evidence, and policy implications. In J. Smarth (Eds.), Higher education: Handbook of theory and research. Agathon Press, NY. ISBN: 0-87586-125-3.

  • Longlong, H., Fengliang, L., & Weifang, M. (2009). Multi-product total cost functions for higher education: The case of Chinese research universities. Economics of Education Review, 28, 505–511.

    Article  Google Scholar 

  • Lundberg, J. (2007). Lifting the crown-citation z-score. Journal of Informetrics, 1(2), 145–154.

    Article  Google Scholar 

  • Moed, H. F. (2005). Citation analysis in research evaluation. Dordrecht, The Netherlands: Springer.

    Google Scholar 

  • Moed, H. F., Glänzel, W., & Schmoch, U. (2004). Handbook of quantitative science and technology research: The use of publication and patent statistics in studies of S & T systems. Berlin: Springer.

    Google Scholar 

  • Newell, A., & Sproull, R. F. (1982). Computer networks: Prospects for scientists. Science, 215(4534), 843–852.

    Article  Google Scholar 

  • Seglen, P. O., & Asknes, D. G. (2000). Scientific productivity and group size: A bibliometric analysis of Norwegian microbiological research. Scientometrics, 49(1), 123–143.

    Article  Google Scholar 

  • VTR. (2006). Italian triennial research evaluation. VTR 20012003. Risultati delle valutazioni dei Panel di Area. http://vtr2006.cineca.it/index_EN.html. Last accessed 20 July 2011.

  • Wagner, C. S., & Leydesdorff, L. (2005). Network structure, self-organization and the growth of international collaboration in science. Research Policy, 34(10), 1608–1618.

    Article  Google Scholar 

  • Williams, D. A. (1976). Improved likelihood ratio tests for complete contingency tables. Biometrika, 63(1), 33–37.

    Article  Google Scholar 

  • Worthington, A. C., & Higgs, H. (2011). Economies of scale and scope in Australian higher education. Higher Education, 61(4), 387–414. doi:10.1007/s10734-010-9337-3.

    Article  Google Scholar 

  • Zitt, M., & Bassecoulard, E. (2004). S&T networks and bibliometrics: The case of international scientific collaboration. 4th Proximity congress: Proximity, networks and co-ordination, Marseille, France, June 17–18, 2004, p 15.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Giovanni Abramo.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Abramo, G., Cicero, T. & D’Angelo, C.A. Revisiting size effects in higher education research productivity. High Educ 63, 701–717 (2012). https://doi.org/10.1007/s10734-011-9471-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10734-011-9471-6

Keywords

Navigation