This paper analyzes the impact of several influencing factors on scientific production of researchers. Time related statistical models for the period of 1996 to 2010 are estimated to assess the impact of research funding and other determinant factors on the quantity and quality of the scientific output of individual funded researchers in Canadian natural sciences and engineering. Results confirm a positive impact of funding on the quantity and quality of the publications. In addition, the existence of the Matthew effect is partially confirmed such that the rich get richer. Although a positive relation between the career age and the rate of publications is observed, it is found that the career age negatively affects the quality of works. Moreover, the results suggest that young researchers who work in large teams are more likely to produce high quality publications. We also found that even though academic researchers produce higher quantity of papers it is the researchers with industrial affiliation whose work is of higher quality. Finally, we observed that strategic, targeted and high priority funding programs lead to higher quantity and quality of publications.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
For more information about NSERC see http://www.nserc-crsng.gc.ca/index_eng.asp.
For more information, see the review by Ebadi and Schiffauerova (2013).
They found no impact of private funding but positive impact of public funding.
Scopus is a commercial database of scientific articles that has been launched by Elsevier in 2004. It is now one of the main competitors of Thomson Reuter‘s Web of Science.
According to NSERC policies and regulations, researchers are required to acknowledge the source of funding in their publications. We held more than 30 interviews with randomly selected funded researchers and almost all of them approved such assumption and confirmed that they do acknowledge NSERC in their papers.
Machine learning technique for topic modeling, first introduced by Blei et al. (2003).
For more information see: http://www.stata.com/stata12/.
The NSERC database originally contains both scholarships and grants.
The rich get richer.
NSERC discovery grants program mainly supports the long term research projects. For more information, see: http://www.nserc-crsng.gc.ca/Professors-Professeurs/Grants-Subs/DGIGP-PSIGP_eng.asp.
As an example of the students’ contribution, please refer to Larivière (2012) who particularly studied the research activities of the Ph.D. students and their contribution to the advancement of knowledge.
We call Researcher in this paper anybody who is funded by NSERC while Professional Researchers are only the ones that are not counted as students.
Measured by the date of his first publication that is available on SCOPUS.
They only found a positive impact in the United States.
Adams, J. D., Black, G. C., Clemmons, J. R., & Stephan, P. E. (2005). Scientific teams and institutional collaborations: Evidence from US universities, 1981–1999. Research Policy, 34(3), 259–285.
Adler, R., Ewing, J., & Taylor, P. (2009). Citation statistics. Statistical Science, 24(1), 1.
Arora, A., & Gambardella, A. (1998). The impact of NSF support for basic research in economics. Economics Working Paper Archive at WUSTL.
Beaudry, C., & Allaoui, S. (2012). Impact of public and private research funding on scientific production: The case of nanotechnology. Research Policy, 41(9), 1589–1606.
Beaudry, C., & Clerk-Lamalice, M. (2010). Grants, contracts and networks: What influences biotechnology scientific production? (pp. 16–18). London: Danish Research Unit for Industrial Dynamics (DRUID) Conference.
Beaver, D. D. (2001). Reflections on scientific collaboration (and its study): Past, present, and future. Scientometrics, 52(3), 365–377.
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent dirichlet allocation. The Journal of Machine Learning Research, 3, 993–1022.
Boyack, K. W., & Börner, K. (2003). Indicator-assisted evaluation and funding of research: Visualizing the influence of grants on the number and citation counts of research papers. Journal of the American Society for Information Science and Technology, 54(5), 447–461.
Campbell, D., & Bertrand, F. (2009). Bibliometrics as a performance measurement tool for the evaluation of research: The case of Canadian forest service. Science-Metrix, 2009 Annual CES Conference.
Campbell, D., Picard-Aitken, M., Côté, G., Caruso, J., Valentim, R., Edmonds, S., & Bastien, N. (2010). Bibliometrics as a performance measurement tool for research evaluation: The case of research funded by the national cancer institute of Canada. American Journal of Evaluation, 31(1), 66–83.
Carayol, N., & Matt, M. (2006). Individual and collective determinants of academic scientists’ productivity. Information Economics and Policy, 18(1), 55–72.
Centra, J. A. (1983). Research productivity and teaching effectiveness. Research in Higher Education, 18(4), 379–389.
Cole, S. (1979). Age and scientific performance. American Journal of Sociology, 84, 958–977.
Coleman, J. S., & Lazarsfeld, P. F. (1981). Longitudinal data analysis. New York: Basic Books.
Crespi, G. A., & Geuna, A. (2008). An empirical study of scientific production: A cross country analysis, 1981–2002. Research Policy, 37(4), 565–579.
De Solla Price, D. J., & Beaver, D. (1966). Collaboration in an invisible college. American Psychologist, 21(11), 1011.
Ebadi, A., & Schiffauerova, A. (2013). Impact of funding on scientific output and collaboration: A survey of literature. Journal of Information and Knowledge Management, 12(04), 1350037.
Ebadi, A., & Schiffauerova, A. (2015a). On the relation between the small world structure and scientific activities. PLoS ONE, 10(3), e0121129.
Ebadi, A., & Schiffauerova, A. (2015b). How to receive more funding for your research? get connected to the right people! Accepted in PLoS ONE.
Ebadi, A., & Schiffauerova, A. (2015c). How to become an important player in scientific collaboration networks? Journal of Informetrics, 9(4), 809–825.
Falagas, M. E., Kouranos, V. D., Arencibia-Jorge, R., & Karageorgopoulos, D. E. (2008). Comparison of SCImago journal rank indicator with journal impact factor. The FASEB Journal, 22(8), 2623–2628.
Gingras, Y. (1996). Bibliometric analysis of funded research. A feasibility study.
Godin, B. (2003). The impact of research grants on the productivity and quality of scientific research. No. 2003. INRS Working Paper.
Gulbrandsen, M., & Smeby, J. (2005). Industry funding and university professors’ research performance. Research Policy, 34(6), 932–950.
Hausman, J. A., Hall, B. H., & Griliches, Z. (1984). Econometric models for count data with an application to the patents-R&D relationship. Econometrica, 52(4), 909–938.
Heinze, T., & Kuhlmann, S. (2008). Across institutional boundaries? Research collaboration in German public sector nanoscience. Research Policy, 37(5), 888–899.
Huffman, W. E., & Evenson, R. E. (2005). New econometric evidence on agricultural total factor productivity determinants: Impact of funding composition. Iowa State University, Department of Economics, Working Paper, 3029.
Jacob, B., & Lefgren, L. (2007). The impact of research grant funding on scientific productivity.
Jacob, B. A., & Lefgren, L. (2011). The impact of research grant funding on scientific productivity. Journal of Public Economics, 95(9), 1168–1177.
Katz, J. S., & Martin, B. R. (1997). What is research collaboration? Research Policy, 26(1), 1–18.
King, J. (1987). A review of bibliometric and other science indicators and their role in research evaluation. Journal of Information Science, 13(5), 261–276.
Kyvik, S., & Olsen, T. B. (2008). Does the aging of tenured academic staff affect the research performance of universities? Scientometrics, 76(3), 439–455.
Larivière, V. (2012). On the shoulders of students? The contribution of PhD students to the advancement of knowledge. Scientometrics, 90(2), 463–481.
Latour, B., & Woolgar, S. (1979). Laboratory life: The social construction of scientific facts. Princeton: Princeton University Press.
Lawani, S. M. (1986). Some bibliometric correlates of quality in scientific research. Scientometrics, 9(1–2), 13–25.
Lee, S., & Bozeman, B. (2005). The impact of research collaboration on scientific productivity. Social Studies of Science, 35(5), 673–702.
Lehman, H. C. (1953). Age and achievement.
Lewison, G., & Dawson, G. (1998). The effect of funding on the outputs of biomedical research. Scientometrics, 41(1), 17–27.
Leydesdorff, L., & Wagner, C. (2009). Macro-level indicators of the relations between research funding and research output. Journal of Informetrics, 3(4), 353–362.
Martín-Sempere, M. J., Rey-Rocha, J., & Garzón-García, B. (2002). The effect of team consolidation on research collaboration and performance of scientists. Case study of Spanish university researchers in geology. Scientometrics, 55(3), 377–394.
McAllister, P. R., & Narin, F. (1983). Characterization of the research papers of US medical schools. Journal of the American Society for Information Science, 34(2), 123–131.
Melin, G. (2000). Pragmatism and self-organization: Research collaboration on the individual level. Research Policy, 29(1), 31–40.
Merton, R. K. (1968). The Matthew effect in science. Science, 159(3810), 56–63.
Merton, R. K. (1973). The sociology of science: Theoretical and empirical investigations. Chicago: University of Chicago press.
Moed, H. F. (2006). Citation analysis in research evaluation. Dordrecht: Springer.
Niosi, J. (2000). Canada’s national system of innovation. Montreal: McGill-Queen’s Press-MQUP.
NSERC. (2013). Report on plans and priorities, 2013–2014. Retrieved from http://www.nserc-crsng.gc.ca/NSERC-CRSNG/Reports-Rapports/RPP-PPR/2013-2014/index_eng.asp.
Okubo, Y. (1997). Bibliometric indicators and analysis of research systems: Methods and examples. No. 1997/1. Paris: OECD Publishing.
Payne, A. A., & Siow, A. (2003). Does federal research funding increase university research output? Advances in Economic Analysis and Policy, 3(1), 1–24.
Peritz, B. C. (1990). The citation impact of funded and unfunded research in economics. Scientometrics, 19(3–4), 199–206.
Plume, A., & van Wiejen, D. (2014). Publish or perish? The rise of the fractional author. Trends Journal of Sciences Research.
Salter, A. J., & Martin, B. R. (2001). The economic benefits of publicly funded basic research: A critical review. Research Policy, 30(3), 509–532.
Sandström, U. (2009). Research quality and diversity of funding: A model for relating research money to output of research. Scientometrics, 79(2), 341–349.
Schilling, M. A., & Phelps, C. C. (2007). Interfirm collaboration networks: The impact of large-scale network structure on firm innovation. Management Science, 53(7), 1113–1126.
Shapira, P., & Wang, J. (2010). Follow the money. Nature, 468(7324), 627–628.
Tahmooresnejad, L., Beaudry, C., & Schiffauerova, A. (2015). The role of public funding in nanotechnology scientific production: Where Canada stands in comparison to the United States. Scientometrics, 102, 753–787.
Thorsteinsdóttir, O. H. (2000). External research collaboration in two small science systems. Scientometrics, 49(1), 145–160.
Wray, K. B. (2003). Is science really a young man’s game? Social Studies of Science, 33(1), 137–149.
Wray, K. B. (2004). An examination of the contributions of young scientists in new fields. Scientometrics, 61(1), 117–128.
Zucker, L. G., Darby, M. R., Furner, J., Liu, R. C., & Ma, H. (2007). Minerva unbound: Knowledge stocks, knowledge flows and new knowledge production. Research Policy, 36(6), 850–863.
About this article
Cite this article
Ebadi, A., Schiffauerova, A. How to boost scientific production? A statistical analysis of research funding and other influencing factors. Scientometrics 106, 1093–1116 (2016). https://doi.org/10.1007/s11192-015-1825-x
- Statistical analysis
- Research output