Skip to main content

Advertisement

SpringerLink
Log in

Comparing the efficiency of countries to assimilate and apply research investment

  • Published:
Quality & Quantity Aims and scope Submit manuscript

Abstract

One of the main purposes of the countries’ economic expenditure in research is to achieve higher levels of scientific results which could impact in better living standards for society. Besides, research efficiency could be considered as a way of getting the largest number of scientific results with the minimum amount of financial investment. To assess the repercussion of research investment in scientific production and measure scientific efficiency we selected a sample of 19 countries representing each region of the world. We used 17 years of social and economic indicators from the UNESCO database, and scientific data from Scopus and SciVal. We introduce two new notions of economic efficiency for national research systems: one based on the capability for assimilating R&D investment, and another based on overall productivity and impact. Through a causal model based on multiple linear regression on panel data, we model assimilation efficiency and confirm that the scientific production of a country can be explained in 98% through the GERD expressed as a percentage of GDP, and the number of Academic and Research Institutions that concentrate at least 50% of the national scientific production. And to measure countries efficiency on productivity and impact we introduce four indicators that quantify the relation between economic inputs and scientific outputs (dollars per paper (DPP), dollars per citation (DPC), citations received per 1,000 dollars invested (CIREDI) and papers produced per 1,000 dollars invested (PAPPDI)).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig.2
Fig.3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Adams, J.D., Black, G.C., Clemmons, J.R., Stephan, P.E.: Scientific teams and institutional collaborations: evidence from US universities, 1981–1999. Res. Policy 34(3), 259–285 (2005)

    Google Scholar 

  • Aksnes, D.: Characteristics of highly cited papers. Res. Eval. 12, 159–170 (2003)

    Google Scholar 

  • Aksnes, D.W., Sivertsen, G., van Leeuwen, T.N., Wendt, K.K.: Measuring the productivity of national R&D systems: challenges in cross-national comparisons of R&D input and publication output indicators. Sci. Pub. Policy 44, 246–258 (2017)

    Google Scholar 

  • Aman, V.: How collaboration impacts citation flows within the German science system. Scientometrics 109(3), 2195–2216 (2016)

    Google Scholar 

  • Amsterdamska, O., Leyderdorff, L.: Citations: indicators of significance? Scientometrics 15(5–6), 444–471 (1989)

    Google Scholar 

  • Arvantis, R., Russel, J.M., Rosas, A.M.A.: Experiences with the national citation reports database for measuring national performance: the case of Mexico. Scientometrics 35, 247–255 (1996)

    Google Scholar 

  • Barjak, F.: Research productivity in the internet era. Scientometrics 68, 343–360 (2006)

    Google Scholar 

  • Biljecki, F.: A scientometric analysis of selected GIScience journals. Int. J. Geogr. Inf. Sci. 30(7), 1302–1335 (2016)

    Google Scholar 

  • Bordons, M., Zulueta, M.A.: Evaluation of scientific activity through bibliometric indicators. Rev. Esp. Cardiol. 52(10), 789–800 (1999)

    Google Scholar 

  • Bornmann, L., Daniel, H.: What do citation counts measure? A review of studies on citing behavior. J. Doc. 64(1), 45–80 (2008)

    Google Scholar 

  • Bornmann, L., Stefaner, M., Moya Anegón, F., Mutz, R.: What is the effect of country-specific characteristics on the research performance of scientific institutions? using multi-level statistical models to rank and map universities and research-focused institutions worldwide. J. Inf. 8(3), 581–593 (2014)

    Google Scholar 

  • Bozeman, B., Corley, E.: Scientists’ collaboration strategies: implications for scientific and technical human capital. Res. Policy 33(4), 599–616 (2004a)

    Google Scholar 

  • Bozeman, B., Corley, E.: Scientists’ collaboration strategies: implications for scientific and technical human capital. Res. Policy 33(4), 599–616 (2004b)

    Google Scholar 

  • Buela-Casal, G.: Evaluación de la calidad de los artículos y de las revistas científicas: propuesta del factor de impacto ponderado y de un índice de calidad. Psicothema 15(1), 23–35 (2003)

    Google Scholar 

  • Camacho-Minano, M., Nunez-Nickel, M.: The multilayered nature of reference selection. J. Am. Soc. Inform. Sci. Technol. 60(4), 754–777 (2009)

    Google Scholar 

  • Castellacci, F., Natera, J.M.: The dynamics of national innovation systems: a panel cointegration analysis of the coevolution between innovative capability and absorptive capacity. Res. Policy 42(3), 579–594 (2013)

    Google Scholar 

  • Castillo-Pérez, J.J., Muñoz-Valera, L., García-Gómez, F., Mejía-Aranguré, J.M.: Análisis bibliométrico de la producción científica sobre la influenza en México, 2000–2012. Rev. Médica del Instituto Mexicano del Seguro Soc. 53(3), 294–301 (2015)

    Google Scholar 

  • Chamberlain, G.: Multivariate regression models for panel data. J Econom 18(1), 5–46 (1982)

    Google Scholar 

  • Chen, X., Xie, E., & Van Essen, M. (2019). Performance feedback and firms' R&D frequency: a comparison between state-owned and private-owned enterprises in China. Asian Business & Management, 1–38

  • Chinchilla, Z., Vargas, B., Hassan, Y., González, A., Moya, F.: New approach to the visualization of international scientific collaboration. Inf. Vis. 9(4), 277–287 (2010)

    Google Scholar 

  • Colledge, L. (2014). Snowball metrics recipe book. Accessed 14.12.17. https://www.snowballmetrics.com/wp-content/uploads/snowball-recipe-book_HR.pdf

  • Conacyt (2016). National general report of science, technology and innovation. Retrieved from https://www.siicyt.gob.mx/index.php/transparencia/informes-conacyt/informe-general-del-estado-de-la-ciencia-tecnologia-e-innovacion/informe-general-2016

  • Costa, M.R., Qin, J., Bratt, S.: Emergence of collaboration networks around large scale data repositories: a study of the genomics community using GenBank. Scientometrics 108(1), 21–40 (2016)

    Google Scholar 

  • Crespi, G.A., Geuna, A.: An empirical study of scientific production: a cross country analysis, 1981–2002. Res. Policy 37(4), 565–579 (2008)

    Google Scholar 

  • Daraio, C., Fabbri, F., Gavazzi, G., Izzo, M. G., Leuzzi, L., Quaglia, G., & Ruocco, G. (2017). Assessing the interdependencies between scientific disciplinary profiles at the country level: a pseudo-likelihood approach. Paper presented at the ISSI 2017–16th International Conference on Scientometrics and Informetrics, Conference Proceedings, 1448–1459

  • Dorta-Contreras, A., Arencibia-Jorge, R., Marti- Lahera, Y., Araujo- Ruiz, J.: Citation-based indicators for the characterization of cuban neurosciences. Acimed. 16(6), 1–21 (2008)

    Google Scholar 

  • Duclos, A., Herquelot, E., Polazzi, S., Malbezin, M., Claris, O.: Performance curves of medical researchers during their career: analysis of scientific production from a retrospective cohort. BMJ Op (2017). https://doi.org/10.1136/bmjopen-2016-013572

    Article  Google Scholar 

  • Ebadi, A., Schiffauerova, A.: How to boost scientific production? a statistical analysis of research funding and other influencing factors. Scientometrics 106(3), 1093–1116 (2016)

    Google Scholar 

  • Ebadi, A., Schiffauerova, A.: How to become an important player in scientific collaboration networks? J. Inf. 9(4), 809–825 (2015)

    Google Scholar 

  • Ebadi, A., Schiffauerova, A.: Impact of funding on scientific output and collaboration: a survey of literature. J. Inf. Knowl. Manage. 12(4), 1–16 (2013)

    Google Scholar 

  • Franco-Paredes, K., de Díaz-Reséndiz, F., Pineda-Lozano, & Hidalgo Rasmussen, J.J.E.C.A.: Bibliometric analysis of scientific production of Mexican journal of eating disorders, 2010–2014. Revista Mexicana de Trastornos Alimentarios 7(1), 9–16 (2016)

    Google Scholar 

  • Frixione, E., Ruiz, Z.L., Hernández, G.: Assessing individual intellectual output in scientific research: mexico’s national system for evaluating scholars performance in the humanities and the behavioral sciences. PLoSONE 11(5), e0155732 (2016)

    Google Scholar 

  • Gantman, E.R.: Economic, linguistic and political factors in the scientific productivity of countries. Scientometrics 93(3), 967–985 (2012)

    Google Scholar 

  • Gazni, A., Thelwall, M.: The citation impact of collaboration between top institutions: a temporal analysis. Res. Eval. 25(2), 219–229 (2016)

    Google Scholar 

  • Gul, S., Nisa, N.T., Shah, T.A., Gupta, S., Jan, A., Ahmad, S.: Middle East: research productivity and performance across nations. Scientometrics 105(2), 1157–1166 (2015)

    Google Scholar 

  • Gulbrandsen, M., Smeby, J.: Industry funding and university professors’ research performance. Res. Policy 34(6), 932–950 (2005)

    Google Scholar 

  • Hayati, Z., Ebrahimy, S.: Correlation between quality and quantity in scientific production: a case study of iranian organizations from 1997 to 2006. Scientometrics 80(3), 625–636 (2009)

    Google Scholar 

  • Heinze, T., Shapira, P., Rogers, J.D., Senker, J.M.: Organizational and Institutional Influences on creativity in scientific research. Res. Policy 38(4), 610–623 (2009)

    Google Scholar 

  • Hernandez-Garcia, Y.I., Chamizo, J.A., Kleiche-Dray, M., Russell, J.: The scientific impact of mexican steroid research 1935–1965: a bibliometric and historiographic analysis. J. Assoc. Inf. Sci. Technol. 67(5), 1245–1256 (2016)

    Google Scholar 

  • Hsu, J.W., Huang, D.W.: Correlation between impact and collaboration. Scientometrics 86(2), 317–324 (2010)

    Google Scholar 

  • Huang, D.: Positive correlation between quality and quantity in academic journals. J Inf. 10(2), 329–335 (2016)

    Google Scholar 

  • Inglesi-Lotz, R., Chang, T., Gupta, R.: Causality between research output and economic growth in BRICS. Qual. Quant. 49(1), 167–176 (2015)

    Google Scholar 

  • Inzelt, A., Schubert, A., Schubert, M.: Incremental citation impact due to international co authorship in Hungarian higher education institutions. Scientometrics 78(1), 37–43 (2009)

    Google Scholar 

  • Jalali, S.M.J., Park, H.W.: State of the art in business analytics: themes and collaborations. Qual. Quant. 52(2), 627–633 (2018)

    Google Scholar 

  • Katz, J., Hicks, D.: How much is a collaboration worth? A calibrated bibliometric model. Scientometrics 40(3), 541–554 (1997)

    Google Scholar 

  • Khor, K.A., Yu, L.G.: Influence of international co-authorship on the research citation impact of young universities. Scientometrics 107(3), 1095–1110 (2016)

    Google Scholar 

  • King, D.K.: The scientific impact of nations. Nature 430, 311–316 (2004)

    Google Scholar 

  • Kotsemir, M.: Unmanned aerial vehicles research in Scopus: an analysis and visualization of publication activity and research collaboration at the country level. Qual. Quant. 53(4), 2143–2173 (2019)

    Google Scholar 

  • Kumar, R., Stauvermann, P.J., Patel, A.: Exploring the link between research and economic growth: an empirical study of China and USA. Qual. Quant.: Int. J. Methodol. 50(3), 1073–1091 (2016)

    Google Scholar 

  • Lancho-Barrantes, B.S., Cantú-Ortiz, F.J.: Science in mexico: a bibliometric analysis. Scientometrics 118(2), 499–517 (2019). https://doi.org/10.1007/s11192-018-2985-2

    Article  Google Scholar 

  • Lee, L.C., Lin, P.H., Chuang, Y.W., Lee, Y.Y.: Research output and economic productivity: a Granger causality test. Scientometrics 89(2), 465–478 (2011)

    Google Scholar 

  • Leimu, R., Koricheva, J.: Does scientific collaboration increase the impact of ecological articles? Bio Sci. 55, 438–443 (2005)

    Google Scholar 

  • Levitt, J.M., Thelwall, M.: Long term productivity and collaboration in information science. Scientometrics 108(3), 1103–1117 (2016)

    Google Scholar 

  • Leydesdorff, L., Wagner, C.: Macro-level indicators of the relations between research funding and research output. J. Inf. 3(4), 353–362 (2009)

    Google Scholar 

  • Li, N.: Evolutionary patterns of national disciplinary profiles in research: 1996–2015. Scientometrics 111(1), 493–520 (2017)

    Google Scholar 

  • Lima, M., Liberman, S., Russell, J.M.: Scientific group cohesiveness at the national university of Mexico. Scientometrics 64(1), 55–66 (2005)

    Google Scholar 

  • Mayorga M.M., & Muñoz S.E. (2000). La técnica de datos de panel una guía para su uso e interpretación. Resource document. Banco Central de Costa Rica. Departamento de investigaciones económicas. https://www.bccr.fi.cr/investigacioneseconomicas/metodoscuantitativos/Tecnica_datos_panel,_una_guia_para_su_uso_e_interpretacion.pdf. Accessed 10 Aug 2017

  • McAllister, P.R., Narin, F.: Characterization of the research papers of US medical schools. J. Am. Soc. Inf. Sci. 34(2), 123–131 (1983)

    Google Scholar 

  • Meo, S.A., Al Masri, A.A., Usmani, A.M., Memon, A.N., Zaidi, S.Z.: Impact of GDP, spending on R&D, number of universities and scientific journals on research publications among Asian countries. PLoS ONE 8(6), e66449 (2013)

    Google Scholar 

  • Meo, S.A., Usmani, A.M.: Impact of R&D expenditures on research publications, patents and high-tech exports among european countries. Eur. Rev Med. Pharmacol. Sci. 8(1), 1–9 (2014)

    Google Scholar 

  • Meo, S.A., Al Masri, A.A., Usmani, A.M., Halepoto, D.M.: Impact of GDP, spending on R&D, the number of universities and scientific journals on research publications in environmental sciences in the Middle East. Int. J. Occup. Med. Environ. Health 26(5), 702–709 (2013)

    Google Scholar 

  • Meo, S.A., Usmani, A.M., Vohra, M.S., Bukhari, I.A.: Impact of GDP, spending on R&D, number of universities and scientific journals on research publications in pharmacological sciences in Middle East. Eur. Rev. Med. Pharma. Sci. 17(20), 2697–2705 (2013)

    Google Scholar 

  • Moya-Anegon, F., Herrero-Solana, V.: Science in America Latina: a comparison of bibliometric and scientific-technical indicators. Scientometrics 46(2), 299–320 (1999)

    Google Scholar 

  • Moya, F., Chinchilla, Z., Corera, E., González, A., Hassan, Y., Vargas, B.: Indicadores Bibliométricos de la Actividad Científica Española: 2002–2006. Fecyt, Madrid (2008)

    Google Scholar 

  • Moya, F., Chinchilla, Z., Vargas, B., Corera, E., Muñoz, F., González, A., Herrero, V.: Coverage analysis of Scopus: a journal metric approach. Scientometrics 73(1), 53–78 (2007)

    Google Scholar 

  • Nguyen, T.V., Pham, L.T.: Scientific output and its relationship to knowledge economy: an analysis of ASEAN countries. Scientometrics 89(1), 107–117 (2011)

    Google Scholar 

  • Ntuli, H., Inglesi-Lotz, R., Chang, T.Y., Pouris, A.: Does research output cause economic growth or vice versa? Evidence from 34 OECD countries. J. Assoc. Inf. Sci. Technol. 66(8), 1709–1716 (2015)

    Google Scholar 

  • Payne, A.A., Siow, A.: Does federal research funding increase university research output? Adv. Econ. Anal. Policy 3(1), 1–24 (2003)

    Google Scholar 

  • Qiu, S., Liu, X., Gao, T.: Do emerging countries prefer local knowledge or distant knowledge? Spillover effect of university collaborations on local firms. Res. Policy 46(7), 1299–1311 (2017)

    Google Scholar 

  • Reinhilde Veugelers.The challenge of China’s rise as a science and technology powerhouse. Policy Contribution, 19, 2017 https://bruegel.org/wp-content/uploads/2017/07/PC-19-2017.pdf

  • Ricklefs, R.E., Miller, G., Miller, G.L.: Ecology. Freeman, W. H (2000)

    Google Scholar 

  • Rivera, R., Sampedro, J.L., & Dutrenit, G. (2009). How productive are academic researchers in agriculture related sciences? The Mexican case. Working paper series. Resource document. United Nations University–Maastricht Economic and social Research and training center on Innovation and Technology. https://www.merit.unu.edu/publications/working-papers/abstract/?id=3787.Accessed 10 Aug 2017

  • Rousseau, R., Ding, J.: Does international collaboration yield a higher citation potential for US scientists publishing in highly visible interdisciplinary journals? J. Assoc. Inf Sci Technol. 67(4), 1009–1013 (2016)

    Google Scholar 

  • Rueda-Barrios, G., Rodenes-Adam, M.: Factores determinantes en la producción científica de los grupos de investigación en Colombia. Revista Española de Documentación Científica 39(1), e118 (2016)

    Google Scholar 

  • Schmoch, U., Schubert, T.: Are international co-publications an indicator for quality of scientific research? Scientometrics 74(3), 361–377 (2008)

    Google Scholar 

  • Scopus. (2017). Elsevier. https://www.elsevier.com/solutions/scopus. Accessed 1 Septem 2017

  • Solarin, S.A., Yen, Y.Y.: A global analysis of the impact of research output on economic growth. Scientometrics 108(2), 855–874 (2016)

    Google Scholar 

  • Thornley, C., Watkinson, A., Nicholas, D., Volentine, R., Jamali, H., Herman, E., Allard, S., Levine, K.J., Tenopir, C.: The role of trust and authority in the citation behaviour of researchers. Inf. Res. 20(3), 1–21 (2015)

    Google Scholar 

  • Uddin, A., Singh, V.K., Pinto, D., Olmos, I.: Scientometric mapping of computer science research in Mexico. Scientometrics 105(1), 97–114 (2015)

    Google Scholar 

  • UIS Statistics (2018). UNESCO Institute for Statistics. Retrieved from https://data.uis.unesco.org/

  • Villaseñor, E.A., Arencibia, J.R., Carrillo-Calvet, H.: Multiparametric characterization of scientometric performance profiles assisted by neural networks: a study of Mexican higher education institutions. Scientometrics 110(1), 77–104 (2017)

    Google Scholar 

  • Wellcome: Government investment in research https://wellcome.ac.uk/what-we-do/our-work/our-policy-work-government-investment-research

  • Whitmire, E.: Academic library performance measures and undergraduates’ library use and educational outcomes. Libr Inf. Sci. Res. 24(2), 107–128 (2002)

    Google Scholar 

  • Zhang, Q., Perra, N., Gonçalves, B., Ciulla, F., Vespignani, A.: Characterizing scientific production and consumption in physics. Sci. Rep (2013). https://doi.org/10.1038/srep01640

    Article  Google Scholar 

  • Zhang, Y., Chen, K., Zhu, G., Yam, R., Guan, J.: Inter-organizational scientific collaborations and policy effects: an ego-network evolutionary perspective of the chinese academy of sciences. Scientometrics 108(3), 1383–1415 (2016)

    Google Scholar 

  • Zhao, Q., Guan, J.: International collaboration of three ‘giants’ with the G7 countries in emerging nanobiopharmaceuticals. Scientometrics 87(1), 159–170 (2011)

    Google Scholar 

Download references

Acknowledgements

We are grateful to Tecnologico de Monterrey and the University of Leeds, which supported this study. We also acknowledge the very valuable statistical guidance and assistance from Jose Enrique Montemayor Gallegos, Director of Academic Evaluation and Institutional Effectiveness and Dra. Elvira Elena Naranjo Priego, Professor in the Department of Economics, School of Business, Social Sciences and Humanities at Tecnologico de Monterrey. Their knowledge and expertise were fundamental in constructing the multiple regression model using panel data and research efficiency indicators.

Author information

Authors and Affiliations

  1. University of Leeds, Leeds, LS2 9JT, United Kingdom

    Barbara S. Lancho-Barrantes

  2. Tecnologico de Monterrey, Av. Garza Sada 2501, 64849, Monterrey, N.L, Mexico

    Hector G. Ceballos-Cancino & Francisco J. Cantu-Ortiz

Authors
  1. Barbara S. Lancho-Barrantes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hector G. Ceballos-Cancino
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Francisco J. Cantu-Ortiz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Barbara S. Lancho-Barrantes.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lancho-Barrantes, B.S., Ceballos-Cancino, H.G. & Cantu-Ortiz, F.J. Comparing the efficiency of countries to assimilate and apply research investment. Qual Quant 55, 1347–1369 (2021). https://doi.org/10.1007/s11135-020-01063-w

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11135-020-01063-w

Keywords

Search

Navigation