The study aims to forecast the research output of four selected countries (USA, China, India and Pakistan) using two models of Grey System Theory—Even Model GM (1, 1) and Nonhomogeneous Discrete Grey Model (NDGM). The study also conducts publication growth analysis using relative growth rate (RGR) and the doubling time (D t). The linear and exponential regression analyses were also performed for comparison. The study also proposes and successfully tests two novel synthetic models for RGR and D t that facilities the comparison of the countries’ performance when actual data and forecasted data produce different sequences of performance in the given period of time. The data of documents published by the four countries from 2005 to 2016 was collected from SJR/Scopus website. Performance criterion was Mean Absolute Percentage Error. The study confirms that NDGM is a better model for forecasting research output as its accuracy level is higher than that of the Even Model GM (1, 1) and statistical regression models. The results revealed that USA is likely to continue leading in research output at least till 2025 however the research output difference between USA and China is likely to reduce. The study reveals that the less developed countries tend to possess higher relative growth rate in publications whereas the more developed countries tend to possess lower relative growth rate. Further, the more developed countries need more time for publications to double in numbers for a given relative growth rate and less developed countries need less time to do so. The study is original in term of its analysis of the problem using the models involved in the study. The study suggests that the strategies of USA and China to enhance the research output of their respective countries seem productive for the time being however in long run less developed countries have greater competitive advantage over the more developed countries because of their publication growth rate and time required to double the number of publications. The study reported nearly linear trend of growth in research output among the countries. The study is primarily important for the academic policy makers and encourages them to take corrective measures if the growth rate of their academic/publishing sector is not reasonable.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
Ayvaz, B., & Kusakci, A. O. (2017). Electricity consumption forecasting for Turkey with nonhomogeneous discrete grey model. Energy Sources, Part B: Economics, Planning and Policy, 12(3), 260–267.
Bajwa, R. S., Yaldram, K., & Rafique, S. (2013). A scientometric assessment of research output in nanoscience and nanotechnology: Pakistan perspective. Scientometrics, 94(1), 333–342.
Bornmann, L., & Mutz, R. (2015). Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references. Journal of the Association for Information Science and Technology, 66(11), 2215–2222.
Ductor, L., Fafchamps, M., Goyal, S., & van der Leij, M. J. (2013). Social networks and research output. Review of Economics and Statistics, 96(5), 936–948. https://doi.org/10.1162/REST_a_00430.
Gupta, B. M. (2012). Scientometric analysis of Pakistan’s S&T research output. Annals of Library and Information Studies (ALIS), 59(1), 25–38.
Gupta, B. M., & Bala, A. (2011). A scientometric analysis of Indian research output in medicine during 1999–2008. Journal of Natural Science, Biology, and Medicine, 2(1), 87.
Gupta, B. M., & Dhawan, S. M. (2009). Status of India in science and technology as reflected in its publication output in the Scopus international database, 1996–2006. Scientometrics, 80(2), 473–490.
Hatemi-J, A., Ajmi, A. N., El Montasser, G., Inglesi-Lotz, R., & Gupta, R. (2015). Research output and economic growth in G7 countries: New evidence from asymmetric panel causality testing. Applied Economics, 48(24), 2301–2308.
Huffman, M. D., Baldridge, A., Bloomfield, G. S., Colantonio, L. D., Prabhakaran, P., Ajay, V. S., et al. (2013). Global cardiovascular research output, citations, and collaborations: A time-trend, bibliometric analysis (1999–2008). PLoS ONE, 8(12), e83440.
Inglesi-Lotz, R., Chang, T., & Gupta, R. (2015). Causality between research output and economic growth in BRICS. Quality & Quantity, 49(1), 167–176.
Inglesilotz, R., & Pouris, A. (2013). The influence of scientific research output of academics on economic growth in South Africa: An autoregressive distributed lag (ARDL) application. Scientometrics, 95(1), 129–139.
Javed, S. A., & Liu, S.F. (2017). Evaluation of project management knowledge areas using grey incidence model and AHP. In Paper presented at the 6th IEEE International Conference on Grey Systems and Intelligent Services. Stockholm, Sweden: IEEE. https://doi.org/10.1109/GSIS.2017.8077684.
Kaur, H., & Gupta, B. M. (2010). Mapping of dental science research in India: A scientometric analysis of India’s research output, 1999–2008. Scientometrics, 85(1), 361–376.
Kostoff, R. N. (2012). China/USA nanotechnology research output comparison—2011 update. Technological Forecasting and Social Change, 79(5), 986–990.
Larsen, P. O., & Von Ins, M. (2010). The rate of growth in scientific publication and the decline in coverage provided by Science Citation Index. Scientometrics, 84(3), 575–603.
Liu, S. F., & Lin, Y. (2010). Grey systems: Theory and applications. Berlin: Springer.
Liu, S. F., & Yang, Y. (2017). Explanation of terms of grey forecasting models. Grey Systems: Theory and Application, 7(1), 123–128.
Liu, S., Yang, Y., & Forrest, J. (2016). Grey data analysis: Methods. Models and Applications: Springer. https://doi.org/10.1007/978-981-10-1841-1.
Murray, M. (2014). Predicting scientific research output at the University of KwaZulu-Natal: Research letter. South African Journal of Science, 110(3–4), 1–4.
Nature. (2014). Central & South Asia. Nature, 515, S89–S90. https://doi.org/10.1038/515S89a. Retrieved from https://www.nature.com/nature/journal/v515/n7526_supp/full/515S89a.html.
Nature. (2016a). US tops global research performance. http://www.natureindex.com/news-blog/us-tops-global-research-performance.
Nature. (2016b). 2016 tables: Countries. http://www.natureindex.com/annual-tables/2016/country/all.
Nature. (2016c). Ten institutions that dominated science in 2015. Retrieved from https://www.natureindex.com/news-blog/ten-institutions-that-dominated-science-in-twentyfifteen.
Neuroskeptic. (2012). Science: Growing too fast?. The official blog of the Discover magazine. Retrieved from http://blogs.discovermagazine.com/neuroskeptic/2012/09/30/science-growing-too-fast/.
NSF. (2016). Science & engineering indicators 2016. https://www.nsf.gov/statistics/2016/nsb20161/uploads/1/nsb20161.pdf.
Ntuli, H., Inglesi-Lotz, R., Chang, T., & Pouris, A. (2015). Does research output cause economic growth or vice versa? Evidence from 34 OECD countries. Journal of the Association for Information Science and Technology, 66(8), 1709–1716.
OECD. (2017). Research and Development Statistics (RDS). Retrieved from http://www.oecd.org/innovation/inno/researchanddevelopmentstatisticsrds.htm.
Pautasso, M. (2012). Publication growth in biological sub-fields: Patterns, predictability and sustainability. Sustainability, 4(12), 3234–3247.
Pirthee, M. (2017). Grey-based model for forecasting Mauritius international tourism from different regions. Grey Systems: Theory and Application, 7(2), 259–271. https://doi.org/10.1108/GS-04-2017-0008.
Scopus. (2017). SCImago Journal & Country Rank. http://www.scimagojr.com/countryrank.php.
Sihvonen, J., & Vähämaa, S. (2015). Business research in the Nordic countries: An analysis of research output across countries, disciplines, and institutions. Nordic Journal of Business, 64(4), 266–296.
UN. (2007). Gross domestic expenditure on research and development as a percent of gross domestic product. Accessed from http://www.un.org/esa/sustdev/natlinfo/indicators/methodology_sheets/econ_development/resesarch_development_expenditure.pdf.
USR. (2015). UNESCO science report: Towards 2030. Accessed from http://unesdoc.unesco.org/images/0023/002354/235406e.pdf.
Wang, X., Liu, D., Ding, K., & Wang, X. (2012). Science funding and research output: A study on 10 countries. Scientometrics, 91(2), 591–599. https://doi.org/10.1007/s11192-011-0576-6.
Wu, L. F., Liu, S. F., Cui, W., Liu, D. L., & Yao, T. X. (2014). Non-homogenous discrete grey model with fractional-order accumulation. Neural Computing and Applications, 25(5), 1215–1221.
Xie, N., & Liu, S. (2015). Interval grey number sequence prediction by using non-homogenous exponential discrete grey forecasting model. Journal of Systems Engineering and Electronics, 26(1), 96–102.
Xie, N. M., Liu, S. F., Yang, Y. J., & Yuan, C. Q. (2013). On novel grey forecasting model based on non-homogeneous index sequence. Applied Mathematical Modelling, 37(7), 5059–5068.
Xie, S., Zhang, J., & Ho, Y. S. (2008). Assessment of world aerosol research trends by bibliometric analysis. Scientometrics, 77(1), 113–130.
Xin, Z., Jin, C., Zhengrong, G., Liehu, C., Weizong, W., Quan, L., et al. (2016). Orthopedics research output from China, USA, UK, Japan, Germany and France: A 10-year survey of the literature. Orthopaedics & Traumatology: Surgery & Research, 102(7), 939–945.
Zhang, L., Ye, X., Sun, Y., Deng, A. M., & Qian, B. H. (2015). Hematology research output from Chinese authors and other countries: A 10-year survey of the literature. Journal of Hematology & Oncology, 8(1), 8.
This work was supported by the Marie Curie International Incoming Fellowship under the 7th Framework Programme of the European Union entitled “Grey Systems and Its Application to Data Mining and Decision Support” (Grant No. FP7-PIIF-GA-2013-629051), a project of the Leverhulme Trust International Network entitled “Grey Systems and Its Applications” (IN-2014-020) and the National Natural Science Foundation of China (71671091). The authors want to thank GreySys Analytics, a project of GreySys Foundation and the Academy of Young Researchers and Scholars, Pakistan, for its assistance in data collection, data entry, formatting and proofreading. The corresponding author is the recipient of the Chinese Government Scholarship thus he wants to thank the Chinese Scholarship Council as well. The authors also want to thank the anonymous/blind reviewers of the journal for their constructive feedback on the earlier versions of the paper.
About this article
Cite this article
Javed, S.A., Liu, S. Predicting the research output/growth of selected countries: application of Even GM (1, 1) and NDGM models. Scientometrics 115, 395–413 (2018). https://doi.org/10.1007/s11192-017-2586-5
- GM (1, 1)
- Research output
- Research growth
- Synthetic relative growth rate doubling time