Skip to main content
SpringerLink
Log in

The Evolution of Research Evaluation in China

  • Organization of Research
  • Published:
Herald of the Russian Academy of Sciences Aims and scope Submit manuscript

Abstract

Reforming the research evaluation system is essentially a struggle between the academic aristocracy, which professes expert approaches to evaluation, and the scientific bureaucracy, which seeks to ensure the dictate of numerical indicators. A representative example is the evolution of this confrontation in China, where a long-term commitment to international scientometric databases made it possible to achieve world leadership in terms of the number of publications. However, these achievements were accompanied by negative effects caused by deterioration in the personnel policy of universities, the reduction of academic freedoms, changes in the publication behavior of researchers, and violations of scientific ethics. This led to a reform of the national evaluation system, namely, the strengthening of the role of expertise, the priority dissemination of scientific information at the national level, and the restriction of open access publications. This review considers the history of the formation of and changes in the research evaluation system in China, its positive and negative effects, as well as new scientific practices, their likely consequences, and the possibility to apply them in other countries.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1.

Similar content being viewed by others

Notes

  1. http://russian.china.org.cn/china/China_Key_Words/2018-10/23/content_67738706.htm.

  2. http://ru.moe.gov.cn/about_MOE/what_we_do/201912/t20191227_413713.html.

  3. http://casseng.cssn.cn/about/about_cass/.

  4. http://www.caf.ac.cn/yqjj1.htm.

  5. https://en.wikipedia.org/wiki/Chinese_Academy_of_Geological_Sciences.

  6. http://www.iwhr.com/zgskywwnew/skgk/skgk/N010101index_1.htm.

  7. https://www.rails.cn/en/index.php?id=187.

  8. https://www.thepaper.cn/newsDetail_forward_1789598.

REFERENCES

  1. X. Liu, Z. Zhao, and J. Li, “A retrospective analysis of China’s science and technology evaluation policy since 1978,” in 18th International Conference on Scientometrics and Informetrics (ISSI, Leuven, 2021), Vol. 1, pp. 693–704.

  2. Jiāng Chūn Lín, “Academic assessment: Research results, problems, and building a management system,” Humanit. Soc. Sci., No. 5, 230–234 (2016). http://xnmzxbsk.ijournal.cn/ch/reader/view_abstract.aspx?file_no=20160539&flag=1. Cited May 16, 2022.

  3. J. Zhu, “Evaluation of scientific and technological research in China’s colleges: A review of policy reforms, 2000–2020,” ECNU Review of Education 3 (3), 556–561 (2020).

    Article  Google Scholar 

  4. Xu F. and X. Li, “The changing role of metrics in research institute evaluations undertaken by the Chinese Academy of Sciences (CAS),” Palgrave Communications, No. 2, 16078 (2016).

  5. L. Liu, H. Xue, and J. Li, “Reflections on the use of SSCI papers in evaluating social sciences research in Chinese universities,” ECNU Rev. Educ. 3 (3), 570–575 (2020).

    Article  Google Scholar 

  6. F. Shu, S. Liu, and V. Larivière, “China’s research evaluation reform: What are the consequences for global science?,” Minerva 60, (3), 329–347 (2022).

    Article  PubMed  PubMed Central  Google Scholar 

  7. L. Zhang and G. Sivertsen, “The new research assessment reform in China and its implementation,” Scholarly Assessment Reports 2 (1), 3 (2020).

    Article  Google Scholar 

  8. A. B. Gusev, E. G. Doronina, I. V. Vershinin, and V. A. Malakhov, “Monitoring and evaluation of the results of scientific and technical activities: Foreign experience and Russian practice,” Nauka. Innovatsii. Obrazovanie 13 (1) (2018). https://elibrary.ru/ item.asp?id=32651996. Cited November 13, 2022.

  9. E. V. Mel’nikova, “Comparative analysis of modern approaches of Russia and China to the evaluation of the results of scientific activity,” National Strategy Issues, No. 1 (2022). https://www.elibrary.ru/item.asp?id= 48575201. Cited June 14, 2022.

  10. A. V. Vinogradov, E. A. Salitskaya, and A. I. Salitskii, “Science and technology in China: Modernization accomplished,” Herald Russ. Acad. Sci. 86, 48−56 (2016). https://www.elibrary.ru/item.asp?id=25481579. Cited June 15, 2022.

    Article  Google Scholar 

  11. A. V. Ostrovskii, A. V. Afonas’eva, and P. B. Kamennov, “Prospects for the development of science, technology, and innovation in the PRC,” East Asia: Facts and Analytics, No. 2 (2019). https://www.elibrary.ru/ item.asp?id=41753643. Cited June 14, 2022.

  12. F. F. Sharipov, “On some results and prospects of the scientific and technological development of the People’s Republic of China,” Scientific Notes of the Russian Academy of Entrepreneurship 20 (3) (2021). https://www.elibrary.ru/item.asp?id=46633020. Cited June 14, 2022.

  13. A. B. Petrovskii, S. V. Pronichkin, M. Yu. Sternin, and G. I. Shepelev, “Organization and management of science: The experience of China,” Tr. Ins. Sistemnogo Analiza Ross. Akad. Nauk 67 (4) (2017). https://www.elibrary.ru/item.asp?id=30782143. Cited June 14, 2022.

  14. S. A. Ivanov, “China’s science and technology policy: Catch-up development priorities and results,” Izv. Vost. Ins. Nauchno-Tekh. Polit. Kitaya, No. 2 (38) (2018). https://www.elibrary.ru/item.asp?id=36490110. Cited June 14, 2022.

  15. I. I. Osinskii, “China in the world of science,” Evraziistvo i Mir, No. 1 (2019).

  16. Regulations on the functional structure, internal organization, and staffing of the Ministry of Science and Technology of the People’s Republic of China. https://www.most.gov.cn/zzjg/kjbzn/201907/t20190709_ 147572.html. Cited October 28, 2022.

  17. Notification of the General Administration of the State Council to issue the main responsibilities, internal organization, and staffing of the Ministry of Education. http://www.moe.gov.cn/jyb_zzjg/moe_188/202006/t20200604_462577.html. Cited January 9, 2023.

  18. https://data.stats.gov.cn/english/easyquery.htm?cn=C01. Cited October 31, 2022.

  19. E. G. Raevskaya, “The activities of the Chinese Academy of Sciences and the reflection of its scientific and technical publications in international information systems,” Nauchno-Tekh. Inf., Ser. 1: Orgnizatsiya i Metodika Inf. Raboty, No. 4 (2015). http://lamb.viniti.ru/sid2/sid2free?sid2=J13328198. Cited January 9, 2023.

  20. Notification of the Ministry of Education, the Ministry of Finance and the National Development, and the Reform Commission of the publication of the List of World-Class Universities and First-Class Civil Engineering Universities and Civil Engineering Disciplines. http://www.moe.gov.cn/srcsite/A22/moe_843/201709/t20170921_314942.html. Cited January 9, 2023.

  21. K. Zhao and Z. You, “Isomorphism, diversification, and strategic ambiguity: Goal setting of Chinese higher education institutions in the Double World-Class Project,” Higher Education Policy 34 (4) 841–860 (2021).

    Article  Google Scholar 

  22. The “Chinese Decade” of Innovative Development of Science and Technology: Material for the press conference of the Publicity Department of Central Committee of the CPC, China in the Past Decade: Science, Technology and Innovation Progress: Press Conference, 2022. http://www.scio.gov.cn/xwfbh/xwbfbh/wqfbh/47673/48320/48328/Document/1725057/ 1725057.htm. Cited December 14, 2022.

  23. Song Jiaojiao, Xu Fang, and Meng Wei, “Changes and evolutions of science and technology evaluation policies in China: Characteristics, subjects, and collaborative networks,” Kēyánguǎnlǐ (Science Research Management) 42 (10), 11–19 (2021).

    Google Scholar 

  24. Q. Pan and Z. Cao, “Construction of the evaluation system of scientific research results base on SPSS analysis: The questionnaires of the 63 Universities in China,” Proceedings of 2020 International Conference on Information Science and Education, ICISE-IE 2020 (2020), pp 496–502.

  25. A. I. Salitskii and E. A. Salitskaya, “Science and technology of China in the world market,” Perspectives and Prospects, No. 1 (1) (2015). https://www.elibrary.ru/ item.asp?id=23589656. Cited February 9, 2023.

  26. S. Q. Li, “The end of publish or perish? China’s new policy on research evaluation,” Observations, No. 1, 34695 (2020). https://pure.mpg.de/pubman/item/ item_3263127. Cited May 6, 2022.

  27. Wú Yáng, “A study of teacher development in colleges and universities,” Wénjiào Zīliào, No. 04, 163–165 (2008).

  28. W. Zhou, J. You, and Y. Wang, “Scientific research evaluation system for quality improvement of the university research institution,” in Advances in Management of Technology: Proceedings of the International Conference on Management of Technology (Taiyuan, 2007).

  29. Wáng Yǎ Fēn, “Determination, prevention, and regulation of misconduct in scientific research,” Yánjiū yǔ fāzhǎn guǎnlǐ, No. 4, 133–137 (2007).

  30. X. Wu and D. Jia, “Scientific and ethical reflections on academic corruption in universities: On the science research evaluation system in China’s universities,” Chinese Education and Society 40 (6), 67–76 (2007).

    Article  Google Scholar 

  31. R. Yang, L. Vidovich, and J. Currie, “Dancing in a cage: Changing autonomy in Chinese higher education,” Higher Education 54 (4), 575–592 (2007).

    Article  Google Scholar 

  32. J. Qian, Z. Yuan, J. Li, and H. Zhu, “Science Citation Index (SCI) and scientific evaluation system in China,” Humanit. Soc. Sci. Communications, No. 7, 108 (2020).

  33. Liu W., “China’s SCI-indexed publications: Facts, feelings, and future directions,” ECNU Rev. Educ. 3 (3), 562–569 (2020).

    Article  Google Scholar 

  34. X. Gao and Y. Zheng, “‘Heavy mountains’ for Chinese humanities and social science academics in the quest for world-class universities,” Compare 50 (4), 554–572 (2020).

    Article  Google Scholar 

  35. J. Lei, “Neoliberal ideologies in a Chinese university’s requirements and rewards schemes for doctoral publication,” Studies in Continuing Education 43 (1), 68–85 (2021).

    Article  Google Scholar 

  36. Q. Liu, S. Zheng, C. Gui, and X. Wang, “Analysis of scholars’ comments on breaking through the evaluation criteria based on four only,” J. Library Inf. Sci. Agric. 33 (10), 45–58 (2021).

    Google Scholar 

  37. M. Tian, Y. Su, and X. Ru, “Perish or publish in China: Pressures on young Chinese scholars to publish in internationally indexed journals,” Publications 4 (2), 9 (2016). https://www.mdpi.com/2304-6775/4/2/9. Cited May 8, 2022.

    Article  Google Scholar 

  38. J. Xu, D. Chen, H. Chen, and Y. Zeng, “How are the new wave of Chinese researchers shaping up in scholarly communication terms?,” Malaysian J. Library Inf. Sci. 25 (3), 49–70 (2020).

    Article  Google Scholar 

  39. Publications Output: US Trends and International Comparisons, National Science Foundation. https://ncses.nsf.gov/pubs/nsb20214/publication-output-by-country-region-or-economy-and-scientific-field. Cited December 12, 2022.

  40. The Center for Academic Degree Development and Postgraduate Education of the Ministry of Education is answering journalists’ questions about the Fifth Round of the Work Plan for Discipline Assessment: Interpretation. http://www.gov.cn/zhengce/2020-11/03/content_5556902.htm. Cited May 8, 2022.

  41. F. Wei and G. Zhang, “Measuring the scientific publications of double first-class universities from mainland China,” Learned Publishing 33 (3), 230–244 (2020).

    Article  Google Scholar 

  42. J. Lv, “Research on the construction of scientific research evaluation system for teachers in higher vocational colleges based on computer PCA and ANP,” in Application of Big Data, Blockchain, and Internet of Things for Education Informatization: Lecture Notes of the Institute for Computer Sciences, Social Informatics, and Telecommunications Engineering (Springer, Cham, 2021), Vol. 391, pp. 327–335.

    Google Scholar 

  43. H. Horta and W. Shen, “Current and future challenges of the Chinese research system,” J. High. Educ. Policy Manag. 42 (2) 157–177 (2020).

    Article  Google Scholar 

  44. L. Schneider, “The full-service paper mill and its Chinese customers,” (2020). https://forbetterscience.com/ 2020/01/24/the-full-service-paper-mill-and-its-chinese-customers/. Cited January 11, 2023.

  45. Q. Li, X. Guan, P. Wu, et al., “Early transmission dynamics in Wuhan, China, of novel Coronavirus–infected pneumonia,” N. Engl. J. Med. 382 (13), 1199–1207 (2020).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  46. Is the initial rush to publish articles delaying the fight against disease? China CDC response should be more detailed. https://www.sohu.com/a/369715786_665455. Cited December 14, 2022.

  47. Xi Jinping, Hold High the Great Banner of Socialism with Chinese Characteristics and Strive in Unity to Build a Modern Socialist Country in All Respects: Report to the 20th National Congress of the Communist Party of China, October 16, 2022. http://my.china-embassy.gov.cn/eng/zgxw/202210/t20221026_10792358.htm. Cited December 8, 2022.

  48. The Fourteenth Five-Year Plan for the National Economic and Social Development of the People’s Republic of China and an outline of long-term goals for the period up to 2035. http://www.gov.cn/xinwen/2021-03/13/content_5592681.htm. Cited December 14, 2022.

  49. Fifth round of discipline evaluation work: Sections of the ministry and government. http://www.gov.cn/xinwen/2020-11/03/content_5556900.htm. Cited May 8, 2022.

  50. Notification of the Ministry of Education and the Ministry of Science and Technology of the issuance of several opinions on the regulation of the use of indicators associated with SCI documents in higher education institutions and the establishment of the correct orientation of the assessment. http://www.moe.gov.cn/srcsite/A16/moe_784/202002/t20200223_423334.html. Cited May 8, 2022.

  51. Ministry of Science and Technology, Some Measures to Eliminate the Bad “Articles Only” Orientation in Science and Technology Evaluation (Trial). https://news.sciencenet.cn/htmlnews/2020/2/436125.shtm. Cited May 10, 2022.

  52. Notice to the Natural Science Foundation of the Ministry of Science and Technology to further strengthen the scientific research style of units carrying out the tasks of the National Science and Technology Plan (special projects, foundations, etc.) and the responsibility of the main body of scientific research integrity. http://www.gov.cn/zhengce/zhengceku/2020-07/30/ content_5531151.htm. Cited December 15, 2022.

  53. Guiding opinions of the General Administration of the State Council on improving the mechanism for evaluating scientific and technological achievements. https://www.most.gov.cn/xxgk/xinxifenlei/fdzdgknr/fgzc/gfxwj/gfxwj2021/202108/t20210804_176223.html. Cited December 15, 2022.

  54. Headquarters of the Central Committee of the Communist Party of China and Headquarters of the State Council, Opinions on Strengthening the Ethical Governance of Science and Technology: State Council Communiqué No. 10 of 2022. http://www.gov.cn/gongbao/content/2022/content_ 5683838.htm. Cited May 8, 2022.

  55. Headquarters of the Ministry of Science and Technology, Ministry of Education, Headquarters of the Ministry of Finance, and Headquarters of the Ministry of Human Resources and Social Security, Notice from the Ministry of Science and Technology of the People’s Republic of China “Several Opinions on Expanding the Autonomy of Universities and Research Institutions Related to Scientific Research: A Question and Answer Guide.” http://www.most.gov.cn/xxgk/xinxifenlei/ fdzdgknr/fgzc/zcjd/202203/t20220308_179673.html. (Cited May 10, 2022).

  56. Ministry of Education Notice of the Publication “A Few Opinions on Eliminating the Bad ‘Thesis Only’ Orientation in Assessing Research in Philosophy and Social Sciences in Colleges and Universities.” http://www.gov.cn/zhengce/zhengceku/2020-12/15/ content_5569588.htm. Cited May 8, 2022.

  57. 285 projects are selected in the China Science and Technology Journal Excellence Action Plan. https://news.sciencenet.cn/htmlnews/2019/11/433140.shtm. Cited May 8, 2022.

  58. L. Xiaoxuan and X. U. Fang, “How to break the ‘Siwei’? Practice and enlightenment based on Research Institute Evaluation of Chinese Academy of Sciences,” Bull. Chinese Acad. Sci. (Chinese Version) 35 (12), 1431–1438 (2020).

    Google Scholar 

  59. J. Gu and J. S. Levin, “Tournament in academia: A comparative analysis of faculty evaluation systems in research universities in China and the USA,” Higher Education 81 (5), 897–915 (2021).

    Article  Google Scholar 

  60. S. Mallapaty, “China bans cash rewards for publishing papers,” Nature 579 (7797), 18–18 (2020).

    Article  ADS  CAS  PubMed  Google Scholar 

  61. “Evaluation system reform promotes the development of Chinese academic journals: Interview with Academician Guo Zhengtang,” Chinese Science Bulletin 65 (21), 2187–2190. https://doi.org/. Cited December 15, 2022.https://doi.org/10.1360/TB-2020-0613

  62. W. Liang, J. Gu, and C. Nyland, “China’s new research evaluation policy: Evidence from economics faculty of Elite Chinese universities,” Research Policy 51 (1), 104407, 1–10 (2022).

Download references

Author information

Authors and Affiliations

  1. Russian Research Institute of Economics, Politics, and Law in Science and Technology (RIEPL), Moscow, Russia

    I. G. Lakizo & A. E. Gus’kov

Authors
  1. I. G. Lakizo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. E. Gus’kov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to I. G. Lakizo or A. E. Gus’kov.

Ethics declarations

The authors declare that they have no conflicts of interest.

Additional information

Translated by B. Alekseev

Publisher’s Note.

Pleiades Publishing remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Irina Gelasievna Lakizo, Cand. Sci. (Pedagogy), is a Researcher at the RIEPL. Andrei Evgen’evich Gus’kov, Cand. Sci. (Eng.), is Head of the Laboratory of Scientometrics and Scientific Communications at the same institute.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lakizo, I.G., Gus’kov, A.E. The Evolution of Research Evaluation in China. Her. Russ. Acad. Sci. 93, 168–179 (2023). https://doi.org/10.1134/S1019331623020107

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S1019331623020107

Keywords:

Search

Navigation