Abstract
An index system for evaluating academic papers is constructed and verified based on the empirical analysis of papers that has gained the 6th Chinese Academy of Social Sciences Award for Outstanding Achievements. Some new index, such as paper discipline impact factor, discipline average cited rate per paper and discipline average downloaded rate per paper have been put forward in this paper. The empirical research results show that the ranking of papers calculated by this evaluation index system is in conformity with the awards determined by peer review in general, but still needs to be verified and improved in practice.
Similar content being viewed by others
References
Dalkey, N., & Helmer, O. (1963). An experimental application of the Delphi method to the use of experts. Management Science, 9(3), 458–467.
Finkenstaedt, T. (1990). Measuring research performance in the humanities. Scientometrics, 19(5–6), 409–417.
Forman, E. H., & Gass, S. I. (2001). The analytical hierarchy process—an exposition. Operations Research, 49(4), 469–486.
Glänzel, W., Thijs, B., Schubert, A., & Debackere, K. (2009). Subfield-specific normalized relative indicators and a new generation of relational charts: Methodological foundations illustrated on the assessment of institutional research performance. Scientometrics, 78(1), 165–188.
Hanney, S., Frame, I., Grant, J., Buxton, M., Young, T., & Lewison, G. (2005). Using categorizations of citations when assessing the outcomes from health research. Scientometrics, 65(3), 357–379.
Jiang, X., Yin, G., & Mo, Z. (2009). A Guide to the Humanities & Social Science Core Journals in China (2008 Edition). Beijing: Social Sciences Academic Press.
Landeta, J. (2006). Current validity of the Delphi method in social sciences. Technological Forecasting and Social Change, 73(5), 467–482.
Moed, H. F., Luwel, M., & Nederhof, A. J. (2002). Towards research performance in the humanities. Library Trends, 50(3), 498–520.
Norris, M., & Oppenheim, C. (2003). Citation counts and the research assessment exercise V. Archaeology and the 2001 RAE. Journal of Documentation, 59(6), 709–730.
Saaty, T. L. (1977). A scaling method for priorities in hierarchical structures. Journal of Mathematical Psychology, 15(3), 234–281.
Skulmoski, G. J., Hartman, F. T., & Krahn, J. (2007). The Delphi method for graduate research. The Journal of Information Technology Education, 6, 1–21.
Vidal, L. A., Marle, F., & Bocquet, J. C. (2010). Using a Delphi process and the analytic hierarchy process (AHP) to evaluate the complexity of projects. Expert Systems with Applications. doi:10.1016/j.eswa.2010.10.016.
Zhang, L., Zhao, H., Li, Q., Wang, J., & Tan, X. (2010). Establishment of paper assessment system based on academic disciplinary benchmarks. Scientomerics, 84, 421–429.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ren, Q., Gong, X. Evaluation index system for academic papers of humanities and social sciences. Scientometrics 93, 1047–1060 (2012). https://doi.org/10.1007/s11192-012-0790-x
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-012-0790-x