Factors affecting number of citations: a comprehensive review of the literature
The majority of academic papers are scarcely cited while a few others are highly cited. A large number of studies indicate that there are many factors influencing the number of citations. An actual review is missing that provides a comprehensive review of the factors predicting the frequency of citations. In this review, we performed a search in WoS, Scopus, PubMed and Medline to retrieve relevant papers. In overall, 2087 papers were retrieved among which 198 relevant papers were included in the study. Three general categories with twenty eight factors were identified to be related to the number of citations: Category one: “paper related factors”: quality of paper; novelty and interest of subject; characteristics of fields and study topics; methodology; document type; study design; characteristics of results and discussion; use of figures and appendix in papers; characteristics of the titles and abstracts; characteristics of references; length of paper; age of paper; early citation and speed of citation; accessibility and visibility of papers. Category two: “journal related factors”: journal impact factor; language of journal; scope of journal; form of publication. Category three: “author(s) related factors”: number of authors; author’s reputation; author’s academic rank; self-citations; international and national collaboration of authors; authors’ country; gender, age and race of authors; author’s productivity; organizational features; and funding. Probably some factors such as the quality of the paper, journal impact factor, number of authors, visibility and international cooperation are stronger predictors for citations, than authors’ gender, age and race; characteristics of results and discussion and so on.
KeywordsCitations Impact factor Determinant factors Predictive factors Citation characterization Citation analysis
Authors very much appreciate professor Lutz Bornmann, a sociologist of Science at the Division for Science and Innovation Studies in the Administrative Headquarters of the Max Planck Society in Munich (Germany) for his valuable comments on the manuscript and his helps for improving the paper. This research was supported by the Health Management Research Center, Hormozgan University of Medical Sciences, Bandar Abbas, Iran.
- Andersen, J. P., & Schneider, J. W. (2011). Influence of study design on the citation patterns of Danish, medical research. In Proceedings of ISSI 2011: The 13th conference of the international society for scientometrics and informetrics, Vols. 1 and 2, pp. 46–53.Google Scholar
- Bensman, S. J. (2008). Distributional differences of the impact factor in the sciences versus the social sciences: An analysis of the probabilistic structure of the 2005 journal citation reports. Journal of the American Society for Information Science and Technology, 59(9), 1366–1382.CrossRefGoogle Scholar
- Bernius, S., & Hanauske, M. (2009). Open access to scientific literature—Increasing citations as an incentive for authors to make their publications freely accessible. Paper presented at the C3—Proceedings of the 42nd annual Hawaii international conference on system sciences, HICSS. http://www.scopus.com/inward/record.url?eid=2-s2.0-63349109269&partnerID=40&md5=4c0403d6c3c42b463281dccb4820cc76.
- Bhandari, M., Busse, J., Devereaux, P. J., Montori, V. M., Swiontkowski, M., Tornetta Iii, P., & Schemitsch, E. H. (2007). Factors associated with citation rates in the orthopedic literature. Canadian Journal of Surgery, 50(2), 119–123.Google Scholar
- Bhat, M. H. (2009). Effect of peer review on citations in the open access environment. Library Philosophy and Practice, 11, 1–6.Google Scholar
- Buela-Casal, G., & Zych, I. (2010). Analysis of the relationship between the number of citations and the quality evaluated by experts in psychology journals. Psicothema, 22(2), 270–276.Google Scholar
- Chakraborty, T., Kumar, S., Goyal, P., Ganguly, N., & Mukherjee, A. (2014). Towards a stratified learning approach to predict future citation counts. Paper presented at the Proceedings of the ACM/IEEE joint conference on digital libraries. http://www.scopus.com/inward/record.url?eid=2-s2.0-84919398068&partnerID=40&md5=4ab5eaa92d5b8f6d089ef130650f22ac.
- Chu, H., & Krichel, T. (2007). Downloads vs. citations in economics: Relationships, contributing factors and beyond. Paper presented at the C3—Proceedings of ISSI 2007—11th international conference of the international society for scientometrics and informetrics. http://www.scopus.com/inward/record.url?eid=2-s2.0-77952034760&partnerID=40&md5=93cf9b04e77b4eab198b8568f50e8ca7.
- Costas, R., Bordons, M., Van Leeuwen, T. N., & Van Raan, A. F. J. (2009). Scaling rules in the science system: Influence of field-specific citation characteristics on the impact of individual researchers. Journal of the American Society for Information Science and Technology, 60(4), 740–753.CrossRefGoogle Scholar
- Davis, P. M. (2010). Does open access lead to increased readership and citations? A randomized controlled trial of articles published in APS journals. Physiologist, 53(6), 191–200.Google Scholar
- De Araújo, C. G. S., De Oliveira, B. R. R., De Oliveira Brito, L. V., Da Matta, T. T., Viana, B. F., De Souza, C. P., & Da Matta Mello Portugal, E. (2012). Two-year citations of JAPPL original articles: Evidence of a relative age effect. Journal of Applied Physiology, 112(9), 1434–1436.CrossRefGoogle Scholar
- de Groote, S. L., Shultz, M., & Doranski, M. (2005). Online journals’ impact on the citation patterns of medical faculty. Journal of the Medical Library Association, 93(2), 223–228.Google Scholar
- Dehghani, L., Jahromi, R. B., & Ganjoo, M. (2011). Citations to highly-cited researchers by their co-authors and their self-citations: How these factors affect highly-cited researchers’ h-index in Scopus. Webology, 8(2), 1–13.Google Scholar
- Dervos, D. A., & Kalkanis, T. (2007). cc-IFF: A cascading citations impact factor framework for the automatic ranking of research publications C3. In Proceedings of the third workshop—2005 IEEE intelligent data acquisition and advanced computing systems: Technology and applications, IDAACS 2005, pp. 668–673.Google Scholar
- Gallivan, M. J. (2012). Analyzing citation impact of IS research by women and men: Do women have higher levels of research impact? Paper presented at the C3—SIGMIS-CPR’12—Proceedings of the 2012 computers and people research conference. http://www.scopus.com/inward/record.url?eid=2-s2.0-84863524757&partnerID=40&md5=d488810d10e756a2beaa3839e525e766.
- Gomes, J. A. N. F., & Vieira, E. S. (2009). How to improve the citation impact of a paper: Choice of journal, co-authors and institutional addresses. Paper presented at the C3—12th International conference on scientometrics and informetrics, ISSI 2009. http://www.scopus.com/inward/record.url?eid=2-s2.0-84901983008&partnerID=40&md5=ec158d329d4c5e0b81b579636c7c36f3.
- Henneken, E. A., & Accomazzi, A. (2011). Linking to data: Effect on citation rates in astronomy (Vol. 461). arXiv:1111.3618.
- Hurley, L. A., Ogier, A. L., & Torvik, V. I. (2013). Deconstructing the collaborative impact: Article and author characteristics that influence citation count. Proceedings of the ASIST Annual Meeting, 50(1), 1–10.Google Scholar
- Jaffe, K. (2011). Do countries with lower self-citation rates produce higher impact papers? Or, does humility pay? Interciencia, 36(9), 694–698.Google Scholar
- Jiang, J., He, D., & Ni, C. (2013). The correlations between article citation and references’ impact measures: What can we learn. Proceedings of the ASIST Annual Meeting, 50(1), 1–4.Google Scholar
- Kousha, K., & Thelwall, M. (2011). Assessing the citation impact of book-based disciplines: The role of Google Books, Google Scholar and Scopus. In Proceedings of ISSI 2011: The 13th conference of the international society for scientometrics and informetrics, Vols. 1 and 2, pp. 361–372.Google Scholar
- Lira, R. P. C., Amorim, F. H. R., Gonçalves, F. A., Arieta, C. E. L., & Kara-Junior, N. (2014). Comparison of the citation characteristics between the case reports/cases series versus the other study designs in the articles published in Brazilian journals of ophthalmology. Revista Brasileira de Oftalmologia, 73(1), 7–10.CrossRefGoogle Scholar
- Lira, R. P. C., Vieira, R. M. C., Gonçalves, F. A., Ferreira, M. C. A., Maziero, D., & Arieta, C. E. L. (2013). Influence of English language in the number of citations of articles published in Brazilian journals of Ophthalmology. Arquivos Brasileiros de Oftalmologia, 76(1), 26–28.CrossRefGoogle Scholar
- Mishra, P. N., Panda, K. C., & Goswami, N. G. (2010). Citation analysis and research impact of National Metallurgical Laboratory, India during 1972–2007: A case study. Malaysian Journal of Library and Information Science, 15(1), 91–113.Google Scholar
- Nieri, M., Clauser, C., Franceschi, D., Pagliaro, U., Saletta, D., & Pini-Prato, G. (2007). Randomized clinical trials in implant therapy: Relationships among methodological, statistical, clinical, paratextual features and number of citations. Clinical Oral Implants Research, 18(4), 419–431.CrossRefGoogle Scholar
- Pagel, P. S., & Hudetz, J. A. (2011). Scholarly productivity of United States academic cardiothoracic anesthesiologists: Influence of fellowship accreditation and transesophageal echocardiographic credentials on h-index and other citation bibliometrics. Journal of Cardiothoracic and Vascular Anesthesia, 25(5), 761–765.CrossRefGoogle Scholar
- Poomkottayil, D., Bornstein, M. M., & Sendi, P. (2011). Lost in translation: The impact of publication language on citation frequency in the scientific dental literature. Swiss Medical Weekly, 141, 30.Google Scholar
- Robson, B. J., & Mousquès, A. (2014). Predicting citation counts of environmental modelling papers C3. In Proceedings—7th international congress on environmental modelling and software: Bold visions for environmental modeling, iEMSs 2014, Vol. 3, pp. 1390–1396.Google Scholar
- Roldan-Valadez, E., & Rios, C. (2015). Alternative bibliometrics from impact factor improved the esteem of a journal in a 2-year-ahead annual-citation calculation: Multivariate analysis of gastroenterology and hepatology journals. European Journal of Gastroenterology and Hepatology, 27(2), 115–122.CrossRefGoogle Scholar
- Schneider, J. W., & Henriksen, D. (2013). Are larger effect sizes in experimental studies good predictors of higher citation rates? A bayesian examination C3. In Proceedings of ISSI 2013—14th international society of scientometrics and informetrics conference. http://www.scopus.com/inward/record.url?eid=2-s2.0-84896830466&partnerID=40&md5=960a18915c0fa828b5625ff9415a083c.
- Tang, X., Wang, L., & Kishore, R. (2014). Why do is scholars cite other scholars? An empirical analysis of the direct and moderating effects of cooperation and competition among is scholars on individual citation behavior C3. In 35th International conference on information systems “building a better world through information systems”, ICIS 2014.Google Scholar
- Yu, T., & Yu, G. (2014). Features of scientific papers and the relationships with their citation impact. Malaysian Journal of Library and Information Science, 19(1), 37–50.Google Scholar