Skip to main content
Log in

Evidence-based recommendations for increasing the citation frequency of original articles

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

Publications and citations are important for career advancement of researchers. Our main aim was to derive recommendations that might increase the citation frequency of authors’ work. We examined title and article characteristics of original research articles published in the major medical journals BMJ, JAMA, Lancet, NEJM and PLOS Med (PLOS) between 2011 and 2020, using PubMed and Web of Science. To analyze citation frequencies, we estimated quasi Poisson regression models. The NEJM had by far the shortest titles (9.7 ± 1.8 words). Titles in the other journals were at least 8 words longer on average. Randomized controlled trials (RCTs) were rarely identifiable by its title in the NEJM (5.3% by title, 63.3% by title plus abstract). BMJ, Lancet and PLOS articles had more frequently active verbs than JAMA and NEJM articles. The citation frequency was higher when articles were open access and when more authors and corporate authors were involved (all p < 0.001), and it was lower when a geography was mentioned (p < 0.001). Titles differed substantially in their characteristics between major medical journals. The NEJM often chose titles for RCTs not following the CONSORT 2010 statement. Several modifiable title and article characteristics were associated with the citation frequency of articles, such as open access of an article. We recommend authors to choose the title carefully to obtain the maximum range for their work.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

Data availability

All relevant data are within the manuscript and its Supporting Information files.

Code availability

All relevant code is within the Supporting Information files.

References

  • Abramo, G., D’Angelo, C. A., & Di Costa, F. (2016). The effect of a country’s name in the title of a publication on its visibility and citability. Scientometrics, 109, 1895–1909.

    Article  Google Scholar 

  • Albert, T. (2016). Winning the publications game: The smart way to write your paper and get it published. CRC Press.

    Google Scholar 

  • Ale Ebrahim, N., Salehi, H., Amin Embi, M., Habibi Tanha, F., Gholizadeh, H., Motahar, S. M., & Ordi, A. (2013). Effective strategies for increasing citation frequency. International Education Studies, 6, 93–99.

    Article  Google Scholar 

  • Araujo, A. C., Gonzalez, G. Z., Nascimento, D. P., & Costa, L. O. P. (2020). Deep impact: 4 tips for authors and journal editors to improve altmetric scores. Physical Therapy, 100, 2060–2062.

    Article  Google Scholar 

  • Baggio, S., Iglesias, K., & Rousson, V. (2018). Modeling count data in the addiction field: Some simple recommendations. International Journal of Methods in Psychiatric Research, 27, e1585.

    Article  Google Scholar 

  • Beel, J. & Gipp, B. (2009). Google Scholar's ranking algorithm: an introductory overview. In Flory, A. & Collard, M. (eds.) Proceedings of the IEEE international conference on research challenges in information sciences, RCIS 2009. Piscataway: IEEE.

  • Bornmann, L., & Daniel, H. D. (2008). What do citation counts measure? A review of studies on citing behavior. Journal of Documentation, 64, 45–80.

    Article  Google Scholar 

  • Cano, V., & Lind, N. C. (1991). Citation life cycles of ten citation classics. Scientometrics, 22, 297–312.

    Article  Google Scholar 

  • DerSimonian, R., & Laird, N. (2015). Meta-analysis in clinical trials revisited. Contemporary Clinical Trials, 45, 139–145.

    Article  Google Scholar 

  • Falahati-Qadimi-Fumani, M. R., Goltaji, M., & Parto, P. (2015). The impact of title length and punctuation marks on article citations. Annals of Library and Information Studies, 62, 126–132.

    Google Scholar 

  • Figg, W. D., Dunn, L., Liewehr, D. J., Steinberg, S. M., Thurman, P. W., Barrett, J. C., & Birkinshaw, J. (2006). Scientific collaboration results in higher citation rates of published articles. Pharmacotherapy, 26, 759–767.

    Article  Google Scholar 

  • Fox, C. W., & Burns, C. S. (2015). The relationship between manuscript title structure and success: Editorial decisions and citation performance for an ecological journal. Ecology and Evolution, 5, 1970–1980.

    Article  Google Scholar 

  • Goodman, N. W. (2000). Survey of active verbs in the titles of clinical trial reports. BMJ, 320, 914–915.

    Article  Google Scholar 

  • Guo, F., Ma, C., Shi, Q., & Zong, Q. (2018). Succinct effect or informative effect: The relationship between title length and the number of citations. Scientometrics, 116, 1531–1539.

    Article  Google Scholar 

  • Habibzadeh, F., & Yadollahie, M. (2010). Are shorter article titles more attractive for citations? Cross-sectional study of 22 scientific journals. Croatian Medical Journal, 51, 165–170.

    Article  Google Scholar 

  • Hamrick, T. A., Fricker, R. D., Jr., & Brown, G. G. (2010). Assessing what distinguishes highly cited from less-cited papers published in Interfaces. Interfaces, 40, 454–464.

    Article  Google Scholar 

  • Hopewell, S., Boutron, I., & Moher, D. (2020). CONSORT and its extensions for reporting clinical trials. In S. Piantadosi & C. L. Meinert (Eds.), Principles and practice of clinical trials. Cham: Springer International Publishing.

    Google Scholar 

  • Jeong, G.-H., & Huh, S. (2014). Increase in frequency of citation by SCIE journals of non-Medline journals after listing in an open access full-text database. Science Editing, 1, 24–26.

    Article  Google Scholar 

  • Ke, Q. (2020). The citation disadvantage of clinical research. Journal of Informetrics, 14, 100998.

    Article  Google Scholar 

  • Kerans, M. E., Anne, M., & Sabatè, S. (2016). Content and phrasing in titles of original research and review articles in 2015: Range of practice in four clinical journals. Publications, 4, 11.

    Article  Google Scholar 

  • Kerans, M. E., Marshall, J., Murray, A., & Sabaté, S. (2020). Research article title content and form in high-ranked international clinical medicine journals. English for Specific Purposes, 60, 127–139.

    Article  Google Scholar 

  • Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Sage.

    Google Scholar 

  • Morgan, P. P. (1983). The importance of being cited. Canadian Medical Association Journal, 129, 9.

    Google Scholar 

  • Norman, E. R. (2012). Maximizing journal article citation online: Readers, robots, and research visibility. Politics and Policy, 40, 1–12.

    Article  Google Scholar 

  • PLoS Medicine Editors. (2009). A medical journal for the world's health priorities. PLOS Medicine, 6, e1000072.

  • Rossi, M. J., & Brand, J. C. (2020). Journal article titles impact their citation rates. Arthroscopy, 36, 2025–2029.

    Article  Google Scholar 

  • Schulz, K. F., Altman, D. G., & Moher, D. (2010). CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. PLoS Medicine, 7, e1000251.

    Article  Google Scholar 

  • Sollaci, L. B., & Pereira, M. G. (2004). The introduction, methods, results, and discussion (IMRAD) structure: A fifty-year survey. Journal of the Medical Library Association, 92, 364–367.

    Google Scholar 

  • Tahamtan, I., Safipour Afshar, A., & Ahamdzadeh, K. (2016). Factors affecting number of citations: A comprehensive review of the literature. Scientometrics, 107, 1195–1225.

    Article  Google Scholar 

  • Urlings, M. J. E., Duyx, B., Swaen, G. M. H., Bouter, L. M., & Zeegers, M. P. (2021). Citation bias and other determinants of citation in biomedical research: Findings from six citation networks. Journal of Clinical Epidemiology, 132, 71–78.

    Article  Google Scholar 

  • Vieira, E. S., & Gomes, J. A. N. F. (2010). Citations to scientific articles: Its distribution and dependence on the article features. Journal of Informetrics, 4, 1–13.

    Article  Google Scholar 

Download references

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

Authors

Contributions

NH: Formal analysis, Methodology, Supervision, Visualization, Writing—original draft, Writing—review and editing. AZ: Formal analysis, Methodology, Visualization, Writing—original draft, Writing—review & editing.

Corresponding author

Correspondence to Andreas Ziegler.

Ethics declarations

Conflict of interest

There are no patents, products in development or marketed products to declare. AZ is a licensed Tim Albert trainer and has held several courses in the past based on Albert’s concept.

Supplementary Information

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Heßler, N., Ziegler, A. Evidence-based recommendations for increasing the citation frequency of original articles. Scientometrics 127, 3367–3381 (2022). https://doi.org/10.1007/s11192-022-04378-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-022-04378-7

Keywords

Navigation