Abstract
Publications and citations are important for career advancement of researchers. Our main aim was to derive recommendations that might increase the citation frequency of authors’ work. We examined title and article characteristics of original research articles published in the major medical journals BMJ, JAMA, Lancet, NEJM and PLOS Med (PLOS) between 2011 and 2020, using PubMed and Web of Science. To analyze citation frequencies, we estimated quasi Poisson regression models. The NEJM had by far the shortest titles (9.7 ± 1.8 words). Titles in the other journals were at least 8 words longer on average. Randomized controlled trials (RCTs) were rarely identifiable by its title in the NEJM (5.3% by title, 63.3% by title plus abstract). BMJ, Lancet and PLOS articles had more frequently active verbs than JAMA and NEJM articles. The citation frequency was higher when articles were open access and when more authors and corporate authors were involved (all p < 0.001), and it was lower when a geography was mentioned (p < 0.001). Titles differed substantially in their characteristics between major medical journals. The NEJM often chose titles for RCTs not following the CONSORT 2010 statement. Several modifiable title and article characteristics were associated with the citation frequency of articles, such as open access of an article. We recommend authors to choose the title carefully to obtain the maximum range for their work.
Similar content being viewed by others
Data availability
All relevant data are within the manuscript and its Supporting Information files.
Code availability
All relevant code is within the Supporting Information files.
References
Abramo, G., D’Angelo, C. A., & Di Costa, F. (2016). The effect of a country’s name in the title of a publication on its visibility and citability. Scientometrics, 109, 1895–1909.
Albert, T. (2016). Winning the publications game: The smart way to write your paper and get it published. CRC Press.
Ale Ebrahim, N., Salehi, H., Amin Embi, M., Habibi Tanha, F., Gholizadeh, H., Motahar, S. M., & Ordi, A. (2013). Effective strategies for increasing citation frequency. International Education Studies, 6, 93–99.
Araujo, A. C., Gonzalez, G. Z., Nascimento, D. P., & Costa, L. O. P. (2020). Deep impact: 4 tips for authors and journal editors to improve altmetric scores. Physical Therapy, 100, 2060–2062.
Baggio, S., Iglesias, K., & Rousson, V. (2018). Modeling count data in the addiction field: Some simple recommendations. International Journal of Methods in Psychiatric Research, 27, e1585.
Beel, J. & Gipp, B. (2009). Google Scholar's ranking algorithm: an introductory overview. In Flory, A. & Collard, M. (eds.) Proceedings of the IEEE international conference on research challenges in information sciences, RCIS 2009. Piscataway: IEEE.
Bornmann, L., & Daniel, H. D. (2008). What do citation counts measure? A review of studies on citing behavior. Journal of Documentation, 64, 45–80.
Cano, V., & Lind, N. C. (1991). Citation life cycles of ten citation classics. Scientometrics, 22, 297–312.
DerSimonian, R., & Laird, N. (2015). Meta-analysis in clinical trials revisited. Contemporary Clinical Trials, 45, 139–145.
Falahati-Qadimi-Fumani, M. R., Goltaji, M., & Parto, P. (2015). The impact of title length and punctuation marks on article citations. Annals of Library and Information Studies, 62, 126–132.
Figg, W. D., Dunn, L., Liewehr, D. J., Steinberg, S. M., Thurman, P. W., Barrett, J. C., & Birkinshaw, J. (2006). Scientific collaboration results in higher citation rates of published articles. Pharmacotherapy, 26, 759–767.
Fox, C. W., & Burns, C. S. (2015). The relationship between manuscript title structure and success: Editorial decisions and citation performance for an ecological journal. Ecology and Evolution, 5, 1970–1980.
Goodman, N. W. (2000). Survey of active verbs in the titles of clinical trial reports. BMJ, 320, 914–915.
Guo, F., Ma, C., Shi, Q., & Zong, Q. (2018). Succinct effect or informative effect: The relationship between title length and the number of citations. Scientometrics, 116, 1531–1539.
Habibzadeh, F., & Yadollahie, M. (2010). Are shorter article titles more attractive for citations? Cross-sectional study of 22 scientific journals. Croatian Medical Journal, 51, 165–170.
Hamrick, T. A., Fricker, R. D., Jr., & Brown, G. G. (2010). Assessing what distinguishes highly cited from less-cited papers published in Interfaces. Interfaces, 40, 454–464.
Hopewell, S., Boutron, I., & Moher, D. (2020). CONSORT and its extensions for reporting clinical trials. In S. Piantadosi & C. L. Meinert (Eds.), Principles and practice of clinical trials. Cham: Springer International Publishing.
Jeong, G.-H., & Huh, S. (2014). Increase in frequency of citation by SCIE journals of non-Medline journals after listing in an open access full-text database. Science Editing, 1, 24–26.
Ke, Q. (2020). The citation disadvantage of clinical research. Journal of Informetrics, 14, 100998.
Kerans, M. E., Anne, M., & Sabatè, S. (2016). Content and phrasing in titles of original research and review articles in 2015: Range of practice in four clinical journals. Publications, 4, 11.
Kerans, M. E., Marshall, J., Murray, A., & Sabaté, S. (2020). Research article title content and form in high-ranked international clinical medicine journals. English for Specific Purposes, 60, 127–139.
Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Sage.
Morgan, P. P. (1983). The importance of being cited. Canadian Medical Association Journal, 129, 9.
Norman, E. R. (2012). Maximizing journal article citation online: Readers, robots, and research visibility. Politics and Policy, 40, 1–12.
PLoS Medicine Editors. (2009). A medical journal for the world's health priorities. PLOS Medicine, 6, e1000072.
Rossi, M. J., & Brand, J. C. (2020). Journal article titles impact their citation rates. Arthroscopy, 36, 2025–2029.
Schulz, K. F., Altman, D. G., & Moher, D. (2010). CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. PLoS Medicine, 7, e1000251.
Sollaci, L. B., & Pereira, M. G. (2004). The introduction, methods, results, and discussion (IMRAD) structure: A fifty-year survey. Journal of the Medical Library Association, 92, 364–367.
Tahamtan, I., Safipour Afshar, A., & Ahamdzadeh, K. (2016). Factors affecting number of citations: A comprehensive review of the literature. Scientometrics, 107, 1195–1225.
Urlings, M. J. E., Duyx, B., Swaen, G. M. H., Bouter, L. M., & Zeegers, M. P. (2021). Citation bias and other determinants of citation in biomedical research: Findings from six citation networks. Journal of Clinical Epidemiology, 132, 71–78.
Vieira, E. S., & Gomes, J. A. N. F. (2010). Citations to scientific articles: Its distribution and dependence on the article features. Journal of Informetrics, 4, 1–13.
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Author information
Authors and Affiliations
Contributions
NH: Formal analysis, Methodology, Supervision, Visualization, Writing—original draft, Writing—review and editing. AZ: Formal analysis, Methodology, Visualization, Writing—original draft, Writing—review & editing.
Corresponding author
Ethics declarations
Conflict of interest
There are no patents, products in development or marketed products to declare. AZ is a licensed Tim Albert trainer and has held several courses in the past based on Albert’s concept.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Heßler, N., Ziegler, A. Evidence-based recommendations for increasing the citation frequency of original articles. Scientometrics 127, 3367–3381 (2022). https://doi.org/10.1007/s11192-022-04378-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-022-04378-7