Calculating Impact Factor: How Bibliographical Classification of Journal Items Affects the Impact Factor of Large and Small Journals
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
As bibliographical classification of published journal items affects the denominator in this equation, we investigated how the numerator and denominator of the impact factor (IF) equation were generated for representative journals in two categories of the Journal Citation Reports (JCR). We performed a full text search of the 1st-ranked journal in 2004 JCR category “Medicine, General and Internal” (New England Journal of Medicine, NEJM, IF = 38.570) and 61st-ranked journal (Croatian Medical Journal, CMJ, IF = 0.690), 1st-ranked journal in category “Multidisciplinary Sciences” (Nature, IF = 32.182) and journal with a relative rank of CMJ (Anais da Academia Brasileira de Ciencias, AABC, IF = 0.435). Large journals published more items categorized by Web of Science (WoS) as non-research items (editorial material, letters, news, book reviews, bibliographical items, or corrections): 63% out of total 5,193 items in Nature and 81% out of 3,540 items in NEJM, compared with 31% out of 283 items in CMJ and only 2 (2%) out of 126 items in AABC. Some items classified by WoS as non-original contained original research data (9.5% in Nature, 7.2% in NEJM, 13.7% in CMJ and none in AABC). These items received a significant number of citations: 6.9% of total citations in Nature, 14.7% in NEJM and 18.5% in CMJ. IF decreased for all journals when only items presenting original research and citations to them were used for IF calculation. Regardless of the journal’s size or discipline, publication of non-original research and its classification by the bibliographical database have an effect on both numerator and denominator of the IF equation.
- Garfield, E. (2006). The history and meaning of the journal impact factor. JAMA, 295, 90–93. CrossRef
- Seglen, P. O. (1997). Why the impact factor of journals should not be used for evaluating research. BMJ, 314, 498–502.
- Joseph, K. S., & Hoey, J. (1999). CMAJ’s impact factor: Room for recalculation. CMAJ, 161, 977–978.
- Joseph, K. S. (2003). Quality of impact factors of general medical journals. BMJ, 326, 283. CrossRef
- Adam, D. (2002). The counting house. Nature, 415, 726–729.
- The PLoS Medicine Editors (2006). The impact factor game. PLoS Medicine, 3, e291. CrossRef
- Brown, H. (2007). How impact factor changed medical publishing—and science. BMJ, 334, 561–564. CrossRef
- Walter, G., Bloch, S., Hunt, G., & Fisher, K. (2003) Counting on citations: A flawed way to measure quality. MJA, 178, 280–281.
- Lundberg, G. D. (2003). The “omnipotent” science citation index impact factor. MJA, 178, 253–254.
- Nankivell, B. J., et al. (2003). The natural history of chronic allograft nephropathy. The New England Journal of Medicine, 349, 2326–2233. CrossRef
- Marusic, A., & Marusic, M. (2003). Teaching students how to read and write science: Mandatory course on scientific research and communication in medicine. Academic Medicine, 78, 1235–1239. CrossRef
- Martinson, B. C., Anderson, M. S., & de Vries, R. (2005). Scientists behaving badly. Nature, 435, 737–738. CrossRef
- Williams, G., & Hobbs R. (2007). Should we ditch impact factors? BMJ, 334, 568–569. CrossRef
- Dellavalle, R. P., Schilling, L. M., Rodriguez, M. A., Van de Sompel J., & Bollen J. (2007). Refining dermatology journal impact factors using PageRank. Journal of the American Academy of Dermatology, 57, 116–119. CrossRef
- Thomson Scientific (2005). Journal performance indicators. Available at: http://www.scientific.thomson.com/products/jpi/. Accessibility verified October 19, 2007.
- Calculating Impact Factor: How Bibliographical Classification of Journal Items Affects the Impact Factor of Large and Small Journals
Science and Engineering Ethics
Volume 14, Issue 1 , pp 41-49
- Cover Date
- Print ISSN
- Online ISSN
- Springer Netherlands
- Additional Links
- Impact factor
- Bibliographical database
- Author Affiliations
- 1. Department of Occupational Medicine, Andrija Stampar School of Public Health, Zagreb University School of Medicine, Zagreb, Croatia
- 2. Department of ENT, Zagreb University Hospital Center, Zagreb, Croatia
- 3. Croatian Medical Journal, Zagreb University School of Medicine, Salata 3, 10000, Zagreb, Croatia