Scientometrics

, Volume 76, Issue 2, pp 391–406 | Cite as

An investigation into diabetes researcher’s perceptions of the Journal Impact Factor — reconsidering evaluating research

  • Eva M. Sønderstrup-Andersen
  • Hans H. K. Sønderstrup-Andersen
Article

Abstract

Currently the Journal Impact Factors (JIF) attracts considerable attention as components in the evaluation of the quality of research in and between institutions. This paper reports on a questionnaire study of the publishing behaviour and researchers preferences for seeking new knowledge information and the possible influence of JIF on these variables. 54 Danish medical researchers active in the field of Diabetes research took part. We asked the researchers to prioritise a series of scientific journals with respect to which journals they prefer for publishing research and gaining new knowledge. In addition we requested the researchers to indicate whether or not the JIF of the prioritised journals has had any influence on these decisions. Furthermore we explored the perception of the researchers as to what degree the JIF could be considered a reliable, stable or objective measure for determining the scientific quality of journals. Moreover we asked the researchers to judge the applicability of JIF as a measure for doing research evaluations. One remarkable result is that app. 80% of the researchers share the opinion that JIF does indeed have an influence on which journals they would prefer for publishing. As such we found a statistically significant correlation between how the researchers ranked the journals and the JIF of the ranked journals. Another notable result is that no significant correlation exists between journals where the researchers actually have published papers and journals in which they would prefer to publish in the future measured by JIF. This could be taken as an indicator for the actual motivational influence on the publication behaviour of the researchers. That is, the impact factor actually works in our case. It seems that the researchers find it fair and reliable to use the Journal Impact Factor for research evaluation purposes.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Garfield, E. (1955). The preparation of printed indexes by automatic punched-card techniques. American Documentation, 6(2): 68–76. Reprinted in Essays of an Information Scientist, (1983), 6: 459. Found at http://www.garfield.library.upenn.edu/essays/v6p459y1983.pdf CrossRefGoogle Scholar
  2. Garfield, E. (1972). Citation analysis as a tool in journal evaluation. Science, 178: 471–479. Found at http://www.garfield.library.upenn.edu/essays/V1p527y1962-73.pdf CrossRefGoogle Scholar
  3. Lewison, G. (2002). Researchers’ and user’ perceptions of the relative standing of biomedical papers in different journals. Scientometrics, 53(2): 229–240.CrossRefGoogle Scholar
  4. MacRoberts, M. & MacRoberts, B. R. (1989). Problems of citation analysis: A critical review. Journal of the American Society for Information Science, 40(5): 342–349.CrossRefGoogle Scholar
  5. Maier, G. (2006). Impact factors and peer judgment: The case of regional science journal. Scientometrics, 69(3): 651–667.CrossRefGoogle Scholar
  6. Seglen, Per O. (1997). Why the impact factor should not be used for evaluating research. BMJ, 14: 497. Found at http://www.bmj.com/cgi/content/full/314/7079/497 Google Scholar

Databases and web-sites

  1. EMBASE® (1993–). Elsevier Science B.V. (producer). Hosted by Dialog® (file 72) at www: http://www.dialogclassic.com (password protected)
  2. MEDLINE®. (1990–). U.S. National Library of Medicin/NLM (producer). Hosted by Dialog® (file 154) at www: http://www.dialogclassic.com (password protected)
  3. PubMed® (1966–). U.S. National Library of Medicin/NLM (producer). Found at www: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  4. HONSelect (4. September 2003). Health On the Net Foundation (producer). Found at www: http://www.hon.ch/HONselect
  5. Journal Citation Reports. ISI Web of Knowledge. Found at www: http://portal15.isiknowledge.com/portal.cgi?DestApp=JCR&Func=Frame (password protected)
  6. Lægeforeningens Vejviser Online. Den Almindelige Danske Lægeforening. Found at www: http://www.dadlnet.dk/2laegeforeningen/vejviser/senest6x8.html (password protected)
  7. Lægemiddelkataloget Online (updated 9 may 2005). Dansk Lægemiddel Information A/S. Found at www: http://www.lmk.dk
  8. NetDoktor.dk (1998–2006) NetDoktor A/S (producer). Found at www: http://www.netdoktor.dk
  9. sundhed.dk. (2004). Amterne — Indenrigs — og Sundhedsministeriet — Hovedstadens Sygehusfællesskab — Københavns Kommune — Frederiksberg Kommune — Apotekerne [producer]. Found at www: http://www.sundhed.dk/wps/portal/_s.155/1836
  10. sundhedsguiden.dk. (2005). Patient Link A/S in cooperation with Kuratorium Zur Förderung Deutscher Medizin im Ausland (www.committee-german-medicine.de). Found at www: http://www.sundhedsguiden.dk/fagbeskrivelse

Copyright information

© Springer Science+Business Media B.V. 2008

Authors and Affiliations

  • Eva M. Sønderstrup-Andersen
    • 1
    • 3
  • Hans H. K. Sønderstrup-Andersen
    • 2
  1. 1.Roskilde Psychiatric Hospital Special LibraryRoskildeDenmark
  2. 2.National Research Centre for the Working EnvironmentCopenhagenDenmark
  3. 3.Danish Library Agency, Copenhagen, H.C.CopenhagenDenmark

Personalised recommendations