Exploring the bibliometric and semantic nature of negative results
- 573 Downloads
Negative results are not popular to disseminate. However, their publication would help to save resources and foster scientific communication. This study analysed the bibliometric and semantic nature of negative results publications. The Journal of Negative Results in Biomedicine (JNRBM) was used as a role model. Its complete articles from 2002–2009 were extracted from SCOPUS and supplemented by related records. Complementary negative results records were retrieved from Web of Science in “Biochemistry” and “Telecommunications”. Applied bibliometrics comprised of co-author and co-affiliation analysis and a citation impact profile. Bibliometrics showed that authorship is widely spread. A specific community for the publication of negative results in devoted literature is non-existent. Neither co-author nor co-affiliation analysis indicated strong interconnectivities. JNRBM articles are cited by a broad spectrum of journals rather than by specific titles. Devoted negative results journals like JNRBM have a rather low impact measured by the number of received citations. On the other hand, only one-third of the publications remain uncited, corroborating their importance for the scientific community. The semantic analysis relies on negative expressions manually identified in JNRBM article titles and abstracts and extracted to syntactic patterns. By using a Natural Language Processing tool these patterns are then employed to detect their occurrences in the multidisciplinary bibliographical database PASCAL. The translation of manually identified negation patterns to syntactic patterns and their application to multidisciplinary bibliographic databases (PASCAL, Web of Science) proved to be a successful method to retrieve even hidden negative results. There is proof that negative results are not only restricted to the biomedical domain. Interestingly a high percentage of the so far identified negative results papers were funded and therefore needed to be published. Thus policies that explicitly encourage or even mandate the publication of negative results could probably bring about a shift in the current scientific communication behaviour.
KeywordsBibliometrics Scientometrics Negative result publication S&T information Semantic analysis Publication bias
- Aucouturier, J. J., & Pachet, F. (2004). Improving timbre similarity: How high is the sky? Journal of Negative Results in Speech and Audio Sciences, 1, 1.Google Scholar
- González-Pereira, B., Guerrero-Bote, V. P., Moya-Anegón, F. de (2010). A new approach to the metric of journals’ scientific prestige: The SJR indicator. Journal of Informetrics 4(3), 379–391. http://arxiv.org/ftp/arxiv/papers/0912/0912.4141.pdf. Accessed 23 April 2012.Google Scholar
- Kopcsa, A., Schiebel, E. (2001). Content Visualisation by BibTechMon™. In Informatics 2001/Network Economy-Visions and Reality, OCG-Austrian Computer Society.Google Scholar
- Morante, R., Daelemans, W. (2009). A metalearning approach to processing the scope of negation. In Proceedings of the Thirteenth Conference on Computational Natural Language Learning, pages 21–29.Google Scholar
- Newman, M. E. J. (2008). The mathematics of networks. The New Palgrave Encyclopedia of Economics. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.131.8175&rep=rep1&type=pdf (Accessed 2012-07-12).
- Scargle, J. D. (2000). Publication bias: the “file-drawer” problem in scientific inference. Journal of Scientific Exploration, 14(1), 91–106.Google Scholar