Substance without citation: evaluating the online impact of grey literature
- 820 Downloads
Individuals and organisations producing information or knowledge for others sometimes need to be able to provide evidence of the value of their work in the same way that scientists may use journal impact factors and citations to indicate the value of their papers. There are many cases, however, when organisations are charged with producing reports but have no real way of measuring their impact, including when they are distributed free, do not attract academic citations and their sales cannot be tracked. Here, the web impact report (WIRe) is proposed as a novel solution for this problem. A WIRe consists of a range of web-derived statistics about the frequency and geographic location of online mentions of an organisation’s reports. WIRe data is typically derived from commercial search engines. This article defines the component parts of a WIRe and describes how to collect and analyse the necessary data. The process is illustrated with a comparison of the web impact of the reports of a large UK organisation. Although a formal evaluation was not conducted, the results suggest that WIRes can indicate different levels of web impact between reports and can reveal the type of online impact that the reports have.
KeywordsGrey literature Web impact Webometrics
This research is part of the FP7 EU-funded project ACUMEN on assessing web indicators in research evaluation.
- Baumgartner, F. (2007). Punctuated equilibrium theory and environmental policy. In R. Repetto (Ed.), Punctuated equilibrium models and environmental policy (pp. 97–116). New Haven: Yale University Press.Google Scholar
- Cronin, B., & Shaw, D. (2002). Banking (on) different forms of symbolic capital. Journal of the American Society for the Information Science, 53(13), 1267–1270.Google Scholar
- Dutton, W. H., & Elsper, E. J. (2007). The Internet in Britain 2007. Oxford: Oxford Internet Institute.Google Scholar
- Geisler, E. (2000). The metrics of science and technology. Westport, CT: Quorum Books.Google Scholar
- Moed, Hf. (2005). Citation analysis in research evaluation. New York: Springer.Google Scholar
- Neuendorf, K. (2002). The content analysis guidebook. London: Sage.Google Scholar
- Thelwall, M. (2009). Introduction to webometrics: Quantitative web research for the social sciences. New York: Morgan & Claypool.Google Scholar