On the Status of Experimental Research on the Semantic Web
Experimentation is an important way to validate results of Semantic Web and Computer Science research in general. In this paper, we investigate the development and the current status of experimental work on the Semantic Web. Based on a corpus of 500 papers collected from the International Semantic Web Conferences (ISWC) over the past decade, we analyse the importance and the quality of experimental research conducted and compare it to general Computer Science. We observe that the amount and quality of experiments are steadily increasing over time. Unlike hypothesised, we cannot confirm a statistically significant correlation between a paper’s citations and the amount of experimental work reported. Our analysis, however, shows that papers comparing themselves to other systems are more often cited than other papers.
- 1.Popper, K.: The logic of scientific discovery. Routledge (2002)Google Scholar
- 3.Wright, D.: Motivation, design, and ubiquity: A discussion of research ethics and computer science. arXiv preprint arXiv:0706.0484 (2007)Google Scholar
- 10.Pinelle, D., Gutwin, C.: A review of groupware evaluations. In: Proeedings of the IEEE 9th International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises (WET ICE 2000), pp. 86–91. IEEE (2000)Google Scholar
- 13.Bauer, K., Bakkalbasi, N.: An examination of citation counts in a new scholarly communication environment. D-Lib Magazine (2005)Google Scholar
- 15.Viera, A.J., Garrett, J.M.: Understanding interobserver agreement: The kappa statistic. Fam. Med. 37, 360–363 (2005)Google Scholar