Bibliographic coupling, common abstract stems and clustering: A comparison of two document-document similarity approaches in the context of science mapping
This paper deals with two document-document similarity approaches in the context of science mapping: bibliographic coupling and a text approach based on the number of common abstract stems. We used 43 articles, published in the journal Information Retrieval, as test articles. An information retrieval expert performed a classification of these articles. We used the cosine measure for normalization, and the complete linkage method was used for clustering the articles. A number of articles pairs were ranked (1) according to descending normalized coupling strength, and (2) according to descending normalized frequency of common abstract stems. The degree of agreement between the two obtained rankings was low, as measured by Kendall’s tau. The agreement between the two cluster solutions, one for each approach, was fairly low, according to the adjusted Rand index. However, there were examples of perfect agreement between the coupling solution and the stems solution. The classification generated by the expert contained larger groups compared to the coupling and stems solutions, and the agreement between the two solutions and the classification was not high. According to the adjusted Rand index, though, the stems solution was a better approximation of the classification than the coupling solution. With respect to cluster quality, the overall Silhouette value was slightly higher for the stems solution. Examples of homogeneous cluster structures, as well as negative Silhouette values, were found with regard to both solutions. The expert classification indicates that the field of information retrieval, as represented by one volume of articles published in Information Retrieval, is fairly heterogeneous regarding research themes, since the classification is associated with 15 themes. The complete linkage method, in combination with the upper tail rule, gave rise to a fairly good approximation of the classification with respect to the number of identified groups, especially in case of the stems approach.
KeywordsCluster Solution Adjusted Rand Index Test Article Bibliographic Coupling Coupling Solution
Unable to display preview. Download preview PDF.
- Boyce, B., Meadow, C., Kraft, D. (1994). Measurement in Information Science. San Diego: Academic press.Google Scholar
- Calado, P., Cristo, M., Moura, E., Ziviani, N., Ribeiro-Neto, B., Gonçalves, M. (2003). Combining link-based and content-based methods for web document classification. In: Proceedings of the 12th ACM International Conference on Information and Knowledge Management, 394–401.Google Scholar
- Couto, T., Cristo, M., Gonçalves, M., Calado, P., Ziviani, N., Moura, E., Ribeiro-Neto, B. (2006). A Comparative study of citations and links in document classification. In: Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries, 75–84.Google Scholar
- Everitt, B., Landau, S., Leese, M. (2001). Cluster Analysis. 4th ed. London: Arnold.Google Scholar
- Janssens, F., Tran Quoc, V., Glänzel, W., De Moor, B. (2006). Integration of textual content and link information for accurate clustering of science fields. In: InSCit2006, Current Research in Information Sciences and Technologies: Multidsciplinary Approaches to Global Information Systems (Volume I). Badajoz: Open Institute of Knowledge, pp. 615–619.Google Scholar
- Kaufman, L., Rousseeuw, P. (1990). Finding Groups in Data: An Introduction to Cluster Analysis. New York: John Wiley & Sons.Google Scholar
- Porter, M. (2001). Snowball: A language for stemming algorithms. URL http://snowball.tartarus.org/texts/introduction.html. Visited June 22nd, 2007.
- Stopword List 1 (2000). The reference created 2007-08-04. URL: http://www.lextek.com/manuals/onix/stopwords1.html.
- Vladutz, G., Cook, J. (1984). Bibliographic coupling and subject relatedness. Proceedings of the 47th ASIS Annual Meeting, 21, 204–207.Google Scholar
- Wishart, D. (2005). Number of clusters. In: Everitt, B., Howell, D. (Eds), Encyclopedia of Statistics in Behavioral Science. Chichester: John Wiley & Sons, 1442–1446.Google Scholar
- Wishart, D. (2006). ClustanGraphics Primer: A Guide to Cluster Analysis. Edinburgh: Clustan Limited.Google Scholar