Text Comparison Using Soft Cardinality
The classical set theory provides a method for comparing objects using cardinality and intersection, in combination with well-known resemblance coefficients such as Dice, Jaccard, and cosine. However, set operations are intrinsically crisp: they do not take into account similarities between elements. We propose a new general-purpose method for comparison of objects using a soft cardinality function that show that the soft cardinality method is superior via an auxiliary affinity (similarity) measure. Our experiments with 12 text matching datasets suggest that the soft cardinality method is superior to known approximate string comparison methods in text comparison task.
KeywordsVector Space Model Cardinality Measure Cardinality Function Approximate String Match String Pair
Unable to display preview. Download preview PDF.
- 4.Cohen, W.W., Ravikumar, P., Fienberg, S.E.: A comparison of string distance metrics for name-matching tasks. In: Proceedings of the IJCAI-2003 Workshop on Information Integration on the Web (2003)Google Scholar
- 5.Baeza-Yates, R., Ribero-Neto, B.: Modern Information Retrieval. Addison Wesley/ACM Press (1999)Google Scholar
- 6.Jimenez, S.: A knowledge-based information extraction prototype for data-rich documents in the information technology domain. Master’s thesis, National University of Colombia (2008)Google Scholar