Integrating Approximate String Matching with Phonetic String Similarity
Well-defined dictionaries of tagged entities are used in many tasks to identify entities where the scope is limited and there is no need to use machine learning. One common solution is to encode the input dictionary into Trie trees to find matches on an input text. However, the size of the dictionary and the presence of spelling errors on the input tokens have a negative influence on such solutions. We present an approach that transforms the dictionary and each input token into a compact well-known phonetic representation. The resulting dictionary is encoded in a Trie that is about 72% smaller than a non-phonetic Trie. We perform inexact matching over this representation to filter a set of initial results. Lastly, we apply a second similarity measure to filter the best result to annotate a given entity. The experiments showed that it achieved good F1 results. The solution was developed as an entity recognition plug-in for GATE, a well-known information extraction framework.
KeywordsEntity recognition Metaphone Text tagging Trie Active nodes Fast similarity search
This work was partially funded by Project Sistema de Monitoramento de Políticas de Promoção da Igualdade Racial (SNPPIR).
- 1.Cunningham, H.: Information extraction, automatic. In: Encyclopedia of Language and Linguistics, 2nd edn. (2005)Google Scholar
- 4.Grishman, R., Sundheim, B.: Message understanding conference-6: a brief history. In: COLING, vol. 96, pp. 466–471 (1996)Google Scholar
- 5.Ji, S., Li, G., Li, C., Feng, J.: Efficient interactive fuzzy keyword search. In: Proceedings of the 18th WWW, WWW 2009, Madrid, Spain, pp. 371–380. ACM (2009)Google Scholar
- 7.Li, G., Ji, S., Li, C., Feng, J.: Efficient type-ahead search on relational data: a tastier approach. In: Proceedings of the 2009 ACM SIGMOD, SIGMOD 2009, Providence, Rhode Island, USA, pp. 695–706. ACM (2009)Google Scholar
- 11.Philips, L.: Hanging on the metaphone. Comput. Lang. Mag. 7(12), 38–44 (1990)Google Scholar
- 18.Zobel, J., Dart, P.: Phonetic string matching: lessons from information retrieval. In: The 19th SIGIR, SIGIR 1996, Zurich, Switzerland, pp. 166–172. ACM (1996)Google Scholar