Automatic Discovery of Similar Words

  • Pierre P. Senellart
  • Vincent D. Blondel


We deal with the issue of automatic discovery of similar words (synonyms and near-synonyms) from different kinds of sources: from large corpora of documents, from the Web, and from monolingual dictionaries. We present in detail three algorithms that extract similar words from a large corpus of documents and consider the specific case of the World Wide Web. We then describe a recent method of automatic synonym extraction in a monolingual dictionary. The method is based on an algorithm that computes similarity measures between vertices in graphs. We use the 1913 Websters Dictionary and apply the method on four synonym queries. The results obtained are analyzed and compared with those obtained by two other methods.


Similar Word Neighborhood Graph Automatic Discovery Cosine Similarity Measure Term Frequency Inverse Document Frequency 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [BP98]
    S. Brin and L. Page.The anatomy of a large-scale hypertextual Web search engine.Computer Networks and ISDN Systems, 30 (1–7): 107–117, 1998.CrossRefGoogle Scholar
  2. [BS01]
    V.D. Blondel and P.P. Senellart.Automatic extraction of synonyms in a dictionary.Technical Report 89, Université catholique de Louvain, Louvain-la-neuve, Belgium, 2001. Presented at the Text Mining Workshop 2002 in Arlington, VA.Google Scholar
  3. [BV02]
    V.D. Blondel and P. Van Dooren.A measure of graph similarity between graph vertices.Technical Report, Université catholique de Louvain, Louvain-la-neuve, Belgium, 2002.Google Scholar
  4. [CL92]
    H. Chen and K.J. Lynch.Automatic construction of networks of concepts characterizing document databases.IEEE Transactions on Systems, Man and Cybernetics, 22 (5): 885–902, 1992.CrossRefGoogle Scholar
  5. [Cro90]
    C.J. Crouch.An approach to the automatic construction of global thesauri.Information Processing and Management, 26: 629–640, 1990.CrossRefGoogle Scholar
  6. [DH99]
    J. Dean and M.R. Henzinger.Finding related pages in the World Wide Web. WWW8/Computer Networks, 31 (11–16): 1467–1479, 1999.MathSciNetCrossRefGoogle Scholar
  7. [Gre93]
    G. Grefenstette.Automatic thesaurus generation from raw text using knowledge-poor techniques.In Making Sense of Words. Ninth Annual Conference of the UW Centre for the New OED and Text Research. 9, 1993.Google Scholar
  8. [Gre94]
    G. Grefenstette.Explorations in Automatic Thesaurus Discovery.Kluwer Academic, Boston, 1994.Google Scholar
  9. [Hey01]
    M. Heymans.Extraction d’information dans les graphes, et application aux moteurs de recherche sur interne, Jun 2001. Université Catholique de Louvain, Faculté des Sciences Appliquées, Département d’Ingénierie Mathématique.Google Scholar
  10. JW99] J. Jannink and G. Wiederhold.Thesaurus entry extraction from an on-line dictionary.In Proceedings of Fusion ‘89,Sunnyvale, CA, Jul 1999.Google Scholar
  11. [K1e99]
    J.M. Kleinberg.Authoritative sources in a hyperlinked environment. Journal of the ACM, 46 (5): 604–632, 1999.MathSciNetCrossRefGoogle Scholar
  12. [OPT00]
    The online plain text english dictionary, 2000.http: //msowww. anu. edu. au/ralph/OPTED/.Google Scholar
  13. [Sen01]
    P. P. Senellart.Extraction of information in large graphs. Automatic search for synonyms.Technical Report 90, Université catholique de Louvain, Louvain-laneuve, Belgium, 2001.Google Scholar
  14. [SYY75]
    G. Salton, C.S. Yang, and C.T. Yu.A theory of term importance in automatic text analysis. Journal of the American Society for Information Science, 26 (1): 33–44, 1975.CrossRefGoogle Scholar
  15. [Tur01]
    P. D. Turney.Mining the Web for synonyms: PMI-IR versus LSA on TOEFL.In Proceedings of the European Conference on Machine Learning, pages 491–502, 2001.Google Scholar
  16. [Wor98]
    Wordnet 1.6, 1998.

Copyright information

© Springer Science+Business Media New York 2004

Authors and Affiliations

  • Pierre P. Senellart
  • Vincent D. Blondel

There are no affiliations available

Personalised recommendations