Chapter

Information Retrieval Technology

Volume 3689 of the series Lecture Notes in Computer Science pp 374-387

An Incremental Document Clustering for the Large Document Database

  • Kil Hong JooAffiliated withDept. of Computer Education, Gyeongin National University of Education
  • , Won Suk LeeAffiliated withDept. of Computer Science, Yonsei University

* Final gross prices may vary according to local VAT.

Get Access

Abstract

With the development of the internet and computer, the amount of information through the internet is increasing rapidly and it is managed in document form. For this reason, the research into the method to manage for a large amount of document in an effective way is necessary. The document clustering is integrated documents to subject by classifying a set of documents through their similarity among them. Accordingly, the document clustering can be used in exploring and searching a document and it can increase accuracy of search. This paper proposes an efficient incremental clustering algorithm for a set of documents increase gradually. The incremental document clustering algorithm assigns a set of new documents to the legacy clusters which have been identified in advance. In addition, to improve the correctness of the clustering, removing the stop words can be proposed and the weight of the word can be calculated by the proposed TF × NIDF function. In this paper, the performance of the proposed method is analyzed by a series of experiments to identify their various characteristics.