Clustering Ensemble for Categorical Geological Text Based on Diversity and Quality
Clustering analysis for geological text makes the navigation, retrieval or extraction of geological text more effectively. Clustering ensemble can be employed to obtain more robust clustering results. However, most generation approaches focus on the diversity of clustering members rather than their quality. Too much emphasis on the diversity of clustering members reduces the accuracy of clustering results. In order to solve the problem, a new generation method of clustering members is proposed in this paper. Hierarchical clustering algorithm and k-means algorithm alternately combined with random projection method are employed to generate diverse base members and a new selection strategy for the number of clusters is presented to improve the quality of clustering members. Furthermore, a clustering ensemble framework for geological text is constructed. The framework involves geological text preprocessing, geological text feature representation, clustering members generation and ensemble integration. Experimental results on two UCI datasets and one real-world geological text demonstrate that the clustering ensemble based on diversity and quality is superior to those clustering ensemble algorithms that only consider the diversity of clustering members.
KeywordsClustering ensemble Diversity Geological text Quality
This study is supported in part by National Natural Science Foundation of China (No. 41802247, 41862012), Open Fund of Jiangxi Engineering Laboratory on Radioactive Geoscience and Big data Technology (No. JELRGBDT201708, No. JELRGBDT201705), Key Research Development Foundation of Jiangxi Province Technology Department (No. 20161BBE50063).
- 3.Strehl, A., Ghosh, J.: Cluster ensemble-a knowledge reuse framework for combining multiple partitions. In: Proceedings of the 18th National Conference on Artificial Intelligence, pp. 93–98 (2002)Google Scholar
- 4.Jain, A.K., Topchy, A., Law, M.H., Buhmann, J.M.: Landscape of clustering algorithms. In: Proceedings of the 17th International Conference on Pattern Recognition, pp. 260–263 (2004)Google Scholar
- 5.Minaei-Bidgoli, B., Topchy, A., Punch, W.F.: Ensembles of partitions via data resampling. In: International Conference on Information Technology: Coding and Computing, p. 188 (2004)Google Scholar
- 7.Topchy, A., Jain, A.K., Punch, W.: Combining multiple weak clusterings. In: Proceedings of the Third IEEE International Conference on Data Mining, pp. 331–338 (2003)Google Scholar
- 8.Fern, X.Z., Brodley, C.E.: Random projection for high dimensional data clustering: a cluster ensemble approach. In: Twentieth International Conference on Machine Learning, pp. 186–193 (2003)Google Scholar