Abstract
The combination of multiple classifiers to generate a single classifier has been shown to be very useful in practice. Similarly, several efforts have shown that cluster ensembles can improve the quality of results as compared to a single clustering solution. These observations suggest that ensembles containing both classifiers and clusterers are potentially useful as well. Specifically, clusterers provide supplementary constraints that can improve the generalization capability of the resulting classifier. This paper introduces a new algorithm named C 3 E that combines ensembles of classifiers and clusterers. Our experimental evaluation of C 3 E shows that it provides good classification accuracies in eleven tasks derived from three real-world applications. In addition, C 3 E produces better results than the recently introduced Bipartite Graph-based Consensus Maximization (BGCM) Algorithm, which combines multiple supervised and unsupervised models and is the algorithm most closely related to C 3 E.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Banerjee, A., Merugu, S., Dhillon, I., Ghosh, J.: Clustering with Bregman divergences. In: JMLR (2005)
Schlkopf, B., Zien, A., Chapelle, O.: Semi-Supervised Learning. MIT Press. Cambridge (2006)
Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)
Fern, X.Z., Brodley, C.E.: Solving cluster ensemble problems by bipartite graph partitioning. In: Proc. of the ICML, pp. 36–43 (2004)
Gao, J., Liang, F., Fan, W., Sun, Y., Han, J.: Graph-based consensus maximization among multiple supervised and unsupervised models. In: Proc. of NIPS, pp. 1–9 (2009)
Ghosh, J., Acharya, A.: Cluster ensembles. WIREs Data Mining and Knowledge Discovery 1, 1–12 (to appear 2011)
Kittler, J., Roli, F. (eds.): IPSN 2003. LNCS, vol. 2634. Springer, Heidelberg (2003)
Kuncheva, L.I.: Combining Pattern Classifiers: Methods and Algorithms. Wiley, Chichester (2004)
Oza, N., Tumer, K.: Classifier ensembles: Select real-world applications. Information Fusion 9(1), 4–20 (2008)
Punera, K., Ghosh, J.: Consensus based ensembles of soft clusterings. Applied Artificial Intelligence 22, 109–117 (2008)
Davidson, I., Basu, S., Wagstaff, K.L. (eds.): Clustering with Balancing Constraints. CRC Press, Boca Raton (2008)
Strehl, A., Ghosh, J.: Cluster ensembles – a knowledge reuse framework for combining multiple partitions. In: JMLR, vol. 617, pp. 583–617 (2002)
Tumer, K., Ghosh, J.: Analysis of decision boundaries in linearly combined neural classifiers. Pattern Recognition 29, 341–348 (1996)
Goldberg, A., Zhu, X.: Introduction to Semi-Supervised Learning. Morgan and Claypool Publishers, San Rafael (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Acharya, A., Hruschka, E.R., Ghosh, J., Acharyya, S. (2011). C 3E: A Framework for Combining Ensembles of Classifiers and Clusterers. In: Sansone, C., Kittler, J., Roli, F. (eds) Multiple Classifier Systems. MCS 2011. Lecture Notes in Computer Science, vol 6713. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21557-5_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-21557-5_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21556-8
Online ISBN: 978-3-642-21557-5
eBook Packages: Computer ScienceComputer Science (R0)