Abstract
Combination of multiple classifiers has been shown to increase classification accuracy in many application domains. Besides, the use of cluster analysis techniques in supervised classification tasks has shown that they can enhance the quality of the classification results. This is based on the fact that clusters can provide supplementary constraints that may improve the generalization capability of the classifiers. In this paper we introduce a new classifier combination scheme which is based on the Decision Templates Combiner. The proposed scheme uses the same concept of representing the classifiers decision as a vector in an intermediate feature space and builds more representatives decision templates by using clustering ensembles. An experimental evaluation was carried out on several synthetic and real datasets. The results show that the proposed scheme increases the classification accuracy over the Decision Templates Combiner, and other classical classifier combinations methods.
Chapter PDF
Similar content being viewed by others
References
Kuncheva, L.I.: Combining Pattern Classifiers. Methods and Algorithms. John Wiley & Sons, New York (2004)
Vega-Pons, S., Ruiz-Shulcloper, J.: A survey of clustering ensemble algorithms. International Journal of Pattern Recognition and Artificial Intelligence 25(3), 337–372 (2011)
Jurek, A., Bi, Y., Wu, S., Nugent, C.: Classification by Cluster Analysis: A New Meta-Learning Based Approach. In: Sansone, C., Kittler, J., Roli, F. (eds.) MCS 2011. LNCS, vol. 6713, pp. 259–268. Springer, Heidelberg (2011)
Gao, J., Liangy, F., Fanz, W., Sun, Y., Han, J.: Graph-based consensus maximization among multiple supervised and unsupervised models. In: 23rd Annual Conference on Neural Information Processing Systems, pp. 1–9 (2009)
Ma, X., Luo, P., Zhuang, F., He, Q., Shi, Z., Shen, Z.: Combining supervised and unsupervised models via unconstrained probabilistic embedding. In: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence (2011)
Acharya, A., Hruschka, E.R., Ghosh, J., Acharyya, S.: C 3E: A Framework for Combining Ensembles of Classifiers and Clusterers. In: Sansone, C., Kittler, J., Roli, F. (eds.) MCS 2011. LNCS, vol. 6713, pp. 269–278. Springer, Heidelberg (2011)
Xu, L., Krzyzak, A., Suen, C.: Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Transactions on Systems, Man and Cybernetics 22(3), 418–435 (1992)
Kuncheva, L.: Combining classifiers: Soft computing solutions, pp. 427–452. World Scientific (2001)
Rogova, G.: Combining the results of several neural network classifiers. Neural Networks 7(5), 777–781 (1994)
Kuncheva, L., Bezdek, J., Duin, R.: Decision templates for multiple classifier fusion: an experimental comparison. Pattern Recognition 34(2), 299–314 (2001)
Frank, A., Asuncion, A.: UCI machine learning repository (2010), http://archive.ics.uci.edu/ml
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The weka data mining software: An update. SIGKDD Explorations 11(1) (2009)
Fred, A., Jain, A.: Combining multiple clustering using evidence accumulation. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(6), 835–850 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Duval-Poo, M.A., Sosa-García, J., Guerra-Gandón, A., Vega-Pons, S., Ruiz-Shulcloper, J. (2012). A New Classifier Combination Scheme Using Clustering Ensemble. In: Alvarez, L., Mejail, M., Gomez, L., Jacobo, J. (eds) Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. CIARP 2012. Lecture Notes in Computer Science, vol 7441. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33275-3_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-33275-3_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33274-6
Online ISBN: 978-3-642-33275-3
eBook Packages: Computer ScienceComputer Science (R0)