Set Analysis of Coincident Errors and Its Applications for Combining Classifiers
There is a common agreement in many recent publications related to pattern recognition that dependency among classifier outputs plays a key role in combining classifiers –. Diversity, independence, disagreement and most recently negative dependency are the terms often used to express a desirable relation among classifiers to ensure the maximum improvement of the fusion system –. In this variety of concepts the idea is the same: how to measure relationship among classifiers from their outputs so that it is possible to say something about the combined classifier performance? Recent investigations indicate that error coincidences seem to be the most valuable information in this pursuit –.
KeywordsMajority Vote Venn Diagram Binary Matrix Linear Classifier Correlation Curve
Unable to display preview. Download preview PDF.
- L.I. Kuncheva, C.J. Whitaker, Ten Measures of Diversity in Classifier Ensembles: Limits for Two Classifiers. IEE Workshop on Intelligent Sensor Processing, Birmingham (2001), 10/1–10/6.Google Scholar
- C.A. Shipp, L.I. Kuncheva, Relationships between combination methods and measures of diversity in combining classifiers. Information Fusion, accepted.Google Scholar
- D. Ruta, B. Gabrys, Analysis of the Correlation Between Majority Voting Errors and the Diversity Measures in Multiple Classifier Systems. In Proceedings of the SOCO/ISFI2001 Conference, ISBN: 3–906454–27–4, Abstract page 50, Paper No. #1824–025, Paisley, UK, 2001.Google Scholar
- F. Ruskey, A Survey of Venn Diagrams. The Electronic Journal of Combinatorics eds. March 2001, (the electronic version available at: http://www.combinatorics.org/Surveys/ds5/VennEJC.html).Google Scholar
- D. Ruta, B. Gabrys. A theoretical analysis of the limits of majority voting errors for multiple classifier systems. To appear in Pattern Analysis and Applications.Google Scholar
- L.I. Kuncheva, C.J. Whitaker, C.A. Shipp, R.P.W Duin, Limits on the majority vote accuracy in classifier fusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, accepted.Google Scholar