Reduction of the Boasting Bias of Linear Experts

  • Arūnas Janeliūnas
  • Šarūnas Raudys
Conference paper

DOI: 10.1007/3-540-45428-4_24

Part of the Lecture Notes in Computer Science book series (LNCS, volume 2364)
Cite this paper as:
Janeliūnas A., Raudys Š. (2002) Reduction of the Boasting Bias of Linear Experts. In: Roli F., Kittler J. (eds) Multiple Classifier Systems. MCS 2002. Lecture Notes in Computer Science, vol 2364. Springer, Berlin, Heidelberg

Abstract

If no large design data set is available to design the Multiple classifier system, one typically uses the same data set to design both the expert classifiers and the fusion rule. In that case, the experts form an optimistically biased training data for a fusion rule designer. We consider standard Fisher linear and Euclidean distance classifiers used as experts and the single layer perceptron as a fusion rule. Original bias correction terms of experts’ answers are derived for these two types of expert classifiers under assumptions of high-variate Gaussian distributions. In addition, noise injection as a more universal technique is presented. Experiments with specially designed artificial Gaussian and real-world medical data showed that the theoretical bias correction works well in the case of high-variate artificial data and the noise injection technique is more preferable in the real-world problems.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Arūnas Janeliūnas
    • 1
  • Šarūnas Raudys
    • 2
  1. 1.Department of Mathematics and Computer ScienceVilniusLithuania
  2. 2.Vilnius Gediminas Technical UniversityVilniusLithuania

Personalised recommendations