Analysis and Improvements of the Classifier Error Estimate in XCSF

  • Daniele Loiacono
  • Jan Drugowitsch
  • Alwyn Barry
  • Pier Luca Lanzi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4998)

Abstract

The estimation of the classifier error plays a key role in accuracy-based learning classifier systems. In this paper we study the current definition of the classifier error in XCSF and discuss the limitations of the algorithm that is currently used to compute the classifier error estimate from online experience. Subsequently, we introduce a new definition for the classifier error and apply the Bayes Linear Analysis framework to find a more accurate and reliable error estimate. This results in two incremental error estimate update algorithms that we compare empirically to the performance of the currently applied approach. Our results suggest that the new estimation algorithms can improve the generalization capabilities of XCSF, especially when the action-set subsumption operator is used.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Drugowitsch, J., Barry, A.: A formal framework and extensions for function approximation in learning classifier systems. Machine Learning 70(1), 45–88 (2008)CrossRefGoogle Scholar
  2. 2.
    Glantz, S.A., Slinker, B.K.: Primer of Applied Regression & Analysis of Variance, 2nd edn. McGraw Hill, New York (2001)Google Scholar
  3. 3.
    Goldstein, M.: Bayes linear analysis. In: Kotz, S., Read, C.B., Banks, D.L. (eds.) Encyclopedia of Statistical Sciences, vol. 3, pp. 29–34. Wiley, New York (1999)Google Scholar
  4. 4.
    Lanzi, P.L., Loiacono, D., Wilson, S.W., Goldberg, D.E.: Extending XCSF beyond linear approximation. In: Genetic and Evolutionary Computation – GECCO-2005. ACM Press, Washington (2005)Google Scholar
  5. 5.
    Lanzi, P.L., Loiacono, D., Wilson, S.W., Goldberg, D.E.: XCS with Computed Prediction for the Learning of Boolean Functions. In: Proceedings of the IEEE Congress on Evolutionary Computation – CEC-2005, Edinburgh, UK. IEEE Computer Society Press, Los Alamitos (2005)Google Scholar
  6. 6.
    Lanzi, P.L., Loiacono, D., Wilson, S.W., Goldberg, D.E.: Prediction update algorithms for XCSF: RLS, kalman filter, and gain adaptation. In: GECCO 2006: Proceedings of the 8th annual conference on Genetic and evolutionary computation, pp. 1505–1512. ACM Press, New York (2006)Google Scholar
  7. 7.
    Lanzi, P.L., Loiacono, D., Wilson, S.W., Goldberg, D.E.: Generalization in the XCSF classifier system: Analysis, improvement, and extension. Evolutionary Computation 15(2), 133–168 (2007)CrossRefGoogle Scholar
  8. 8.
    Loiacono, D., Marelli, A., Lanzi, P.L.: Support vector regression for classifier prediction. In: GECCO 2007: Proceedings of the 9th annual conference on Genetic and evolutionary computation, pp. 1806–1813. ACM Press, New York (2007)Google Scholar
  9. 9.
    Weisstein, E.W.: Sherman-morrison formula. From MathWorld–A Wolfram Web Resource, http://mathworld.wolfram.com/Sherman-MorrisonFormula.html
  10. 10.
    Widrow, B., Hoff, M.E.: Neurocomputing: Foundation of Research. In: Adaptive Switching Circuits, pp. 126–134. MIT Press, Cambridge (1988)Google Scholar
  11. 11.
    Wilson, S.W.: Classifier Fitness Based on Accuracy. Evolutionary Computation 3(2), 149–175 (1995)CrossRefGoogle Scholar
  12. 12.
    Wilson, S.W.: Classifiers that approximate functions. Journal of Natural Computing 1(2-3), 211–234 (2002)MathSciNetCrossRefMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Daniele Loiacono
    • 1
  • Jan Drugowitsch
    • 2
  • Alwyn Barry
    • 2
  • Pier Luca Lanzi
    • 1
    • 3
  1. 1.Artificial Intelligence and Robotics Laboratory (AIRLab)Politecnico di MilanoMilanoItaly
  2. 2.Department of Computer ScienceUniversity of BathUK
  3. 3.Illinois Genetic Algorithm Laboratory (IlliGAL)University of Illinois at Urbana ChampaignUrbanaUSA

Personalised recommendations