An Introduction to Anticipatory Classifier Systems
Anticipatory Classifier Systems (ACS) are classifier systems that learn by using the cognitive mechanism of anticipatory behavioral control which was introduced in cognitive psychology by Hoffmann . They can learn in deterministic multi-step environments.1 A stepwise introduction to ACS is given. We start with the basic algorithm and apply it in simple “woods” environments. It will be shown that this algorithm can only learn in a special kind of deterministic multi-step environments. Two extensions are discussed. The first one enables an ACS to learn in any deterministic multi-step environment. The second one allows an ACS to deal with a special kind of non-Markov state.
KeywordsGoal State Learn Classifier System Knowledge Number Classifier List Basic Learning Algorithm
Unable to display preview. Download preview PDF.
- Barry, Alwyn (1999). Aliasing in XCS and the Consequtive State Problem. In Banzaf, W. et al. (editors). Proceedings of the Genetic and Evolutionary Computation Conference GECCO 99, July 13–17,1999 Orlando, Florida. Volume 1. San Francisco, CA: Morgan Kaufmann. 19–34.Google Scholar
- Butz, M., Goldberg, D., & Stolzmann, W. (1999). New Challenges for an Anticipatory Classifier System: Some Hard Problems and Possible Solutions. IlliGAL Report No. 99019. Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-ChampaignGoogle Scholar
- Hoffmann, Joachim (1993). Vorhersage und Erkenntnis. Göttingen: Hogrefe.Google Scholar
- Holland, J. H. (1985). Properties of the bucket brigade algorithm. In John J. Grefenstette, editor. Proceedings of the 1st International Conference on Genetic Algorithms and their Applications (ICGA85). Lawrence Erlbaum Associates: Pittsburgh, PA, July 1985. 1–7.Google Scholar
- Lanzi, Pier Luca (1998). An Analysis of the Memory Mechanism of XCSM. In Koza, John R. et al. (editors). Genetic Programming 1998: Proceedings of the Third Annual Conference, July 22–25, 1998, University of Wisconsin, Madison, Wisconsin. San Francisco, CA: Morgan Kaufmann. 643–651.Google Scholar
- Lanzi, P. L., & Colombetti, M. (1999). An Extension to the XCS Classifier System for Stochastic Environments. In Banzaf, W. et al. (editors). Proceedings of the Genetic and Evolutionary Computation Conference GECCO 99, July 13–17,1999 Orlando, Florida. Volume 1. San Francisco, CA: Morgan Kaufmann. 353–360.Google Scholar
- Lanzi, P. L., & Wilson, S. W. (1999). Optimal Classifier System Performance in Non-Markov Environments. Technical Report N. 99.36, Politecnico di Milano (submitted to Evolutionary Computation).Google Scholar
- Stolzmann, Wolfgang (1998). Anticipatory Classifier Systems. In Koza, John R. et al. (editors). Genetic Programming 1998: Proceedings of the Third Annual Conference, July 22–25, 1998, University of Wisconsin, Madison, Wisconsin. San Francisco, CA: Morgan Kaufmann. 658–664.Google Scholar
- Tolman, Edward C. (1932). Purposive behavior in animals and men. New York: Appleton.Google Scholar
- Widrow, B., & Hoff, M. (1960). Adaptive switching circuits. Western Electronic Show and Convention, 4. 96–104.Google Scholar
- Wilson, S. W. (1985). Knowledge growth in an artificial animat. In L.E. Associates (Ed.). Proceedings of the First International Conference on Genetic Algorithms and Their Applications. 16–23Google Scholar