A model of many goal-oriented stochastic automata with application on a marketing problem

  • Y. M. El-Fattah
Operational Research
Part of the Lecture Notes in Computer Science book series (LNCS, volume 40)


Here presented is a model of many goal-oriented stochastic automata. The goal of each automaton is the extremum of the absolute mean value of a certain utility function. That function depends explicitly on the automaton strategy and the environment response. Without need of any a priori knowledge each automaton adapts its structure in the process of achieving its own goal. By suitably setting the environment characteristics the automata model can be useful for the analysis of some operations research problems. As example that model is used for the study of the price formation process in a free competitive market. The results demonstrated the convergence of the automata updating scheme as well as the influence of a number of interesting physical parameters (like the buyers tactics, the sellers psychology, etc...) on the equilibrium condition.


Utility Function Remote Control Collective Behavior Reference Price Environment Response 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    L. Tsetlin, "On the Behavior of Finite Automata in Random Media", Automation and Remote Control, 22, p. 1210–1219 (1961).Google Scholar
  2. 2.
    V.Yu. Krylov, and M.L. Tsetlin., "Game between Automata", Automation and Remote Control, 24, pp. 889–899 (1962).Google Scholar
  3. 3.
    V.I. Varshavskii, and I.P. Vorontsova., "On the Behavior of Stochastic Automata with Variable Structure, Automation and Remote Control, 24, pp. 327–333 (1963).Google Scholar
  4. 4.
    K.S. Narendra, and M.L.A. Thathachar., "Learning Automata — A Survey", IEEE Trans., SMC-4, pp. 323–334 (1974).Google Scholar
  5. 5.
    Yu.D.Tenisberg., "Some Models of Collective Behavior in Dynamic Processes of Market Price Formation", Automation and Remote Control, no 7, pp. 1140–1148 (1969).Google Scholar
  6. 6.
    A.V.Malishevskii, and Yu.D.Tenisberg., "One Class of Games Connected with Models of Collective Behavior," Automation and Remote Control, n o 11, pp. 1828–1837 (1969).Google Scholar
  7. 7.
    A.V.Malisheskii., "Models of Joint Operation of Many Goal-Oriented Elements,I,II, "Automation and Remote Control, n o 11,12, pp. 1828–1845, 2020–2028 (1971).Google Scholar
  8. 8.
    S. Karlin., "Mathematical Methods in Games Theory, Programming, and Economics, I, Reading, Massachusetts, Addison-Wesley (1959).Google Scholar
  9. 9.
    V.I.Varshavskii, M.V.Meleshina, and V.T.Perekrest., "Use of Model of Collective Behavior in the Problem of Resources Allocation", Automation and Remote Control, n o 7, pp. 1107–1114 (1968).Google Scholar
  10. 10.
    L.P.Krylatykh., "On a Model of Collective Behavior", Engineering Cybernetics, pp. 803–808 (1972).Google Scholar

Copyright information

© Springer-Verlag 1976

Authors and Affiliations

  • Y. M. El-Fattah
    • 1
  1. 1.University of LiègeLiègeBelgium

Personalised recommendations