A Hierarchical Learning Scheme for Solving the Stochastic Point Location Problem

  • Anis Yazidi
  • Ole-Christoffer Granmo
  • B. John Oommen
  • Morten Goodwin
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7345)

Abstract

This paper deals with the Stochastic-Point Location (SPL) problem. It presents a solution which is novel in both philosophy and strategy to all the reported related learning algorithms. The SPL problem concerns the task of a Learning Mechanism attempting to locate a point on a line. The mechanism interacts with a random environment which essentially informs it, possibly erroneously, if the unknown parameter is on the left or the right of a given point which also is the current guess. The first pioneering work [6] on the SPL problem presented a solution which operates a one-dimensional controlled Random Walk (RW) in a discretized space to locate the unknown parameter. The primary drawback of the latter scheme is the fact that the steps made are always very conservative. If the step size is decreased the scheme yields a higher accuracy, but the convergence speed is correspondingly decreased.

In this paper we introduce the Hierarchical Stochastic Searching on the Line (HSSL) solution. The HSSL solution is shown to provide orders of magnitude faster convergence when compared to the original SPL solution reported in [6]. The heart of the HSSL strategy involves performing a controlled RW on a discretized space, which unlike the traditional RWs, is not structured on the line per se, but rather on a binary tree described by intervals on the line. The overall learning scheme is shown to be optimal if the effectiveness of the environment, p, is greater than the golden ratio conjugate [4] – which, in itself, is a very intriguing phenomenon. The solution has been both analytically analyzed and simulated, with extremely fascinating results. The strategy presented here can be utilized to determine the best parameter to be used in any optimization problem, and also in any application where the SPL can be applied [6].

Keywords

Stochastic-Point Problem Discretized Learning Learning Automata Controlled Random Walk 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Baeza-Yates, R., Culberson, J., Rawlins, G.: Searching with uncertainty. In: Proceedings of Scandinavian Workshop Algorithms and Theory (SWAT), Halmstad, Sweden, pp. 176–189 (1998)Google Scholar
  2. 2.
    Baeza-Yates, R., Schott, R.: Parallel searching in the plane. Comput. Geom. Theory Appl. 5, 143–154 (1995)MathSciNetMATHCrossRefGoogle Scholar
  3. 3.
    Bentley, J.L., Yao, A.C.C.: An Almost Optimal Algorithm for Unbounded Searching. Inform. Proc. Lett. 5, 82–87 (1976)MathSciNetMATHCrossRefGoogle Scholar
  4. 4.
    Livio, M.: The Golden Ratio: The Story of Phi, the World’s Most Astonishing Number. Paw Prints (2008)Google Scholar
  5. 5.
    Narendra, K.S., Thathachar, M.A.L.: Learning Automata: An Introduction. Prentice-Hall, Inc. (1989), http://portal.acm.org/citation.cfm?id=64802
  6. 6.
    Oommen, B.J.: Stochastic searching on the line and its applications to parameter learning in nonlinear optimization. IEEE Transactions on Systems, Man and Cybernetics 27B, 733–739 (1997)Google Scholar
  7. 7.
    Oommen, B.J., Kim, S.W., Samuel, M., Granmo, O.C.: A solution to the stochastic point location problem in metalevel nonstationary environments. IEEE Transactions on Systems, Man, and Cybernetics 38(2), 466–476 (2008)CrossRefGoogle Scholar
  8. 8.
    Oommen, B.J., Raghunath, G.: Automata learning and intelligent tertiary searching for stochastic point location. IEEE Transactions on Systems, Man and Cybernetics 28B, 947–954 (1998)Google Scholar
  9. 9.
    Oommen, B.J., Raghunath, G., Kuipers, B.: Parameter learning from stochastic teachers and stochastic compulsive liars. IEEE Transactions on Systems, Man and Cybernetics 36B, 820–836 (2006)Google Scholar
  10. 10.
    Yazidi, A., Granmo, O.C., Oommen, B.J., Goodwin, M.: Hierarchical stochastic searching on the line. Unabridged version of this paper (to be submitted for publication)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Anis Yazidi
    • 1
  • Ole-Christoffer Granmo
    • 1
  • B. John Oommen
    • 2
  • Morten Goodwin
    • 1
  1. 1.Dept. of ICTUniversity of AgderGrimstadNorway
  2. 2.School of Computer ScienceCarleton UniversityOttawaCanada

Personalised recommendations