Novel Results on Random Walk-Jump Chains That Possess Tree-Based Transitions
The most difficult task in analyzing and appraising algorithms in Artificial Intelligence (AI) involves their formal mathematical analysis. In general, such an analysis is intractable because of the size of the search space and the fact that the transitions between the states within this space can be very intricate. That is why AI algorithms are, for the most part, evaluated empirically and experimentally, i.e., by simulations. However, whenever such an analysis is undertaken, it usually involves an analysis of the underlying stochastic process. In this connection, the most common tools used involve Random Walks (RWs), which is a field that has been extensively studied for more than a century . These walks have traditionally been on a line, and the generalizations for two and three dimensions, have been by extending the random steps to the corresponding neighboring positions in one or many of the dimensions. The analysis of RWs on a tree have received little attention, even though it is an important topic since a tree is a counter-part space representation of a line whenever there is some ordering on the nodes on the line.
Nevertheless, RWs on a tree entail moving to non-neighbor states in the space, which makes the analysis involved, and in many cases, impossible. This is precisely what we achieve in this rather pioneering paper. The applications of this paper are numerous. Indeed, the RW on the tree that this paper models, is a type of generalization of dichotomous search with faulty feedback about the direction of the search, rendering the real-life application of the model to be pertinent. To resolve this, we advocate the concept of “backtracking” transitions in order to efficiently explore the search space. Interestingly, it is precisely these “backtracking” transitions that naturally render the chain to be “time reversible”. By doing this, we are able to bridge the gap between deterministic dichotomous search and its faulty version, explained, in detail, in .
KeywordsTime reversibility Controlled random walk Random walk with jumps Dichotomous search Learning systems
- 1.Altman, A., Tennenholtz, M.: Ranking systems: the pagerank axioms. In: EC 2005: Proceedings of the 6th ACM Conference on Electronic Commerce, pp. 1–8. ACM, New York (2005)Google Scholar
- 2.Ben Or, M., Hassidim, A.: The bayesian learner is optimal for noisy binary search (and pretty good for quantum as well). In: IEEE 49th Annual IEEE Symposium on Foundations of Computer Science, FOCS 2008, pp. 221–230. IEEE (2008)Google Scholar
- 3.Berg, H.C.: Random Walks in Biology, Revised edn. Princeton University Press, Princeton (1993)Google Scholar
- 4.Bishop, P.G., Pullen, F.D.: A random walk through software reliability theory. Math. Struct. Softw. Eng., 83–111 (1991)Google Scholar
- 9.Gross, D., Harris, C.M.: Fundamentals of Queueing Theory (Wiley Series in Probability and Statistics). Wiley-Interscience, New York (1998)Google Scholar
- 10.Karlin, S., Taylot, H.: A First Course in Stochastic Processes. Academic Press, New York (1975)Google Scholar
- 11.Kelly, F.: Reversibility and Stochastic Networks. Wiley Series in Probability and Mathematical Statistics. Tracts on Probability and Statistics, Wiley, Chichester (1987)Google Scholar
- 17.Ross, S.: Introduction to Probability Models. Academic Press, New York (1980)Google Scholar
- 21.Yazidi, A., Oommen, B.J.: On the analysis of a random walk-jump chain with tree-based transitions, and its applications to faulty dichotomous search. Unabridged version of this paper (2016). To be submitted for publicationGoogle Scholar
- 22.Zhang, J., Wang, Y., Wang, C., Zhou, M.: Symmetrical hierarchical stochastic searching on the line in informative and deceptive environments. To appear in IEEE Trans. Cybern. (2016)Google Scholar