On Allocating Limited Sampling Resources Using a Learning Automata-based Solution to the Fractional Knapsack Problem
In this paper, we consider the problem of allocating limited sampling resources in a “real-time” manner with the purpose of estimating multiple binomial proportions. This is the scenario encountered when evaluating multiple web sites by accessing a limited number of web pages, and the proportions of interest are the fraction of each web site that is successfully validated by an HTML validator . Our novel solution is based on mapping the problem onto the so-called nonlinear fractional knapsack problem with separable and concave criterion functions , which, in turn, is solved using a Team of deterministic Learning Automata (LA). To render the problem even more meaningful, since the binomial proportions are unknown and must be sampled, we particularly consider the scenario when the target criterion functions are stochastic with unknown distributions. Using the general LA paradigm, our scheme improves a current solution in an online manner, through a series of informed guesses which move towards the optimal solution. At the heart of our scheme, a team of deterministic LA performs a controlled random walk on a discretized solution space. Comprehensive experimental results demonstrate that the discretization resolution determines the precision of our scheme, and that for a given precision, the current resource allocation solution is consistently improved, until a near-optimal solution is found – even for periodically switching environments. Thus, our scheme, while being novel to the entire field of LA, also efficiently handles a class of resource allocation problems previously not addressed in the literature.
KeywordsKnapsack Problem Learn Automaton Aggregate Variance Stochastic Environment Learn Automaton
Unable to display preview. Download preview PDF.
- 1.1. Fractional knapsack problem. http://www.nist.gov/dads/HTML/fractional Knapsack.html, 2004. NIST.Google Scholar
- 2.2. G. K. Bhattacharyya and R. A. Johnson. Statistical Concepts and Methods. John Wiley & Sons, 1977.Google Scholar
- 4.4. B. C. Dean, M. X. Goemans, and J. Vondrdk. Approximating the Stochastic Knapsack Problem: the benefit of adaptivity. In 45th Annual IEEE Symposium on Foundations of Computer Science, pages 208–217. IEEE, 2004.Google Scholar
- 6.6. H. Kellerer, U. Pferschy, and D. Pisinger. Knapsack Problems. Springer, 2004.Google Scholar
- 7.7. K. S. Narendra and M. A. L. Thathachar. Learning Automata: An Introduction. Prentice Hall, 1989.Google Scholar
- 9.9. B. J. Oommen and L. Rueda. Stochastic Learning-based Weak Estimation of Multinomial Random Variables and its Applications to Pattern Recognition in Non-stationary Environments. Pattern Recognition, 2006.Google Scholar
- 10.10. K. W. Ross and D.H.K. Tsang. The stochastic knapsack problem. IEEE Transactions on Communications, 37(7), 1989.Google Scholar
- 11.11. M. Snaprud, N. Ulltveit-Moe, O.-C. Granmo, M. Rafoshei-Klev, A. Wiklund, and A. Sawicka. Quantitative Assessment of Public Web Sites Accessibility - Some Early Results. In The Accessibility for All Conference, 2003.Google Scholar
- 13.13. M. A. L. Thathachar and P. S. Sastry. Networks of Learning Automata: Techniques for Online Stochastic Optimization. Kluwer Academic Publishers, 2004.Google Scholar
- 14.14. M. L. Tsetlin. Automaton Theory and Modeling of Biological Systems. Academic Press, 1973.Google Scholar
- 15.15. Z. Xiaoming. Evaluation and Enhancement of Web Content Accessibility for Persons with Disabilities. PhD thesis, University of Pittsburgh, 2004.Google Scholar
- 16.16. Q. Zhu and B. J. Oommen. Some Fundamental Results on Optimal Search with Unknown Target Distributions. Submitted for Publication, 2005.Google Scholar