Abstract
Glazebrook [1] has given an account of improved procedures for strategy evaluation for resource allocation in a stochastic environment. These methods are extended in the paper in such a way that they can be applied to problems which, for example, have precedence constraints and/or an arrivals process of new jobs. Theoretical results, backed up by numerical studies, show that quasi-myopic heuristics often perform well.
Similar content being viewed by others
References
K.D. Glazebrook, Procedures for the evaluation of strategies for resource allocation in a stochastic environment, J. Appl. Prob. (1990), to appear.
J.C. Gittins, Bandit processes and dynamic allocation indices, J. Roy. Statist. Soc. B41 (1979) 148 (with disccssion).
P. Whittle, Arm-acquiring bandits, Ann. Prob. 9 (1981) 284.
P. Varaiya, J. Walrand and C. Buyukkoc, Extensions of the multi-armed bandit problem: the discounted case, IEEE Trans. Aut. Control AC-30 (1985) 425.
G. Weiss, Branching bandit processes, Technical Report, Georgia Institute of Technology.
K.D. Glazebrook, On the evaluation of suboptimal strategies for families of alternative bandit processes. J. Appl. Prob. 19 (1982) 716.
K.D. Glazebrook, Sensitivity analysis for stochastic scheduling problems, Math. Oper. Res. 12 (1987) 205.
S.M. Ross,Applied Probability Models with Optimisation Applications (Holden-Day, 1970).
J.C. Gittins and K.D. Glazebrook, On Bayesian models in stochastic scheduling, J. Appl. Prob. 14 (1977) 556.
K.D. Glazebrook, Stochastic scheduling with order constraints, Int. J. Sys. Sci. 7 (1976) 657.
K.D. Glazebrook and J.C. Gittins, On single machine scheduling with precedence relations and linear or discounted costs, Oper. Res. 29 (1981) 161.
T.E. Morton and B.C.T. Dharan, Algoristics for single-machine sequencing with precedence constraints, Mgmt. Sci. 24 (1978) 1011.
K.D. Glazebrook and N.A. Fay, Evaluating strategies for Markov decision processes in parallel, Math. Oper. Res. (1990), to appear.
N.A. Fay and K.D. Glazebrook, Stochastic scheduling — do we need to model arrivals?, submitted.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Glazebrook, K.D., Boys, R.J. & Fay, N.A. On the evaluation of strategies for branching bandit processes. Ann Oper Res 30, 299–319 (1991). https://doi.org/10.1007/BF02204822
Issue Date:
DOI: https://doi.org/10.1007/BF02204822