Abstract
This paper examines a distributed system where users employ a mobile software agent to perform a sequence of tasks associated with different network nodes. Each operation can be carried out either locally or remotely, and may or may not involve moving the agent from one node to another; in general, all these options have different costs. The problem is to determine the optimal agent allocation policy, for a given cost structure and pattern of user demand. The methodology adopted is that of Markov Decision Processes. Two numerical approaches are presented for the general problem, and a closed-form solution is obtained in a non-trivial special case.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D. Blackwell, “Discounted dynamic programming”, Ann. Math. Stat., 26, 226–235, 1965.
C. Derman, Finite State Markovian Decision Processes, Acedemic Press, New York, 1970.
S.E. Dreyfus and A.M. Law, The Art and Theory of Dynamic Programming, Acedemic Press, New York, 1977.
A. Hordijk and G. Koole, “On the optimality of LEPT and μc rules for parallel processors and dependent arrival processes”, Advances in Applied Probability, 25, 979–996, 1993.
F.P. Kelly (editor), Probability, Statistics and Optimization, J. Wiley, Chichester, 1994.
E. Kim and M.P. Van Oyen, “Dynamic scheduling to minimize lost sales subject to set-up costs”, Queueing Systems, 29, 193–229, 1998.
S.M. Ross, Introduction to Stochastic Dynamic Programming, Acedemic Press, New York, 1983.
P. Whittle, Optimization Over Time. Dynamic Programming and Stochastic Control, Vols. I and II, J. Wiley, New York, 1983.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hamilton, M.D., Mitrani, I. (2000). Optimal Allocation Policies for Mobile Agents. In: Haverkort, B.R., Bohnenkamp, H.C., Smith, C.U. (eds) Computer Performance Evaluation.Modelling Techniques and Tools. TOOLS 2000. Lecture Notes in Computer Science, vol 1786. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-46429-8_11
Download citation
DOI: https://doi.org/10.1007/3-540-46429-8_11
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67260-9
Online ISBN: 978-3-540-46429-7
eBook Packages: Springer Book Archive