Optimal Allocation Policies for Mobile Agents

  • M. D. Hamilton
  • I. Mitrani
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1786)


This paper examines a distributed system where users employ a mobile software agent to perform a sequence of tasks associated with different network nodes. Each operation can be carried out either locally or remotely, and may or may not involve moving the agent from one node to another; in general, all these options have different costs. The problem is to determine the optimal agent allocation policy, for a given cost structure and pattern of user demand. The methodology adopted is that of Markov Decision Processes. Two numerical approaches are presented for the general problem, and a closed-form solution is obtained in a non-trivial special case.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    D. Blackwell, “Discounted dynamic programming”, Ann. Math. Stat., 26, 226–235, 1965.MathSciNetCrossRefGoogle Scholar
  2. 2.
    C. Derman, Finite State Markovian Decision Processes, Acedemic Press, New York, 1970.MATHGoogle Scholar
  3. 3.
    S.E. Dreyfus and A.M. Law, The Art and Theory of Dynamic Programming, Acedemic Press, New York, 1977.MATHGoogle Scholar
  4. 4.
    A. Hordijk and G. Koole, “On the optimality of LEPT and μc rules for parallel processors and dependent arrival processes”, Advances in Applied Probability, 25, 979–996, 1993.MATHCrossRefMathSciNetGoogle Scholar
  5. 5.
    F.P. Kelly (editor), Probability, Statistics and Optimization, J. Wiley, Chichester, 1994.Google Scholar
  6. 6.
    E. Kim and M.P. Van Oyen, “Dynamic scheduling to minimize lost sales subject to set-up costs”, Queueing Systems, 29, 193–229, 1998.MATHCrossRefGoogle Scholar
  7. 7.
    S.M. Ross, Introduction to Stochastic Dynamic Programming, Acedemic Press, New York, 1983.MATHGoogle Scholar
  8. 8.
    P. Whittle, Optimization Over Time. Dynamic Programming and Stochastic Control, Vols. I and II, J. Wiley, New York, 1983.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2000

Authors and Affiliations

  • M. D. Hamilton
    • 1
  • I. Mitrani
    • 1
  1. 1.Department of Computing ScienceUniversity of Newcastle upon TyneUK

Personalised recommendations