A Cross Entropy Multiagent Learning Algorithm for Solving Vehicle Routing Problems with Time Windows
The vehicle routing problem with time windows (VRPTW) has been the subject of intensive study because of its importance in real applications. In this paper, we propose a cross entropy multiagent learning algorithm, which considers an optimum solution as a rare event to be learned. The routing policy is node-distributed, controlled by a set of parameterized probability distribution functions. Based on the performance of experienced tours of vehicle agents, these parameters are updated iteratively by minimizing Kullback-Leibler cross entropy in order to generate better solutions in next iterations. When applying the proposed algorithm on Solomon’s 100-customer problem set, it shows outperforming results in comparison with the classical cross entropy approach. Moreover, this method needs only very small number of parameter settings. Its implementation is also relatively simple and flexible to solve other vehicle routing problems under various dynamic scenarios.
KeywordsLocal Search Vehicle Route Problem Local Search Algorithm Local Search Procedure Cross Entropy
Unable to display preview. Download preview PDF.
- 1.Cordeau, J.F., Desaulniers, G., Desrosiers, J., Solomon, M.M., Soumis, F.: The VRP with time windows. In: Toth, P., Vigo, D. (eds.) The Vehicle Routing Problem. SIAM Monographs on Discrete Mathematics and Applications, pp. 157–194 (2002)Google Scholar
- 4.Golden, B., Raghavan, S., Wasil, E. (eds.): The vehicle routing problem, latest advances and new challenges. Operations Research/Computer Science Interfaces Series, vol. 43. Springer, Berlin (2008)Google Scholar
- 12.Helsgaun, K.: An effective implementation of the Lin-Kernighan traveling salesman heuristic. Datalogiske skrifter, Writings on Computer Science, no. 81. Roskilde University (1999)Google Scholar
- 16.Barbucha, D., Jedrzejowicz, P.: Multi-agent platform for solving the dynamic vehicle routing problem. In: Proc.of 11th Int. IEEE Conf. on Intelligent Transportation Systems, pp. 517–522 (2008)Google Scholar
- 17.Vokrinek, J., Komenda, A., Pechoucek, M.: Agents Towards Vehicle Routing Problems. In: Proc. of 9th Int. Conf. on Autonomous Agents and Multiagent Systems, pp. 773–780 (2010)Google Scholar
- 21.Rubinstein, R.Y., Kroese, D.K.: Simulation and the Monte Carlo Method. Wiley Series in Probability and Statistics (2008)Google Scholar