Abstract
Inland waterway networks are likely to go through heavy changes due to a will in increasing the boat traffic and to the effects of climate change. Those changes would lead to a greater need of an automatic and intelligent planning for an adaptive and resilient water management. A representative model is proposed and tested using MDPs with promising results on the water management optimization. The proposed model permits to coordinate multiple entities over multiple time steps in order to avoid a flood in the waterway network. However, the proposed model suffers a lack of scalability and is unable to represent a real case application. The advantages and limitations of several approaches of the literature are discussed according to our case study.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bellman, R.: A Markovian decision process. J. Math. Mech. 6, 679–684 (1957)
Bichot, C.E., Siarry, P.: Graph Partitioning. Wiley-ISTE (2011)
Boutilier, C., Dean, T., Hanks, S.: Decision-theoretic planning: structural assumptions and computational leverage. J. Artif. Intell. Res. 11, 1–94 (1999)
Boutilier, C., Dearden, R., Goldszmidt, M., et al.: Exploiting structure in policy construction. In: IJCAI, vol. 14, pp. 1104–1113 (1995)
Brand, C., Tran, M., Anable, J.: The uk transport carbon model: an integrated life cycle approach to explore low carbon futures. Energy Policy 41, 107–124 (2012)
Chades, I., Scherrer, B., Charpillet, F.: A heuristic approach for solving decentralized-POMDP: assessment on the pursuit problem. In: SAC 2002: Proceedings of the 2002 ACM Symposium on Applied Computing, pp. 57–62. ACM, New York (2002)
Dean, T., Lin, S., Lin, S.: Decomposition techniques for planning instochastic domains. In: 14th International Joint Conference on Artificial Intelligence (1995)
Guestrin, C., Koller, D., Parr, R.: Multiagent planning with factored mdps. In: NIPS, vol. 1, pp. 1523–1530 (2001)
Guestrin, C., Venkataraman, S., Koller, D.: Context-specific multiagent coordination and planning with factored mdps. In: AAAI/IAAI, pp. 253–259 (2002)
Hoey, J., St-Aubin, R., Hu, A., Boutilier, C.: Spudd: stochastic planning using decision diagrams. In: Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, pp. 279–288. Morgan Kaufmann Publishers Inc. (1999)
Kocsis, L., Szepesvári, C.: Bandit based Monte-Carlo planning. In: Fürnkranz, J., Scheffer, T., Spiliopoulou, M. (eds.) ECML 2006. LNCS (LNAI), vol. 4212, pp. 282–293. Springer, Heidelberg (2006)
Lozenguez, G., Adouane, L., Beynier, A., Mouaddib, A.I., Martinet, P.: Punctual versus continuous auction coordination for multi-robot and multi-task topological navigation. Auton. Robots 40, 599–613 (2016)
Mallidis, I., Dekker, R., Vlachos, D.: The impact of greening on supply chain design and cost: a case for a developing region. J. Transp. Geogr. 22, 118–128 (2012)
Mihic, S., Golusin, M., Mihajlovic, M.: Policy and promotion of sustainable inland waterway transport in europe-danube river. Renew. Sustain. Energy Rev. 15(4), 1801–1809 (2011)
Nair, R., Varakantham, P., Tambe, M., Yokoo, M.: Networked distributed POMDPs: a synthesis of distributed constraint optimization and POMDPs. In: National Conference on Artificial Intelligence, p. 7 (2005)
Nouasse, H., Rajaoarisoa, L., Doniec, A., Duviella, E., Chuquet, K., Chiron, P., Archimede, B.: Study of drought impact on inland navigation systems based on a flow network model. In: 2015 XXV International Conference on Information, Communication and Automation Technologies (ICAT), pp. 1–6. IEEE (2015)
Pachauri, R.K., Allen, M., Barros, V., Broome, J., Cramer, W., Christ, R., Church, J., Clarke, L., Dahe, Q., Dasgupta, P., et al.: Climate change 2014: synthesis report. contribution of working groups i, ii and iii to the fifth assessment report of the intergovernmental panel on climate change (2014)
Parr, R.: Flexible decomposition algorithms for weakly coupled Markov decision problems. In: 14th Conference on Uncertainty in Artificial Intelligence, pp. 422–430 (1998)
Puterman, M.L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, New York (1994)
Sabbadin, R.: Graph partitioning techniques for Markov Decision Processes decomposition. In: 15th Eureopean Conference on Artificial Intelligence, pp. 670–674 (2002)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Desquesnes, G., Lozenguez, G., Doniec, A., Duviella, E. (2016). Dealing with Large MDPs, Case Study of Waterway Networks Supervision. In: Demazeau, Y., Ito, T., Bajo, J., Escalona, M. (eds) Advances in Practical Applications of Scalable Multi-agent Systems. The PAAMS Collection. PAAMS 2016. Lecture Notes in Computer Science(), vol 9662. Springer, Cham. https://doi.org/10.1007/978-3-319-39324-7_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-39324-7_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-39323-0
Online ISBN: 978-3-319-39324-7
eBook Packages: Computer ScienceComputer Science (R0)