Abstract
Communicating nodes in Mobile Ad-hoc NETworks (MANETs) must deal with routing in an efficient and adaptive way. Efficiency feature is strongly recommended since both bandwidth and energy are scarce resources in MANETs. Besides, adaptivity is crucial to accomplish the routing task correctly in presence of varying network conditions in terms of mobility, links quality and traffic load. Our focus, in this paper, is on the application of Reinforcement Learning (RL) technique to achieve adaptive routing in MANETs. Particularly, we try to underline the main design-issues that arise when dealing with adaptive-routing as a Reinforcement Learning task.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Chettibi, S., Chikhi, S.: A survey of Reinforcement Learning Based Routing for Mobile Ad-hoc Networks. In: The third international Conference on Wireless and Mobile Networks, Turkey (2011)
Dowling, J., Curran, E., Cunningham, R., Cahill, V.: Using feedback in collaborative reinforcement learning to adaptively optimize MANET routing. IEEE Trans. Syst. Man. Cybern. 35, 360–372 (2005)
Usaha, W., Barria, J.A.: A reinforcement learning Ticket-Based Probing path discovery scheme for MANETs. Ad Hoc Networks Journal 2, 319–334 (2004)
Maneenil, K., Usaha, W.: Preventing malicious nodes in ad hoc networks using reinforcement learning. In: The 2nd International Symposium on Wireless Communication Systems, Italy, pp. 289–292 (2005)
Sutton, R., Barto, A.: Reinforcement learning. MIT Press, Washington (1998)
Boyan, J.A., Littman, M.L.: Packet routing in dynamically changing networks: A reinforcement learning approach. Advances In Neural Information Processing Systems 6, 671–678 (1994)
Chang, Y.-H., Ho, T.: Mobilized ad-hoc networks: A reinforcement learning approach. In: ICAC 2004: Proceedings of the First International Conference on Autonomic Computing, USA, pp. 240–247. IEEE Computer Society, Los Alamitos (2004)
Tao, T., Tagashira, S., Fujita, S.: LQ-Routing Protocol for Mobile Ad-Hoc Networks. In: Proceedings of the Fourth Annual ACIS International Conference on Computer and Information Science (2005)
Binbin, Z., Quan, L., Shouling, Z.: Using statistical network link model for routing in ad hoc networks with multi-agent reinforcement learning. In: International Conference on Advanced Computer Control, pp. 462–466 (2010)
Nurmi, P.: Reinforcement Learning for Routing in Ad Hoc Networks. In: 5th Int. Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks. IEEE Computer Society Press, Los Alamitos (2007)
Peshkin, L.: Reinforcement Learning by Policy Search. PhD thesis, Brown University (2001)
Naruephiphat, W., Usaha, W.: Balancing tradeoffs for energy-efficient routing in MANETs based on reinforcement learning. In: The IEEE 67th Vehicular Technology Conference, Singapore (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chettibi, S., Chikhi, S. (2011). Routing in Mobile Ad-hoc Networks as a Reinforcement Learning Task. In: Fong, S. (eds) Networked Digital Technologies. NDT 2011. Communications in Computer and Information Science, vol 136. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22185-9_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-22185-9_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22184-2
Online ISBN: 978-3-642-22185-9
eBook Packages: Computer ScienceComputer Science (R0)