Abstract
Internet of Things, is an innovative technology which allows the connection of physical things with the digital world through the use of heterogeneous networks and communication technologies. In an IoT system, a major role is played by the wireless sensor network as its components comprise: sensing, data acquiring, heterogeneous connectivity and data processing. Mobile ad-hoc networks are highly self reconfiguring networks of mobile nodes which communicate through wireless links. In such a network, each node acts both as a router and host at the same time. The interaction between MANETs and Internet of Things opens new ways for service provision in smart environments and challenging issues in its networking aspects. One of the main issues in MANET–IoT systems is the mobility of the network nodes: routing protocol must react effectively to the topological changes into the algorithm design. We describe the design and implementation of AQ-Routing, and analyze its performance using both simulations and measurements based on our implementation. In general, the networking of such a system is very challenging regarding routing aspects. Also, it is related to system mobility and limited network sensor resources. This article builds upon this observation an adaptive routing protocol (AQ-Routing) based on Reinforcement Learning (RL) techniques, which has the ability to detect the level of mobility at different points of time so that each individual node can update routing metric accordingly. The proposed protocol introduces: (i) new model, developed via Q-learning technique, to detect the level of mobility at each node in the network; (ii) a new metric, called \(Q_{\textit{metric}},\) which account for the static and dynamic routing metrics, and which are combined and updated to the changing network topologies. The protocol can efficiently handle network mobility by a way of preemptively adapting its behaviour thanks to the mobility detection model. The presented results of simulation provide an effective approach to improve the stability of links in both static and mobile scenario and, hence, increase the packet delivery ratio in the global MANET–IoT system.
Similar content being viewed by others
References
Alameri, I.A.: MANETS and Internet of Things: the development of a data routing algorithm. Eng. Technol. Appl. Sci. Res. 8(1), 2604–2608 (2018)
Luigi, Atzori, Antonio, Iera, Giacomo, Morabito: The internet of things: a survey. Comput Netw. 54(15), 2787–805 (2010)
Mukherjee, S., Biswas, G.P.: Networking for IoT and applications using existing communication technology. Egypt. Inf. J. 19(2), 107–127 (2018)
Karlsson, J., Dooley, L.S., Pulkkis, G.: Secure routing for MANET connected Internet of Things systems. In: 2018 IEEE 6th International Conference on Future Internet of Things and Cloud (FiCloud), Barcelona, pp. 114–119 (2018)
Noorul, T.M., Pramila, R.S., Islam, N.: An analysis of routing protocols in MANETs and Internet of Things. In: 2017 International Conference on IoT and Application (ICIOT), Nagapattinam, pp. 1–8 (2017)
Airehrour, D., Gutierrez, J., Ray, S.K.: Secure routing for Internet of Things: a survey. J. Netw. Comput. Appl. 66, 198–213 (2016)
Boukerche, A., Turgut, B., Aydin, N., Ahmad, M.Z., Boloni, L., Turgut, D.: Routing protocols in ad hoc networks: a survey. Comput. Netw. 55(13), 3032–3080 (2011)
Clausen, T., Jacquet, P. (eds.): Optimized Link State Routing Protocol (OLSR). IETF RFC 3626, October 2003
Perkins, C., Belding-Royer, E., Das, S. (eds.): Ad hoc On-Demand Distance Vector (AODV) Routing. TETF RFC 3561, July 2003
Hoebeke, J., Moerman, I., Demeester, P.: Adaptive routing for mobile ad hoc networks. EURASIP J. Wireless Commun. Netw. 2012(1), 126 (2012)
Giannoulis, S., et al.: A hybrid adaptive routing protocol for ad hoc wireless networks. In: Proceedings of 2004 IEEE International Workshop on Factory Communication Systems (2004)
Seba Lagraa, H.: ARPM: an adaptive routing protocol for MANETs. In: IEEE International Conference on Pervasive Services, Lyon, France (2006)
Fathy, C., El-Hadidi, M.T., El-Nasr, M.A.: Fuzzy-based adaptive cross layer routing protocol for delay sensitive applications in MANET. In: 2012 IEEE International Conference on Communications (ICC) (2012)
Ramachandran, B., Shanmugavel, S.: Mobility adaptive cross layer design for reliable route discovery in ad-hoc networks. In: Third International Conference on Wireless Communication and Sensor Networks, 2007 (WCSN ’07) (2007)
Son, T.T. et al.: Self-adaptive proactive routing scheme for mobile ad-hoc networks. IET Netw. 4(2), 128–136 (2015)
Watkins, C.J.C.H., Dayan, P.: Q-learning. Mach. Learn. 8(3), 279–292 (1992)
Boyan, J.A., Littman, M.L.: Packet routing in dynamically changing networks: a reinforcement learning approach. In: Proceedings of the 6th International Conference on Neural Information Processing Systems (NIPS’93). Morgan Kaufmann, San Francisco, pp. 671–678 (1993)
De Couto, Douglas S.J., Aguayo, Daniel, Bicket, John, Morris, Robert: A high-throughput path metric for multi-hop wireless routing. Wireless Netw. 11(4), 419–434 (2005)
Wu, C., Kumekawa, K., Kato, T.: A MANET protocol considering link stability and bandwidth efficiency. In: 2009 International Conference on Ultra Modern Telecommunications & Workshops, St. Petersburg, pp. 1–8 (2009)
Ayodele, T.O.: Introduction to machine learning. In: New Advances in Machine Learning, pp. 1–9. InTech, Rijeka (2010)
Forster, A.: Machine learning techniques applied to wireless ad-hoc networks: guide and survey. In: 3rd International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), pp. 365–370. IEEE (2007)
Forster, A., Murphy, A.L.: Machine Learning Across the WSN Layers in Emerging Communications for Wireless Sensor Networks, pp. 165–181. InTech, Rijeka (2011)
Abu-Mostafa, Y.S., Magdon-Ismail, M., Lin, H.-T.: Learning from Data. AMLBook, Chicago (2012)
Chapelle, O., Scholkopf, B., Zien, A.: Semi-Supervised Learning, vol. 2. MIT, Cambridge (2006)
Puterman, Martin L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, New York (2008)
Sutton, R.S., Barto, A.G.: Reinforcement Learning. MIT, Cambridge (1997)
Johnson, D., Hu, Y., Maltz, D.: The Dynamic Source Routing Protocol (DSR) for mobile ad hoc networks for IPv4. IETF REC (2007)
Sarkar, S.K., Basavaraju, T.G., Puttamadappa, C.: Ad Hoc Mobile Wireless Networks: Principles, Protocols and Applications, 1st edn. Auerbach Publications, Boston (2007)
Draves, R., Padhye, J., Zill, B.: Comparison of routing metrics for static multi-hop wireless networks. SIGCOMM Comput. Commun. Rev. 34(4), 133–144 (2004)
Li, J., Blake, C., Couto, D.S.J.D., Lee, H.I., Morris, R.: Capacity of Ad Hoc wireless networks. In: 7th Annual International Conference on Mobile Computing and Networking (MobiCom ’01), pp. 61–69. ACM, New York (2001)
Adya, A., Bahl, P., Padhye, J., Wolman, A., Zhou, L.: A multi-radio unification protocol for IEEE 802.11 wireless networks. In: 1st International Conference on Broadband Networks (BROADNETS ’04), pp. 344–354. IEEE Computer Society, Washington (2004)
Khelil, A., Marron, P.J., Rothermel, K.: Contact-based mobility metrics for delay-tolerant ad hoc networking. In: 13th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, pp. 435–444 (2005)
Ingelrest, F., Mitton, N., Simplot-Ryl, D.: A Turnover based adaptive HELLO protocol for mobile ad hoc and sensor networks. In: 2007 15th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, Istanbul, pp. 9–14 (2007)
Grossglauser, M., Vetterli, M.: Locating nodes with EASE: last encounter routing in ad hoc networks through mobility diffusion. In: IEEE 2003 22nd Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No. 03CH37428) (INFOCOM), vol. 3, pp. 1954–1964 (2003)
Boleng, J., Navidi, W., Camp, T.: Metrics to enable adaptive protocols for mobile ad hoc networks. In: Proceedings of International Conference on Wireless Networks (ICWN’02), pp. 293–296 (2002)
Macone, D., Oddi, G., Pietrabissa, A.: MQ-Routing: Mobility-, GPS- and energy-aware routing protocol in MANETs for disaster relief scenarios. Ad Hoc Netw. 11(3), 861–878 (2013)
Son, Tran The, Le Minh, Hoa, Sexton, Graham, Aslam, Nauman: A novel encounter-based metric for mobile ad-hoc networks routing. Ad Hoc Netw. 14, 2–14 (2014)
Richard, D., Jitendra, P., Brian, Z.: Routing in multi-radio, multi-hop wireless mesh networks. In: Proceedings of the MOBICOM Conference (2004)
Edalat, N., Tham, C.-K., Xiao, W.: An auction-based strategy for distributed task allocation in wireless sensor networks. Comput. Commun. 35(8), 916–928 (2012)
Chun, L.D., Hyeon, L.D.: Novel routing protocol scheme for real-time applications in mobile ad hoc networks. Clust. Comput. 20(77), 1–12 (2017)
Mase, K., Speakman, L., Akima, K., Owada, Y.: Loop Detection for MANET. Internet Engineering Task Force (2007). https://datatracker.ietf.org/doc/html/draft-mase-manet-loopdetect-00
Perkins, C., Bhagwat, P.: Highly Dynamic Destination-Sequenced Distance-Vector Routing (DSDV) for mobile computers. In: ACM SIGCOMM’94 Conference on Communications Architectures, Protocols and Applications, pp. 234–244 (1994)
Garcia-Luna, J., Spohn, M.: Source Tree Adaptive Routing Internet Draft. draft-ietf-manet-star-00.txt, work in progress, October 1999
Macker, J. (ed.): Simplified Multicast Forwarding. RFC 6621, May 2012. https://doi.org/10.17487/RFC6621, http://www.rfc-editor.org/info/rfc6621
ns-3 Development Team, ns-3 Network Simulator (2014). https://www.nsnam.org/doxygen- release/group__mobility.html
Camp, T., Boleng, J., Davies, V.: A survey of mobility models for ad hoc network research. Wirel. Commun. Mob. Comput. 2, 483–502 (2002). https://doi.org/10.1002/wcm.72
IEEE 802.11TM Wireless Local Area Networks: the Working Group for WLAN Standards. http://www.ieee802.org/11/. Accessed Oct 2011
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Serhani, A., Naja, N. & Jamali, A. AQ-Routing: mobility-, stability-aware adaptive routing protocol for data routing in MANET–IoT systems. Cluster Comput 23, 13–27 (2020). https://doi.org/10.1007/s10586-019-02937-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-019-02937-x