Abstract
Cloud computing improves the performance of software applications by providing on-demand usage, high availability, reliability, and agility. However, during peak traffic conditions the resources in cloud services can become over-utilized, impairing the ability to provide performance levels specified in service-level agreements. Therefore, a load balancing algorithm that provides an efficient and fair allocation of cloud resources while providing high availability to end users is a timely necessity. In this paper, we propose a load balancing scheme to distribute the workload among virtual servers using a modified version of the double Q-learning algorithm. The proposed algorithm is implemented on a load balancing controller and leverages user requests using software defined network technologies. The results reveal a considerable reduction in terms of unsatisfied cloud consumers compared to already existing popular algorithms. In short, this work will serve as a future guide for load balancing implementations in cloud environments that require higher Quality of Service.
Similar content being viewed by others
References
Chaczko, Z., Mahadevan, V., Aslanzadeh, S., & Mcdermid, C. (2011) Availability and load balancing in cloud computing. In International conference on computer and software modeling, singapore (Vol. 14)
Dasgupta, K., Mandal, B., Dutta, P., Mandal, J. K., & Dam, S. (2013). A genetic algorithm (ga) based load balancing strategy for cloud computing. Procedia Technology, 10, 340–347.
Domanal, S. G., & Reddy, G. R. M. (2013). Load balancing in cloud computingusing modified throttled algorithm. In IEEE international conference on cloud computing in emerging markets (CCEM) (pp. 1–5).
Iyer, B., & Henderson, J. C. (2010) Preparing for the future: Understanding the seven capabilities cloud computing. MIS Quarterly Executive, 9(2), 117–131.
James, J., & Verma, B. (2012). Efficient VM load balancing algorithm for a cloud computing environment. International Journal on Computer Science and Engineering, 4(9), 1658.
Knox, W. B., & Stone, P. (2010). Combining manual feedback with subsequent MDP reward signals for reinforcement learning. In In: Proceedings of the 9th international conference on autonomous agents and multiagent systems: volume 1-Volume 1, International Foundation for Autonomous Agents and Multiagent Systems (pp. 5–12).
Krishna, P. V. (2013). Honey bee behavior inspired load balancing of tasks in cloud computing environments. Applied Soft Computing, 13(5), 2292–2303.
Namal, S., Ghaboosi, K., Bennis, M., MacKenzie, A. B., Latva-aho, M. (2010). Joint admission control & interference avoidance in self-organized femtocells. In 2010 Conference record of the forty fourth Asilomar conference on signals, systems and computers (ASILOMAR) (pp. 1067–1071). IEEE
Namal, S., Ahmad, I., Gurtov, A., & Ylianttila, M. (2013). SDN based inter-technology load balancing leveraged by flow admission control. In: 2013 IEEE SDN for future networks and services (SDN4FNS) (pp. 1–5). https://doi.org/10.1109/SDN4FNS.2013.6702551.
Nuaimi, K. A., Mohamed, N., Nuaimi, M. A., & Al-Jaroodi, J. (2012). A survey of load balancing in cloud computing: Challenges and algorithms. In 2012 Second Symposium on Network Cloud Computing and Applications (pp. 137–142). https://doi.org/10.1109/NCCA.2012.29
Sethi, S., Sahu, A., & Jena, S. K. (2012). Efficient load balancing in cloud computing using fuzzy logic. IOSR Journal of Engineering, 2(7), 65–71.
Su, J., Liu, J., Thomas, D. B., & Cheung, P. Y. (2017). Neural network based reinforcement learning acceleration on FPGA platforms. ACM SIGARCH Computer Architecture News, 44(4), 68–73.
Tennakoon, D., Karunarathna, S., Udugama, B. (2018). Q-learning approach for load-balancing in software defined networks. In 2018 Moratuwa engineering research conference (MERCon) (pp. 1–6). IEEE
Van Hasselt, H., Guez, A., & Silver, D. (2016). Deep reinforcement learning with double Q-learning. AAAI, 16, 2094–2100.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tennakoon, D., Chowdhury, M. & Luan, T.H. Cloud-based load balancing using double Q-learning for improved Quality of Service. Wireless Netw 29, 1043–1050 (2023). https://doi.org/10.1007/s11276-018-1888-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11276-018-1888-8