Abstract
Predicting demand for computing resources in any system is a vital task since it allows the optimized management of resources. To some degree, cloud computing reduces the urgency of accurate prediction as resources can be scaled on demand, which may, however, result in excessive costs. Numerous methods of optimizing cloud computing resources have been proposed, but such optimization commonly degrades system responsiveness which results in quality of service deterioration. This paper presents a novel approach, using anomaly detection and machine learning to achieve cost-optimized and QoS-constrained cloud resource configuration. The utilization of these techniques enables our solution to adapt to different system characteristics and different QoS constraints. Our solution was evaluated using a system located in Microsoft’s Azure cloud environment, and its efficiency in other providers’ computing clouds was estimated as well. Experiment results demonstrate a cost reduction ranging from 51% to 85% (for PaaS/IaaS) over the tested period.
Data Availability
The data that support the findings of this study are available from OTI Europa ASEC but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are, however, available from the authors upon reasonable request and with permission of OTI Europa ASEC.
References
Adhikari, M., Amgoth, T.: Multi-objective accelerated particle swarm optimization technique for scientific workflows in iaas cloud. In: 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp 1448–1454. IEEE (2018)
Akintoye, S. B., Bagula, A.: Improving quality-of-service in cloud/fog computing through efficient resource allocation. Sensors 19(6), 1267 (2019)
Alessio, B., De Donato, W., Persico, V., Pescapé, A.: On the integration of cloud computing and internet of things. In: Proc. Future Internet of Things and Cloud (FiCloud), pp. 23–30 (2014)
Ardagna, D., Ciavotta, M., Lancellotti, R., Guerriero, M.: A hierarchical receding horizon algorithm for qos-driven control of multi-iaas applications. IEEE Transactions on Cloud Computing (2018)
Beegom, A. A., Rajasree, M.: Integer-pso: a discrete pso algorithm for task scheduling in cloud computing systems. Evol. Intel. 12(2), 227–239 (2019)
Bheda, H. A., Lakhani, J.: Qos and performance optimization with vm provisioning approach in cloud computing environment. In: 2012 Nirma University International Conference on Engineering (NUiCONE), pp 1–5. IEEE (2012)
Calheiros, R. N., Ranjan, R., Buyya, R.: Virtual machine provisioning based on analytical performance and qos in cloud computing environments. In: 2011 International Conference on Parallel Processing, pp. 295–304 (2011)
Chaisiri, S., Lee, B. S., Niyato, D.: Robust cloud resource provisioning for cloud computing environments. In: 2010 IEEE International Conference on Service-Oriented Computing and Applications (SOCA), pp. 1–8. IEEE (2010)
Chan, L., Silverman, B. W., Vincent, K.: Multiple systems estimation for sparse capture data: Inferential challenges when there are nonoverlapping lists. J. Am. Stat. Assoc., 1–10 (2020)
Chen, Y., Huang, J., Lin, C., Shen, X.: Multi-objective service composition with qos dependencies. IEEE Transactions on Cloud Computing 7(2), 537–552 (2019)
Cherubin, G., Baldwin, A., Griffin, J.: Exchangeability martingales for selecting features in anomaly detection. In: Conformal and Probabilistic Prediction and Applications, pp. 157–170 (2018)
Comi, A., Fotia, L., Messina, F., Pappalardo, G., Rosaci, D., Sarné, G. M. L.: A reputation-based approach to improve qos in cloud service composition. In: 2015 IEEE 24th International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises, pp. 108–113 (2015)
Evangelinou, A., Ciavotta, M., Ardagna, D., Kopaneli, A., Kousiouris, G., Varvarigou, T.: Enterprise applications cloud rightsizing through a joint benchmarking and optimization approach. Futur. Gener. Comput. Syst. 78, 102–114 (2018)
Gavvala, S. K., Jatoth, C., Gangadharan, G., Buyya, R.: Qos-aware cloud service composition using eagle strategy. Futur. Gener. Comput. Syst. 90, 273–290 (2019)
Gill, S. S., Buyya, R., Chana, I., Singh, M., Abraham, A.: Bullet: particle swarm optimization based scheduling technique for provisioned cloud resources. J. Netw. Syst. Manag. 26(2), 361–400 (2018)
Goiri, Í. , Julià, F., Fitó, J. O., Macías, M., Guitart, J.: Resource-level qos metric for cpu-based guarantees in cloud providers. In: International Workshop on Grid Economics and Business Models, pp. 34–47. Springer (2010)
Hayyolalam, V., Kazem, A. A. P.: A systematic literature review on qos-aware service composition and selection in cloud environment. J. Netw. Comput. Appl. 110, 52–74 (2018)
He, F., Sato, T., Chatterjee, B. C., Kurimoto, T., Urushidani, S., Oki, E.: Robust optimization model for backup resource allocation in cloud provider. In: 2018 IEEE International Conference on Communications (ICC), pp. 1–6. IEEE (2018)
Jian, C., Li, M., Kuang, X.: Edge cloud computing service composition based on modified bird swarm optimization in the internet of things. Clust. Comput. 22(4), 8079–8087 (2019)
Jiang, W., Lee, D., Hu, S.: Large-scale longitudinal analysis of soap-based and restful web services. In: 2012 IEEE 19th International Conference on Web Services, pp. 218–225 (2012)
Kumar, T. S.: Efficient resource allocation and qos enhancements of IoT with fog network. Journal of ISMAC 1(02), 101–110 (2019)
Li, J., Chinneck, J., Woodside, M., Litoiu, M., Iszlai, G.: Performance model driven qos guarantees and optimization in clouds. In: 2009 ICSE Workshop on Software Engineering Challenges of Cloud Computing, pp. 15–22. IEEE (2009)
Medel, V., Tolosana-Calasanz, R., Bañares, J. Á. , Arronategui, U., Rana, O. F.: Characterising resource management performance in kubernetes. Computers & Electrical Engineering 68, 286–297 (2018)
Mehmood, T., Latif, S., Malik, S.: Prediction of cloud computing resource utilization. In: 2018 15th International Conference on Smart Cities: Improving Quality of Life Using ICT & IoT (HONET-ICT), pp. 38–42. IEEE (2018)
Mersy, G., Santore, V., Rand, I., Kleinman, C., Wilson, G., Bonsall, J., Edwards, T.: A comparison of machine learning algorithms applied to american legislature polarization. arXiv:2008.04072 (2020)
Naseri, A., Navimipour, N. J.: A new agent-based method for qos-aware cloud service composition using particle swarm optimization algorithm. J. Ambient. Intell. Humaniz. Comput. 10(5), 1851–1864 (2019)
Oliveira, T., Barbar, J., Soares, A.: Computer network traffic prediction: A comparison between traditional and deep learning neural networks. Int. J. Big Data Intell. 3, 28 (2016)
Osypanka, P., Nawrocki, P.: Resource usage cost optimization in cloud computing using machine learning. IEEE Transactions on Cloud Computing, 1–1 (2020)
Rahman, S., Ahmed, T., Huynh, M., Tornatore, M., Mukherjee, B.: Auto-scaling vnfs using machine learning to improve qos and reduce cost. In: 2018 IEEE International Conference on Communications (ICC), pp. 1–6 (2018)
Rokach, L.: Decision forest: Twenty years of research. Information Fusion 27, 111–125 (2016)
Sniezynski, B., Nawrocki, P., Wilk, M., Jarzab, M., Zielinski, K.: VM reservation plan adaptation using machine learning in cloud computing. Journal of Grid Computing 17(4), 797–812 (2019)
Sun, Y., White, J., Li, B., Walker, M., Turner, H.: Automated qos-oriented cloud resource optimization using containers. Automated Software Engineering 24(1), 101–137 (2017)
Tang, Y.: Beyond em: A faster bayesian linear regression algorithm without matrix inversions. Neurocomputing 378, 435–440 (2020)
Tchernykh, A., Schwiegelsohn, U., Alexandrov, V., Talbi, E.g.: Towards understanding uncertainty in cloud computing resource provisioning. Procedia Computer Science 51, 1772–1781 (2015)
Thanka, M. R., Maheswari, P. U., Edwin, E. B.: An improved efficient: Artificial bee colony algorithm for security and qos aware scheduling in cloud computing environment. Clust. Comput. 22 (5), 10905–10913 (2019)
Varshney, S., Sandhu, R., Gupta, P.: Qos based resource provisioning in cloud computing environment: a technical survey. In: International Conference on Advances in Computing and Data Sciences, pp. 711–723. Springer (2019)
Wong, T. T., Yang, N. Y.: Dependency analysis of accuracy estimates in k-fold cross validation. IEEE Trans. Knowl. Data Eng. 29(11), 2417–2427 (2017)
Yang, J., Xiao, W., Jiang, C., Hossain, M. S., Muhammad, G., Amin, S. U.: Ai-powered green cloud and data center. IEEE Access 7, 4195–4203 (2018)
Yao, J., Lu, Q., Jacobsen, H. A., Guan, H.: Robust multi-resource allocation with demand uncertainties in cloud scheduler. In: 2017 IEEE 36th Symposium on Reliable Distributed Systems (SRDS), pp. 34–43. IEEE (2017)
Ye, Z., Mistry, S., Bouguettaya, A., Dong, H.: Long-term qos-aware cloud service composition using multivariate time series analysis. IEEE Trans. Serv. Comput. 9(3), 382–393 (2016)
Yu, Y., Jindal, V., Bastani, F., Li, F., Yen, I. L.: Improving the smartness of cloud management via machine learning based workload prediction. In: 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC), vol. 2, pp 38–44. IEEE (2018)
Acknowledgements
The research presented in this paper was supported by funds from the Polish Ministry of Science and Higher Education assigned to the AGH University of Science and Technology.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interests
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Nawrocki, P., Osypanka, P. Cloud Resource Demand Prediction using Machine Learning in the Context of QoS Parameters. J Grid Computing 19, 20 (2021). https://doi.org/10.1007/s10723-021-09561-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10723-021-09561-3
Keywords
- Cloud computing
- Resource usage prediction
- Anomaly detection
- Machine learning
- Quality of service
- Resource cost optimization