Skip to main content
SpringerLink
Log in

Predicting QoS of virtual machines via Bayesian network with XGboost-induced classes

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Quality of Service (QoS) of virtual machines (VMs) is guaranteed by the Service Level Agreements (SLAs) signed between users and service providers during the renting of VMs. A typical idea to ensure the SLAs being reached is to predict the QoS of VMs accurately and then take the appropriate measures according to the prediction results timely. However, the QoS is affected by multiple VM-related features, among which the uncertain and non-linear relationships are challenging to represent and analyze. Thus, in this paper, we construct a class parameter augmented Bayesian Network (CBN) to overcome the difficulties and then predict the QoS of VMs accurately. Specifically, we first cluster multiple VM-related features based on the Euclidean distance, and then use XGboost to classify the different VM configurations within each cluster. Then, we construct the CBN based on the classification results as well as the corresponding QoS values. Consequently, we predict the QoS of VMs via the variable elimination (VE) with CBN. Experimental results show the efficiency and effectiveness of our proposed method on predicting the QoS of VMs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Notes

  1. Amazon EC2. http://aws.amazon.com/ec2/, 2020.

  2. The PARSEC Benchmark Suite, https://parsec.cs.princeton.edu/, 2020.

  3. The phoronix-test-suite, http://www.phoronix-test-suite.com/, 2020.

  4. Netica, https://www.norsys.com/netica.html, 2020.

  5. Student’s t distribution: https://byjus.com/maths/t-distribution/, 2020.

References

  1. Danilov, A., Andersen, J., Molodkina, J., et al.: The NIST definition of cloud computing. Commun. ACM 53, 50–50 (2011)

    Google Scholar 

  2. Alin, Z., Hai, J., Song, W., et al.: Performance implications of non-uniform VCPU-PCPU mapping in virtualization environment. Clust. Comput. 16(3), 347–358 (2013)

    Article  Google Scholar 

  3. Hayyolalam, V., Kazem, A.: A systematic literature review on QoS-aware service composition and selection in cloud environment. J. Netw. Comput. Appl. 110, 52–74 (2018)

    Article  Google Scholar 

  4. Gavvala, S., Jatoth, C., Buyya, G.: QoS-aware cloud service composition using eagle strategy. Future Gener. Comput. Syst. 90, 273–290 (2019)

    Article  Google Scholar 

  5. Dabbagh, M., Hamdaoui, B., Guizani, M., et al.: An energy-efficient VM prediction and migration framework for overcommitted clouds. IEEE Trans. Cloud Comput. 6(4), 955–966 (2018)

    Article  Google Scholar 

  6. Mostafa, G., Sam, J., Mohammad, P.: An autonomic resource provision approach for service-based cloud application: a hybrid approach. Future Gener. Comput. Syst. 78, 191–210 (2018)

    Article  Google Scholar 

  7. Jyoti, A., Shrimali, M.: Dynamic provisioning of resources based on load balancing and service broker policy in cloud computing. Clust. Comput. 23(1), 377–395 (2020)

    Article  Google Scholar 

  8. Ignatyev, O.A.: Optimal allocation of cloud multi-tenant platform infrastructure resources. Int. J. Cloud Comput. 8(1), 117–139 (2019)

    Article  Google Scholar 

  9. Sung, H., Min, J., Ha, S., et al.: OMBM: optimized memory bandwidth management for ensuring QoS and high server utilization. Clust. Comput. 22(1), 161–174 (2019)

    Article  Google Scholar 

  10. Hao, J., Zhang, B., Yue, K., et al.: Measuring Performance Degradation of Virtual Machines Based on the Bayesian Network with Hidden Variables. International Journal of Communication System. 31(13), e3732 (2018). https://doi.org/10.1002/dac.3732

    Article  Google Scholar 

  11. Jonas, V., Wannes, M., Guy, V., et al.: Exploiting local and repeated structure in Dynamic Bayesian Networks. Artif. Intell. 232, 43–53 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  12. Chen, T., Guestrin, C.: XGBoost: a scalable tree boosting system. In: International Conference on Knowledge Discovery and Data Mining. pp. 785–794, (2016)

  13. Yue, K., Fang, Q., Wang, X., et al.: A parallel and incremental approach for data-intensive learning of Bayesian networks. IEEE Trans. Cybernet. 45(12), 2890–2904 (2015)

    Article  Google Scholar 

  14. Liu, Y., Liu, S., Wang, Y., et al.: A stochastic computational multi-layer perceptron with backward propagation. IEEE Trans. Comput. 67(9), 1273–1286 (2018)

    Article  MathSciNet  Google Scholar 

  15. Liu, Q., Yu, Z.: The elasticity and plasticity in semi-containerized co-locating cloud workload: a view from alibaba trace. In: IEEE International System-on-Chip Conference. pp. 347–360, (2018)

  16. Vozmediano, M., Montero, R., Huedo, E., et al.: Efficient resource provisioning for elastic Cloud services based on machine learning techniques. J. Cloud Comput. (2019). https://doi.org/10.1186/s13677-019-0128-9

    Article  Google Scholar 

  17. Lin, J., Chen, C.: Interference-aware virtual machine placement in cloud computing systems. In: International Conference on Computer & Information Science. pp. 598–603 (2012)

  18. Xiong, H., Wang, C.: Cloud application classification and fine-grained resource provision based on prediction. J, Comput. Appl. 33(6), 1534–1539 (2013)

    Google Scholar 

  19. Li, B., Guo, S., Wu, Y.: Construction and resource allocation of cost-efficient clustered virtual network in software defined networks. J. Grid Comput. 4, 1–17 (2017)

    Google Scholar 

  20. Huda, O., Raafat, E.: An integer linear programming model and adaptive genetic algorithm approach to minimize energy consumption of cloud computing data centers. Comput. Electr. Eng. 67, 551–565 (2018)

    Article  Google Scholar 

  21. Jlassi, S., Mammar, A., Abbassi, I., et al.: Towards correct cloud resource allocation in FOSS applications. Future Gener. Comput. Syst. 91, 392–406 (2019)

    Article  Google Scholar 

  22. Li, F., Yang, D., Zhou, P., et al.: Modeling application performance in a virtualized environment. Comput. Syst. Appl. 24, 9–15 (2015)

    Google Scholar 

  23. Khandelwal, V., Chaturvedi, A., Gupta, C.: Amazon EC2 spot price prediction using regression random forests. IEEE Trans. Cloud Comput. 8(1), 59–72 (2020)

    Article  Google Scholar 

  24. Gond, S., Singh, S.: Dynamic load balancing using hybrid approach. Int. J. Cloud Appl. Comput. 9(3), 75–88 (2019)

    Google Scholar 

  25. Radhakrishnan, A., Kavitha, V.: Energy conservation in cloud data centers by minimizing virtual machines migration through artificial neural network. Concurr. Comput. 98(11), 1–18 (2016)

    MathSciNet  Google Scholar 

  26. Xia, Q., Lan, Y., Xiao, L.: Scheduling resource of IaaS clouds for energy saving based on predicting the overloading status of physical machines. Int. Conf. Algorithms Archit. Parallel Process. 9523, 211–221 (2015)

    Article  Google Scholar 

  27. Hammer, L., Yazidi, A., Begnum, K.: An inhomogeneous hidden Markov model for efficient virtual machine placement in cloud computing environments. J. Forecast. 36(4), 407–420 (2017)

    MathSciNet  MATH  Google Scholar 

  28. Gill, S., Chana, I., Singh, M., et al.: CHOPPER: an intelligent QoS-aware autonomic resource management approach for cloud computing. Clust. Comput. 21(2), 1203–1241 (2018)

    Google Scholar 

  29. Hu, C., Deng, Y., Min, G., et al.: QoS promotion in energy-efficient datacenters through peak load scheduling. IEEE Trans. Cloud Comput. (2018). https://doi.org/10.1109/TCC.2018.2886187

    Article  Google Scholar 

  30. Chang, X., Xia, R., Muppala, J.: Effective modeling approach for IaaS data center performance analysis under heterogeneous workload. IEEE Trans. Cloud Comput. 6(4), 991–1003 (2018)

    Article  Google Scholar 

  31. Ramezani, F., Naderpour, M., Lu, J.: Handling uncertainty in cloud resource management using fuzzy Bayesian networks. IEEE Int. Conf. Fuzzy Syst. (2015). https://doi.org/10.1155/2015/383209

    Article  Google Scholar 

  32. Shyam, G., Manvi, S.: Virtual resource prediction in cloud environment: a Bayesian approach. J. Netw. Comput. Appl. 65, 144–154 (2016)

    Article  Google Scholar 

  33. Yan, C., Li, Z., Yu, X.: Bayesian networks-based selection algorithm for virtual machine to be migrated. Big Data Cloud Comput. 16, 573–578 (2016)

    Google Scholar 

  34. Li, Z., Yan, C., Yu, X.: Bayesian network-based virtual machines consolidation method. Future Gener. Comput. Syst. 69, 75–87 (2017)

    Article  Google Scholar 

  35. Delimitrou, C., Kozyrakis, C.: Quasar: resource-efficient and QoS-aware cluster management. In: International Conference on Architectural Support for Programming Languages and Operating Systems. pp. 127–144 (2014)

  36. Yue, K., Wei, M., Tian, K., Liu, W.: Representing and inferring causalities among classes of multidimensional data. Lect. Notes Comput. Sci. 5446, 223–234 (2009)

    Article  Google Scholar 

  37. Shang, C., Hao, J., Zhang, B., Yue, K.: Performance prediction of virtual machines via the class parameter augmented Bayesian network. J. Chin. Comput. Syst. 40(7), 1416–1422 (2019)

    Google Scholar 

Download references

Acknowledgements

This paper was supported by the National Natural Science Foundation of China (U1802271, 61962030), Science Foundation for Distinguished Young Scholars of Yunnan Province (2019FJ011), China Postdoctoral Science Foundation (2020M673310) and Donglu Scholar Cultivation Project of Yunnan University.

Author information

Authors and Affiliations

  1. School of Information Science and Engineering, Yunnan University, Kunming, China

    Jia Hao, Kun Yue, Liang Duan & Binbin Zhang

  2. College of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China

    Xiaodong Fu

Authors
  1. Jia Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kun Yue
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Liang Duan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Binbin Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xiaodong Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kun Yue.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hao, J., Yue, K., Duan, L. et al. Predicting QoS of virtual machines via Bayesian network with XGboost-induced classes. Cluster Comput 24, 1165–1184 (2021). https://doi.org/10.1007/s10586-020-03183-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-020-03183-2

Keywords

Search

Navigation