Skip to main content
SpringerLink
Log in

Machine Learning for Cloud Resources Management—An Overview

  • Conference paper
  • First Online:
Computer Networks and Inventive Communication Technologies

Part of the book series: Lecture Notes on Data Engineering and Communications Technologies ((LNDECT,volume 141))

Abstract

Nowadays, an important topic that is considered a lot is how to integrate Machine Learning (ML) to cloud resources management. In this study, our goal is to explore the most important cloud resources management issues that have been combined with ML and which present many promising results. To accomplish this, we used chronological charts based on keywords that we considered important and tried to answer the question: is ML suitable for resources management problems in the cloud? Furthermore, a short discussion takes place on the data that are available and the open challenges on it. A big collection of researches is used to make sensible comparisons between the ML techniques that are used in the different kind of cloud resources management fields and we propose the most suitable ML model for each field.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Global digital population as of July 2020. https://www.statista.com/statistics/617136/digital-population-worldwide/

  2. Lakshmi Devasena C (2014) Impact study of cloud computing on business development. Oper Res Appl Int J (ORAJ) 1:1–7

    Google Scholar 

  3. Rajaraman V (2014) Cloud Comput. Reson 19:242–258. https://doi.org/10.1007/s12045-014-0030-1

    Article  Google Scholar 

  4. Wieder P, Butler JM, Wolfgang T, Yahyapour R (2011) Service level agreements for cloud computing. https://link.springer.com/book/10.1007/978-1-4614-1614-2. Cited 15 Jan 2011

  5. Kohavi R, Provost F (1998) Glossary of terms. Mach Learn 30(2–3):271–274

    Google Scholar 

  6. Samuel AL (1959) Some studies in machine learning using the game of checkers. IBM J Res Develop 3(3):210–229. https://doi.org/10.1147/rd.33.0210

    Article  MathSciNet  Google Scholar 

  7. Alipour H, Liu Y (2017) Online machine learning for cloud resource provisioning of microservice backend systems. In: 2017 IEEE International conference on big data (Big Data), Boston, MA, pp 2433-2441. https://doi.org/10.1109/BigData.2017.8258201

  8. Islam S et al (2012) Empirical prediction models for adaptive resource provisioning in the cloud. Future Gener Comput Syst 28(1), pp 155–162. ISSN 0167-739X, https://doi.org/10.1016/j.future.2011.05.027

  9. Bankole AA, Ajila SA (2013) Predicting cloud resource provisioning using machine learning techniques. In: 2013 26th IEEE Canadian conference on electrical and computer engineering (CCECE), Regina, SK, pp. 1–4. https://doi.org/10.1109/CCECE.2013.6567848

  10. Rafael M-V, Rubén M, Eduardo H, Ignacio L (2019) Efficient resource provisioning for elastic Cloud services based on machine learning techniques. J Cloud Comput 8. https://doi.org/10.1186/s13677-019-0128-9

  11. Netflix Data Benchmark, https://medium.com/netflix- techblog/netflix-data-benchmark-benchmarking-cloud-data-stores-7266186ded11

  12. Biswas A, Majumdar S, Nandy B, El-Haraki A (2014) Automatic resource provisioning: a machine learning based proactive approach. In: 2014 IEEE 6th International conference on cloud computing technology and science, Singapore, pp 168–173. https://doi.org/10.1109/CloudCom.2014.147

  13. Smith WD. TPC-W*: Benchmarking an ecommerce solution

    Google Scholar 

  14. Bartłomiej Ś, Piotr P, Michal W, Marcin J, Krzysztof Z (2019) VM reservation plan adaptation using machine learning in cloud Computing. J Grid Comput 17. https://doi.org/10.1007/s10723-019-09487-x

  15. Yang R, Ouyang X, Chen Y, Townend P, Xu J (2018) Intelligent resource scheduling at scale: a machine learning perspective. In: IEEE Symposium on service-oriented system engineering (SOSE), Bamberg, pp 132–141. https://doi.org/10.1109/SOSE.2018.00025

  16. Singh S, Chana I (2015) QRSF: QoS-aware resource scheduling framework in cloud computing. J Supercomput 71:241–292. https://doi.org/10.1007/s11227-014-1295-6

    Article  Google Scholar 

  17. Tong Z, Deng X, Chen H et al (2020) QL-HEFT: a novel machine learning scheduling scheme base on cloud computing environment. Neural Comput Appl 32:5553–5570. https://doi.org/10.1007/s00521-019-04118-8

    Article  Google Scholar 

  18. Liu N, Li Z, Xu Z, Xu J, Lin S, Qiu Q, Tang J, Wang Y (2017) A hierarchical framework of cloud resource allocation and power management using deep reinforcement learning

    Google Scholar 

  19. Reiss C, Wilkes J, Hellerstein JL. Google cluster-usage traces: format + schema. http://code.google.com/p/googleclusterdata/wiki/TraceVersion2

  20. Zhang J, Xie N, Zhang X, Yue K, Li W, Kumar D (2018) Machine learning based resource allocation of cloud computing in auction. Comput Mater Continua 56:123–135. https://doi.org/10.3970/cmc.2018.03728

    Article  Google Scholar 

  21. Chen X, Zhu F, Chen Z, Min G, Zheng X, Rong C (2020) Resource allocation for cloud-based software services using prediction-enabled feedback control with reinforcement learning. In: IEEE Trans Cloud Comput. https://doi.org/10.1109/TCC.2020.2992537

  22. The grid workloads archive. http://gwa.ewi.tudelft.nl/

    Google Scholar 

  23. Reiss C, Wilkes J, Hellerstein JL (2011) Google cluster-usage traces: format + schema, Google Inc., Mountain View, CA, USA, Technical Report, Nov 2011, revised 20 Mar 2012. Posted at http://code.google.com/p/googleclusterdata/wiki/TraceVersion2

  24. Krisantus S, Andreas B (2013) Dynamic resource allocation for cloud-based media processing. In: Proceedings of the international workshop on network and operating system support for digital audio and video, pp 49–54. https://doi.org/10.1145/2460782.2460791

  25. Lee YC, Zomaya AY (2012) Energy efficient utilization of resources in cloud computing systems. J Supercomput 60:268–280. https://doi.org/10.1007/s11227-010-0421-3

    Article  Google Scholar 

  26. Heath T, Diniz B, Carrera EV, Meira W, Bianchini R (2005) Energy conservation in heterogeneous server clusters. In: Proceedings of the tenth ACM SIGPLAN symposium on principles and practice of parallel programming (PPoPP ’05). Association for Computing Machinery, New York, NY, USA, pp 186–195. https://doi.org/10.1145/1065944.1065969

  27. Prevost JJ, Nagothu K, Kelley B, Jamshidi M (2011) Prediction of cloud data center networks loads using stochastic and neural models. In: 2011 6th International conference on system of systems engineering, Albuquerque, NM, pp 276–281. https://doi.org/10.1109/SYSOSE.2011.5966610

  28. Duy TVT, Sato Y, Inoguchi Y (2010) Performance evaluation of a Green Scheduling Algorithm for energy savings in Cloud computing. In: IEEE International symposium on parallel & distributed processing, workshops and Ph.D. forum (IPDPSW), Atlanta, GA, pp 1–8. https://doi.org/10.1109/IPDPSW.2010.5470908

  29. Cai X-B, Ji Y-X, Han K (2017) Energy efficiency optimizing based on characteristics of machine learning in cloud computing. ITM Web Conf 12:03047. https://doi.org/10.1051/itmconf/20171203047

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the M.Phil. program “Advanced Technologies in Informatics and Computers”, hosted by the Department of Computer Science, International Hellenic University, Greece.

Author information

Authors and Affiliations

  1. MLV Research Group, Department of Computer Science, International Hellenic University, Kavala, 65404, Greece

    Viktoria N. Tsakalidou, Pavlina Mitsou & George A. Papakostas

Authors
  1. Viktoria N. Tsakalidou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pavlina Mitsou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. George A. Papakostas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to George A. Papakostas .

Editor information

Editors and Affiliations

  1. Department of CSE, RVS Technical Campus, Coimbatore, Tamil Nadu, India

    S. Smys

  2. Department of Telecommunication Engineering, Czech Technical University in Prague, Prague, Czech Republic

    Pavel Lafata

  3. Gerald Schwartz School of Business, St. Francis Xavier University, Antigonish, NS, Canada

    Ram Palanisamy

  4. Department of Computer Science, Texas Southern University, Houston, TX, USA

    Khaled A. Kamel

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tsakalidou, V.N., Mitsou, P., Papakostas, G.A. (2023). Machine Learning for Cloud Resources Management—An Overview. In: Smys, S., Lafata, P., Palanisamy, R., Kamel, K.A. (eds) Computer Networks and Inventive Communication Technologies. Lecture Notes on Data Engineering and Communications Technologies, vol 141. Springer, Singapore. https://doi.org/10.1007/978-981-19-3035-5_67

Download citation

  • DOI: https://doi.org/10.1007/978-981-19-3035-5_67

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-19-3034-8

  • Online ISBN: 978-981-19-3035-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation