Advertisement

Soft Computing

, Volume 21, Issue 16, pp 4531–4542 | Cite as

Analysis of power consumption in heterogeneous virtual machine environments

  • Catalin Negru
  • Mariana Mocanu
  • Valentin Cristea
  • Stelios Sotiriadis
  • Nik Bessis
Focus

Abstract

Reduction of energy consumption in Cloud computing datacenters today is a hot a research topic, as these consume large amounts of energy. Furthermore, most of the energy is used inefficiently because of the improper usage of computational resources such as CPU, storage and network. A good balance between the computing resources and performed workload is mandatory. In the context of data-intensive applications, a significant portion of energy is consumed just to keep alive virtual machines or to move data around without performing useful computation. Moreover, heterogeneity of resources increases the difficulty degree, when trying to achieve energy efficiency. Power consumption optimization requires identification of those inefficiencies in the underlying system and applications. Based on the relation between server load and energy consumption, we study the efficiency of data-intensive applications, and the penalties, in terms of power consumption, that are introduced by different degrees of heterogeneity of the virtual machines characteristics in a cluster.

Keywords

Cloud computing Energy-efficiency Virtualization  Data intensive-applications 

Notes

Acknowledgments

The work has been funded by the projects: DataWay: Real-time Data Processing Platform for Smart Cities: Making sense of Big Data, PN-II-RU-TE-2014-4-2731; CyberWater grant of the Romanian National Authority for Scientific Research, CNDI-UEFISCDI, project number 47/2012.

Compliance with ethical standards

Conflict of interest

The authors of this paper Catalin Negru, Mariana Mocanu, Valentin Cristea, Stelios Sotiriadis and Nik Bessis declare that they have no conflict of interest.

Human and animal rights

This article does not contain any studies with human participants or animals performed by any of the authors.

References

  1. Andreas M, Natalia K, Christine S (2012) Towards cloud-centric service environments. J Serv Sci Res 4(2):213–234CrossRefGoogle Scholar
  2. Andreas B, Hermann D (2011) An energy consumption model for virtualized office environments. Futur Gener Comput Syst 27(8):1047–1055CrossRefGoogle Scholar
  3. Aroca JA, Anta AF, Mosteiro MA, Thraves C, Wang L (2016) Power-efficient assignment of virtual machines to physical machines. Futur Gener Comput Syst 54:82–94Google Scholar
  4. Barroso LA, Clidaras J, Hölzle U (2013) The datacenter as a computer: An introduction to the design of warehouse-scale machines. Synth Lect Comput Archit 8(3):1–154Google Scholar
  5. Bessis N, Sotiriadis S, Pop F, Cristea V (2012) Optimizing the energy efficiency of message exchanging for service distribution in interoperable infrastructures. In: Intelligent networking and collaborative systems (INCoS), 2012 4th international conference on IEEE, pp 105–112Google Scholar
  6. Bessis N, Sotiriadis S, Pop F, Cristea V (2013) Using a novel message exchanging optimization (meo) model to reduce energy consumption in distributed systems. Simul Model Pract Theory 39:104–120Google Scholar
  7. Bircher WL, John LK (2012) Complete system power estimation using processor performance events. Comput IEEE Trans 61(4):563–577Google Scholar
  8. Bohra AEH, Chaudhary V (2010) Vmeter: power modelling for virtualized clouds. In: Parallel and distributed processing, workshops and Phd Forum (IPDPSW), 2010 IEEE International Symposium on IEEE, pp 1–8Google Scholar
  9. Borthakur D (2008) Hdfs architecture guide. HADOOP APACHE PROJECT http://hadoop.apache.org/common/docs/current/hdfsdesign.pdf
  10. Borthakur D, Gray J, Sarma JS, Muthukkaruppan K, Spiegelberg N, Kuang H, Ranganathan K, Molkov D, Menon A, Rash S et al (2011) Apache hadoop goes realtime at facebook. In: Proceedings of the 2011 ACM SIGMOD international conference on management of data ACM, pp 1071–1080Google Scholar
  11. Christoph M, Waltenegus D, Alexander S (2014) Power consumption estimation models for processors, virtual machines, and servers. Parallel Distrib Syst IEEE Trans 25(6):1600–1614CrossRefGoogle Scholar
  12. Copeland M, Soh J, Puca A, Manning M, Gollob D (2015) Microsoft azure and cloud computing. In: Microsoft azure. Apress, New York, pp 3–26Google Scholar
  13. Delforge P (2014) America’s data centers consuming and wasting growing amounts of energy. Natural Resource Defense Council. Retrieved from http://www.nrdc.org/energy/data-center-efficiency-assessment.asp
  14. Demchenko Y, Grosso P, De Laat C, Membrey P (2013) Addressing big data issues in scientific data infrastructure. In: Collaboration technologies and systems (CTS), 2013 international conference on IEEE, pp 48–55Google Scholar
  15. Dorigo M, Birattari M (2010) Ant colony optimization. In: Encyclopedia of machine learning. Springer, New York, pp 36–39Google Scholar
  16. Enhanced Intel (2004) Speedstep technology for the intel pentium m processor. Retrieved from http://download.intel.com/design/network/papers/30117401.pdf
  17. Ewa N-S, Andrzej S, Piotr A, Mariusz K, Marcin M, Joanna K (2014) Dynamic power management in energy-aware computer networks and data intensive computing systems. Futur Gener Comput Syst 37:284–296CrossRefGoogle Scholar
  18. Feller E, Rilling L, Morin C (2011) Energy-aware ant colony based workload placement in clouds. In: Proceedings of the 2011 IEEE/ACM 12th international conference on grid computing. IEEE Computer Society, USA, pp 26–33Google Scholar
  19. Ficco M, Palmieri F (2015) Introducing fraudulent energy consumption in cloud infrastructures: a new generation of denial-of-service attacks. Syst J IEEE (99):1–11Google Scholar
  20. Florin P, Ciprian D, Valentin C, Nik B, Fatos X, Leonard B (2015) Deadline scheduling for aperiodic tasks in inter-cloud environments: a new approach to resource management. J Supercomput 71(5):1754–1765CrossRefGoogle Scholar
  21. Ghit B, Capota M, Hegeman T, Hidders J, Epema D, Iosup A (2014) V for vicissitude: the challenge of scaling complex big data workflows. In: Cluster, cloud and grid computing (CCGrid), 2014 14th IEEE/ACM international symposium on IEEE, pp 927–932Google Scholar
  22. Goudarzi H, Pedram M (2012) Energy-efficient virtual machine replication and placement in a cloud computing system. In: Cloud computing (CLOUD), 2012 IEEE 5th international conference on IEEE, pp 750–757Google Scholar
  23. Iordache GV, Boboila MS, Pop F, Stratan C, Cristea V (2006) A decentralized strategy for genetic scheduling in heterogeneous environments. In: On the move to meaningful internet systems 2006: CoopIS, DOA, GADA, and ODBASE. Springer, New York, pp 1234–1251Google Scholar
  24. Isard M, Budiu M, Yu Y, Birrell A, Fetterly D (2007) Dryad: distributed data-parallel programs from sequential building blocks. In: ACM SIGOPS operating systems review, vol 41. ACM, New York, pp 59–72Google Scholar
  25. Jeffrey D, Sanjay G (2008) Mapreduce: simplified data processing on large clusters. Commun ACM 51(1):107–113CrossRefGoogle Scholar
  26. Khosravi A, Garg SK, Buyya R (2013) Energy and carbon-efficient placement of virtual machines in distributed cloud data centers. In: Euro-Par 2013 parallel processing. Springer, New York, pp 317–328Google Scholar
  27. Kołodziej J, Khan SU, Xhafa F (2011) Genetic algorithms for energy-aware scheduling in computational grids. In: P2P, parallel, grid, cloud and internet computing (3PGCIC), 2011 international conference on IEEE, pp 17–24Google Scholar
  28. KołOdziej J, Khan SU (2012) Multi-level hierarchic genetic-based scheduling of independent jobs in dynamic heterogeneous grid environment. Inf Sci 214:1–19CrossRefGoogle Scholar
  29. Kolodziej J, Szmajduch M, Maqsood T, Madani SA, Min-Allah N, Khan SU (2013a) Energy-aware grid scheduling of independent tasks and highly distributed data. In: Frontiers of information technology (FIT), 2013 11th international conference on IEEE, pp 211–216Google Scholar
  30. Kolodziej J, Szmajduch M, Khan SU, Wang L, Chen D (2013b) Genetic-based solutions for independent batch scheduling in data grids. International conference on ECMS pp 504–510Google Scholar
  31. Kou Lawrence T, George M (1977) Multidimensional bin packing algorithms. IBM J Res Dev 21(5):443–448MathSciNetCrossRefzbMATHGoogle Scholar
  32. Lim MY, Porterfield A, Fowler R (2010) Softpower: fine-grain power estimations using performance counters. In: Proceedings of the 19th ACM international symposium on high performance distributed computing. ACM, San Jose, California, pp 308–311Google Scholar
  33. Lin C-C, Liu P, Wu J-J (2011) Energy-aware virtual machine dynamic provision and scheduling for cloud computing. In: Cloud computing (CLOUD), 2011 IEEE international conference on IEEE, pp 736–737Google Scholar
  34. Maciel P, Callou G, Tavares E, Sousa E, Silva B et al (2011) Estimating reliability importance and total cost of acquisition for data center power infrastructures. In: Systems, man, and cybernetics (SMC), 2011 IEEE international conference on IEEE, pp 421–426Google Scholar
  35. Mhedheb Y, Jrad F, Tao J, Zhao J, Kołodziej J, Streit A (2013) Load and thermal-aware vm scheduling on the cloud. In: Algorithms and architectures for parallel processing. Springer, New York, pp 101–114Google Scholar
  36. Mohsen S, Hadi S, Mahsa N (2012) Power-efficient distributed scheduling of virtual machines using workload-aware consolidation techniques. J Supercomput 61(1):46–66CrossRefGoogle Scholar
  37. Molnar E, Kryvinska N, Greguš M, (2014) Customer driven big-data analytics for the companies’ servitization. In: Baines T, Clegg B, Harrison D (eds) The spring servitization conference 2014 (SSC 2014), 12–14 May 2014, Aston Business School, Aston University, UK, pp 133–140Google Scholar
  38. Negru C, Mocanu M, Cristea V, (2015a) Impact of virtual machines heterogeneity on data center power consumption in data-intensive applications. In adaptive resource management and scheduling for cloud computing. Springer, New York, pp 91–102Google Scholar
  39. Negru C, Mocanu M, Chiru C, Draghia A, Drobot R (2015b) Cost efficient cloud-based service oriented architecture for water pollution prediction. In: Intelligent computer communication and processing (ICCP), 2015 IEEE international conference on IEEE, pp 417–423Google Scholar
  40. Pallipadi V (2009) Enhanced intel speedstep technology and demand-based switching on linux. Intel Developer ServiceGoogle Scholar
  41. Panigrahy R, Talwar K, Uyeda L, Wieder U (2011) Heuristics for vector bin packing. research. microsoft. comGoogle Scholar
  42. Peng X, Zhigang H, Dongbo L, Guofeng Y, Xilong Q (2013) Virtual machine power measuring technique with bounded error in cloud environments. J Netw Comput Appl 36(2):818–828Google Scholar
  43. Pillai P, Shin KG (2001) Real-time dynamic voltage scaling for low-power embedded operating systems. In: ACM SIGOPS operating systems review, vol 35. ACM, New York, pp 89–102Google Scholar
  44. Prekas G, Primorac M, Belay A, Kozyrakis C, Bugnion E (2015) Energy proportionality and workload consolidation for latency-critical applications. In: Proceedings of the sixth ACM symposium on cloud computing. ACM, New York, pp 342–355Google Scholar
  45. Ramon B, Yolanda B, David C, Vicenç B, Marc G, Xavier M, Nacho N, Jordi T, Eduard A (2012) Energy accounting for shared virtualized environments under dvfs using pmc-based power models. Futur Gener Comput Syst 28(2):457–468CrossRefGoogle Scholar
  46. Roman K, Markus G, Natalia K, Andreas M, Christine S, Christian S (2013) Strategic management of disruptive technologies: a practical framework in the context of voice services and of computing towards the cloud. Int J Grid Utility Comput 4(1):47–59CrossRefGoogle Scholar
  47. Sfrent A, Pop F (2015) Asymptotic scheduling for many task computing in big data platforms. Inf SciGoogle Scholar
  48. Sotiriadis S, Bessis N, Antonopoulos N (2011) Towards inter-cloud schedulers: a survey of meta-scheduling approaches. In: P2P, parallel, grid, cloud and internet computing (3PGCIC), 2011 international conference on IEEE, pp 59–66Google Scholar
  49. Sotiriadis S, Bessis N, Anjum A, Buyya R (2015) An inter-cloud meta-scheduling (icms) simulation framework: architecture and evaluation. IEEE Trans Serv Comput 99:1–1Google Scholar
  50. Welker MW, OA Place (2015). AMD processor performance evaluation guide. Retrieved from http://support.amd.com/techdocs/30579_3_74.pdf
  51. Yongqiang G, Haibing G, Zhengwei Q, Yang H, Liang L (2013) A multi-objective ant colony system algorithm for virtual machine placement in cloud computing. J Comput Syst Sci 79(8):1230–1242MathSciNetCrossRefzbMATHGoogle Scholar
  52. Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I (2010) Spark: cluster computing with working sets. In: Proceedings of the 2nd USENIX conference on Hot topics in cloud computing (HotCloud’10). USENIX Association, Berkeley, CA, pp 10–10Google Scholar
  53. Zaharia M, Das T, Li H, Hunter T, Shenker S, Stoica I (2013) Discretized streams: fault-tolerant streaming computation at scale. In: Proceedings of the twenty-fourth ACM symposium on operating systems principles (SOSP ’13). ACM, New York, pp 423–438Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2016

Authors and Affiliations

  • Catalin Negru
    • 1
  • Mariana Mocanu
    • 1
  • Valentin Cristea
    • 1
  • Stelios Sotiriadis
    • 2
  • Nik Bessis
    • 3
  1. 1.Computer Science and Engineering DepartmentUniversity “Politehnica” of BucharestBucharestRomania
  2. 2.The Edward Rogers Sr. Department of Electrical and Computer EngineeringUniversity of TorontoTorontoCanada
  3. 3.Department of ComputingEdge Hill UniversityOrmskirkUK

Personalised recommendations