Abstract
Cloud computing continues to mature and more applications continue to be deployed in public clouds. Client applications deployed in the cloud should automatically scale up and down to match changing workload demands, though they must be careful to ensure that sufficient resources are provisioned to achieve performance objectives. The cloud provider, on the other hand, attempts to reduce costs by reducing power consumption by consolidating load onto fewer, highly utilized machines. In this work, we introduce an algorithm that integrates both application autoscaling and dynamic virtual machine (VM) allocation into a single algorithm in order to achieve the goals of both cloud provider and client. Further, we consider multi-VM applications, such as multi-tiered web-based applications, and extend the integrated algorithm to take the network topology into account when placing or migrating applications. The goal is to reduce VM-to-VM communication latency; our focus is on trying to contain applications within the same racks. We evaluate our work through simulation, showing that the integrated algorithm can achieve better application performance with a significant reduction in virtual machine live migrations, and the topology-aware extension successfully places applications within a single rack.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Amazon: Amazon EC2 Auto Scale. http://aws.amazon.com/autoscaling/ (2013)
Ballani, H., Costa, P., Karagiannis, T., Rowstron, A.: Towards predictable datacenter networks. ACM SIGCOMM Comput. Commun. Rev. 41(4), 242–253 (2011)
Barker, S.K., Shenoy, P: Empirical evaluation of latency-sensitive application performance in the cloud. In: Proceedings of the first annual ACM SIGMM conference on multimedia systems, pp. 35–46. ACM (2010). doi:http://dx.doi.org/10.1145/1730836.1730842
Barroso, L., Holzle, U.: The case for energy-proportional computing. Computer 40(12), 33–37 (2007)
Beloglazov, A., Buyya, R: Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurr. Computat. Pract. Exper., 1–24 (2011)
Bobroff, N., Kochut, A., Beaty, K: Dynamic placement of virtual machines for managing sla violations. In: Proceedings of the 2007 IEEE/IFIP International Symposium on IM. doi:10.1109/INM.2007.374776, pp 119–128 (2007)
Cardosa, M., Korupolu, M.R., Singh, A.: Shares and utilities based power consolidation in virtualized server environments. In: Proceedings of the 2009 IEEE/IFIP international symposium IM, pp 299–302 (2009)
Dias, D.S., Costa, L.H.M.: Online Traffic-aware virtual machine placement in data center networks. In: Global information infrastructure and networking symposium (GIIS), pp 1–8. IEEE (2012)
Ferretti, S., Ghini, V., Panzieri, F., Pellegrini, M., Turrini, E.: Qos–aware clouds. In: 2010 IEEE 3rd international conference on cloud computing (CLOUD), pp 321–328. IEEE (2010)
Foster, G., Keller, G., Tighe, M., Lutfiyya, H., Bauer, M.: The right tool for the job: switching data centre management strategies at runtime. In: 2013 IFIP/IEEE international symposium on integrated network management (IM), pp 151–159 (2013)
Galante, G., de-Bona, L.C.E.: A survey on cloud computing elasticity. In: IEEE/ACM fifth international conference on utility and cloud computing. doi:10.1109/UCC.2012.30, pp 263–270 (2012)
Ghanbari, H., Simmons, B., Litoiu, M., Barna, C., Iszlai, G.: Optimal autoscaling in a iaas cloud. In: Proceedings of the 9th international conference on autonomic computing, pp 173–178. ACM (2012)
Ghanbari, H., Simmons, B., Litoiu, M., Iszlai, G.: Exploring alternative approaches to implement an elasticity policy. In: 2011 IEEE international conference on cloud computing (CLOUD), pp 716–723. IEEE (2011)
Gmach, D., Rolia, J., Cherkasova, L., Belrose, G., Turicchi, T., Kemper, A.: An integrated approach to resource pool management: policies, efficiency and quality metrics. In: 38th Annual IEEE/IFIP international conference on dependable systems and networks (DSN). doi:10.1109/DSN.2008.4630101, pp 326–335 (2008)
Guo, C., Lu, G., Wang, H.J., Yang, S., Kong, C., Sun, P., Wu, W., Zhang, Y.: Secondnet: a data center network virtualization architecture with bandwidth guarantees. In: Proceedings of the 6th international conference, p 15. ACM (2010)
Gupta, A., Milojicic, D., Kalé, L.V.: Optimizing Vm placement for Hpc in the cloud. In: Proceedings of the 2012 workshop on cloud services, federation, and the 8th open cirrus summit, pp 1–6. ACM (2012)
Hyser, C., Mckee, B., Gardner, R., Watson, B.J.: Autonomic virtual machine placement in the data center. Tech. Rep. HPL-2007-189 HP Laboratories (2007)
Jung, G., Joshi, K.R., Hiltunen, M.A., Schlichting, R.D., Pu, C.: A cost-sensitive adaptation engine for server consolidation of multitier applications. In: Middleware 2009, pp 163–183. Springer (2009)
Keller, G., Tighe, M., Lutfiyya, H., Bauer, M.: An analysis of first fit heuristics for the virtual machine relocation problem. In: Proceedings of the 6th international DMTF academic alliance workshop on SVM, pp 406–413 (2012)
Kephart, J., Chess, D.: The vision of autonomic computing. IEEE Comput. 36(1), 41–50 (2003)
Khanna, G., Beaty, K., Kar, G., Kochut, A.: Application performance management in virtualized server environments. In: NOMS Proceedings, 2006 IEEE/IFIP. doi:10.1109/NOMS.2006.1687567, pp 373–381 (2006)
Lawrence Berkeley National Laboratory: The internet traffic archive. http://ita.ee.lbl.gov/ (2013)
Lorido-Botran, T., Miguel-Alonso, J., Lozano, J.A.: A review of auto-scaling techniques for elastic applications in cloud environments. J. Grid Comput. 12(4), 559–592 (2014). doi:10.1007/s10723-014-9314-7
Mann, V., Gupta, A., Dutta, P., Vishnoi, A., Bhattacharya, P., Poddar, R., Iyer, A.: Remedy: network-aware steady state Vm management for data centers. In: NETWORKING 2012, pp 190–204. Springer (2012)
Maurer, M., Breskovic, I., Emeakaroha, V., Brandic, I.: Revealing the MAPE loop for the autonomic management of cloud infrastructures. In: IEEE symposium on computers and communications (ISCC). doi:10.1109/ISCC.2011.5984008, pp 147–152 (2011)
Naskos, A., Gounaris, A., Sioutas, S.: A review of auto-scaling techniques for elastic applications in cloud environments. LNCS 9511 ALGOCLOUD 2015 pp. 151–167 (2016). doi:10.1007/978-3-319-29919-8 12
Petrucci, V., Carrera, E. V., Loques, O., Leite, J. C., Mossé, D.: Optimized management of power and performance for virtualized heterogeneous server clusters. In: 2011 11Th IEEE/ACM international symposium on cluster, cloud and grid computing (CCGrid), pp 23–32. IEEE (2011)
Reiser, M., Lavenberg, S.S.: Mean-value analysis of closed multichain queuing networks. J. ACM (JACM) 27(2), 313–322 (1980). doi:10.1145/322186.322195
Shen, Z., Subbiah, S., Gu, X., Wilkes, J.: Cloudscale: elastic resource scaling for multi-tenant cloud systems. In: Proceedings of the 2nd ACM symposium on cloud computing, p 5. ACM (2011)
Singh, S., Chana, I: A survey on resource scheduling in cloud computing: Issues and challenges. J. Grid Comput. 14(2), 217–264 (2016). doi:10.1007/s10723-015-9359-2
Speitkamp, B., Bichler, M.: A mathematical programming approach for server consolidation problems in virtualized data centers. IEEE TSC 3(4), 266–278 (2010). doi:10.1109/TSC.2010.25
Standard Performance Evaluation Corporation: Specpower_ ssj2008 benchmark. http://www.spec.org/power_ssj2008/ (2013)
Stillwell, M., Schanzenbach, D., Vivien, F., Casanova, H: Resource allocation algorithms for virtualized service hosting platforms. J. Parallel Distrib. Comput. 70(9), 962–974 (2010). doi:10.1016/j.jpdc.2010.05.006
Tighe, M., Bauer, M.: Integrating cloud application autoscaling with dynamic VM allocation. In: IEEE/ IFIP network operations and management symposium (NOMS), pp 1–9. IEEE (2014)
Tighe, M., Keller, G.: DCSim on GitHub. https://github.com/digs-uwo/dcsim (2013)
Tighe, M., Keller, G., Bauer, M., Lutfiyya, H.: Towards an improved data centre simulation with DCSim. In: Proceedings of the 7th international DMTF academic alliance workshop on SVM, pp 364–372 (2013)
Tighe, M., Keller, G., Lutfiyya, H., Bauer, M.: A distributed approach to dynamic VM management. In: 2013 9th international conference on network and service management (CNSM). IEEE (2013)
Verma, A., Ahuja, P., Neogi, A.: pMapper: power and migration cost aware application placement in virtualized systems. In: Proceedings of the 9th ACM/IFIP/USENIX international conference on middleware, pp 243–264 (2008)
Wang, G., Ng, T.S.E.: The impact of virtualization on network performance of Amazon EC2 data center. In: Proceedings IEEE INFOCOM. doi:10.1109/INFCOM.2010.5461931, pp 469–482 (2010)
Wood, T., Shenoy, P., Venkataramani, A., Yousif, M.: Black-box and gray-box strategies for virtual machine migration. In: Proceedings of the 4th symposium on NSDI, pp 229–242, Cambridge, MA, USA (2007)
Wuhib, F., Stadler, R., Spreitzer, M.: Gossip-based resource management for cloud environments. In: 2010 international conference on network and service management (CNSM), pp 1–8. IEEE (2010)
Yanggratoke, R., Wuhib, F., Stadler, R.: Gossip-based resource allocation for green computing in large clouds. In: 2011 7th international conference on network and service management (CNSM), pp 1–9. IEEE (2011)
Yapicioglu, T., Oktug, S.: A traffic-aware virtual machine placement method for cloud data centers. In: Proceedings of the 2013 IEEE/ACM 6th international conference on utility and cloud computing, pp 299–301. Computer Society (2013)
Zhani, M. F., Zhang, Q., Simon, G., Boutaba, R.: VDC planner: dynamic migration-aware virtual data center embedding for clouds. In: IEEE/IFIP integrated network management symposium (IM), pp 18–25. IEEE (2013)
Zhu, Q., Zhu, J., Agrawal, G.: Power-Aware Consolidation of Scientific Workflows in Virtualized Environments. In: ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, pp 1–12 (2010)
Author information
Authors and Affiliations
Corresponding author
Additional information
Support for this research was provided by the Natural Sciences and Engineering Research Council of Canada (NSERC).
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Tighe, M., Bauer, M. Topology and Application Aware Dynamic VM Management in the Cloud. J Grid Computing 15, 273–294 (2017). https://doi.org/10.1007/s10723-017-9397-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10723-017-9397-z