Skip to main content

Advertisement

SpringerLink
Log in

Allocating Compute and Network Resources Under Management Objectives in Large-Scale Clouds

  • Published:
Journal of Network and Systems Management Aims and scope Submit manuscript

Abstract

We consider the problem of jointly allocating compute and network resources in a large Infrastructure-as-a-service cloud. We formulate the problem of optimally allocating resources to virtual data centers (VDCs) for four well-known management objectives: balanced load, energy efficiency, fair allocation, and service differentiation. Then, we outline an architecture for resource allocation, which centers around a set of cooperating controllers, each solving a problem related to the chosen management objective. We illustrate how a global management objective is mapped onto objectives that govern the execution of these controllers. For a key controller, the Dynamic Placement Controller, we give a detailed distributed design, which is based on a gossip protocol that can switch between management objectives. The design is applicable to a broad class of management objectives, which we characterize through a property of the objective function. The property ensures the applicability of an iterative descent method that the gossip protocol implements. We evaluate, through simulation, the dynamic placement of VDCs for a large cloud under changing load and VDC churn. Simulation results show that this controller is effective and highly scalable, up to 100’000 nodes, for the management objectives considered.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Gulati, A., Shanmuganathan, G., Holler, A., Ahmad, I.: In: Proceedings of the 3rd USENIX conference on Hot topics in cloud computing, pp. 3–3. USENIX Association, Berkeley (2011), HotCloud’11, http://dl.acm.org/citation.cfm?id=2170444.2170447

  2. Wuhib, F., Stadler, R., Spreitzer, M.: Network and service management. IEEE Transactions on (2012)

  3. Wuhib, F., Stadler, R., Spreitzer, M.: In international conference on network and service management (2010)

  4. Yanggratoke, R., Wuhib, F., Stadler, R.: In International conference on network and service management (2011)

  5. Wuhib, F., Stadler, R., Lindgren, H.: In Proceedings of the 7th international conference on network and services management CNSM ’12 (2012)

  6. Netcraft: http://news.netcraft.com/archives/2013/01/07/ (2013)

  7. MapReduce: http://www.mapreduce.org (2012)

  8. Dryad: http://research.microsoft.com/en-us/projects/dryad/ (2012)

  9. Amazon Web Services: http://aws.amazon.com/ec2/ (2012)

  10. Popa, L., Ratnasamy, S., Iannaccone, G., Krishnamurthy, A., Stoica, I.: In Proceedings of the 6th international conference (ACM, New York, NY, USA, 2010), Co-NEXT ’10, pp. 16:1–16:12. doi:10.1145/1921168.1921189

  11. Raiciu, C., Ionescu, M., Niculescu, D.: In Proceedings of the 4th USENIX conference on hot topics in cloud computing (USENIX Association, Berkeley, CA, USA, 2012), HotCloud’12, pp. 6–6

  12. Verma, A., Ahuja, P., Neogi, A.: In Proceedings of the 9th ACM/IFIP/USENIX international conference on middleware Springer, New York, Inc., New York, (2008) Middleware ’08, pp. 243–264

  13. Verma, A., Kumar, G., Koller, R.: In Proceedings of the 11th international middleware conference industrial track (ACM, New York, 2010), Middleware Industrial Track ’10, pp. 11–16

  14. Mitzenmacher, M.: IEEE Trans. Parallel Distrib. Syst. 12(10), 1094 (2001). doi:10.1109/71.963420

    Article  Google Scholar 

  15. Voulgaris, S., Gavidia, D., van Steen, M.: J. Netw. Syst. Manag. 13(2), 197 (2005)

    Article  Google Scholar 

  16. Allavena, A., Demers, A., Hopcroft, J.E.: In Proceedings of the twenty-fourth annual ACM symposium on principles of distributed computing pp. 292–301, ACM, New York (2005), PODC ’05. DOI 10.1145/1073814.1073871

  17. Montresor, A., Jelasity, M.: In Peer-to-Peer Computing, 2009. P2P ’09. IEEE ninth international conference on. pp. 99–100. doi:10.1109/P2P.2009.5284506 (2009)

  18. Reiss, C., Tumanov, A., Ganger, G.R., Katz, R.H., Kozuch, M.A.: In ACM symposium on cloud computing (SoCC) San Jose, (2012)

  19. Shrivastava, V., Zerfos, P., Lee, K.W., Jamjoom, H., Liu, Y.H., Banerjee, S.: In INFOCOM, 2011 Proceedings IEEE (2011), pp. 66–70. doi:10.1109/INFCOM.2011.5935247

  20. Guo, C., Lu, G., Wang, H.J., Yang, S., Kong, C., Sun, P., Wu, W., Zhang, Y.: In Proceedings of the 6th international conference, pp. 15:1–15:12. ACM, New York (2010), Co-NEXT ’10. doi:10.1145/1921168.1921188

  21. Ballani, H., Costa, P., Karagiannis, T., Rowstron, A.: In Proceedings of the ACM SIGCOMM 2011 conference, pp. 242–253. ACM, New York (2011), SIGCOMM ’11. doi:10.1145/2018436.2018465

  22. Wang, M., Meng, X., Zhang, L.: In INFOCOM, 2011 Proceedings IEEE, pp. 71–75. doi:10.1109/INFCOM.2011.5935254 (2011)

  23. Breitgand, D., Epstein, A.: In INFOCOM, 2012 Proceedings IEEE, pp. 2861–2865. doi:10.1109/INFCOM.2012.6195716 (2012)

  24. Meng, X., Pappas, V., Zhang, L.: In INFOCOM, 2010 Proceedings IEEE, pp. 1–9. doi:10.1109/INFCOM.2010.5461930 (2010)

  25. Lee, G., Tolia, N., Ranganathan, P., Katz, R.H.: SIGCOMM Comput. Commun. Rev. 41(1), 120 (2010). doi:10.1145/1925861.1925881

    Article  Google Scholar 

  26. Jiang, J., Lan, T., Ha, S., Chen, M., Chiang, M.: In INFOCOM, 2012 Proceedings IEEE, pp. 2876–2880. doi:10.1109/INFCOM.2012.6195719 (2012)

  27. Biran, O., Corradi, A., Fanelli, M., Foschini, L., Nus, A., Raz, D., Silvera, E.: In Cluster, Cloud and Grid Computing (CCGrid), 2012 12th IEEE/ACM international symposium on, pp. 498–506. doi:10.1109/CCGrid.2012.119 (2012)

  28. Jayasinghe, D., Pu, C., Eilam, T., Steinder, M., Whally, I., Snible, E.: In services computing (SCC), 2011 IEEE international conference on, pp. 72–79. doi:10.1109/SCC.2011.28 (2011)

  29. Yazir, Y., Matthews, C., Farahbod, R., Neville, S., Guitouni, A., Ganti, S., Coady, Y.: In IEEE international conference on cloud computing, pp. 91–98. doi:10.1109/CLOUD.2010.66 (2010)

  30. Younge, A.J., von Laszewski, G., Wang, L., Lopez-Alarcon, S., Carithers, W.: In Proceedings of the international conference on green computing. IEEE, Chicago (2010). doi:10.1109/GREENCOMP.2010.5598294

  31. Wei, G., Vasilakos, A.V., Zheng, Y., Xiong, N.J.: Supercomput. 54(2), 252 (2010). doi:10.1007/s11227-009-0318-1

    Article  Google Scholar 

  32. Rao, J., Wei, Y., Gong, J., Xu, C.Z.: In Proceedings of the nineteenth international workshop on quality of service. IEEE Press, Piscataway (2011), IWQoS ’11, pp. 31:1–31:9

  33. Li, J.Z., Woodside, M., Chinneck, J., Litoiu, M.: In Proceedings of the 7th international conference on network and services management (2011), CNSM ’11, pp. 162–170

  34. Mudigonda, J., Yalagandula, P., Al-Fares, M., Mogul, J.C.: In Proceedings of the 7th USENIX conference on Networked systems design and implementation. USENIX Association, Berkeley, NSDI’10, pp. 18–18 (2010)

  35. Raiciu, C., Barre, S., Pluntke, C., Greenhalgh, A., Wischik, D., Handley, M.: In Proceedings of the ACM SIGCOMM 2011 conference. ACM, New York (2011), SIGCOMM ’11, pp. 266–277. doi:10.1145/2018436.2018467

  36. Mudigonda, J., Yalagandula, P., Mogul, J., Stiekes, B., Pouffary, Y.: SIGCOMM Comput. Commun. Rev. 41(4), 62 (2011). doi:10.1145/2043164.2018444

    Article  Google Scholar 

  37. Koslovski, G., Soudan, S., Goncalves, P., Vicat-Blanc, P.: In integrated network management (IM), 2011 IFIP/IEEE international symposium on (2011), pp. 153–160. doi:10.1109/INM.2011.5990686

Download references

Author information

Authors and Affiliations

  1. CDN & Cloud Computing, Ericsson Research, Färögatan 6, 164 80, Kista, Sweden

    Fetahi Wuhib

  2. ACCESS Linnaeus Center, KTH Royal Institute of Technology, Osquldas väg 10, 100 44, Stockholm, Sweden

    Rerngvit Yanggratoke & Rolf Stadler

Authors
  1. Fetahi Wuhib
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rerngvit Yanggratoke
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rolf Stadler
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rerngvit Yanggratoke.

Additional information

Work done while Dr. Fetahi Wuhib was with KTH Royal Institute of Technology.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wuhib, F., Yanggratoke, R. & Stadler, R. Allocating Compute and Network Resources Under Management Objectives in Large-Scale Clouds. J Netw Syst Manage 23, 111–136 (2015). https://doi.org/10.1007/s10922-013-9280-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10922-013-9280-6

Keywords

Search

Navigation