Skip to main content

Advertisement

SpringerLink
Log in

Joint Elastic Cloud and Virtual Network Framework for Application Performance-cost Optimization

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

Cloud computing infrastructures are providing resources on demand for tackling the needs of large-scale distributed applications. To adapt to the diversity of cloud infrastructures and usage, new operation tools and models are needed. Estimating the amount of resources consumed by each application in particular is a difficult problem, both for end users who aim at minimizing their costs and infrastructure providers who aim at controlling their resources allocation. Furthermore, network provision is generally not controlled on clouds. This paper describes a framework automating cloud resources allocation, deployment and application execution control. It is based on a cost estimation model taking into account both virtual network and nodes managed by the cloud. The flexible provisioning of network resources permits the optimization of applications performance and infrastructure cost reduction. Four resource allocation strategies relying on the expertise that can be captured in workflow-based applications are considered. Results of these strategies are confined virtual infrastructure descriptions that are interpreted by the HIPerNet engine responsible for allocating, reserving and configuring physical resources. The evaluation of this framework was carried out on the Aladdin/Grid’5000 testbed using a real application from the area of medical image analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Open Cloud Computing Interface Working Group (OCCI-WG). http://www.occi-wg.org/doku.php (2009)

  2. Addie, R., Braithwaite, S., Zareer, A.: Netml: a language and website for collaborative work on networks and their algorithms. In: ATNAC 06 (2006)

  3. Anhalt, F., Koslovski, G., Vicat-Blanc Primet, P.: Specifying and provisioning virtual infrastructures with HIPerNet. In: ACM International Journal of Network Management (IJNM)—Special Issue on Network Virtualization and its Management, vol. 20(3), pp. 129–148 (2010)

  4. Bavier, A., Feamster, N., Huang, M., Peterson, L., Rexford, J.: In VINI veritas: realistic and controlled network experimentation. ACM SIGCOMM Comput. Commun. Rev. 36(4), 3–14 (2006)

    Article  Google Scholar 

  5. Begnum, K., Sechrest, J.: The MLN Manual—Version 1.0. http://mln.sourceforge.net/doc/mln-manual.pdf (2009)

  6. Bittencourt, L.F., Madeira, E.R.M.: Towards the scheduling of multiple workflows on computational grids. J. Grid Comput. 8(3), 419–441 (2010)

    Article  Google Scholar 

  7. Blythe, J., Jain, S., Deelman, E., Gil, Y., Vahi, K., Mandal, A., Kennedy, K.: Task scheduling strategies for workflow-based applications in Grids. In: International Symposium on Cluster Computing and the Grid (CCGrid’05), pp. 759–767 (2005)

  8. Braun, T.D., Siegel, H.J., Beck, N., Bölöni, L.L., Maheswaran, M., Reuther, A.I., Robertson, J.P., Theys, M.D., Yao, B., Hensgen, D., Freund, R.F.: A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J. Parallel Distrib. Comput. 61(6), 810–837 (2001)

    Article  Google Scholar 

  9. Crosby, S., Doyle, R., Gering, M., Gionfriddo, M., Grarup, S., Hand, S., Hapner, M., Hiltgen, D., Johanssen, M., Lamers, L.J., Leung, J., Machida, F., Maier, A., Mellor, E., Parchem, J., Pardikar, S., Schmidt, S.J., Schmidt, R.W., Warfield, A., Weitzel, M.D., Wilson, J.: Open Virtualization Format Specification (OVF). Technical Report DSP0243, Distributed Management Task Force, Inc. (2009)

  10. Dang, M.Q., Altmann, J.: Resource allocation algorithm for light communication Grid-based workflows within an SLA context. Int. J. Parallel Emergent Distrib. Syst. 24(1), 31–48 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  11. Dang, M.Q., Hsu, D.F.: Mapping Heavy Communication Grid-Based Workflows Onto Grid Resources Within an SLA Context Using Metaheuristics. Int. J. High Perform. Comput. Appl. 22(3), 330–346 (2008)

    Article  Google Scholar 

  12. Deelman, E., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., Blackburn, K., Lazzarini, A., Arbree, A., Cavanaugh, R., Koranda, S.: Mapping abstract complex workflows onto Grid environments. J. Grid Comput. 1(1), 9–23 (2003)

    Article  Google Scholar 

  13. Dijkstra, F., Swany, M.: Network Mark-up Language Working Group (NML-WG). https://forge.gridforum.org/projects/nml-wg (2007)

  14. Feamster, N., Gao, L., Rexford, J.: How to lease the internet in your spare time. SIGCOMM Comput. Commun. Rev. 37(1), 61–64 (2007)

    Article  Google Scholar 

  15. Glatard, T., Montagnat, J., Emsellem, D., Lingrand, D.: A service-oriented architecture enabling dynamic services grouping for optimizing distributed workflows execution. Future Gener. Comput. Syst. 24(7), 720–730 (2008)

    Article  Google Scholar 

  16. Glatard, T., Montagnat, J., Lingrand, D., Pennec, X.: Flexible and efficient workflow deployement of data-intensive applications on grids with MOTEUR. Int. J. High Perform. Comput. Appl. 22(3), 347–360 (2008)

    Article  Google Scholar 

  17. Glatard, T., Pennec, X., Montagnat, J.: Performance evaluation of grid-enabled registration algorithms using bronze-standards. In: Medical Image Computing and Computer-Assisted Intervention (MICCAI’06) (2006)

  18. Guo, W., Sun, W., Hu, W., Jin, Y.: Resource allocation strategies for data-intensive workflow-based applications in optical Grids. In: 10th IEEE Singapore International Conference on Communication Systems (IEEE ICCS 2006), pp. 1–5 (2006)

  19. He, J., Zhang-Shen, R., Li, Y., Lee, C.-Y., Rexford, J., Chiang, M.: Davinci: dynamically adaptive virtual networks for a customized internet. In: CoNEXT ’08: Proceedings of the 2008 ACM CoNEXT Conference, pp. 1–12. ACM, New York (2008)

    Google Scholar 

  20. Huang, R., Casanova, H., Chien, A.A.: Using virtual Grids to simplify application scheduling. In: 20th IEEE International Parallel and Distributed Processing Symposium (IPDPS 2006) (2006)

  21. Distributed Management Task Force Inc. Common Information Model (CIM) Standards. http://www.dmtf.org/standards/cim/ (1999)

  22. Jiang, X., Xu, D.: vbet: a vm-based emulation testbed. In: MoMeTools ’03: Proceedings of the ACM SIGCOMM Workshop on Models, Methods and Tools for Reproducible Network Research, pp. 95–104. ACM, New York (2003)

    Chapter  Google Scholar 

  23. Koslovski, G., Truong Huu, T., Montagnat, J., Primet, P.V.-B.: Executing distributed applications on virtualized infrastructures specified with the VXDL language and managed by the HIPerNET framework. In: First International Conference on Cloud Computing (CLOUDCOMP 2009), Munich, Germany (2009)

  24. Koslovski, G., Primet, P.V.-B., Charão, A.S.: VXDL: virtual resources and interconnection networks description language. In: GridNets 2008 (2008)

  25. Maheswaran, M., Ali, S., Siegel, H.J., Hensgen, D., Freund, R.F.: Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems. In: Eighth Heterogeneous Computing Workshop (HCW’99), pp. 30–44. IEEE Computer Society, San Juan, Puerto Rico (1999)

    Chapter  Google Scholar 

  26. Mandal, A., Kennedy, K., Koelbel, C., Marin, G., Mellor-Crummey, J., Liu, B., Johnsson, L.: Scheduling strategies for mapping application workflows onto the Grid. In: 14th IEEE International Symposium on High Performance Distributed Computing (HPDC’05), pp. 125–134. IEEE Computer Society, Washington, DC, USA (2005)

    Chapter  Google Scholar 

  27. Peterson, L., Anderson, T., Blumenthal, D., Casey, D., Clark, D., Estrin, D., Evans, J., Raychaudhuri, D., Reiter, M., Rexford, J., Shenker, S., Wroclawski, J.: GENI design principles. Computer 39(9), 102–105 (2006)

    Article  Google Scholar 

  28. Ramakrishnan, L., Nurmi, D., Mandal, A., Koelbel, C., Gannon, D., Huang, T.M., Kee, Y.-S., Obertelli, G., Thyagaraja, K., Wolski, R., YarKhan, A., Zagorodnov, D.: VGrADS: enabling e-science workflows on grids and clouds with fault tolerance. In: International Conference for High Performance Computing, Networking, Storage and Analysis (SC09) (2009)

  29. Sakellariou, R., Zhao, H., Tsiakkouri, E., Dikaiakos, M.D.: Scheduling workflows with budget constraints. In: CoreGRID Integration Workshop (CGIW2005), pp. 347–357. Springer-Verlag, Pisa, Italy (2005)

    Google Scholar 

  30. Senkul, P., Toroslu, I.H.: An architecture for workflow scheduling under resource allocation constraints. Inf. Syst. 30(5), 399–422 (2005)

    Article  Google Scholar 

  31. Silva, J.N., Veiga, L., Ferreira, P.: Heuristic for resources allocation on utility computing infrastructures. In: 6th International Workshop on Middleware for Grid Computing (MGC 2008), pp. 1–6. ACM (2008)

  32. Topcuoglu, H., Hariri, S., Min-You, W.: Performance-effective and low-complexity task scheduling for heterogeneous computing. Int. J. Supercomput. Appl 13(3), 260–274 (2002)

    Google Scholar 

  33. van der Ham, J., Grosso, P., van der Pol, R., Toonk, A., de Laat, C.: Using the network description language in optical networks. In: Proc. IFIP/IEEE IM (2007)

  34. Primet, P.V.-B., Anhalt, F., Koslovski, G.: Exploring the virtual infrastructure service concept in Grid’5000. In: 20th ITC Specialist Seminar on Network Virtualization, Hoi An, Vietnam (2009)

  35. Primet, P.V.-B., Roca, V., Montagnat, J., Gelas, J.-P., Mornard, O., Giraud, L., Koslovski, G., Truong Huu, T.: A scalable security model for enabling dynamic virtual private execution infrastructures on the internet. In: IEEE International Symposium on Cluster Computing and the Grid (CCGRID 2009), Shanghai, China (2009)

  36. Xiao, Z., Chang, H., Yi, Y. (2007) Optimization of Workflow Resources Allocation with Cost Constraint, pp. 647–656. Springer, Berlin/Heidelberg

    Google Scholar 

  37. Yu, J., Buyya, R.: A taxonomy of workflow management systems for Grid computing. J. Grid Comput. 3(3–4), 171 – 200 (2005)

    Article  Google Scholar 

  38. Yu, J., Buyya, R., Tham, C.K.: Cost-based scheduling of scientific workflow application on utility Grids. In: First International Conference on e-Science and Grid Computing (E-SCIENCE’05), pp. 140–147. IEEE Computer Society, Melbourne, Australia (2005)

    Google Scholar 

  39. Zhao, H., Sakellariou, R.: Scheduling multiple DAGs onto heterogeneous systems. In: 15th Heterogeneous Computing Workshop (HCW 2006), Rhodes Island, Greece (2006)

Download references

Author information

Authors and Affiliations

  1. I3S Laboratory, University of Nice - Sophia Antipolis, 06903, Sophia Antipolis Cedex, France

    Tram Truong Huu

  2. INRIA - University of Lyon, 69621, Lyon, France

    Guilherme Koslovski, Fabienne Anhalt & Pascale Vicat-Blanc Primet

  3. CNRS - I3S Laboratory, 06903, Sophia Antipolis Cedex, France

    Johan Montagnat

Authors
  1. Tram Truong Huu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guilherme Koslovski
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fabienne Anhalt
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Johan Montagnat
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Pascale Vicat-Blanc Primet
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tram Truong Huu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Truong Huu, T., Koslovski, G., Anhalt, F. et al. Joint Elastic Cloud and Virtual Network Framework for Application Performance-cost Optimization. J Grid Computing 9, 27–47 (2011). https://doi.org/10.1007/s10723-010-9168-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-010-9168-6

Keywords

Search

Navigation