Skip to main content
SpringerLink
Log in

Double Auction-based Scheduling of Scientific Applications in Distributed Grid and Cloud Environments

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

Economy models have long been considered as a promising complement to the classical distributed resource management not only due of their dynamic and decentralized nature, but also because the concept of financial valuation of resources and services is an inherent part of any such model. In its broadest sense, scheduling of scientific applications in distributed Grid and Cloud environments can be regarded as a market-based negotiation between a scheduling service optimizing user-centric objectives (execution time, budget), and a resource manager optimizing provider-centric metrics (resource utilization, income, job throughput). In this paper, we propose a new instantiation of the negotiation protocol between the scheduler and resource manager using a market-based Continuous Double Auction (CDA) model. We analyze different scheduling strategies that can be applied and identify general strategic patterns that can lead to a fast and cheap work ow execution. In the experimental study, we demonstrate that under certain circumstances one can benefit by applying an aggressive scheduling strategy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Abramson, D., Buyya, R., Giddy, J.: A computational economy for Grid computing and its implementation in the nimrod-g resource broker. Future Gener. Comput. Syst. 18(8), 1061–1074 (2002)

    Article  MATH  Google Scholar 

  2. Buyya, R., Abramson, D., Giddy, J.: Economy driven resource management architecture for computational power Grids (2000). citeseer.ist.psu.edu/buyya00economy.html

  3. Buyya, R., Abramson, D., Venugopal, S.: The Grid economy. Proc. I.E.E.E. 93(3), 698–714 (2005)

    Google Scholar 

  4. Buyya, R., Stockinger, H., Giddy, J., Abramson, D.: Economic models for management of resources in peer-to-peer and Grid computing. Tech. Rep. 0108001, Economics Working Paper Archive at WUSTL (2001)

  5. Chien, C.H., Chang, P.H.M., Soo, V.W.: Market-oriented multiple resource scheduling in Grid computing environments. In: 19th International Conference on Advanced Information Networking and Applications, pp. 867–872. IEEE Computer Society Press, Washington, DC, USA (2005)

    Google Scholar 

  6. Cotton, W.R., Pielke, R.A., Walko, R.L., Liston, G.E., Tremback, C.J., Jiang, H., McAnelly, R.L., Harrington, J.Y., Nicholls, M.E., Carrio, G.G., McFadden, J.P.: RAMS 2001: current status and future directions. Meteorol. Atmos. Phys. 82, 5–29 (2003)

    Article  Google Scholar 

  7. Czajkowski, K., Foster, I., Kesselman, C.: Co-allocation services for computational Grids. In: High Performance Distributed Computing Symposium. IEEE Computer Society Press (1999)

  8. Davis, K.: ’Zero intelligence’ trading closely mimics stock market. New Scientist (2005)

  9. Deelman, E., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., Blackburn, K., Lazzarini, A., Arbree, A., Cavanaugh, R., Koranda, S.: Mapping abstract complex workflows onto Grid environments. Journal of Grid Computing 1(1), 25–39 (2003)

    Article  Google Scholar 

  10. Dias de Assunção, M., Buyya, R.: An evaluation of communication demand of auction protocols in Grid environments. In: 3rd International Workshop on Grid Economics and Business Models. World Scientific Publications, Singapore (2006)

    Google Scholar 

  11. Fahringer, T., Prodan, R., Duan, R., Hofer, J., Nadeem, F., Nerieri, F., Stefan Podlipnig, J.Q., Siddiqui, M., Truong, H.L., Villazon, A., Wieczorek, M.: Askalon: A development and Grid computing environment for scientific workflows. In: Taylor, I.J., Deelman, E., Gannon, D.B., Shields, M. (eds.) Scientific Workflows for Grids, Workflows for e-Science, chap. Frameworks and Tools: Workflow Generation, Refinement and Execution. Springer (2007)

  12. Farmer, J.D., Patelli, P., Zovko, I.I.: The predictive power of zero intelligence in financial markets. Proc. Natl. Acad. Sci. U.S.A. 102(6), 2254–2259 (2005)

    Article  Google Scholar 

  13. Germain-Renaud, C., Loomis, C., und Romain Texier, J.T.M.: Scheduling for responsive Grids. Journal of Grid Computing 6(1), 15–27 (2008)

    Article  Google Scholar 

  14. Gode, D., Sunder, S.: Allocation efficiency of markets with zero intelligence traders: market as a partial substitute for individual rationality. J. Polit. Econ. 101, 119–137 (1993)

    Article  Google Scholar 

  15. Iosup, A., Epema, D.: Grid computing workloads. IEEE Internet Comput. 15(2), 19–26 (2011)

    Article  Google Scholar 

  16. Jasper, K., Schulla, J.: Model description WaSiM-ETH, p. 166. Tech. rep., Institute for Climate Research, ETH Zurich (2000)

  17. Luo, P., Lü, K., Shi, Z., He, Q.: Distributed data mining in Grid computing environments. Future Gener. Comput. Syst. 23, 84–91 (2007)

    Article  Google Scholar 

  18. Milgrom, P.: Putting Auction Theory to Work. Cambridge University Press (2004)

  19. Nadeem, F., Yousaf, M., Prodan, R., Fahringer, T.: Soft benchmarks-based application performance prediction using a minimum training set. In: International Conference on e-Science and Grid Computing. IEEE Computer Society Press (2006)

  20. Pourebrahimi, B., Bertels, K., Kandru, G.M., Vassiliadis, S.: Market-based resource allocation in Grids. In: 2nd International Conference on e-Science and Grid Computing, p. 80. IEEE Computer Society Press, Amsterdam, The Netherlands (2006)

    Google Scholar 

  21. Pourebrahimi, B., Bertels, K., Vassiliadis, S., Alima, L.: A dynamic pricing and bidding strategy for autonomous agents in Grids. In: 6th International Workshop on Agents and Peer-to-Peer Computing (2007)

  22. Prodan, R., Wieczorek, M.: Negotiation-based scheduling of scientific Grid workflows through advance reservations. Journal of Grid Computing 8(4), 493–510 (2010)

    Article  Google Scholar 

  23. Schüller, F., Qin, J.: Towards a workflow model for meteorological simulations on the Austrian Grid. In: 1st Austrian Grid Symposium. OCG Verlag, Schloss Hagenberg, Austria (2005)

  24. Sulistio, A., Poduval, G., Buyya, R., Tham, C.K.: Constructing a Grid simulation with differentiated network service using GridSim. In: International Conference on Internet Computing, pp. 437–444 (2005)

  25. Tan, Z., Gurd, J.R.: Market-based Grid resource allocation using a stable continuous double auction. In: 8th International Conference on Grid Computing. IEEE Computer Society Press, Austin, Texas, USA (2007)

  26. Taylor, I., Deelman, E., Gannon, D., Shields, M.: Workflows for e-Science. Springer (2007)

  27. Tian, L., Chandy, K.M.: Resource allocation in streaming environments. In: 7th International Conference on Grid Computing, pp. 270–277 (2006)

  28. Vanmechelen, K., Broeckhove, J.: A comparative analysis of single-unit Vickrey auctions and commodity markets for realizing Grid economies with dynamic pricing. In: 4th International Workshop on Grid Economics and Business Models, Lecture Notes in Computer Science. Springer, Rennes, France (2007)

    Google Scholar 

  29. Volkert, J.: Austrian Grid: overview on the project with focus on parallel applications. In: International Symposium on Parallel and Distributed Computing. Timisoara, Romania (2006)

  30. Wolski, R., Plank, J.S., Brevik, J., Bryan, T.: Analyzing market-based resource allocation strategies for the computational Grid. Int. J. High Perform. Comput. Appl. 15(3), 258–281 (2001)

    Article  Google Scholar 

  31. Yu, J., Buyya, R.: A taxonomy of workflow management systems for Grid computing. Journal of Grid Computing 3(3–4), 171–200 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Computer Science, University of Innsbruck, Technikerstraße 21a, 6020, Innsbruck, Austria

    Radu Prodan & Hamid Mohammadi Fard

  2. Google Poland Ltd., Rynek Główny 12, 31-042, Kraków, Poland

    Marek Wieczorek

Authors
  1. Radu Prodan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marek Wieczorek
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hamid Mohammadi Fard
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Radu Prodan.

Additional information

This work is partially funded by the European Union under grant agreement number 261585/SHIWA Project.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Prodan, R., Wieczorek, M. & Fard, H.M. Double Auction-based Scheduling of Scientific Applications in Distributed Grid and Cloud Environments. J Grid Computing 9, 531–548 (2011). https://doi.org/10.1007/s10723-011-9196-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-011-9196-x

Keywords

Search

Navigation