Advertisement

Journal of Grid Computing

, 9:355 | Cite as

Infrastructure Federation Through Virtualized Delegation of Resources and Services

DGSI: Adding Interoperability to DCI Meta Schedulers
  • Georg Birkenheuer
  • André Brinkmann
  • Mikael Högqvist
  • Alexander Papaspyrou
  • Bernhard Schott
  • Dietmar Sommerfeld
  • Wolfgang Ziegler
Article

Abstract

Infrastructure federation is becoming an increasingly important issue for modern Distributed Computing Infrastructures (DCIs): Dynamic elasticity of quasi-static Grid environments, incorporation of special-purpose resources into commoditized Cloud infrastructures, cross-community collaboration for increasingly diverging areas of modern e-Science, and Cloud Bursting pose major challenges on the technical level for many resource and middleware providers. Especially with respect to increasing costs of operating data centers, the intelligent yet automated and secure sharing of resources is a key factor for success. With the D-Grid Scheduler Interoperability (DGSI) project within the German D-Grid Initiative, we provide a strategic technology for the automatically negotiated, SLA-secured, dynamically provisioned federation of resources and services for Grid-and Cloud-type infrastructures. This goal is achieved by complementing current DCI schedulers with the ability to federate infrastructure for the temporary leasing of resources and rechanneling of workloads. In this work, we describe the overall architecture and SLA-secured negotiation protocols within DGSI and depict an advanced mechanism for resource delegation through means of dynamically provisioned, virtualized middleware. Through this methodology, we provide the technological foundation for intelligent capacity planning and workload management in a cross-infrastructure fashion.

Keywords

Grid computing Cloud computing Resource management Negotiation Virtualization Middleware SLAs 

References

  1. 1.
    Alef, M., Fieseler, T., Freitag, S., Garcia, A., Grimm, C., Gürich, W., Mehammed, H., Schley, L., Schneider, O., Volpato, G.: Integration of multiple middlewares on a single computing resource. Future Gener. Comput. Syst. 25(3), 268–274 (2009). doi: 10.1016/j.future.2008.05.004 CrossRefGoogle Scholar
  2. 2.
    Andreozzi, S., Burke, S., Ehm, F., Field, L., Galang, G., Konya, B., Litmaath, M., Millar, P., Navarro, J.: GLUE Specification v. 2.0 (2009). Grid Forum proposed recommendation GFD.147, available at http://www.ogf.org/documents/GFD.147.pdf
  3. 3.
    Andrieux, A., Czajkowski, K., Dan, A., Keahey, K., Ludwig, H., Nakata, T., Pruyne, J., Rofrano, J., Tuecke, S., Xu, M.: Web Services Agreement Specification (WS-Agreement). Grid Forum proposed recommendation GFD.107, available at http://www.ogf.org/documents/GFD.107.pdf
  4. 4.
    Anjomshoaa, A., Brisard, F., Drescher, M., Fellows, D., Ly, A., McGough, S., Pulsipher, D., Savva, A.: Job Submission Description Language (JSDL) Specification v1.0 (2008). Grid Forum recommendation GFD.136, available at http://www.ogf.org/documents/GFD.136.pdf
  5. 5.
    Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R.H., Konwinski, A., Lee, G., Patterson, D.A., Rabkin, A., Stoica, I., Zaharia, M.: Above the Clouds: A Berkeley View of Cloud Computing. Tech. rep., EECS Department, University of California, Berkeley (2009)Google Scholar
  6. 6.
    Battré, D., Hovestadt, M., Wäldrich, O.: Lessons learned from implementing WS-Agreement. In: Wieder, P., Yahyapour, R., Ziegler, W. (eds.) Grids and Service-Oriented Architectures for Service Level Agreements, pp. 23–34. Springer US (2010). doi: 10.1007/978-1-4419-7320-7_3
  7. 7.
    Baur, T., Breu, R., Kálmán, T., Lindinger, T., Milbert, A., Poghosyan, G., Reiser, H., Romberg, M.: An interoperable grid information system for integrated resource monitoring based on virtual organizations. J. Grid Computing 7, 319–333 (2009). doi: 10.1007/s10723-009-9134-3 CrossRefGoogle Scholar
  8. 8.
    Bazaar: Project Website: https://www.ce-egee.org/weblog/bazaar (2010)
  9. 9.
    Bolte, M., Sievers, M., Birkenheuer, G., Niehoerster, O., Brinkmann, A.: Non-intrusive virtualization management using libvirt. In: Proceedings of Design, Automation and Test in Europe (DATE). Dresden, Germany (2010)Google Scholar
  10. 10.
    BREIN—Business Objective Driven Reliable and Intelligent Grids for Real Business: Project Website: http://www.eu-brein.com (2010)
  11. 11.
    Cornwall, L.A., Jensen, J., Kelsey, D.P., Frohner, Á., Kouřil, D., Bonnassieux, F., Nicoud, S., Lőrentey, K., Hahkala, J., Silander, M., Cecchini, R., Ciaschini, V., dell’Agnello, L., Spataro, F., O’Callaghan, D., Mulmo, O., Volpato, G.L., Groep, D., Steenbakkers, M., McNab, A.: Authentication and authorization mechanisms for multi-domain grid environments. J. Grid Computing 2, 301–311 (2004). doi: 10.1007/s10723-004-8182-y CrossRefGoogle Scholar
  12. 12.
    England, D., Weissman, J.B.: Costs and benefits of load sharing in the computational Grid. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) Proceedings of the 10th Job Scheduling Strategies for Parallel Processing, Lecture Notes in Computer Science (LNCS), vol. 3277, pp. 160–175. Springer (2004)Google Scholar
  13. 13.
    Ernemann, C., Hamscher, V., Schwiegelshohn, U., Streit, A., Yahyapour, R.: On advantages of Grid computing for parallel job scheduling. In: Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID02), pp. 39–46. IEEE Press (2002)Google Scholar
  14. 14.
    Eucalyptus Systems: Eucalyptus. Website: http://open.eucalyptus.com/ (2010)
  15. 15.
    Field, L., Laure, E., Schulz, M.: Grid deployment experiences: Grid interoperation. J. Grid Computing 7, 287–296 (2009). doi: 10.1007/s10723-009-9128-1 CrossRefGoogle Scholar
  16. 16.
    Fölling, A., Grimme, C., Lepping, J., Papaspyrou, A.: Decentralized Grid scheduling with evolutionary fuzzy systems. In: Frachtenberg, E., Schwiegelshohn, U. (eds.) Proceedings of the 14th Job Scheduling Strategies for Parallel Processing, Lecture Notes in Computer Science (LNCS), vol. 5798, pp. 16–36. Springer (2009)Google Scholar
  17. 17.
    Fölling, A., Grimme, C., Lepping, J., Papaspyrou, A., Schwiegelshohn, U.: Competitive co-evolutionary learning of fuzzy systems for job exchange in computational Grids. Evol. Comput. 17(4), 545–560 (2009)CrossRefGoogle Scholar
  18. 18.
    Gagliardi, F., Jones, B., Grey, F., Begin, M.E., Heikkurinen, M.: Building an infrastructure for scientific Grid computing: status and goals of the EGEE project. Phil. Trans., Ser. A, Math. Phys. Eng. Sci. 363(1833), 1729–1742 (2005)CrossRefGoogle Scholar
  19. 19.
    GRAAP-WG—Grid Resource Allocation Agreement Protocol Working Group): Project Website: https://forge.gridforum.org/projects/graap-wg (2010)
  20. 20.
    Grimme, C., Lepping, J., Papaspyrou, A.: Prospects of collaboration between compute providers by means of job interchange. In: Frachtenberg, E., Schwiegelshohn, U. (eds.) Proceedings of Job Scheduling Strategies for Parallel Processing, Lecture Notes in Computer Science (LNCS), vol. 4942, pp. 132–151. Springer (2007)Google Scholar
  21. 21.
    GSA-RG—Grid Scheduling Architecture Research Group: Project Website: https://forge.gridforum.org/projects/gsa-rg (2009)
  22. 22.
    Iosup, A., Epema, D.H., Tannenbaum, T., Farrellee, M., Livny, M.: Inter-operating Grids through delegated matchmaking. In: Proceedings of International Conference for High Performance Computing, Networking, Storage and Analysis (SC07). Reno, NV (2007)Google Scholar
  23. 23.
    Iyengar, V., Tilak, S., Lewis, M.J., Abu-Ghazaleh, N.B.: Non-uniform information dissemination for dynamic Grid resource discovery. In: NCA ’04: Proceedings of the Network Computing and Applications, Third IEEE International Symposium, pp. 97–106. IEEE Computer Society, Washington, DC (2004)CrossRefGoogle Scholar
  24. 24.
    Kota, S.R., Shekhar, C., Kokkula, A., Toshniwal, D., Kartikeyan, M.V., Joshi, R.C.: Parameterized module scheduling algorithm for reconfigurable computing systems. In: ADCOM ’07: Proceedings of the 15th International Conference on Advanced Computing and Communications, pp. 473–478. IEEE Computer Society, Washington, DC (2007)CrossRefGoogle Scholar
  25. 25.
    Kurowski, K., Nabrzyski, J., Oleksiak, A., Weglarz, J.: Scheduling jobs on the Grid—multicriteria approach. Comput Methods Sci Technol 12(2), 123–138 (2006)Google Scholar
  26. 26.
    Libvirt Development Team: Libvirt. Project Website: http://libvirt.org/ (2010)
  27. 27.
  28. 28.
    Nimbus Community: Nimbus. Project Website: http://www.nimbusproject.org/ (2010)
  29. 29.
    OpenNebula Community: OpenNebula:. Project Website: http://www.opennebula.org/ (2010)
  30. 30.
    Parkin, M., Badia, R.M., Martrat, J.: A Comparison of SLA Use in Six of the European Commissions FP6 Projects. Tech. Rep. TR-0129, Institute on Resource Management and Scheduling, CoreGRID—Network of Excellence. URL http://www.coregrid.net/mambo/images/stories/TechnicalReports/tr-0129.pdf (2008)
  31. 31.
    PHOSPHORUS—Lambda User Controlled Infrastructure For European Research:. Project Website: www.ist-phosphorus.eu (2010)
  32. 32.
    Riedel, M., Terstyanszky, G.: Grid interoperability for e-research. J. Grid Computing 7, 285–286 (2009). doi: 10.1007/s10723-009-9138-z CrossRefGoogle Scholar
  33. 33.
    Rings, T., Caryer, G., Gallop, J., Grabowski, J., Kovacikova, T., Schulz, S., Stokes-Rees, I.: Grid and cloud computing: opportunities for integration with the next generation network. J. Grid Computing 7, 375–393 (2009). doi: 10.1007/s10723-009-9132-5 CrossRefGoogle Scholar
  34. 34.
    Rumpl, A., Wäldrich, O., Ziegler, W.: Extending WS-Agreement with multi-round negotiation capability. In: Grids and Service-Oriented Architectures for Service Level Agreements, CoreGRID series 13, pp. 89–103. Springer (2010). doi: 10.1007/978-1-4419-7320-7_9
  35. 35.
    Seidel, J., Wäldrich, O., Wieder, P., Yahyapour, R., Ziegler, W.: SLA for resource management and scheduling—a survey. In: Grid Middleware and Services: Challenges and Solutions, CoreGRID Series 8. Springer (2008)Google Scholar
  36. 36.
    SLA@SOI—Project Website:. Project Website: http://sla-at-soi.eu (2010)
  37. 37.
    SmartLM—Grid-friendly Software Licensing for Location Independent Application Execution:. Project Website: http://www.smartlm.eu (2010)
  38. 38.
    SORMA—Self-Organizing ICT Resource Management:. Project Website: http://www.im.uni-karlsruhe.de/sorma (2010)
  39. 39.
    Subramaniyan, R., Troxel, I., George, A.D., Smith, M.: Simulative analysis of dynamic scheduling heuristics for reconfigurable computing of parallel applications. In: Proceedings of the 2006 ACM/SIGDA 14th International Symposium on Field Programmable Gate Arrays, pp. 230–230. ACM (2006)Google Scholar
  40. 40.
    Wäldrich, O.: WS-Agreement for JAVA (WSAG4J): Project Website: http://packcs-e0.scai.fraunhofer.de/wsag4j/
  41. 41.
    IBM Web Service Level Agreements (WSLA) Project: Project Website: http://www.research.ibm.com/wsla
  42. 42.
    OASIS Web Services Resource Framework (WSRF) TC: Project Website: http://www.oasis-open.org/committees/wsrf

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  • Georg Birkenheuer
    • 1
  • André Brinkmann
    • 1
  • Mikael Högqvist
    • 2
  • Alexander Papaspyrou
    • 3
  • Bernhard Schott
    • 4
  • Dietmar Sommerfeld
    • 5
  • Wolfgang Ziegler
    • 6
  1. 1.Paderborn Center for Parallel ComputingUniversity of PaderbornPaderbornGermany
  2. 2.Zuse Institute BerlinBerlinGermany
  3. 3.Technische Universität DortmundDortmundGermany
  4. 4.Platform Computing GmbHRatingenGermany
  5. 5.Gesellschaft für wissenschaftliche Datenverarbeitung mbH GöttingenGöttingenGermany
  6. 6.Fraunhofer Institute SCAISankt AugustinGermany

Personalised recommendations