Journal of Grid Computing

, Volume 8, Issue 1, pp 19–45 | Cite as

Standards-Based Job Management in Grid Systems

  • Paolo Andreetto
  • Sergio Andreozzi
  • Antonia Ghiselli
  • Moreno Marzolla
  • Valerio Venturi
  • Luigi Zangrando
Article

Abstract

The Grid paradigm for accessing heterogeneous distributed resources proved to be extremely effective, as many organizations are relying on Grid middlewares for their computational needs. Many different middlewares exist, the result being a proliferation of self-contained, non interoperable “Grid islands”. This means that different Grids, based on different middlewares, cannot share resources, e.g. jobs submitted on one Grid cannot be forwarded for execution on another one. To address this problem, standard interfaces are being proposed for some of the important functionalities provided by most Grids, namely job submission and management, authorization and authentication, resource modeling, and others. In this paper we review some recent standards which address interoperability for three types of services: the BES/JSDL specifications for job submission and management, the SAML notation for authorization and authentication, and the GLUE specification for resource modeling. We describe how standards-enhanced Grid components can be used to create interoperable building blocks for a Grid architecture. Furthermore, we describe how existing components from the gLite middleware have been re-engineered to support BES/JSDL, GLUE and SAML. From this experience we draw some conclusions on the strengths and weaknesses of these specifications, and how they can be improved.

Keywords

Job management Grid interoperability Basic Execution Service (BES) Job Submission Description Language (JSDL) GLUE Security Assertion Markup Language (SAML) 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Aiftimiei, C., Andreetto, P., Bertocco, S., Cesini, D., Corvo, M., Dalla Fina, S., Da Ronco, S., Dongiovanni, D., Dorigo, A., Gianelle, A., Grandi, C., Marzolla, M., Mazzucato, M., Miccio, V., Sciaba’, A., Sgaravatto, M., Verlato, M., Zangrando, L.: Job submission and management through web services: the experience with the CREAM service. Journal of Physics, Conference Series 119(6), 062,004 (2008). doi:10.1088/1742-6596/119/6/06200 Google Scholar
  2. 2.
    Alfieri, R., Cecchini, R., Ciaschini, V., dell’Agnello, L., Frohner, Á., Lőentey, K., Spataro, F.: From gridmap-file to VOMS: managing authorization in a Grid environment. Future Gener. Comput. Syst. 21(4), 549–558 (2005). doi:10.1016/j.future.2004.10.006 CrossRefGoogle Scholar
  3. 3.
    Andreetto, P., et al.: The gLite workload management system. Journal of Physics, Conference Series 119(6), 062,007 (2008). doi:10.1088/1742-6596/119/6/062007 CrossRefGoogle Scholar
  4. 4.
    Andreozzi, S., Burke, S., Ehm, F., Field, L., Galang, G., Konya, B., Litmaath, M., Millar, P., Navarro, J.: GLUE 2.0–Reference Realizations to Concrete Data Models. http://forge.ogf.org/sf/docman/do/listDocuments/projects.glue-wg/docman.root.public_comment. OGF Proposed Recommendation in Public Comment (2008)
  5. 5.
    Andreozzi, S., Burke, S., Ehm, F., Field, L., Galang, G., Konya, B., Litmaath, M., Millar, P., Navarro, J.: GLUE 2.0 Specification. OGF Specification GFD-R-P.147. http://www.ogf.org/documents/GFD.147.pdf (2008)
  6. 6.
    Andreozzi, S., Canaparo, M., Carpene, M.: GLUEMan: a WBEM-based framework for information providers in Grid services. In: International Conference on Enterprise Distributed Object Computing Workshops, pp. 377–384. IEEE Computer Society, Munich, Germany (2008). doi:10.1109/EDOCW.2008.34 CrossRefGoogle Scholar
  7. 7.
    Andreozzi, S., Marzolla, M.: A RESTful approach to the OGSA Basic Execution Service specification. In: Perry, M., Sasaki, H., Ehmann, M., Bellot, G.O., Dini, O. (eds.) Fourth International Conference on Internet and Web Applications and Services, ICIW 2009, 24–28 May 2009, Venice/Mestre, Italy, pp. 131–136. IEEE Computer Society (2009). doi:10.1109/ICIW.2009.26
  8. 8.
    Anjomshoaa, A., Brisard, F., Drescher, M., Fellows, D., Ly, A., McGough, S., Pulsipher, D., Savva, A.: Job Submission Description Language (JSDL) Specification, Version 1.0. http://www.gridforum.org/documents/GFD.56.pdf. OGF Specification GFD-R.056 (2005)
  9. 9.
    Barton, T., Basney, J., Freeman, T., Scavo, T., Siebenlist, F., Welch, V., Ananthakrishnan, R., Baker, B., Keahey, K.: Identity federation and attribute-based authorization through the Globus toolkit, Shibboleth, Gridshib, and MyProxy. In: 5th Annual PKI R&D Workshop (2006)Google Scholar
  10. 10.
    Biron, P.V., Permanente, K., Malhotra, A.: Xml Schema Part 2: Datatypes, 2nd edn. W3C Recommendation. http://www.w3.org/TR/xmlschema-2/ (2004)
  11. 11.
    Brooks, F. Jr.: No silver bullet–essence and accidents of software engineering. Computer 20(4), 10–19 (1987). doi:10.1109/MC.1987.1663532 CrossRefMathSciNetGoogle Scholar
  12. 12.
    Cantor, S., Hirsch, F., Kemp, J., Philpott, R., Maler, E.: Bindings for the oasis security assertion markup language (SAML) v2.0. OASIS Standard saml-bindings-2.0-osn. http://docs.oasis-open.org/security/saml/v2.0/saml-bindings-2.0-os.pdf (2005)
  13. 13.
    Cantor, S., Kemp, J., Philpott, R., Maler, E.: Assertions and protocols for the oasis security assertion markup language (SAML) v2.0. OASIS Standard saml-core-2.0-os. http://docs.oasis-open.org/security/saml/v2.0/saml-core-2.0-os.pdf (2005)
  14. 14.
    Case, D.A., T. E. Cheatham, I., Darden, T., Gohlke, H., Luo, R. Jr., K.M.M., Onufriev, A., Simmerling, C., Wang, B., Woods, R.: The amber biomolecular simulation programs. J. Computat. Chem. 26, 1668–1688 (2005). doi:10.1002/jcc.20290 CrossRefGoogle Scholar
  15. 15.
    Common Information Model (CIM): Infrastructure, version 2.3 final. DMTF Document DSP00004. http://docs.oasis-open.org/security/saml/v2.0/saml-core-2.0-os.pdf (2005)
  16. 16.
    CIM Query Language Specification: DMTF DSP0202. http://www.dmtf.org/standards/published_documents/DSP0202_1.0.0.pdf (2007)
  17. 17.
  18. 18.
    Common Management Programming Interface (CMPI): Open Group Technical Standard C051. http://www.opengroup.org/pubs/catalog/c051.htm (2004)
  19. 19.
    Czajkowski, K., Fitzgerald, S., Foster, I., Kesselman, C.: Grid information services for distributed resource sharing. In: HPDC ’01: Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing, pp. 181–194. IEEE Computer Society, Washington, DC, USA (2001). doi:10.1109/HPDC.2001.945188 CrossRefGoogle Scholar
  20. 20.
    Dillaway, B., Humphrey, M., Smith, C., Theimer, M., Wasson, G.: HPC Basic Profile, Version 1.0. http://www.ogf.org/documents/GFD.114.pdf. OGF Specification GFD-R-P.114 (2007)
  21. 21.
    Ellert, M., Grønager, M., Konstantinov, A., Kónya, B., Lindemann, J., Livenson, I., Nielsen, J., Niinimäki, M., Smirnova, O., Wäänänen, A.: Advanced resource connector middleware for lightweight computational Grids. Future Gener. Comput. Syst. 23(2), 219–240 (2007). doi:10.1016/j.future.2006.05.008 CrossRefGoogle Scholar
  22. 22.
    Erwin, D.W.: UNICORE–a Grid computing environment. Concurrency and Computation: Practice and Experience 14(13–15) (2002). doi:10.1002/cpe.691
  23. 23.
    Fisher, S., et al.: R-GMA: an information integration system for Grid monitoring. In: On the Move to Meaningful Internet Systems 2003: CoopIS, DOA, and ODBASE, pp. 462–481 (2003)Google Scholar
  24. 24.
    Foster, I., Grimshaw, A., Lane, P., Lee, W., Morgan, M., Newhouse, S., Pickles, S., Pulsipher, D., Smith, C., Theimer, M.: OGSA Basic Execution Service Version 1.0. http://www.ogf.org/documents/GFD.108.pdf. OGF Specification GFD.108 (2007)
  25. 25.
    Foster, I., Kesselman, C.: Globus: a metacomputing infrastructure toolkit. Int. J. High Perform. Comput. Appl. 11(2), 115–128 (1997). doi:10.1177/109434209701100205 CrossRefGoogle Scholar
  26. 26.
    Foster, I., Kesselman, C., Pearlman, L., Tuecke, S., Welch, V.: The community authorization service: status and future. In: Proceedings of Computing in High Energy Physics 03 (CHEP ’03) (2003)Google Scholar
  27. 27.
    Foster, I., Kesselman, C., Tuecke, S.: The anatomy of the Grid: enabling scalable virtual organizations. Int. J. High Perform. Comput. Appl. 15(3), 200–222 (2001). doi:10.1177/109434200101500302 CrossRefGoogle Scholar
  28. 28.
    Foster, I., Kishimoto, H., Savva, A., Berry, D., Djaoui, A., Grimshaw, A., Horn, B., Maciel, F., Siebenlist, F., Subramaniam, R., Treadwell, J., Von Reich, J.: The Open Grid Services Architecture (OGSA), version 1.5. OGF Specification GFD-I.080. http://www.ogf.org/documents/GFD.80.pdf (2006)
  29. 29.
    Good, G.: The LDAP Data Interchange Format (LDIF). IETF RFC 2849 (2000)Google Scholar
  30. 30.
    Goodale, T., Jha, S., Kaiser, H., Kielmann, T., Kleijer, P., Merzky, A., Shalf, J., Smith, C.: A Simple API for Grid Applications (SAGA). OGF Specification GFD-R-P.90. http://www.ggf.org/documents/GFD.90.pdf (2008)
  31. 31.
    Graham, S., Karmarkar, A., Mischkinsky, J., Robinson, I., Sedukhin, I.: Web Services Resource 1.2 (WS-Resource). http://docs.oasis-open.org/wsrf/wsrf-ws_resource-1.2-spec-os.pdf. OASIS Standard wsrf-ws_resource-1.2-spec-os (2006)
  32. 32.
    Gudgin, M., Hadley, M., Rogers, T.: Web Services Addressing 1.0–Core, W3C Recommendation. http://www.w3.org/TR/2006/REC-ws-addr-core-20060509 (2006)
  33. 33.
    Housley, R., Polk, W., Ford, W., Solo, D.: RFC3280: Internet X.509 Public Key Infrastructure Certificate and Certificate Revocation List (CRL) Profile. http://www.ietf.org/rfc/rfc3280.txt (2002)
  34. 34.
    The Unofficial Specification of the INI Format, version 1.3: http://www.cloanto.com/specs/ini.html (2003)
  35. 35.
    Kónya, B.: The NorduGrid/ARC Information System–technical description and reference manual. Tech. Rep. NORDUGRID-TECH-4. http://www.nordugrid.org/documents/arc_infosys.pdf (2007)
  36. 36.
    Laure, E., Fisher, S.M., Frohner, Á., Grandi, C., Kunszt, P., Krenek, A., Mulmo, O., Pacini, F., Prelz, F., White, J., Barroso, M., Buncic, P., Hemmer, F., Di Meglio, A., Edlund, A.: Programming the Grid with gLite. Comput. Methods Sci. Technol. 12(1), 33–45 (2006)Google Scholar
  37. 37.
    Moses, T.: OASIS eXtensible Access Control Markup Language (XACML), Version 2.0. OASIS Standard oasis-access_control-xacml-2.0-core-spec-os. http://www.oasis-open.org/committees/xacml (2005)
  38. 38.
    Nadalin, A., Goodner, M., Gudgin, M., Barbir, A., Granqvist, H.: Ws-trust 1.3. OASIS Standard ws-trust-1.3-spec-os. http://docs.oasis-open.org/ws-sx/ws-trust/v1.3/ws-trust.pdf (2007)
  39. 39.
    Nadalin, A., Kaler, C., Monzillo, R., Hallam-Baker, P.: Web service security: SAML token profile 1.1. OASIS Standard wss-v1.1-spec-os-SAMLTokenProfile. http://docs.oasis-open.org/wss/v1.1/wss-v1.1-spec-os-SAMLTokenProfile.pdf (2006)
  40. 40.
    Nadalin, A., Kaler, C., Monzillo, R., Hallam-Baker, P.: Web service security: soap message security 1.1 (ws-security 2004). OASIS Standard Specification wss-v1.1-spec-os-SOAPMessageSecurity. http://docs.oasis-open.org/wss/v1.1/wss-v1.1-spec-os-SOAPMessageSecurity.pdf (2006)
  41. 41.
    Raman, R.: Matchmaking frameworks for distributed resource management. Ph.D. thesis, University of Wisconsin-Madison (2001)Google Scholar
  42. 42.
    Riedel, M., et al.: Interoperation of world-wide production e-science infrastructures. Concurrency and Computation: Practice and Experience 21(8), 961–990 (2009). doi:10.1002/cpe.1402 CrossRefGoogle Scholar
  43. 43.
    Scavo, T.: Saml v2.0 deployment profiles for x.509 subjects. Committee Draft 02. http://docs.oasis-open.org/security/saml/Post2.0/sstc-saml2-profiles-deploy-x509-cd-02.odt2 (2007)
  44. 44.
    Thompson, H.S., Beech, D., Maloney, M., Mendelsohn, N.: XML Schema Part 1: Structures, 2nd edn. W3C Recommendation. http://www.w3.org/TR/xmlschema-1/ (2004)
  45. 45.
    Tröger, P., Rajic, H., Haas, A., Domagalski, P.: Standardization of an API for distributed resource management systems. In: Proc. of the Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2007), pp. 619–626. Rio de Janeiro, Brazil (2007)Google Scholar
  46. 46.
    Tuecke, S., Welch, V., Engert, D., Pearlman, L., Thompson, M.: Internet X.509 Public Key Infrastructure (PKI) Proxy Certificate Profile. RFC 3820 (Proposed Standard). http://www.ietf.org/rfc/rfc3820.txt (2004)
  47. 47.
    WBEM: Web-based Enterprise Management. http://www.dmtf.org/standards/wbem/ (2009)

Copyright information

© Springer Science+Business Media B.V. 2010

Authors and Affiliations

  • Paolo Andreetto
    • 1
  • Sergio Andreozzi
    • 2
  • Antonia Ghiselli
    • 3
  • Moreno Marzolla
    • 4
  • Valerio Venturi
    • 3
  • Luigi Zangrando
    • 1
  1. 1.Istituto Nazionale di Fisica Nucleare (INFN)PadovaItaly
  2. 2.CESIAUniversità di BolognaBolognaItaly
  3. 3.INFN-CNAFBolognaItaly
  4. 4.Dipartimento di Scienze dell’InformazioneUniversità di BolognaBolognaItaly

Personalised recommendations