Journal of Grid Computing

, Volume 12, Issue 1, pp 111–125 | Cite as

Towards Standardized Job Submission and Control in Infrastructure Clouds

Article

Abstract

The submission and management of computational jobs is a traditional part of utility computing environments. End users and developers of domain-specific software abstractions often have to deal with the heterogeneity of such batch processing systems. This lead to a number of application programming interface and job description standards in the past, which are implemented and established for cluster and Grid systems. With the recent rise of cloud computing as new utility computing paradigm, the standardized access to batch processing facilities operated on cloud resources becomes an important issue. Furthermore, the design of such a standard has to consider a tradeoff between feature completeness and the achievable level of interoperability. The article discusses this general challenge, and presents some existing standards with traditional cluster and Grid computing background that may be applicable to cloud environments. We present OCCI-DRMAA as one approach for standardized access to batch processing facilities hosted in a cloud.

Keywords

Cloud IaaS DRMS DRMAA OCCI Batch processing Job submission Job monitoring 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Allen, G., Davis, K., Dolkas, K., Doulamis, N., Goodale, T., Kielmann, T., Merzky, A., Nabrzyski, J., Pukacki, J., Radke, T., Russell, M., Seidel, E., Shalf, J., Taylor, I.: Enabling applications on the Grid: a GridLab overview. Int. J. High Perform. Comput. Appl. 4, 449–466 (2003)CrossRefGoogle Scholar
  2. 2.
    Dillaway, B., Humphrey, M., Smith, C., Theimer, M., Wasson, G.: HPC basic profile, Version 1.0. http://www.ogf.org/documents/GFD.114.pdf (2007). Accessed Sept 2013
  3. 3.
    Distributed Management Task Force (DMTF): Open virtualization format specification version 2.0.1 – DSP 0243 (2013)Google Scholar
  4. 4.
    Edmonds, A., Metsch, T., Luster, E.: An open, interoperable cloud. http://www.infoq.com/articles/open-interoperable-cloud (2011). Accessed Sept 2013
  5. 5.
    Erwin, D., Snelling, D.: UNICORE: a Grid computing environment. Lect. Notes Comput. Sci. 2150, 825 (2001)CrossRefGoogle Scholar
  6. 6.
    Fallside, D., Walmsley, P.: XML schema part 0: primer second edition. W3C Recommendation. World Wide Web Consortium. http://www.w3.org/TR/xmlschema-0 (2004). Accessed Sept 2013
  7. 7.
    Foster, I., Grimshaw, A., Lane, P., Lee, W., Morgan, M., Newhouse, S., Pickles, S., Pulsipher, D., Smith, C., Theimer, M.: OGSA Basic Execution Service v1.0 (GFD-R.108). Open Grid Forum. http://www.ogf.org/documents/GFD.108.pdf (2008). Accessed Sept 2013
  8. 8.
    Gentzsch, W., Yenier, B.: HPC experiment: round 1 – final report. http://www.hpcexperiment.com/ (2012). Accessed Sept 2013
  9. 9.
    Goodale, T., Jha, S., Kaiser, H., Kielmann, T., Kleijer, P., Merzky, A., Shalf, J., Smith, C.: A simple API for Grid applications (SAGA) Version 1.1 (GFD-R-P.90). Open Grid Forum. http://www.ogf.org/documents/GFD.90.pdf (2008). Accessed Sept 2013
  10. 10.
    Lee, C.: A perspective on scientific cloud computing. In: 19th ACM International Symposium on High Performance Distributed Computing, pp. 451–459. ACM, New York, NY, USA (2010)Google Scholar
  11. 11.
    Memon, S., Yen, E., Riedel, M., Salle, M., Koeroo, O.: EMI cloud strategy. http://indico.egi.eu/indico//contributionDisplay.py?contribId=210&resId=4&confId=452. Accessed September 2013
  12. 12.
    Metsch, M., Edmonds, A.: Open cloud computing interface - infrastructure. http://www.ogf.org/documents/GFD.184.pdf(2011). Accessed Sept 2013
  13. 13.
    Metsch, T., Edmonds, A.: Open cloud computing interface - RESTful HTTP rendering. http://www.ogf.org/documents/GFD.185.pdf (2011)
  14. 14.
    Moreau, J.-J., Ryman, A., Weerawarana, S., Chinnici, R.: Web services description language (WSDL) version 2.0 part 1: core language. World Wide Web Consortium. http://www.w3.org/TR/wsdl20 (2006). Accessed Sept 2013
  15. 15.
    Nyren, R., Edmonds, A., Papaspyrou, A., Metsch, T.: Open cloud computing interface - core. http://www.ogf.org/documents/GFD.183.pdf (2011)
  16. 16.
    Riedel, M., Schuller, B., Mallmann, D., Menday, R., Streit, A., Tweddell, B., Memon, M., Memon, A., Demuth, B., Lippert, T.: Web services interfaces and open standards integration into the European UNICORE 6 Grid middleware. In: Eleventh International IEEE EDOC Conference Workshop, pp. 57–60. IEEE Computer Society, Washington, DC, USA (2007)Google Scholar
  17. 17.
    Rings, T., Caryer, G., Gallop, J., Grabowski, J., Kovacikova, T., Schulz, S., Stokes-Rees, I.: Grid and cloud computing: opportunities for integration with the next generation network. J. Grid Comput. 7 (2009). Special issue on Grid interoperabilityGoogle Scholar
  18. 18.
    Snell, J., Glover, T.: Portability and interoperability: Similarities and differences explained. http://www.ibm.com/developerworks/webservices/library/ws-port/ (2003)
  19. 19.
    Thain, D., Tannenbaum, T., Livny, M.: Condor and the Grid, pp. 299–336. John Wiley & Sons Inc. (2002)Google Scholar
  20. 20.
    Tröger, P., Brobst, R., Gruber, D., Mamonski, M., Templeton, D.: Distributed resource management application API Version 2 (DRMAA). http://www.ogf.org/documents/GFD.194.pdf (2012). Accessed Sept 2013

Copyright information

© Springer Science+Business Media Dordrecht 2013

Authors and Affiliations

  1. 1.Hasso Plattner InstituteUniversity of PotsdamPotsdamGermany
  2. 2.CCTLouisiana State UniversityBaton RougeUSA

Personalised recommendations