A Framework for Job Management in the NorduGrid ARC Middleware

  • Henrik Thostrup Jensen
  • Josva Kleist
  • Jesper Ryge Leth
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3470)

Abstract

This paper presents a framework for managing jobs in the NorduGrid ARC middleware. The system introduces a layer between the user and the grid, and acts as a proxy for the user. Jobs are continuously monitored and the system reacts to changes in their status, by invoking plug-ins to handle a certain job status. Unlike other job management systems, our is run on the client side, under the control of the user. This eliminates the need for the user to share a proxy credential, which is needed to control jobs. Furthermore the system can be extended by the user, as it is designed as a framework. This gives the users the possibility to adapt and extend it, to their needs.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    The Globus Alliance. The globus resource specification language rsl v1.0. (May 2000), http://www-fp.globus.org/gram/rsl_spec1.html
  2. 2.
    The Globus Alliance. The globus toolkit (September 2004), http://www-unix.globus.org/toolkit/
  3. 3.
    The Globus Alliance. Grid security infrastructure (gsi) (April 2004), http://www-unix.globus.org/security/
  4. 4.
    Benekos, N.C., Nairz, A.: Welcome to the atlas data challenges (June 2003), http://atlas.web.cern.ch/Atlas/GROUPS/SOFTWARE/DC/
  5. 5.
    Bogdanski, M., Kosiedowski, M., Mazurek, C., Wolniewicz, M.: Progress – access environment to computational services performed by cluster of sun systems (December 2002), http://progress.psnc.pl/English/cgw02.pdf
  6. 6.
    Bogdanski, M., Kosiedowski, M., Mazurek, C., Wolniewicz, M.: Grid service provider: How to improve flexibility of grid user interfaces? (June 2003), http://progress.psnc.pl/English/petersburg_progress.pdf
  7. 7.
    Boverhof, J.: Python globus (pyglobus). pyGlobus (September 2004), http://www-itg.lbl.gov/gtg/projects/
  8. 8.
    Bracha, G., Cook, W.: Mixin-based inheritance. In: Meyrowitz, N. (ed.) Proceedings of the Conference on Object-Oriented Programming: Systems, Languages, and Applications / Proceedings of the European Conference on Object-Oriented Programming, Ottawa, Canada, pp. 303–311. ACM Press, New York (1990)CrossRefGoogle Scholar
  9. 9.
    The NorduGrid Collaboration. Nordugrid general information (September 2004), http://www.nordugrid.org/about.html
  10. 10.
    Zope Corporation. Zope object database (June 2004), http://zope.org/Products/ZODB3.2
  11. 11.
    Czajkowski, K., Foster, I., Karonis, N., Kesselman, C., Martin, S., Smith, W., Tuecke, S.: A Resource Management Architecture for Metacomputing Systems. In: Feitelson, D.G., Rudolph, L. (eds.) IPPS-WS 1998, SPDP-WS 1998, and JSSPP 1998. LNCS, vol. 1459, p. 62. Springer, Heidelberg (1998)CrossRefGoogle Scholar
  12. 12.
    Fitzgerald, S., Foster, I., Kesselman, C., von Laszewski, G., Smith, W., Tuecke, S.: A directory service for configuring high-performance distributed computations. In: Proc. 6th IEEE Symp. on High Performance Distributed Computing, pp. 365–375. IEEE Computer Society Press, Los Alamitos (1997)Google Scholar
  13. 13.
    The Python Software Foundation. What is python? (October 2004), http://python.org/doc/Summary.html
  14. 14.
    Gudgin, M., Hadley, M., Mendelsohn, N., Moreau, J.-J., Nielsen, H.F.: Soap version 1.2 part 1: Messaging framework (June 2003), http://www.w3.org/TR/soap12-part1/
  15. 15.
    Konstantinov, A.: The nordugrid grid manager and gridftp server - description and administrators manual(July 2003), http://www.nordugrid.org/documents/GM.pdf
  16. 16.
    Konya, B.: The nordugrid information system. (September 2002), http://www.nordugrid.org/documents/ng-infosys.pdf
  17. 17.
    Lee, W., McCough, S., Newhouse, S., Darlington, J.: Load-balancing eu-datagrid resource broker (September 2003), http://www.doc.ic.ac.uk/~nfur/iceni/AHM2003/edg.pdf
  18. 18.
    McNab, A.: Gacl - a grid acl manipulation library (November 2003), http://www.gridpp.ac.uk/authz/gacl/
  19. 19.
    Novotny, J., Tuecke, S., Welch, V.: An online credential repository for the grid: Myproxy (2001)Google Scholar
  20. 20.
    LHC Computing Grid Project. Lhc computing grid project (lcg) homepage. (December 2003), http://lcg.web.cern.ch/lcg/
  21. 21.
    The Globus Project. Gridftp universal data transfer for the grid (September 2000)Google Scholar
  22. 22.
    The Grid2003 Project. Grid3 (October 2004), http://www.ivdgl.org/grid2003/
  23. 23.
    Smirnova, O.: Extended resource specification language. (October 2003), http://www.nordugrid.org/documents/xrsl.pdf
  24. 24.
    Tadepalli, S., Ribbens, C.J., Varadarajan, S.: Gems: A job management system for fault tolerant grid computing. In: Meyer, J. (ed.) High Performance Computing Symposium 2004, San Diego, CA. Soc. for Modeling and Simulation Internat, pp. 59–66 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Henrik Thostrup Jensen
    • 1
  • Josva Kleist
    • 1
  • Jesper Ryge Leth
    • 1
  1. 1.Danish Center for Grid Computing & Aalborg UniversityDenmark

Personalised recommendations