Advertisement

Dynamic Virtual Worker Nodes in a Production Grid

  • Stephen Childs
  • Brian Coghlan
  • Jason McCandless
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4331)

Abstract

There is a growing body of opinion that virtual machines (VMs) provide a good environment for executing user jobs on Grid compute nodes. Sites which execute jobs in specially-created virtual machines can provide levels of isolation and customisation that are unobtainable when jobs run directly on the hardware. Various solutions have been proposed for initiating and controlling such dynamic virtual environments, but issues of integration with a production Grid middleware stack have not received much attention. In addition, solutions proposed to date often require significant user involvement in the process of locating and initiating VMs. We outline a scheme for transparently providing dynamically-instantiated VM-based worker nodes in the EGEE production grid. By extending server-side software, the use of virtual machines is made invisible to the user. Users simply specify the details of their required execution environment in the standard job description language. Resource brokers then locate sites that advertise support for that particular environment. Sites that support dynamic virtual worker nodes advertise support for the various environments that they know how to create; the site’s compute element is responsible for instantiating a VM that conforms to the environment description requested and for executing the job in that VM’s context. We also evaluate the VM management tools available to implement such a scheme and describe their possible integration with LCG and gLite middleware.

Keywords

Virtual Machine Execution Environment Computing Element Production Grid Virtual Cluster 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Figueiredo, R.J., Dinda, P.A., Fortes, J.A.B.: A Case for Grid Computing on Virtual Machines. In: Proceedings of the International Conference on Distributed Computing Systems (2003)Google Scholar
  2. 2.
    Keahey, K., Foster, I., Freeman, T., Zhang, X.: Virtual Workspaces: Achieving Quality of Service and Quality of Life in the Grid. Scientific Programming Journal (2006)Google Scholar
  3. 3.
    Keahey, K., Doering, K., Foster, I.: From Sandbox to Playground: Dynamic Virtual Environments in the Grid. In: 5th International Workshop in Grid Computing (Grid 2004) (2004)Google Scholar
  4. 4.
    Adabala, S., Chadha, V., Chawla, P., Figueiredo, R., Fortes, J., Krsul, I., Matsunaga, A., Tsugawa, M., Zhang, J., Zhao, M., Zhu, L., Zhu, X.: From virtualized resources to virtual computing Grids: The In-VIGO system. Future Generation Computer Systems 21 (2005)Google Scholar
  5. 5.
    Globus: The Globus Resource Specification Language (RSL), specification 1.0. http://www-fp.globus.org/gram/rsl_spec1.html
  6. 6.
    Solomon, M.: The ClassAd language reference manual (2004), http://www.cs.wisc.edu/condor/classad/refman.pdf
  7. 7.
    European Data Grid: The EDG job description language (JDL), http://server11.infn.it/workload-grid/docs/DataGrid-01-TEN-0142-0_2.pdf
  8. 8.
    Foster, I., Kesselman, C., Tsudik, G., Tuecke, S.: A security architecture for computational grids. In: Proc. 5th ACM Conference on Computer and Communications Security Conference, pp. 83–92 (1998)Google Scholar
  9. 9.
    Alfieri, R., Cecchini, R., Ciaschini, V., dell Agnello, L., Frohner, A., Gianoli, A., Lőrentey, K., Spataro, F.: VOMS, an authorization system for virtual organizations. In: Fernández Rivera, F., Bubak, M., Gómez Tato, A., Doallo, R. (eds.) Across Grids 2003. LNCS, vol. 2970, pp. 33–40. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  10. 10.
    Peris, A.D., Lorenzo, P.M., Donno, F., Sciaba, A., Campana, S., Santinelli, R.: LCG-2 user guide. In: LHC Computing Grid Manuals Series (2005), https://edms.cern.ch/file/454439/2/LCG-2-UserGuide.pdf
  11. 11.
    Andreozzi, S., Burke, S., Field, L., Fisher, S., Konya, B., Mambelli, M., Schopf, J.M., Viljoen, M., Wilson, A.: GLUE schema specification version 1.2 (2005), http://infnforge.cnaf.infn.it/glueinfomodel/index.php/Spec/V12
  12. 12.
    Prelz, F.: Passing requirement information to the gLite CE via BLAHPD. In: HEPIX conference (2006)Google Scholar
  13. 13.
    Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the Art of Virtualization. In: Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles, ACM Press, New York (2003)Google Scholar
  14. 14.
    VMware: VMware scripting API user’s manual (2005), http://www.vmware.com/pdf/Scripting_API_215.pdf
  15. 15.
    Keahey, K., Foster, I., Freeman, T., Zhang, X., Galron, D.: Virtual Workspaces in the Grid. In: Proceedings of Europar 2005 (2005)Google Scholar
  16. 16.
    Krsul, I., Ganguly, A., Zhang, J., Fortes, J.A.B., Figueiredo, R.J.: VMPlants: Providing and Managing Virtual Machine Execution Environments for Grid Computing. In: Proceedings of the 2004 ACM/IEEE conference on Supercomputing (2004)Google Scholar
  17. 17.
    Traylen, S.: How to publish different memory limits for different queues on the same ce (2005), http://goc.grid.sinica.edu.tw/gocwiki/How_to_publish_different_memory_limits_for_different_queues_on_the_same_CE

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Stephen Childs
    • 1
  • Brian Coghlan
    • 1
  • Jason McCandless
    • 1
  1. 1.Department of Computer ScienceTrinity College Dublin 

Personalised recommendations