Advertisement

gLite Job Provenance

  • František Dvořák
  • Daniel Kouřil
  • Aleš Křenek
  • Luděk Matyska
  • Miloš Mulač
  • Jan Pospíšil
  • Miroslav Ruda
  • Zdeněk Salvet
  • Jiří Sitera
  • Michal Voců
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4145)

Abstract

The Job Provenance (JP) service is designed to automate keeping track of computations on large scale Grids, giving thus users a tool to correctly archive information about their jobs and to re-submit any job in a reconstructed environment. JP provides a permanent minimal record of job (and its environment) related information, to which free-form user annotations can be added. JP also offers the capability of configuring any number of indexed logical views on the large collections of raw data, allowing efficient processing of even complex user queries selecting on both system data and the annotations. The scalable architecture, capable to handle millions of jobs in a single JP installation, and integrated into the EGEE gLite middleware environment is presented.

Keywords

Service Orient Architecture User Query Index Server Logical View Primary Storage 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    AliEn (ALIce ENvironment), http://aliceinfo.cern.ch/AliEn
  2. 2.
    EU FP6 Programme Enabling and Supporting Provenance in Grids for Complex Problems, http://twiki.gridprovenance.org/bin/view/Provenance/ProjectInformation
  3. 3.
    gLite—Ligthweight Middleware for Grid Computing, http://glite.web.cern.ch/glite/default.asp
  4. 4.
  5. 5.
    PASOA: Provenance Aware Service Oriented Architecture, http://twiki.pasoa.ecs.soton.ac.uk/bin/view/PASOA/AboutPasoa
  6. 6.
    SAM (Sequential data Access via Meta-data), http://d0db.fnal.gov/sam/
  7. 7.
    The Atlas Metadata Interface, https://atlastagcollector.in2p3.fr:8443/AMI/
  8. 8.
    Chen, L., Tan, V., Xu, F., Biller, A., Groth, P., Miles, S., Ibbotson, J., Luck, M., Moreau, L.: A proof of concept: Provenance in a Service Oriented Architecture. In: Proceedings of the fourth UK e-Science All Hands Meeting, Nottingham, UK (2005)Google Scholar
  9. 9.
    EGEE JRA1. EGEE Middleware Design—Release 1, https://edms.cern.ch/document/487871/
  10. 10.
    Groth, P., Luck, M., Moreau, L.: A protocol for recording provenance in service-oriented grids. In: Higashino, T. (ed.) OPODIS 2004. LNCS, vol. 3544, pp. 124–139. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  11. 11.
  12. 12.
    Rajbhandari, S., Walker, D.W.: Support for Provenance in a Service-based Computing Grid. In: Proceedings of the third UK e-Science All Hands Meeting, Nottingham, UK (2004)Google Scholar
  13. 13.
    Townend, P., Groth, P., Xu, J.: A provenance-aware weighted fault tolerance scheme for service-based applications. In: Proceedings of the 8th IEEE International Symposium on Object-oriented Real-time distributed Computing (ISORC 2005) (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • František Dvořák
    • 1
  • Daniel Kouřil
    • 1
  • Aleš Křenek
    • 1
  • Luděk Matyska
    • 1
  • Miloš Mulač
    • 1
  • Jan Pospíšil
    • 1
  • Miroslav Ruda
    • 1
  • Zdeněk Salvet
    • 1
  • Jiří Sitera
    • 1
  • Michal Voců
    • 1
  1. 1.CESNET z.s.p.o.Praha 6Czech Republic

Personalised recommendations