Abstract
In this paper we describe the Pegasus system that can map complex workflows onto the Grid. Pegasus takes an abstract description of a workflow and finds the appropriate data and Grid resources to execute the workflow. Pegasus is being released as part of the GriPhyN Virtual Data Toolkit and has been used in a variety of applications ranging from astronomy, biology, gravitational-wave science, and high-energy physics. A deferred planning mode of Pegasus is also introduced.
This research was supported in part by the National Science Foundation under grants ITR-0086044(GriPhyN) and EAR-0122464 (SCEC/ITR).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abramovici, A., et al.: LIGO: The Laser Interferometer Gravitational-Wave Observatory (in Large Scale Measurements). Science 256(5055) (1992)
Akarsu, E., et al.: Webflow - high-level programming environment and visual authoring toolkit for high performance distributed computing. In: Sc 1998 (1998)
Allcock, B., et al.: Data management and transfer in high performance computational grid environments. Parallel Computing Journal 28(5), 749–771 (2002a)
Annis, J., and others: Applying Chimera Virtual Data Concepts to Cluster Finding in the Sloan Sky Survey. In: Supercomputing 2002, Baltimore, MD (2002)
Berriman, B., et al.: Montage: A grid-enabled image mosaic service for the nvo. In: Astronomical Data Analysis Software & Systems (ADASS) XIII (October 2003)
Buyya, R., et al.: Nimrod/G: An Architecture for a Resource Management and Scheduling System in a Global Computational Grid. In: HPC, Asia (2000)
Cao, J., et al.: Gridflow: Workflow management for grid computing. In: 3rd Int. Symposium on Cluster Computing and the Grid, pp. 198–205 (2003)
Chervenak, A., et al.: Giggle: A framework for constructing scalable replica location services. In: Proceedings of Supercomputing 2002 (SC 2002) (November 2002)
Czajkowski, K., et al.: A resource management architecture for metacom-puting systems. In: Workshop on Job Scheduling Strategies for Parallel Processing (1998)
Czajkowski, K., et al.: Grid information services for distributed resource sharing. In: HPDC (2001)
Deelman, E., et al.: Transformation catalog design for griphyn, prototype of transformation catalog schema. Technical Report 2001-17, GRIPHYN (2001)
Deelman, E., et al.: Grid-based galaxy morphology analysis for the national virtual observatory. In: SC 2003 (2003)
Deelman, E., et al.: Workflow Management in GriPhy. In: Kluwer, N., Jabrzyski, J., Schopf, J., Weglarz, J. (eds.) The Grid Resource Management (2003)
Deelman, E., et al.: Mapping abstract complex workflows onto grid environments. Journal of Grid Computing 1 (2003)
Foster, I., et al.: Chimera: A Virtual Data System for Representing, Querying, and Automating Data Derivation. In: SSDBM (2002)
Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. Intl. Journal of High Performance Computing Applications 15(3), 200–222 (2001), http://www.globus.org/-research/papers/anatomy.pdf
Frey, J., et al.: Condor-G: A Computation Managament Agent for Multi-Institutional Grids. In: Proceedings of the Tenth IEEE Symposium on High Performance Distributed Computing, HPDC10 (2001)
Condor Team. The directed acyclic graph manager (2002), http://www.cs.wisc.edu/condor/dagman
von Laszewski, G., et al.: Gridant-client-side management with ant. Whitepaper (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Deelman, E. et al. (2004). Pegasus: Mapping Scientific Workflows onto the Grid. In: Dikaiakos, M.D. (eds) Grid Computing. AxGrids 2004. Lecture Notes in Computer Science, vol 3165. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-28642-4_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-28642-4_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22888-2
Online ISBN: 978-3-540-28642-4
eBook Packages: Springer Book Archive