Abstract
One of the main goals of the CrossGrid Project [1] is to provide explicit support to parallel and interactive compute- and data- intensive applications. The CrossBroker job manager provides services as part of the CrossGrid middleware and allows execution of parallel MPI applications on Grid resources in a transparent and automatic way. This document describes the design and implementation of the key components responsible for an efficient and reliable execution of MPI jobs splitted over multiple Grid sites, executed either in an on-line or batch manner. We also provide details on the overheads introduced by our system, as well as an experimental study showing that our system is well-suited for embarrassingly parallel applications.
This work was made in the frame of the ”int-eu.grid” project (sponsored by the European Union), and supported by the MEyC-Spain under contract TIN 2004-03388, and partially supported by the NATO under contract EST.EAP.CLG 981032.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
EU-CrossGrid (2004), http://www.eu-crossgrid.org
Schopt, J.M.: Ten Actions When Grid Scheduling. In: Grid Resource Management - State of the Art and Future Trends, Kluwer Academic Publishers, Dordrecht (2003)
Karonis, N.T., et al.: Mpich-g2: A grid-enabled implementation of the message passing interface. J. Parallel Distrib. Comput. 63(5), 551–563 (2003)
Bucur, A., Epema, D.: The performance of processor co-allocation in multicluster. In: 11th Int. Symp on High Perf. Distr. Comp. (2002)
Wang, L., et al.: Resource co-allocation for parallel tasks in computational grids. In: Int. Workshop on Challenges of Large Apps. in Dist. Env. (2003)
Czajkowski, K., Foster, I., Kesselman, C.: Resource co-allocation in computational grids. In: Proceedings of the HPDC-8, pp. 219–228 (1999)
Lindner, P., et al.: Gcm: a grid configuration manager for heterogeneous grid enviromnents. Int. J. Grid and Utility Computing 1(1), 4–12 (2005)
Gabriel, E., et al.: Distributed computing in a heterogenous computing environment. In: EuroPVMMPI 1998 (1998)
Heymann, E., et al.: Managing mpi applications in grid environments. In: European Across Grids Conference, pp. 42–50 (2004)
Pazini, F.: Jdl attibutes. Technical report, European Datagrid Project (2001)
Raman, R., et al.: Matchmaking: Distributed resource management for high throughput computing. In: HPDC-7, Chicago, IL (1998)
Thain, D., et al.: Condor and the grid. In: Grid Computing: Making the Global Infrastructure a Reality, John Wiley & Sons Inc., Chichester (2003)
Gutiérrez, A., et al.: Parallelization of a neural net training program in a grid environment. In: PDP 2004, pp. 258–265 (2004)
Cameron, D., et al.: Replica management services in the european datagrid project. In: UK e-Science All Hands Conference (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fernández, E., Heymann, E., Senar, M.À. (2006). Supporting Efficient Execution of MPI Applications Across Multiple Sites. In: Nagel, W.E., Walter, W.V., Lehner, W. (eds) Euro-Par 2006 Parallel Processing. Euro-Par 2006. Lecture Notes in Computer Science, vol 4128. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11823285_40
Download citation
DOI: https://doi.org/10.1007/11823285_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-37783-2
Online ISBN: 978-3-540-37784-9
eBook Packages: Computer ScienceComputer Science (R0)