Advertisement

Design and Evaluation of a Parallel Data Redistribution Component for TGrid

  • Sascha Hunold
  • Thomas Rauber
  • Gudula Rünger
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4330)

Abstract

Data redistribution of parallel data representations has become an important factor of grid frameworks for scientific computing. Providing the developers with generalized interfaces for flexible parallel data redistribution is a major goal of this research. In this article we present the architecture and the implementation of the redistribution module of TGrid. TGrid is a grid-enabled runtime system for applications consisting of cooperating multiprocessor tasks (M-tasks). The data redistribution module enables TGrid components to transfer data structures to other components which may be located on the same local subnet or may be executed remotely. We show how the parallel data redistribution is designed to be flexible, extendible, scalable, and particularly easy-to-use. The article includes a detailed experimental analysis of the redistribution module by providing a comparison of throughputs which were measured for a large range of processors and for different interconnection networks.

Keywords

Grid Environment Task Graph Message Size Target Component Runtime System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Hunold, S., Rauber, T., Rünger, G.: TGrid – Grid Runtime Support for Hierarchically Structured Task-Parallel Programs. In: Proceedings of the Fifth International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Networks. IEEE Computer Society Press, Los Alamitos (2006)Google Scholar
  2. 2.
    Rauber, T., Rünger, G.: Tlib - A Library to Support Programming with Hierarchical Multi-Processor Tasks. Journal of Parallel and Distributed Computing 65, 347–360 (2005)Google Scholar
  3. 3.
    Hunold, S., Rauber, T., Rünger, G.: Multilevel Hierarchical Matrix Multiplication on Clusters. In: Proceedings of the 18th Annual ACM International Conference on Supercomputing, ICS 2004, pp. 136–145 (2004)Google Scholar
  4. 4.
    Rauber, T., Rünger, G.: M-Task-Programming for Heterogeneous Systems and Grid Environments. In: Proc. of the IPDPS Joint Workshop on High-Performance Grid Computing and High-Level Parallel Programming Models. IEEE, Los Alamitos (2005)Google Scholar
  5. 5.
    Beckman, P.H., Fasel, P.K., Humphrey, W.F., Mniszewski, S.M.: Efficient Coupling of Parallel Applications Using PAWS. In: HPDC 1998: Proceedings of the The Seventh IEEE International Symposium on High Performance Distributed Computing, Washington, DC, USA, p. 215. IEEE Computer Society, Washington (1998)CrossRefGoogle Scholar
  6. 6.
    Larson, J., Jacob, R., Ong, E.: The Model Coupling Toolkit: A New Fortran90 Toolkit for Building Multiphysics Parallel Coupled Models. Int. J. High Perform. Comput. Appl. 19, 277–292 (2005)CrossRefGoogle Scholar
  7. 7.
    Lee, J.-Y., Sussman, A.: High Performance Communication between Parallel Programs. In: IPDPS 2005: Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS 2005) - Workshop 4, p. 177.2. IEEE Computer Society Press, Washington (2005)Google Scholar
  8. 8.
    Bertrand, F., Bramley, R., Damevski, K.B., Kohl, J.A., Bernholdt, D.E., Larson, J.W., Sussman, A.: Data Redistribution and Remote Method Invocation in Parallel Component Architectures. In: Proceedings of the 19th International Parallel and Distributed Processing Symposium: IPDPS (2005), Best Paper AwardGoogle Scholar
  9. 9.
    Zhang, L., Parashar, M.: Enabling efficient and flexible coupling of parallel scientific applications. In: International Parallel and Distributed Processing Symposium IPDPS 2006, Rhodes Island, Greece. IEEE Computer Society Press, Los Alamitos (2006)Google Scholar
  10. 10.
    Bertrand, F., Bramley, R.: DCA: A Distributed CCA Framework Based on MPI. In: 18th International Parallel and Distributed Processing Symposium (IPDPS 2004), Santa Fe, New Mexico, USA, pp. 90–97. IEEE Computer Society, Los Alamitos (2004)Google Scholar
  11. 11.
    Krishnan, S., Gannon, D.: XCAT3: A Framework for CCA Components as OGSA Services. In: 18th International Parallel and Distributed Processing Symposium (IPDPS 2004), CD-ROM / Abstracts Proceedings, Santa Fe, New Mexico, USA, 26-30 April 2004, pp. 90–97. IEEE Computer Society, Los Alamitos (2004)Google Scholar
  12. 12.
    Jeannot, E., Wagner, F.: Messages Scheduling for data Redistribution between Heterogeneous Clusters. In: Proceedings of the IASTED International Conference on Parallel and Distributed Computing and Systems (PDCS 2005) (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Sascha Hunold
    • 1
  • Thomas Rauber
    • 1
  • Gudula Rünger
    • 2
  1. 1.Department of Mathematics and PhysicsUniversity of BayreuthGermany
  2. 2.Department of Computer ScienceChemnitz University of TechnologyGermany

Personalised recommendations