A Data Broker for Distributed Computing Environments

  • L. A. Drummond
  • J. Demmel
  • C. R. Mechoso
  • H. Robinson
  • K. Sklower
  • J. A. Spahr
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2073)

Abstract

This paper presents a toolkit for managing distributed communication in multi-application systems that are targeted to run in high performance computing environments; the Distributed Data Broker (DDB). The DDB provides a flexible mechanism for coupling codes with different grid resolutions and data representations. The target applications are coupled systems that deal with large volumes of data exchanges and/or are computational expensive. These application codes need to run efficiently in massively parallel computer environments generating a need for a distributed coupling to minimize long synchronization points. Furthermore, with the DDB, coupling is realized in a plug-in manner rather than hard-wire inclusion of any programming language statements. The DDB performance in the CRAY T3E-600 and T3E-900 systems is examined

Keywords

MMP systems Distributed Computing Data Brokerage coupling 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Drummond, L. A., J. D. Farrara, C. R. Mechoso, J. A. Spahr, J. W. Demmel, K. Sklower and H. Robinson, 1999: An Earth System Model for MPP environments: Issues in coupling components with different complexities. Proceedings of the 1999 High Performance Computing-Grand Challenges in Computer Simulation Conference April 11-15, 1999, San Diego, CA, 123–127.Google Scholar
  2. 2.
    Mechoso, C. R., L. A. Drummond, J. D. Farrara, J. A. Spahr, 1998: The UCLA AGCM in high performance computing environments. In Proceedings, Supercomputing 98, Orlando, FL.Google Scholar
  3. 3.
    Sklower, K., H. R. Robinson, L. A. Drummond, C. R. Mechoso, J. A. Spahr, E. Mesrobian, 2000: The Data Broker: A decentralized mechanism for periodic exchange of fields between multiple ensembles of parallel computations http://www.cs.berkeley.edu/~sklower/DDB/paper.html
  4. 4.
    Smith, R. D., J. K. Dukowicz, and R. C. Malone, 1992: Parallel Ocean General Circulation Modeling, Physica D, 60, 38–61.MATHCrossRefGoogle Scholar
  5. 5.
    Wehner, M. F., A. A. Mirin, P. G. Eltgroth, W. P. Dannevik, C. R. Mechoso, J. D. Farrara and J. A. Spahr, 1995: Performance of a distributed memory finite-difference atmospheric general circulation model. Parallel Computing, 21, 1655–1675.MATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • L. A. Drummond
    • 1
  • J. Demmel
    • 3
  • C. R. Mechoso
    • 2
  • H. Robinson
    • 3
  • K. Sklower
    • 3
  • J. A. Spahr
    • 2
  1. 1.Lawrence Berkeley National LaboratoryNational Energy Research Scientific Computing CenterBerkeleyUSA
  2. 2.Department of Atmospheric SciencesUniversity of California, Los AngelesLos AngelesUSA
  3. 3.Computer Science DivisionUniversity of California, BerkeleyBerkeleyUSA

Personalised recommendations