Abstract
This paper presents a toolkit for managing distributed communication in multi-application systems that are targeted to run in high performance computing environments; the Distributed Data Broker (DDB). The DDB provides a flexible mechanism for coupling codes with different grid resolutions and data representations. The target applications are coupled systems that deal with large volumes of data exchanges and/or are computational expensive. These application codes need to run efficiently in massively parallel computer environments generating a need for a distributed coupling to minimize long synchronization points. Furthermore, with the DDB, coupling is realized in a plug-in manner rather than hard-wire inclusion of any programming language statements. The DDB performance in the CRAY T3E-600 and T3E-900 systems is examined
Chapter PDF
Similar content being viewed by others
References
Drummond, L. A., J. D. Farrara, C. R. Mechoso, J. A. Spahr, J. W. Demmel, K. Sklower and H. Robinson, 1999: An Earth System Model for MPP environments: Issues in coupling components with different complexities. Proceedings of the 1999 High Performance Computing-Grand Challenges in Computer Simulation Conference April 11-15, 1999, San Diego, CA, 123–127.
Mechoso, C. R., L. A. Drummond, J. D. Farrara, J. A. Spahr, 1998: The UCLA AGCM in high performance computing environments. In Proceedings, Supercomputing 98, Orlando, FL.
Sklower, K., H. R. Robinson, L. A. Drummond, C. R. Mechoso, J. A. Spahr, E. Mesrobian, 2000: The Data Broker: A decentralized mechanism for periodic exchange of fields between multiple ensembles of parallel computations http://www.cs.berkeley.edu/~sklower/DDB/paper.html
Smith, R. D., J. K. Dukowicz, and R. C. Malone, 1992: Parallel Ocean General Circulation Modeling, Physica D, 60, 38–61.
Wehner, M. F., A. A. Mirin, P. G. Eltgroth, W. P. Dannevik, C. R. Mechoso, J. D. Farrara and J. A. Spahr, 1995: Performance of a distributed memory finite-difference atmospheric general circulation model. Parallel Computing, 21, 1655–1675.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Drummond, L.A., Demmel, J., Mechoso, C.R., Robinson, H., Sklower, K., Spahr, J.A. (2001). A Data Broker for Distributed Computing Environments. In: Alexandrov, V.N., Dongarra, J.J., Juliano, B.A., Renner, R.S., Tan, C.J.K. (eds) Computational Science — ICCS 2001. ICCS 2001. Lecture Notes in Computer Science, vol 2073. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45545-0_13
Download citation
DOI: https://doi.org/10.1007/3-540-45545-0_13
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42232-7
Online ISBN: 978-3-540-45545-5
eBook Packages: Springer Book Archive