A Data Broker for Distributed Computing Environments
This paper presents a toolkit for managing distributed communication in multi-application systems that are targeted to run in high performance computing environments; the Distributed Data Broker (DDB). The DDB provides a flexible mechanism for coupling codes with different grid resolutions and data representations. The target applications are coupled systems that deal with large volumes of data exchanges and/or are computational expensive. These application codes need to run efficiently in massively parallel computer environments generating a need for a distributed coupling to minimize long synchronization points. Furthermore, with the DDB, coupling is realized in a plug-in manner rather than hard-wire inclusion of any programming language statements. The DDB performance in the CRAY T3E-600 and T3E-900 systems is examined
KeywordsMMP systems Distributed Computing Data Brokerage coupling
Unable to display preview. Download preview PDF.
- 1.Drummond, L. A., J. D. Farrara, C. R. Mechoso, J. A. Spahr, J. W. Demmel, K. Sklower and H. Robinson, 1999: An Earth System Model for MPP environments: Issues in coupling components with different complexities. Proceedings of the 1999 High Performance Computing-Grand Challenges in Computer Simulation Conference April 11-15, 1999, San Diego, CA, 123–127.Google Scholar
- 2.Mechoso, C. R., L. A. Drummond, J. D. Farrara, J. A. Spahr, 1998: The UCLA AGCM in high performance computing environments. In Proceedings, Supercomputing 98, Orlando, FL.Google Scholar
- 3.Sklower, K., H. R. Robinson, L. A. Drummond, C. R. Mechoso, J. A. Spahr, E. Mesrobian, 2000: The Data Broker: A decentralized mechanism for periodic exchange of fields between multiple ensembles of parallel computations http://www.cs.berkeley.edu/~sklower/DDB/paper.html