Abstract
In many scientific applications, array redistribution is usually required to enhance data locality and reduce remote memory access on distributed memory multicomputers. Since the redistribution is performed at run-time, there is a performance tradeoff between the efficiency of the new data decomposition for a subsequent phase of an algorithm and the cost of redistributing data among processors. In this paper, we present efficient methods for multi-dimensional array redistribution. Based on the previous work, the basic-cycle calculation technique, we present a basic-block calculation (BBC) and a complete-dimension calculation (CDC) techniques. We also developed a theoretical model to analyze the computation costs of these two techniques. The theoretical model shows that the BBC method has smaller indexing costs and performs well for the redistribution with small array size. The CDC method has smaller packing/unpacking costs and performs well when array size is large. When implemented these two techniques on an IBM SP2 parallel machine along with the PITFALLS method and the Prylli's method, the experimental results show that the BBC method has the smallest execution time of these four algorithms when the array size is small. The CDC method has the smallest execution time of these four algorithms when the array size is large.
Similar content being viewed by others
References
S. Benkner. Handling block-cyclic distribution arrays in Vienna Fortran 90. In Proceedings of the International Conference on Parallel Architectures and Compilation Techniques, Limassol, Cyprus, pp. 224-253, June 1995.
B. Chapman, P. Mehrotra, H. Moritsch, and H. Zima. Dynamic data distribution in Vienna Fortran. In '93, pp. 284-293, November 1993.
S. Chatterjee, J. R. Gilbert, F. J. E. Long, R. Schreiber, and S.-H. Teng. Generating local address and communication sets for data parallel programs. Journal of Parallel and Distributed Computing, 26: 72-84, 1995.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Hsu, CH., Chung, YC. & Dow, CR. Efficient Methods for Multi-Dimensional Array Redistribution. The Journal of Supercomputing 17, 23–46 (2000). https://doi.org/10.1023/A:1008167621154
Issue Date:
DOI: https://doi.org/10.1023/A:1008167621154