Abstract
A template algorithm for parallel execution of independent iterations of the repetitive loop on a multiprocessor computer with distributed memory is constructed. Regardless of the number of processors, the algorithm must provide efficient utilization of computing capacity under essentially different complexities of iterations and/or performance of processors. The interprocessor data communication and control of parallel computations are assumed to be implemented using a standard message-passing interface (MPI), which is widely used in such systems. Existing methods for the loop parallelization are analyzed and the corresponding efficiencies are empirically estimated for various models of iteration nonuniformity.
Similar content being viewed by others
References
The OpenMP API specification for parallel programming http://openmp.org/wp/
Message-passing Interface Forum. MPI Documents http://www.mpi-forum.org/docs/docs.html
CENTAUR Software Tools for Hybrid Supercomputing http://centaur.botik.ru/home
Joint Supercomputer Center of Russian Academy Science. Computing Systems http://www.jscc.ru/scomputers.shtml
O. A. Zverkov, A. V. Seliverstov, and V. A. Lyubetskii, “Albuminous families typical of plastoms of small taxonomic groups of algas and protozoa,” Molekulyar. Biologiya 46, 799–809 (2012).
V. A. Lyubetsky, L. I. Rubanov, and A. V. Seliverstov, “Lack of conservation of bacterial type promoters in plastids of Streptophyta,” Biology Direct 5(34) (2010).
V. A. Lyubetsky, O. A. Zverkov, L. I. Rubanov, and A. V. Seliverstov, “Modeling RNA polymerase competition: the effect of σ-subunit knockout and heat shock on gene transcription level,” Biology Direct 6(3) (2011).
V. A. Lyubetsky, O. A. Zverkov, S. A. Pirogov, L. I. Rubanov, and A. V. Seliverstov, “Modeling RNA polymerase interaction in mitochondria of chordates,” Biology Direct 7(26) (2012).
V. A. Lyubetsky, L. I. Rubanov, L. Yu. Rusin, and K. Yu. Gorbunov, “Cubic time algorithms of amalgamating gene trees and building evolutionary scenarios,” Biology Direct 7(48) (2012).
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © L.I. Rubanov, 2013, published in Informatsionnye Protsessy, 2013, Vol. 13, No. 4, pp. 295–305.
Rights and permissions
About this article
Cite this article
Rubanov, L.I. Parallelization of nonuniform loops in supercomputers with distributed memory. J. Commun. Technol. Electron. 59, 639–646 (2014). https://doi.org/10.1134/S1064226914060175
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S1064226914060175