Abstract
The Angara interconnect developed by JSC “NICEVT” is designed to connect the nodes of supercomputers and computing clusters. The paper describes the main architectural solutions, algorithms and functionality of the collective operations subnet of the Angara interconnect and presents the forecast of its characteristics based on the simulation modeling and actual operation. The proposed solutions allow bringing the time complexity of the collective operations execution to the theoretical limit for the kD-torus topology network.
JSC “NICEVT”.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Habata, S., et al.: The earth simulator system. NEC Res. Dev. 44(1), 21–26 (2003)
Gara, A.: Overview of the Blue Gene/L system architecture. IBM J. Res. Dev. 49, 195–212 (2005). http://rsim.cs.illinois.edu/arch/qual_papers/systems/19.pdf
Almasi, G., Asaad, S., Bellofatto, R.E., et al.: Overview of the IBM Blue Gene/P project. IBM J. Res. Dev. 52(1–2), 199–220 (2008). http://scc.acad.bg/ncsa/documentation/team.pdf
Chen, D., Eisley, N., Heidelberger, P., et al.: The IBM BlueGene/Q interconnection fabric. IEEE Micro 32(1), 32–43 (2012). https://www.researchgate.net/publication/220290398_The_IBM_blue_geneQ_interconnection_fabric
Abts, D., Storm, C.R.: The Cray XT4 and Seastar 3-D torus interconnect (2010). https://static.googleusercontent.com/media/research.google.com/ru//pubs/archive/36896.pdf
Alam, S.R.: Cray XT4: an early evaluation for petascale scientific simulation. In: Proceedings of the 2007 ACM/IEEE Conference on Supercomputing, pp. 1–12. IEEE (2007). https://doi.org/10.1145/1362622.1362675
Alverson, R., Roweth, D., Kaplan, L.: The Gemini system interconnect. 2010 IEEE 18th Annual Symposium on High Performance Interconnects (HOTI), pp. 83–87. IEEE (2010). https://doi.org/10.1109/HOTI.2010.23
Bala, V., Bruck, J., Cypher, R., et al.: CCL: A Portable and Tunable Collective Communication Library for Scalable Parallel Computers. In: Proceedings of the Parallel Processing Symposium, pp. 835–844 (1994). ISBN 0-8186-5620-6
Almási, G., Dózsa, G., Erway, C.C., Steinmacher-Burow, B.: Efficient implementation of allreduce on BlueGene/L collective network. In: Di Martino, B., Kranzlmüller, D., Dongarra, J. (eds.) EuroPVM/MPI 2005. LNCS, vol. 3666, pp. 57–66. Springer, Heidelberg (2005). https://doi.org/10.1007/11557265_12
Mukosey, A., Simonov, A., Semenov, A.: Extended routing table generation algorithm for the angara interconnect. In: Voevodin, V., Sobolev, S. (eds.) Extended Routing Table Generation Algorithm for the Angara Interconnect. CCIS, vol. 1129, pp. 573–583. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-36592-9_47
Stegailov, V., et al.: Angara interconnect makes GPU-based Desmos supercomputer an efficient tool for molecular dynamics calculations. Int. J. High Perform. Comput. Appl. 33, 507–521 (2019)
Stegailov, V., Smirnov, G., Vecher, V.: VASP hits the memory wall: processors efficiency comparison. Concurr. Comput. Pract. Exp., e5136 (2019). https://doi.org/10.1002/cpe.5136
Polyakov, S., Podryga, V., Puzyrkov, D.: High performance computing in multiscale problems of gas dynamics. Lobachevskii J. Math. 39(9), 1239–1250 (2018)
Ostroumova, G., Orekhov, N., Stegailov, V.: Reactive molecular-dynamics study of onion-like carbon nanoparticle formation. Diamond Related Mater. 94, 14–20 (2019)
Tolstykh, M., Goyman, G., Fadeev, R., Shashkin, V.: Structure and algorithms of SL-AV atmosphere model parallel program complex. Lobachevskii J. Math. 39(4), 587–595 (2018). https://doi.org/10.1134/S1995080218040145
Akimov, V., Silaev, D., Aksenov, A., Zhluktov, S., Savitskiy, D., Simonov, A.: FlowVision scalability on supercomputers with angara interconnect. Lobachevskii J. Math. 39(9), 1159–1169 (2018). https://doi.org/10.1134/S1995080218090081
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Simonov, A., Brekhov, O. (2020). Architecture and Functionality of the Collective Operations Subnet of the Angara Interconnect. In: Vishnevskiy, V.M., Samouylov, K.E., Kozyrev, D.V. (eds) Distributed Computer and Communication Networks. DCCN 2020. Lecture Notes in Computer Science(), vol 12563. Springer, Cham. https://doi.org/10.1007/978-3-030-66471-8_17
Download citation
DOI: https://doi.org/10.1007/978-3-030-66471-8_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-66470-1
Online ISBN: 978-3-030-66471-8
eBook Packages: Computer ScienceComputer Science (R0)