Delegation-Based MPI Communications for a Hybrid Parallel Computer with Many-Core Architecture

  • Kazumi Yoshinaga
  • Yuichi Tsujita
  • Atsushi Hori
  • Mikiko Sato
  • Mitaro Namiki
  • Yutaka Ishikawa
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7490)

Abstract

Many-core architecture draws much attention in HPC community towards the Exascale era. Many ongoing research activities using GPU or the Many Integrated Core (MIC) architecture from Intel exist worldwide. Many-core CPUs have a great deal of impact to improve computing performance, however, they are not favorable for heavy communications and I/Os which are essential for MPI operations in general.

We have been focusing on the MIC architecture as many-core CPUs to realize a hybrid parallel computer in conjunction with multi-core CPUs. We propose a delegation mechanism for scalable MPI communications issued on many-core CPUs so as to play delegated operations on multi-core ones. This architecture also minimizes memory utilization of not only many-core CPUs but also multi-core ones by deploying multi-layered MPI communicator information. Here we evaluated the delegation mechanism on an emulated hybrid computing environment. We show our innovative design and its performance evaluation on the emulated environment in this paper.

Keywords

many-core architecture MPI inter-core communication delegation multi-layered MPI communicator information 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Balaji, P., Buntinas, D., Goodell, D., Gropp, W., Hoefler, T., Kumar, S., Lusk, E.L., Thakur, R., Träff, J.L.: MPI on millions of cores. Parallel Processing Letters 21(1), 45–60 (2011)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Broquedis, F., Clet-Ortega, J., Moreaud, S., Furmento, N., Goglin, B., Mercier, G., Thibault, S., Namyst, R.: hwloc: A generic framework for managing hardware affinities in hpc applications. In: Proceedings of the 18th Euromicro Conference on Parallel, Distributed and Network-based Processing, PDP 2010, Pisa, Italy, February 17-19, pp. 180–186. IEEE Computer Society (2010)Google Scholar
  3. 3.
    Goodell, D., Gropp, W., Zhao, X., Thakur, R.: Scalable Memory Use in MPI: A Case Study with MPICH2. In: Cotronis, Y., Danalis, A., Nikolopoulos, D.S., Dongarra, J. (eds.) EuroMPI 2011. LNCS, vol. 6960, pp. 140–149. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  4. 4.
    Hursey, J., Squyres, J.M., Dontje, T.: Locality-aware parallel process mapping for multi-core hpc systems. In: Proceedings of 2011 IEEE International Conference on Cluster Computing (CLUSTER), Austin, TX, USA, September 26-30, pp. 527–531. IEEE (2011)Google Scholar
  5. 5.
    Intel: Intel unveils new product plans for high-performance computing (2010), http://www.intel.com/pressroom/archive/releases/2010/20100531comp.htm
  6. 6.
    Kamal, H., Mirtaheri, S., Wagner, A.: Scalability of communicators and groups in MPI. In: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, pp. 264–275. ACM, New York (2010)CrossRefGoogle Scholar
  7. 7.
    KNEM: High-performance intra-node MPI communication, http://runtime.bordeaux.inria.fr/knem/
  8. 8.
  9. 9.
    Open MPI: Open Source High Performance Computing, http://www.open-mpi.org/
  10. 10.
    Sato, M., Fukazawa, G., Nagamine, K., Sakamoto, R., Namiki, M., Yoshinaga, K., Tsujita, Y., Hori, A., Ishikawa, Y.: A design of hybrid operating system for a parallel computer with multi-core and many-core processors. Accepted to ROSS 2012 (2012)Google Scholar
  11. 11.
    Texas Advanced Computing Center: Stampede, http://www.tacc.utexas.edu/stampede
  12. 12.
    The Ohio State University: MVAPICH: MPI over InfiniBand, 10GigE/iWARP and RoCE, http://mvapich.cse.ohio-state.edu/index.shtml

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Kazumi Yoshinaga
    • 1
    • 5
  • Yuichi Tsujita
    • 1
    • 5
  • Atsushi Hori
    • 2
    • 5
  • Mikiko Sato
    • 3
    • 5
  • Mitaro Namiki
    • 3
    • 5
  • Yutaka Ishikawa
    • 4
  1. 1.Kinki UniversityJapan
  2. 2.Advanced Institute for Computational ScienceRIKENJapan
  3. 3.Tokyo University of Agriculture and TechnologyJapan
  4. 4.The University of TokyoJapan
  5. 5.JST CRESTJapan

Personalised recommendations