Advertisement

Hybrid Parallel Programming on SMP Clusters Using XPFortran and OpenMP

  • Yuanyuan Zhang
  • Hidetoshi Iwashita
  • Kuninori Ishii
  • Masanori Kaneko
  • Tomotake Nakamura
  • Kohichiro Hotta
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6132)

Abstract

Process-thread hybrid programming paradigm is commonly employed in SMP clusters. XPFortran, a parallel programming language that specifies a set of compiler directives and library routines, can be used to realize process-level parallelism in distributed memory systems. In this paper, we introduce hybrid parallel programming by XPFortran to SMP clusters, in which thread-level parallelism is realized by OpenMP. We present the language support and compiler implementation of OpenMP directives in XPFortran, and show some of our experiences in XPFortran-OpenMP hybrid programming. For nested loops parallelized by process-thread hybrid programming, it’s common sense to use process parallelization for outer loops and thread parallelization for inner ones. However, we have found that in some cases it’s possible to write XPFortran-OpenMP hybrid program in a reverse way, i.e., OpenMP outside, XPFortran inside. Our evaluation results show that this programming style sometimes delivers better performance than the traditional one. We therefore recommend using the hybrid parallelization flexibly.

Keywords

Nest Loop Hybrid Programming Fortran Compiler Process Parallelization High Performance Fortran 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Co-Array Fortran, http://www.co-array.org/
  2. 2.
  3. 3.
  4. 4.
    Message Passing Interface Forum. MPI: A message-passing interface standard, http://www.mpi-forum.org/
  5. 5.
  6. 6.
    Iwashita, H., Aoki, M.: Mapping Normalization Technique on the HPF Compiler fhpf. In: Labarta, J., Joe, K., Sato, T. (eds.) ISHPC 2005 and ALPS 2006. LNCS, vol. 4759, pp. 315–329. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  7. 7.
    Iwashita, H., Sueyasu, N., Kamiya, S., van Waveren, M.: VPP Fortran and the Design of HPF/JA Extensions. In: Concurrency and Computation: Practice and Experience, vol. 14(8-9), pp. 575–588. John Wiley &Sons Ltd., Chichester (2002)Google Scholar
  8. 8.
    Iwashita, H., Aoki, M.: A Code Generation Technique Common to Distribution Kinds on the HPF Translator. IPSJ Transactions on Advanced Computing Systems (ACS) 0(15), 329–339 (2006) (in Japanese) Google Scholar
  9. 9.
    Rabenseifner, R., Hager, G., Jost, G.: Hybrid MPI/OpenMP Parallel Programming on Clusters of Multi-Core SMP Nodes. In: Proc. of the 2009 17th Euromicro International Conference on Parallel, Distributed and Network-based Processing, pp. 427–436 (2009)Google Scholar
  10. 10.
    Benkner, S., Sipkova, V.: Language and Compiler Support for Hybrid-Parallel Programming on SMP Clusters. In: Zima, H.P., Joe, K., Sato, M., Seo, Y., Shimasaki, M. (eds.) ISHPC 2002. LNCS, vol. 2327, pp. 11–24. Springer, Heidelberg (2002)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Yuanyuan Zhang
    • 1
  • Hidetoshi Iwashita
    • 1
  • Kuninori Ishii
    • 1
  • Masanori Kaneko
    • 1
  • Tomotake Nakamura
    • 1
  • Kohichiro Hotta
    • 1
  1. 1.Software Development Division, Next Generation Technical Computing UnitFujitsu LimitedKawasakiJapan

Personalised recommendations