Performance Expectations and Guidelines for MPI Derived Datatypes
MPI’s derived datatypes provide a powerful mechanism for concisely describing arbitrary, noncontiguous layouts of user data for use in MPI communication. This paper formulates self-consistent performance guidelines for derived datatypes. Such guidelines make performance expectations for derived datatypes explicit and suggest relevant optimizations to MPI implementers. We also identify self-consistent guidelines that are too strict to enforce, because they entail NP-hard optimization problems. Enforced self-consistent guidelines assure the user that certain manual datatype optimizations cannot lead to performance improvements, which in turn contributes to performance portability between MPI implementations that behave in accordance with the guidelines. We present results of tests with several MPI implementations, which indicate that many of them violate the guidelines.
KeywordsPerformance Expectation Performance Portability Type Constructor Communication Operation Performance Guideline
Unable to display preview. Download preview PDF.
- 1.Bajrović, E., Träff, J.L.: Using MPI derived datatypes in numerical libraries. In: Cotronis, Y., et al. (eds.) EuroMPI 2011. LNCS, vol. 6960, pp. 29–38. Springer, Heidelberg (2011)Google Scholar
- 4.Gropp, W.D., Lusk, E., Swider, D.: Improving the performance of MPI derived datatypes. In: Proceedings of the Third MPI Developer’s and User’s Conference, pp. 25–30. MPI Software Technology Press (1999)Google Scholar
- 6.Lu, Q., Wu, J., Panda, D.K., Sadayappan, P.: Applying MPI derived datatypes to the NAS benchmarks: A case study. In: 33rd International Conference on Parallel Processing Workshops (ICPP 2004 Workshops), pp. 538–545. IEEE Computer Society, Los Alamitos (2004)Google Scholar
- 7.MPI Forum: MPI: A Message-Passing Interface Standard. Version 2.2 ( September 4, 2009), http://www.mpi-forum.org
- 10.Santhanaraman, G., Wu, J., Huang, W., Panda, D.K.: Designing zero-copy message passing interface derived datatype communication over Infiniband: Alternative approaches and performance evaluation. International Journal on High Performance Computing Applications 19(2), 129–142 (2005)CrossRefGoogle Scholar