Measuring Execution Times of Collective Communications in an Empirical Optimization Framework

  • Katharina Benkert
  • Edgar Gabriel
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6305)


An essential part of an empirical optimization library are the timing procedures with which the performance of different codelets is determined. In this paper, we present for four different timing methods to optimize collective MPI communications and compare their accuracy for the FFT NAS Parallel Benchmarks on a variety of systems with different MPI implementations. We find that timing larger code portions with infrequent synchronizations performs well on all systems.


Empirical Optimization Abstract Data and Communication Library (ADCL) Collective Communication NAS Parallel Benchmark 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Whaley, R.C., Petite, A.: Minimizing development and maintenance costs in supporting persistently optimized BLAS. Software: Practice and Experience 35(2), 101–121 (2005)CrossRefGoogle Scholar
  2. 2.
    Frigo, M., Johnson, S.G.: The Design and Implementation of FFTW3. Proceedings of IEEE 93(2), 216–231 (2005)CrossRefGoogle Scholar
  3. 3.
    Bilmes, J., Asanovic, K., Chin, C., Demmel, J.: Optimizing matrix multiply using PHIPAC: a Portable, High-Performance, ANSI C coding methodology. In: Proceedings of the International Conference on Supercomputing, Vienna, Austra (July 1997)Google Scholar
  4. 4.
    Faraj, A., Yuan, X., Lowenthal, D.: STAR-MPI: self tuned adaptive routines for MPI collective operations. In: ICS 2006: Proceedings of the 20th Annual International Conference on Supercomputing, pp. 199–208. ACM Press, New York (2006)CrossRefGoogle Scholar
  5. 5.
    Gabriel, E., Feki, S., Benkert, K., Resch, M.M.: Towards Performance Portability through Runtime Adaption for High Performance Computing Applications. Concurrency and Computation — Practice and Experience (2010) (accepted for publication)Google Scholar
  6. 6.
    Benkert, K., Gabriel, E., Resch, M.M.: Outlier Detection in Performance Data of Parallel Applications. In: 9th IEEE International Workshop on Parallel and Distributed Scientific and Engineering Computing (2008)Google Scholar
  7. 7.
    Bailey, D., Barszcz, E., Barton, J., Browning, D., Carter, R., Dagum, L., Fatoohi, R., Fineberg, S., Frederickson, P., Lasinski, T., Schreiber, R., Simon, H., Venkatakrishnan, V., Weeratunga, S.: The NAS Parallel Benchmarks (1994)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Katharina Benkert
    • 1
  • Edgar Gabriel
    • 2
  1. 1.High Performance Computing Center Stuttgart (HLRS)University of StuttgartStuttgartGermany
  2. 2.Parallel Software Technologies Laboratory, Department of Computer ScienceUniversity of HoustonHoustonUSA

Personalised recommendations