Benchmark Based on Application Signature to Analyze and Predict Their Behavior
- 268 Downloads
Currently, there are benchmark sets that measure the performance of HPC systems under specific computing and communication properties. These benchmarks represent the kernels of applications that measure specific hardware components. If the user’s application is not represented by any benchmark, it is not possible to obtain an equivalent performance metric. In this work, we propose a benchmark based on the signature of an MPI application obtained by the PAS2P method. PAS2P creates the application signature in order to predict the execution time, which we believe will be very adjusted in relation to the execution time of the full application. The signature has two performance qualities: the bounded time to execute it (a benchmark property) and the quality of prediction. Therefore, we propose to extend the signature by giving the benchmark capacities such as the efficiency of the application over the HPC system. The performance metrics will be performed by the benchmark proposed. The experimentation validates our proposal with an average error of prediction close to 7%.
KeywordsHigh Performance Computing MPI application Performance Prediction Performance metrics
This research has been supported by the Agencia Estatal de Investigación (AEI), Spain and the Fondo Europeo de Desarrollo Regional (FEDER) UE, under contract TIN2017-84875-P and partially funded by a research collaboration agreement with the Fundacion Escuelas Universitarias Gimbernat (EUG).
- 1.Adams, M., Brown, J., Shalf, J., Van Straalen, B., Strohmaier, E., Williams, S.: HPGMG 1.0: a benchmark for ranking high performance computing systems. Technical report, Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA, United States (2014)Google Scholar
- 5.Heroux, M.A., et al.: Improving performance via mini-applications. Sandia National Laboratories, Technical report SAND2009-5574, 3 (2009)Google Scholar
- 6.Heroux, M.A., Dongarra, J.: Toward a new metric for ranking high performance computing systems. Sandia National Laboratories Report, SAND2013-4744 (2013)Google Scholar
- 9.McCalpin, J., Oakland, C.A.: An industry perspective on performance characterization: applications vs benchmarks. In: Proceedings of the Third Annual IEEE Workshop Workload Characterization, Keynote Address, September 2000Google Scholar
- 10.Meuer, H., Strohmaier, E., Dongarra, J., Simon, H., Meuer, M.: Top 500 list (2012)Google Scholar