Abstract
Symbolic cost models are an important performance engineering tool because of their diagnostic value and their very low solution cost when the computation features regularity. However, especially for parallel applications their derivation, including the symbolic simplifications essential for low solution cost, is an effort-intensive and error-prone process. We present a tool that automatically compiles process-oriented performance simulation models into symbolic cost models that are symbolically simplified to achieve extremely low solution cost. As the simulation models are intuitively close to the parallel program and machine under study, derivation effort is significantly reduced. Apart from its use as a stand-alone tool, the compiler is also used within a symbolic cost estimator for data-parallel programs. With minimal program annotation by the user, symbolic cost models are automatically generated in a matter of seconds, while the evaluation time of the models ranges in the milliseconds. Experimental results on four data-parallel programs show that the average prediction error is less than 15 %. Apart from providing program scalability assessment, the models correctly predict the best design alternative in all cases.
Chapter PDF
References
V.S. Adve, Analyzing the Behavior and Performance of Parallel Programs. PhD thesis, University of Wisconsin, Madison, WI, Dec. 1993. Tech. Rep. #1201.
M. Ajmone Marsan, G. Balbo and G. Conte, “A class of Generalized Stochastic Petri Nets for the performance analysis of multiprocessor systems,” ACM TrCS, vol. 2, 1984, pp. 93–122.
H. Bal et al., “The distributed ASCI supercomputer project,” Operating Systems Review, vol. 34, Oct. 2000, pp. 76–96.
D. Culler, R. Karp, D. Patterson, A. Sahay, K.E. Schauser, E. Santos, R. Subramonian and T. von Eicken, “LogP: Towards a realistic model of parallel computation,” in Proc. 4th ACM SIGPLAN Symposium on PPoPP, May 1993, pp. 1–12.
T. Fahringer, “Estimating and optimizing performance for parallel programs,” IEEE Computer, Nov. 1995, pp. 47–56.
H. Gautama and A.J.C. van Gemund, “Static performance prediction of data-dependent programs,” in ACM Proc. on The Second International Workshop on Software and Performance (WOSP’00), Ottawa, ACM, Sept. 2000, pp. 216–226.
A.J.C. van Gemund, “Performance prediction of parallel processing systems: The Pamela methodology,” in Proc. 7th ACM Int’l Conf. on Supercomputing, Tokyo, 1993, pp. 318–327.
A.J.C. van Gemund, Performance Modeling of Parallel Systems. PhD thesis, Delft University of Technology, The Netherlands, Apr. 1996.
A.J.C. van Gemund, “Automatic cost estimation of data parallel programs,” Tech. Rep. 1-68340-44(2001)09, Delft University of Technology, The Netherlands, Oct. 2001.
N. Götz, U. Herzog and M. Rettelbach, “Multiprocessor and distributed system design: The integration of functional specification and performance analysis using stochastic process algebras,” in Proc. SIGMETRICS/PERFORMANCE’93, LNCS 729, Springer, 1993.
H. Jonkers, A.J.C. van Gemund and G.L. Reijns, “A probabilistic approach to parallel system performance modelling,” in Proc. 28th HICSS, Vol. II, IEEE, Jan. 1995, pp. 412–421.
C.L. Mendes and D.A. Reed, “Integrated compilation and scalability analysis for parallel systems,” in Proc. PACT’ 98, Paris, Oct. 1998, pp. 385–392.
H. Schwetman, “Object-oriented simulation modeling with C++/CSIM17,” in Proc. 1995 Winter Simulation Conference, 1995.
L. Valiant,“A bridging model for parallel computation,” CACM, vol. 33, 1990, pp. 103–111.
C. van Reeuwijk, A.J.C. van Gemund and H.J. Sips, “Spar: A programming language for semi-automatic compilation of parallel programs,” Concurrency: Practice and Experience, vol. 9, Nov. 1997, pp. 1193–1205.
K-Y. Wang, “Precise compile-time performance prediction for superscalar-based computers,” in Proc. ACM SIGPLAN PLDI’94, Orlando, June 1994, pp. 73–84.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
van Gemund, A.J.C. (2002). Symbolic Cost Estimation of Parallel Applications. In: Monien, B., Feldmann, R. (eds) Euro-Par 2002 Parallel Processing. Euro-Par 2002. Lecture Notes in Computer Science, vol 2400. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45706-2_18
Download citation
DOI: https://doi.org/10.1007/3-540-45706-2_18
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44049-9
Online ISBN: 978-3-540-45706-0
eBook Packages: Springer Book Archive