Application benchmarks can play a key role in analyzing and predicting the performance and scalability of Grid applications, serve as an evaluation of the fitness of a collection of Grid resources for running a specific application or class of applications [27], and help in implementing performance-aware resource allocation policies of real time job schedulers. However, application benchmarks have been largely ignored due to diversified types of applications, multi-constrained executions, dynamic Grid behavior and heavy computational costs. To remedy these, we present the GrapBench (Grid Application Benchmarks) system. GrapBench computes theGrapBenchmarks for Grid applications which are flexible regarding variations in problem-size of the application and machine-size of the Grid-site. GrapBench dynamically controls the number of benchmarking experiments for individual applications, and manages the execution of these experiments on different Grid-sites in an easy and flexible way. We also present results from the prototype implementation of our proposed system to show the effectiveness of our approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Globus toolkit. http://www.globus.org/.
Grid benchmarking group, global grid forum. http://forge.gridforum.org/projects/gb-rg (Accessed 2005).
Spec benchmarks. http://www.spec.org/.
E. Afgan, V. Velusamy, and P. V. Bangalore. Grid resource broker using application benchmarking. In EGC, pages 691-701, 2005.
R. H. Arpaci-Dusseau, A. C. Arpaci-Dusseau, A. Vahdat, L. T. Liu, T. E. Anderson, and D. A. Patterson. The interaction of parallel and sequential workloads on a network of workstations. In SIGMETRICS, pages 267-278, 1995.
D. H. Bailey, E. Barszcz, J. T. Barton, D. S. Browning, R. L. Carter, D. Dagum, R. A. Fatoohi, P. O. Frederickson, T. A. Lasinski, R. S. Schreiber, H. D. Simon, V. Venkatakr-ishnan, and S. K. Weeratunga. The nas parallel benchmarks. The International Journal of Supercomputer Applications, 5(3):63-73, 1991.
P. Blaha, K. Schwarz, G. Madsen, D. Kvasnicka, and J. Luitz. WIEN2k: An Augmented Plane Wave plus Local Orbitals Program for Calculating Crystal Properties. Institute of Physical and Theoretical Chemistry, TU Vienna, 2001.
M. De Roure, D. Surridge. Interoperability challenges in grid for industrial applications. In In Proceedings of GGF9 Semantic Grid Workshop, Chicago IL, USA, May 2003.
R. F. V. der Wijngaart and M. A. Frumkin. Evaluating the information power grid using the nas grid benchmarks. In IPDPS, 2004.
M. D. Dikaiakos. Grid benchmarking: vision, challenges, and current status: Research articles. Concurr. Comput. : Pract. Exper., 19(1):89-105, 2007.
T. Fahringer and R. P. et. al. ASKALON: A Grid Application Development and Computing Environment. In 6th International Workshop on Grid Computing (Grid 2005), Seattle, USA, Nov 2005.
I. Foster and C. Kesselman. The Grid Blueprint for a New Computing Infrastructure. San Francisco CA, USA, 2004.
E. Heymann, A. Fern ández, M. A. Senar, and J. Salt. The eu-crossgrid approach for grid application scheduling. In European Across Grids Conference, pages 17-24, 2003.
A. Iosup and D. H. J. Epema. Grenchmark: A framework for analyzing, testing, and comparing grids. In CCGRID, pages 313-320, 2006.
H. H. Mohamed and D. H. J. Epema. Experiences with the koala co-allocating scheduler in multiclusters. In CCGRID, pages 784-791, 2005.
F. Nadeem, M. M. Yousaf, R. Prodan, and T. Fahringer. Soft benchmarks-based application performance prediction using a minimum training set. In E-SCIENCE ’06: Proceedings of the Second IEEE International Conference on e-Science and Grid Computing, page 71, Amsterdam, Netherlands, December 2006.
Netlib. http://www.netlib.org/linpack/.
G. R. Nudd and S. A. Jarvis. Performance-based middleware for grid computing: Research articles. Concurr. Comput. : Pract. Exper., 17(2-4):215-234, 2005.
X. D. W. Rob Allan and A. Richards. Xml schema for hpc applications and resources. Grid Technology Group. Daresbury Laboratory (2002).
J. Q. Schueller Felix and F. Nadeem. Performance, Scalability and Quality of the Meteo- rological Grid Workflow MeteoAG. In 2nd Austrian Grid Symposium, Innsbruck, Austria, Sep 2006.
U. Schwiegelshohn and R. Yahyapour. Fairness in parallel job scheduling. Journal of Scheduling, 3(5):297-320, 2000.
M. I. Seltzer, D. Krinsky, K. A. Smith, and X. Zhang. The case for application-specific benchmarking. In Workshop on Hot Topics in Operating Systems, pages 102-, 1999.
M. Siddiqui, A. Villazon, J. Hofer, and T. Fahringer. Glare: A grid activity registration, deployment and provisioning framework. In SC ’05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing, page 52, Washington, DC, USA, 2005.
D. Theiner and M. Wieczorek. Reduction of calibration time of distributed hydrological models by use of grid computing and nonlinear optimisation algorithms. In Proceedings of the 7th International Conference on Hydroinformatics (HIC 2006), Sep. 2006.
A. Tiramo-Ramos, G. Tsouloupas, M. Dikaiakos, and P. M. A. Sloot. Grid resource selection by application benchmarking: a computational haemodynamics case study. In Computational Science - ICCS 2005, 5th International Conference Atlanta, GA, USA, May 22-25, 2005, Proceedings, Part I., volume 3514, pages 534-543, Atlanta, Georgia, USA, May 2005.
G. Tsouloupas and M. D. Dikaiakos. Gridbench: A tool for benchmarking grids. Grid Computing, page 60, 2003.
J. Weinberg and A. Snavely. Symbiotic space-sharing on sdsc’s datastar system. In JSSPP, pages 192-209, 2006.
R. Wolski, N. T. Spring, and J. Hayes. The network weather service: a distributed resource performance forecasting service for metacomputing. Future Generation Computer Sys-tems, 15(5-6):757-768, 1999.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Nadeem, F., Prodan, R., Fahringer, T., Iosup, A. (2008). Benchmarking Grid Applications. In: Grid Middleware and Services. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-78446-5_2
Download citation
DOI: https://doi.org/10.1007/978-0-387-78446-5_2
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-78445-8
Online ISBN: 978-0-387-78446-5
eBook Packages: Computer ScienceComputer Science (R0)