Abstract
Grid computing is becoming the natural way to aggregate and share large sets of heterogeneous resources. However, grid development and acceptance hinge on proving that grids reliably support real applications. A step in this direction is to combine several grid components into a demonstration and testing framework. This paper presents such an integration effort, in which three research prototypes, namely a grid application development toolkit (Ibis), a grid scheduler capable of co-allocating resources (Koala), and a synthetic grid workload generator (GrenchMark), are used to generate and run workloads comprising well-established and new grid applications on our DAS multi-cluster testbed.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
The Standard Performance Evaluation Corporation. SPEC High-Performance Computing benchmarks. [Accessed] March 2006. [Online] http: //www. spec. org/.
Transaction Processing Performance Council. TPC transaction processing and database benchmarks. [Accessed] March 2006. [Online] http://www.tpc.org/.
Henri E. Bal et al. The distributed ASCI supercomputer project. Operating Systems Review, 34(4):76–96, October 2000.
F. Berman, A. Hey, and G. Fox. Grid Computing: Making The Global Infrastructure a Reality. Wiley Publishing House, 2003. ISBN: 0-470-85319-0.
Anca I. D. Bucur and Dick H. J. Epema. Trace-based simulations of processor co-allocation policies in multiclusters. In HPDC, pages 70–79. IEEE Computer Society, 2003.
Steve J. Chapin, Walfredo Cirne, Dror G. Feitelson, James Patton Jones, Scott T. Leutenegger, Uwe Schwiegelshohn, Warren Smith, and David Talby. Benchmarks and standards for the evaluation of parallel job schedulers. In Dror G. Feitelson and Larry Rudolph, editors, JSSPP, volume 1659 of Lecture Notes in Computer Science, pages 67–90. Springer, 1999.
G. Chun, H. Dail, H. Casanova, and A. Snavely. Benchmark probes for grid assessment. In IPDPS. IEEE Computer Society, 2004.
Alexandre Denis, Olivier Aumage, Rutger F. H. Hofman, Kees Verstoep, Thilo Kielmann, and Henri E. Bal. Wide-area communication for grids: An integrated solution to connectivity, performance and security problems. In HPDC, pages 97–106. IEEE Computer Society, 2004.
Carsten Ernemann, Baiyi Song, and Ramin Yahyapour. Scaling of workload traces. In Dror G. Feitelson, Larry Rudolph, and Uwe Schwiegelshohn, editors, JSSPP, volume 2862 of Lecture Notes in Computer Science, pages 166–182. Springer, 2003.
D. Barberis et al. Common use cases for a high-energy physics common application layer for analysis. Report LHC-SC2-20-2002, LHC Grid Computing Project, October 2003.
Dror G. Feitelson and Larry Rudolph. Metrics and benchmarking for parallel job scheduling. In Dror G. Feitelson and Larry Rudolph, editors, JSSPP, volume 1459 of Lecture Notes in Computer Science, pages 1–24. Springer, 1998.
Ian Foster, Carl Kesselman, and Steve Tuecke. The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of Supercomputing Applications, 15(3), 2002.
Michael Frumkin and Rob F. Van der Wijngaart. Nas grid benchmarks: A tool for grid space exploration. Cluster Computing, 5(3):247–255, 2002.
Vladimir Getov and Thilo Kielmann, editors. Component Models and Systems for Grid Applications, volume 1 of CoreGRID series. Springer Verlag, June 2004. Proceedings of the Workshop on Component Models and Systems for Grid Applications held June 26, 2004 in Saint Malo, France.
M. Humphrey et al. State and events for web services: A comparison of five WS-Resource Framework and WS-Notification implementations. In Proc. of the 14th IEEE HPDC, Research Triangle Park, NC, USA, July 2005.
Uri Lublin and Dror G. Feitelson. The workload on parallel supercomputers: Modeling the characteristics of rigid jobs. Journal of Parallel & Distributed Computing, 63(11):1105–1122, Nov 2003.
H.H. Mohamed and D.H.J. Epema. Experiences with the koala co-allocating scheduler in multiclusters. In Proc. of the 5th IEEE/ACM Int’l Symp. on Cluster Computing and the GRID (CCGrid2005), Cardiff, UK, May 2005.
Warren Smith, Ian T. Foster, and Valerie E. Taylor. Predicting application run times with historical information. J. Parallel Distrib. Comput., 64(9): 1007–1016, 2004.
Allan Snavely, Greg Chun, Henri Casanova, Rob F. Van der Wijngaart, and Michael A. Frumkin. Benchmarks for grid computing: a review of ongoing efforts and future directions. SIGMETRICS Perform. Eval. Rev., 30(4):27–32, 2003.
Douglas Thain and Miron Livny. Error scope on a computational grid: Theory and practice. In HPDC, pages 199–208. IEEE Computer Society, 2002.
G. Tsouloupas and M. D. Dikaiakos. GridBench: A workbench for grid benchmarking. In P. M. A. Sloot, A. G. Hoekstra, T. Priol, A. Reinefeld, and M. Bubak, editors, EGC, volume 3470 of Lecture Notes in Computer Science, pages 211–225. Springer, 2005.
Rob V. van Nieuwpoort, J. Maassen, G. Wrzesinska, R. Hofman, C. Jacobs, T. Kielmann, and H. E. Bal. Ibis: a flexible and efficient java-based grid programming environment. Concurrency & Computation: Practice & Experience., 17(7–8): 1079–1107, June–July 2005.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Iosup, A., Epema, D.H.J., Maassen, J., van Nieuwpoort, R. (2007). Synthetic Grid Workloads with Ibis, Koala, and Grenchmark. In: Gorlatch, S., Danelutto, M. (eds) Integrated Research in GRID Computing. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-47658-2_20
Download citation
DOI: https://doi.org/10.1007/978-0-387-47658-2_20
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-47656-8
Online ISBN: 978-0-387-47658-2
eBook Packages: Computer ScienceComputer Science (R0)