Abstract
Grid applications are increasingly being developed as workflows using well-structured, reusable components. We argue that components with well-defined semantics facilitate an efficient scheduling on the Grid. We have previously developed a user-transparent scheduling approach for Higher-Order Components (HOCs) – parallel implementations of typical programming patterns, accessible and customizable via Web services. Our approach combines three scheduling techniques: using cost functions for reducing communication overhead, reusability of schedules for similar workflows, and the aggregated submission of jobs. We analyze the user-transparent scheduling from four perspectives, namely: the easiness of integration within already existing Grid scheduling systems, the gains for individual users, the resource provider advantages, and the robustness with respect to execution failures. We perform our evaluation using the KOALA Grid scheduler extended to support our user-transparent scheduling, which we run on the DAS-2 system combining over 200 nodes at five sites in the Netherlands. The experimental results show an increase in throughput by more than 100%, a descreasing of the response time by 50%, and a failure reduction by 45% for the considered scenarios
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
A. Benoit and M. Aldinucci. Towards the Automatic Mapping of ASSIST Applications for the Grid. In Proceedings of CoreGRID Integration Workshop, University of Pisa, Italy, Nov. 2005.
A. Benoit, M. Cole, S. Gilmore, and J. Hillston. Evaluating the performance of pipeline-structured parallel programs with skeletons and process algebra. PAPP Workshop, 2005.
A. I. D. Bucur and D. H. Epema. The influence of communication on the performance of co-allocation. In Workshop on Job Scheduling and Parallel Processing, pages 66–86, London, 2001. Springer.
R. Buyya, D. Abramson, and J. Giddy. An economy driven resource management architecture for computational power grids. In Parallel and Distributed Processing, 2000.
A. Dan, C. Dumitrescu, K. Ranganathan, and M. Ripeanu. A Layered Framework for Connecting Client Objectives and Resource Capabilities. International Journal of Cooperative Communication Systems, 2006.
E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, S. Patil, M.-H. Su, K. Vahi, and M. Livny. Pegasus : Mapping scientific workflows onto the grid. In 2nd EUROPEAN ACROSS GRIDS CONFERENCE, Nicosia, Cyprus, 2004.
C. Dumitrescu, D. H. Epema, J. Dünnweber, and S. Gorlatch. User Transparent Scheduling of Structured Parallel Applications in Grid Environments. In HPC-GECO/CompFrame Workshop held in Conjunction with HPDC’06, 2006.
C. Dumitrescu, D. H. Epema, J. Dünnweber, and S. Gorlatch. Reusable Cost-based Scheduling of Grid Workflows Operating on Higher-Order Components. Technical Report TR-0044, CoreGRID - Network of Excellence, 2006.
C. Dumitrescu and I. Foster. GRUBER: A Grid Resource Usage SLA BrokER. In Proc. of 11th International Euro-Par Conference (Euro-Par’05), Portugal, 2005.
C. Dumitrescu, I. Raicu, and I. Foster. Experiences in running workloads over Grid3. In Grid and Cooperative Computing (GCC), 2005.
C. Dumitrescu, I. Raicu, and I. Foster. DI-GRUBER: A Distributed Approach for Resource Brokering. In Proc. of SuperComputing Conference, Seattle, USA, 2006.
C. Dumitrescu, M. Wilde, and I. Foster. A Model for Usage Policy-based Resource Allocation in Grids. In Policies for Distributed Systems and Networks, 2005. Sixth IEEE International Workshop on Policy, pages 191 – 200, June 2005.
J. Dünnweber, S. Gorlatch, A. Benoit, and M. Cole. Integrating MPI-Skeletons with Web services. In Proceedings of the International Conference on Parallel Computing, Malaga, Spain, September 2005.
J. Dünnweber, S. Gorlatch, S. Campa, M. Danelutto, and M. Aldinucci. Using code parameters for component adaptations. In CoreGRID Integration Workshop, Pisa, Italy, November 2005.
Dutch University Backbone. The distributed ASCI supercomputer 2 (DAS-2), 2006.
S. Gorlatch and J. Dünnweber. From Grid Middleware to Grid Applications: Bridging the Gap with HOCs. In Future Generation Grids. Springer Verlag, 2005.
M. Humphrey, G. Wasson, J. Gawor, J. Bester, S. Lang, I. Foster, S. Pickles, M. M. Keown, K. Jackson, J. Boverhof, M. Rodriguez, and S. Meder. State and events for Web services: A comparison of five WS-resource framework and WS-notification implementations. In 14th IEEE International Symposium on High Performance Distributed Computing (HPDC-14), 2005.
A. Iosup, D. H. Epema, C. Franke, A. Papaspyrou, L. Schley, B. Song, and R. Yahyapour. On Grid performance evaluation using synthetic workloads. In The 12th Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP), Saint Malo, FR, June 2006.
A. Iosup and D. H. Epema. GrenchMark: A framework for analyzing, testing, and comparing grids. In 6th IEEE/ACM Int’l Symposium on Cluster Computing and the Grid (CCGrid), 2006.
A. Mayer, S. McGough, and N. Furmento. ICENI: Optimisation of component applications within a grid environment. In Parallel Computing Amsterdam, 2002.
H. Mohamed and D. H. Epema. The design and implementation of the KOALA co-allocating grid scheduler. In .-. LNCS 3470, editor, Proceedings of the European Grid Conference, Amsterdam, 2005.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Dumitrescu, C.L., Dünnweber, J., Gorlatch, S., Epema, D.H. (2008). User-Transparent Scheduling for Software Components on the Grid. In: Gorlatch, S., Bubak, M., Priol, T. (eds) Achievements in European Research on Grid Systems. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-72812-4_4
Download citation
DOI: https://doi.org/10.1007/978-0-387-72812-4_4
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-72811-7
Online ISBN: 978-0-387-72812-4
eBook Packages: Computer ScienceComputer Science (R0)