Advertisement

User-Transparent Scheduling for Software Components on the Grid

  • Câtâlin L. Dumitrescu
  • Jan Dünnweber
  • Sergei Gorlatch
  • Dick H.J. Epema

Abstract

Grid applications are increasingly being developed as workflows using well-structured, reusable components. We argue that components with well-defined semantics facilitate an efficient scheduling on the Grid. We have previously developed a user-transparent scheduling approach for Higher-Order Components (HOCs) – parallel implementations of typical programming patterns, accessible and customizable via Web services. Our approach combines three scheduling techniques: using cost functions for reducing communication overhead, reusability of schedules for similar workflows, and the aggregated submission of jobs. We analyze the user-transparent scheduling from four perspectives, namely: the easiness of integration within already existing Grid scheduling systems, the gains for individual users, the resource provider advantages, and the robustness with respect to execution failures. We perform our evaluation using the KOALA Grid scheduler extended to support our user-transparent scheduling, which we run on the DAS-2 system combining over 200 nodes at five sites in the Netherlands. The experimental results show an increase in throughput by more than 100%, a descreasing of the response time by 50%, and a failure reduction by 45% for the considered scenarios

Keywords

User-Transparent Scheduling Co-Allocation Component Technology Higher-Order Components 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    A. Benoit and M. Aldinucci. Towards the Automatic Mapping of ASSIST Applications for the Grid. In Proceedings of CoreGRID Integration Workshop, University of Pisa, Italy, Nov. 2005.Google Scholar
  2. [2]
    A. Benoit, M. Cole, S. Gilmore, and J. Hillston. Evaluating the performance of pipeline-structured parallel programs with skeletons and process algebra. PAPP Workshop, 2005.Google Scholar
  3. [3]
    A. I. D. Bucur and D. H. Epema. The influence of communication on the performance of co-allocation. In Workshop on Job Scheduling and Parallel Processing, pages 66–86, London, 2001. Springer.Google Scholar
  4. [4]
    R. Buyya, D. Abramson, and J. Giddy. An economy driven resource management architecture for computational power grids. In Parallel and Distributed Processing, 2000.Google Scholar
  5. [5]
    A. Dan, C. Dumitrescu, K. Ranganathan, and M. Ripeanu. A Layered Framework for Connecting Client Objectives and Resource Capabilities. International Journal of Cooperative Communication Systems, 2006.Google Scholar
  6. [6]
    E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, S. Patil, M.-H. Su, K. Vahi, and M. Livny. Pegasus : Mapping scientific workflows onto the grid. In 2nd EUROPEAN ACROSS GRIDS CONFERENCE, Nicosia, Cyprus, 2004.Google Scholar
  7. [7]
    C. Dumitrescu, D. H. Epema, J. Dünnweber, and S. Gorlatch. User Transparent Scheduling of Structured Parallel Applications in Grid Environments. In HPC-GECO/CompFrame Workshop held in Conjunction with HPDC’06, 2006.Google Scholar
  8. [8]
    C. Dumitrescu, D. H. Epema, J. Dünnweber, and S. Gorlatch. Reusable Cost-based Scheduling of Grid Workflows Operating on Higher-Order Components. Technical Report TR-0044, CoreGRID - Network of Excellence, 2006.Google Scholar
  9. [9]
    C. Dumitrescu and I. Foster. GRUBER: A Grid Resource Usage SLA BrokER. In Proc. of 11th International Euro-Par Conference (Euro-Par’05), Portugal, 2005.Google Scholar
  10. [10]
    C. Dumitrescu, I. Raicu, and I. Foster. Experiences in running workloads over Grid3. In Grid and Cooperative Computing (GCC), 2005.Google Scholar
  11. [11]
    C. Dumitrescu, I. Raicu, and I. Foster. DI-GRUBER: A Distributed Approach for Resource Brokering. In Proc. of SuperComputing Conference, Seattle, USA, 2006.Google Scholar
  12. [12]
    C. Dumitrescu, M. Wilde, and I. Foster. A Model for Usage Policy-based Resource Allocation in Grids. In Policies for Distributed Systems and Networks, 2005. Sixth IEEE International Workshop on Policy, pages 191 – 200, June 2005.Google Scholar
  13. [13]
    J. Dünnweber, S. Gorlatch, A. Benoit, and M. Cole. Integrating MPI-Skeletons with Web services. In Proceedings of the International Conference on Parallel Computing, Malaga, Spain, September 2005.Google Scholar
  14. [14]
    J. Dünnweber, S. Gorlatch, S. Campa, M. Danelutto, and M. Aldinucci. Using code parameters for component adaptations. In CoreGRID Integration Workshop, Pisa, Italy, November 2005.Google Scholar
  15. [15]
    Dutch University Backbone. The distributed ASCI supercomputer 2 (DAS-2), 2006.Google Scholar
  16. [16]
    S. Gorlatch and J. Dünnweber. From Grid Middleware to Grid Applications: Bridging the Gap with HOCs. In Future Generation Grids. Springer Verlag, 2005.Google Scholar
  17. [17]
    M. Humphrey, G. Wasson, J. Gawor, J. Bester, S. Lang, I. Foster, S. Pickles, M. M. Keown, K. Jackson, J. Boverhof, M. Rodriguez, and S. Meder. State and events for Web services: A comparison of five WS-resource framework and WS-notification implementations. In 14th IEEE International Symposium on High Performance Distributed Computing (HPDC-14), 2005.Google Scholar
  18. [18]
    A. Iosup, D. H. Epema, C. Franke, A. Papaspyrou, L. Schley, B. Song, and R. Yahyapour. On Grid performance evaluation using synthetic workloads. In The 12th Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP), Saint Malo, FR, June 2006.Google Scholar
  19. [19]
    A. Iosup and D. H. Epema. GrenchMark: A framework for analyzing, testing, and comparing grids. In 6th IEEE/ACM Int’l Symposium on Cluster Computing and the Grid (CCGrid), 2006.Google Scholar
  20. [20]
    A. Mayer, S. McGough, and N. Furmento. ICENI: Optimisation of component applications within a grid environment. In Parallel Computing Amsterdam, 2002.Google Scholar
  21. [21]
    H. Mohamed and D. H. Epema. The design and implementation of the KOALA co-allocating grid scheduler. In .-. LNCS 3470, editor, Proceedings of the European Grid Conference, Amsterdam, 2005.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2008

Authors and Affiliations

  • Câtâlin L. Dumitrescu
    • 1
  • Jan Dünnweber
    • 2
  • Sergei Gorlatch
    • 3
  • Dick H.J. Epema
    • 4
    • 5
  1. 1.Mathematics and Computer Science DepartmentThe University of MünsterMünsterGermany
  2. 2.CoreGRID Institute on Programming ModelsMünsterGermany
  3. 3.CoreGRID Institute on Resource Management and SchedulingMünsterGermany
  4. 4.Electrical Eng. Mathematics and Computer Science DepartmentTechnical University of DelftNetherlands
  5. 5.CoreGRID Institute on Resource Management and SchedulingNetherlands

Personalised recommendations