Core Algorithms of the Maui Scheduler

  • David Jackson
  • Quinn Snell
  • Mark Clement
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2221)

Abstract

The Maui scheduler has received wide acceptance in the HPC community as a highly configurable and effective batch scheduler. It is currently in use on hundreds of SP, O2K, and Linux cluster systems throughout the world including a high percentage of the largest and most cutting edge research sites. While the algorithms used within Maui have proven themselves effective, nothing has been published to date documenting these algorithms nor the configurable aspects they support. This paper focuses on three areas of Maui scheduling, specifically, backfill, job prioritization, and fairshare. It briefly discusses the goals of each component, the issues and corresponding design decisions, and the algorithms enabling the Maui policies. It also covers the configurable aspects of each algorithm and the impact of various parameter selections.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    D. Jackson. The Maui Scheduler. Technical report. http://supercluster.org/projects/maui.
  2. 2.
    J.S. Skovira, W. Chen, and H. Zhou. The EASY-LoadLeveler API Project. Job Scheduling Strategies for Parallel Processing, Lecture Notes in Computer Science 1162, pages 41–47, 1996.CrossRefGoogle Scholar
  3. 3.
    R.L. Henderson. Job scheduling under the Portable Batch System. Job Scheduling Strategies for Parallel Processing, Lecture Notes in Computer Science, 949, 1995.Google Scholar
  4. 4.
    J.M. Barton and N. Bitar. A scalable multi-discipline multiple processor scheduling framework for IRIX. Job Scheduling Strategies for Parallel Processing, Lecture Notes in Computer Science, 949, 1995.Google Scholar
  5. 5.
    D. Jackson. HPC workload repository. Technical report. http://www.supercluster.org/research/traces.
  6. 6.
    D. Feitelson and A. Mu’alem Weil. Utilization and predicability in scheduling the IBM SP2 with backfilling. In Proceedings of IPPS/SPDP, April 1998.Google Scholar
  7. 7.
    Q. Snell, M. Clement, D. Jackson, and C. Gregory. The performance impact of advance reservation metascheduling. Lecture Notes in Computer Science:Job Scheduling Strategiew for Parallel Processing, 1911, 2000.CrossRefGoogle Scholar
  8. 8.
    John Jardine. Avoiding livelock using the Y Metascheduler and exponential backo off Master’s thesis, Brigham Young University, 2000.Google Scholar
  9. 9.
    D. Jackson, Q. Snell, and M. Clement. Simulation based HPC workload analysis. In International Parallel and Distributed Processing Symposium, 2001.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • David Jackson
    • 1
  • Quinn Snell
    • 1
  • Mark Clement
    • 1
  1. 1.Brigham Young UniversityProvo

Personalised recommendations