Chapter

Job Scheduling Strategies for Parallel Processing

Volume 5798 of the series Lecture Notes in Computer Science pp 138-156

Effects of Topology-Aware Allocation Policies on Scheduling Performance

  • Jose Antonio PascualAffiliated withThe University of the Basque Country
  • , Javier NavaridasAffiliated withThe University of the Basque Country
  • , Jose Miguel-AlonsoAffiliated withThe University of the Basque Country

* Final gross prices may vary according to local VAT.

Get Access

Abstract

This paper studies the influence that job placement may have on scheduling performance, in the context of massively parallel computing systems. A simulation-based performance study is carried out, using workloads extracted from real systems logs. The starting point is a parallel system built around a k-ary n-tree network and using well-known scheduling algorithms (FCFS and backfilling). We incorporate an allocation policy that tries to assign to each job a contiguous network partition, in order to improve communication performance. This policy results in severe scheduling inefficiency due to increased system fragmentation. A relaxed version of it, which we call quasi-contiguous allocation, reduces this adverse effect. Experiments show that, in those cases where the exploitation of communication locality results in an effective reduction of application execution time, the achieved gains more than compensate the scheduling inefficiency, therefore resulting in better overall performance.