Skip to main content

Unfairness Metrics for Space-Sharing Parallel Job Schedulers

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 3834))

Abstract

Sociology, computer networking and operations research provide evidence of the importance of fairness in queuing disciplines. Currently, there is no accepted model for characterizing fairness in parallel job scheduling. We introduce two fairness metrics intended for parallel job schedulers, both of which are based on models from sociology, networking, and operations research. The first metric is motivated by social justice and attempts to measure deviation from arrival order, which is perceived as fair by the end user. The second metric is based on resource equality and compares the resources consumed by a job with the resources deserved by the job. Both of these metrics are orthogonal to traditional metrics, such as turnaround time and utilization.

The proposed fairness metrics are used to measure the unfairness for some typical scheduling policies via simulation studies. We analyze the fairness of these scheduling policies using both metrics, identifying similarities and differences.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Talby, D., Feitelson, D.: Supporting priorities and improving utilization of the IBM SP scheduler using slack-based backfilling. In: Proceedings of the 13th International Parallel Processing Symposium (1999)

    Google Scholar 

  2. Mu’alem, A., Feitelson, D.: Utilization, predictability, workloads, and user runtime estimates in scheduling the IBM SP2 with backfilling. IEEE Transactions on Parallel and Distributed Systems 12, 529–543 (2001)

    Article  Google Scholar 

  3. Sabin, G., Kettimuthu, R., Rajan, A., Sadayappan, P.: Scheduling of parallel jobs in a heterogeneous multi-site environement. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2003. LNCS, vol. 2862, pp. 87–104. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  4. Islam, M., Balaji, P., Sadayappan, P., Panda, D.K.: QoPS: A QoS based scheme for parallel job scheduling. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2003. LNCS, vol. 2862, pp. 252–268. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  5. Feitelson, D.: Workshops on job scheduling strategies for parallel processing, http://www.cs.huji.ac.il/~feit/parsched/

  6. Shmueli, E., Feitelson, D.: Backfilling with lookahead to optimize the performance of parallel job scheduling. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2003. LNCS, vol. 2862, pp. 228–251. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  7. Srinivasan, S., Kettimuthu, R., Subramani, V., Sadayappan, P.: Characterization of backfilling strategies for job scheduling. In: 2002 Intl. Workshops on Parallel Processing (2002); held in conjunction with the 2002 Intl. Conf. on Parallel Processing, ICPP 2002

    Google Scholar 

  8. Raz, D., Levy, H., Avi-Itzhak, B.: A resource-allocation queueing fairness measure. In: Proceedings of Sigmetrics 2004/Performance 2004 Joint Conference on Measurement and Modeling of Computer Systems, New York, NY, pp. 130–141 (2004); Also appears as Performance Evaluation Review Special Issue 32(1), 130–141

    Google Scholar 

  9. Avi-Itzhak, B., Levy, H., Raz, D.: Quantifying fairness in queueing systems: Principles and applications. Technical Report RRR-26-2004, RUTCOR, Rutgers University (2004)

    Google Scholar 

  10. Raz, D., Levy, H., Avi-Itzhak, B.: RAQFM: a resource allocation queueing fairness measure. Technical Report RRR-32-2004, RUTCOR, Rutgers University (2004)

    Google Scholar 

  11. Mann, L.: Queue culture: The waiting line as a social system. The American Journal of Sociology 75, 340–354 (1969)

    Article  Google Scholar 

  12. Larson, R.: Perspectives on queues: Social justice and the psychology of queueing. Operations Research 35, 895–905 (1987)

    Article  MathSciNet  Google Scholar 

  13. Gordon, E.S.: Slips and Skips in Queues. PhD thesis, Massachusetts Institute of Technology (1989)

    Google Scholar 

  14. Whitt, W.: The amount of overtaking in a network of queues. Networks 14, 411–426 (1984)

    Article  MATH  MathSciNet  Google Scholar 

  15. Rafaeli, A., Kedmi, E., Vashdi, D., Barron, G.: Queues and fairness: A multiple study experimental investigation, http://queues-fairness.rafaeli.net/

  16. Greenberg, A.G., Madras, N.: How fair is fair queueing? Association for Computing Machinery 39, 568–598 (1992)

    MATH  MathSciNet  Google Scholar 

  17. Demers, A., Keshav, S., Shenker, S.: Analysis and simulation of a fair queueing algorithm. Internetworking Research and Experience 1, 3–26 (1990)

    Google Scholar 

  18. Nandagopal, T., Lu, S., Bharghavan, V.: A unified architecture for the design and evaluation of wireless fair queueing algorithms. Wireless Networks 8, 231–247 (2002)

    Article  MATH  Google Scholar 

  19. Wierman, A., Harchol-Balter, M.: Classifying scheduling policies with respect to unfairness in an M/GI/1. In: Proceedings of the 2003 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, pp. 238–249 (2003)

    Google Scholar 

  20. Bansal, N., Harcol-Balter, M.: Analysis of SRPT scheduling: Investigating unfairness. In: SIGMETRICS (2001)

    Google Scholar 

  21. Harchol-Balter, M., Sigman, K., Wierman, A.: Asymptotic convergence of scheduling policies with respect to slowdown. In: IFIP WG 7.3 International Symposium on Computer Modeling, Measurement and Evaluation (2002)

    Google Scholar 

  22. Schwiegelshohn, U., Yahyapour, R.: Fairness in parallel job scheduling. Journal of Scheduling 5, 297–320 (2000)

    Article  MathSciNet  Google Scholar 

  23. Sabin, G., Sahasrabudhe, V., Sadayappan, P.: On fairness in distributed job scheduling across multiple sites. In: Cluster (2004)

    Google Scholar 

  24. Sabin, G., Kochhar, G., Sadayappan, P.: Job fairness in non-preemptive job scheduling. In: International Conference on Parallel Processesing (2004)

    Google Scholar 

  25. Feitelson, D.G.: Logs of real parallel workloads from production systems, http://www.cs.huji.ac.il/labs/parallel/workload/

  26. Hansen, B.: An analysis of response ratio. In: IFIP Congress (1971)

    Google Scholar 

  27. Weisstein, E.W.: Spearman rank correlation coefficient, http://mathworld.wolfram.com/SpearmanRankCorrelationCoefficient.html From MathWorld–A Wolfram Web Resource

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sabin, G., Sadayappan, P. (2005). Unfairness Metrics for Space-Sharing Parallel Job Schedulers. In: Feitelson, D., Frachtenberg, E., Rudolph, L., Schwiegelshohn, U. (eds) Job Scheduling Strategies for Parallel Processing. JSSPP 2005. Lecture Notes in Computer Science, vol 3834. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11605300_12

Download citation

  • DOI: https://doi.org/10.1007/11605300_12

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-31024-2

  • Online ISBN: 978-3-540-31617-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics