Patience-Aware Scheduling for Cloud Services: Freeing Users from the Chains of Boredom

  • Carlos Cardonha
  • Marcos D. Assunção
  • Marco A. S. Netto
  • Renato L. F. Cunha
  • Carlos Queiroz
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8274)


Scheduling of service requests in Cloud computing has traditionally focused on the reduction of pre-service wait, generally termed as waiting time. Under certain conditions such as peak load, however, it is not always possible to give reasonable response times to all users. This work explores the fact that different users may have their own levels of tolerance or patience with response delays. We introduce scheduling strategies that produce better assignment plans by prioritising requests from users who expect to receive results earlier and by postponing servicing jobs from those who are more tolerant to response delays. Our analytical results show that the behaviour of users’ patience plays a key role in the evaluation of scheduling techniques, and our computational evaluation demonstrates that, under peak load, the new algorithms typically provide better user experience than the traditional FIFO strategy.


Cloud Computing Cloud Service Peak Load Schedule Strategy Patience Index 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Alt, F., Sahami Shirazi, A., Schmidt, A., Atterer, R.: Bridging waiting times on web pages. In: 14th Int. Conf. on Human-computer Interaction with Mobile Devices and Services (MobileHCI 2012), pp. 305–308. ACM, New York (2012)CrossRefGoogle Scholar
  2. 2.
    Assunção, M.D., et al.: Context-aware job scheduling for cloud computing environments. In: 5th IEEE Int. Conf. on Utility and Cloud Computing, UCC (2012)Google Scholar
  3. 3.
    Atterer, R., Wnuk, M., Schmidt, A.: Knowing the user’s every move: user activity tracking for website usability evaluation and implicit interaction. In: 15th Int. Conf. on World Wide Web (WWW 2006), pp. 203–212. ACM, New York (2006)CrossRefGoogle Scholar
  4. 4.
    AuYoung, A., et al.: Service contracts and aggregate utility functions. In: 15th IEEE Int. Symp. on High Performance Distributed Computing, HPDC 2006 (2006)Google Scholar
  5. 5.
    Braun, T.D., Siegel, H.J., Beck, N., Bölöni, L.L., Maheswaran, M., Reuther, A.I., Robertson, J.P., Theys, M.D., Yao, B., Hensgen, D., et al.: A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. Journal of Parallel and Distributed Computing 61(6), 810–837 (2001)CrossRefGoogle Scholar
  6. 6.
    Brown, L., Gans, N., Mandelbaum, A., Sakov, A., Shen, H., Zeltyn, S., Zhao, L.: Statistical analysis of a telephone call center: A queueing-science perspective. Journal of the American Statistical Association 100, 36–50 (2005)MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Cardonha, C., et al.: Patience-aware scheduling for cloud services: Freeing users from the chains of boredom. arXiv preprint cs/1308.4166 (2013)Google Scholar
  8. 8.
    Cunha, C.R., Jaccoud, C.F.B.: Determining www user’s next access and its application to pre-fetching. In: 2nd IEEE Symp. on Computers and Communications (ISCC 1997), Washington, DC, USA, p. 6 (1997)Google Scholar
  9. 9.
    Doulamis, N.D., Doulamis, A.D., Varvarigos, E.A., Varvarigou, T.A.: Fair scheduling algorithms in grids. IEEE Transactions on Parallel and Distributed Systems 18(11), 1630–1648 (2007)CrossRefGoogle Scholar
  10. 10.
    Feitelson, D.G., Rudolph, L., Schwiegelshohn, U., Sevcik, K.C., Wong, P.: Theory and practice in parallel job scheduling. In: Feitelson, D.G., Rudolph, L. (eds.) IPPS-WS 1997 and JSSPP 1997. LNCS, vol. 1291, pp. 1–34. Springer, Heidelberg (1997)CrossRefGoogle Scholar
  11. 11.
    Galletta, D.F., Henry, R.M., McCoy, S., Polak, P.: Web site delays: How tolerant are users? Journal of the Association for Information Systems 5(1), 1–28 (2004)Google Scholar
  12. 12.
    Gans, N., Koole, G., Mandelbaum, A.: Telephone call centers: Tutorial, review, and research prospects. Manufacturing & Service Operations Management 5(2), 79–141 (2003)CrossRefGoogle Scholar
  13. 13.
    Kahneman, D., Tversky, A.: Prospect theory: An analysis of decision under risk. Econometrica: Journal of the Econometric Society, 263–291 (1979)Google Scholar
  14. 14.
    Precise and Realistic Utility Functions for User-Centric Performance Analysis of Schedulers (2007)Google Scholar
  15. 15.
    Netto, M.A.S., Assunção, M.D., Bianchi, S.: Leveraging attention scarcity to improve the overall user experience of cloud services. In: Proceedings of the IFIP 9th International Conference on Network and Service Management, CNSM 2013 (2013)Google Scholar
  16. 16.
    Pineau, J.F., Robert, Y., Vivien, F.: Energy-aware scheduling of bag-of-tasks applications on master–worker platforms. Concurrency and Computation: Practice and Experience 23(2), 145–157 (2011)CrossRefGoogle Scholar
  17. 17.
    Taylor, S.: Waiting for service: the relationship between delays and evaluations of service. The Journal of Marketing, 56–69 (1994)Google Scholar
  18. 18.
    Tsafrir, D., Etsion, Y., Feitelson, D.G.: Backfilling using system-generated predictions rather than user runtime estimates. IEEE Transactions on Parallel and Distributed Systems 18(6), 789–803 (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Carlos Cardonha
    • 1
  • Marcos D. Assunção
    • 1
  • Marco A. S. Netto
    • 1
  • Renato L. F. Cunha
    • 1
  • Carlos Queiroz
    • 2
  1. 1.IBM ResearchBrazil
  2. 2.IBM ResearchAustralia

Personalised recommendations