Online Resource Coalition Reorganization for Efficient Scheduling on the Intercloud

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10048)


While users running applications on the intercloud can run their applications on configurations unavailable on single clouds they are faced with VM performance fluctuations among providers and even within the same provider as recent papers have indicated. These fluctuations can impact an application’s objectives. A solution is to cluster intercloud resources into coalitions working together towards a common goal, i.e., ensuring that the deviation from the objectives is minimal. These coalitions are formed based on historical information on the performance of the underlying resources by assuming that patterns in the deployment of the applications are repeatable. However, static coalitions can lead to underutilized resources due to the fluctuating job flow leading to obsolete information. In this paper propose an online coalition formation metaheuristics which allows us to update existing and create new coalitions at run time based on the job flow. We test our AntClust online coalition formation method against a static coalition formation approach.


Resource management Cloud computing Scheduling algorithms Metaheuristics 


  1. 1.
    Chirkin, A.M., Kovalchuk, S.V.: Towards better workflow execution time estimation. IERI Procedia 10, 216–223 (2014)CrossRefGoogle Scholar
  2. 2.
    Antonescu, A.F., Oprescu, A.M., Demchenko, Y., de Laat, C., Braun, T.: Dynamic optimization of SLA-based services scaling rules. In: 2013 IEEE 5th International Conference on Cloud Computing Technology and Science (CloudCom), vol. 1, pp. 282–289 (2013)Google Scholar
  3. 3.
    Caglar, F., Shekhar, S., Gokhale, A.S.: Towards a performance interference-aware virtual machine placement strategy for supporting soft real-time applications in the cloud. In: Proceedings of 3rd IEEE International Workshop on Real-Time and Distributed Computing in Emerging Applications, REACTION 2014, Rome, Italy, 2 December 2014Google Scholar
  4. 4.
    Chavan, V., Kaveri, P.: Clustered virtual machines for higher availability of resources with improved scalability in cloud computing. In: 2014 First International Conference on Networks Soft Computing (ICNSC), pp. 221–225 (2014)Google Scholar
  5. 5.
    Chen, W., Da Silva, R., Deelman, E., Sakellariou, R.: Balanced task clustering in scientific workflows. In: 2013 IEEE 9th International Conference on eScience (eScience), pp. 188–195 (2013)Google Scholar
  6. 6.
    Choromanska, A., Monteleoni, C.: Online clustering with experts. In: Proceedings of the Fifteenth International Conference on Artificial Intelligence and Statistics, AISTATS 2012, La Palma, Canary Islands, 21–23 April 2012, pp. 227–235 (2012)Google Scholar
  7. 7.
    Cormen, T.H., Leiserson, C.E., Rivest, R.L., Stein, C.: Introduction to Algorithms, 3rd edn. MIT Press, Cambridge (2009)zbMATHGoogle Scholar
  8. 8.
    Dayama, N.R., Krishnamoorthy, M., Ernst, A., Rangaraj, N., Narayanan, V.: History-dependent scheduling: models and algorithms for scheduling with general precedence and sequence dependence. Comput. Oper. Res. 64, 245–261 (2015)MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
    Deng, K., Kong, L., Song, J., Ren, K., Yuan, D.: A weighted k-means clustering based co-scheduling strategy towards efficient execution of scientific workflows in collaborative cloud environments. In: 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing (DASC), pp. 547–554 (2011)Google Scholar
  10. 10.
    Doulamis, N., Kokkinos, P., Varvarigos, E.: Resource selection for tasks with time requirements using spectral clustering. IEEE Trans. Comput. 63(2), 461–474 (2014)CrossRefGoogle Scholar
  11. 11.
    Farley, B., Juels, A., Varadarajan, V., Ristenpart, T., Bowers, K.D., Swift, M.M.: More for your money: exploiting performance heterogeneity in public clouds. In: Proceedings of the Third ACM Symposium on Cloud Computing, pp. 20:1–20:14 (2012)Google Scholar
  12. 12.
    Frincu, M.E., Genaud, S., Gossa, J.: On the efficiency of several VM provisioning strategies for workflows with multi-threaded tasks on clouds. Computing 96(11), 1059–1086 (2014)MathSciNetCrossRefzbMATHGoogle Scholar
  13. 13.
    Frincu, M.E., Genaud, S., Gossa, J.: Client-side resource management on the cloud: survey and future directions. Int. J. Cloud Comput. 4(3), 234–257 (2015)CrossRefGoogle Scholar
  14. 14.
    Iverson, M., Ozguner, F., Follen, G.: Run-time statistical estimation of task execution times for heterogeneous distributed computing. In: Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing, pp. 263–270 (1996)Google Scholar
  15. 15.
    Iverson, M.A., Özgüner, F., Potter, L.: Statistical prediction of task execution times through analytic benchmarking for scheduling in a heterogeneous environment. IEEE Trans. Comput. 48(12), 1374–1379 (1999)CrossRefGoogle Scholar
  16. 16.
    King, A.: Online k-means clustering of non-stationary data. Technical report, MIT, May 2012Google Scholar
  17. 17.
    Kumbhare, A., Simmhan, Y., Prasanna, V.: Plasticc: predictive look-ahead scheduling for continuous dataflows on clouds. In: 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp. 344–353 (2014)Google Scholar
  18. 18.
    Labroche, N., Monmarche, N., Venturini, G.: A new clustering algorithm based on the chemical recognition system of ants. In: ECAI, pp. 345–349 (2002)Google Scholar
  19. 19.
    Lin, H., Qi, X., Yang, S., Midkiff, S.: Workload-driven VM consolidation in cloud data centers. In: 2015 IEEE International on Parallel and Distributed Processing Symposium (IPDPS), pp. 207–216 (2015)Google Scholar
  20. 20.
    Malik, S., Huet, F., Caromel, D.: Latency based dynamic grouping aware cloud scheduling. In: 2012 26th International Conference on Advanced Information Networking and Applications Workshops (WAINA), pp. 1190–1195 (2012)Google Scholar
  21. 21.
    Ou, Z., Zhuang, H., Lukyanenko, A., Nurminen, J.K., Hui, P., Mazalov, V., Yla-Jaaski, A.: Is the same instance type created equal? Exploiting heterogeneity of public clouds. IEEE Trans. Cloud Comput. 1(2), 201–214 (2013)CrossRefGoogle Scholar
  22. 22.
    Palmieri, F., Fiore, U., Ricciardi, S., Castiglione, A.: Grasp-based resource re-optimization for effective big data access in federated clouds. Future Gener. Comput. Syst. 54, 168–179 (2016)CrossRefGoogle Scholar
  23. 23.
    Phinjaroenphan, P., Bevinakoppa, S., Zeephongsekul, P.: A method for estimating the execution time of a parallel task on a grid node. In: Sloot, P.M.A., Hoekstra, A.G., Priol, T., Reinefeld, A., Bubak, M. (eds.) EGC 2005. LNCS, vol. 3470, pp. 226–236. Springer, Heidelberg (2005). doi: 10.1007/11508380_24 CrossRefGoogle Scholar
  24. 24.
    Pietri, I., Juve, G., Deelman, E., Sakellariou, R.: A performance model to estimate execution time of scientific workflows on the cloud. In: Proceedings of the 9th Workshop on Workflows in Support of Large-Scale Science, pp. 11–19 (2014)Google Scholar
  25. 25.
    Reiss, C., Wilkes, J., Hellerstein, J.L.: Google cluster-usage traces: format + schema. Technical report, Google Inc., Mountain View, CA, USA (2011)Google Scholar
  26. 26.
    Smanchat, S., Viriyapant, K.: Taxonomies of workflow scheduling problem and techniques in the cloud. Future Gener. Comput. Syst. 52, 1–12 (2015)CrossRefGoogle Scholar
  27. 27.
    Uriarte, R., Tsaftaris, S., Tiezzi, F.: Service clustering for autonomic clouds using random forest. In: 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), pp. 515–524 (2015)Google Scholar
  28. 28.
    Vasile, M.A., Pop, F., Tutueanu, R.I., Cristea, V., Koodziej, J.: Resource-aware hybrid scheduling algorithm in heterogeneous distributed computing. Future Gener. Comput. Syst. 51, 61–71 (2015)CrossRefGoogle Scholar
  29. 29.
    Xu, F., Liu, F., Jin, H.: Heterogeneity and interference-aware virtual machine provisioning for predictable performance in the cloud. IEEE Trans. Comput. PP(99), 1 (2015)MathSciNetGoogle Scholar
  30. 30.
    Xu, Y.: Characterizing and mitigating virtual machine interference in public clouds. Ph.D. thesis, University of Michigan (2014)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.e-Austria Research InstituteTimisoaraRomania
  2. 2.Department of Computer ScienceWest University of TimisoaraTimisoaraRomania

Personalised recommendations