Skip to main content
Log in

Elastic Resource Allocation Algorithms for Collaboration Applications

  • Published:
Journal of Network and Systems Management Aims and scope Submit manuscript

Abstract

Cloud technologies can provide elasticity to real-time audio and video (A/V) collaboration applications. However, cloud-based collaboration solutions generally operate on a best-effort basis, with neither delivery nor quality guarantees, and high-quality business focused solutions rely on dedicated infrastructure and hardware-based components. This article describes our 2-year of research in the EMD project, which targets to migrate a hardware-based and business focused A/V collaboration solution to a software-based platform hosted in the cloud, providing higher levels of elasticity and reliability. Our focus during this period was an educational collaboration scenario with teachers and students (locally present in the classroom or remotely following the classes). A model of collaboration streaming (e.g. network topology, codecs, stream, streaming workflow, software components) is defined as base for software deployment and preemptive VM allocation techniques. These heuristics are evaluated using a version of the CloudSim simulator extended to generate and simulate realistic collaboration scenarios, to manage network congestion and to monitor a.o. cost and session delay metrics. Our results show that the algorithms reduce costs when compared to previously designed approaches, having an effectiveness of 99% in meeting A/V collaboration setup deadlines, which is a stringent requirement for this collaboration application.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Google (2017) Google Hangout. https://hangouts.google.com/. Accessed: 2017-05

  2. Facebook (2017) Facebook Messenger. https://www.messenger.com/. Accessed: 2017-05

  3. WhatsApp (2017) WhatsApp Messenger and Collaboration Tool. https://www.whatsapp.com. Accessed: 2017-05

  4. Microsoft (2017) Enterprise capabilities with Skype for Business in Office 365. http://products.office.com/en-us/skype-for-business/online-meetings. Accessed: 2017-05

  5. Cisco (2017) Cisco Hosted Collaboration Solution (HCS). http://www.cisco.com/web/solutions/hcs/index.html. Accessed: 2017-05

  6. IBM (2017) IBM Sametime: enterprise instant messaging, online presence indicators and community collaboration. http://www-03.ibm.com/software/products/en/ibmsame. Accessed: 2017-05

  7. NV B.: Solutions for higher education and training (2017). https://www.barco.com/en/Products/Collaborative-Learning/Solutions-for-higher-education-and-training. Accessed: 2017-05

  8. iMinds (2017) EMD project: elastic media distribution for online collaboration. http://www.iminds.be/en//projects/2015/03/11/emd. Accessed: 2017-05

  9. Diot, C., Levine, B.N., Lyles, B., Kassem, H., Balensiefen, D.: Deployment issues for the IP multicast service and architecture. IEEE Netw. 14(1), 78–88 (2000)

    Article  Google Scholar 

  10. Hosseini, M., Ahmed, D.T., Shirmohammadi, S., Georganas, N.D.: A survey of application-layer multicast protocols. IEEE Commun. Surv. Tutor. 9(3), 58–74 (2007)

    Article  Google Scholar 

  11. Xavier, R., Moens, H., Volckaert, B., De Turck, F.: Design and evaluation of elastic media resource allocation algorithms using CloudSim extensions. In: 2015 11th International Conference on Network and Service Management (CNSM), pp. 318–326 (2015)

  12. Xavier, R., Moens, H., Volckaert, B., De Turck, F.: Adaptive virtual machine allocation algorithms for cloud-hosted elastic media services. In: Network Operations and Management Symposium (NOMS), 2016 IEEE/IFIP. IEEE, pp. 564–570 (2016)

  13. Xavier, R., Moens, H., Volckaert, B., De Turck, F.: Resource allocation algorithms for multicast streaming in elastic cloud-based media collaboration services. In: 2016 IEEE 9th International Conference on Cloud Computing (CLOUD). IEEE, pp. 947–950 (2016)

  14. Xavier, R., Moens, H., Slowack, J., Sandra, W., Delputte, S., Volckaert, B., De Turck, F.: Cloud resource allocation algorithms for elastic media collaboration flows. In: 2016 IEEE International Conference on Cloud Computing Technology and Science (CloudCom). IEEE, pp. 440–447 (2016)

  15. Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A.F., Buyya, R.: CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw. Pract. Exp. 41(1), 23–50 (2011)

    Article  Google Scholar 

  16. Jennings, B., Stadler, R.: Resource management in clouds: survey and research challenges. J. Netw. Syst. Manag. 23(3), 567–619 (2015)

    Article  Google Scholar 

  17. Koslovski, G., Soudan, S., Goncalves, P., Vicat-Blanc, P.: Locating virtual infrastructures: users and InP perspectives. In: 2011 IFIP/IEEE International Symposium on Integrated Network Management (IM), pp. 153–160 (2011)

  18. Alicherry, M., Lakshman, T.: Network aware resource allocation in distributed clouds. In: IEEE INFOCOM, pp. 963–971 (2012)

  19. Steiner, M., Gaglianello, B.G., Gurbani, V., Hilt, V., Roome, W., Scharf, M., Voith, T.: Network-aware service placement in a distributed cloud environment. SIGCOMM Comput. Commun. Rev. 42(4), 73–74 (2012)

    Article  Google Scholar 

  20. Zhu, Y., Liang, Y., Zhang, Q., Wang, X., Palacharla, P., Sekiya, M.: Reliable resource allocation for optically interconnected distributed clouds. In: 2014 IEEE International Conference on Communications (ICC), pp. 3301–3306 (2014)

  21. Fischer, A., Botero, J., Till Beck, M., de Meer, H., Hesselbach, X.: Virtual network embedding: a survey. IEEE Commun. Surv. Tutor. 15(4), 1888–1906 (2013)

    Article  Google Scholar 

  22. ETSI Industry Group (2013) Network function virtualisation NFV. http://www.etsi.org/technologies-clusters/technologies/nfv. Accessed: 2017-05

  23. Clayman, S., Maini, E., Galis, A., Manzalini, A., Mazzocca, N.: The dynamic placement of virtual network functions. In: Network Operations and Management Symposium (NOMS), 2014 IEEE, pp. 1–9. IEEE (2014)

  24. Moens, H., De Turck, F.: VNF-P: a model for efficient placement of virtualized network functions. In: Proceedings of the 10th International Conference on Network and Service Management (CNSM 2014), pp. 418–423 (2014)

  25. Holbrook, H.W., Cheriton, D.R.: IP multicast: EXPRESS support for large-scale single-source applications. ACM SIGCOMM Comput. Commun. Rev. 29, 65–78 (1999)

    Article  Google Scholar 

  26. Steve, D.: Host extensions for IP multicasting. RFC1112 (1989)

  27. Deering, S.E., Cheriton, D.R.: Multicast routing in datagram internetworks and extended lans. ACM Trans. Comput. Syst. (TOCS) 8(2), 85–110 (1990)

    Article  Google Scholar 

  28. Ruso, T., Chellappan, C., Sivasankar, P.: Ppssm: push/pull smooth video streaming multicast protocol design and implementation for an overlay network. Multimed. Tools Appl. 75, 1–23 (2015)

    Google Scholar 

  29. Castro, M., Druschel, P., Kermarrec, A.M., Nandi, A., Rowstron, A., Singh, A.: SplitStream: high-bandwidth multicast in cooperative environments. ACM SIGOPS Oper. Syst. Rev. 37, 298–313 (2003)

    Article  Google Scholar 

  30. Banerjee, S., Bhattacharjee, B., Kommareddy, C.: Scalable Application Layer Multicast, vol. 32. ACM, New york (2002)

    Google Scholar 

  31. Venkataraman, V., Yoshida, K., Francis, P.: Chunkyspread: heterogeneous unstructured tree-based peer-to-peer multicast. In: Proceedings of the 2006 14th IEEE International Conference on Network Protocols, 2006. ICNP’06. IEEE, pp. 2–11 (2006)

  32. Tran, D.A., Hua, K.A., Do, T.: Zigzag: an efficient peer-to-peer scheme for media streaming. In: INFOCOM 2003. 22nd Annual Joint Conference of the IEEE Computer and Communications, vol. 2, pp. 1283–1292. IEEE Societies, IEEE (2003)

  33. Volckaert, B., Thysebaert, P., De Turck, F., Demeester, P., Dhoedt, B.: Evaluation of grid scheduling strategies through a network-aware grid simulator. In: PDPTA’03: Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, vols. 1–4, pp. 31–35 (2003)

  34. Issariyakul, T., Hossain, E.: Introduction to Network Simulator NS2, 2nd edn. Springer, Berlin (2011)

    Google Scholar 

  35. Riley, G.F., Henderson, T.R.: The NS-3 network simulator modeling and tools for network simulation. In: Wehrle, K., Güneş, M., Gross, J. (eds.) Modeling and Tools for Network Simulation, pp. 15–34. Springer, Berlin (2010). (Chap. 2)

    Chapter  Google Scholar 

  36. Liu, L., Wang, H., Liu, X., Jin, X., He, W.B., Wang, Q.B., Chen, Y.: GreenCloud: a new architecture for green data center. In: Proceedings of the 6th International Conference Industry Session on Autonomic Computing and Communications Industry Session, ICAC-INDST ’09, pp. 29–38. ACM, New York (2009)

  37. Keller, G., Tighe, M., Lutfiyya, H., Bauer, M.: DCSim: a data centre simulation tool. In: 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013), pp. 1090–1091 (2013)

  38. Sahhaf, S., Tavernier, W., Colle, D., Pickavet, M.: Resilient availability and bandwidth-aware multipath provisioning for media transfer over the internet. In: 2016 8th International Workshop on Resilient Networks Design and Modeling (RNDM), pp. 134–141. IEEE (2016)

  39. Mao, M., Humphrey, M.: A performance study on the VM startup time in the cloud. In: 2012 IEEE 5th International Conference on Cloud Computing (CLOUD), pp. 423–430. IEEE (2012)

  40. Amazon Inc. (2017) Amazon elastic compute cloud (EC2) images. http://aws.amazon.com/pt/ec2/instance-types/. Accessed: 2017-05

  41. Carles Mateo (2015) Benchmarking the new Amazon C4 instances. http://www.cmips.net/tag/intel-xeon-e5-2666-v3-2-90ghz/. Accessed: 2017-05

  42. VMWare (2017) VMWare vSphere ESXi Hypervisor. https://www.vmware.com/products/esxi-and-esx.html/. Accessed: 2017-05

  43. Soltesz, S., Pötzl, H., Fiuczynski, M.E., Bavier, A., Peterson, L.: Container-based operating system virtualization: a scalable, high-performance alternative to hypervisors. ACM SIGOPS Oper. Syst. Rev. 41, 275–287 (2007)

    Article  Google Scholar 

  44. Seo, K.T., Hwang, H.S., Moon, I.Y., Kwon, O.Y., Kim, B.J.: Performance comparison analysis of linux container and virtual machine for building cloud. Adv. Sci. Technol. Lett. 66(105–111), 2 (2014)

    Google Scholar 

Download references

Acknowledgements

The research described in this article is partially funded by the iMinds Elastic Media Distribution (EMD) research project.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rafael Xavier.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xavier, R., Granville, L.Z., Volckaert, B. et al. Elastic Resource Allocation Algorithms for Collaboration Applications. J Netw Syst Manage 25, 699–734 (2017). https://doi.org/10.1007/s10922-017-9431-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10922-017-9431-2

Keywords

Navigation