Skip to main content
Log in

Latency-aware virtual desktops optimization in distributed clouds

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Distributed clouds offer a choice of data center locations for providers to host their applications. In this paper, we consider distributed clouds that host virtual desktops which are then accessed by users through remote desktop protocols. Virtual desktops have different levels of latency-sensitivity, primarily determined by the actual applications running and affected by the end users’ locations. In the scenario of mobile users, even switching between 3G and WiFi networks affects the latency-sensitivity. We design VMShadow, a system to automatically optimize the location and performance of latency-sensitive VMs in the cloud. VMShadow performs black-box fingerprinting of a VM’s network traffic to infer the latency-sensitivity and employs both ILP and greedy heuristic based algorithms to move highly latency-sensitive VMs to cloud sites that are closer to their end users. VMShadow employs a WAN-based live migration and a new network connection migration protocol to ensure that the VM migration and subsequent changes to the VM’s network address are transparent to end-users. We implement a prototype of VMShadow in a nested hypervisor and demonstrate its effectiveness for optimizing the performance of VM-based desktops in the cloud. Our experiments on a private as well as the public EC2 cloud show that VMShadow is able to discriminate between latency-sensitive and insensitive desktop VMs and judiciously moves only those that will benefit the most from the migration. For desktop VMs with video activity, VMShadow improves VNC’s refresh rate by 90% by migrating virtual desktop to the closer location. Transcontinental remote desktop migrations only take about 4 min and our connection migration proxy imposes 13 μs overhead per packet.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Notes

  1. Example features include throughput, connection duration or inter-packet latency.

  2. Live migration of a VM takes place in rounds, where the whole disk and memory state is migrated in the first round. Since the VM is executing in this period, it dirties a fraction of the disk and memory, and in the next round, we must move \((S_{\text {disk}} + S_{\text {mem}}) \cdot r ,\) where r is the dirtied fraction. The next round will need an additional \((S_{\text {disk}} + S_{\text {mem}})\cdot r^2\). Thus we obtain an expression: \((S_{\text {disk}} + S_{\text {mem}})\cdot (1 + r + r^2 + \cdots )\). This expression can be further refined using different disk and memory dirtying rates for the VM.

  3. Our focus is not on comparing the performance differences of different remote desktop protocol.

  4. We choose Chrome browser due to the fact that Netflix is not supported in the default Firefox browser.

References

  1. Guo, T., Gopalakrishnan, V., Ramakrishnan, K., Shenoy, P., Venkataramani, A., Lee, S.: Vmshadow: optimizing the performance of latency-sensitive virtual desktops in distributed clouds. In: Proceedings of the 5th ACM Multimedia Systems Conference, pp. 103–114. ACM (2014)

  2. Amazon WorkSpaces. https://aws.amazon.com/workspaces/

  3. Microsoft Desktop virtualization. https://www.microsoft.com/en-us/cloud-platform/desktop-virtualization

  4. Wood, T., Ramakrishnan, K.K., Shenoy, P., Van der Merwe, J.: CloudNet : dynamic pooling of cloud resources by live WAN migration of virtual machines. In: Proceedings of ACM SIGPLAN/SIGOPS conference on Virtual Execution Environments (VEE) (2011)

  5. Williams, D., Jamjoom, H., Weatherspoon, H.: The xen-blanket: virtualize once, run everywhere. In: Proceedings of ACM EuroSys (2012)

  6. Response times: the 3 important limits. http://www.nngroup.com/articles/response-times-3-important-limits/

  7. Katz-Bassett, E., John, J.P., Krishnamurthy, A., Wetherall, D., Anderson, T., Chawathe, Y.: Towards ip geolocation using delay and topology measurements. In: Proceedings of the 6th ACM SIGCOMM Conference on Internet Measurement, IMC ’06, pp. 71–84. ACM, New York, NY, USA (2006). doi:10.1145/1177080.1177090

  8. Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live migration of virtual machines. In: Proceedings of USENIX NSDI (2005)

  9. Heroku:Cloud Application Platform. https://www.heroku.com/

  10. Sharma, P., Lee, S., Guo, T., Irwin, D., Shenoy, P.: Spotcheck: Designing a derivative iaas cloud on the spot market. In: Proceedings of the Tenth European Conference on Computer Systems, EuroSys ’15, pp. 16:1–16:15. ACM, New York, NY, USA (2015). doi:10.1145/2741948.2741953

  11. Cully, B., Lefebvre, G., Meyer, D., Feeley, M., Hutchinson, N., Warfield, A.: Remus: high availability via asynchronous virtual machine replication. In: Proceedings of USENIX NSDI (2008)

  12. Aggarwal, B., Akella, A., Anand, A., Balachandran, A., Chitnis, P., Muthukrishnan, C., Ramjee, R., Varghese, G.: Endre: an end-system redundancy elimination service for enterprises. In: Proceedings of USENIX NSDI (2010)

  13. Host Identity Protocol (HIP). http://tools.ietf.org/html/rfc5201

  14. Locator/ID Separation Protocol (LISP). http://www.lisp4.net/

  15. Identifier-Locator Network Protocol (ILNP). http://tools.ietf.org/html/rfc6740.txt

  16. Nordström, E., Shue, D., Gopalan, P., Kiefer, R., Arye, M., Ko, S.Y., Rexford, J., Freedman, M.J.: Serval: An end-host stack for service-centric networking. In: Proceedings of USENIX NSDI (2012)

  17. Ford, B., Srisuresh, P., Kegel, D.: Peer-to-peer communication across network address translators. In: Proceedings of USENIX Annual Technical Conference (2005)

  18. Dong, J., Jin, X., Wang, H., Li, Y., Zhang, P., Cheng, S.: Energy-saving virtual machine placement in cloud data centers. In: Cluster, Cloud and Grid Computing (CCGrid), 2013 13th IEEE/ACM International Symposium on, pp. 618–624 (2013). Doi:10.1109/CCGrid.2013.107

  19. Le, K., Bianchini, R., Zhang, J., Jaluria, Y., Meng, J., Nguyen, T.D.: Reducing electricity cost through virtual machine placement in high performance computing clouds. In: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, p. 22. ACM (2011)

  20. Teng, F., Deng, D., Yu, L., Magouls, F.: An energy-efficient vm placement in cloud datacenter. In: High Performance Computing and Communications, 2014 IEEE 6th Intl Symp on Cyberspace Safety and Security, 2014 IEEE 11th Intl Conf on Embedded Software and Syst (HPCC,CSS,ICESS), 2014 IEEE Intl Conf on, pp. 173–180 (2014)

  21. Wu, G., Tang, M., Tian, Y.C., Li, W.: Energy-Efficient Virtual Machine Placement in Data Centers by Genetic Algorithm, pp. 315–323. Springer, Berlin, Heidelberg, Berlin, Heidelberg (2012). doi:10.1007/978-3-642-34487-9_39

  22. Do, A.V., Chen, J., Wang, C., Lee, Y.C., Zomaya, A.Y., Zhou, B.B.: Profiling applications for virtual machine placement in clouds. In: Cloud Computing (CLOUD), 2011 IEEE International Conference on, pp. 660–667 (2011). doi:10.1109/CLOUD.2011.75

  23. Guo, T., Shenoy, P.: Model-driven geo-elasticity in database clouds. In: Autonomic Computing (ICAC), 2015 IEEE International Conference on, pp. 61–70. IEEE (2015)

  24. Jiang, J.W., Lan, T., Ha, S., Chen, M., Chiang, M.: Joint vm placement and routing for data center traffic engineering. In: INFOCOM, 2012 Proceedings IEEE, pp. 2876–2880. IEEE (2012)

  25. Ballani, H., Costa, P., Karagiannis, T., Rowstron, A.: Towards predictable datacenter networks. In: Proceedings of the ACM SIGCOMM (2011)

  26. Guo, C., Lu, G., Wang, H.J., Yang, S., Kong, C., Sun, P., Wu, W., Zhang, Y.: Secondnet: a data center network virtualization architecture with bandwidth guarantees. In: Proceedings of ACM CoNEXT (2010)

  27. Coffmann, E.G., Gary, M.R., Johnson, D.S.: Approximation algorithms for bin-packing-an updated survey. Algorithm Design for Computer System Design, pp. 49–106 (1984)

  28. Mishra, M., Sahoo, A.: On theory of vm placement: anomalies in existing methodologies and their mitigation using a novel vector based approach. In: Cloud Computing (CLOUD), 2011 IEEE International Conference on, pp. 275–282. IEEE (2011)

  29. Xu, J., Fortes, J.A.: Multi-objective virtual machine placement in virtualized data center environments. In: Green Computing and Communications (GreenCom), 2010 IEEE/ACM Int’l Conference on and Int’l Conference on Cyber, Physical and Social Computing (CPSCom), pp. 179–188. IEEE (2010)

  30. Piao, J.T., Yan, J.: A network-aware virtual machine placement and migration approach in cloud computing. In: Proceedings of Grid and Cooperative Computing (GCC 2010), pp. 87–92 (2010). doi:10.1109/GCC.2010.29

  31. Yapicioglu, T., Oktug, S.: A traffic-aware virtual machine placement method for cloud data centers. In: Proceedings of the 2013 IEEE/ACM 6th international conference on utility and cloud computing, pp. 299–301. IEEE Computer Society (2013)

  32. Chaisiri, S., Lee, B.S., Niyato, D.: Optimal virtual machine placement across multiple cloud providers. In: Services Computing Conference, 2009. APSCC 2009. IEEE Asia-Pacific, pp. 103–110. IEEE (2009)

  33. Hao, F., Kodialam, M., Lakshman, T.V., Mukherjee, S.: Online allocation of virtual machines in a distributed cloud. In: IEEE INFOCOM 2014—IEEE Conference on Computer Communications, pp. 10–18 (2014). doi:10.1109/INFOCOM.2014.6847919

  34. Bronson, N., Amsden, Z., Cabrera, G., Chakka, P., Dimov, P., Ding, H., Ferris, J., Giardullo, A., Kulkarni, S., Li, H., et al.: Tao: Facebooks distributed data store for the social graph. In: Presented as part of the 2013 USENIX Annual Technical Conference (USENIX ATC 13), pp. 49–60 (2013)

  35. Chen, K.y., Xu, Y., Xi, K., Chao, H.J.: Intelligent virtual machine placement for cost efficiency in geo-distributed cloud systems. In: 2013 IEEE International Conference on Communications (ICC), pp. 3498–3503. IEEE (2013)

  36. Project Voldemort. http://project-voldemort.com/

  37. Sovran, Y., Power, R., Aguilera, M.K., Li, J.: Transactional storage for geo-replicated systems. In: Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles, pp. 385–400. ACM (2011)

  38. Steiner, M., Gaglianello, B.G., Gurbani, V., Hilt, V., Roome, W., Scharf, M., Voith, T.: Network-aware service placement in a distributed cloud environment. In: Proceedings of the ACM SIGCOMM (2012)

  39. Alicherry, M., Lakshman, T.V.: Network aware resource allocation in distributed clouds. In: INFOCOM (2012)

  40. Guo, T., Sharma, U., Shenoy, P., Wood, T., Sahu, S.: Cost-aware cloud bursting for enterprise applications. ACM Trans. Internet Technol. 13(3), 10 (2014)

    Article  Google Scholar 

  41. Chaisiri, S., Lee, B.S., Niyato, D.: Optimization of resource provisioning cost in cloud computing. IEEE Trans. Serv. Comput. 5(2), 164–177 (2012)

    Article  Google Scholar 

  42. Guo, T., Sharma, U., Wood, T., Sahu, S., Shenoy, P.: Seagull: intelligent cloud bursting for enterprise applications. In: Proceedings of USENIX Annual Technical Conference (2012)

  43. Calyam, P., Rajagopalan, S., Selvadhurai, A., Mohan, S., Venkataraman, A., Berryman, A., Ramnath, R.: Leveraging openflow for resource placement of virtual desktop cloud applications. In: 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013), pp. 311–319. IEEE (2013)

  44. Lai, A.M., Nieh, J.: On the performance of wide-area thin-client computing. ACM Trans. Comput. Syst. 24(2), 175–209 (2006). doi:10.1145/1132026.1132029

  45. Abe, Y.: Liberating virtual machines from physical boundaries through execution knowledge (2015)

  46. Hiltunen, M., Joshi, K., Schlichting, R., Yamada, N., Moritsu, T.: CloudTops: Latency aware placement of Virtual Desktops institution Distributed Cloud Infrastructures (2013)

  47. Lagar-Cavilla, H.A., Tolia, N., De Lara, E., Satyanarayanan, M., OHallaron, D.: Interactive resource-intensive applications made easy. In: ACM/IFIP/USENIX International Conference on Distributed Systems Platforms and Open Distributed Processing, pp. 143–163. Springer (2007)

  48. Lagar-Cavilla, H.A., Whitney, J.A., Scannell, A.M., Patchin, P., Rumble, S.M., De Lara, E., Brudno, M., Satyanarayanan, M.: Snowflock: rapid virtual machine cloning for cloud computing. In: Proceedings of the 4th ACM European conference on Computer systems, pp. 1–12. ACM (2009)

  49. Nelson, M., Lim, B.H., Hutchins, G.: Fast transparent migration for virtual machines. In: Proceedings of the annual conference on USENIX Annual Technical Conference (2005)

  50. Breitgand, D., Kutiel, G., Raz, D.: Cost-aware live migration of services in the cloud. In: Proceedings of Annual Haifa Experimental Systems Conference (2010)

  51. Ibrahim, K.Z., Hofmeyr, S., Iancu, C., Roman, E.: Optimized pre-copy live migration for memory intensive applications. In: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, p. 40. ACM (2011)

  52. Jin, H., Deng, L., Wu, S., Shi, X., Pan, X.: Live virtual machine migration with adaptive, memory compression. In: CLUSTER’09, pp. 1–10 (2009)

  53. Nathan, S., Bellur, U., Kulkarni, P.: Towards a comprehensive performance model of virtual machine live migration. In: Proceedings of the Sixth ACM Symposium on Cloud Computing, pp. 288–301. ACM (2015)

  54. Hou, K.Y., Shin, K.G., Sung, J.L.: Application-assisted live migration of virtual machines with java applications. In: Proceedings of the Tenth European Conference on Computer Systems, p. 15. ACM (2015)

  55. Bradford, R., Kotsovinos, E., Feldmann, A., Schiöberg, H.: Live wide-area migration of virtual machines including local persistent state. In: Proceedings of ACM SIGPLAN/SIGOPS conference on Virtual Execution Environments (VEE) (2007)

  56. Hirofuchi, T., Ogawa, H., Nakada, H., Itoh, S., Sekiguchi, S.: A live storage migration mechanism over wan for relocatable virtual machine services on clouds. In: Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, pp. 460–465. IEEE Computer Society (2009)

  57. Harney, E., Goasguen, S., Martin, J., Murphy, M., Westall, M.: The efficacy of live virtual machine migrations over the internet. In: Proceedings of VTDC (2007)

Download references

Acknowledgements

We would like to thank all our reviewers for their comments and suggestions. This research was supported by NSF Grants CNS-1117221, CNS-1345300 and OCI-1032765.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tian Guo.

Additional information

Communicated by R. Rejaie.

A preliminary version of this work appeared at the ACM MMSys 2014 Conference [1].

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guo, T., Shenoy, P., Ramakrishnan, K.K. et al. Latency-aware virtual desktops optimization in distributed clouds. Multimedia Systems 24, 73–94 (2018). https://doi.org/10.1007/s00530-017-0536-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-017-0536-y

Keywords

Navigation