Pre-Copy and Post-Copy VM Live Migration for Memory Intensive Applications

  • Aidan Shribman
  • Benoit Hudzia
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7640)

Abstract

Virtualization technology provides a means for server consolidation, reducing the number of physical servers required for running a given workload. Virtual Machine (VM) live migration facilitates the transfer of a running (VM) between physical hosts while appearing transparent to the running application. Memory intensive applications tend to obstruct the original pre-copy live migration process and may result in the failure of the migration process due to its inability to transfer memory faster than memory is dirtied by the running application. The focus of this paper is to present several techniques that can be applied to both pre-copy live migration and post-copy live migration to better support migration of memory intensive applications.

Keywords

Operating Systems Hypervisors Virtual Machines Live Migration Pre-Copy Post-Copy RDMA QEMU Linux/KVM 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the art of virtualization. In: SOSP 2003: Proceedings of the 19th ACM Symposium on Operating Systems Principles, pp. 164–177. ACM, New York (2003)Google Scholar
  2. 2.
    Kivity, A.: KVM: Kernel-based Virtualization Machine, http://www.linux-kvm.org
  3. 3.
    Ballard, F.: QEMU: Open Source Processor Emulator, http://wiki.qemu.org
  4. 4.
    VMWare Inc.: VMWare, http://www.vmware.com
  5. 5.
    Bradford, R., Kotsovinos, E., Feldmann, A., Schiberg, H.: Live wide-area migration of virtual machines including local persistent state. In: VEE 2007 Proceedings of the 3rd International Conference on Virtual Execution Environments, pp. 169–179 (2007)Google Scholar
  6. 6.
    Checconi, F., Cucinotta, T., Stein, M.: Real-Time Issues in Live Migration of Virtual Machines. In: Lin, H.-X., Alexander, M., Forsell, M., Knüpfer, A., Prodan, R., Sousa, L., Streit, A. (eds.) Euro-Par 2009. LNCS, vol. 6043, pp. 454–466. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  7. 7.
    Hudzia, B., Svard, P., Tordsson, J., Elmroth, E.: Evaluation of Delta Compression Techniques for Efficient Live Migration of Large Virtual Machines. In: VEE 2011 Proceedings of the 7th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, pp. 111–120 (2011)Google Scholar
  8. 8.
    Shribman, A., Hudzia, B., Svard, P.: PATCH v4: XBZRLE delta for live migration of large memory apps, http://patchwork.ozlabs.org/patch/108868/
  9. 9.
    Shribman, A., Hudzia, B., Svard, P.: Microbenchmarks of page delta encoders, http://lists.gnu.org/archive/html/qemu-devel/2011-08/msg00214.html
  10. 10.
    Memon, N., Suel, T.: The zdelta-2.0 experimental results, http://cis.poly.edu/zdelta/results.shtml
  11. 11.
    Megiddo, N., Modha, D.S.: ARC: A Self-Tuning, Low Overhead Replacement Cache. In: FAST 2003 Proceedings of the 2nd USENIX Conference on File and Storage Technologies, pp. 115–130 (2003)Google Scholar
  12. 12.
    Bansal, S., Modha, D.S.: CAR: Clock with Adaptive Replacement. In: FAST 2004 Proceedings of the 3rd USENIX Conference on File and Storage Technologies, pp. 187–200 (2004)Google Scholar
  13. 13.
    Huang, W., Gao, Q., Liu, J., Panda, D.K.: High performance virtual machine migration with RDMA over modern interconnects. In: CLUSTER 2007 Proceedings of the 2007 IEEE International Conference on Cluster Computing, pp. 11–20 (2007)Google Scholar
  14. 14.
    Kaplan, S.F., McGeoch, L.A., Cole, M.F.: Adaptive Caching for Demand Prepaging. In: ISMM 2002 Proceedings of the 3rd International Symposium on Memory Management, pp. 114–126 (2002)Google Scholar
  15. 15.
    Comer, D.E., Griffioen, J.: A New Design for Distributed Systems: The Remote Memory Model, http://docs.lib.purdue.edu/cstech/830
  16. 16.
    Hines, M.R., Gopalan, K.: Post-Copy Based Live Virtual Machine Migration Using Adaptive Pre-Paging and Dynamic Self-Ballooning. In: VEE 2009 Proceedings of the 2009 ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, pp. 51–60 (2009)Google Scholar
  17. 17.
    Hirofuchi, T., Yamahata, I.: Yabusame: Postcopy Live Migration for QEMU/KVM. In: KVM Forum 2011 (2011)Google Scholar
  18. 18.
    Fisher, R.A., Yates, F.: Statistical tables for biological, agricultural and medical research, 3rd edn., pp. 26–27. Oliver & Boyd, London (1938, 1948), OCLC 14222135Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Aidan Shribman
    • 1
  • Benoit Hudzia
    • 2
  1. 1.SAP ResearchRa’ananaIsrael
  2. 2.SAP ResearchBelfastUK

Personalised recommendations