Skip to main content
SpringerLink
Log in

Reducing the Time of Live Container Migration in a Workflow

  • Conference paper
  • First Online:
Network and Parallel Computing (NPC 2020)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 12639))

Included in the following conference series:

  • 1182 Accesses

Abstract

As a lightweight virtualization solution, container technology can provide resource limiting capabilities and can run multiple isolated process sets under a single kernel instance. Multi-tenant preemption leads to competition in computing, storage, and network resources, resulting in degraded computing service performance. Virtualization service migration can provide a solution to the problem of resource shortage in supercomputing systems. However, the resource overhead and delay in the migration process also reduce the efficiency of high-performance computers. To solve this problem, this dissertation proposes a method of container migration and a tool for supporting container migration. Also, this paper optimizes the startup of containers from checkpoints and proposes a multi-container migration strategy, reducing migration time by 30% compared to sequential migration. The migration method in this paper provides valuable experience for service migration in supercomputers and data centers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Ansel, J., Arya, K., Cooperman, G.: DMTCP: transparent checkpointing for cluster computations and the desktop. In: 2009 IEEE International Symposium on Parallel & Distributed Processing, pp. 1–12. IEEE (2009)

    Google Scholar 

  2. Banga, G., Druschel, P., Mogul, J.C.: Resource containers: a new facility for resource management in server systems. In: OSDI, vol. 99, pp. 45–58 (1999)

    Google Scholar 

  3. Barak, A., La’adan, O.: The MOSIX multicomputer operating system for high performance cluster computing. Future Gener. Comput. Syst. 13(4–5), 361–372 (1998)

    Article  Google Scholar 

  4. Bhattiprolu, S., Biederman, E.W., Hallyn, S., et al.: Virtual servers and checkpoint/restart in mainstream Linux. ACM SIGOPS Oper. Syst. Rev. 42(5), 104–113 (2008)

    Article  Google Scholar 

  5. Clark, J.: Google: ‘EVERYTHING at Google runs in a container’[OL]. https://www.theregister.co.uk/2014/05/23/google_containerization_two_billion

  6. Docker[OL]. https://docs.docker.com/get-started/overview/

  7. Douglis, F., Ousterhout, J.: Transparent process migration: design alternatives and the Sprite implementation. Softw. Pract. Exp. 21(8), 757–785 (1991)

    Article  Google Scholar 

  8. Duell, J.: The Design and Implementation of Berkeley Lab’s Linux Checkpoint/Restart. Lawrence Berkeley National Laboratory (2005)

    Google Scholar 

  9. Hargrove, P.H., Duell, J.C.: Berkeley lab checkpoint/restart (BLCR) for Linux clusters. J. Phys. Conf. 46, 494–499 (2006)

    Article  Google Scholar 

  10. Jul, E., Levy, H., Hutchinson, N., et al.: Fine-grained mobility in the Emerald system. ACM Trans. Comput. Syst. (TOCS) 6(1), 109–133 (1988)

    Article  Google Scholar 

  11. Kamp, P.H., Watson, R.N.M.: Jails: confining the omnipotent root. In: Proceedings of the 2nd International SANE Conference, vol. 43, p. 116 (2000)

    Google Scholar 

  12. Kotikalapudi, S.V.N.: Comparing live migration between Linux containers and kernel virtual machine: investigation study in terms of parameters (2017)

    Google Scholar 

  13. MacCarty, B.: SELinux-NSA’s open source security enhanced Linux: beating the O-day vulnerability threat (2005)

    Google Scholar 

  14. Menage, P.B.: Adding generic process containers to the Linux kernel. In: Proceedings of the Linux Symposium, vol. 2, pp. 45–57 (2007)

    Google Scholar 

  15. Morris, J., Smalley, S., Kroah-Hartman, G.: Linux security modules: general security support for the Linux kernel. In: USENIX Security Symposium, pp. 17–31. ACM, Berkeley (2002)

    Google Scholar 

  16. Nagar, S., Franke, H., Choi, J., et al.: Class-based prioritized resource control in Linux. In: 2003 Linux Symposium (2003)

    Google Scholar 

  17. Pickartz, S., Eiling, N., Lankes, S., et al.: Migrating LinuX containers using CRIU. In: IEEE International Conference on High Performance Computing, Data, and Analytics, pp. 674–684 (2016)

    Google Scholar 

  18. Pike, R., Presotto, D., Thompson, K., et al.: The use of name spaces in Plan 9. Oper. Syst. Rev. 27(2), 72–76 (1993)

    Article  Google Scholar 

  19. Powell, M.L., Miller, B.P.: Process migration in DEMOS/MP. ACM SIGOPS Oper. Syst. Rev. 17(5), 110–119 (1983)

    Article  Google Scholar 

  20. Vasyukov, A., Beklemysheva, K.: Using CRIU with HPC containers field experience. Int. J. Eng. Comput. Sci. 7(07), 24106–24108 (2018)

    Google Scholar 

Download references

Acknowledgement

This work is supported in part by National Program on Key Research Project (No. 2018YFB0204400), by NSFC (No. 61702484, No. 61972380), by CASSPRP (XDB24050200). Sponsored by CCF-Baidu Open Fund.

Author information

Authors and Affiliations

  1. University of Chinese Academy of Sciences, Beijing, China

    Zhanyuan Di & En Shao

  2. State Key Laboratory of Computer Architecture, Institute of Computing Technology, CAS, Beijing, China

    Zhanyuan Di & En Shao

  3. Chongqing University, Chongqing, China

    Mujun He

Authors
  1. Zhanyuan Di
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. En Shao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mujun He
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to En Shao .

Editor information

Editors and Affiliations

  1. Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China

    Xin He

  2. Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China

    En Shao

  3. Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China

    Guangming Tan

Rights and permissions

Reprints and permissions

Copyright information

© 2021 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Di, Z., Shao, E., He, M. (2021). Reducing the Time of Live Container Migration in a Workflow. In: He, X., Shao, E., Tan, G. (eds) Network and Parallel Computing. NPC 2020. Lecture Notes in Computer Science(), vol 12639. Springer, Cham. https://doi.org/10.1007/978-3-030-79478-1_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-79478-1_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-79477-4

  • Online ISBN: 978-3-030-79478-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation