DISCOVERY, Beyond the Clouds

DIStributed and COoperative Framework to Manage Virtual EnviRonments autonomicallY: A Prospective Study
  • Adrien Lèbre
  • Paolo Anedda
  • Massimo Gaggero
  • Flavien Quesnel
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7156)

Abstract

Although the use of virtual environments provided by cloud computing infrastructures is gaining consensus from the scientific community, running applications in these environments is still far from reaching the maturity of more usual computing facilities such as clusters or grids. Indeed, current solutions for managing virtual environments are mostly based on centralized approaches that barter large-scale concerns such as scalability, reliability and reactivity for simplicity. However, considering current trends about cloud infrastructures in terms of size (larger and larger) and in terms of usage (cross-federation), every large-scale concerns must be addressed as soon as possible to efficiently manage next generation of cloud computing platforms.

In this work, we propose to investigate an alternative approach leveraging DIStributed and COoperative mechanisms to manage Virtual EnviRonments autonomicallY (DISCOVERY). This initiative aims at overcoming the main limitations of the traditional server-centric solutions while integrating all mandatory mechanisms into a unified distributed framework. The system we propose to implement, relies on a peer-to-peer model where each agent can efficiently deploy, dynamically schedule and periodically checkpoint the virtual environments they manage. The article introduces the global design of the DISCOVERY proposal and gives a preliminary description of its internals.

Keywords

Cloud Computing Virtual Machine Virtual Environment Distribute Hash Table Hadoop Distribute File System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Nimbus is cloud computing for science, http://www.nimbusproject.org/
  2. 2.
  3. 3.
    Openstack: The open source, open standards cloud. open source software to build private and public clouds, http://www.openstack.org/
  4. 4.
    XenServer Administrator’s Guide 5.5.0. Tech. rep., Citrix Systems (February 2010)Google Scholar
  5. 5.
    Anedda, P., Leo, S., Gaggero, M., Zanetti, G.: Scalable Repositories for Virtual Clusters. In: Lin, H.-X., Alexander, M., Forsell, M., Knüpfer, A., Prodan, R., Sousa, L., Streit, A. (eds.) Euro-Par 2009 Workshop. LNCS, vol. 6043, pp. 414–423. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  6. 6.
    Anedda, P., Leo, S., Manca, S., Gaggero, M., Zanetti, G.: Suspending, migrating and resuming hpc virtual clusters. Future Generation Computer Systems 26(8), 1063–1072 (2010)CrossRefGoogle Scholar
  7. 7.
    Bolte, M., Sievers, M., Birkenheuer, G., Niehörster, O., Brinkmann, A.: Non-intrusive virtualization management using libvirt. In: Proceedings of the Conference on Design, Automation and Test in Europe, DATE 2010, pp. 574–579. European Design and Automation Association, Leuven (2010)Google Scholar
  8. 8.
    Borthakur, D.: The Hadoop Distributed File System: Architecture and Design. The Apache Software Foundation (2007)Google Scholar
  9. 9.
    Bose, S.K., Brock, S., Skeoch, R., Rao, S.: CloudSpider: Combining Replication with Scheduling for Optimizing Live Migration of Virtual Machines Across Wide Area Networks. In: 11th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing (CCGrid), Newport Beach, California, U.S.A (May 2011)Google Scholar
  10. 10.
    Bradford, R., Kotsovinos, E., Feldmann, A., Schiöberg, H.: Live wide-area migration of virtual machines including local persistent state. In: Proceedings of the 3rd International Conference on Virtual Execution Environments, VEE 2007, pp. 169–179. ACM, San Diegoe (2007)CrossRefGoogle Scholar
  11. 11.
    Chanchio, K., Leangsuksun, C., Ong, H., Ratanasamoot, V., Shafi, A.: An efficient virtual machine checkpointing mechanism for hypervisor-based hpc systems. In: High Availability and Performance Computing Workshop, Denver, USA (2008)Google Scholar
  12. 12.
    Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live migration of virtual machines. In: Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation, NSDI 2005, vol. 2, pp. 273–286. USENIX Association, Berkeley (2005)Google Scholar
  13. 13.
    Claudel, B., Huard, G., Richard, O.: Taktuk, adaptive deployment of remote executions. In: Proceedings of the 18th ACM International Symposium on High Performance Distributed Computing, HPDC 2009. ACM, Munich (2009)Google Scholar
  14. 14.
    DMTF: Open Virtualization Format Specification (January 2010), http://www.dmtf.org/standards/ovf
  15. 15.
    Figueiredo, R.J., Dinda, P.A., Fortes, J.A.B.: A case for grid computing on virtual machines. In: Proceedings of the 23rd International Conference on Distributed Computing Systems (ICDCS). IEEE, Washington, DC (2003)Google Scholar
  16. 16.
    Ghosh, R., Longo, F., Naik, V.K., Trivedi, K.S.: Quantifying resiliency of iaas cloud. In: SRDS, pp. 343–347. IEEE (2010)Google Scholar
  17. 17.
    Hermenier, F., Lèbre, A., Menaud, J.M.: Cluster-wide context switch of virtualized jobs. In: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, HPDC 2010. ACM, New York (2010)Google Scholar
  18. 18.
    Hines, M.R., Gopalan, K.: Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning. In: Proceedings of the 2009 ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, VEE 2009, pp. 51–60. ACM, Washington, DC (2009)CrossRefGoogle Scholar
  19. 19.
    Jin, H., Deng, L., Wu, S., Shi, X., Pan, X.: Live virtual machine migration with adaptive, memory compression. In: IEEE International Conference on Cluster Computing and Workshops, CLUSTER 2009, pp. 1–10 (September 2009)Google Scholar
  20. 20.
    Keahey, K.: From sandbox to playground: Dynamic virtual environments in the grid. In: Proceedings of the 5th International Workshop on Grid Computing (2004)Google Scholar
  21. 21.
    Keahey, K., Tsugawa, M., Matsunaga, A., Fortes, J.: Sky computing. IEEE Internet Computing 13, 43–51 (2009)CrossRefGoogle Scholar
  22. 22.
    Kephart, J.O., Chess, D.M.: The vision of autonomic computing. Computer 36(1), 41–50 (2003)MathSciNetCrossRefGoogle Scholar
  23. 23.
    Lagar-Cavilla, H.A., Whitney, J., Bryant, R., Patchin, P., Brudno, M., de Lara, E., Rumble, S.M., Satyanarayanan, M., Scannell, A.: Snowflock: Virtual machine cloning as a first class cloud primitive. Transactions on Computer Systems (TOCS) 19(1) (February 2011)Google Scholar
  24. 24.
    Lowe, S.: Introducing VMware vSphere 4, 1st edn. Wiley Publishing Inc., Indianapolis (2009)Google Scholar
  25. 25.
    McKeown, N., Anderson, T., Balakrishnan, H., Parulkar, G., Peterson, L., Rexford, J., Shenker, S., Turner, J.: OpenFlow: Enabling Innovation in Campus Networks. SIGCOMM Comput. Commun. Rev. 38(2), 69–74 (2008)CrossRefGoogle Scholar
  26. 26.
    McNett, M., Gupta, D., Vahdat, A., Voelker, G.M.: Usher: An Extensible Framework for Managing Clusters of Virtual Machines. In: Proceedings of the 21st Large Installation System Administration Conference (LISA) (November 2007)Google Scholar
  27. 27.
    Nicolae, B., Bresnahan, J., Keahey, K., Antoniu, G.: Going back and forth: Efficient multi-deployment and multi-snapshotting on clouds. In: Proceedings of the 20th ACM International Symposium on High Performance Distributed Computing, HPDC 2011. ACM, New York (2011)Google Scholar
  28. 28.
    Nurmi, D., Wolski, R., Grzegorczyk, C., Obertelli, G., Soman, S., Youseff, L., Zagorodnov, D.: The eucalyptus open-source cloud-computing system. In: Proceedings of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID, Washington, DC, USA (2009)Google Scholar
  29. 29.
    Quesnel, F., Lebre, A.: Operating Systems and Virtualization Frameworks: From Local to Distributed Similarities. In: Cotronis, Y., Danelutto, M., Papadopoulos, G.A. (eds.) PDP 2011: Proceedings of the 19th Euromicro International Conference on Parallel, Distributed and Network-Based Computing, pp. 495–502. IEEE Computer Society, Los Alamitos (2011)CrossRefGoogle Scholar
  30. 30.
    Rowstron, A., Druschel, P.: Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems. In: Guerraoui, R. (ed.) Middleware 2001. LNCS, vol. 2218, pp. 329–350. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  31. 31.
    Ruth, P., Rhee, J., Xu, D., Kennell, R., Goasguen, S.: Autonomic live adaptation of virtual computational environments in a multi-domain infrastructure. In: IEEE International Conference on Autonomic Computing, ICAC 2006 (June 2006)Google Scholar
  32. 32.
    Sotomayor, B., Montero, R., Llorente, I., Foster, I., et al.: Virtual infrastructure management in private and hybrid clouds. IEEE Internet Computing 13(5) (2009)Google Scholar
  33. 33.
    Stoica, I., Morris, R., Liben-Nowell, D., Karger, D.R., Kaashoek, M.F., Dabek, F., Balakrishnan, H.: Chord: a scalable peer-to-peer lookup protocol for internet applications. IEEE/ACM Transactions on Networking 11(1), 17–32 (2003)CrossRefGoogle Scholar
  34. 34.
    Tsugawa, M., Fortes, J.: A virtual network (vine) architecture for grid computing. In: International Parallel and Distributed Processing Symposium, p. 123 (2006)Google Scholar
  35. 35.
    Zhao, B.Y., Huang, L., Stribling, J., Rhea, S.C., Joseph, A.D., Kubiatowicz, J.D.: Tapestry: a resilient global-scale overlay for service deployment. IEEE Journal on Selected Areas in Communications 22(1), 41–53 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Adrien Lèbre
    • 1
  • Paolo Anedda
    • 2
  • Massimo Gaggero
    • 2
  • Flavien Quesnel
    • 1
  1. 1.ASCOLA Research GroupEcole des Mines de NantesNantesFrance
  2. 2.Distributed Computing GroupCRS4PulaItaly

Personalised recommendations