Skip to main content

Advertisement

SpringerLink
Log in
Menu
Find a journal Publish with us
Search
Cart
Book cover

European Conference on Parallel Processing

Euro-Par 2011: Euro-Par 2011: Parallel Processing Workshops pp 446–456Cite as

  1. Home
  2. Euro-Par 2011: Parallel Processing Workshops
  3. Conference paper
DISCOVERY, Beyond the Clouds

DISCOVERY, Beyond the Clouds

DIStributed and COoperative Framework to Manage Virtual EnviRonments autonomicallY: A Prospective Study

  • Adrien Lèbre30,
  • Paolo Anedda31,
  • Massimo Gaggero31 &
  • …
  • Flavien Quesnel30 
  • Conference paper
  • 1084 Accesses

  • 1 Citations

Part of the Lecture Notes in Computer Science book series (LNTCS,volume 7156)

Abstract

Although the use of virtual environments provided by cloud computing infrastructures is gaining consensus from the scientific community, running applications in these environments is still far from reaching the maturity of more usual computing facilities such as clusters or grids. Indeed, current solutions for managing virtual environments are mostly based on centralized approaches that barter large-scale concerns such as scalability, reliability and reactivity for simplicity. However, considering current trends about cloud infrastructures in terms of size (larger and larger) and in terms of usage (cross-federation), every large-scale concerns must be addressed as soon as possible to efficiently manage next generation of cloud computing platforms.

In this work, we propose to investigate an alternative approach leveraging DIStributed and COoperative mechanisms to manage Virtual EnviRonments autonomicallY (DISCOVERY). This initiative aims at overcoming the main limitations of the traditional server-centric solutions while integrating all mandatory mechanisms into a unified distributed framework. The system we propose to implement, relies on a peer-to-peer model where each agent can efficiently deploy, dynamically schedule and periodically checkpoint the virtual environments they manage. The article introduces the global design of the DISCOVERY proposal and gives a preliminary description of its internals.

Keywords

  • Cloud Computing
  • Virtual Machine
  • Virtual Environment
  • Distribute Hash Table
  • Hadoop Distribute File System

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Download conference paper PDF

References

  1. Nimbus is cloud computing for science, http://www.nimbusproject.org/

  2. Openqrm, http://www.openqrm.com/

  3. Openstack: The open source, open standards cloud. open source software to build private and public clouds, http://www.openstack.org/

  4. XenServer Administrator’s Guide 5.5.0. Tech. rep., Citrix Systems (February 2010)

    Google Scholar 

  5. Anedda, P., Leo, S., Gaggero, M., Zanetti, G.: Scalable Repositories for Virtual Clusters. In: Lin, H.-X., Alexander, M., Forsell, M., Knüpfer, A., Prodan, R., Sousa, L., Streit, A. (eds.) Euro-Par 2009 Workshop. LNCS, vol. 6043, pp. 414–423. Springer, Heidelberg (2010)

    CrossRef  Google Scholar 

  6. Anedda, P., Leo, S., Manca, S., Gaggero, M., Zanetti, G.: Suspending, migrating and resuming hpc virtual clusters. Future Generation Computer Systems 26(8), 1063–1072 (2010)

    CrossRef  Google Scholar 

  7. Bolte, M., Sievers, M., Birkenheuer, G., Niehörster, O., Brinkmann, A.: Non-intrusive virtualization management using libvirt. In: Proceedings of the Conference on Design, Automation and Test in Europe, DATE 2010, pp. 574–579. European Design and Automation Association, Leuven (2010)

    Google Scholar 

  8. Borthakur, D.: The Hadoop Distributed File System: Architecture and Design. The Apache Software Foundation (2007)

    Google Scholar 

  9. Bose, S.K., Brock, S., Skeoch, R., Rao, S.: CloudSpider: Combining Replication with Scheduling for Optimizing Live Migration of Virtual Machines Across Wide Area Networks. In: 11th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing (CCGrid), Newport Beach, California, U.S.A (May 2011)

    Google Scholar 

  10. Bradford, R., Kotsovinos, E., Feldmann, A., Schiöberg, H.: Live wide-area migration of virtual machines including local persistent state. In: Proceedings of the 3rd International Conference on Virtual Execution Environments, VEE 2007, pp. 169–179. ACM, San Diegoe (2007)

    CrossRef  Google Scholar 

  11. Chanchio, K., Leangsuksun, C., Ong, H., Ratanasamoot, V., Shafi, A.: An efficient virtual machine checkpointing mechanism for hypervisor-based hpc systems. In: High Availability and Performance Computing Workshop, Denver, USA (2008)

    Google Scholar 

  12. Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live migration of virtual machines. In: Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation, NSDI 2005, vol. 2, pp. 273–286. USENIX Association, Berkeley (2005)

    Google Scholar 

  13. Claudel, B., Huard, G., Richard, O.: Taktuk, adaptive deployment of remote executions. In: Proceedings of the 18th ACM International Symposium on High Performance Distributed Computing, HPDC 2009. ACM, Munich (2009)

    Google Scholar 

  14. DMTF: Open Virtualization Format Specification (January 2010), http://www.dmtf.org/standards/ovf

  15. Figueiredo, R.J., Dinda, P.A., Fortes, J.A.B.: A case for grid computing on virtual machines. In: Proceedings of the 23rd International Conference on Distributed Computing Systems (ICDCS). IEEE, Washington, DC (2003)

    Google Scholar 

  16. Ghosh, R., Longo, F., Naik, V.K., Trivedi, K.S.: Quantifying resiliency of iaas cloud. In: SRDS, pp. 343–347. IEEE (2010)

    Google Scholar 

  17. Hermenier, F., Lèbre, A., Menaud, J.M.: Cluster-wide context switch of virtualized jobs. In: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, HPDC 2010. ACM, New York (2010)

    Google Scholar 

  18. Hines, M.R., Gopalan, K.: Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning. In: Proceedings of the 2009 ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, VEE 2009, pp. 51–60. ACM, Washington, DC (2009)

    CrossRef  Google Scholar 

  19. Jin, H., Deng, L., Wu, S., Shi, X., Pan, X.: Live virtual machine migration with adaptive, memory compression. In: IEEE International Conference on Cluster Computing and Workshops, CLUSTER 2009, pp. 1–10 (September 2009)

    Google Scholar 

  20. Keahey, K.: From sandbox to playground: Dynamic virtual environments in the grid. In: Proceedings of the 5th International Workshop on Grid Computing (2004)

    Google Scholar 

  21. Keahey, K., Tsugawa, M., Matsunaga, A., Fortes, J.: Sky computing. IEEE Internet Computing 13, 43–51 (2009)

    CrossRef  Google Scholar 

  22. Kephart, J.O., Chess, D.M.: The vision of autonomic computing. Computer 36(1), 41–50 (2003)

    CrossRef  MathSciNet  Google Scholar 

  23. Lagar-Cavilla, H.A., Whitney, J., Bryant, R., Patchin, P., Brudno, M., de Lara, E., Rumble, S.M., Satyanarayanan, M., Scannell, A.: Snowflock: Virtual machine cloning as a first class cloud primitive. Transactions on Computer Systems (TOCS) 19(1) (February 2011)

    Google Scholar 

  24. Lowe, S.: Introducing VMware vSphere 4, 1st edn. Wiley Publishing Inc., Indianapolis (2009)

    Google Scholar 

  25. McKeown, N., Anderson, T., Balakrishnan, H., Parulkar, G., Peterson, L., Rexford, J., Shenker, S., Turner, J.: OpenFlow: Enabling Innovation in Campus Networks. SIGCOMM Comput. Commun. Rev. 38(2), 69–74 (2008)

    CrossRef  Google Scholar 

  26. McNett, M., Gupta, D., Vahdat, A., Voelker, G.M.: Usher: An Extensible Framework for Managing Clusters of Virtual Machines. In: Proceedings of the 21st Large Installation System Administration Conference (LISA) (November 2007)

    Google Scholar 

  27. Nicolae, B., Bresnahan, J., Keahey, K., Antoniu, G.: Going back and forth: Efficient multi-deployment and multi-snapshotting on clouds. In: Proceedings of the 20th ACM International Symposium on High Performance Distributed Computing, HPDC 2011. ACM, New York (2011)

    Google Scholar 

  28. Nurmi, D., Wolski, R., Grzegorczyk, C., Obertelli, G., Soman, S., Youseff, L., Zagorodnov, D.: The eucalyptus open-source cloud-computing system. In: Proceedings of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID, Washington, DC, USA (2009)

    Google Scholar 

  29. Quesnel, F., Lebre, A.: Operating Systems and Virtualization Frameworks: From Local to Distributed Similarities. In: Cotronis, Y., Danelutto, M., Papadopoulos, G.A. (eds.) PDP 2011: Proceedings of the 19th Euromicro International Conference on Parallel, Distributed and Network-Based Computing, pp. 495–502. IEEE Computer Society, Los Alamitos (2011)

    CrossRef  Google Scholar 

  30. Rowstron, A., Druschel, P.: Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems. In: Guerraoui, R. (ed.) Middleware 2001. LNCS, vol. 2218, pp. 329–350. Springer, Heidelberg (2001)

    CrossRef  Google Scholar 

  31. Ruth, P., Rhee, J., Xu, D., Kennell, R., Goasguen, S.: Autonomic live adaptation of virtual computational environments in a multi-domain infrastructure. In: IEEE International Conference on Autonomic Computing, ICAC 2006 (June 2006)

    Google Scholar 

  32. Sotomayor, B., Montero, R., Llorente, I., Foster, I., et al.: Virtual infrastructure management in private and hybrid clouds. IEEE Internet Computing 13(5) (2009)

    Google Scholar 

  33. Stoica, I., Morris, R., Liben-Nowell, D., Karger, D.R., Kaashoek, M.F., Dabek, F., Balakrishnan, H.: Chord: a scalable peer-to-peer lookup protocol for internet applications. IEEE/ACM Transactions on Networking 11(1), 17–32 (2003)

    CrossRef  Google Scholar 

  34. Tsugawa, M., Fortes, J.: A virtual network (vine) architecture for grid computing. In: International Parallel and Distributed Processing Symposium, p. 123 (2006)

    Google Scholar 

  35. Zhao, B.Y., Huang, L., Stribling, J., Rhea, S.C., Joseph, A.D., Kubiatowicz, J.D.: Tapestry: a resilient global-scale overlay for service deployment. IEEE Journal on Selected Areas in Communications 22(1), 41–53 (2004)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ASCOLA Research Group, Ecole des Mines de Nantes, Nantes, France

    Adrien Lèbre & Flavien Quesnel

  2. Distributed Computing Group, CRS4, Edificio 1, Polaris, Pula, Italy

    Paolo Anedda & Massimo Gaggero

Authors
  1. Adrien Lèbre
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paolo Anedda
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Massimo Gaggero
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Flavien Quesnel
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Scilytics, Koellnerhofgasse 3/15A, 1010, Vienna, Austria

    Michael Alexander

  2. ICAR-CNR, Via P. Castellino, 111, 80131, Napoli, Italy

    Pasqua D’Ambra

  3. University of Amsterdam, 1090, Amsterdam, Netherlands

    Adam Belloum

  4. Innovative Computing Laboratory, The University of Tennessee, US

    George Bosilca

  5. Department of Experimental Medicine and Clinic, University Magna Græcia, 88100, Catanzaro, Italy

    Mario Cannataro

  6. Computer Science Department, University of Pisa, Italy

    Marco Danelutto

  7. Second University of Naples, Italy

    Beniamino Di Martino

  8. TUMünchen,, Boltzmannstr. 3, ,, 85748, Garching, Germany

    Michael Gerndt

  9. Equipe Runtime, INRIA Bordeaux Sud-Ouest, 33405, Talence Cedex, France

    Emmanuel Jeannot & Raymond Namyst & 

  10. Equipe HIEPACS, INRIA Bordeaux Sud-Ouest, 33405, Talence Cedex, France

    Jean Roman

  11. Computer Science and Mathematics Division, Oak Ridge National Laboratory, 37831-6164, Oak Ridge, TN, USA

    Stephen L. Scott

  12. Department of Scientific Computing, University of Vienna, Nordbergstr. 15/3C, 1090, Vienna, Austria

    Jesper Larsson Traff

  13. Computer Science and Mathematics Division, Oak Ridge National Laboratory, 37831, Oak Ridge, TN, USA

    Geoffroy Vallée

  14. Technische Universität München, Germany

    Josef Weidendorfer

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Lèbre, A., Anedda, P., Gaggero, M., Quesnel, F. (2012). DISCOVERY, Beyond the Clouds. In: Alexander, M., et al. Euro-Par 2011: Parallel Processing Workshops. Euro-Par 2011. Lecture Notes in Computer Science, vol 7156. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29740-3_50

Download citation

  • .RIS
  • .ENW
  • .BIB
  • DOI: https://doi.org/10.1007/978-3-642-29740-3_50

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-29739-7

  • Online ISBN: 978-3-642-29740-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Share this paper

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Search

Navigation

  • Find a journal
  • Publish with us

Discover content

  • Journals A-Z
  • Books A-Z

Publish with us

  • Publish your research
  • Open access publishing

Products and services

  • Our products
  • Librarians
  • Societies
  • Partners and advertisers

Our imprints

  • Springer
  • Nature Portfolio
  • BMC
  • Palgrave Macmillan
  • Apress
  • Your US state privacy rights
  • Accessibility statement
  • Terms and conditions
  • Privacy policy
  • Help and support

167.114.118.210

Not affiliated

Springer Nature

© 2023 Springer Nature