Adding Virtualization Capabilities to the Grid’5000 Testbed

  • Daniel Balouek
  • Alexandra Carpen Amarie
  • Ghislain Charrier
  • Frédéric Desprez
  • Emmanuel Jeannot
  • Emmanuel Jeanvoine
  • Adrien Lèbre
  • David Margery
  • Nicolas Niclausse
  • Lucas Nussbaum
  • Olivier Richard
  • Christian Perez
  • Flavien Quesnel
  • Cyril Rohr
  • Luc Sarzyniec
Part of the Communications in Computer and Information Science book series (CCIS, volume 367)

Abstract

Almost ten years after its premises, the Grid’5000 testbed has become one of the most complete testbed for designing or evaluating large-scale distributed systems. Initially dedicated to the study of High Performance Computing, the infrastructure has evolved to address wider concerns related to Desktop Computing, the Internet of Services and more recently the Cloud Computing paradigm. This paper present recent improvements of the Grid’5000 software and services stack to support large-scale experiments using virtualization technologies as building blocks. Such contributions include the deployment of customized software environments, the reservation of dedicated network domain and the possibility to isolate them from the others, and the automation of experiments with a REST API. We illustrate the interest of these contributions by describing three different use-cases of large-scale experiments on the Grid’5000 testbed. The first one leverages virtual machines to conduct larger experiments spread over 4000 peers. The second one describes the deployment of 10000 KVM instances over 4 Grid’5000 sites. Finally, the last use case introduces a one-click deployment tool to easily deploy major IaaS solutions. The conclusion highlights some important challenges of Grid’5000 related to the use of OpenFlow and to the management of applications dealing with tremendous amount of data.

Keywords

Distributed Systems Large-Scale Testbed Virtualization Cloud Computing Experiments 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
    Avetisyan, A., Campbell, R., Gupta, I., Heath, M., Ko, S., Ganger, G., Kozuch, M., O’Hallaron, D., Kunze, M., Kwan, T., Lai, K., Lyons, M., Milojicic, D., Lee, H.Y., Soh, Y.C., Ming, N.K., Luke, J.Y., Namgoong, H.: Open Cirrus: A Global Cloud Computing Testbed. IEEE Computer 43(4), 42–50 (2010)Google Scholar
  12. 12.
  13. 13.
    Capit, N., Da Costa, G., Georgiou, Y., Huard, G., Martin, C., Mounié, G., Neyron, P., Richard, O.: A batch scheduler with high level components. In: Cluster Computing and Grid 2005 (CCGrid 2005), Cardiff. Royaume-Uni. (2005), http://hal.archives-ouvertes.fr/hal-00005106
  14. 14.
    Cappello, F., Caron, E., Dayde, M., Desprez, F., Jegou, Y., Primet, P., Jeannot, E., Lanteri, S., Leduc, J., Melab, N., Mornet, G., Namyst, R., Quetier, B., Richard, O.: Grid’5000: A large scale and highly reconfigurable grid experimental testbed. In: Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing, GRID 2005, pp. 99–106. IEEE Computer Society, Washington, DC (2005), http://dx.doi.org/10.1109/GRID.2005.1542730 Google Scholar
  15. 15.
    Claudel, B., Huard, G., Richard, O.: Taktuk, adaptive deployment of remote executions. In: Proceedings of the International Symposium on High Performance Distributed Computing, HPDC (May 2009)Google Scholar
  16. 16.
    Desprez, F., Fox, G., Jeannot, E., Keahey, K., Kozuch, M., Margery, D., Neyron, P., Nussbaum, L., Perez, C., Richard, O., Smith, W., von Laszewski, G., Voeckler, J.: Supporting Experimental Computer Science. Report, Argonne National Laboratory, Argonne (March 2012), http://www.nimbusproject.org/downloads/Supporting_Experimental_Computer_Science_final_draft.pdf
  17. 17.
  18. 18.
    Jeanvoine, E., Sarzyniec, L., Nussbaum, L.: Kadeploy3: Efficient and Scalable Operating System Provisioning for HPC Clusters. Rapport de recherche RR-8002, INRIA (June 2012), http://hal.inria.fr/hal-00710638
  19. 19.
    Keahey, K., Freeman, T.: Science Clouds: Early Experiences in Cloud Computing for Scientific Applications. In: Proceedings of the 2008 Conference on Cloud Computing and Its Applications (CCA), Chicago, IL, USA (2008)Google Scholar
  20. 20.
    Moreno-Vozmediano, R., Montero, R.S., Llorente, I.M.: Elastic management of cluster-based services in the cloud. In: Proceedings of the 1st Workshop on Automated Control for Datacenters and Clouds (ACDC), pp. 19–24. ACM, New York (2009)CrossRefGoogle Scholar
  21. 21.
  22. 22.
  23. 23.
  24. 24.
    Quesnel, F., Lèbre, A., Südholt, M.: Cooperative and Reactive Scheduling in Large-Scale Virtualized Platforms with DVMS. Concurrency and Computation: Practice and Experience, p. XX (December 2012), http://hal.archives-ouvertes.fr/hal-00675315
  25. 25.
    Riteau, P., Tsugawa, M., Matsunaga, A., Fortes, J., Keahey, K.: Large-Scale Cloud Computing Research: Sky Computing on FutureGrid and Grid’5000. ERCIM News (83), 41–42 (2010)Google Scholar
  26. 26.
    Sarzyniec, L., Badia, S., Jeanvoine, E., Nussbaum, L.: Scalability Testing of the Kadeploy Cluster Deployment System using Virtual Machines on Grid’5000. In: SCALE Challenge 2012, Held in Conjunction with CCGrid 2012, Ottawa, Canada (May 2012), http://hal.inria.fr/hal-00700962
  27. 27.
    SC11 Support for Experimental Computer Science Worskhop, http://graal.ens-lyon.fr/~desprez/SC11workshop.htm
  28. 28.
    Shvachko, K., Huang, H., Radia, S., Chansler, R.: The Hadoop distributed file system. In: MSST 2010: Proceedings of the 26th IEEE Symposium on Massive Storage Systems and Technologies, Incline Village, NV, USA, pp. 1–10 (May 2010)Google Scholar
  29. 29.
    The Nimbus Project, http://www.nimbusproject.org/
  30. 30.
    The OAR Project, http://oar.imag.fr/

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • Daniel Balouek
    • 1
  • Alexandra Carpen Amarie
    • 1
  • Ghislain Charrier
    • 1
  • Frédéric Desprez
    • 1
  • Emmanuel Jeannot
    • 1
  • Emmanuel Jeanvoine
    • 1
  • Adrien Lèbre
    • 2
  • David Margery
    • 1
  • Nicolas Niclausse
    • 1
  • Lucas Nussbaum
    • 3
  • Olivier Richard
    • 4
  • Christian Perez
    • 1
  • Flavien Quesnel
    • 2
  • Cyril Rohr
    • 1
  • Luc Sarzyniec
    • 3
  1. 1.INRIAFrance
  2. 2.Ecole des Mines de NantesFrance
  3. 3.Université de LorraineFrance
  4. 4.Université de GrenobleFrance

Personalised recommendations