Advertisement

Journal of Grid Computing

, Volume 12, Issue 3, pp 543–558 | Cite as

Validation of Grid Middleware for the European Grid Infrastructure

  • Mário David
  • Gonçalo Borges
  • Jorge Gomes
  • João Pina
  • Isabel Campos Plasencia
  • Enol Fernández-del-Castillo
  • Iván Díaz
  • Carlos Fernandez
  • Esteban Freire
  • Álvaro Simón
  • Kostas Koumantaros
  • Michel Dreschner
  • Tiziana Ferrari
  • Peter Solagna
Article

Abstract

The European Grid Infrastructure (EGI) is providing a sustainable pan–European Computing Grid to support e–Science, integrating more than 350 computing resource centers worldwide. One of its main challenges is that the middleware driving this production infrastructure is constantly evolving, as it adapts to the changing needs of the EGI Community. Since the software is provided by external technology providers, it needs to pass through a quality verification process before it is included in the EGI official release called Unified Middleware Distribution (UMD). Therefore, all software components undergo a release process covering the definition of the functionality and quality criteria, the verification of those criteria, and the testing under production environments. This paper details the design, development and implementation of this software validation process. An analysis is performed on several metrics to evaluate the process impact on the stability of the production infrastructure, by capturing malfunctions and other issues at the initial testing phases.

Keywords

Grid middleware Grid infrastructures Software validation 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Notes

Acknowledgments

This work is partially funded by the EGI-InSPIRE (European Grid Initiative: Integrated Sustainable Pan-European Infrastructure for Researchers in Europe) is a project co-funded by the European Commission (contract number INFSO-RI-261323) as an Integrated Infrastructure Initiative within the 7th Framework Programme. EGI-InSPIRE began in May 2010 and will run for 4 years. Full information is available at: http://www.egi.eu/. Mário David and Gonçalo Borges would like to thank to the Portuguese Foundation for Science and Technology under the context of the Ciência 2007/2008 programs jointly funded by the European Social Fund and by MCTES national funds – through POPH - NSRF-Type 4.2.

References

  1. 1.
    Kranzlmüller, D., Marco de Lucas, J., Öster, P.: The european grid initiative (EGI), remote instrumentation and virtual laboratories, pp 61–66. Springer (2010)Google Scholar
  2. 2.
    Campos Plasencia, I.: EGI.eu the European grid initiative. In: 4th Iberian Grid Infrastructure Conference Proceedings, pp. 5–15 (2010)Google Scholar
  3. 3.
    Jones, B.: An overview of the EGEE project, peer-to-peer, grid, and service-orientation in digital library architectures. LNCS 3664, 1–8 (2005)Google Scholar
  4. 4.
    Ferrari, T., Gaido, L.: Resources and services of the EGEE production infrastructure. J. Grid Comput. 9, 119–133 (2011)CrossRefGoogle Scholar
  5. 5.
    Andronico, G., et al.: e–infrastructures for e–science: a global view. J. Grid Comput. 9, 155–184 (2011)CrossRefGoogle Scholar
  6. 6.
    European Middleware Initiative: http://www.eu-emi.eu/. Accessed February 25, 2014
  7. 7.
    Initiative for Globus in Europe: http://www.ige-project.eu/. Accessed February 25, 2014
  8. 8.
    Ferrari, T. Annual report on the EGI production infrastructure, EGI-D4.5 (2012) http://documents.egi.eu/document/1059. Accessed February 25, 2014
  9. 9.
    Burke, S., et al.: HEP applications and their experience with the use of datagrid middleware. J. Grid Comput. 2(4), 369–386 (2004)CrossRefMathSciNetGoogle Scholar
  10. 10.
    Berger, M., Fahringer, T.: Practical experience from porting and executing the Wien2k application on the EGEE production grid infrastructure. J. Grid Comput. 8, 261–279 (2010)CrossRefGoogle Scholar
  11. 11.
    Fanfani, A., et al.: Distributed analysis in CMS. J. Grid Comput. 8, 159–179 (2010)CrossRefGoogle Scholar
  12. 12.
    Lagouvardos, K., et al.: A grid-enabled regional-scale ensemble forecasting system in the mediterranean area. J. Grid Comput. 8, 181–197 (2010)CrossRefGoogle Scholar
  13. 13.
    Borges, G., et al.: Fostering multi-scientific usage in the iberian production infrastructure. Comput. Inform. 31–1, 61–72 (2012)Google Scholar
  14. 14.
    Balaz, A., et al.: Development of grid e-Infrastructure in South-Eastern Europe. J. Grid Comput. 9, 135–154 (2011)CrossRefGoogle Scholar
  15. 15.
    Kalmady, R., et al.: Monitoring the availability of grid services using SAM and gridview, grid computing. Int. Symp Grid Comput (ISGC), 163–168 (2009)Google Scholar
  16. 16.
    Altunay, M., et al.: A science driven production Cyberinfrastructurethe open science grid. J. Grid Comput. 9, 201–218 (2011)CrossRefGoogle Scholar
  17. 17.
    Roy A. on behalf of the OSG consortium. J. Phys. Conf. Ser. 180, 012052 (2009)CrossRefGoogle Scholar
  18. 18.
    Pavlo, A., et al. The NMI build and test laboratory: continuous integration framework for distributed computing software. In: Proceedings of LISA ’06: Twentieth Systems Administration Conference, pp. 263–273Google Scholar
  19. 19.
    Beckman, P.H.: Building the TeraGrid. Phil. Trans. R. Soc. A 363, 1715–1728 (2005)CrossRefGoogle Scholar
  20. 20.
    Smallen, S., Olschanowski, C., Ericson, K., Bechman, P., Schopf, J.: The Inca test harness and reporting framework. In: Proceedings of the ACM/IEEE SC2004 Conference, pp. 55 (2004)Google Scholar
  21. 21.
    Gentzsch, W., et al.: DEISA – distributed european infrastructure for supercomputing applications. J. Grid Comput. 9, 259–277 (2011)CrossRefGoogle Scholar
  22. 22.
    Kónya, B.: Advanced resource connector (ARC) – the grid middleware of the NorduGrid, LNCS. Recent Advances in Parallel Virtual Machine and Message Passing Interface. vol. 3241, pp. 22–45. Springer, Heidelberg (2004)Google Scholar
  23. 23.
    Fuhrmann, P., Gulzow, V.: dCache, storage system for the future, LNCS. Euro-Par 2006 Parallel Processing. vol. 4128, pp. 1106–1113. Springer, Heidelberg (2006)Google Scholar
  24. 24.
    gLite – lightweight middleware for grid computing: http://glite.cern.ch/. Accessed February 25, 2014
  25. 25.
    Erwin, D. W., Snelling, D. F.: UNICORE: a grid computing environment, LNCS. In: Euro-Par 2001 Parallel Processing. vol. 2150, pp. 825–834. Springer, Heidelberg (2001)Google Scholar
  26. 26.
    Globus: http://www.globus.org/. Accessed February 25, 2014
  27. 27.
    Newhouse, S. UMD Roadmap, EGI-D5.1. http://documents.egi.eu/document/100. Accessed February 25, 2014 (2010)
  28. 28.
    Schuldt, H.: Multi-tier architecture, encyclopedia of database systems, pp 1862–1865. Springer (2009)Google Scholar
  29. 29.
    Edmonds, A., Metsch, T., Papaspyrou, A.: Open cloud computing interface in data management-related setups. Grid and Cloud Database Management, pp. 23–48 (2011)Google Scholar
  30. 30.
    David, M., et al.: Software provisioning process for EGI. Comput. Inform. 31–1, 135–148 (2012)Google Scholar
  31. 31.
    Antoni, T., et al.: Sustainable support for WLCG through the EGI distributed infrastructure. J. Phys. Conf. Ser. 331, 082009 (2011)CrossRefGoogle Scholar
  32. 32.
    EGI.eu: Service level agreement for the provision of software and support services between EGI.eu and EMI (2011). http://documents.egi.eu/document/461 Accessed 25 Feb. 2014
  33. 33.
    EGI.eu: Service level agreement between egi.eu and initiative for globus in Europe IGE, EGI Document, 442 (2011). http://documents.egi.eu/document/442. Accessed 25 Feb. 2014
  34. 34.
    OpenNebula cloud framework: http://www.opennebula.org. Accessed February 25, 2014
  35. 35.
    Simón, A., et al.: New deployments on EGI Verification and Staged Rollout processes. In: 6th Iberian Grid Infrastructure Conference Proceedings, pp. 3–16 (2012)Google Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2014

Authors and Affiliations

  • Mário David
    • 1
  • Gonçalo Borges
    • 1
  • Jorge Gomes
    • 1
  • João Pina
    • 1
  • Isabel Campos Plasencia
    • 2
  • Enol Fernández-del-Castillo
    • 2
  • Iván Díaz
    • 3
  • Carlos Fernandez
    • 3
  • Esteban Freire
    • 3
  • Álvaro Simón
    • 3
  • Kostas Koumantaros
    • 4
  • Michel Dreschner
    • 5
  • Tiziana Ferrari
    • 5
  • Peter Solagna
    • 5
  1. 1.Laboratório de Instrumentação e Física Experimental de Partículas (LIP)LisboaPortugal
  2. 2.Instituto de Física de Cantabria (CSIC)SantanderSpain
  3. 3.Fundación Centro de Supercomputación de Galicia (CESGA)Santiago de CompostelaSpain
  4. 4.Greek Research and Technology Network (GRNET)AthensGreece
  5. 5.Stichting European Grid Infrastructure (EGI.eu)AmsterdamThe Netherlands

Personalised recommendations