Journal of Grid Computing

, Volume 9, Issue 2, pp 241–257 | Cite as

Using a Simple Prioritisation Mechanism to Effectively Interoperate Service and Opportunistic Grids in the EELA-2 e-Infrastructure

  • Francisco Brasileiro
  • Matheus Gaudencio
  • Rafael Silva
  • Alexandre Duarte
  • Diego Carvalho
  • Diego Scardaci
  • Leandro Ciuffo
  • Rafael Mayo
  • Herbert Hoeger
  • Michael Stanton
  • Raul Ramos
  • Roberto Barbera
  • Bernard Marechal
  • Philippe Gavillet
Article

Abstract

Grids currently in production can be broadly classified as either service Grids, composed of dedicated resources, or opportunistic Grids that harvest the computing power of non-dedicated resources when they are idle. While a service Grid provides high and well defined levels of quality of service, an opportunistic Grid provides only a best-effort service. Nevertheless, since opportunistic Grids do not require resources to be fully dedicated to the Grid, they have the potential to assemble a much larger number of resources. Moreover, these Grids cater very well to the execution of the so-called embarrassingly parallel applications, a type of application that is frequently found in practice, and that comprises the largest portion of the typical workload processed in production Grid systems. The EELA-2 e-infrastructure is comprised of a service Grid and an opportunistic Grid that federates computing resources from scientific institutions in both Europe and Latin America. Due to the complementary characteristics of these two types of Grids, a lot of attention has recently been placed in how to interoperate them. In this paper we focus on the less studied problem of assessing the feasibility of such interoperation. We analyse different prioritisation policies that define when the resources of one Grid can be used to run jobs originating from the other. Our results show that in the absence of a suitable prioritisation policy, the benefits that the users of one Grid may have, frequently come with an important negative impact on the users of the other Grid. We also show that a simple reciprocation mechanism is capable of arbitrating the interoperation in such a way that, whenever possible, users profit from the interoperation and, in no case, this benefit leads to a noticeable reduction on the quality of service that the users would experience were the Grids not to interoperate. We conclude discussing how we have implemented, in the context of the EELA-2 project, this prioritisation mechanism, allowing the effective interoperation of a service Grid based on the gLite middleware with an opportunistic Grid that uses the OurGrid middleware.

Keywords

Grid computing Service Grids Opportunistic Grids Prioritisation EELA-2 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Anderson, D.P., Cobb, J., Korpela, E., Lebofsky, M., Werthimer, D.: SETI@home: an experiment in public-resource computing. Commun. ACM, 45(11), 56–61 (2002)CrossRefGoogle Scholar
  2. 2.
    Anderson, D.P.: BOINC: a system for public-resource computing and storage. In: Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, GRID ’04, pp. 4–10. IEEE Computer Society, Washington, DC, USA (2004)CrossRefGoogle Scholar
  3. 3.
    Andrade, N., Brasileiro, F., Cirne, W., Mowbray, M.: Automatic Grid assembly by promoting collaboration in peer-to-peer Grids. J. Parallel Distrib. Comput. 67(8), 957–966 (2007)MATHCrossRefGoogle Scholar
  4. 4.
    Anglano, C., Canonico, M., Guazzone, M.: The ShareGrid peer-to-peer desktop Grid: infrastructure, applications, and performance evaluation. J. Grid Computing 8(4), 543–570 (2010). doi:10.1007/s10723-010-9162-z CrossRefGoogle Scholar
  5. 5.
    Brochu, F., Egede, U., Elmsheuser, J., Harrison, K., Jones, R.W.L., Lee, H.C., Liko, D., Maier, A., Moscicki, J.T., Muraru, A., Patrick, G.N., Pajchel, K., Reece, W., Samset, B.H., Slater, M.W., Soroko, A., Tan, C.L., Vanderster, D.C.: Ganga: a tool for computational-task management and easy access to Grid resources. CoRR. abs/0902.2685 (2009)
  6. 6.
    Cirne, W., Brasileiro, F., Andrade, N., Costa, L., Andrade, A., Novaes, R., Mowbray, M.: Labs of the world, unite!!! J. Grid Computing 4(3), 225–246 (2006)MATHCrossRefGoogle Scholar
  7. 7.
    da Silva, D.P, Cirne, W, Brasileiro, F.: Trading cycles for information: using replication to schedule bag-of-tasks applications on computational Grids. In: Proceedings of the Euro-Par 2003: International Conference on Parallel and Distributed Computing, pp. 169–180. Klagenfurt, Austria (2003)Google Scholar
  8. 8.
    de Barros, A.G., Furtado, A.A., Brasileiro, F.: Bridging OurGrid-based and gLite-based Grid infrastructures. In: Proceedings of the Second EELA-2 Conference (2009)Google Scholar
  9. 9.
    Epema, D.H.J., Livny, M., van Dantzig, R., Evers, X., Pruyne, J.: A worldwide flock of condors: load sharing among workstation clusters. Future Gener. Comput. Syst. 12(1), 53–65 (1996)CrossRefGoogle Scholar
  10. 10.
    Estrada, T., Taufer, M., Anderson, D.: Performance prediction and analysis of BOINC projects: an empirical study with EmBOINC. J. Grid Computing 7, 537–554 (2009) doi:10.1007/s10723-009-9126-3 CrossRefGoogle Scholar
  11. 11.
    Farkas, Z., Kacsuk, P., Balaton, Z., Gombás, G.: Interoperability of BOINC and EGEE. Future Gener. Comput. Syst. 26(8), 1092–1103 (2010)CrossRefGoogle Scholar
  12. 12.
    Field, L., Laure, E., Schulz, M.: Grid deployment experiences: Grid interoperation. J. Grid Computing 7, 287–296 (2009) doi:10.1007/s10723-009-9128-1 CrossRefGoogle Scholar
  13. 13.
    Flechl, M., Field, L.: Grid interoperability: joining Grid information systems. J. Phys. Conf. Ser. 119(6), 062030 (2008)CrossRefGoogle Scholar
  14. 14.
    Gagliardi, F., Jones, B., Grey, F., Bégin, M.-E., Heikkurinen, M.: Building an infrastructure for scientific Grid computing: status and goals of the egee project. Philos. Trans. R. Soc. Lond. A: Math. Phys. Eng. Sci. 363(1833), 1729–1742 (2005)CrossRefGoogle Scholar
  15. 15.
    Hernández, V., Blanquer, I., Aparicio, G., Isea, R., Chaves, J.L., Hernández, Á., Mora, H.R., Fernández, M., Acero, A., Montes, E., Mayo, R.: Advances in the biomedical applications of the EELA project. Stud. Health Technol. Inform. 126, 31–36 (2007)Google Scholar
  16. 16.
    Iosup, A., Li, H., Jan, M., Anoep, S., Dumitrescu, C., Wolters, L., Epema, D.H.J.: The Grid workloads archive. Future Gener. Comput. Syst. 24(7), 672–686 (2008)CrossRefGoogle Scholar
  17. 17.
    Kacsuk, P., Kiss, T., Sipos, G.: Solving the Grid interoperability problem by P-GRADE portal at workflow level. Future Gener. Comput. Syst. 24(7), 744–751 (2008)CrossRefGoogle Scholar
  18. 18.
    Litzkow, M., Livny, M., Mutka, M.: Condor—a hunter of idle workstations. In: Proceedings of the 8th International Conference of Distributed Computing Systems, pp. 104–111. IEEE Computer Society, San Jose, CA, USA (1988)Google Scholar
  19. 19.
    Marechal, B., Bello, P.H.R., Carvalho, D.: Building a Grid in latin america: the EELA project e-infrastructure. In: CCGRID ’07: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, pp. 835–839. IEEE Computer Society, Washington, DC, USA (2007)CrossRefGoogle Scholar
  20. 20.
    Marechal, B., Bello, P.R., Carvalho, D., Mayo, R.: Applications ported to the EELA e-infrastructure. In: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid’07), pp. 852–857. IEEE Computer Society, Washington, DC, USA (2007)CrossRefGoogle Scholar
  21. 21.
    Marzolla, M., Andreetto, P., Venturi, V., Ferraro, A., Memon, A.S., Memon, M.S., Twedell, B., Riedel, M., Mallmann, D., Streit, A., van de Berghe, S., Li, V., Snelling, D., Stamou, K., Shah, Z.A., Hedman, F.: Open standards-based interoperability of job submission and management interfaces across the Grid middleware platforms gLite and UNICORE. In: Proceedings of International Interoperability and Interoperation Workshop (IGIIW) 2007 at 3rd IEEE International Conference on e-Science and Grid Computing, pp. 592–599. IEEE Computer Society, Bangalore, India (2007)Google Scholar
  22. 22.
    Riedel, M., Memon, A.S., Memon, M.S., Mallmann, D., Streit, A., Wolf, F., Lippert, Th., Venturi, V., Andreetto, P., Marzolla, M., Ferraro, A., Ghiselli, A., Hedman, F., Shah, Z.A., Salzemann, J., Da Costa, A., Breton, V., Kasam, V., Hofmann-Apitius, M., Snelling, D., van de Berghe, S., Li, V., Brewer, S., Dunlop, A., De Silva, N.: Improving e-science with interoperability of the e-infrastructures EGEE and DEISA. In: Proceedings of the 31st International Convention MIPRO, Conference on Grid and Visualization Systems (GVS), pp. 225–231. Opatija, Croatia, Croatian Society for Information and Communication Technology, Electronics and Microelectronics (2008)Google Scholar
  23. 23.
    Santos, R., Andrade, A., Cirne, W., Brasileiro, F., Andrade, N.: Relative autonomous accounting for peer-to-peer Grids: research articles. Concurr. Comput.: Pract. Exp. 19, 1937–1954 (2007)CrossRefGoogle Scholar
  24. 24.
    Urbah, E., Kacsuk, P., Farkas, Z., Fedak, G., Kecskemeti, G., Lodygensky, O., Marosi, A., Balaton, Z., Caillat, G., Gombas, G., Kornafeld, A., Kovacs, J., He, H., Lovas, R.: EDGeS: bridging EGEE to BOINC and XtremWeb. J. Grid Computing 7, 335–354 (2009). doi:10.1007/s10723-009-9137-0 CrossRefGoogle Scholar
  25. 25.
    Vadhiyar, S.S., Dongarra, J.J.: A metascheduler for the Grid. In: HPDC ’02: Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing, p. 343. IEEE Computer Society, Washington, DC, USA (2002)CrossRefGoogle Scholar
  26. 26.
    Vázquez-Poletti, J.L., Huedo, E., Montero, R.S., Llorente, I.M.: Coordinated harnessing of the IRISgrid and EGEE testbeds with gridway. J. Parallel Distrib. Comput. 66(5), 763–771 (2006)CrossRefGoogle Scholar
  27. 27.
    Wang, Y., Scardaci, D., Yan, B., Huang, Y.: Interconnect EGEE and CNGRID e-infrastructures through interoperability between gLite and GOS middlewares. In: Proceedings of the 3rd IEEE International Conference on e-Science and Grid Computing (e-Science’07)—International Grid Interoperability and Interoperation Workshop. IEEE Computer Society, Los Alamitos, CA, USA (2007)Google Scholar

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  • Francisco Brasileiro
    • 1
  • Matheus Gaudencio
    • 1
  • Rafael Silva
    • 1
  • Alexandre Duarte
    • 1
  • Diego Carvalho
    • 2
  • Diego Scardaci
    • 6
  • Leandro Ciuffo
    • 4
  • Rafael Mayo
    • 9
  • Herbert Hoeger
    • 3
  • Michael Stanton
    • 4
    • 5
  • Raul Ramos
    • 10
  • Roberto Barbera
    • 7
    • 8
  • Bernard Marechal
    • 10
    • 11
  • Philippe Gavillet
    • 10
    • 11
  1. 1.Universidade Federal de Campina GrandeCampina GrandeBrazil
  2. 2.Centro Federal de Educação Tecnológica Celso Suckow da FonsecaRio de JaneiroBrazil
  3. 3.Universidad de Los Andes, CeCalCULAMéridaVenezuela
  4. 4.Rede Nacional de Ensino e PesquisaRio de JaneiroBrazil
  5. 5.Universidade Federal FluminendeRio de JaneiroBrazil
  6. 6.Istituto Nazionale di Fisica NucleareCataniaItaly
  7. 7.Dipartimento di Fisica e Astronomia dell’Universitá di CataniaCataniaItaly
  8. 8.INFNCataniaItaly
  9. 9.CIEMATMadridSpain
  10. 10.CETA-CIEMATTrujilloSpain
  11. 11.CERNTrujilloSpain

Personalised recommendations