Journal of Grid Computing

, Volume 7, Issue 3, pp 319–333 | Cite as

An Interoperable Grid Information System for Integrated Resource Monitoring Based on Virtual Organizations

  • Timo Baur
  • Rebecca Breu
  • Tibor Kálmán
  • Tobias Lindinger
  • Anne Milbert
  • Gevorg Poghosyan
  • Helmut Reiser
  • Mathilde Romberg
Open Access
Article

Abstract

In many Grid infrastructures different kinds of information services are in use, which utilize different incompatible data structures and interfaces to encode and provide their data. Homogeneous monitoring of these infrastructures with the monitoring data being accessible everywhere independently of the middleware which provided it, is the basis for a consistent status reporting on the Grids’ resources and services. Thus, interoperability or interoperation between the different information services in a heterogeneous Grid infrastructure is required. Monitoring data must contain the identity of the affected Virtual Organization (VO) so that it can be related to the resources and services the VO has allocated to enable VO-specific information provision. This paper describes a distributed architecture for an interoperable information service, which combines data unification and categorization with policies for VO membership, VO resource management and data transformations. This service builds the basis for an integrated and interoperating monitoring of Grids, which provide their data to more than one VO and utilize heterogeneous information services.

Keywords

Grid monitoring Virtual Organizations Grid interoperability Grid information system VO-specific information provisioning 

References

  1. 1.
    Värttö, S. (ed.): DEISA Advancing Science in Europe. www.deisa.eu, http://www.deisa.eu/press/Media (2008)
  2. 2.
    Appleton, O., Cook, A., Hämmerle, H.: EGEE in 2007. www.eu-egee.org, http://press.eu-egee.org/fileadmin/documents/publications/EGEEin2007-final.pdf (2008)
  3. 3.
    TeraGrid: Open scientific discovery infrastructure. http://www.teragrid.org/. Accessed September 2008
  4. 4.
    Neuroth, A., Kerzel, M., Gentzsch, W. (eds.): German Grid Initiative D-Grid. Universitätsverlag Göttingen (2007)Google Scholar
  5. 5.
    Ellert, M., Gronager, M., Konstantinov, A., Konya, B., Lindemann, J., Livenson, I., Nielsen, J., Niinimaki, M., Smirnova, O., Waananen, A.: Advanced Resource Connector middleware for lightweight computational Grids. Future Gener. Comput. Syst. 23(2), 219–240 (2007)CrossRefGoogle Scholar
  6. 6.
    D-MON Project: Horizontal integration of resource- and service monitoring in d-Grid. http://www.d-grid.de/index.php?id=401&L=1. Accessed September 2008
  7. 7.
    Alef, M., Fieseler, T., Freitag, S., Garcia, A., Grimm, C., Gürich, W., Mehammed, H., Schley, L., Schneider, O., Volpato, G.: Integration of Multiple Middlewares on a Single Computing Resource. Future Generation Computer Systems (2008). Accessed May 2008Google Scholar
  8. 8.
    Tierney, B., Aydt, R., Gunter, D., Smith, W., Swany, M., Taylor, V., Wolski, R.: A Grid Monitoring Architecture. Tech. Rep. GDF.7, Global Grid Forum (2002)Google Scholar
  9. 9.
    Schopf, J., Raicu, I., Perlman, L., Miller, N., Kesselman, C., Foster, I., D’Arcy, M.: Monitoring and discovery in a web services framework: functionality and performance of Globus Toolkit MDS4. In: Proceedings of the 15th IEEE International Symposium on High Performance Distributed Computing. IEEE Computer Society, Los Alamitos (2006)Google Scholar
  10. 10.
    Cooke, A., Gray, A.J.G., Ma, L., Nutt, W., Magowan, J., Oevers, M., Taylor, P., Byrom, R., Field, L., Hicks, S., Leake, J., Soni, M., Wilson, A., Cordenonsi, R., Cornwall, L., Djaoui, A., Fisher, S., Podhorszki, N., Coghlan, B., Kenny, S., OrsquoCallaghan, D.: R-GMA: An information integration system for Grid monitoring. In: On The Move to Meaningful Internet Systems 2003: CoopIS, DOA, and ODBASE. LNCS, vol. 2888, pp. 462–481. Springer, New York (2003)Google Scholar
  11. 11.
    Foster, I., Maguire, T., Snelling, D.: OGSA WSRF Basic Profile 1.0. Tech. Rep. GDF.72, Global Grid Forum (2006)Google Scholar
  12. 12.
    Foster, I.: Globus Toolkit Version 4: software for service-oriented systems. In: IFIP International Conference on Network and Parallel Computing. LNCS, no. 3779, pp. 2–13. Springer, New York (2006)Google Scholar
  13. 13.
    gLite: Lightweight Middleware for Grid Computing. http://glite.web.cern.ch/glite/. Accessed September 2008
  14. 14.
    Marzolla, M., Andreetto, P., Venturi, V., Ferraro, A., Memon, A.S., Memon, M.S., Twedell, B., Riedel, M., Mallmann, D., Streit, A., van de Berghe, S., Li, V., Snelling, D., Stamou, K., Shah, Z.A., Hedman, F.: Open standards-based interoperability of job submission and management interfaces across the Grid middleware platforms gLite and UNICORE. In: E-SCIENCE ’07: Proceedings of the Third IEEE International Conference on e-Science and Grid Computing, pp. 592–601. IEEE Computer Society, Washington, DC (2007). doi:10.1109/E-SCIENCE.2007.54 CrossRefGoogle Scholar
  15. 15.
    Hegering, H.G., Abeck, S., Neumair, B.: Integrated Management of Networked Systems: Concepts, Architectures, and Their Operational Application. Morgan Kaufmann, San Francisco (1999)Google Scholar
  16. 16.
    Adreozzi, S., Burke, S., Ehm, F., Field, L., Galang, G., Konya, B., Litmaath, M., Millar, P., Navarro, J. (ed.): GLUE 2.0 Specification V2.0. Tech. rep., Global Grid Forum (2008)Google Scholar
  17. 17.
    EDG: European Data Grid Project. http://eu-datagrid.web.cern.ch/. Accessed October 2008
  18. 18.
    DataTAG: Research & Technological Development for a Data TransAtlantic Grid. http://datatag.web.cern.ch/. Accessed October 2008
  19. 19.
    iVDGL: International Virtual Data Grid Laboratory. http://igoc.ivdgl.indiana.edu/. Accessed October 2008
  20. 20.
    LCG: Worldwide LHC Computing Grid. http://lcg.web.cern.ch/LCG/. Accessed October 2008
  21. 21.
    OSG: Open Science Grid. http://www.opensciencegrid.org/. Accessed October 2008
  22. 22.
    OGF: Open Grid Forum. http://www.ogf.org. Accessed October 2008
  23. 23.
    Mach, R., Lepro-Metz, R., Jackson, S.: Usage Record Format Recommendation. Tech. rep., Open Grid Forum (2006)Google Scholar
  24. 24.
    Wolf, A.: Spezifikation der D-Grid-Ressourcenbeschreibungssprache DGRDL. Tech. rep., Fraunhofer FIRST (2007)Google Scholar
  25. 25.
    Chem, X., Khan, A., Ainsworth, J., Newhouse, S., MacLaren, J.: WSI Resource Usage Service (RUS) Core Specification. Tech. rep., Open Grid Forum (2007)Google Scholar
  26. 26.
    Fielding, R.: Architectural styles and the design of network-based software architectures. Ph.D. Thesis, University of California, IRVINE (2000)Google Scholar
  27. 27.
    Baur, T., Saad, S.: Customer service management for grid monitoring and accounting data. In: Proceedings of the 18th IFIP/IEEE International Workshop on Distributed Systems: Operations and Management (DSOM 2007). Springer, New York (2007)Google Scholar
  28. 28.
    Baur, T.: Functional analysis and architecture for interoperable and DVO-̈specific Grid monitoring services. In: Proceedings of the Fourth IEEE International Conference on eScience (eScience 2008). IEEE Computer Society, Los Alamitos (2008)Google Scholar
  29. 29.
    UNICORE: Uniform Interface to Computer Resources. http://www.unicore.eu/. Accessed September 2008
  30. 30.
    Fuhrmann, P.: dCache, the Overview. http://www.dcache.org/manuals/dcache-whitepaper-light.pdf. Accessed September 2008. White Paper
  31. 31.
    Antonioletti, M., Atkinson, M.P., Baxter, R., Borley, A., Hong, N.C., Collins, B., Hardman, N., Hume, A., Knox, A., Jackson, M., Krause, A., Laws, S., Magowan, J., Paton, N., Pearson, D., Sugden, T., Watson, P., Westhead, M.: The Design and Implementation of Grid Database Services in OGSA-DAI. Concurrency and Computation: Practice and Experience 17(2–4), 357–376 (2005)CrossRefGoogle Scholar
  32. 32.
    Schopf, J.M., Pearlman, L., Miller, N., Kesselman, C., Foster, I., D’Arcy, M., Chervenak, A.: Monitoring the grid with the Globus Toolkit MDS4. Journal of Physics Conference Series 46, 521–525 (2006). doi:10.1088/1742-6596/46/1/072 CrossRefGoogle Scholar
  33. 33.
    Duarte, A., Nyczyk, P., Retico, A., Vicinanza, D.: Monitoring the EGEE/WLCG grid services. Journal of Physics: Conference Series 119(5), 052,014 (10pp) (2008). http://stacks.iop.org/1742-6596/119/052014
  34. 34.
    Memon, A.S., Memon, M.S., Wieder, P., Schuller, B.: CIS: An Information Service based on the Common Information Model. In: Proceedings of 3rd IEEE International Conference on e-Science and Grid Computing, pp. 465–472. IEEE Computer Society, Los Alamitos (2007)Google Scholar
  35. 35.
    Felde, V.D.G.O., Baur, T., Garschhammer, M., Reiser, H.: Anforderungen an das monitoring, ergebnisse aus der erhebung bei den communties und ressourcenanbietern im D-Grid. In: Rückemann, C.-P. (ed.) Ergebnisse der Studie und Anforde- rungsanalyse in den Fachgebieten Monitoring, Accounting, Billing bei den Communities und Ressourcenanbietern im D-Grid (D-Grid Report). http://www.d-grid.de/fileadmin/dgi_document/FG2/koordination_mab/mab_studie_ergebnisse.pdf (2006). Accessed October 2008
  36. 36.
    Baur, T., Felde, V.D.G.O., Reiser, H.: Konzepte zum Monitoring im D-Grid (D-Grid Report). http://www.d-grid.de/uploads/media/mab_monitoring_konzepte.pdf (2007). Accessed October 2008
  37. 37.
    Kunze, M., Pogoshyan, G.: Monitoring for multi-middleware grid. In: IEEE International Symposium on Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE Computer Society, Los Alamitos (2008)Google Scholar
  38. 38.
    Simmhan, Y.L., Plale, B., Gannon, D.: A Survey of Data Provenance Techniques. Tech. Rep. TR-618, Computer Science Department, Indiana University, Bloomington (2005)Google Scholar
  39. 39.
    Berry, D., Luniewski, A., Antonioletti, M.: OGSA Data Architecture. Tech. Rep. GDF.121, Global Grid Forum (2007)Google Scholar
  40. 40.
    Baur, T., Kalman, T., Lindinger, T., Milbert, A., Poghosyan, G., Romberg, M.: Middleware-übergreifendes Monitoring: Evaluierung und Auswahl von Komponenten (D-Grid Report). http://www.d-grid.de/fileadmin/user_upload/documents/D-MON/Komponenten-AP2.1-final.pdf. Accessed September 2008
  41. 41.
    Chaudhuri, S., Dayal, U.: Data warehousing and OLAP for decision support. In: SIGMOD ’97: Proceedings of the 1997 ACM SIGMOD international conference on Management of data, pp. 507–508. ACM, New York (1997). doi:10.1145/253260.253373 CrossRefGoogle Scholar
  42. 42.
    Venturi, V., Riedel, M., Memon, A.S., Memon, M.S., Stagni, F., Schuller, B., Mallmann, D., Tweddell, B., Gianoli, A., Ciaschini, V., van de Berghe, S., Snelling, D., Streit, A.: Using SAML-based VOMS for Authorization within Web Services-based UNICORE Grids. In: Bougé, L., Forsell, M., Träff, J.L., Streit, A., Ziegler, W., Alexander, M., Childs, S. (eds.) Euro-Par 2007 Workshops: Parallel Processing. LNCS, no. 4854, pp. 112–120. Springer, New York (2008)CrossRefGoogle Scholar
  43. 43.
    Adreozzi, S., Burke, S., Ehm, F., Field, L., Galang, G., Konya, B., Litmaath, M., Millar, P., Navarro, J. (ed.): GLUE v. 2.0—Reference to Concrete Data Models. Tech. Rep., Global Grid Forum (2008)Google Scholar
  44. 44.
    GeoMaint Project: Informationprovider (Sensor) for Geolocation and Maintenance Data. http://geomaint.sourceforge.net/. Accessed September 2008
  45. 45.
    The Vine Toolkit: http://www.gridsphere.org/gridsphere/gridsphere/guest/vine/r/. Accessed September 2008

Copyright information

© Springer Science+Business Media B.V. 2009

Authors and Affiliations

  • Timo Baur
    • 1
  • Rebecca Breu
    • 2
  • Tibor Kálmán
    • 3
  • Tobias Lindinger
    • 4
  • Anne Milbert
    • 5
  • Gevorg Poghosyan
    • 6
  • Helmut Reiser
    • 1
  • Mathilde Romberg
    • 2
  1. 1.Leibniz Supercomputing CentreGarchingGermany
  2. 2.Jülich Supercomputing CentreForschungszentrum Jülich GmbHJülichGermany
  3. 3.Gesellschaft fuer wissenschaftliche Datenverarbeitung mbHGöttingenGermany
  4. 4.Ludwig-Maximilians-Universität MünchenMünchenGermany
  5. 5.Max Planck Institute for Gravitational PhysicsGolmGermany
  6. 6.Steinbuch Centre for ComputingForschungszentrum Karlsruhe GmbHEggenstein-LeopoldshafenGermany

Personalised recommendations