Benchmarking Grid Information Systems

  • Laurence Field
  • Rizos Sakellariou
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6852)


Grid information systems play a central role in today’s production Grid infrastructures, enabling the discovery of a range of information about the Grid services that exist in an infrastructure. As the number of services within these infrastructures continues to grow, it must be understood whether the current implementations are able to scale to meet the future requirements. Existing approaches for evaluating Grid information systems mainly focus on performance metrics and do not consider the quality of the information itself. This paper proposes a comprehensive benchmarking methodology for the evaluation of Grid information systems which includes a metric to assess the quality of the information returned. Using this methodology, two commonly used Grid information system implementations, Metadata Directory Service (MDS) and the Berkeley Database Information Index (BDII), are evaluated using data obtained from the Enabling Grids for E-SciencE (EGEE) production Grid.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Andreozzi, S., Burke, S., Field, L., Litmaath, M.: GLUE schema version 1.3,
  2. 2.
    Czajkowski, K., Fitzgerald, S., Foster, I., Kesselman, C.: Grid information services for distributed resource sharing. In: Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing, San Francisco, CA, USA, pp. 181–194 (2001)Google Scholar
  3. 3.
    Ehm, F., Field, L., Schulz, M.W.: Scalability and performance analysis of the EGEE information system. Journal of Physics: Conference Series 119(6), 062029 (2008)Google Scholar
  4. 4.
    Field, L., Andreozzi, S., Konya, B.: Grid information system interoperability: The need for a common information model. In: Proceedings of the 4th IEEE International Conference on eScience, Indianapolis, IN, USA, pp. 501–507 (2008)Google Scholar
  5. 5.
    Field, L., Sakellariou, R.: How dynamic is the grid? Towards a quality metric for grid information systems. In: Proceedings of the 11th ACM/IEEE International Conference on Grid Computing, Brussels, Belgium, pp. 113–120 (2010)Google Scholar
  6. 6.
    Field, L., Schulz, M.W.: Grid deployment experiences: The path to a production quality LDAP based grid information system. In: Proceedings of the Conference for Computing in High-Energy and Nuclear Physics, pp. 723–726 (2004)Google Scholar
  7. 7.
    Fitzgerald, S., Foster, I., Kesselman, C., von Laszewski, G., Smith, W., Tuecke, S.: A directory service for configuring high-performance distributed computations. In: Proceedings of the 6th IEEE International Symposium on High Performance Distributed Computing, Portland, OR, USA, pp. 365–375 (1997)Google Scholar
  8. 8.
    Gagliardi, F., Jones, B., Grey, F., Heikkurinen, M.: Building an infrastructure for scientific grid computing: status and goals of the EGEE project. Philosophical Transactions. Series A, Mathematical, Physical, and Engineering Sciences 363(1833), 1729–1742 (2005)CrossRefGoogle Scholar
  9. 9.
    Plale, B., Jacobs, C., Jenson, S., Liu, Y., Moad, C., Parab, R., Vaidya, P.: Understanding grid resource information management through a synthetic database benchmark/workload. In: Proceedings of the 4th IEEE International Symposium on Cluster Computing and the Grid (CCGrid), Chicago, IL, USA, pp. 277–284 (2004)Google Scholar
  10. 10.
    Riedel, M.: Interoperation of world-wide production e-Science infrastructures. Concurrency and Computation: Practice and Experience 21(8), 961–990 (2009)CrossRefGoogle Scholar
  11. 11.
    Smith, W., Waheed, A., Meyers, D., Yan, J.: An evaluation of alternative designs for a grid information service. In: Proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing, Pittsburgh, PA, USA, pp. 185–192 (2000)Google Scholar
  12. 12.
    Zanikolas, S., Sakellariou, R.: An importance-aware architecture for large-scale grid information services. Parallel Processing Letters 18(3), 347–370 (2008)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Zhang, X., Freschl, J., Schopf, J.: A performance study of monitoring and information services for distributed systems. In: Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing, Seattle, WA, USA, pp. 270–281 (2003)Google Scholar
  14. 14.
    Zhang, X., Freschl, J.L., Schopf, J.M.: Scalability analysis of three monitoring and information systems: MDS2, R-GMA, and Hawkeye. Journal of Parallel and Distributed Computing (JPDC) 67(8), 883–902 (2007)CrossRefMATHGoogle Scholar
  15. 15.
    Zhang, X., Schopf, J.: Performance analysis of the globus toolkit monitoring and discovery service, MDS2. In: IEEE International Conference on Performance, Computing, and Communications, Phoenix, AZ, USA, pp. 843–849 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Laurence Field
    • 1
  • Rizos Sakellariou
    • 2
  1. 1.CERNGenevaSwitzerland
  2. 2.The University of ManchesterManchesterUK

Personalised recommendations