On-Line Grid Monitoring Based on Distributed Query Processing

  • Bartosz Balis
  • Grzegorz Dyk
  • Marian Bubak
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7204)

Abstract

Existing Grid monitoring approaches do not combine three desirable features: on-line access to monitoring data, advanced query capabilities and data reduction. We present a solution for on-line monitoring of large-scale computing infrastructures based on Complex Event Processing principles and technologies. We focus on leveraging CEP for distributed processing of client queries and monitoring data streams. This results in significant reduction of network traffic due to on-line monitoring. We discuss benefits of CEP-based approach to monitoring and describe details of processing queries in a distributed way. A case study – monitoring of load caused by jobs in a Grid infrastructure – is presented. Performance evaluation to investigate monitoring overhead in terms of CPU, memory and network traffic is also provided.

Keywords

on-line monitoring grid infrastructure complex event processing 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Andreozzi, S., Bortoli, N.D., Fantinel, S., Ghiselli, A., Rubini, G.L., Tortone, G., Vistoli, M.C.: GridICE: a monitoring service for Grid systems. Future Generation Computer Systems 21(4), 559–571 (2005)CrossRefGoogle Scholar
  2. 2.
    Balis, B., Kowalewski, B., Bubak, M.: Real-time Grid monitoring based on complex event processing. Future Generation Computer Systems 27(8), 1103–1112 (2011), http://www.sciencedirect.com/science/article/pii/S0167739X11000562 CrossRefGoogle Scholar
  3. 3.
    Bolze, R., Caron, E., Desprez, F., Hoesch, G., Pontvieux, C.: A Monitoring and Visualization Tool and Its Application for a Network Enabled Server Platform. In: Gavrilova, M.L., Gervasi, O., Kumar, V., Tan, C.J.K., Taniar, D., Laganá, A., Mun, Y., Choo, H. (eds.) ICCSA 2006. LNCS, vol. 3984, pp. 202–213. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  4. 4.
    Cooke, A., Gray, A.J.G., Ma, L., Nutt, W., Magowan, J., Oevers, M., Taylor, P., Byrom, R., Field, L., Hicks, S., Leake, J., Soni, M., Wilson, A., Cordenonsi, R., Cornwall, L., Djaoui, A., Fisher, S., Podhorszki, N., Coghlan, B.A., Kenny, S., O’Callaghan, D.: R-GMA: An Information Integration System for Grid Monitoring. In: Meersman, R., Schmidt, D.C. (eds.) CoopIS/DOA/ODBASE 2003. LNCS, vol. 2888, pp. 462–481. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  5. 5.
    Funika, W., Kryza, B., Slota, R., Kitowski, J., Skalkowski, K., Sendor, J., Krol, D.: Monitoring of SLA Parameters within VO for the SOA Paradigm. In: Wyrzykowski, R., Dongarra, J., Karczewski, K., Wasniewski, J. (eds.) PPAM 2009, Part II. LNCS, vol. 6068, pp. 115–124. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  6. 6.
    Gorla, A., Mariani, L., Pastore, F., Pezzè, M., Wuttke, J.: Achieving Cost-Effective Software Reliability Through Self-Healing. Computing and Informatics 29(1), 93–115 (2010)Google Scholar
  7. 7.
    Legrand, I.C., Newman, H.B.: MonALISA: An Agent based, Dynamic Service System to Monitor, Control and Optimize Grid based Applications. In: CHEP 2004 (2004)Google Scholar
  8. 8.
    Smallen, S., Ericson, K., Hayes, J., Olschanowsky, C.: User-level grid monitoring with Inca 2. In: GMW 2007: Proceedings of the 2007 Workshop on Grid Monitoring, pp. 29–38. ACM, New York (2007)CrossRefGoogle Scholar
  9. 9.
    Smith, M., Schwarzer, F., Harbach, M., Noll, T., Freisleben, B.: A Streaming Intrusion Detection System for Grid Computing Environments. In: Proc. HPCC 2009, pp. 44–51. IEEE Computer Society, Washington, DC (2009)Google Scholar
  10. 10.
    Truong, H.L., Fahringer, T.: SCALEA-G: a Unified Monitoring and Performance Analysis System for the Grid. Scientific Programming 12(4), 225–237 (2004)Google Scholar
  11. 11.
    Wright, H., Crompton, R., Kharche, S., Wenisch, P.: Steering and visualization: Enabling technologies for computational science. Future Generation Computer Systems 26(3), 506–513 (2010)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Bartosz Balis
    • 1
  • Grzegorz Dyk
    • 2
  • Marian Bubak
    • 1
    • 2
  1. 1.Department of Computer ScienceAGH UniversityKrakowPoland
  2. 2.ACC Cyfronet AGHAGH UniversityKrakowPoland

Personalised recommendations