Abstract
Existing Grid monitoring approaches do not combine three desirable features: on-line access to monitoring data, advanced query capabilities and data reduction. We present a solution for on-line monitoring of large-scale computing infrastructures based on Complex Event Processing principles and technologies. We focus on leveraging CEP for distributed processing of client queries and monitoring data streams. This results in significant reduction of network traffic due to on-line monitoring. We discuss benefits of CEP-based approach to monitoring and describe details of processing queries in a distributed way. A case study – monitoring of load caused by jobs in a Grid infrastructure – is presented. Performance evaluation to investigate monitoring overhead in terms of CPU, memory and network traffic is also provided.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Andreozzi, S., Bortoli, N.D., Fantinel, S., Ghiselli, A., Rubini, G.L., Tortone, G., Vistoli, M.C.: GridICE: a monitoring service for Grid systems. Future Generation Computer Systems 21(4), 559–571 (2005)
Balis, B., Kowalewski, B., Bubak, M.: Real-time Grid monitoring based on complex event processing. Future Generation Computer Systems 27(8), 1103–1112 (2011), http://www.sciencedirect.com/science/article/pii/S0167739X11000562
Bolze, R., Caron, E., Desprez, F., Hoesch, G., Pontvieux, C.: A Monitoring and Visualization Tool and Its Application for a Network Enabled Server Platform. In: Gavrilova, M.L., Gervasi, O., Kumar, V., Tan, C.J.K., Taniar, D., Laganá, A., Mun, Y., Choo, H. (eds.) ICCSA 2006. LNCS, vol. 3984, pp. 202–213. Springer, Heidelberg (2006)
Cooke, A., Gray, A.J.G., Ma, L., Nutt, W., Magowan, J., Oevers, M., Taylor, P., Byrom, R., Field, L., Hicks, S., Leake, J., Soni, M., Wilson, A., Cordenonsi, R., Cornwall, L., Djaoui, A., Fisher, S., Podhorszki, N., Coghlan, B.A., Kenny, S., O’Callaghan, D.: R-GMA: An Information Integration System for Grid Monitoring. In: Meersman, R., Schmidt, D.C. (eds.) CoopIS/DOA/ODBASE 2003. LNCS, vol. 2888, pp. 462–481. Springer, Heidelberg (2003)
Funika, W., Kryza, B., Slota, R., Kitowski, J., Skalkowski, K., Sendor, J., Krol, D.: Monitoring of SLA Parameters within VO for the SOA Paradigm. In: Wyrzykowski, R., Dongarra, J., Karczewski, K., Wasniewski, J. (eds.) PPAM 2009, Part II. LNCS, vol. 6068, pp. 115–124. Springer, Heidelberg (2010)
Gorla, A., Mariani, L., Pastore, F., Pezzè, M., Wuttke, J.: Achieving Cost-Effective Software Reliability Through Self-Healing. Computing and Informatics 29(1), 93–115 (2010)
Legrand, I.C., Newman, H.B.: MonALISA: An Agent based, Dynamic Service System to Monitor, Control and Optimize Grid based Applications. In: CHEP 2004 (2004)
Smallen, S., Ericson, K., Hayes, J., Olschanowsky, C.: User-level grid monitoring with Inca 2. In: GMW 2007: Proceedings of the 2007 Workshop on Grid Monitoring, pp. 29–38. ACM, New York (2007)
Smith, M., Schwarzer, F., Harbach, M., Noll, T., Freisleben, B.: A Streaming Intrusion Detection System for Grid Computing Environments. In: Proc. HPCC 2009, pp. 44–51. IEEE Computer Society, Washington, DC (2009)
Truong, H.L., Fahringer, T.: SCALEA-G: a Unified Monitoring and Performance Analysis System for the Grid. Scientific Programming 12(4), 225–237 (2004)
Wright, H., Crompton, R., Kharche, S., Wenisch, P.: Steering and visualization: Enabling technologies for computational science. Future Generation Computer Systems 26(3), 506–513 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Balis, B., Dyk, G., Bubak, M. (2012). On-Line Grid Monitoring Based on Distributed Query Processing. In: Wyrzykowski, R., Dongarra, J., Karczewski, K., Waśniewski, J. (eds) Parallel Processing and Applied Mathematics. PPAM 2011. Lecture Notes in Computer Science, vol 7204. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31500-8_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-31500-8_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31499-5
Online ISBN: 978-3-642-31500-8
eBook Packages: Computer ScienceComputer Science (R0)