On-Line Grid Monitoring Based on Distributed Query Processing
- Cite this paper as:
- Balis B., Dyk G., Bubak M. (2012) On-Line Grid Monitoring Based on Distributed Query Processing. In: Wyrzykowski R., Dongarra J., Karczewski K., Waśniewski J. (eds) Parallel Processing and Applied Mathematics. PPAM 2011. Lecture Notes in Computer Science, vol 7204. Springer, Berlin, Heidelberg
Existing Grid monitoring approaches do not combine three desirable features: on-line access to monitoring data, advanced query capabilities and data reduction. We present a solution for on-line monitoring of large-scale computing infrastructures based on Complex Event Processing principles and technologies. We focus on leveraging CEP for distributed processing of client queries and monitoring data streams. This results in significant reduction of network traffic due to on-line monitoring. We discuss benefits of CEP-based approach to monitoring and describe details of processing queries in a distributed way. A case study – monitoring of load caused by jobs in a Grid infrastructure – is presented. Performance evaluation to investigate monitoring overhead in terms of CPU, memory and network traffic is also provided.
Keywordson-line monitoring grid infrastructure complex event processing
Unable to display preview. Download preview PDF.