Assessing and Optimizing Microarchitectural Performance of Event Processing Systems

  • Marcelo R. N. Mendes
  • Pedro Bizarro
  • Paulo Marques
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6417)

Abstract

Event Processing (EP) systems are being progressively used in business critical applications in domains such as algorithmic trading, supply chain management, production monitoring, or fraud detection. To deal with high throughput and low response time requirements, these EP systems mainly use the CPU-RAM sub-system for data processing. However, as we show here, collected statistics on CPU usage or on CPU-RAM communication reveal that available systems are poorly optimized and grossly waste resources. In this paper we quantify some of these inefficiencies and propose cache-aware algorithms and changes on internal data structures to overcome them. We test the before and after system both at the microarchitecture and application level and show that: i) the changes improve microarchitecture metrics such as clocks-per-instruction, cache misses or TLB misses; ii) and that some of these improvements result in very high application level improvements such as a 44% improvement on stream-to-table joins with 6-fold reduction on memory consumption, and order-of-magnitude increase on throughput for moving aggregation operations.

Keywords

Benchmarking Complex Event Processing Performance Tuning 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Marcelo R. N. Mendes
    • 1
  • Pedro Bizarro
    • 1
  • Paulo Marques
    • 1
  1. 1.Dep. Eng. Informática – Pólo IICISUC, University of CoimbraCoimbraPortugal

Personalised recommendations