Abstract
Event processing engines are used in diverse mission-critical scenarios such as fraud detection, traffic monitoring, or intensive care units. However, these scenarios have very different operational requirements in terms of, e.g., types of events, queries/patterns complexity, throughput, latency and number of sources and sinks. What are the performance bottlenecks? Will performance degrade gracefully with increasing loads? In this paper we make a first attempt to answer these questions by running several micro-benchmarks on three different engines, while we vary query parameters like window size, window expiration type, predicate selectivity, and data values. We also perform some experiments to assess engines scalability with respect to number of queries and propose ways for evaluating their ability in adapting to changes in load conditions. Lastly, we show that similar queries have widely different performances on the same or different engines and that no engine dominates the other two in all scenarios.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abadi, D.J., et al.: Aurora. A New Model and Architecture for Data Stream Management. VLDB Journal 12, 120–139 (2003)
Arasu, A., et al.: STREAM: The Stanford Stream Data Manager. In: Proc. SIGMOD 2003 (2003)
Arasu, A., et al.: Linear Road: A Stream Data Management Benchmark. In: Proc. of VLDB 2004 (2004)
Babcock, B., et al.: Models and Issues in Data Stream Systems. In: Proc. of SIGMOD 2002 (2002)
Berndtsson, M., et al.: Performance Evaluation of Object-Oriented Active Database Management Systems Using the BEAST Benchmark. Theory and Practice of Object Systems 4(3), 135–149 (1998)
Bizarro, P., et al.: Event Processing Use Cases. In: Tutorial, DEBS 2009, Nashville USA (2009)
Chandrasekaran, S., et al.: TelegraphCQ: Continuous dataflow processing for an uncertain world. In: Proc. of CIDR 2003 (2003)
Dekkers, P.: Master Thesis Computer Science. Complex Event Processing. Radboud University Nijmegen, Thesis number 574 (October 2007)
DSAL Real-Time Event Processing Benchmark, http://www.datastreamanalysis.com/images/Real-Time%20EP%20Benchmark.pdf
Chakravarthy, S., Mishra, D.: Snoop: An Expressive Event Specification Language for Active Databases. Data Knowl. Eng. (DKE) 14(1), 1–26 (1994)
Esper, http://esper.codehaus.org/
Golab, L., Özsu, M.T.: Issues in data stream management. SIGMOD Record 32(2), 5–14 (2003)
Gray, J. (ed.): The Benchmark Handbook for Database and Transaction Processing Systems, 2nd edn. Morgan Kaufmann, San Francisco (1993)
Gray, J., et al.: Data Cube: A Relational Aggregation Operator Generalizing Group-by, Cross-Tab, and Sub Totals. Data Min. Knowl. Discov. 1(1), 29–53 (1997)
Mendes, M.R.N., Bizarro, P., Marques, P.: A Framework for Performance Evaluation of Complex Event Processing Systems. In: Proc. of DEBS 2008 (2008)
Motwani, R., et al.: Query Processing, Resource Management, and Approximation in a Data Stream Management System. In: Proc. of CIDR 2003 (2003)
NEXMark Benchmark, http://datalab.cs.pdx.edu/niagara/NEXMark/
Sachs, K., Kounev, S., Bacon, J.M., Buchmann, A.: Workload Characterization of the SPECjms2007 Benchmark. In: Wolter, K. (ed.) EPEW 2007. LNCS, vol. 4748, pp. 228–244. Springer, Heidelberg (2007)
STAC-A1 Benchmark, http://www.stacresearch.com/council
STAC Report: Aleri Order Book Consolidation on Intel Tigertown and Solaris 10, http://www.stacresearch.com/node/3844
Stream Query Repository, http://infolab.stanford.edu/stream/sqr/
White, S., Alves, A., Rorke, D.: WebLogic event server: a lightweight, modular application server for event processing. In: Proc. of DEBS 2008 (2008)
Wu, E., Diao, Y., Rizvi, S.: High Performance Complex Event Processing over Streams. In: Proc. of SIGMOD 2006 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mendes, M.R.N., Bizarro, P., Marques, P. (2009). A Performance Study of Event Processing Systems. In: Nambiar, R., Poess, M. (eds) Performance Evaluation and Benchmarking. TPCTC 2009. Lecture Notes in Computer Science, vol 5895. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10424-4_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-10424-4_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-10423-7
Online ISBN: 978-3-642-10424-4
eBook Packages: Computer ScienceComputer Science (R0)