CEPBen: A Benchmark for Complex Event Processing Systems

  • Chunhui Li
  • Robert Berry
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8391)

Abstract

Complex Event processing (CEP) has emerged over the last ten years. CEP systems are outstanding in processing large amount of data and responding in a timely fashion. While CEP applications are fast growing, performance management in this area has not gain much attention. It is critical to meet the promised level of service for both system designers and users. In this paper, we present a benchmark for complex event processing systems: CEPBen. The CEPBen benchmark is designed to evaluate CEP functional behaviours, i.e., filtering, transformation and event pattern detection and provides a novel methodology of evaluating the performance of CEP systems. A performance study by running the CEPBen on Esper CEP engine is described and discussed. The results obtained from performance tests demonstrate the influences of CEP functional behaviours on the system performance.

Keywords

Complex Event Processing Performance Evaluation Benchmark Complexity Throughput Response Time 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Esper performance (2007), http://docs.codehaus.org/
  2. 2.
    Oracle complex event processing performance (November 2008), http://www.oracle.com/
  3. 3.
    Oracle complex event processing exalogic performance study - an oracle white paper (2011), http://www.oracle.com/
  4. 4.
    Arasu, A., Cherniack, M., Galvez, E., Maier, D., Maskey, A., Ryvkina, E., Stonebraker, M., Tibbetts, R.: Linear road: A stream data management benchmark. In: VLDB Conference (September 2004)Google Scholar
  5. 5.
    Bizarro, P.: Bicep - benchmarking complex event processing systems. In: Chandy, M., Etzion, O., von Ammon, R. (eds.) Event Processing, Dagstuhl, Germany. Dagstuhl Seminar Proceedings, number 07191, Internationales Begegnungs- und Forschungszentrum für Informatik (IBFI), Schloss Dagstuhl, Germany (2007)Google Scholar
  6. 6.
    Carey, M.J., DeWitt, D.J., Naughton, J.F.: The 007 benchmark. SIGMOD Rec. 22(2), 12–21 (1993)CrossRefGoogle Scholar
  7. 7.
    Carey, M.J., DeWitt, D.J., Kant, C., Naughton, J.F.: A status report on the oo7 oodbms benchmarking effort. In: OOPSLA 1994: Proceedings of the Ninth Annual Conference on Object-Oriented Programming Systems, Language, and Applications, pp. 414–426. ACM, New York (1994)CrossRefGoogle Scholar
  8. 8.
    Chandy, M.K., Etzion, O., Ammon, von Ammon, R.: 10201 executive summary and manifesto–event processing. Event Processing (10201) (2011)Google Scholar
  9. 9.
    EsperTech Inc. Esper Reference, version 4.9.0 edition (2012)Google Scholar
  10. 10.
    Etzion, O., Niblett, P.: Event Processing in Action. Manning Publication Co., Stamford (2011)Google Scholar
  11. 11.
    Geppert, A., Gatziu, S., Dittrich, K.R.: A designer’s benchmark for active database management systems: 007 meets the beast. In: Sellis, T.K. (ed.) RIDS 1995. LNCS, vol. 985, pp. 309–326. Springer, Heidelberg (1995)CrossRefGoogle Scholar
  12. 12.
    Grabs, T., Lu, M.: Measuring performance of complex event processing systems, pp. 83–96 (2012)Google Scholar
  13. 13.
    Isoyama, K., Kobayashi, Y., Sato, T., Kida, K., Yoshida, M., Tagato, H.: A scalable complex event processing system and evaluations of its performance, pp. 123–126 (2012)Google Scholar
  14. 14.
    Kounev, S., Bacon, J., Sachs, K., Buchmann, A.: A methodology for performance modeling of distributed event-based systems. In: 11th IEEE Symposium on Object Oriented Real-Time Distributed Computing (ISORC) (2008)Google Scholar
  15. 15.
    Lakshmanan, G.T., Rabinovich, Y.G., Etzion, O.: A stratified approach for supporting high throughput event processing applications. In: DEBS 2009: Proceedings of the Third ACM International Conference on Distributed Event-Based Systems, pp. 1–12. ACM, New York (2009)Google Scholar
  16. 16.
    Luckham, D.C.: Event Processing for Business: Organizing the Real Time Enterprise. John Wiley & Sons (2011)Google Scholar
  17. 17.
    Mendes, M.R.N., Bizarro, P., Marques, P.: A performance study of event processing systems. In: Nambiar, R., Poess, M. (eds.) TPCTC 2009. LNCS, vol. 5895, pp. 221–236. Springer, Heidelberg (2009)Google Scholar
  18. 18.
    Schmidt, A.R., Waas, F., Kersten, M.L., Florescu, D., Manolescu, I., Carey, M.J., Busse, R.: The xml benchmark project. Technical report, Amsterdam, The Netherlands (2001)Google Scholar
  19. 19.
    Tibbetts, R.: Performance & scalability characterization., http://www.streambase.com
  20. 20.
    Wu, E., Diao, Y., Rizvi, S.: High-performance complex event processing over streams, pp. 407–418 (2006)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Chunhui Li
    • 1
  • Robert Berry
    • 1
  1. 1.Aston UniversityBirminghamU.K.

Personalised recommendations