Distributed Query Engine for Multiple-Query Optimization over Data Stream

  • Junye Yang
  • Yong ZhangEmail author
  • Jin Wang
  • Chunxiao Xing
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11448)


Query processing over data stream has attracted much attention in real-time applications. While many efforts have been paid for query processing of data streams in distributed environment, no previous study focused on multiple-query optimization. To address this problem, we propose EsperDist, a distributed query engine for multiple-query optimization over data stream. EsperDist can significant reduce the overhead of network transmission and memory usage by reusing operators in the query plan. Moreover, EsperDist also makes best effort to minimize the query cost so as to avoid resource bottle neck in a single machine. In this demo, we will present the architecture and work-flow of EsperDist using datasets collected from real world applications. We also propose a user-friendly to monitor query results and interact with the system in real time.



This work was supported by NSFC (91646202), National Key R&D Program of China (SQ2018YFB140235), and the 1000-Talent program.


  1. 1.
    Ao, X., Luo, P., Wang, J., Zhuang, F., He, Q.: Mining precise-positioning episode rules from event sequences. IEEE Trans. Knowl. Data Eng. 30(3), 530–543 (2018)CrossRefGoogle Scholar
  2. 2.
    Babcock, B., Babu, S., Datar, M., Motwani, R.: Chain: operator scheduling for memory minimization in data stream systems. In: SIGMOD, pp. 253–264 (2003)Google Scholar
  3. 3.
    Cherniack, M., et al.: Scalable distributed stream processing. In: CIDR (2003)Google Scholar
  4. 4.
    Gu, J., Wang, J., Zaniolo, C.: Ranking support for matched patterns over complex event streams: the CEPR system. In: ICDE, pp. 1354–1357 (2016)Google Scholar
  5. 5.
    Repantis, T., Gu, X., Kalogeraki, V.: Synergy: sharing-aware component composition for distributed stream processing systems. In: van Steen, M., Henning, M. (eds.) Middleware 2006. LNCS, vol. 4290, pp. 322–341. Springer, Heidelberg (2006). Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Junye Yang
    • 1
  • Yong Zhang
    • 1
    Email author
  • Jin Wang
    • 2
  • Chunxiao Xing
    • 1
  1. 1.RIIT, TNList, Department of Computer Science and TechnologyTsinghua UniversityBeijingChina
  2. 2.Computer Science DepartmentUniversity of CaliforniaLos AngelesUSA

Personalised recommendations