Advertisement

Subsuming Multiple Sliding Windows for Shared Stream Computation

  • Kostas Patroumpas
  • Timos Sellis
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6909)

Abstract

Shared evaluation of multiple user requests is an utmost priority for stream processing engines in order to achieve high throughput and provide timely results. Given that most continuous queries specify windowing constraints, we suggest a multi-level scheme for concurrent evaluation of time-based sliding windows seeking for potential subsumptions among them. As requests may be registered or suspended dynamically, we develop a technique for choosing the most suitable embedding of a given window into a group composed of multi-grained time frames already employed for other queries. Intuitively, the proposed methodology ”clusters” windowed operators into common hierarchical constructs, thus drastically reducing the need for their separate evaluation. Our empirical study confirms that such a scheme achieves dramatic memory savings with almost negligible maintenance cost.

Keywords

Candidate Group Query Execution Continuous Query Distinct Item Window Query 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Arasu, A., Babu, S., Widom, J.: The CQL Continuous Query Language: Semantic Foundations and Query Execution. VLDB Journal 15(2), 121–142 (2006)CrossRefGoogle Scholar
  2. 2.
    Arasu, A., Widom, J.: Resource Sharing in Continuous Sliding-Window Aggregates. In: VLDB, pp. 336–347 (2004)Google Scholar
  3. 3.
    Babcock, B., Babu, S., Datar, M., Motwani, R., Widom, J.: Models and Issues in Data Stream Systems. In: PODS, pp. 1-16 (2002)Google Scholar
  4. 4.
    Golab, L., Tamer Özsu, M.: Update-Pattern-Aware Modeling and Processing of Continuous Queries. In: SIGMOD, pp. 658-669 (2005)Google Scholar
  5. 5.
    Golab, L., Bijay, K., Tamer Özsu, M.: Multi-Query Optimization of Sliding Window Aggregates by Schedule Synchronization. In: CIKM, pp. 844-845 (2006)Google Scholar
  6. 6.
    Hammad, M., Franklin, M., Aref, W., Elmagarmid, A.: Scheduling for Shared Window Joins over Data Streams. In: VLDB, pp. 297-308 (2003)Google Scholar
  7. 7.
    Jain, N., Mishra, S., Srinivasan, A., Gehrke, J., Widom, J., Balakrishnan, H., Çetintemel, U., Cherniack, M., Tibbetts, R., Zdonik, S.: Towards a Streaming SQL Standard. In: VLDB, pp. 1379-1390 (2008)Google Scholar
  8. 8.
    Krishnamurthy, S., Wu, C., Franklin, M.J.: On-the-Fly Sharing for Streamed Aggregation. In: SIGMOD, pp. 623-634 (2006)Google Scholar
  9. 9.
    Li, J., Maier, D., Tufte, K., Papadimos, V., Tucker, P.: No Pane, No Gain: Efficient Evaluation of Sliding-Window Aggregates over Data Streams. ACM SIGMOD Record 34(1), 39–44 (2005)CrossRefGoogle Scholar
  10. 10.
    Patroumpas, K., Sellis, T.: Multi-granular Time-based Sliding Windows over Data Streams. In: TIME, pp. 146-153 (2010)Google Scholar
  11. 11.
    Patroumpas, K., Sellis, T.: Maintaining consistent Results of Continuous Queries under Diverse Window Specifications. Information Systems 36(1), 42–61 (2011)CrossRefGoogle Scholar
  12. 12.
    Sellis, T.K.: Multiple-Query Optimization. ACM TODS 13(1), 23–52 (1988)CrossRefGoogle Scholar
  13. 13.
    Stonebraker, M., Çetintemel, U., Zdonik, S.: The 8 Requirements of Real-Time Stream Processing. ACM SIGMOD Record 34(4), 42–47 (2005)CrossRefGoogle Scholar
  14. 14.
    Tucker, P., Maier, D., Sheard, T., Fegaras, L.: Exploiting Punctuation Semantics in Continuous Data Streams. IEEE TKDE 15(3), 555–568 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Kostas Patroumpas
    • 1
  • Timos Sellis
    • 1
    • 2
  1. 1.School of Electrical and Computer EngineeringNational Technical University of AthensHellasGreece
  2. 2.Institute for the Management of Information SystemsR.C. ”Athena”HellasGreece

Personalised recommendations