Skip to main content
SpringerLink
Log in

Consistent collective evaluation of multiple continuous queries for filtering heterogeneous data streams

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

Query processing for a data stream should also be continuous and rapid. This article proposes a novel approach for consistent collective evaluation of multiple continuous queries for filtering two different types of data streams: a relational stream and an XML stream. The proposed approach commonly provides region-based selection constructs: an attribute selection construct for relational queries and a path selection construct for XPath queries. Both collectively evaluate the selection predicates of the same attribute (path), based on the precomputed matching results of the queries in each of the disjoint regions divided by the selection predicates. The performance experiments show that the proposed approach is practically more efficient and stable than other approaches at run-time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Abadi D, Carney D, Cetintemel U, Cherniack M, Convey C, Lee S, Stonebraker M, Tatbul N, Zdonik S (2003) Aurora: a new model and architecture for data stream management. VLDB J 12: 120–139

    Article  Google Scholar 

  2. Altinel M, Franklin MJ (2000) Efficient filtering of XML documents for selective dissemination of information. In: Proceedings of the 26th international conference on very large databases, Cairo, pp 53–64

  3. Avnur R, Hellerstein J (2000) Eddies: continuously adaptive query processing. In: Proceedings of ACM SIGMOD international conference on management of data, Dallas, pp 261–272

  4. Babcock B, Babu S, Datar M, Motwani R, Widom J (2002) Models and issues in data stream systems. In: Proceedings of ACM symposium on principles of database systems, pp 1–16

  5. Bruno N, Gravano L, Koudas N, Srivastava D (2003) Navigation- vs. index-based XML multi-query processing. In: Proceedings of international conference on data engineering, (Bangalore), pp 139–150

  6. Carney D, Cetintemel U, Cherniack M, Convey C, Lee S, Seidman G, Stonebraker M, Tatbul N, Zdonik S (2002) Monitoring streams—a new class of data management applications. In: Proceedings of the 28th international conference on very large databases (August), pp 215–226

  7. Chan CY, Felber P, Garofalakis M, Rastogi R (2002) Efficient filtering of XML documents with XPath expressions. VLDB J 11: 354–379

    Article  MATH  Google Scholar 

  8. Chandrasekaran S, Franklin MJ (2002) Streaming queries over streaming data. In: Proceedings of the 28th international conference on very large databases (August)

  9. Chen J, DeWitt DJ, Tian F, Wang Y (2000) NiagaraCQ: a scalable continuous query system for internet databases. In: Proceedings of ACM SIGMOD international conference on management of data, Dallas, pp 379–390

  10. Clark J, DeRose S (1999) XML Path Language (XPath) Version 1.0”, W3C Recommendation. http://www.w3.org/TR/1999/REC-xpath-19991116

  11. Diao Y, Franklin M (2003) Query processing for high-volume XML message brokering. In: Proceedings of the 28th international conference on very large database, pp 261–272

  12. Diao Y, Altinel M, Franklin MJ, Zhang H, Fischer P (2002) Path matching and predicate evaluation for high-performance XML filtering. ACM Trans Database Syst 28(4): 467–516

    Article  Google Scholar 

  13. Diao Y, Fischer PM, Franklin MJ, To R (2002) YFilter: efficient and scalable filtering of XML documents. In: Proceedings of the 18th international conference on data engineering, San Jose, pp 341–342

  14. Ding L, Rundensteiner EA, Herneman G (2003) MJoin: a metadata-aware stream join operator. In: Proceedings of the 2nd international workshop on distributed event-based systems, San Diego

  15. Gokmen H, Ulusoy O (2000) Transmission of continuous query results in mobile computing systems. Inf Sci 125(1–4): 37–63

    Google Scholar 

  16. Green TJ, Miklau G, Onizuka M, Suciu D (2003) Processing XML streams with deterministic Automata. In: Proceedings of international conference on database theory, Siena, pp 173–189

  17. Groppe J, Groppe S (2006) Satisfiability-test, rewriting and refinement of users’ XPath queries according to XML schema definitions. Advances in databases and information systems (ADBIS), Thessaloniki

  18. Gupta AK, Suciu D (2003) Stream processing of XPath queries with predicates. In: Proceedings of ACM SIGMOD international conference on management of data, San Diego, pp 419–430

  19. Ives ZG, Halevy AY, Weld D (2002) An XML query engine for network-bound data. VLDB J 11(4): 380–402

    Article  MATH  Google Scholar 

  20. Josifovski V, Fontoura M, Barta A (2004) Querying XML streams. VLDB J 14: 197–210

    Article  Google Scholar 

  21. Madden SR, Shah M, Hellerstein JM, Raman V (2002) Continuously adaptive continuous queries over streams. In: Proceedings of ACM SIGMOD international conference on management of data, Madison, June)

  22. Motwani R, Widom J, Arasu A, Babcock B, Babu S, Datar M, Manku G, Olston C, Rosenstein J, Varma R (2003) Query processing, resource management, and approximation in a data stream management system. In: Proceedings of first biennial conference on innovative data systems research, Asilomar, January 245–256

  23. Munagala K, Srivastava U, Widom J (2006) Optimization of continuous queries with shared expensive filters. In: Proceedings of international conference on very large dataBase, Seoul

  24. Ng W, Lam W-Y, Wood PT, Levene M (2006) XCQ: a queriable XML compression system. Knowl Inf Syst 10(4): 421–452

    Article  Google Scholar 

  25. Tatbul N, Çetintemel U, Zdonik S, Cherniack M, Stonebraker M (2003) Load shedding in a data stream manager. In: Proceedings of the 29th international conference on very large data bases, Berlin, pp 309–320

  26. Urhan T, Franklin MJ (2000) XJoin: a reactively-scheduled pipelined join operator. Bull IEEE Comput Soc Technical Committee Data Eng 23(2): 27–33

    Google Scholar 

  27. Wu K-L, Chen S-K, Yu PS (2006) Query indexing with containment-encoded intervals for efficient stream processing. Knowl Inform Syst 9(1): 62–90

    Article  Google Scholar 

  28. Wei L, Keogh E, Herle HV, Mafra-Neto A, Abbott RJ (2003) Efficient query filtering for streaming time series with applications to semisupervised learning of time series classifiers. Knowl Inf Syst 11(3): 313–344

    Article  Google Scholar 

  29. http://kdd.ics.uci.edu, UCI KDD Archive

Download references

Author information

Authors and Affiliations

  1. Division of Computer Information, Anyang Technical College, San39-1 Anyang3-Dong Manan-Gu Anyang-Si, Gyeonggi-Do, South Korea

    Hyun-Ho Lee

  2. Department of Computer Science, Yonsei University, 134 Sedaemoongu Shinchondong, Seoul, South Korea

    Won-Suk Lee

Authors
  1. Hyun-Ho Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Won-Suk Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hyun-Ho Lee.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lee, HH., Lee, WS. Consistent collective evaluation of multiple continuous queries for filtering heterogeneous data streams. Knowl Inf Syst 22, 185–210 (2010). https://doi.org/10.1007/s10115-008-0186-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-008-0186-7

Keywords

Search

Navigation