Abstract
Spatio-temporal stream processing in general refers to a class of software systems for processing of high volume spatio-temporal data streams with very low latency, i.e. in near real-time. Motivated by the limitation of DBMS , the database community developed data stream management systems (DSMSs), as a new class of management systems oriented toward processing large data streams in a near real-time. Despite differences these between these two classes of management systems, DSMSs resemble DBMSs—they process data streams using SQL and operators defined by the relational algebra. This chapter gives an insight into spatio-temporal stream processing at conceptual level, i.e. from the DSMS user perspective.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The terms event time and valid time are often used interchangeably.
- 2.
The notation used in this book is close to the notation used in [15, 16], which is itself based on TelegraphCQ [14], PostGIS [43] and SQL/MM—Spatial [25]. Due to the simplicity and clarity of the syntax, as well as to avoid possible confusion with spatio-temporal data types, prefix ST_ has been omitted.
- 3.
- 4.
- 5.
The instantaneous relation in [6].
- 6.
We suppose that DSMS is coupled with spatial DBMS, but to preclude any potential transaction-processing issues that might occur concurrently with data stream processing, we will assume that the content of persistent relations involved in continuous query remain static [7].
- 7.
- 8.
- 9.
In OCEANUS prototype, the instant is implemented as PostgreSQL timestamp data type.
- 10.
The exact names of the functions (and the class to which they must belong) differs depending on the concrete DSMS.
References
Abadi, D.J., Ahmad, Y., Balazinska, M., Çetintemel, U., Cherniack, M., Hwang, J., Lindner, W., Maskey, A., Rasin, A., Ryvkina, E., Tatbul, N., Xing, Y., Zdonik, S.B.: The design of the Borealis stream processing engine. In: CIDR, pp. 277–289 (2005). http://www.cidrdb.org/cidr2005/papers/P23.pdf
Abadi, D.J., Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., Stonebraker, M., Tatbul, N., Zdonik, S.B.: Aurora: a new model and architecture for data stream management. Int. J. Very Large Databases 12(2), 120–139 (2003)
Ali, M.H., Chandramouli, B., Goldstein, J., Schindlauer, R.: The extensibility framework in Microsoft StreamInsight. In: Abiteboul, S., Böhm, K., Koch, C., Tan, K. (eds.) Proceedings of the 27th International Conference on Data Engineering, ICDE 2011, pp. 1242–1253. IEEE Computer Society (2011)
Ali, M.H., Chandramouli, B., Raman, B.S., Katibah, E.: Spatio-temporal stream processing in Microsoft StreamInsight. IEEE Data Eng. Bull. 33(2), 69–74 (2010)
Arasu, A., Babcock, B., Babu, S., Datar, M., Ito, K., Motwani, R., Nishizawa, I., Srivastava, U., Thomas, D., Varma, R., Widom, J.: STREAM: the stanford stream data manager. IEEE Data Eng. Bull. 26(1), 19–26 (2003)
Arasu, A., Babu, S., Widom, J.: The CQL continuous query language: semantic foundations and query execution. Int. J. Very Large Databases 15(2), 121–142 (2006)
Babcock, B., Babu, S., Datar, M., Motwani, R., Widom, J.: Models and issues in data stream systems. In: Popa, L., Abiteboul, S., Kolaitis, P.G. (eds.) PODS, pp. 1–16. ACM (2002)
Bai, Y., Thakkar, H., Wang, H., Luo, C., Zaniolo, C.: A data stream language and system designed for power and extensibility. In: Yu, P.S., Tsotras, V.J., Fox, E.A., Liu, B. (eds.) CIKM, pp. 337–346. ACM (2006)
Bettini, C., Dyreson, C.E., Evans, W.S., Snodgrass, R.T., Wang, X.S.: A glossary of time granularity concepts. In: Temporal Databases, Dagstuhl, pp. 406–413 (1997)
Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., Seidman, G., Stonebraker, M., Tatbul, N., Zdonik, S.B.: Monitoring streams - a new class of data management applications. In: VLDB, pp. 215–226. Morgan Kaufmann (2002)
Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M.J., Hellerstein, J.M., Hong, W., Krishnamurthy, S., Madden, S., Reiss, F., Shah, M.A.: TelegraphCQ: continuous dataflow processing. In: Halevy, A.Y., Ives, Z.G., Doan, A. (eds.) SIGMOD Conference, p. 668. ACM (2003)
Erwig, M., Güting, R.H., Schneider, M., Vazirgiannis, M.: Abstract and discrete modeling of spatio-temporal data types. In: Laurini, R., Makki, K., Pissinou, N. (eds.) ACM-GIS ’98, Proceedings of the 6th International Symposium on Advances in Geographic Information Systems, November 6–7, 1998, Washington, DC, USA, pp. 131–136. ACM (1998). http://doi.acm.org/10.1145/288692.288716
Forlizzi, L., Güting, R.H., Nardelli, E., Schneider, M.: A data model and data structures for moving objects databases. In: Chen, W., Naughton, J.F., Bernstein, P.A. (eds.) Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, May 16–18, 2000, Dallas, Texas, USA, pp. 319–330. ACM (2000). http://doi.acm.org/10.1145/342009.335426
Franklin, M.J., Krishnamurthy, S., Conway, N., Li, A., Russakovsky, A., Thombre, N.: Continuous analytics: Rethinking query processing in a network-effect world. In: CIDR (2009). www.cidrdb.org
Galić, Z., Baranović, M., Križanović, K., Mešković, E.: Geospatial data streams: Formal framework and implementation. Data Knowl. Eng. 91, 1–16 (2014). http://dx.doi.org/10.1016/j.datak.2014.02.002
Galić, Z., Mešković, E., Križanović, K., Baranović, M.: Oceanus: a spatio-temporal data stream system prototype. In: Proceedings of the Third ACM SIGSPATIAL International Workshop on GeoStreaming, pp. 109–115. IWGS ’12, ACM, New York, NY, USA (2012). http://doi.acm.org/10.1145/2442968.2442982
Ghanem, T.M., Aref, W.G., Elmagarmid, A.K.: Exploiting predicate-window semantics over data streams. SIGMOD Rec. 35(1), 3–8 (2006)
Ghanem, T.M., Hammad, M.A., Mokbel, M.F., Aref, W.G., Elmagarmid, A.K.: Incremental evaluation of sliding-window queries over data streams. IEEE Trans. Knowl. Data Eng. 19(1), 57–72 (2007)
Golab, L., Özsu, M.T.: Data Stream Management. Synthesis Lectures on Data Management. Morgan Claypool Publishers, San Rafael (2010)
Güting, R.H.: Second-order signature: a tool for specifying data models, query processing, and optimization. In: Buneman, P., Jajodia, S. (eds.) SIGMOD Conference, pp. 277–286. ACM Press (1993)
Güting, R.H., Böhlen, M.H., Erwig, M., Jensen, C.S., Lorentzos, N.A., Schneider, M., Vazirgiannis, M.: A foundation for representing and quering moving objects. ACM Trans. Database Syst. 25(1), 1–42 (2000)
Güting, R.H., Schneider, M.: Moving Objects Databases. Morgan Kaufmann, Amsterdam (2005)
Huang, Y., Zhang, C.: New data types and operations to support geo-streams. In: Cova, T.J., Miller, H.J., Beard, K., Frank, A.U., Goodchild, M.F. (eds.) GIScience. Lecture Notes in Computer Science, vol. 5266, pp. 106–118. Springer (2008)
ISO 19107:2003: Geographic information – Spatial schema (2008)
ISO/IEC 13249-3:2011: Information technology – Database languages – SQL multimedia and application packages – Part 3: Spatial (2011)
Jain, N., Mishra, S., Srinivasan, A., Gehrke, J., Widom, J., Balakrishnan, H., Çetintemel, U., Cherniack, M., Tibbetts, R., Zdonik, S.B.: Towards a streaming SQL standard. Proc. VLDB Endow. 1(2), 1379–1390 (2008)
Jensen, C.S., Dyreson, C.E., Böhlen, M.H., Clifford, J., Elmasri, R., Gadia, S.K., Grandi, F., Hayes, P.J., Jajodia, S., Käfer, W., Kline, N., Lorentzos, N.A., Mitsopoulos, Y.G., Montanari, A., Nonen, D.A., Peressi, E., Pernici, B., Roddick, J.F., Sarda, N.L., Scalas, M.R., Segev, A., Snodgrass, R.T., Soo, M.D., Tansel, A.U., Tiberio, P., Wiederhold, G.: The consensus glossary of temporal database concepts - february 1998 version. In: Temporal Databases, Dagstuhl, pp. 367–405 (1997)
Kazemitabar, S.J., Demiryurek, U., Ali, M.H., Akdogan, A., Shahabi, C.: Geospatial stream query processing using Microsoft SQL Server StreamInsight. PVLDB 3(2), 1537–1540 (2010)
Krämer, J., Seeger, B.: Semantics and implementation of continuous sliding window queries over data streams. ACM Trans. Database Syst. 34(1) (2009)
Law, Y.N., Wang, H., Zaniolo, C.: Query languages and data models for database sequences and data streams. In: Nascimento, M.A., Özsu, M.T., Kossmann, D., Miller, R.J., Blakeley, J.A., Schiefer, K.B. (eds.) VLDB, pp. 492–503. Morgan Kaufmann (2004)
Law, Y.N., Wang, H., Zaniolo, C.: Relational languages and data models for continuous queries on sequences and data streams. ACM Trans. Database Syst. 36(2), 8:1–8:32 (2011)
Loeckx, J., Ehrich, H.D., Wolf, M.: Specification of Abstract Data Types. Wiley and B. G Teubner (1996)
Melton, J.: Advanced SQL 1999: Understanding Object-Relational, and Other Advanced Features. Elsevier Science Inc., New York (2003)
Meng, X., Chen, J.: Moving Objects Management: Models, Techniques and Applications. Tsinghua University Press and Springer (2010)
Microsoft: Microsoft StreamInsight (2013). http://msdn.microsoft.com/en-us/library/hh750618(v=sql.10).aspx
Miller, J., Raymond, M., Archer, J., Adem, S., Hansel, L., Konda, S., Luti, M., Zhao, Y., Teredesai, A., Ali, M.H.: An extensibility approach for spatio-temporal stream processing using Microsoft StreamInsight. In: Pfoser, D., Tao, Y., Mouratidis, K., Nascimento, M.A., Mokbel, M.F., Shekhar, S., Huang, Y. (eds.) SSTD. Lecture Notes in Computer Science, vol. 6849, pp. 496–501. Springer (2011)
Mokbel, M.F., Aref, W.G.: SOLE: scalable on-line execution of continuous queries on spatio-temporal data streams. Int. J. Very Large Databases 17(5), 971–995 (2008)
Mokbel, M.F., Xiong, X., Hammad, M.A., Aref, W.G.: Continuous query processing of spatio-temporal data streams in PLACE. GeoInformatica 9(4), 343–365 (2005)
Obe, R., Hsu, L.: PostgreSQL - Up and Running: a Practical Guide to the Advanced Open Source Database. O’Reilly (2012)
Patroumpas, K., Kefallinou, E., Sellis, T.K.: Monitoring continuous queries over streaming locations. In: Aref, W.G., Mokbel, M.F., Schneider, M. (eds.) GIS, p. 81. ACM (2008)
Patroumpas, K., Sellis, T.K.: Managing trajectories of moving objects as data streams. In: Sander, J., Nascimento, M.A. (eds.) STDBM, pp. 41–48 (2004)
Patroumpas, K., Sellis, T.K.: Maintaining consistent results of continuous queries under diverse window specifications. Inf. Syst. 36(1), 42–61 (2011)
Refractions Research Inc.: PostGIS Manual (2015)
Schneider, M.: Spatial Data Types for Database Systems, Finite Resolution Geometry for Geographic Information Systems, Lecture Notes in Computer Science, vol. 1288. Springer (1997)
Thakkar, H., Zaniolo, C.: Introducing Stream Mill: User-Guide to the Data Stream Management System, its Expressive Stream Language ESL, and the Data Stream Mining Workbench SMM. Computer Science Department, UCLA (2010)
Zhang, C., Huang, Y., Griffin, T.: Querying geospatial data streams in SECONDO. In: Agrawal, D., Aref, W.G., Lu, C., Mokbel, M.F., Scheuermann, P., Shahabi, C., Wolfson, O. (eds.) 17th ACM SIGSPATIAL International Symposium on Advances in Geographic Information Systems, ACM-GIS 2009, November 4–6, 2009, Seattle, Washington, USA, Proceedings, pp. 544–545. ACM (2009). http://doi.acm.org/10.1145/1653771.1653868
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2016 The Author(s)
About this chapter
Cite this chapter
Galić, Z. (2016). Spatio-Temporal Continuous Queries. In: Spatio-Temporal Data Streams. SpringerBriefs in Computer Science. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-6575-5_2
Download citation
DOI: https://doi.org/10.1007/978-1-4939-6575-5_2
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4939-6573-1
Online ISBN: 978-1-4939-6575-5
eBook Packages: Computer ScienceComputer Science (R0)