Definition of Data Streams
A data stream is a countably infinite sequence of elements. Different models of data streams exist that take different approaches with respect to the mutability of the stream and to the structure of stream elements. Stream processing refers to analyzing data streams on-the-fly to produce new results as new input data becomes available. Time is a central concept in stream processing: in almost all models of streams, each stream element is associated with one or more timestamps from a given time domain that might indicate, for instance, when the element was generated, the validity of its content, or when it became available for processing.
A data stream is a countably infinite sequence of elements and is used to represent data elements that are made available over time. Examples are readings from sensors in an environmental monitoring application, stock quotes in financial applications, or network data in computer...
- Affetti L, Margara A, Cugola G (2017) Flowdb: integrating stream processing and consistent state management. In: Proceedings of the international conference on distributed and event-based systems, DEBS’17. ACM, pp 134–145. https://doi.org/10.1145/3093742.3093929
- Akidau T (2015) The world beyond batch: streaming 101Google Scholar
- Akidau T, Bradshaw R, Chambers C, Chernyak S, Fernández-Moctezuma RJ, Lax R, McVeety S, Mills D, Perry F, Schmidt E, Whittle S (2015) The dataflow model: a practical approach to balancing correctness, latency, and cost in massive-scale, unbounded, out-of-order data processing. VLDB 8(12):1792–1803. https://doi.org/10.14778/2824032.2824076Google Scholar
- Babcock B, Babu S, Datar M, Motwani R, Widom J (2002) Models and issues in data stream systems. In: Proceedings of the symposium on principles of database systems, PODS’02. ACM, pp 1–16. https://doi.org/10.1145/543613.543615
- Carbone P, Katsifodimos A, Ewen S, Markl V, Haridi S, Tzoumas K (2015) Apache flink: stream and batch processing in a single engine. Bull IEEE Comput Soc Tech Comm Data Eng 36(4):28–38.Google Scholar
- Etzion O, Niblett P (2010) Event processing in action. Manning Publications, GreenwichGoogle Scholar
- Luckham DC (2001) The power of events: an introduction to complex event processing in distributed enterprise systems. Addison-Wesley, BostonGoogle Scholar
- Marz N, Warren J (2015) Big data: principles and best practices of scalable realtime data systems. Manning Publications, GreenwichGoogle Scholar