Abstract
Many traffic analysis tasks are solved with tools that are developed in an ad-hoc, incremental, and cumbersome way instead of seeking systematic solutions that are easy to reuse and understand. The huge amount of data that has to be managed and analyzed together with the fact that many different analysis tasks are performed over a small set of different network trace formats, motivates us to study whether Data Stream Management Systems (DSMSs) might be useful to develop traffic analysis tools. We have performed an experimental study to analyze the advantages and limitations of using DSMS in practice. We study how simple and complex analysis tasks can be solved with TelegraphCQ, a public domain DSMS, and present a preliminary performance analysis.Many traffic analysis tasks are solved with tools that are developed in an ad-hoc, incremental, and cumbersome way instead of seeking systematic solutions that are easy to reuse and understand. The huge amount of data that has to be managed and analyzed together with the fact that many different analysis tasks are performed over a small set of different network trace formats, motivates us to study whether Data Stream Management Systems (DSMSs) might be useful to develop traffic analysis tools. We have performed an experimental study to analyze the advantages and limitations of using DSMS in practice. We study how simple and complex analysis tasks can be solved with TelegraphCQ, a public domain DSMS, and present a preliminary performance analysis.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Babcock, B., Babu, S., Datar, M., Motwani, R., Widom, J.: Models and Issues in Data Stream Systems. In: ACM Symposium on Principles of Database Systems PODS 2002, allas, Texas, USA (May 2000)
Cranor, C., Johnson, T., Spatcheck, O., Shkapenyuk, V.: Gigascope: A Stream Database for Network Applications. In: ACM SIGMOD 2003, San Diego, California, USA (June 2003)
Golab, L., Özsu, M.T.: Issues in Data Stream Management. ACM SIGMOD Record 32(2), 5–14 (2003)
Izal, M., Biersack, E.W., Felber, P.A., Urvoy-Keller, G., Al Hamra, A., Garces-Erice, L.: Dissecting BitTorrent: Five Months in a Torrent’s Lifetime. In: Barakat, C., Pratt, I. (eds.) PAM 2004. LNCS, vol. 3015, pp. 1–11. Springer, Heidelberg (2004)
Krishnamurthy, S., Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M. J., Hellerstein, J. M., Hong, W., Madden, S., Reiss, F., Shah, M.A.: TelegraphCQ: An Architectural Status report. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering (March 2003)
Micheel, J., Braun, H.-W., Graham, I.: Storage and Bandwidth Requirements for Passive Internet Header Traces. In: Workshop on Network-Related Data Management. In: conjunction with ACM SIGMOD/PODS 2001, Santa Barbara, California, USA (May 2001)
Schleippmann, C.: Design and Implementation of a TCP Rate Analysis Tool. Master Thesis, TU München/Institut Eurecom (August 2003)
Sullivan, M., Heybey, A.: Tribeca: A System for Managing Large Databases of Network Traffic. In: Proc. USENIX Annual Technical Conference, New Orleans, USA (June 1998)
TelegraphCQ (2003), http://telegraph.cs.berkeley.edu/
Zhang, Y., Breslau, L., Paxon, V., Shenker, S.: On the Characteristics and Origins of Internet Flow Rates. In: ACM SIGCOMM 2002, Pittsburg, USA (August 2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Plagemann, T., Goebel, V., Bergamini, A., Tolu, G., Urvoy-Keller, G., Biersack, E.W. (2004). Using Data Stream Management Systems for Traffic Analysis – A Case Study –. In: Barakat, C., Pratt, I. (eds) Passive and Active Network Measurement. PAM 2004. Lecture Notes in Computer Science, vol 3015. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24668-8_22
Download citation
DOI: https://doi.org/10.1007/978-3-540-24668-8_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21492-2
Online ISBN: 978-3-540-24668-8
eBook Packages: Springer Book Archive