Consistency Analysis of Network Traffic Repositories
Traffic repositories with TCP/IP header information are very important for network analysis. Researchers often assume that such repositories reliably represent all traffic that has been flowing over the network; little thoughts are made regarding the consistency of these repositories. Still, for various reasons, the traffic capturing process may have missed packets. For certain kinds of analysis, for example loss measurements, such inconsistencies may lead to the wrong conclusions.
This paper proposes an algorithm to detect such inconsistencies, using the idea of “fake gaps”. A prototype has been developed, and used to test two well-known repositories: the WIDE and Simpleweb repositories. The paper shows that both repositories contain several inconsistencies.
- 1.Timmer, M.: How to identify the speed limiting factor of a TCP flow, http://dacs.ewi.utwente.nl/assignments/completed/bachelor/reports/B-assignment_Timmer.pdf (retrieved at October 5, 2008)
- 2.Slomp, G.: Consistency of repositories. Presented at 8th TSConIT, http://referaat.cs.utwente.nl/new/paper.php?paperID=377 (retrieved at October 5, 2008)
- 3.Lastdrager, E.E.H.: Consistency of network traffic repositories - an overview. In: Proceedings of 3rd Conference on Autonomous Infrastructure, Management and Security, AIMS 2009 (2009)Google Scholar
- 4.Lastdrager, E.E.H.: Consistency analysis of network traffic repositories. Presented at 10th TSConIT, http://referaat.cs.utwente.nl/new/paper.php?paperID=464 (retrieved at February 20, 2009)
- 5.Wessels, D., Fomenkov, M.: Wow, that’s a lot of packets. In: Proc. Passive and Active Measurements Workshop, PAM (2003)Google Scholar
- 6.van de Meent, R., Pras, A.: Simpleweb/University of Twente – Traffic Measurement Data Repository, http://traces.simpleweb.org (retrieved on October 5, 2008)
- 7.Deri, L.: Improving Passive Packet Capture: Beyond Device Polling. In: Proceedings of 4th International System Administration and Network Engineering Conference, SANE (October 2004)Google Scholar
- 9.Deri, L.: Towards 10 Gbit NetFlow Monitoring Using Commodity Hardware. Presentation at the joint Emanics / IRTF-NMRG workshop on NetFlow/IPFIX for network management, http://www.ibr.cs.tu-bs.de/projects/nmrg/meetings/2008/munich/ (retrieved on March 1, 2009)
- 10.Cho, K., Mitsuya, K., Kato, A.: Traffic data repository at the WIDE project. In: Proc. USENIX Annual Technical Conference, p. 51 (2000)Google Scholar
- 11.Lastdrager, E.E.H.: Prototype and results, http://www.vf.utwente.nl/~lastdragereeh/referaat
- 12.Postel, J.: RFC 793: Transmission Control Protocol, Internet Engineering Task Force (1981)Google Scholar