Abstract
Timely detection of changes in traffic is critical for initiating appropriate traffic engineering mechanisms. Accurate measurement of traffic is an essential step towards change detection and traffic engineering. However, precise traffic measurement involves inspecting every packet traversing a link, resulting in significant overhead, particularly on routers with high speed links. Sampling techniques for traffic load estimation are proposed as a way to limit the measurement overhead. Since the efficacy of change detection depends on the accuracy of traffic load estimation, it is necessary to control error in estimation due to sampling. In this paper, we address the problem of bounding sampling error within a pre-specified tolerance level. We derive a relationship between the number of packet samples, the accuracy of load estimation and the squared coefficient of variation of packet size distribution. Based on this relationship, we propose an adaptive random sampling technique that determines the minimum sampling probability adaptively according to traffic dynamics. Using real network traffic traces, we show that the proposed adaptive random sampling technique indeed produces the desired accuracy, while also yielding significant reduction in the amount of traffic samples, yet simple to implement.We also investigate the impact of sampling errors on the performance of load change detection.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Abilene Internet2. http://abilene.internet2.edu.
A. K. Bera and C. M. Jarque. An efficient large-sample test for normality of observations and regression residuals. In Working Papers in Economics and Econometrics, Australian National University, volume 40, 1981.
D. Berry and B. Lindgren. Statistics theory and Methods. Duxbury Press, ITP, 2nd edition, 1996.
P. Billingsley. Probability Measures. Wiley-Interscience Publication, 1995.
CAIDA. The Cooperative Association for Internet Data Analysis. http://www.caida.org.
Cisco netflow. http://www.cisco.com/en/US/tech/tk648/tk362/tk812/tech protocol home.html.
K. Claffy, George C. Polyzos, and Hans-Werner Braun. Application of sampling methodologies to network traffic characterization. In Proceedings of ACM SIGCOMM, pages 13–17, San Francisco, CA, September 1993.
I. Cozzani and S. Giordano. A measurement based qos evaluation through traffic sampling. In Proceedings of IEEE SICON, Singapore, 1998.
N. Duffield and M. Grossglauser. Trajectory sampling for direct traffic observation. In Proceedings of ACM SIGCOMM, 2000.
N. Duffield, C. Lund, and M. Thorup. Charging from sampled network usage. In Proceedings of ACM SIGCOMM Internet Measurement Workshop, 2001.
C. Estan and G. Varghese. New directions in traffic measurement and accounting. In Proceedings of ACM SIGCOMM, 2002.
J. Gottman. Time-series analysis. Cambridge University Press, 1981.
Sprint ATL IPMon project. http://ipmon.sprint.com.
The Internet Traffic Archive. http://ita.ee.lbl.gov.
J. Jedwab, P. Phaal, and B. Pinna. Traffic estimation for the largest sources on a network, using packet sampling with limited storage. Technical Report HPL-92-35, HP Labs Technical Report, 1992.
V. Moskvina and A. Zhigljavsky. Change-point detection algorithm based on the singularspectrum analysis, detection. In Cardiff University, UK.
C. R. Rao. Sampling Techniques. 2nd ed., N.Y., Wiley, 2nd edition, 1973.
Cisco sampled netflow. http://www.cisco.com/univercd/cc/tc/doc/product/software/ios120/120newft.
A. Sang and S. Q. Li. A predictability analysis of network traffic. In Proceedings of INFOCOM, 2000.
ACM SIGCOMM. Special Interest Group on Data Communications. http://www.acm.org/sigcomm.
W. Stallings. SNMP, SNMPv2, SNMPv3, and RMON 1 and 2. Addison Wesley, 3rd edition, 1999.
W. Willinger, Murad Taqqu, and Ashok Erramilli. A Bibliographical Guide to Self-Similar Traffic and Performance Modeling for Modern High-Speed Networks Stochastic Networks: Theory and Applications, Royal Statistical Society Lecture Notes Series, volume 4. Oxford University Press, 1996.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Choi, BY., Zhang, ZL., Du, D.HC. (2011). Load Characterization and Measurement. In: Scalable Network Monitoring in High Speed Networks. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-0119-3_2
Download citation
DOI: https://doi.org/10.1007/978-1-4614-0119-3_2
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-0118-6
Online ISBN: 978-1-4614-0119-3
eBook Packages: Computer ScienceComputer Science (R0)