Skip to main content

Load Characterization and Measurement

  • Chapter
  • First Online:
  • 580 Accesses

Abstract

Timely detection of changes in traffic is critical for initiating appropriate traffic engineering mechanisms. Accurate measurement of traffic is an essential step towards change detection and traffic engineering. However, precise traffic measurement involves inspecting every packet traversing a link, resulting in significant overhead, particularly on routers with high speed links. Sampling techniques for traffic load estimation are proposed as a way to limit the measurement overhead. Since the efficacy of change detection depends on the accuracy of traffic load estimation, it is necessary to control error in estimation due to sampling. In this paper, we address the problem of bounding sampling error within a pre-specified tolerance level. We derive a relationship between the number of packet samples, the accuracy of load estimation and the squared coefficient of variation of packet size distribution. Based on this relationship, we propose an adaptive random sampling technique that determines the minimum sampling probability adaptively according to traffic dynamics. Using real network traffic traces, we show that the proposed adaptive random sampling technique indeed produces the desired accuracy, while also yielding significant reduction in the amount of traffic samples, yet simple to implement.We also investigate the impact of sampling errors on the performance of load change detection.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abilene Internet2. http://abilene.internet2.edu.

  2. A. K. Bera and C. M. Jarque. An efficient large-sample test for normality of observations and regression residuals. In Working Papers in Economics and Econometrics, Australian National University, volume 40, 1981.

    Google Scholar 

  3. D. Berry and B. Lindgren. Statistics theory and Methods. Duxbury Press, ITP, 2nd edition, 1996.

    Google Scholar 

  4. P. Billingsley. Probability Measures. Wiley-Interscience Publication, 1995.

    Google Scholar 

  5. CAIDA. The Cooperative Association for Internet Data Analysis. http://www.caida.org.

  6. Cisco netflow. http://www.cisco.com/en/US/tech/tk648/tk362/tk812/tech protocol home.html.

  7. K. Claffy, George C. Polyzos, and Hans-Werner Braun. Application of sampling methodologies to network traffic characterization. In Proceedings of ACM SIGCOMM, pages 13–17, San Francisco, CA, September 1993.

    Google Scholar 

  8. I. Cozzani and S. Giordano. A measurement based qos evaluation through traffic sampling. In Proceedings of IEEE SICON, Singapore, 1998.

    Google Scholar 

  9. N. Duffield and M. Grossglauser. Trajectory sampling for direct traffic observation. In Proceedings of ACM SIGCOMM, 2000.

    Google Scholar 

  10. N. Duffield, C. Lund, and M. Thorup. Charging from sampled network usage. In Proceedings of ACM SIGCOMM Internet Measurement Workshop, 2001.

    Google Scholar 

  11. C. Estan and G. Varghese. New directions in traffic measurement and accounting. In Proceedings of ACM SIGCOMM, 2002.

    Google Scholar 

  12. J. Gottman. Time-series analysis. Cambridge University Press, 1981.

    Google Scholar 

  13. Sprint ATL IPMon project. http://ipmon.sprint.com.

  14. The Internet Traffic Archive. http://ita.ee.lbl.gov.

  15. J. Jedwab, P. Phaal, and B. Pinna. Traffic estimation for the largest sources on a network, using packet sampling with limited storage. Technical Report HPL-92-35, HP Labs Technical Report, 1992.

    Google Scholar 

  16. V. Moskvina and A. Zhigljavsky. Change-point detection algorithm based on the singularspectrum analysis, detection. In Cardiff University, UK.

    Google Scholar 

  17. C. R. Rao. Sampling Techniques. 2nd ed., N.Y., Wiley, 2nd edition, 1973.

    Google Scholar 

  18. Cisco sampled netflow. http://www.cisco.com/univercd/cc/tc/doc/product/software/ios120/120newft.

  19. A. Sang and S. Q. Li. A predictability analysis of network traffic. In Proceedings of INFOCOM, 2000.

    Google Scholar 

  20. ACM SIGCOMM. Special Interest Group on Data Communications. http://www.acm.org/sigcomm.

  21. W. Stallings. SNMP, SNMPv2, SNMPv3, and RMON 1 and 2. Addison Wesley, 3rd edition, 1999.

    Google Scholar 

  22. W. Willinger, Murad Taqqu, and Ashok Erramilli. A Bibliographical Guide to Self-Similar Traffic and Performance Modeling for Modern High-Speed Networks Stochastic Networks: Theory and Applications, Royal Statistical Society Lecture Notes Series, volume 4. Oxford University Press, 1996.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Baek-Young Choi .

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Choi, BY., Zhang, ZL., Du, D.HC. (2011). Load Characterization and Measurement. In: Scalable Network Monitoring in High Speed Networks. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-0119-3_2

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-0119-3_2

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-0118-6

  • Online ISBN: 978-1-4614-0119-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics