Skip to main content
SpringerLink
Log in

Measurements of Data Plane Reliability and Performance

  • Chapter
  • First Online:
Guide to Reliable Internet Services and Applications

Part of the book series: Computer Communications and Networks ((CCN))

  • 847 Accesses

Abstract

Providing detailed, accurate, and consistent network measurements is essential to running a service provider network, both for planning, engineering and troubleshooting the network, and for verifying that network performance meets targets that are set by the provider and agreed with its customers. The speed and scale of networks, coupled with increasing need for active and passive measurements differentiated by customer, service class, and network elements, present challenges for providers in deploying and operating the measurement infrastructure. This chapter reviews a spectrum of methods, practices, and standards for the acquisition, management, and interpretation of network measurements.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Adams, A., Bu, T., Caceres, R., Duffield, N., Friedman, T., Horowitz, J., Lo Presti, F., Moon, S. B., Paxson, V., & Towsley. D. (2000). The use of end-to-end multicast measurements for characterizing internal network behavior. IEEE Communications Magazine, May 2000, 38(5), 152–159.

    Article  Google Scholar 

  2. Almes, G., Kalidindi, S., & Zekauskas, M. (1999). A one-way delay metric for IPPM. RFC 2679, September 1999.

    Google Scholar 

  3. Almes, G., Kalidindi, S., & Zekauskas, M. (1999). A one-way packet loss metric for IPPM. RFC 2680, September 1999.

    Google Scholar 

  4. Alon, N., Duffield, N., Lund, C., & Thorup, M. (2005). Estimating arbitrary subset sums with few probes. In Proceedings of 24th ACM Symposium on Principles of Database Systems (PODS) (pp. 317–325). Baltimore, MD, June 13–16, 2005.

    Google Scholar 

  5. AT&T Labs. Application traffic analyzer. http://www.research.att.com/viewProject.cfm?prjID=125.

  6. Bradner, S. (1991). Benchmarking terminology for network interconnection devices. RFC 1242, July 1991.

    Google Scholar 

  7. Breslau, L., Chase, C., Duffield, N., Fenner, B., Mao, Y., & Sen, S. (2006). Vmscope: a virtual multicast vpn performance monitor. In INM ’06: Proceedings of the 2006 SIGCOMM Workshop on Internet Network Management (pp. 59–64). New York, NY, USA: ACM.

    Chapter  Google Scholar 

  8. Burch, H., & Chase, C. (2005). Monitoring link delays with one measurement host. SIGMETRICS Performance Evaluation Review, 33(3):10–17.

    Article  Google Scholar 

  9. CAIDA. The CAIDA anonymized 2009 internet traces dataset. http://www.caida.org/data/passive/passive_2009_dataset.xml.

  10. CAIDA. cflowd: Traffic flow analysis tool. http://www.caida.org/tools/measurement/cflowd/.

  11. Castro, R., Coates, M., Liang, G., Nowak, R., & Yu, B. (2004). Network tomography: recent developments. Statistical Science, 19, 499–517.

    Article  MathSciNet  MATH  Google Scholar 

  12. Chimento, P., & Ishac, J. (2008). Defining network capacity. RFC 5136, February 2008.

    Google Scholar 

  13. Ciavattone, L., Morton, A., & Ramachandran, G. (2003). Standardized active measurements on a tier 1 IP backbone. IEEE Communications Magazine, pp. 90–97, June 2003.

    Google Scholar 

  14. Cisco Systems. Cisco IOS Flexible NetFlow. http://www.cisco.com/web/go/fnf.

  15. Cisco Systems. Cisco NetFlow Collector Engine. http://www.cisco.com/en/US/products/sw/netmgtsw/ps1964/.

  16. Cisco Systems. Delivering the next generation data center. http://www.cisco.com/en/US/products/ps9402/.

  17. Cisco Systems. IOS switching services configuration guide. http://www.cisco.com/en/US/docs/ios/12_1/switch/configuration/guide/xc%dipsp.html.

  18. Cisco Systems. NetFlow. http://www.cisco.com/warp/public/732/netflow/index.html.

  19. Cisco Systems. Optimizing application traffic with cisco service control technology. http://www.cisco.com/go/servicecontrol.

  20. Cisco Systems. Performance Routing. http://www.cisco.com/web/go/pfr/.

  21. Cisco Systems. Random Sampled NetFlow. http://www.cisco.com/en/US/docs/ios/12_0s/feature/guide/nfstatsa.html.

  22. Claffy, K. C., Braun, H.-W., & Polyzos, G. C. (1995). Parameterizable methodology for internet traffic flow profiling. IEEE Journal on Selected Areas in Communications, 13(8), 1481–1494, October 1995.

    Article  Google Scholar 

  23. Claise, B. (2004). Cisco Systems NetFlow Services Export Version 9. RFC 3954, October 2004.

    Google Scholar 

  24. Claise, B., Johnson, A., & Quittek, J. (2009). Packet sampling (psamp) protocol specifications. RFC 5476, March 2009.

    Google Scholar 

  25. Claise, B., & Wolter, R. (2007). Network management: accounting and performance strategies. Cisco.

    Google Scholar 

  26. Cohen, E., Duffield, N., Lund, C., & Thorup, M. (2008). Confident estimation for multistage measurement sampling and aggregation. In ACM SIGMETRICS. June 2–6, 2008, Maryland, USA: Annapolis.

    Google Scholar 

  27. Cohen, E., Duffield, N. G., Kaplan, H., Lund, C.,& Thorup, M. (2007). Algorithms and estimators for accurate summarization of internet traffic. In IMC ’07: Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement (pp. 265–278). New York, NY, USA: ACM.

    Chapter  Google Scholar 

  28. Cranor, C., Johnson, T., Spataschek, O., & Shkapenyuk, V., (2003). Gigascope: a stream database for network applications. In SIGMOD ’03: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data (pp. 647–651). New York, NY, USA: ACM.

    Chapter  Google Scholar 

  29. Crovella, M., & Krishnamurthy, B. (2006). Internet measurement: infrastructure, traffic and applications. New York, NY: Wiley.

    Google Scholar 

  30. Dasu, T., & Johnson, T. (2003). Exploratory data mining and data cleaning. New York, NY, USA: Wiley.

    Book  MATH  Google Scholar 

  31. Demichelis, C., & Chimento, P. (2002). Ip packet delay variation metric for ip performance metrics (ippm). RFC 3393, November 2002.

    Google Scholar 

  32. Dietz, T., Claise, B., Aitken, P., Dressler, F., & Carle, G. (2009). Information model for packet sampling export. RFC 5477, March 2009.

    Google Scholar 

  33. Duffield, N.G., Claise, B., Chiou, D., Greenberg, A., Grossglauser, M., & Rexford, J. (2009). A framework for packet selection and reporting. RFC 5474, March 2009.

    Google Scholar 

  34. Duffield, N.G., Gerber, A., & Grossglauser, M. (2002). Trajectory engine: A backend for trajectory sampling. In IEEE Network Operations and Management Symposium (NOMS) 2002. Florence, Italy, 15–19 April 2002.

    Google Scholar 

  35. Duffield, N.G., Lund, C., & Thorup, M. (2001). Charging from sampled network usage. In Proceedings of 1st ACM SIGCOMM Internet Measurement Workshop (IMW) (pp. 245–256). San Francisco, CA, November 1–2, 2001.

    Google Scholar 

  36. Duffield, N.G., Lund, C., & Thorup, M. (2005). Learn more, sample less: control of volume and variance in network measurements. IEEE Transactions on Information Theory, 51(5), 1756–1775.

    Article  MathSciNet  Google Scholar 

  37. Duffield, N.G., Lund, C., & Thorup, M. (2007). Priority sampling for estimation of arbitrary subset sums. Journal of ACM, 54(6), Article 32, December 2007. Announced at SIGMETRICS’04.

    Google Scholar 

  38. Duffield, N., & Grossglauser, M. (2001). Trajectory sampling for direct traffic observation. IEEE/ACM Transactions on Networking, 9(3), 280–292, June 2001.

    Article  Google Scholar 

  39. Duffield, N., & Lund, C. (2003). Predicting resource usage and estimation accuracy in an IP flow measurement collection infrastructure. In Proceedings of Internet Measurement Conference. Miami, FL, October 27–29, 2003.

    Google Scholar 

  40. Estan, C., Keys, K., Moore, D., & Varghese, G. (2004). Building a better netflow. In Proceedings of the ACM SIGCOMM 04. New York, NY, 12–16 June 2004.

    Google Scholar 

  41. Estan, C., & Varghese, G. (2002). New directions in traffic measurement and accounting. In Proceedings of ACM SIGCOMM ’2002. Pittsburgh, PA, August 2002.

    Google Scholar 

  42. Feldmann, A., Rexford, J., & Cáceres, R. (1998). Efficient policies for carrying web traffic over flow-switched networks. IEEE/ACM Transactions on Networking, 6(6), 673–685, December 1998.

    Article  Google Scholar 

  43. Goldberg, S., & Rexford, J. (2007). Security vulnerabilities and solutions for packet sampling. In IEEE Sarnoff Symposium. Princeton, NJ, May 2007.

    Google Scholar 

  44. Greer, R. (1999). Daytona and the fourth-generation language cymbal. In SIGMOD ’99: Proceedings of the 1999 ACM SIGMOD International Conference on Management of Data (pp. 525–526). New York, NY, USA: ACM.

    Chapter  Google Scholar 

  45. Hao, F., Kodialam, M., & Lakshman, T.V. (2004). Accel-rate: a faster mechanism for memory efficient per-flow traffic estimation. In SIGMETRICS ’04/Performance ’04: Proceedings of the Joint International Conference on Measurement and Modeling of Computer Systems (pp. 155–166). New York, NY, USA: ACM.

    Google Scholar 

  46. Hedayat, K., Krzanowski, R., Morton, A., Yum, K., & Babiarz, J. (2008). A two-way active measurement protocol (twamp). RFC 5357, October 2008.

    Google Scholar 

  47. Horvitz, D. G., & Thompson, D. J. (1952). A generalization of sampling without replacement from a finite universe. Journal of the American Statistical Association, 47(260), 663–685.

    Article  MathSciNet  MATH  Google Scholar 

  48. Huang, Y., Feamster, N., & Teixeira, R. (2008). Practical issues with using network tomography for fault diagnosis. SIGCOMM Computer Communication Review, 38(5), 53–58.

    Article  Google Scholar 

  49. IETF. IP Flow Information Export (ipfix) charter. http://www.ietf.org/html.charters/ipfix-charter.html. Version of 16 December 2008.

  50. Internet Assigned Numbers Authority. Port numbers. http://www.iana.org/assignments/port- numbers.

  51. ITU-T Recommendation Y.1540. Network performance objectives for IP-based services, February 2006.

    Google Scholar 

  52. Jacobson, V., Leres, C., & McCanne, S. tcpdump.

    Google Scholar 

  53. Jacobson V. Traceroute. ftp://ftp.ee.lbl.gov/traceroute.tar.gz.

  54. Jain, R., & Routhier, S. (1986). Packet trains – measurements and a new model for computer network traffic. IEEE Journal on Selected Areas in Communications, 4(6), 986–995, September 1986.

    Article  Google Scholar 

  55. Juniper Networks. Junose 8.2.x ip services configuration guide: Configuring j-flow statistics. http://www.juniper.net/techpubs/software/erx/junose82/swconfig-ip-servi%ces/html/ip-jflow-stats-config.html.

  56. Kent, S., & Atkinson, R. (1998). Security architecture for the Internet Protocol. RFC 2401, November 1998.

    Google Scholar 

  57. Keynote Systems. http://www.keynote.com.

  58. Mathis, M., & Mahdavi, J. (1996). Diagnosing internet congestion with a transport layer performance tool. In Proceedings of INET 96. Montreal, Quebec, 24–28 June 1996.

    Google Scholar 

  59. McCloghrie, K., & Kastenholz, F. The interfaces group mib. RFC 2863, June 2000.

    Google Scholar 

  60. McCloghrie, K., & Rose, M. (1991). Management Information Base for Network Management of TCP/IP-based internets: MIB-II. RFC 1213, available from http://www.ietf.org/rfc, March 1991.

  61. MeasurementLab. http://www.measurementlab.net/.

  62. Mills, C., Hirsh, D.,& Ruth, D. (1991). Internet accounting: background. RFC 1272, November 1991.

    Google Scholar 

  63. Greg Minshall. tcpdpriv. http://ita.ee.lbl.gov/html/contrib/tcpdpriv.html.

  64. Moore, D., Paxson, V., Savage, S., Shannon, C., Staniford, S., & Weaver, N. (2003). Inside the slammer worm. IEEE Security and Privacy, 1(4), 33–39.

    Article  Google Scholar 

  65. Morton, A. (2008). Framework for metric composition, June 2009. draft-ietf-ippm-framework-compagg-08 (work in progress).

    Google Scholar 

  66. Morton, A., & Claise, B. (2009). Packet delay variation applicability statement. RFC 5481, March 2009.

    Google Scholar 

  67. Morton, A., & Stephan, E. (2008). Spatial composition of metrics, October 2009. draft-ietf-ippm-spatial-composition-10 (work in progress).

    Google Scholar 

  68. Narus, Inc. Narusinsight secure suite. http://www.narus.com/products/security.html.

  69. Packetdesign. Traffic explorer. http://www.packetdesign.com/products/tex.htm.

  70. Paxson, V., Almes, G., Mahdavi, J., & Mathis, M. (1998). Framework for ip performance metrics. RFC 2330, May 1998.

    Google Scholar 

  71. Phaal, P., Panchen, S., & McKee, N. (2001). Inmon corporation’s sflow: A method for monitoring traffic in switched and routed networks. RFC 3176, September 2001. http://www.ietf.org/rfc/rfc3176.txt.

  72. Raisanen, V., Grotefeld, G., & Morton, A. (2002). Network performance measurement with periodic streams. RFC 3432, November 2002.

    Google Scholar 

  73. RIPE. http://www.ripe.net.

  74. Roesch, M. (1999). Snort – Lightweight Intrusion Detection for Networks. In Proceedings of USENIX Lisa ’99, Seattle, WA, November 1999.

    Google Scholar 

  75. Sandvine. http://www.sandvine.com/.

  76. Srinivasan, C., Viswanathan, A., & Nadeau, T. (2004). Multiprotocol label switching (MPLS) label switching router (LSR) management information base (MIB). RFC 3813, June 2004.

    Google Scholar 

  77. Stallings, W. (1999). SNMP, SNMP v2, SNMP v3, and RMON 1 and 2 (Third Edition). Reading, MA: Addison-Wesley.

    Google Scholar 

  78. Stewart, R., Ramalho, M., Xie, Q., Tuexen, M., & Conrad, P. (2004). Stream control transmission protocol (sctp) partial reliability extension. RFC3758, May 2004.

    Google Scholar 

  79. Thorup, M. (2006). Confidence intervals for priority sampling. In Proceedings of ACM SIGMETRICS/Performance 2006 (pp. 252–263) Saint-Malo, France, 26–30 June 2006.

    Google Scholar 

  80. van der Merwe J., Cáceres, R., Chu, Y.-H., & Sreenan, C. (2000). mmdump: a tool for monitoring internet multimedia traffic. SIGCOMM Computer Commununication Review, 30(5), 48–59.

    Article  Google Scholar 

  81. Waldbusser, S. (2000). Remote network monitoring management information base. RFC 2819, available from http://www.ietf.org/rfc, May 2000.

  82. Zseby, T., Molina, M., Duffield, N.G., Niccolini, S., & Raspall, F. (2009). Sampling and filtering techniques for ip packet selection. RFC 5475, March 2009.

    Google Scholar 

  83. Zseby, T., Zander, S., & Carle, G. (2001). Evaluation of building blocks for passive one-way-delay measurements. In Proceedings of Passive and Active Measurement Workshop (PAM 2001). Amsterdam, The Netherlands, 23–24 April 2001.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. AT&T Labs, 180 Park Avenue, Florham Park, NJ, 07901, USA

    Nick Duffield

  2. AT&T Labs, 200 S Laurel Ave, Middletown, NJ, 07748, USA

    Al Morton

Authors
  1. Nick Duffield
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Al Morton
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nick Duffield .

Editor information

Editors and Affiliations

  1. AT & T Labs Research, Park Ave. 180, Florham Park, 07932, USA

    Charles R. Kalmanek

  2. , School of Information Technology, Indian Institute of Technology Kharagpur, Kharagpur, 721302, India

    Sudip Misra

  3. Dept. Computer Science, Yale University, Prospect St. 51, New Haven, 06511, USA

    Yang (Richard) Yang

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag London

About this chapter

Cite this chapter

Duffield, N., Morton, A. (2010). Measurements of Data Plane Reliability and Performance. In: Kalmanek, C., Misra, S., Yang, Y. (eds) Guide to Reliable Internet Services and Applications. Computer Communications and Networks. Springer, London. https://doi.org/10.1007/978-1-84882-828-5_10

Download citation

  • DOI: https://doi.org/10.1007/978-1-84882-828-5_10

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84882-827-8

  • Online ISBN: 978-1-84882-828-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation