Towards a High Quality Path-Oriented Network Measurement and Storage System

  • David Johnson
  • Daniel Gebhardt
  • Jay Lepreau
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4979)

Abstract

Researchers need current and historical measurements of Internet paths. We built and deployed a complete system designed to fill these needs: a safe, shareable, multi-user active network measurement system probes network paths and reliably records measurements in a storage facility with multiple levels of caching, providing users with fast, flexible querying. Our system, deployed on PlanetLab for over 20 months, has accumulated 940 million measurements and made them publicly available in a separate, federated data repository. Our experience shows that building and running such a valuable research tool poses significant engineering and practical challenges.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Andersen, D.G., Feamster, N.: Challenges and Opportunities in Internet Data Mining. Technical Report CMU–PDL–06–102, CMU Parallel Data Laboratory (January 2006), http://www.datapository.net/
  2. 2.
    Danalis, A., Dovrolis, C.: ANEMOS: An Autonomous Network Monitoring System. In: Proc. PAM, San Diego, CA (April 2003)Google Scholar
  3. 3.
    Jain, M., Dovrolis, C.: End-to-End Available Bandwidth: Measurement Methodology, Dynamics, and Relation with TCP Throughput. IEEE/ACM Trans. Networking 11(4), 537–549 (2003)CrossRefGoogle Scholar
  4. 4.
    Krishnamurthy, B., Madhyastha, H.V., Spatscheck, O.: ATMEN: A Triggered Network Measurement Infrastructure. In: Proc. WWW (May 2005)Google Scholar
  5. 5.
    Lee, S.-J., et al.: Measuring Bandwidth Between PlanetLab Nodes. In: Proc. PAM (March–April 2005)Google Scholar
  6. 6.
    Park, K., Pai, V.: CoMon: A Mostly-Scalable Monitoring System for PlanetLab. OSR 40(1), 65–74 (2006)Google Scholar
  7. 7.
    Paxson, V., Mahdavi, J., Adams, A., Mathis, M.: An Architecture for Large-Scale Internet Measurement. IEEE Comm. 36(8), 48–54 (1998)CrossRefGoogle Scholar
  8. 8.
    Peterson, L., Anderson, T., Culler, D., Roscoe, T.: A Blueprint for Introducing Disruptive Technology into the Internet. In: Proc. HotNets-I (October 2002)Google Scholar
  9. 9.
    Ribeiro, V., Riedi, R., Baraniuk, R., Navratil, J., Cottrell, L.: pathChirp: Efficient Available Bandwidth Estimation for Network Paths. In: Proc. PAM (April 2003)Google Scholar
  10. 10.
    Ricci, R., et al.: The Flexlab Approach to Realistic Evaluation of Networked Systems. In: Proc. NSDI (April 2007)Google Scholar
  11. 11.
    Sherwood, R., Spring, N.: A Platform for Unobtrusive Measurements on PlanetLab. In: Proc. of WORLDS 2006, Seattle, WA (November 2006)Google Scholar
  12. 12.
    Sommers, J., Barford, P.: An Active Measurement System for Shared Environments. In: Proc. IMC (October 2007)Google Scholar
  13. 13.
    Spring, N., Wetherall, D., Anderson, T.: Scriptroute: A Public Internet Measurement Facility. In: Proc. USITS (March 2003)Google Scholar
  14. 14.
    Webb, K., et al.: Implementing the Emulab-PlanetLab Portal: Experience and Lessons Learned. In: Proc. WORLDS (December 2004)Google Scholar
  15. 15.
    White, B., et al.: An Integrated Experimental Environment for Distributed Systems and Networks. In: Proc. OSDI (December 2002)Google Scholar
  16. 16.
    Yalagandula, P., et al.: S3: A Scalable Sensing Service for Monitoring Large Networked Systems. In: Proc. Workshop on Internet Network Mgmt (September 2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • David Johnson
    • 1
  • Daniel Gebhardt
    • 1
  • Jay Lepreau
    • 1
  1. 1.School of ComputingUniversity of Utah 

Personalised recommendations