Skip to main content
Log in

ModelNet-TE: An emulation tool for the study of P2P and traffic engineering interaction dynamics

  • Published:
Peer-to-Peer Networking and Applications Aims and scope Submit manuscript

Abstract

In the Internet, user-level performance of P2P applications may be determined by the interaction of two independent dynamics: on the one hand, by the end-to-end control policies applied at the P2P application layer (L7); on the other hand, by Traffic Engineering (TE) decisions taken at the network level (L3). Currently available tools do not allow to study L7/L3 interactions in realistic settings due to a number of limitations. Building over ModelNet, we develop a framework for the real-time emulation of TE capabilities, named ModelNet-TE, that we make available to the scientific community as open source software. ModelNet-TE allows (i) to deploy real unmodified Internet P2P applications, and to test their interaction with (ii) many TE algorithms, as its design allows to easily integrate other TE algorithms than those we already provide, (iii) in a furthermore controlled network environment. Due to these features, ModelNet-TE is a complementary tool with respect to hybrid simulation/protoyping toolkits (that constrain application development to a specific language and framework, and cannot be used with existing or proprietary applications) and to other open testbeds such as PlanetLab or Grid5000 (lacking of control or TE-capabilities respectively). ModelNet-TE can thus be useful to L7-researchers, as it allows to seamlessly and transparently test any existing P2P application without requiring any software modification. At the same time, ModelNet-TE can be useful to L3-researchers as well, since they can test their TE algorithms on the traffic generated by real applications. As a use case, in this work we carry on an experimental campaign of L7/L3 routing layers interaction through ModelNet-TE. As TE we consider the classic minimum congestion load-balancing, that we compare against standard IP routing. As example P2P applications, we take BitTorrent, one among the most popular file-sharing applications nowadays, and WineStreamer, an open source live-streaming application. We emulate BitTorrent and WineStreamer swarms over both realistic topologies (e.g., Abilene) and simplistic topologies that are commonly in use today (e.g., where the bottleneck is located at the network edge) under a variety of scenarios. Results of our experimental campaign show that user-level performance may be significantly affected by both the TE mechanism in use at L3 (e.g., due to interactions with TCP congestion control or P2P chunk trading logic), as well as scenario parameters that are difficult to control in the wild Internet, which thus testifies the interest for tools such as ModelNet-TE.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. ModelNet-TE flips a bit of the virtual destination address, which forces packets to exit the Host (instead of being “captured” by the loop-back interface), and be directed to the Core (which is set as Host default gateway). The same bit of the IP destination address is then flipped again at packet reception in the Core.

  2. As our patch applies only to specific versions of the Linux kernel (namely 2.6.18 or 2.6.22), and so as to reduce the startup time for new users, we directly provide full ready-to-use system images of the patched Core and Host machines, containing the source code as well.

  3. Clearly, instrumentation of the P2P application, whether possible, can bring a more detailed view of the QoE perceived by P2P users. At the same time, we provide basic QoS monitoring of end-point traffic (e.g., traffic volumes, delay, jitter, losses, etc.) that are general enough for any P2P applications.

  4. At the same time, care should be taken in this case, as [47] experienced degradation of ModelNet precision for aggregate traffic exceeding 600 Mbps, so that further testing would be needed in this case.

  5. The support for different operations simplify the implementation of different algorithms, that may rely on different inputs (e.g., average for iAWM [7] or maximum for [42]).

  6. This may be due to the fact that [67] exhaustively explores all torrents, while observation in [46] are limited to a smaller torrents catalog.

  7. Notice that edge-to-edge latencies are measured between any pair of gateways GW (or IP routers), taking into account the physical distance between US cities. End-to-end latencies are emulated by additionally taking into account the local loop network beside the access GW [36].

  8. HRC was however not available at the time of the experimental campaign.

  9. Since TCP is advantaged by smaller RTT, applications preferring high-bandwidth peers will also likely prefer nearby peers. Even for applications such as PPLive, using UDP at L4 and measuring transfer rates at L7, we experimentally verified that bandwidth preference induces a clustering of nearby peers [54].

  10. Notice that this should change with the recent ability in OneLab to reserve resources similarly to what happens in Grid5000

References

  1. ns3 homepage. http://www.nsnam.org. Accessed Mar 2011

  2. Omnetpp homepage. http://www.omnetpp.org. Accessed Mar 2011

  3. Abilene network. http://www.internet2.edu/network/. Accessed Oct 2010

  4. Akella A, Seshan S, Shaikh A (2003) An empirical evaluation of wide-area internet bottlenecks. In Proc of the 3rd ACM SIGCOMM conference on Internet Measurement (IMC’03), Miami, FL, USA

  5. Ietf ALTO. http://datatracker.ietf.org/wg/alto/charter/. Accessed Feb 2011

  6. Arad C, Dowling J, Haridi S (2009) Building and evaluating P2P systems using the Kompics component framework. In: Peer-to-peer computing, 2009. P2P’09. IEEE ninth international conference on, IEEE, pp 93–94

  7. Auer P, Cesa-Bianchi N, Gentile C (2002) Adaptive and self-confident on-line learning algorithms. J Comput Syst Sci 64(1):48–75

    Article  MathSciNet  MATH  Google Scholar 

  8. Augustin B, Cuvellier X, Orgogozo B, Viger F, Friedman T, Latapy M, Magnien C, Teixeira R (2006) Avoiding traceroute anomalies with Paris traceroute. In: Proc of ACM SIGCOMM Internet Measurement Conference, (IMC’06), Rio de Janeiro, Brazil

  9. Augustin B, Friedman T, Teixeira R (2007) Measuring load-balanced paths in the internet. In: ACM SIGCOMM Internet Measurement Conference (IMC’07), ACM, pp 149–160

  10. Baumgart I, Heep B, Krause S (2007) Oversim: a flexible overlay network simulation framework. In: IEEE global internet symposium, 2007, IEEE, pp 79–84

  11. Bindal R, Cao P, Chan W, Medved J, Suwala G, Bates T, Zhang A (2006) Improving traffic locality in BitTorrent via biased neighbor selection. In: Proc of IEEE distributed computing systems (ICDCS’06), Lisboa, Portugal

  12. Birke R, Kiraly C, Leonardi E, Mellia M, Meo M, Traverso S (2011) Hose rate control for P2P-tv streaming systems. In: Proc of IEEE international conference on peer-to-peer computing (P2P’11), Kyoto, Japan

  13. Birke R, Leonardi E, Mellia M, Bakay A, Szemethy T, Kiraly C, Cigno RL, Mathieu F, Muscariello L, Niccolini S, Seedorf J, Tropea G (2011) Architecture of a network-aware P2P-tv application: the Napa-Wine approach. IEEE Commun Mag 49:154–163

    Article  Google Scholar 

  14. BitTorrent home page. http://www.bittorrent.com. Accessed Nov 2010

  15. Blond SL, Legout A, Dabbous W (2011) Pushing BitTorrent locality to the limit. Comput Networks 55(3):541–557

    Article  Google Scholar 

  16. Cisco visual networking index: forecast and methodology, 20102015. http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/white_paper_c11-481360.pdf. Accessed Jan 2011

  17. Comcast discloses throttling practices BitTorrent targeted. http://www.wired.com/threatlevel/2008/09/comcast-disclos/. Accessed Feb 2009

  18. Bertsekas D (1999) Nonlinear programming. Athena Scientific

  19. Bertsekas D, Gallager R (1987) Data networks. Prentice-Hall

  20. da Silva A, Leonardi E, Mellia M, Meo M (2008) A bandwidth-aware scheduling strategy for P2P-tv systems. In: Proc of IEEE international conference on peer-to-peer computing (P2P’08), Aachen, Germany

  21. Dai L, Cao Y, Cui Y, Xue Y (2009) On scalability of proximity-aware peer-to-peer streaming. Comput Commun 32(1):144–153

    Article  Google Scholar 

  22. Dale C, Liu J, Peters J, Li B (2008) Evolution and enhancement of BitTorrent network topologies. In: Proc of ACM/IEEE International Workshop on Quality of Service (IWQoS’08), Twente, The Netherlands

  23. DiPalantino D, Johari R (2009) Traffic engineering vs content distribution: a game theoretic perspective. In: Proc of IEEE INFOCOM, Rio de Janeiro, Brazil

  24. Alessandria DRE, Muscariello L (2011) ModelNet-TE: an emulation tool for the study of P2P and traffic engineering interaction dynamics. Technical report, Telecom ParisTech. Available at http://www.enst.fr/∼drossi/ModelnetTE/modelnet-techrep.pdf

  25. Larroca F (2009) Techniques d’Ingénierie de trafic dynamique pour l’Internet. PhD thesis, Telecom ParisTech

  26. Galuba W, Aberer K, Despotovic Z, Kellerer W (2009) Protopeer: distributed systems prototyping toolkit. In: IEEE P2P’09, IEEE, pp 97–98

  27. García P, Pairot C, Mondéjar R, Pujol J, Tejedor H, Rallo R (2005) Planetsim: a new overlay network simulation framework. In: Software engineering and middleware, pp 123–136

  28. Grid5000 home page. http://www.grid5000.fr/. Accessed Jan 2011

  29. Horvath A, Telek M, Rossi D, Veglia P, Ciullo D, da Rocha Neta AG, Leonardi E, Mellia M (2010) Network awareness of P2P live streaming applications: a measurement study. IEEE Trans Multimedia 12(1):54–63

    Article  Google Scholar 

  30. Jiang W, Chiu D-M, Lui JCS (2005) On the interaction of multiple overlay routing. Perform Eval 62(1–4):229–246

    Article  Google Scholar 

  31. Keralapura R, Chuah C-N, Taft N, Iannaccone G (2004) Can ISPs take the heat from overlay networks? In: Proc of ACM workshop on hot topics in networks (HotNets-III), San Diego, CA, USA

  32. Legout A, Liogkas N, Kohler E, Zhang L (2007) Clustering and sharing incentives in BitTorrent systems. In: Proc of ACM SIGMETRICS, San Diego, CA, USA

  33. Legout A, Urvoy-Keller G, Michiardi P (2006) Rarest first and choke algorithms are enough. In: Proc of ACM SIGCOMM Internet Measurement Conference, (IMC’06), Rio de Janeiro, Brazil

  34. Leonardi E, Mellia M, Horvath A, Muscariello L, Niccolini S, Rossi D (2008) Building a cooperative P2P-tv application over a wise network: the approach of the European fp-7 strep Napa-Wine. IEEE Commun Mag 46(4):20–22

    Article  Google Scholar 

  35. Liu Y, Zhang H, Gong W, Towsley D (2005) On the interaction between overlay routing and underlay routing. In: Proc of IEEE INFOCOM, Miami, FL, USA

  36. Madhyastha HV, Isdal T, Piatek M, Dixon C, Anderson T, Krishnamurthy A, Venkataramani A (2006) iplane: an information plane for distributed services. In Proc of 7th USENIX sympsium on Operating Systems Design and Implementation (OSDI’06), Seattle, WA, USA

  37. Marciniak P, Liogkas N, Legout A, Kohler E (2008) Small is not always beautiful. In: Proc of 7th international workshop on peer-to-peer systems (IPTPS’07), Tampa, FL, USA

  38. Megaupload accuse orange de ralentissements. http://www.info.france2.fr/sciences-tech/megaupload-accuse-orange-de-ralentissements-66896673.html. Accessed Feb 2011

  39. Mellia M, Meo M, Muscariello L, Rossi D (2008) Passive analysis of tcp anomalies. Comput Networks 52(14):2663–2676

    Article  MATH  Google Scholar 

  40. ModelNet-TE Web page. http://perso.telecom-paristech.fr/∼drossi/index.php?n=Software.ModelNet-TE. Accessed Mar 2011

  41. Montresor A, Jelasity M (2009) Peersim: a scalable p2p simulator. In: IEEE P2P’09, pp 99–100

  42. Muscariello L, Perino D, Rossi D (2009) Do next generation networks need path diversity? In: Proc of IEEE International Conference on Communications, (ICC’09), Dresden, Germany

  43. Naicken S, Livingston B, Basu A, Rodhetbhai S, Wakeman I, Chalmers D (2007) The state of peer-to-peer simulators and simulations. ACM SIGCOMM Comput Commun Rev 37(2):95–98

    Article  Google Scholar 

  44. Onelab home page. http://www.onelab.eu. Accessed May 2011

  45. Orda A, Rom R, Shimkin N (1993) Competitive routing in multiuser communication networks. IEEE/ACM Trans Netw 1(5):510–521

    Article  Google Scholar 

  46. Piatek M, Isdal T, Anderson T, Krishnamurthy A, Venkataramani A (2007) Do incentives build robustness in BitTorrent? In: Proc of 4th USENIX symposium on Networked Systems Design & Implementation (NSDI’07), Cambridge, MA, USA

  47. Picconi F, Massoulié L (2008) Is there a future for mesh-based live video streaming? In: Proc of IEEE international conference on peer-to-peer computing (P2P’08), Aachen, Germany

  48. Picconi F, Massoulié L (2009) Isp friend or foe? Making p2p live streaming isp-aware. In: Proc of IEEE International Conference on Distributed Computing Systems (ICDCS’09), IEEE, Montreal, Quebec, Canada

  49. Planetlab home page. http://www.planet-lab.org. Accessed Jun 2011

  50. Qiu L, Yang YR, Zhang Y, Shenker S (2003) On selfish routing in internet-like environments. In: Proc of ACM SIGCOMM, Karlsruhe, Germany

  51. Rao A, Legout A, Dabbous W (2010) Can realistic BitTorrent experiments be performed on clusters? In: IEEE international conference on peer-to-peer computing (P2P’10), Delft, Netherlands

  52. Ren D, Li Y, Chan S (2008) On reducing mesh delay for peer-to-peer live streaming. In: IEEE INFOCOM, Phoenix, AZ, USA

  53. Rossi D, Testa C, Valenti S, Muscariello L (2010) Ledbat: the new BitTorrent congestion control protocol. In: Proc of International Conference on Computer Communication Networks (ICCCN’10), Zurich, Switzerland

  54. Rossi D, Veglia P (2010) An hybrid approach to assess the network awareness of P2P-tv applications. International Journal of Digital Multimedia Broadcasting, SI on Network-Aware Peer-to-Peer (P2P) and Internet Video. Hindawi IJDMB, vol 2010, Article ID 826351, 11 pp

  55. Rossi D, Veglia P (2011) Assessing the impact of signaling on the QoE of push-based P2P-tv diffusion algorithms. In: Proc of 4th IFIP international conference on New Technologies, Mobility and Security (NTMS’11), Paris, France

  56. Roughgarden T, Tardos É (2002) How bad is selfish routing. J ACM 49:236–259

    Article  MathSciNet  Google Scholar 

  57. Seibert J, Zage D, Fahmy S, Nita-Rotaru C (2008) Experimental comparison of peer-to-peer streaming overlays: an application perspective. In: Proc of IEEE conference on Local Computer Networks (LCN’08), Montreal, Canada

  58. Shumate P (2008) Fiber-to-the-home: 1977–2007. J Lightwave Technol 26(9):1093–1103

    Article  Google Scholar 

  59. Silverston T, Fourmaux O, Salamatian K, Cho K (2010) On fairness and locality in P2P-TV through large-scale measurement experiment. In: Proc of IEEE GLOBECOM, Miami, FL, USA

  60. Spring N, Peterson L, Bavier A, Pai V (2006) Using Planetlab for network research: myths, realities, and best practices. SIGOPS Oper Syst Rev 40:17–24

    Article  Google Scholar 

  61. Testa C, Rossi D (2011) The impact of uTP on BitTorrent completion time. In: Proc of IEEE international conference on peer-to-peer computing (P2P’11), Kyoto, Japan

  62. Vahdat A, Yocum K, Walsh K, Mahadevan P, Kostic D, Chase J, Becker D (2002) Scalability and accuracy in a large-scale network emulator. In: Proc of 5th USENIX symposium on operating systems design and implementation (OSDI’02)

  63. Table of united states metropolitan statistical areas. http://www.en.wikipedia.org/wiki/Table_of_United_States_Metropolitan_Statistical_Areas. Accessed Mar 2011

  64. Wong B, Slivkins A, Sirer EG (2005) Meridian: a lightweight network location service without virtual coordinates. In: Proc of ACM SIGCOMM, Philadelphia, Pennsylvania, USA

  65. Wu D, Dhungel P, Hei X, Zhang C, Ross K (2010) Understanding peer exchange in bittorrent systems. In: Proc of IEEE international conference on peer-to-peer computing (P2P’10), Delft, Netherlands

  66. Xu D, Chiang M, Rexford J (2011) Link-state routing with hop-by-hop forwarding can achieve optimal traffic engineering. IEEE/ACM Trans Netw PP(99):466–474

    Google Scholar 

  67. Zhang C, Dhungel P, Wu D, Ross K (2011) Unraveling the BitTorrent ecosystem. IEEE Trans Parallel Distrib Syst 22(7):1164–1177

    Article  Google Scholar 

  68. Zhang H, Liu Y, Gong W, Towsley D (2004) On the interaction between overlay routing and mpls traffic engineering. In: Proc of ACM SIGCOMM, poster session, Portland, OR, USA

Download references

Acknowledgements

This work was funded by FP7 STREP NAPA-WINE. Authors wish to thank Eugenio Alessandria and Luca Muscariello for their initial help on this work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Paolo Veglia.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rossi, D., Veglia, P., Sammarco, M. et al. ModelNet-TE: An emulation tool for the study of P2P and traffic engineering interaction dynamics. Peer-to-Peer Netw. Appl. 6, 194–212 (2013). https://doi.org/10.1007/s12083-012-0134-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12083-012-0134-x

Keywords

Navigation