Skip to main content
Book cover

International Conference on Passive and Active Network Measurement

PAM 2022: Passive and Active Measurement pp 199–215Cite as

A First Measurement with BGP Egress Peer Engineering

Part of the Lecture Notes in Computer Science book series (LNCS,volume 13210)

Abstract

This paper reports on measuring the effect of engineering egress traffic to peering ASes using Segment Routing, called BGP-EPE. BGP-EPE can send packets destined to arbitrary prefixes to arbitrary eBGP peers regardless of the BGP path selection. This ability enables us to measure external connectivity from a single AS in various perspectives; for example, does the use of paths other than the BGP best paths improve performance? We conducted an experiment to measure latency to the Internet from an event network, Interop Tokyo ShowNet, where SR-MPLS and BGP-EPE were deployed. Our findings from the experiment show BGP-EPE improves latency for 77% of target prefixes, and peering provides shorter latency than transit. We further show factors on which the degree of improvement depends, e.g., the performance-obliviousness of BGP and the presence of remote peering. Also, we find 91% of peer ASes forwarded packets towards prefixes that the peers did not advertise.

Keywords

  • BGP egress peer engineering
  • Segment routing
  • Internet latency

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-98785-5_9
  • Chapter length: 17 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   84.99
Price excludes VAT (USA)
  • ISBN: 978-3-030-98785-5
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   109.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.
Fig. 9.
Fig. 10.
Fig. 11.
Fig. 12.
Fig. 13.
Fig. 14.
Fig. 15.
Fig. 16.
Fig. 17.

Notes

  1. 1.

    We used an unanonymized version of the trace with a responsible person’s consent.

  2. 2.

    MAWI Traffic Archive FAQ, https://mawi.wide.ad.jp/mawi/faq.html.

References

  1. Alexa top 1 million sites. http://s3.amazonaws.com/alexa-static/top-1m.csv.zip

  2. Interop Tokyo 2021 (2021). https://interop.jp/en/

  3. Interop Tokyo 2021 ShowNet (2021). https://www.interop.jp/shownet/en/

  4. Ahmed, A., Shafiq, Z., Bedi, H., Khakpour, A.: Peering vs. transit: performance comparison of peering and transit interconnections. In: 2017 IEEE 25th International Conference on Network Protocols (ICNP), pp. 1–10 (2017). https://doi.org/10.1109/ICNP.2017.8117549

  5. Akella, A., Maggs, B., Seshan, S., Shaikh, A.: On the performance benefits of multihoming route control. IEEE/ACM Trans. Netw. 16(1), 91–104 (2008)

    CrossRef  Google Scholar 

  6. Apostolaki, M., Singla, A., Vanbever, L.: Performance-driven internet path selection. In: Proceedings of the Symposium on SDN Research, SOSR ’21. Association for Computing Machinery, New York (2021). https://doi.org/10.1145/3482898.3483357

  7. Arnold, T., et al.: Beating BGP is harder than we thought. In: Proceedings of the 18th ACM Workshop on Hot Topics in Networks, pp. 9b–16. HotNets ’19. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3365609.3365865

  8. Augustin, B., et al.: Avoiding traceroute anomalies with Paris traceroute. In: Proceedings of the 6th ACM SIGCOMM Conference on Internet Measurement, IMC ’06, pp. 153–158. Association for Computing Machinery, New York (2006). https://doi.org/10.1145/1177080.1177100

  9. CAIDA: As rank: A ranking of the largest autonomous systems (as) in the internet. https://asrank.caida.org/

  10. Castro, I., Cardona, J.C., Gorinsky, S., Francois, P.: Remote peering: more peering without internet flattening. In: Proceedings of the 10th ACM International on Conference on Emerging Networking Experiments and Technologies, CoNEXT ’14, pp. 185–198. Association for Computing Machinery, New York (2014). https://doi.org/10.1145/2674005.2675013

  11. Chen, E., Sangli, R.S.: Avoid BGP best path transitions from one external to another. RFC 5004 (2007). https://doi.org/10.17487/RFC5004. https://rfc-editor.org/rfc/rfc5004.txt

  12. Cho, K., Mitsuya, K., Kato, A.: Traffic data repository at the wide project. In: Proceedings of the Annual Conference on USENIX Annual Technical Conference, ATEC ’00, p. 51. USENIX Association, USA (2000)

    Google Scholar 

  13. Claypool, M., Claypool, K.: Latency can kill: precision and deadline in online games, pp. 215–222. Association for Computing Machinery, New York (2010). https://doi.org/10.1145/1730836.1730863

  14. Dac Duy Nguyen, H., Secci, S.: LISP-EC: enhancing lisp with egress control. In: 2016 IEEE Conference on Standards for Communications and Networking (CSCN), pp. 1–7 (2016). https://doi.org/10.1109/CSCN.2016.7785189

  15. Faratin, P., Clark, D., Bauer, S., Lehr, W., Gilmore, P., Berger, A.: The growing complexity of internet interconnection. Commun. Strat. 1, 51–72 (2008)

    Google Scholar 

  16. Feamster, N., Borkenhagen, J., Rexford, J.: Guidelines for interdomain traffic engineering. SIGCOMM Comput. Commun. Rev. 33(5), 19–30 (2003). https://doi.org/10.1145/963985.963988

    CrossRef  Google Scholar 

  17. Filsfils, C., Previdi, S., Dawra, G., Aries, E., Afanasiev, D.: Segment routing centralized BGP egress peer engineering. RFC 9087 (2021). https://doi.org/10.17487/RFC9087. https://rfc-editor.org/rfc/rfc9087.txt

  18. Filsfils, C., Previdi, S., Ginsberg, L., Decraene, B., Litkowski, S., Shakir, R.: Segment routing architecture. RFC 8402 (2018). https://doi.org/10.17487/RFC8402. https://rfc-editor.org/rfc/rfc8402.txt

  19. Goldenberg, D.K., Qiuy, L., Xie, H., Yang, Y.R., Zhang, Y.: Optimizing cost and performance for multihoming. SIGCOMM Comput. Commun. Rev. 34(4), 79–92 (2004)

    CrossRef  Google Scholar 

  20. Huston, G.: AS Names. https://bgp.potaroo.net/cidr/autnums.html

  21. Jager, M.: Securing ixp connectivity. APINIC 34 (2012). https://conference.apnic.net/34/pdf/apnic34-mike-jager-securing-ixp-connectivity_1346119861.pdf

  22. Juniper Networks: Containerized routing protocol daemon (CRPD) (2021). https://www.juniper.net/us/en/products/routers/containerized-routing-protocol-daemon-crpd.html

  23. Khan, F.: The cost of latency—digital realty (2015). https://www.digitalrealty.com/blog/the-cost-of-latency

  24. Luckie, M.: Scamper: a scalable and extensible packet prober for active measurement of the internet. In: Proceedings of the 10th ACM SIGCOMM Conference on Internet Measurement, IMC ’10, pp. 239–245. Association for Computing Machinery, New York (2010). https://doi.org/10.1145/1879141.1879171

  25. Norton, W.: DrPeering white paper - the art of peering: the peering playbook, 7. partial transit (regional) (2010). http://drpeering.net/white-papers/Art-Of-Peering-The-Peering-Playbook.html#7

  26. PCI-SIG: Single root i/o virtualization and sharing specification revision 1.1 (2010). https://pcisig.com/single-root-io-virtualization-and-sharing-specification-revision-11

  27. Rekhter, Y., Hares, S., Li, T.: A Border Gateway Protocol 4 (BGP-4). RFC 4271 (2006). https://doi.org/10.17487/RFC4271. https://rfc-editor.org/rfc/rfc4271.txt

  28. Schlinker, B., et al.: Engineering egress with edge fabric: steering oceans of content to the world. In: Proceedings of the Conference of the ACM Special Interest Group on Data Communication, SIGCOMM ’17, pp. 418–431. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3098822.3098853

  29. StefPrevidi, S., Talaulikar, K., Filsfils, Clarence Filand Patel, K., Ray, S., Dong, J.: Border Gateway Protocol - Link State (BGP-LS) Extensions for Segment Routing BGP Egress Peer Engineering. RFC 9086 (2021). https://doi.org/10.17487/RFC9086. https://rfc-editor.org/rfc/rfc9086.txt

  30. The ANT Lab: IP Address Space Hitlists. https://ant.isi.edu/datasets/ip_hitlists/format.html

  31. Tsurumaki, S.: How do we improve internet connectivity outside major cities? A Japanese approach. APNIC Blog (2021). https://blog.apnic.net/2021/09/02/how-do-we-improve-internet-connectivity-outside-major-cities-a-japanese-approach/

  32. Ventre, P.L., et al.: Segment routing: a comprehensive survey of research activities, standardization efforts, and implementation results. IEEE Commun. Surv. Tutor. 23(1), 182–221 (2021). https://doi.org/10.1109/COMST.2020.3036826

    CrossRef  Google Scholar 

  33. Yap, K.K., et al.: Taking the edge off with espresso: scale, reliability and programmability for global internet peering. In: Proceedings of the Conference of the ACM Special Interest Group on Data Communication, SIGCOMM ’17, pp. 432–445. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3098822.3098854

Download references

Acknowledgments

We would like to thank our shepherd Dr. Marcel Flores and the anonymous reviewers for their insightful feedback. We also thank all the people involved in Interop Tokyo ShowNet 2021.

Author information

Authors and Affiliations

  1. The University of Tokyo, Tokyo, Japan

    Ryo Nakamura

  2. Juniper Networks K.K., Tokyo, Japan

    Kazuki Shimizu

  3. Cisco Systems G.K., Tokyo, Japan

    Teppei Kamata

  4. University of Strasbourg, Strasbourg, France

    Cristel Pelsser

Authors
  1. Ryo Nakamura
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kazuki Shimizu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Teppei Kamata
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Cristel Pelsser
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ryo Nakamura .

Editor information

Editors and Affiliations

  1. Brandenburg University of Technology, Cottbus, Germany

    Oliver Hohlfeld

  2. SIDN Labs - TU Delft, Arnhem, The Netherlands

    Giovane Moura

  3. ICube - University of Strasbourg, Illkirch, France

    Cristel Pelsser

Appendices

Appendices

A Other Metrics for Representative RTTs

We chose the minimum, not median, RTTs for each prefix to avoid statistical errors. Figure 18a shows the median version of Fig. 5. As shown, there is no significant difference between minimum and median in a broad view. However, Fig. 19, which shows the median version of improved latency with peering (Fig. 11c, 12c, 13b, and 14b), includes such errors. Accidentally overestimated RTTs cause inaccurate latency differences between peering and transit.

Fig. 18.
figure 18

CDF of RTTs to target prefixes or addresses.

Full size image
Fig. 19.
figure 19

Peering vs. transit with median RTTs on a per-prefix basis.

Full size image

Throughout the paper, we summarized RTTs by prefixes in the BGP table. Figure 18b shows the not-summarized version, which means per-address RTT, of Fig. 5. Differences between the figures, e.g., the per-address version has a higher rate with RTTs under 100 ms, arises from a bias on the distribution of target addresses. In addition, Fig. 20 shows the per-address version of peering versus transit (Fig. 11c, 12c, 13b, and 14b). The figure shows results similar to the per-prefix versions. This is because the number of prefixes advertised from the peers was small (3526 unique prefixes). As a result, there were no especially large prefixes that accommodated many target addresses.

Fig. 20.
figure 20

Peering vs. transit with minimum RTTs on per-address basis.

Full size image

Rights and permissions

Reprints and Permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Nakamura, R., Shimizu, K., Kamata, T., Pelsser, C. (2022). A First Measurement with BGP Egress Peer Engineering. In: Hohlfeld, O., Moura, G., Pelsser, C. (eds) Passive and Active Measurement. PAM 2022. Lecture Notes in Computer Science, vol 13210. Springer, Cham. https://doi.org/10.1007/978-3-030-98785-5_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-98785-5_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-98784-8

  • Online ISBN: 978-3-030-98785-5

  • eBook Packages: Computer ScienceComputer Science (R0)