Skip to main content
Log in

Data Plane Programmability Beyond OpenFlow: Opportunities and Challenges for Network and Service Operations and Management

  • Published:
Journal of Network and Systems Management Aims and scope Submit manuscript

Abstract

SDN and OpenFlow reshaped the way we configure forwarding devices and determine network behavior, by offering an open interface upon which apps like routing, monitoring, etc. can be built. SDN/OpenFlow helped break network “ossification” and unleash evolution, by enabling one to effectively think networking from top-down. It evidenced, however, a subtle but important problem: networking evolution is also hampered by the inability to change switch behavior, which forces one to build systems constrained from the bottom up. This scenario can change dramatically with the re-emergence of programmable data planes, and languages like POF and P4. Although recent, these languages proved to be very influential, powering several contributions towards flexible and customizable forwarding devices. In this paper, we survey the literature on data plane programmability, from early concepts (like Active Networks) to state-of-the-art solutions. We then dive into research questions that more recent work (especially P4) have uncovered: how to deploy and manage custom switch programs in large-scale networks? Can we improve services like monitoring and security with programmable data planes? Can we make network operation more dependable? As another contribution, we organize and discuss opportunities and challenges with potential to influence research in the field, from the perspective of network and service operations and management.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

(Adapted from Bosshart et al. [19])

Fig. 2

(Adapted from Kim and Lee [50])

Fig. 3
Fig. 4

(Adapted from Thomas and Laupkhov [120])

Similar content being viewed by others

Notes

  1. www.geni.net.

  2. www.ict-fire.eu.

  3. www.opennetworking.org.

References

  1. Leiner, B.M., Cerf, V.G., Clark, D.D., Kahn, R.E., Kleinrock, L., Lynch, D.C., Postel, J., Roberts, L.G., Wolff, S.: A brief history of the internet. SIGCOMM Comput. Commun. Rev. 39, 22–31 (2009)

    Article  Google Scholar 

  2. Kleinrock, L.: Information flow in large communication nets. RLE Quarterly Progress Report, Massachusetts Institute of Technology (1961). https://www.lk.cs.ucla.edu/bibliography-public_reports.html. Accessed on 24 Aug 2017

  3. Cerf, V., Kahn, R.: A protocol for packet network intercommunication. IEEE Trans. Commun. 22, 637–648 (1974)

    Article  Google Scholar 

  4. Cerf, V., Dalal, Y., Sunshine, C.: Specification of Internet Transmission Control Program. RFC 675, Dec 1974

  5. Berners-Lee, T., Cailliau, R.: Worldwideweb: proposal for a hypertext project. Retrieved on 26 Feb 2008 (1990)

  6. Deering, D.S.E., Hinden, R.M.: Internet Protocol, Version 6 (IPv6) Specification. RFC 1883, Dec 1995

  7. Czyz, J., Allman, M., Zhang, J., Iekel-Johnson, S., Osterweil, E., Bailey, M.: Measuring ipv6 adoption. SIGCOMM Comput. Commun. Rev. 44, 87–98 (2014)

    Article  Google Scholar 

  8. Czyz, J., Allman, M., Zhang, J., Iekel-Johnson, S., Osterweil, E., Bailey, M.: Measuring ipv6 adoption. In: Proceedings of the 2014 ACM Conference on SIGCOMM (SIGCOMM’14), New York, NY. pp. 87–98. ACM (2014)

  9. Google, Google ipv6 statistics, 2017. Accessed on 29 June 2017

  10. Turner, J.S., Taylor, D.E.: Diversifying the internet. In: Global Telecommunications Conference, 2005 (GLOBECOM’05) IEEE, vol. 2 (2005)

  11. McKeown, N., Anderson, T., Balakrishnan, H., Parulkar, G., Peterson, L., Rexford, J., Shenker, S., Turner, J.: Openflow: enabling innovation in campus networks. SIGCOMM Comput. Commun. Rev. 38, 69–74 (2008)

    Article  Google Scholar 

  12. Anderson, T., Peterson, L., Shenker, S., Turner, J.: Overcoming the internet impasse through virtualization. Computer 38, 34–41 (2005)

    Article  Google Scholar 

  13. Touch, J., Wang, Y.-S., Eggert, L., Finn, G.: A virtual internet architecture. In: ACM SIGCOMM Workshop on Future Directions in Network Architecture, pp. 73–80 (2003)

  14. Kreutz, D., Ramos, F.M.V., Veríssimo, P.E., Rothenberg, C.E., Azodolmolky, S., Uhlig, S.: Software-defined networking: a comprehensive survey. Proc. IEEE 103, 14–76 (2015)

    Article  Google Scholar 

  15. Moy, J.: OSPF Version 2. RFC 2328, Apr 1998

  16. Rekhter, Y., Hares, S., Li, D.T.: A Border Gateway Protocol 4 (BGP-4). RFC 4271, Jan 2006

  17. Perlman, R.: An algorithm for distributed computation of a spanningtree in an extended lan. SIGCOMM Comput. Commun. Rev. 15, 44–53 (1985)

    Article  Google Scholar 

  18. Andersson, L., Minei, I.: LDP Specification. RFC 5036, Oct 2007

  19. Bosshart, P., Daly, D., Gibb, G., Izzard, M., McKeown, N., Rexford, J., Schlesinger, C., Talayco, D., Vahdat, A., Varghese, G., Walker, D.: P4: programming protocol-independent packet processors. SIGCOMM Comput. Commun. Rev. 44, 87–95 (2014)

    Article  Google Scholar 

  20. Song, H.: Protocol-oblivious forwarding: Unleash the power of SDN through a future-proof forwarding plane. In: Proceedings of the Second ACM SIGCOMM Workshop on Hot Topics in Software Defined Networking (HotSDN’13), New York, NY, pp. 127–132. ACM (2013)

  21. Sivaraman, A., Kim, C., Krishnamoorthy, R., Dixit, A., Budiu, M.: Dc.p4: programming the forwarding plane of a data-center switch. In: Proceedings of the 1st ACM SIGCOMM Symposium on Software Defined Networking Research (SOSR’15), New York, NY, pp. 2:1–2:8. ACM (2015)

  22. Feamster, N., Rexford, J., Zegura, E.: The Road to SDN: An intellectual history of programmable networks. SIGCOMM Comput. Commun. Rev. 44, 87–98 (2014)

    Article  Google Scholar 

  23. Calvert, K.L., Bhattacharjee, S., Zegura, E., Sterbenz, J.: Directions in active networks. IEEE Commun. Mag. 36, 72–78 (1998)

    Article  Google Scholar 

  24. Tennenhouse, D.L., Smith, J.M., Sincoskie, W.D., Wetherall, D.J., Minden, G.J.: A survey of active network research. IEEE Commun. Mag. 35, 80–86 (1997)

    Article  Google Scholar 

  25. White, J.E.: Telescript: the foundation for the electronic marketplace. Technical report, General Magic, Inc (1993)

  26. Gray, R.S.: Agent tcl: A flexible and secure mobile-agent system. In: Proceedings of the Fourth Annual USENIX Tcl/Tk Workshop, Fourth Annual Tcl/Tk Workshop, Berkeley, CA, USENIX (1996)

  27. Schoenwaelder, J., Quittek, J.: Script MIB Extensibility Protocol Version 1.1. RFC 3179, Oct. 2001. Accessed on 29 June 2017

  28. Wetherall, D.J., Guttag, J.V., Tennenhouse, D.L.: ANTS: a toolkit for building and dynamically deploying network protocols. In: 1998 IEEE Open Architectures and Network Programming, pp. 117–129. Apr 1998

  29. Wetherall, D.: Active network vision and reality: lessons from a capsule-based system. In: Proceedings DARPA Active Networks Conference and Exposition, pp. 25–40 (2002)

  30. Alexander, D.S., Shaw, M., Nettles, S.M., Smith, J.M.: Active bridging. In: Proceedings of the ACM SIGCOMM’97 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM’97), New York, NY, pp. 101–111. ACM (1997)

  31. Alexander, D.S., Arbaugh, W.A., Hicks, M.W., Kakkar, P., Keromytis, A.D., Moore, J.T., Gunter, C.A., Nettles, S.M., Smith, J.M.: The SwitchWare active network architecture. IEEE Netw. 12, 29–36 (1998)

    Article  Google Scholar 

  32. Brunner, M., Stadler, R.: The impact of active networking technology on service management in a telecom environment. In: Integrated Network Management VI. Distributed Management for the Networked Millennium. Proceedings of the Sixth IFIP/IEEE International Symposium on Integrated Network Management (Cat. No.99EX302), pp. 385–400 (1999)

  33. Smith, J.M., Calvert, K.L., Murphy, S.L., Orman, H.K., Peterson, L.L.: Activating networks: a progress report. Computer 32, 32–41 (1999)

    Article  Google Scholar 

  34. Quittek, J., Brunner, M.: Applying and evaluating active technologies in distributed management. J. Netw. Syst. Manag. 11(2), 171–197 (2003)

    Article  Google Scholar 

  35. Yang, L., Dantu, R., Anderson, T., Gopal, R.: Forwarding and Control Element Separation (ForCES) Framework. RFC 3746, Apr. 2004. Accessed on 29 June (2017)

  36. Feamster, N., Balakrishnan, H., Rexford, J., Shaikh, A., van der Merwe, J.: The case for separating routing from routers. In: Proceedings of the ACM SIGCOMM Workshop on Future Directions in Network Architecture (FDNA’04), New York, NY, pp. 5–12. ACM (2004)

  37. Lakshman, T., Nandagopal, T., Ramjee, R., Sabnani, K., Woo, T.: The softrouter architecture. In: Proceedings of ACM SIGCOMM Workshop on Hot Topics in Networking, vol. 2004, Citeseer (2004)

  38. Salim, J., Khosravi, H., Kleen, A., Kuznetsov, A.: Linux Netlink as an IP Services Protocol. RFC 3549, July 2003 Accessed on 29 June 2017

  39. Greenberg, A., Hjalmtysson, G., Maltz, D.A., Myers, A., Rexford, J., Xie, G., Yan, H., Zhan, J., Zhang, H.: A clean slate 4d approach to network control and management. SIGCOMM Comput. Commun. Rev. 35, 41–54 (2005)

    Article  Google Scholar 

  40. Yan, H., Maltz, D.A., Ng, T.E., Gogineni, H., Zhang, H., Cai, Z.: Tesseract: a 4d network control plane. NSDI 7, 27–27 (2007)

    Google Scholar 

  41. Casado, M., Garfinkel, T., Akella, A., Freedman, M.J., Boneh, D., McKeown, N., Shenker, S.: Sane: a protection architecture for enterprise networks. In: Usenix Security (2006)

  42. Casado, M., Freedman, M.J., Pettit, J., Luo, J., McKeown, N., Shenker, S.: Ethane: taking control of the enterprise. In: Proceedings of the 2007 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM’07), New York, NY, pp. 1–12. ACM (2007)

  43. Gude, N., Koponen, T., Pettit, J., Pfaff, B., Casado, M., McKeown, N., Shenker, S.: Nox: towards an operating system for networks. SIGCOMM Comput. Commun. Rev. 38, 105–110 (2008)

    Article  Google Scholar 

  44. Foster, N., Freedman, M.J., Harrison, R., Rexford, J., Meola, M.L., Walker, D.: Frenetic: A high-level language for openflow networks. In: Proceedings of the Workshop on Programmable Routers for Extensible Services of Tomorrow (PRESTO’10), New York, NY, pp. 6:1–6:6. ACM (2010)

  45. Tootoonchian, A., Ganjali, Y.: Hyperflow: A distributed control plane for openflow. In: Proceedings of the 2010 Internet Network Management Conference on Research on Enterprise Networking, p. 3 (2010)

  46. Macedo, D.F., Guedes, D., Vieira, L.F.M., Vieira, M.A.M., Nogueira, M.: Programmable networks: from software-defined radio to software-defined networking. IEEE Commun. Surv. Tutor. 17, 1102–1125 (2015)

    Article  Google Scholar 

  47. Dabbagh, M., Hamdaoui, B., Guizani, M., Rayes, A.: Software-defined networking security: pros and cons. IEEE Commun. Mag. 53, 73–79 (2015)

    Article  Google Scholar 

  48. Kim, C., Sivaraman, A., Katta, N., Bas, A., Dixit, A., Wobker, L.J.: In-band network telemetry via programmable dataplanes. In: ACM SIGCOMM Symposium on SDN Research (SOSR) (2015)

  49. Dang, H.T., Canini, M., Pedone, F., Soulé, R.: Paxos made switch-y. SIGCOMM Comput. Commun. Rev. 46, 18–24 (2016)

    Article  Google Scholar 

  50. Kim, C., Lee, J.: P4: Programming the network data plane. ACM SIGCOMM Tutorial, August 2016. Accessed on 29 June 2017

  51. P4, P4 reference compiler. 2017. Accessed on 10 Aug 2017

  52. Li, P., Luo, Y.: P4gpu: Acceleration of programmable data plane using a cpu-gpu heterogeneous architecture. In: 2016 IEEE 17th International Conference on High Performance Switching and Routing (HPSR), pp. 168–175, June 2016

  53. Li, P., Luo, Y.: P4gpu: Accelerate packet processing of a p4 program with a cpu-gpu heterogeneous architecture. In: 2016 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS), pp. 125–126, Mar 2016

  54. Programming nfp with p4 and c. Technical report, Netronome, Santa Clara, CA, 2017. Accessed on 10 Aug 2017

  55. Tnsing, J.: P4/pif+c programmable intelligent nics: Requirements and implementation notes. In: The 2nd P4 Workshop, Stanford, CA (2015)

  56. Wang, H., Soulé, R., Dang, H.T., Lee, K.S., Shrivastav, V., Foster, N., Weatherspoon, H.: P4fpga: a rapid prototyping framework for p4. In: Proceedings of the Symposium on SDN Research (SOSR’17), New York, NY, pp. 122–135. ACM (2017)

  57. Brebner, G.: P4 for an fpga target. In: P4 Workshop (2015)

  58. Benácek, P., Pu, V., Kubátová, H.: P4-to-vhdl: Automatic generation of 100 gbps packet parsers. In: 2016 IEEE 24th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), pp. 148–155, May 2016

  59. P4, Behavorial model v2: P4 reference software switch. 2017. Accessed on 10 Aug 2017

  60. Shahbaz, M., Choi, S., Pfaff, B., Kim, C., Feamster, N., McKeown, N., Rexford, J.: Pisces: A programmable, protocol-independent software switch. In: Proceedings of the 2016 ACM SIGCOMM Conference (SIGCOMM’16), New York, NY, pp. 525–538. ACM (2016)

  61. Pfaff, B., Pettit, J., Koponen, T., Jackson, E., Zhou, A., Rajahalme, J., Gross, J., Wang, A., Stringer, J., Shelar, P., Amidon, K., Casado, M.: The design and implementation of open vswitch. In: 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI’15), pp. 117–130 (2015)

  62. P4, Packet testing framework. 2017. Accessed on 10 Aug 2017

  63. Dang, H.T., Wang, H., Jepsen, T., Brebner, G., Kim, C., Rexford, J., Soulé, R., Weatherspoon, H.: Whippersnapper: a p4 language benchmark suite. In: Proceedings of the Symposium on SDN Research (SOSR’17), New York, NY, pp. 95–101. ACM (2017)

  64. Abhashkumar, A., Lee, J., Tourrilhes, J., Banerjee, S., Wu, W., Kang, J.-M., Akella, A.: P5: Policy-driven optimization of p4 pipeline. In: Proceedings of the Symposium on SDN Research (SOSR’17), New York, NY, pp. 136–142. ACM (2017)

  65. Abdi, S., Aftab, U., Bailey, G., Boughzala, B., Dewal, F., Parsazad, S., Tremblay, E.: Pfpsim: a programmable forwarding plane simulator. In: 2016 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS), pp. 55–60, Mar 2016

  66. Hancock, D., van der Merwe, J.: Hyper4: Using p4 to virtualize the programmable data plane. In: Proceedings of the 12th International on Conference on Emerging Networking EXperiments and Technologies (CoNEXT’16), New York, NY, pp. 35–49, ACM (2016)

  67. Zhang, C., Bi, J., Zhou, Y., Dogar, A.B., Wu, J.: Mpvisor: A modular programmable data plane hypervisor. In: Proceedings of the Symposium on SDN Research (SOSR’17), New York, NY, pp. 179–180, ACM (2017)

  68. Avizienis, A., Laprie, J.-C., Randell, B., Landwehr, C.: Basic concepts and taxonomy of dependable and secure computing. IEEE Trans. Dependable Secur. Comput. 1, 11–33 (2004)

    Article  Google Scholar 

  69. Damianou, N., Dulay, N., Lupu, E., Sloman, M.: The ponder policy specification language. In: Proceedings of the International Workshop on Policies for Distributed Systems and Networks (POLICY’01), London, pp. 18–38, Springer, Berlin (2001)

  70. Sloman, M.: Policy driven management for distributed systems. Journal of Network and Systems Management 2(4), 333–360 (1994)

    Article  Google Scholar 

  71. Sloman, M., Lupu, E.: Security and management policy specification. IEEE Network 16, 10–19 (2002)

    Article  Google Scholar 

  72. Fogel, A., Fung, S., Pedrosa, L., Walraed-Sullivan, M., Govindan, R., Mahajan, R., Millstein, T.: A General Approach to Network Configuration Analysis. In: 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI), pp. 469–483, May 2015

  73. Kazemian, P., Varghese, G., McKeown, N.: Header space analysis: Static checking for networks. In: Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation (NSDI’12), Berkeley, CA, pp. 9–9, USENIX Association (2012)

  74. Khurshid, A., Zou, X., Zhou, W., Caesar, M., Godfrey, P.B.: Veriflow: verifying network-wide invariants in real time. In: Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI’13), pp. 15–27 (2013)

  75. Son, S., Shin, S., Yegneswaran, V., Porras, P., Gu, G.: Model Checking Invariant Security Properties in OpenFlow. In: IEEE International Conference on Communications, pp. 1974–1979 (2013)

  76. Fayaz, S.K., Yu, T., Tobioka, Y., Chaki, S., Sekar, V.: Buzz: Testing context-dependent policies in stateful networks. In: 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI’16), pp. 275–289, USENIX Association (2016)

  77. Lopes, N.P., Bjørner, N., Godefroid, P., Jayaraman, K., Varghese, G.: Checking beliefs in dynamic networks. In: 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI’15), pp. 499–512 (2015)

  78. Mai, H., Khurshid, A., Agarwal, R., Caesar, M., Godfrey, P.B., King, S.T.: Debugging the data plane with anteater. SIGCOMM Comput. Commun. Rev. 41, 290–301 (2011)

    Article  Google Scholar 

  79. Boutaba, R., Aib, I.: Policy-based management: A historical perspective. Journal of Network and Systems Management 15, 447–480 (2007)

    Article  Google Scholar 

  80. Udupi, Y.B., Sahai, A., Singhal, S.: A classification-based approach to policy refinement. In: 2007 10th IFIP/IEEE International Symposium on Integrated Network Management, pp. 785–788, May 2007

  81. Craven, R., Lobo, J., Lupu, E., Russo, A., Sloman, M.: Policy refinement: Decomposition and operationalization for dynamic domains. In: 2011 7th International Conference on Network and Service Management, pp. 1–9, Oct 2011

  82. Verma, D.C.: Simplifying network administration using policy-based management. IEEE network 16(2), 20–26 (2002)

    Article  Google Scholar 

  83. A. Westerinen, Schnizlein, J., Strassner, J., Scherling, M., Quinn, B., Herzog, S., Huynh, A., Carlson, M., Perry, J., Waldbusser, S.: Terminology for Policy-Based Management. RFC 3198, Nov 2001

  84. Kreutz, D., Ramos, F.M., Verissimo, P.: Towards secure and dependable software-defined networks. In: Proceedings of the Second ACM SIGCOMM Workshop on Hot Topics in Software Defined Networking (HotSDN’13), New York, NY, pp. 55–60, ACM (2013)

  85. Lupu, E.C., Sloman, M.: Conflicts in policy-based distributed systems management. IEEE Trans. Softw. Eng. 25, 852–869 (1999)

    Article  Google Scholar 

  86. Hamed, H., Al-Shaer, E.: Taxonomy of conflicts in network security policies. IEEE Communications Magazine 44, 134–141 (2006)

    Article  Google Scholar 

  87. Canini, M., Venzano, D., Perešíni, P., Kostić, D., Rexford, J.: A nice way to test openflow applications. In: Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation (NSDI’12), Berkeley, CA, pp. 10–10, USENIX Association (2012)

  88. Stoenescu, R., Popovici, M., Negreanu, L., Raiciu, C.: Symnet: Scalable symbolic execution for modern networks. In: Proceedings of the 2016 Conference on ACM SIGCOMM 2016 Conference (SIGCOMM’16), New York, NY, pp. 314–327, ACM (2016)

  89. Dobrescu, M., Argyraki, K.: Software dataplane verification. In: Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation (NSDI’14), Berkeley, CA, pp. 101–114, USENIX Association (2014)

  90. Feamster, N., Balakrishnan, H.: Detecting bgp configuration faults with static analysis. In: Proceedings of the 2Nd Conference on Symposium on Networked Systems Design & Implementation (NSDI’05), Berkeley, CA, vol. 2, pp. 43–56, USENIX Association (2005)

  91. Yuan, L., Mai, J., Su, Z., Chen, H., Chuah, C.-N., Mohapatra, P.: Fireman: a toolkit for firewall modeling and analysis. In: Proceedings of the 2006 IEEE Symposium on Security and Privacy (SP’06), Washington, DC, pp. 199–213, IEEE Computer Society (2006)

  92. Xie, G.G., Zhan, J., Maltz, D.A., Zhang, H., Greenberg, A., Hjalmtysson, G., Rexford, J.: On static reachability analysis of ip networks. In: Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies., vol. 3, pp. 2170–2183 (2005)

  93. Kazemian, P., Chang, M., Zeng, H., Varghese, G., McKeown, N., Whyte, S.: Real time network policy checking using header space analysis. In: Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI’13), pp. 99–111 (2013)

  94. Sandhu, R.S.: Lattice-based access control models. Computer 26, 9–19 (1993)

    Article  Google Scholar 

  95. Katta, N., Hira, M., Ghag, A., Kim, C., Keslassy, I., Rexford, J.: Clove: How I learned to stop worrying about the core and love the edge. In: Proceedings of the 15th ACM Workshop on Hot Topics in Networks (HotNets’16), New York, NY, pp. 155–161. ACM (2016)

  96. Mizrahi, T., Moses, Y.: The case for data plane timestamping in sdn. In: 2016 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), pp. 856–861, April 2016

  97. Bremler-Barr, A., Harchol, Y., Hay, D.: Openbox: enabling innovation in middlebox applications. In: Proceedings of the 2015 ACM SIGCOMM Workshop on Hot Topics in Middleboxes and Network Function Virtualization (HotMiddlebox’15), New York, NY, pp. 67–72. ACM (2015)

  98. Bremler-Barr, A., Harchol, Y., Hay, D.: Openbox: A software-defined framework for developing, deploying, and managing network functions. In: Proceedings of the 2016 ACM SIGCOMM Conference (SIGCOMM’16), New York, NY, pp. 511–524. ACM (2016)

  99. Xing, T., Huang, D., Xu, L., Chung, C.-J., Khatkar, P.: Snortflow: a openflow-based intrusion prevention system in cloud environment. In: Proceedings of the 2013 Second GENI Research and Educational Experiment Workshop (GREE’13), Washington, DC, pp. 89–92, IEEE Computer Society (2013)

  100. Tangari, G., Charalambides, M., Tuncer, D., Pavlou, G.: Decentralized Solutions for Monitoring Large-Scale Software-Defined Networks, pp. 47–51. Springer, Cham (2016)

    Google Scholar 

  101. Kothandaraman, B., Du, M., Sköldström, P.: Centrally controlled distributed vnf state management. In: Proceedings of the 2015 ACM SIGCOMM Workshop on Hot Topics in Middleboxes and Network Function Virtualization (HotMiddlebox’15), New York, NY, pp. 37–42. ACM (2015)

  102. Verissimo, P.E., Neves, N.F., Cachin, C., Poritz, J., Powell, D., Deswarte, Y., Stroud, R., Welch, I.: Intrusion-tolerant middleware: the road to automatic security. IEEE Secur. Priv. 4(4), 54–62 (2006)

    Article  Google Scholar 

  103. Al-Kuwaiti, M., Kyriakopoulos, N., Hussein, S.: A comparative analysis of network dependability, fault-tolerance, reliability, security, and survivability. IEEE Commun. Surv. Tutor. 11, 106–124 (2009)

    Article  Google Scholar 

  104. Nguyen, Q., Sood, A.: A comparison of intrusion-tolerant system architectures. IEEE Secur. Priv. 9(4), 24–31 (2011)

    Article  Google Scholar 

  105. Fisher, D., Linger, R., Lipson, H., Longstaff, T., Mead, N., Ellison, R.: Survivable network systems: an emerging discipline. Technical report. CMU/SEI-97-TR-013, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA, 1997. Accessed on 29 June 2017

  106. Aboba, B., Arkko, J., Harrington, D.: Introduction to Accounting Management. RFC 2975, Oct. 2000. Accessed on 29 June 2017

  107. Claise, B., Wolter, R.: Network Management: Accounting and Performance Strategies. Cisco Press, Indianapolis (2006)

    Google Scholar 

  108. Cisco Networks, Cisco IOS NetFlow. Accessed on 29 June 2017

  109. sFlow, sflow.org - making the network visible. Accessed on 29 June 2017

  110. Estan, C., Varghese, G.: New directions in traffic measurement and accounting: Focusing on the elephants, ignoring the mice. ACM Trans. Comput. Syst. 21, 270–313 (2003)

    Article  Google Scholar 

  111. Charikar, M., Chen, K., Farach-Colton, M.: Finding Frequent Items in Data Streams, pp. 693–703. Springer, Berlin (2002)

    MATH  Google Scholar 

  112. Manku, G.S., Motwani, R.: Approximate frequency counts over data streams. In: Proceedings of the 28th International Conference on Very Large Data Bases (VLDB’02), pp. 346–357, VLDB Endowment (2002)

  113. Schweller, R., Gupta, A., Parsons, E., Chen, Y.: Reversible sketches for efficient and accurate change detection over network data streams. In: Proceedings of the 4th ACM SIGCOMM Conference on Internet Measurement (IMC’04), New York, NY, pp. 207–212. ACM (2004)

  114. Cormode, G., Muthukrishnan, S.: An improved data stream summary: the count-min sketch and its applications. J. Algorithms 55(1), 58–75 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  115. Yu, M., Jose, L., Miao, R.: Software defined traffic measurement with opensketch. NSDI 13, 29–42 (2013)

    Google Scholar 

  116. Li, Y., Miao, R., Kim, C., Yu, M.: Flowradar: a better netflow for data centers. In: 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI’16), pp. 311–324, USENIX Association (2016)

  117. Brockners, F., Bhandari, S., Dara, S., Pignataro, C., Gredler, H., Leddy, J., Youell, S., Mozes, D., Mizrahi, T., Lapukhov, P., Chang, R.: Requirements for in-situ oam. Internet-Draft draft-brockners-inband-oam-requirements-03, IETF Secretariat, March 2017. Accessed on 29 June 2017

  118. Jeyakumar, V., Alizadeh, M., Geng, Y., Kim, C., Mazières, D.: Millions of little minions: using packets for low latency network programming and visibility. In: Proceedings of the 2014 ACM Conference on SIGCOMM (SIGCOMM’14), New York, NY, pp. 3–14. ACM (2014)

  119. Cisco, In-band OAM (iOAM). Accessed on 29 June 2017

  120. Thomas, J., Laupkhov, P.: Tracking packets’ paths and latency via int (in-band network telemetry). 3rd P4 Workshop, may 2016. Accessed on 29 June (2017)

  121. Zhu, Y., Kang, N., Cao, J., Greenberg, A., Lu, G., Mahajan, R., Maltz, D., Yuan, L., Zhang, M., Zhao, B.Y., Zheng, H.: Packet-level telemetry in large datacenter networks. In: Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication (SIGCOMM’15), New York, NY, pp. 479–491. ACM (2015)

  122. Sivaraman, H., Narayana, S., Rottenstreich, O., Muthukrishnan, S., Rexford, J.: Heavy-hitter detection entirely in the data plane. In: Proceedings of the Symposium on SDN Research (SOSR’17), New York, NY, pp. 164–176. ACM (2017)

  123. Gupta, A., Harrison, R., Pawar, A., Birkner, R., Canini, M., Feamster, N., Rexford, J., Willinger, W.: Sonata: query-driven network telemetry (2017). arXiv:1705.01049

  124. Ghasemi, M., Benson, T., Rexford, J.: Dapper: Data plane performance diagnosis of tcp. In: Proceedings of the Symposium on SDN Research (SOSR’17), New York, NY, pp. 61–74. ACM (2017)

  125. Medhi, D., Ramasamy, K.: Network routing: algorithms, protocols, and architectures (2007)

  126. ONF, Onf technical library. https://www.opennetworking.org/software-defined-standards/specifications/. Accessed on 29 June 2017

  127. Sherry, J., Hasan, S., Scott, C., Krishnamurthy, A., Ratnasamy, S., Sekar, V.: Making middleboxes someone else’s problem: Network processing as a cloud service. In: Proceedings of the ACM SIGCOMM 2012 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM’12), New York, NY, pp. 13–24. ACM (2012)

  128. Hagen, S., Seibold, M., Kemper, A.: Efficient verification of it change operations or: how we could have prevented amazon’s cloud outage. In: Network Operations and Management Symposium (NOMS), 2012 IEEE, pp. 368–376 (2012)

  129. Machado, G.S., da Costa Cordeiro, W.L., dos Santos, A.D., Wickboldt, J., Lunardi, R.C., Andreis, F.G., Both, C.B., Gaspary, L.P., Granville, L.Z., Trastour, D., Bartolini, C.: Refined failure remediation for it change management systems. In: IFIP/IEEE International Symposium on Integrated Network Management, 2009 (IM’09), pp. 638–645 (2009)

  130. Keller, A., Hellerstein, J.L., Wolf, J.L., Wu, K.-L., Krishnan, V.: The champs system: change management with planning and scheduling. In: Network Operations and Management Symposium, 2004 (NOMS’2004), IEEE/IFIP, vol. 1, pp. 395–408 (2004)

  131. da Costa Cordeiro, W.L., Machado, G.S., Andreis, F.G., dos Santos, A.D., Both, C.B., Gaspary, L.P., Granville, L.Z., Bartolini, C., Trastour, D.: Changeledge: change design and planning in networked systems based on reuse of knowledge and automation. Comput. Netw. 53(16), 2782–2799 (2009)

    Article  MATH  Google Scholar 

  132. Budiu, M.: Evolving p4. P4 Workshop, Stanford, 2015. Accessed on 29 June 2017

  133. Jin, X., Gossels, J., Rexford, J., Walker, D.: Covisor: A compositional hypervisor for software-defined networks. In: 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI’15), Oakland, CA, pp. 87–101. USENIX Association (2015)

  134. Enns, R., Bjorklund, M., Schoenwaelder, J., Bierman, A.: Network Configuration Protocol (NETCONF). RFC 6241 (Proposed Standard), June 2011. Updated by RFC 7803 (2011)

  135. Bosshart, P., Gibb, G., Kim, H.-S., Varghese, G., McKeown, N., Izzard, M., Mujica, F., Horowitz, M.: Forwarding metamorphosis: fast programmable match–action processing in hardware for sdn. In: Proceedings of the ACM SIGCOMM 2013 Conference on SIGCOMM (SIGCOMM’13), New York, NY, pp. 99–110. ACM (2013)

  136. Ozdag, R.: Intel® Ethernet Switch FM6000 Series-Software Defined Networking. Technical report, Intel Corporation, 2012. Accessed on 29 June 2017

  137. Cavium, XPliant® Ethernet Switch Product Family. Accessed on 29 June 2017

  138. Barefoot, Barefoot Tofino™. Accessed on 29 June 2017

  139. Innovium, Innovium Teralynx. Accessed on 29 June 2017

  140. Sharma, N.K., Kaufmann, A., Anderson, T., Krishnamurthy, A., Nelson, J., Peter, S.: Evaluating the power of flexible packet processing for network resource allocation. In: 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI’17), Boston, MA, pp. 67–82. USENIX Association (2017)

  141. Monsanto, C., Reich, J., Foster, N., Rexford, J., Walker, D.: Composing software-defined networks. In: Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation (NSDI’13), Berkeley, CA, pp. 1–14. USENIX Association (2013)

  142. Drutskoy, D., Keller, E., Rexford, J.: Scalable network virtualization in software-defined networks. IEEE Internet Comput. 17, 20–27 (2013)

    Article  Google Scholar 

  143. Desai, A., Gupta, V., Jackson, E., Qadeer, S., Rajamani, S., Zufferey, D.: P: Safe asynchronous event-driven programming. ACM SIGPLAN Not. 48, 321–332 (2013)

    Article  Google Scholar 

  144. Blenk, A., Basta, A., Reisslein, M., Kellerer, W.: Survey on network virtualization hypervisors for software defined networking. IEEE Commun. Surv. Tutor. 18, 655–685 (2016)

    Article  Google Scholar 

  145. P4, P4.org, 2017. Accessed on 3 July 2017

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Weverton Luis da Costa Cordeiro.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

da Costa Cordeiro, W.L., Marques, J.A. & Gaspary, L.P. Data Plane Programmability Beyond OpenFlow: Opportunities and Challenges for Network and Service Operations and Management. J Netw Syst Manage 25, 784–818 (2017). https://doi.org/10.1007/s10922-017-9423-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10922-017-9423-2

Keywords

Navigation