Skip to main content
Log in

Scalability, Consistency, Reliability and Security in SDN Controllers: A Survey of Diverse SDN Controllers

  • Published:
Journal of Network and Systems Management Aims and scope Submit manuscript

Abstract

Software Defined Networking simplifies design, monitoring and management of next generation networks by segregating a legacy network into a centralized control plane and a remotely programmable data plane. The intelligent centralized SDN control plane controls behavior of forwarding devices in processing the incoming packets and provides a bird-eye view of entire network at a single central point. The centralized control provides network programmability and facilitates introduction of adaptive and automatic network control. The SDN control plane can be implemented by using following three deployment models: (i) physically centralized, in which a single SDN controller is configured for a network; (ii) physically distributed but logically centralized, wherein multiple SDN controllers are used to manage a network; and (iii) hybrid, in which both legacy distributed control and centralized SDN control coexist. This manuscript presents all these control plane architectures and discusses various SDN controllers supporting these architectures. We have analyzed more than forty SDN controllers in terms of following performance parameters: scalability, reliability, consistency and security. We have examined the mechanisms used by various SDN controllers to address the said performance parameters and have highlighted the pros and cons associated with each mechanism. In addition to it, this manuscript also highlights number of research challenges and open issues in different SDN control plane architectures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Zhang, Q., Cheng, L., Boutaba, R.: Cloud computing: state-of-the-art and research challenges. J. Intern. Serv. Appl. 1(1), 7–18 (2010)

    Google Scholar 

  2. Rossi, F.D., Rodrigues, G.D.C., Calheiros, R.N., Conterato, M.D.S.: Dynamic network bandwidth resizing for Big Data applications, In: Proceedings of thirteenth IEEE International Conference on eScience, (2017).

  3. Samaan, N., Karmouch, A.: Towards autonomic network management: an analysis of current and future research directions. IEEE Commun. Surv. Tutorials 11(3), 22–36 (2009)

    Google Scholar 

  4. ONF, “Open Networking Foundation”, (online) https://www.opennetworking.org/

  5. “Software Defined Networking: The New Norm for Networks”, ONF White Paper, April 13, (2012).

  6. McKeown, N., Anderson, T., Balakrishnan, H., Parulkar, G., et al.: OpenFlow: Enabling Innovation in Campus Networks, In: SIGCOMM Computer Communication Review, vol. 38, no. 2, pp. 69–74, Mar. (2008).

  7. Limoncelli, T. A.: Openflow: a radical new idea in networking, In: ACM Queue, vol. 10, no. 6, (2012).

  8. Yu, Y., Li, X., Leng, X., Song, L., Bu, K., Chen, Y., Yang, J., Zhang, L., Cheng, K., Xiao, X.: Fault Management in software defined networking: a survey. IEEE Commun. Surv. Tutorials 21(1), 349–392 (2018)

    Google Scholar 

  9. Open Networking Foundation North Bound Interface Working Group (NBI-WG) Charter; VERSION: V 1.1 (online) https://www.opennetworking.org/images/stories/downloads/working-groups/charter-nbi.pdf

  10. Kreutz, D., Ramos, F.M.V., Verissimo, P., Rothenberg, C.E., Azodolmolky, S., Uhlig, S.: Software-defined networking: a comprehensive survey. Proc. IEEE 103, 1 (2015). https://doi.org/10.1109/JPROC.2014.2371999

    Article  Google Scholar 

  11. Nunes, B.A.A., Mendonca, M., Nguyen, X.N., Obraczka, K., Turletti, T.: A survey of software defined networking: past, present and future of programmable networks. IEEE Commun. Surv. Tutor. 16(3), 1617–1634 (2014)

    Google Scholar 

  12. Feamster, N., Rexford, J., Zegura, E.: The Road to SDN: An Intellectual History of Programmable Networks, In: ACM SIGCOMM Computer Communiation Review, vol. 44, no. 2, pp. 87–98, (2014).

  13. Jarraya, Y., Madi, T., Debbabi, M.: A survey and a layered taxonomy of software defined networking. IEEE Commun. Surv. Tutorials 16(4), 1955–1980 (2014)

    Google Scholar 

  14. Hu, F., Hao, Q., Bao, K.: A survey on software defined network and openflow: from concept to implementation. IEEE Commun. Surv. Tutorials 16(4), 2181–2206 (2014)

    Google Scholar 

  15. Hakiri, A., Gokhale, A., Berthou, P., Schmidt, D.C., Gayraud, T.: Software defined networking: challenges and research opportunities for future internet. Comput. Netw. 75, 453–471 (2014)

    Google Scholar 

  16. Farhady, H., Lee, H., Nakao, A.: Software defined networking: a survey. Comput. Netw. 81, 79–95 (2015)

    Google Scholar 

  17. Gong, Y., Huang, W., Wang, W., Lei, Y.: A survey on software defined networking and its applications. Front. Comput. Sci. 9(6), 827–845 (2015)

    Google Scholar 

  18. Xia, W., Wen, Y., Foh, C.H., Niyato, D., Xie, H.: A survey on software defined networking. IEEE Commun. Surv. Tutor. 17(1), 27–51 (2015)

    Google Scholar 

  19. Trois, C., Fabro, M.D.D., de Bona, L.C.E., Martinello, M.: A survey on SDN programming languages: toward a taxonomy. IEEE Commun. Surv. Tutor. 18(4), 2687–2712 (2016)

    Google Scholar 

  20. Fonseca, P., Mota, E.: A survey on fault management in software defined networks. IEEE Commun. Surv. Tutor. 19(4), 2284–2321 (2017)

    Google Scholar 

  21. Akyilidiz, I.F., Lee, A., Wang, P., Luo, M., Chou, W.: A roadmap for traffic engineering in SDN-OpenFlow networks. Comput. Netw. 71, 1–30 (2014)

    Google Scholar 

  22. Mendiola, A., Astorga, J., Jacob, E., Higuero, M.: A survey on the contributions of software defined networking to traffic engineering. IEEE Commun. Surv. Tutor. 19(2), 918–953 (2017)

    Google Scholar 

  23. Ahmad, I., Namal, S., Ylianttila, M., Gurtov, A.: Security in software defined networks: a survey. IEEE Commun. Surv. Tutor. 17(4), 2317–2346 (2015)

    Google Scholar 

  24. Hayward, S.S., Natarajan, S., Sezer, S.: A Survey of Security in Software Defined Networks. IEEE Commun. Surv. Tutor. 18(1), 623–654 (2016)

    Google Scholar 

  25. Yan, Q., Yu, F.R., Gong, Q., Li, J.: Software-defined networking SDN and Distributed Denial Of Service (DDOS) attacks in cloud computing environments: a survey, some research issues and challenges. IEEE Commun. Surv. Tutor. 18(1), 602–622 (2016)

    Google Scholar 

  26. Dargahi, T., Caponi, A., Ambrosin, M., Bianchi, G., Conti, M.: A survey on the security of stateful SDN data planes. IEEE Commun. Surv. Tutor. 19(3), 1701–1725 (2017)

    Google Scholar 

  27. Kerpez, K.J., Cioffi, J.M., Ginis, G., Goldburg, M., Galli, S., Silverman, P.: Software Defined Access Networks. IEEE Commun. Magaz. 52(9), 152–159 (2014)

    Google Scholar 

  28. Alvizu, R., Maier, G., Kukreja, N., Pattavina, A., Morro, R., Capello, A., Cavazzoni, C., Keller, E.: Comprehensive survey on T-SDN: software-defined networking for transport networks. IEEE Commun. Surv. Tutor. 19(4), 1701–1725 (2017)

    Google Scholar 

  29. Baktir, A.C., Ozgovde, A., Ersoy, C.: How can edge computing benefit from software-defined networking: a survey, use cases & future directions. IEEE Commun. Surv. Tutor. 19(4), 2359–2391 (2017)

    Google Scholar 

  30. Modieginyane, K.M., Letswamotse, B.B., Malekian, R., Abu-Mahfouz, A.M.: Software defined wireless sensor networks application opportunities for efficient network management: a survey. Comput. Electr. Eng. 1, 274–287 (2018)

    Google Scholar 

  31. Bera, S., Misra, S., Vasilakos, A.V.: Software defined networking for internet of things: a survey. IEEE Internet Things J. 4(6), 1994–2008 (2017)

    Google Scholar 

  32. Thyagaturu, A.S., Mercian, A., McGarry, M.P., Reisslein, M., Kellerer, W.: Software defined optical networks (sdons): a comprehensive survey. IEEE Commun. Surv. Tutor. 18(4), 2738–2786 (2016)

    Google Scholar 

  33. Karakus, M., Durresi, A.: A Survey: Control Plane Scalability Issues and Approaches in Software-Defined Networking. Computer Networks 112, 279–293 (2017)

    Google Scholar 

  34. Bannour, F., Souihi, S., Mellouk, A.: Distributed SDN control: survey, taxonomy, and challenges. IEEE Commun. Surv. Tutor. 20(1), 333–354 (2018)

    Google Scholar 

  35. Blial, O., Ben Mamoun, M. and Benaini, R.: An Overview on SDN Architectures with Multiple Controllers.
J. Comput. Netw. Commun. vol. 2016, Hindawi, Article ID 9396525, (2016).

  36. Hu, T., Guo, Z., Yi, P., Baker, T., Lan, J.: Multi-controller based Software-Defined Networking: A Survey. IEEE Access 6, 15980–15996 (2018)

    Google Scholar 

  37. Vissicchio, S., Vanbever, L., Bonaventure, O.: Opportunities and research challenges of hybrid software defined networks. ACM SIGCOMM Comput. Commun. Rev 44(2), 70–75 (2014)

    Google Scholar 

  38. Sinha, Y., Haribabu, K.: A survey: Hybrid SDN. J. Netw. Comput. Appl. 100, 35–55 (2017)

    Google Scholar 

  39. Khan, S., Gani, A., Wahab, A.W.A., Guizani, M., Khan, M.K.: Topology discovery in software defined networks: threats, taxonomy, and state-of-the-art. IEEE Commun. Surv. Tutor. 19(1), 303–324 (2016)

    Google Scholar 

  40. Canini, M., Feldmann, A., Levin, D., Schaffert, F., Schmid, S.: Software-defined networks: incremental deployment with panopticon. IEEE Computer 47(11), 56–60 (2014)

    Google Scholar 

  41. Levin, D., Canini, M., Schmid, S. and Feldmann, A.: Panopticon: Reaping the Benefits of Partial SDN Deployment in Enterprize Networks. In: the Proceedings of USENIX Annual Technical Conference, (2014).

  42. Gude, N., Koponen, T., Pettit, J., Pfaff, B., Casado, M., McKeown, N., Shenker, S.: NOX: Towards an Operating System for Networks”, Computer Communication Review, (2008).

  43. Benson, T., Akella, A., Maltz, D.A.: Network Traffic Characteristics of Data Centers in the Wild. In: Proceedings of the tenth ACM SIGCOMM Conference on Internet Measurement, New York, USA: ACM, pp. 267–280. (2010).

  44. Michel, O., Keller, E.: SDN in Wide Area Networks: A Survey. In: the Proceedings of Fourth International Conference on Software Defined Systems (SDS) , pp. 37–42, May, (2017).

  45. Voellmy, A. Wang, J. C.: Scalable Software Defined Network Controllers. In: Proceedings of ACM SIGCOMM conference on Applications, Technologies, Architectures and Protocols for Computer Communication, pp. 289–290, (2012).

  46. Ul-Huque, M.T.I., Si, W., Jourjon, G., Gramoli, V.: Large Scale Dynamic Controller Placement. IEEE Trans. Netw. Serv. Manag. 14(1), 63–76 (2017)

    Google Scholar 

  47. Heller, B., Sherwood, R., McKeown, N.: The Controller Placement Problem. In: Proceedings of the First Workshop on Hot Topics in Software Defined Networks, New York, USA: ACM, pp. 7–12, (2012).

  48. Macapuna, C.A., Rothenberg, C.E., Maurício, M.F.: In: Packet Bloom Filter-Based Data Center Networking with Distributed OpenFlow Controllers”, in the Proceedings of IEEE GLOBECOM Workshops, pp. 584–588, (2010).

  49. Mattos, D.M.F., Duarte, O.C.M.B., Pujolle, G.: Reverse update: a consistent policy update scheme for software defined networking. IEEE Commun. Lett. 20(5), 886–889 (2016). https://doi.org/10.1109/LCOMM.2016.2546240,May

    Article  Google Scholar 

  50. Mahajan, R., Wattenhofer, R.: On Consistent Updates in Software Defined Networks. In: The Procedings of ACM Symposium on SDN Research, Santa Clara, CA, April 3–4, (2017).

  51. Foerster, K.T., Schmid, S., Vissicchio, S.: Survey of Consistent Software-Defined Network Updates. https://arxiv.org/abs/1609.02305, (2018).

  52. Tavakoli, A., Casado, M., Koponen, T., Shenker, S.: Applying NOX to the Data Center. In: Proceedings of Ninth ACM SIGCOMM workshop on Hot Topics in Networks, Oct-(2009).

  53. Tootoonchian, A., Gorbunov, S., Ganjali, Y., Casado, M., Sherwood, R.: On Controller Performance in Software-Defined Networks. In: Proceedings of the Second USENIX conference on Hot Topics in Management of Internet, Cloud, and Enterprise Networks and Services, (2012).

  54. Shalimov, A., Zuikov, D., Zimarina, D., Pashkov, V., Smeliansky, R.: Advanced Study of SDN/OpenFlow Controllers. In: Proceedings of the Ninth Central & Eastern European Software Engineering Conference in Russia, New York, USA: ACM, pp. 1–6, (2013).

  55. POX. (online) https://www.noxrepo.org/pox/about-pox/

  56. Floodlight Project. (online) https://www.projectfloodlight.org/

  57. Curtis, A.R., Mogul, J.C., Tourrilhes, J., Yalagandula, P., Sharma, P., Banerjee, S.: Devoflow: Scaling Flow Management for High-Performance Networks”, in Proceedings of the ACM SIGCOMM Conference, New York, NY, USA: ACM, pp. 254–265, (2011).

  58. Ilyas, Q., Khondoker, R.: “Security analysis of FloodLight, ZeroSDN, beacon and POX SDN controllers” L. Notes Netw. Syst. 30, 85–98 (2018)

    Google Scholar 

  59. Cai, Z., Cox, A.L., Ng, T.S: Maestro: A System for Scalable Open Flow Control”, (2011).

  60. Dhawan, M., Poddar, R., Mahajan, K., Mann, V.: Sphinx: Detecting Security Attacks in Software Defined Networks. In: The proceedings of Network and Distributed System Security (NDSS) Symposium. The Internet Society, ISBN 1–891562–38-X, (2015).

  61. Zhu, L., Karim, M.M., Sharif, K., Li, F., Du, X., Guizani, M.: SDN Controllers: Benchmarking and Performance Evaluation. arXiv:1902.04491v1. [cs. NI] (2019).

  62. Berde, P., Gerola, M., Hart, J., Higuchi, Y., Kobayashi, M., Koide, T., Lantz, B., O'Connor, B., Radoslavov, P., Snow, W., Parulkar, G.: ONOS: towards an open, distributed SDN OS. In: Proceedings of the Third Workshop on Hot Topics in Software Defined Networking, New York, USA: ACM, pp. 1–6, (2014).

  63. Phemius, K., Bouet, M., Leguay, J.: DISCO: Distributed Multi-Domain SDN Controllers”, CoRR, vol. abs/1308.6138, (2013).

  64. Ryu SDN Framework. (online) https://ryu-sdn.org/

  65. MUL SDN Contoller. (online) https://www.openmul.org/

  66. TREMA SDN Controller Framework. (online) https://trema.github.io/trema/

  67. Erickson, D.: The Beacon Openflow Controller. In: The Proceedings of Second ACM SIGCOMM Workshop on Hot Topics in Software Defined Networking, New York, USA: ACM, pp. 13–18, (2013).

  68. OSGi Specification. (online) https://www.osgi.org/developer/what-is-osgi/

  69. Lee, B., Park, S.H., Shin, J., Yang, S.: IRIS: The Openflow-based Recursive SDN controller. In: Proceeding of Sixteenth IEEE International Conference on Advanced Communication Technology,DOI: https://doi.org/10.1109/ICACT.2014.6779154, 16–19 Feb. (2014).

  70. Shin, S., Song, Y., Lee, T., Lee, S., Chung, J., Porras, P., Yegneswaran, V., Noh, J., Kang, B.B.: Rosemary: A Robust, Secure and High-Performance Network Operating System. In: Proceedings of ACM SIGSAC Conference on Computer and Communications Security, pp. 78–89, (2014).

  71. Arbettu, R.K., Khondoker, R., Bayarou, K., Weber, F.: Security Analysis of OpenDaylight, ONOS, Rosemary and Ryu SDN Controllers. In: the Proceedings of Seventeenth IEEE International Telecommunications Network Strategy and Planning Symposium (Networks), Sept. (2016).

  72. Song, P., Liu, Y., Liu, C., Qian, D.: ParaFlow: fine-grained parallel SDN controller for large-scale networks. J Netw. Comput. Appl. (2017). https://doi.org/10.1016/j.jnca.2017.03.009

    Article  Google Scholar 

  73. Panda, A., Scott, C., Ghodsi, A., Koponen, T., Shenker, S.: CAP for networks. In: Proceedings of the Second ACM SIGCOMM Workshop on Hot Topics in Software Defined Networking, New York, USA-ACM, pp. 91–96, (2013).

  74. Levin, D., Wundsam, A., Heller, B., Handigol, N., Feldmann, A.: Logically centralized? State Distribution Trade-offs in Software Defined Networks. In: Proceedings of the first workshop on Hot topics in Software Defined Networks, pp. 1–6, (2012).

  75. Sridharan, V., Gurusamy, M., Truong-Huu, T.: On multiple controller mapping in software defined networks with resilience constraints. IEEE Commun. Lett. 21, 1763–1766 (2017)

    Google Scholar 

  76. Fonseca, P., Bennesby, R., Mota, E., Passito, A.: Resilience Of SDNs based on Active and Passive Replication Mechanisms. In: Proceedings of Global Communications Conference, pp. 2188–2193, (2013).

  77. Fonseca, P., Bennesby, R., Mota, E., Passito, A.: A Replication Component for Resilient Openflow-Based Networking”, in the Proceeding of Symposium on Network Operations and Management, pp. 933–939 , (2012).

  78. Botelho, F., Bessani, A., Ramos, F.M., Ferreira, P.: On the Design of Practical Fault-Tolerant SDN Controllers. In: Third European Workshop on Software Defined Networks, pp. 73–78, Sept (2014).

  79. Spalla, E.S., Mafioletti, D.R., Liberato, A.B., Ewald, G., Rothenberg, C.E., Camargos, L., Villaca, R.S., Martinello, M.: Ar2c2: Actively Replicated Controllers for SDN Resilient Control Plane. In: The Proceedings of IEEE/IFIP Network Operations and Management Symposium (NOMS) , pp. 189–196, April (2016).

  80. Yazici, V., Sunay, M.O., Ercan, A.O.: Controlling a Software-Defined Network via Distributed Controllers. CoRR, vol. abs/1401.7651, (2014).

  81. Oktian, Y.E., Lee, S., Lee, H., Lam, J.: Distributed SDN controller system: a survey on design choice. Comput. Netw. 121, 100–111 (2017)

    Google Scholar 

  82. Koponen, T., Casado, M., Gude, N., Stribling, J., Poutievski, L., Zhu, M., Ramanathan, R., Iwata, Y., Inoue, H., Hama, T., Shenker, S.: Onix: A Distributed Control Platform for Large-Scale Production Networks. In: Proceedings of the Ninth USENIX Conference on Operating Systems Design and Implementation, CA, USA: USENIX Association, pp. 1–6, (2010).

  83. Wallin, S., Wikstrom, C.: Automating Network and Service Configuration Using Netconf and Yang. In: Proceedings of the Twenty Fifth International Conference on Large Installation System Administration, Berkeley, CA, USA, pp. 22–22, (2011).

  84. OpenConfig. (online) https://www.openconfig.net/

  85. OF-CONFIG 1.2: Openflow Management and Configuration Protocol, ONF, Tech. Report, (2014).

  86. Chang, Y., Rezaei, A., Vamanan, B., Hasan, J., Rao, S., Vijaykumar, T.N.: Hydra: Leveraging Functional Slicing for Efficient Distributed SDN Controllers, arXiv preprint arXiv:1609.07192.

  87. He, M., Basta, A., Blenk, A., Kellerer, W: Modeling Flow Setup Time for Controller Placement in SDN: Evaluation for Dynamic Flows. In: Proceedings of IEEE International Conference on Communications (ICC), pp. 1–7, (2017).

  88. Zhang, T., Giaccone, P., Bianco, A., De Domenico, S.: The Role of the Inter-Controller Consensus in the Placement of Distributed SDN Controllers. Comput. Commun. 113, 1–13 (2017)

    Google Scholar 

  89. Alhazmi, K., Moubayed, A., Shami, A.: Distributed SDN Controller Placement Using Betweenness Centrality & Hierarchical Clustering. In: The Proceedings of Eighth ACM Symposium on Design and Analysis of Intelligent Vehiclular Networks and Applications, Canada Oct 28-Nov 2, (2018).

  90. Dacier, M.C., Konig, H., Cwalinski, R., Kargl, F., Dietrich, S.: Security challenges and opportunities of software-defined networking. IEEE Secur. Priv. 15(2), 96–100 (2017)

    Google Scholar 

  91. Qi, C., Wu, J., Hu, H., Cheng, G., Liu, W., Ai, J., Yang, C. An Intensive Security Architecture with Multi-Controller for SDN” in Proceedings of IEEE International Conference on Computer Communications Workshops, pp. 401–402, (2016).

  92. Jain, S., Kumar, A., Mandal, S., Ong, J., Poutievski, L., Singh, A., Venkata, S., Wanderer, J., Zhou, J., Zhu, M., Zolla, J.: B4: Experience with a Globally Deployed Software Defined WAN. In: Proceedings of the ACM SIGCOMM Conference on SIGCOMM, New York, USA, ACM, pp. 3–14. (2013).

  93. Chandra, T.D., Griesemer, R., Redstone, J.: Paxos Made Live: An Engineering Perspective. In: Proceedings of the Twenty-sixth Annual ACM Symposium on Principles of Distributed Computing, New York, USA: ACM, pp. 398–407, (2007).

  94. Hassas Yeganeh, S., Ganjali, Y.: Kandoo: A Framework for Efficient and Scalable Offloading of Control Applications. In: Proceedings of the First Workshop on Hot Topics in Software Defined Networks, USA, ACM, pp. 19–24, (2012).

  95. McCauley, J., Panda, A., Casado, M., Koponen, T., Shenker, S.:. Extending SDN to Large-Scale Networks. In: Proceeding of ONS, (2013).

  96. Yap, K.K., Motiwala, M., Rahe, J., Padgett, S., Holliman, M., Baldus, G., Hines, M., Kim, T., Narayanan, A., Jain, A., Lin, V.: Taking the Edge Off With Espresso: Scale, Reliability and Programmability for Global Internet Peering”, in Proceedings of the Conference of the ACM Special Interest Group on Data Communication, New York, USA, ACM, pp. 432–445, (2017).

  97. A. Bianco, P. Giaccone, S. D. Domenico, and T. Zhang, “The Role of Inter-Controller Traffic for Placement of Distributed SDN Controllers”, CoRR, vol. abs/1605.09268, (2016).

  98. Katta, N., Zhang, H., Freedman, M., Rexford, J.: Ravana: Controller Fault-Tolerance in Software Defined Networking”, in Proceedings of the First ACM SIGCOMM Symposium on Software Defined Networking Research, pp. 4:1–4:12, (2015).

  99. Hunt, P., Konar, M., Junqueira, F.P., Reed, B.: Zookeeper: Wait-Free Coordination for Internet-Scale Systems. In: Proceedings of the Annual USENIX Technical Conference, (2010).

  100. OpenDayLight Project. (online) https://www.opendaylight.org/

  101. Benamrane, F., Benaini, R: Performances Of Openflow-Based Software Defined Networks: An Overview. J. Netw. 10(6): 329–337, (2015).

  102. Magnesium. (online) https://www.opendaylight.org/what-we-do/current-release/magnesium, March (2020).

  103. Akka Framework. (online) https://akka.io/

  104. Ongaro, D., Ousterhout, J.: In Search of an Understandable Consensus Algorithm. In: Proceedings of USENIX Annual Technical Conference, CA, USA, pp. 305–320, (2014).

  105. Clark, D.D., Partridge, C., Ramming, J.C., Wroclawski, J.T.: A Knowledge Plane for the Internet. In: The Proceedings of Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications, New York, USA-ACM, pp. 3–10, (2003).

  106. Shin, J., Kim, T., Lee, B., Yang, S.: IRIS-HiSA: highly scalable and available carrier-grade SDN controller cluster. Mobile Netw. Appl. 22(5), 894–905 (2017). https://doi.org/10.1007/s11036-017-0853-6,Oct

    Article  Google Scholar 

  107. Johns, M.: Getting Started with Hazelcast. Packt Publishing Ltd (2013).

  108. Dixit, A., Hao, F., Mukherjee, S., Lakshman, T.V., Kompella, R.R.: ElastiCon: An Elastic Distributed SDN Controller. In: Proceedings of Tenth ACM/IEEE symposium on Architectures for networking and communications systems, Los Angeles, California, USA, pp. 17–28, October 20 - 21, (2014).

  109. Hyperic SIGAR API. (online). https://www.hyperic.com/products/sigar.

  110. Fu, Y., Bi, J., Gao, K., Chen, Z., Wu, J., Hao, B.: Orion: A Hybrid Hierarchical Control Plane of Software-Defined Networking for Large-Scale Networks. In: The Proceedings of Twenty Second IEEE International Conference on Network Protocols, Raleigh, NC, USA, 21–24 Oct. (2014).

  111. Dijkstra, E.W.: Dijkstra: A Note on Two Problems in Connexion With Graphs. Numer. Math. 1(1), 269–271 (1959)

    MathSciNet  MATH  Google Scholar 

  112. Hong, C.Y., Kandula, S., Mahajan, R., Zhang, M., Gill, V., Nanduri, M., Wattenhofer, R.: Achieving high utilization with software-driven WAN. In: Proceedings of the ACM SIGCOMM Conference on SIGCOMM, New York, USA-ACM, pp. 15–26, (2013).

  113. Rothenberg, C.E., Nascimento, M.R., Salvador, M.R., Corrêa, C.N.A., Cunha de Lucena, S., Raszuk, R.: Revisiting routing control platforms with the eyes and muscles of software-defined networking. In: Proceedings of ACM Workshop on Hot Topics in Software Defined Networks, pp. 13–18, (2012).

  114. Gamperli, A., Kotronis, V., Dimitropoulos, X.: Evaluating the effect of Centralization on Routing Convergence on a hybrid BGP-SDN Emulation Framework. In: ACM SIGCOMM Computer Communication Review, vol. 44, no. 4, pp. 369–370, Oct. (2014).

  115. Nelson, T., Ferguson, A.D., Yu, D., Fonseca, R., Krishnamurthi, S.: Exodus: Toward Automatic Migration of Enterprise Network Configurations to SDNs. In: The Proceedings of ACM SIGCOMM Symposium on Software Defined Networking Research, pp. 1–7, (2015).

  116. Vissicchio, S., Vanbever, L., Cittadini, L., Xie, G.G., Bonaventure, O: Safe update of hybrid SDN Networks”, IEEE/ACM Transactions on Networking, vol. 25, no. 3, pp. 1649–1662, June (2017).

  117. Ochoa Aday, L., Cervelló Pastor, C., Fernández Fernández, A.: Current Trends of Topology Discovery in Openflow-based Software Defined Networks. (online) https://upcommons.upc.edu/handle/2117/77672

  118. Pakzad, F., Portmann, M., Tan, W.L., Indulska, J.: Efficient Topology Discovery in Software Defined Networks. In: Proceedings of Eighth IEEE International Conference on Signal Processing and Communication Systems (ICSPCS), pp. 1–8. (2014)

  119. Pakzad, F., Portmann, M., Tan, W.L., Indulska, J.: Efficient Topology Discovery in Openflow-Based Software Defined Networks. In: ACM SIGCOMM Computer Communication Review, vol. 77, no. C, 52–61, March (2016).

  120. Saha, A.K., Sambyo, K., Bhunia, C.: Topology Discovery, Loop Finding and Alternative Path Solution in POX Controller. In: the Proceedings of the International MultiConference of Engineers and Computer Scientists, vol. 2, pp. 553–557, (2016).

  121. Hong, D. K., Ma, Y., Banerjee, S., Mao, Z. M.: Incremental Deployment of SDN in Hybrid Enterprise and ISP Networks. In: The Proceedings of Symposium on SDN Research , USA, March (2016).

  122. Hand, R., Keller, E.: ClosedFlow: OpenFlow like Control over Proprietary Devices. In: The Proceedings of the Third Workshop on Hot Topics in Software Defined Networking, ACM, pp. 7–12, (2014).

  123. Kotronis, V., Gamperli, A., Dimitropoulos, X.: Routing Centralization across Domains Via SDN: A Model and Emulation Framework for BGP Evolution. In: Computer Networks, vol. 92, pp. 227–239, (2015)

  124. Lu, H., Arora, N., Zhang, H., Lumezanu, C., Rhee, J., Jiang, G.: Hybnet: Network Manager for a Hybrid Network Infrastructure. In: Proceedings of the Industrial Track of the Thirteenth ACM/IFIP/USENIX International Middleware Conference, (2013).

  125. Katiyar, R., Pawar, P., Gupta, A., Kataoka,: Auto-configuration of SDN Switches in Sdn/Non-SDN Hybrid Network. In: The Proceedings of the Asian Internet Engineering Conference, ACM, pp. 48–53, (2015).

  126. Casado, M., Koponen, T., Shenker, S., Tootoonchian, A.: Fabric: A Retrospective on Evolving SDN, In: The Proceedings of the First Workshop on Hot topics in Software Defined Networks, ACM, pp. 85–90, (2012).

  127. Mishra, A., Bansod, D., Haribabu, K.: A Framework for Openflow-Like Policy-Based Routing in Hybrid Software Defined Networks. In: The Proceedings of Eleventh International Network Conference, pp. 97–102, (2016).

  128. Big Virtual Switch Network Virtualization with the Open SDN Architecture. (online) https://www.bigswitch.com/sites/default/files/sdnresources/bvsdatasheet.pdf

  129. D. J. Casey and B. E. Mullins, “SDN Shim: Controlling Legacy Devices,” in the Proceedings of IEEE Conference on Local Computer Networks, pp. 169–172, (2015).

  130. Parniewicz, D., Doriguzzi Corin, R., Ogrodowczyk, L., Rashidi Fard, M., Matias, J., Gerola, M., Fuentes, V., Toseef, U., Zaalouk, A., Belter, B., Jacob, E., et al.: Design and Implementation of an OpenFlow Hardware Abstraction Layer. In: The Proceedings of the ACM SIGCOMM workshop on Distributed cloud computing, pp. 71–76, (2014).

  131. OpenStack, (online) https://www.openstack.org/

  132. Jin, C., Lumezanu, C., Xu, Q., Zhang, Z.L., Jiang, G.: Telekinesis: Controlling Legacy Switch Routing with Openflow in Hybrid Networks. In: Proceedings of ACM SIGCOMM Symposium on Software Defined Networking Research, pp. 1–7, (2015).

  133. Jin, C., Lumezanu, C., Xu, Q., Mekky, H., Zhang, Z. L., Jiang, G.: Magneto: Unified Fine-Grained Path Control in Legacy and Openflow Hybrid Networks. In: Proceedings of ACM Symposium on SDN Research, pp. 75–87, (2017).

  134. Markovitch, M., Schmid, S.: SHEAR: A Highly Available And Flexible Network Architecture Marrying Distributed and Logically Centralized Control Planes. In: Proceedings of IEEE International Conference on Network Protocols (ICNP) , pp. 78–89, (2015).

  135. Vanbever, L., Vissicchio, S.: Enabling SDN in Old School Networks with Software-Controlled Routing Protocols. In: The Proceedings of the Open Networking Summit, (2014).

  136. Vissicchio, L., Vanbever, J.: Rexford, “Sweet little lies: Fake Topologies for Flexible Routing” , in Proceedings of the Thirteenth ACM Workshop on Hot Topics in Networks, ACM, (2014).

  137. Vissicchio, S., Tilmans, O., Vanbever, L., Rexford, J.: Central control over distributed routing. ACM SIGCOMM Comput. Commun. Rev. 45(4), 43–56 (2015)

    Google Scholar 

  138. Tilmans, O., Vissicchio, S., Vanbever, L., Rexford, J.: Fibbing in action: on demand load-balancing for better video delivery. In: Proceedings of ACM SIGCOMM Conference on SIGCOMM, pp. 619–620, (2016).

  139. Chemalamarri, V.D., Nanda, P., Navarro, K.F.: SYMPHONY: A Controller Architecture for Hybrid Software Defined Networks. In: The Proceedings of European Workshop on Software Defined Networks (EWSDN) , pp. 55–60, (2015).

  140. GNU Quagga Project, (online) https://www.quaggaproject.org

  141. Farias, F., Salvatti, J., Victor, P., Abelem, A.: Integrating Legacy Forwarding Environment to Openflow/SDN Control Plane. In: The Proceedings of Asia-Pacific Network Operations and Management Symposium (APNOMS) , pp. 1–3, (2013).

  142. Vidal12, A., Verdi, F., Fernandes, E.L., Rothenberg, C.E., Salvador, M.R.: Building upon RouteFlow: A SDN Development Experience. In: The Proceedings of Thirty First Simpsio Brasileiro de Redes de Computadores (SBRC) , pp. 879–892, May (2013).

  143. Huang, S., Zhao, J., Wang, X.: HybridFlow: A Lightweight Control Plane for Hybrid SDN in Enterprise Networks. In: The Proceedings of IEEE/ACM Twenty Fourth International Symposium on Quality of Service (IWQoS) , pp. 1–2, (2016).

  144. Banikazemi, M., Olshefski, D., Shaikh, A., Tracey, J., Wang, G.: Meridian: An SDN Platform for Cloud Network Services. In: IEEE Communications Magazine, vol. 51, no. 2, pp. 120–127, (2013).

  145. Caria, M., Jukan, A., Hoffmann, M.: SDN Partitioning, A Centralized Control Plane for Distributed Routing Protocols, In: IEEE Transactions on Network and Service Management, (2016).

  146. Caria, M., Das, T., Jukan, A., Hoffmann, M.: Divide and Conquer, Partitioning OSPF networks with SDN, In: IFIP/IEEE International Symposium on Integrated Network Management (IM), 11–15 May, (2015).

  147. Gupta, A., Vanbever, L., Shahbaz, M., Donovan, S.P., Schlinker, B., Feamster, N., Rexford, J., Shenker, S., Clark, R., Katz-Bassett, E.: SDX: A Software Defined Internet Exchange, In: ACM SIGCOMM, (2014).

  148. Gupta, A., MacDavid, R., Birkner, R., Canini, M., Feamster, N., Rexford, J., Vanbever, L.: An Industrial-Scale Software Defined Internet Exchange Point. In: Thirteenth USENIX Symposium on Networked Systems Design and Implementation (NSDI), (2016).

  149. Morgan, H.: Atlanticwave-sdx: A Distributed Intercontinental Experimental Software Defined Exchange for Research and Education Networking, Press Release, (2015).

  150. Chung, J., Cox, J., Ibarra, J., Bezerra, J., Morgan, H., Clark, R., Owen, H.: Atlanticwave-sdx: An International SDX To Support Science Data Applications,” in Software Defined Networking (SDN) for Scientific Networking Workshop, Austin, Texas, (2015)

  151. Stringer, J., Pemberton, D., Fu, Q., Lorier, C., Nelson, R., Bailey, J., Corrêa, C.N., Rothenberg, C.E.: Cardigan: SDN Distributed Routing Fabric Going Live at an Internet Exchange. In: IEEE Symposium on Computers and Communications, Madeira, Portugal, pp. 1–7, (2014).

  152. Lapeyrade, R., Bruyère, M., Owezarski, P.: Openflow-based Migration and Management of the TouIX IXP. In: IEEE/IFIP Network Operations and Management Symposium, Istanbul, Turkey, pp. 1131–1136, April 25–29, (2016).

  153. OpenFlow Switch Specification Version 1.3. (online):https://www.opennetworking.org/images/stories/downloads/sdn-resources/onf-specifications/openflow/openflow-spec-v1.3.0.pdf.

  154. Kim, J., Sim, A., Suh, S.C., Kim, I.: An Approach to Online Network Monitoring using Clustered Patterns. In: Proceedings of the International Conference on Computing, Networking and Communications,Silicon Valley, USA, 26–29, pp. 656–661, (2017).

  155. Yu, M., Jose, L., Miao, R.: Software Defined Traffic Measurement with Opensketch. In: The Proceedings of USENIX Symposium on Networked Systems Design and Implementation (NSDI), vol. 13, pp. 29–42, (2013).

  156. Chowdhury, S.R., Bari, M.F., Ahmed, R., Boutaba, R.: Payless: A Low Cost Network Monitoring Framework for Software Defined Networks. In: The Proceedings of IEEE Network Operations and Management Symposium (NOMS) , pp. 1–9, (2014).

  157. Van Adrichem, N.L., Doerr, C., Kuipers, F.A.: OpenNetMon: Network Monitoring in Openflow Software Defined Networks. In: The Proceedings of IEEE Network Operations and Management Symposium (NOMS) , pp. 1–8, (2014).

  158. Su, Z., Wang, T., Xia, Y., Hamdi, M.: FlowCover: Low-Cost Flow Monitoring Scheme in Software Defined Networks. In: Proceedings of the Global Communications Conference, Austin, TX, USA, pp. 1956–1961, (2015).

  159. Henni, D.E., Hadjaj-Aoul, Y., Ghomari, A.: Probe-SDN: A Smart Monitoring Framework for SDN-Based Networks. In: The proceedings of the Global Information Infrastructure and Networking Symposium, France, pp. 1–6, (2017).

  160. Choi, T., Kang, S., Yoon, S., Yang, S., Song, S., Park, H.: SuVMF: Software-Defined Unified Virtual Monitoring Function for SDN-Based Large-Scale Networks. In: Proceedings of ACM International Conference on Future Internet Technology, pp. 1–6, (2014).

  161. Cardinal: OpenDaylight Monitoring as a Service, (Online), https://docs.opendaylight.org/en/stable-fluorine/user-guide/cardinal_opendaylight-monitoring-as-a-service.html#cardinal-architecture

  162. Kim, W., Li, J., Hong, J.W.K., Suh, Y.J.: OFMon: OpenFlow Monitoring System in ONOS Controllers. In: Proceedings of IEEE NetSoft Conference and Workshops (NetSoft), (2016).

  163. Enns, R., Bjorklund, M. Schoenwaelder, J.: NETCONF Configuration Protocol. RFC 6241, (2011)

  164. Handigol, N., Heller, B., Jeyakumar, V., Maziéres, D., McKeown, N.: Where is the Debugger for my Software-Defined Network? In: The Proceedings of ACM SIGCOMM Workshop on Hot Topics in Software Defined Networks, pp. 55–60, (2012)

  165. Khurshid, A., Zhou, W., Caesar, M., Godfrey, P.: Veriflow: verifying network wide invariants in real time. ACM SIGCOMM Comput. Commun. Rev. 42(4), 467–472 (2012)

    Google Scholar 

  166. Jin, X., Liu, H.H., Gandhi, R., Kandula, S., Mahajan, R., Zhang, M., Rexford, J., Wattenhofer, R.: Dynamic scheduling of network updates. In: ACM SIGCOMM Computer Communication Review, vol. 44, no. 4, pp. 539–550, (2014).

  167. Hu, S., Chen, K., Wu, H., Bai, W., Lan, C., Wang, H., Zhao, H., Guo, C.: Explicit Path Control in Commodity Data Centers: Design and Applications. In: IEEE/ACM Transactions on Networking, vol. 24, no. 5, pp. 2768–2781, (2016).

  168. Yu, H., Li, K., Qi, H., Li, W., Tao, X.: Zebra: An East-West Control Framework For SDN Controllers. In: The Proceedings of Forty Fourth IEEE International Conference on Parallel Processing, (2015).

  169. Richardsonan L., Ruby S.: RESTful web services, O’Reilly Media Inc. , (2008).

  170. Kim, H., Reich, J., Gupta, A., Shahbaz, M., Feamster, N., Clark, R.: Kinetic: Verifiable Dynamic Network Control. In: Proceedings of USENIX NSDI, Oakland, CA, USA, 59–72. 2015.

  171. Voellmy, A., Kim, H., Feamster, N.: Procera: A Language for High Level Reactive Network Control. In: Proceedings of the First Workshop on Hot topics in Software Defined Networks, ACM, (2012).

  172. Reitblatt, M., Canini, M., Guha, A., Foster, N.: FatTire: Declarative Fault Tolerance for Software Defined Networks. In: Proceedings of the Second Workshop on Hot Topics in Software Defined Networks, ACM, (2013).

  173. Foster, N., Harrison, R., Freedman, M.J., Monsanto, C., Rexford, J., Story, A. Walker, D.: Frenetic: A Network Programming Language. In: The Proceedings of SIGPLAN, (2011).

  174. Layeghy, S., Pakzad, F., Portmann, M.:SCOR: Constraint Programming-Based Northbound Interface for SDN, In: Twenty Sixth International Telecommunication Networks and Applications Conference (ITNAC) , pp. 83–88, Dec 2016.

  175. Network Intent Composition (NIC) Developer Guide (Online). https://docs.opendaylight.org/ en/stable-oxygen/developer-guide/network-intent-composition-(nic)-developer-guide.html

  176. Rodrigues,Y.: OpenDaylight ODL: Network Intent Composition (NIC) - A real Intent-based solution, challenges and next steps Intent Framework, (online) https://www.serro.com/opendaylight-network-intent-composition-a-real-intent-based-solution-challenges-and-next-steps/

  177. “Intent Framework,” (Online). https://wiki.onosproject.org/display/ONOS/Intent+Framework

  178. Bonfim, M.S., Dias, K.L., Fernandes, S.F.:Integrated NFV/SDN Architectures: A Systematic Literature Review. In: ACM Computing Surveys, Vol. 51, No. 06, (2019).

  179. Moyano, R.F., Fernández, D., Merayo, N., Lentisco, C.M., Cárdenas, A.: NFV and SDN-Based Differentiated Traffic Treatment for Residential Networks, IEEE Access, (2020).

  180. Martínez, R., Mayoral, A., Vilalta, R., Casellas, R., Muñoz, R., Pachnicke, S., Szyrkowiec, T., Autenrieth, A. Integrated SDN/NFV orchestration for the dynamic deployment of mobile virtual backhaul networks over a multilayer (packet/optical) aggregation infrastructure. In: IEEE/OSA Journal of Optical Communications and Networking Vol. 9, No. 2, (2017).

  181. Saridis, G.M., Peng, S., Yan, Y., Aguado, A., Guo, B., Arslan, M., Jackson, C., Miao, W., Calabretta, N., Agraz, F., Spadaro, S., et al.: Lightness: a function-virtualizable software defined data center network with all-optical circuit/packet Switching. J. Lightwave Technology 34, 7 (2016)

    Google Scholar 

  182. Schulz-Zander, J., Mayer, C., Ciobotaru, B., Schmid, S, et al.:. Unified Programmability of Virtualized Network Functions and Software-Defined Wireless Networks, In: IEEE Transactions on Network and Service Management (2017).

  183. Schulz-Zander, J., Mayer, C., Ciobotaru, B., Schmid, S, et al.:. OpenSDWN: Programmatic Control over Home and Enterprise WiFi. In: Proceedings of the 1st ACM SIGCOMM Symposium on Software Defined Networking Research (SOSR ’15). ACM, New York, NY, USA, (2015).

  184. Cheng, G., Chen, H., Hu, H., Wang, Z., Lan, J.: Enabling network function combination via service chain instantiation. Comput. Netw. 92(2), 396–407 (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Suhail Ahmad.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ahmad, S., Mir, A.H. Scalability, Consistency, Reliability and Security in SDN Controllers: A Survey of Diverse SDN Controllers. J Netw Syst Manage 29, 9 (2021). https://doi.org/10.1007/s10922-020-09575-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10922-020-09575-4

Keywords

Navigation