Estimating SDN traffic matrix based on online adaptive information gain maximization method

  • Dongyang Li
  • Changyou Xing
  • Ningyun Dai
  • Fei Dai
  • Guomin Zhang
Article
  • 17 Downloads
Part of the following topical collections:
  1. Special Issue on Software Defined Networking: Trends, Challenges and Prospective Smart Solutions

Abstract

Traffic Matrix (TM) estimation is important for network management and traffic engineering. However, current estimation methods are insufficient in estimation accuracy and measurement cost. In this paper, by using the flow measurement capability in Software Defined Networks (SDN), we propose an Online Information Gain Maximization based SDN traffic matrix estimation method IGME. IGME uses the information gain metric to determine which flows are most informative, and then constructs the measurement flow set iteratively until the accuracy requirement is satisfied or the measurement resource constraint is reached. The experiment results on three Internet measurement datasets show that IGME can improve the estimation accuracy only by consuming a small amount of measurement resource. Besides, the iteration feature of IGME provides a means to dynamically adjust the measurement flow selection choice, so as to adapt to the time-varying characteristics of the network traffic.

Keywords

Traffic matrix estimation Software defined networking Information entropy OpenFlow 

Notes

Acknowledgements

We wish to express our great thanks for the discussion with Dr. Marco Polverini. This research was supported by a research grant from the National Basic Research Program of China (973 Program) under Grant No.2012CB315806, the China PostDoctoral Science Foundation under Grant No. 2017 M610286, the National Natural Science Foundation of China under Grant No. 61379149, and the Natural Science Foundation of Jiangsu under Grant No. BK20140070.

References

  1. 1.
    Medina A, Taft N, Salamatian K, Bhattacharyya S, Diot C (2002) Traffic matrix estimation: existing techniques and new directions. In: ACM SIGCOMM computer communication review. ACM, pp 161–174Google Scholar
  2. 2.
    Mckeown N, Anderson T, Balakrishnan H, Parulkar G, Peterson L, Rexford J, Shenker S, Turner J (2008) OpenFlow: enabling innovation in campus networks. In: ACM SIGCOMM computer communication review. ACM, pp 69–74Google Scholar
  3. 3.
    Polverini M, Baiocchi A, Cianfrani A, Iacovazzi A, Listanti M (2016) The power of SDN to improve the estimation of the ISP traffic matrix through the flow spread concept. IEEE J Sel Areas in Commun 34(6):1904–1913CrossRefGoogle Scholar
  4. 4.
    Tune P, Roughan M (2013) Internet traffic matrices: a primer. in Recent Advances in Networking, vol 1, ACM SIGCOMM eBook, Aug. 2013Google Scholar
  5. 5.
    Lakhina A, Papagiannaki K, Crovella M, Diot C, Kolaczyk E.D, Taft N (2004) Structural analysis of network traffic flows. In: Joint International Conference on Measurement and Modeling of Computer Systems, pp 61–72Google Scholar
  6. 6.
    Crovella M (2012) On traffic matrix completion in the internet. In: ACM SIGCOMM Internet Measurement Conference. ACM, pp 399–412Google Scholar
  7. 7.
    Li D, Dai N, Li F, Xing C, Dai F (2017) Estimating SDN traffic matrix based on online informative flow measurement method. In: International Conference on Advanced Cloud and Big Data, pp 75–80Google Scholar
  8. 8.
    Tebaldi C, West M (1998) Bayesian inference on network traffic using link count data. J Am Stat Assoc 93(442):557–573MathSciNetCrossRefMATHGoogle Scholar
  9. 9.
    Liang G, Yu B (2003) Maximum pseudo likelihood estimation in network tomography. IEEE Trans Signal Process 51(8):2043–2053CrossRefGoogle Scholar
  10. 10.
    Zhang Y, Roughan M, Duffield N, Greenberg A (2003) Fast accurate computation of large-scale IP traffic matrices from link loads. In: ACM SIGMETRICS ACM, pp 206–217, 31Google Scholar
  11. 11.
    Nucci A, Cruz R, Taft N, Diot C (2004) Design of IGP link weight changes for estimation of traffic matrices. In: IEEE INFOCOM IEEE, pp 2341–2351Google Scholar
  12. 12.
    Papagiannaki K, Taft N, Lakhina A (2004) A distributed approach to measure IP traffic matrices. ACM SIGCOMM Internet Measurement Conference ACM:161–174Google Scholar
  13. 13.
    Soule A, Nucci A, Taft N (2005) Traffic matrix tracking using Kalman filters. In: ACM Sigmetrics performance evaluation review. ACM, pp 24–31Google Scholar
  14. 14.
    Xie K, Wang L, Wang X, Xie G, Wen J, Zhang G (2016) Accurate recovery of internet traffic data: a tensor completion approach. IEEE INFOCOM, IEEE:1–9Google Scholar
  15. 15.
    Xie K, Peng C, Wang X, Xie G, Wen J (2017) Accurate recovery of internet traffic data under dynamic measurements. IEEE INFOCOM, IEEE:1–9Google Scholar
  16. 16.
    Yuan L, Chuah CN, Mohapatra P (2011) ProgME: towards programmable network measurement. IEEE/ACM Trans Networking 19(1):115–128CrossRefGoogle Scholar
  17. 17.
    Yu M, Jose L, Miao R (2013) Software defined traffic measurement with OpenSketch. In: the 10th USENIX conference on Networked Systems Design and Implementation, pp 29–42Google Scholar
  18. 18.
    Tootoonchian A, Ghobadi M, Ganjali Y (2010) OpenTM: traffic matrix estimator for OpenFlow networks. International Conference on Passive and Active Measurement:201–210Google Scholar
  19. 19.
    Yu Y, Qian C, Li X (2014) Distributed and collaborative traffic monitoring in software defined networks. The Workshop on Hot Topics in Software Defined Networking:85–90Google Scholar
  20. 20.
    Malboubi M, Wang L, Chuah CN, Sharma P (2014) Intelligent SDN based traffic (de)aggregation and measurement paradigm (iSTAMP). IEEE INFOCOM, IEEE:934–942Google Scholar
  21. 21.
    Gong Y, Wang X, Malboubi M, Wang S, Xu S, Chuah CN (2015) Towards accurate online traffic matrix estimation in software-defined networks. ACM SIGCOMM SOSR, ACM:1–7Google Scholar
  22. 22.
    Xing C, Ding K, Hu C, Chen M (2016) Sample and fetch-based large flow detection mechanism in software defined networks. IEEE Commun Lett 20(9):1764–1767CrossRefGoogle Scholar
  23. 23.
    Kullback S (1997) Information theory and statistics. Dover Publications, July 7:1997MATHGoogle Scholar
  24. 24.
    SNDlib library (2014). http://sndlib.zib.de/home.action. Accessed 12 December 2017
  25. 25.
    DEFO Website (2015). http://sites.uclouvain.be/defo/. Accessed 12 December 2017

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Dongyang Li
    • 1
  • Changyou Xing
    • 1
  • Ningyun Dai
    • 1
  • Fei Dai
    • 1
  • Guomin Zhang
    • 1
  1. 1.College of Command Control EngineeringArmy Engineering University of PLANanjingChina

Personalised recommendations