Estimating and Forecasting Network Traffic Performance Based on Statistical Patterns Observed in SNMP Data

  • Kejia Hu
  • Alex Sim
  • Demetris Antoniades
  • Constantine Dovrolis
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7988)

Abstract

With scientific data growing to unprecedented volumes and the needs to share such massive amounts of data by increasing numbers of geographically distributed collaborators, the best possible network performance is required for efficient data access. Estimating the network traffic performance for a given time window with a probabilistic tolerance enables better data routing and transfers that is particularly important for large scientific data movements, which can be found in almost every scientific domain. In this paper, we develop a network performance estimation model based on statistical time series approach, to improve the efficiency of network resource utilization and data transfer scheduling and management over networks. Seasonal adjustment procedures are developed for identification of the cycling period and patterns, seasonal adjustment and diagnostics. Compared to the traditional time series models, we show a better forecast performance in our seasonal adjustment model with narrow confidence intervals.

Keywords

Time series Seasonal Adjustment Network Traffic Forecast STL X12-ARIMA 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Alarcon-Aquino, V., Barria, J.A.: Multiresolution FIR Neural-Network-Based Learning Algorithm Applied to Network Traffic Prediction. IEEE Transactions on Systems, Man, and Cybernetics—Part C: Applications and Reviews 36(2), 208–220 (2006)CrossRefGoogle Scholar
  2. 2.
    Box, G., Jenkins, G.: Time series analysis: Forecasting and control. Wiley Series in Probability and Statistics (1970)Google Scholar
  3. 3.
    Cleveland, W.S.: STL: A Seasonal-Trend Decomposition Procedure Based on Loess. Journal of Official Statistics 6(1), 3–73 (1990)Google Scholar
  4. 4.
    Durbin, J., Koopman, S.J.: Time Series Analysis by State Space Methods. Oxford University Press (2001)Google Scholar
  5. 5.
    Feng, H., Shu, Y.: Study on Network Traffic Prediction Techniques. In: Proceedings of International Conference on Wireless Communications, Networking and Mobile Computing, vol. 2, pp. 1041–1044 (2005)Google Scholar
  6. 6.
    Findley, D.F., Hood, C.H.: Seasonal Adjustment Procedures. In: Experiences and Perspectives, Istituto Nazionale di Statistica, Rome, pp. 231–251 (2000)Google Scholar
  7. 7.
    Findley, D.F.: Some Recent Developments and Directions in Seasonal Adjustment. Journal of Official Statistics 21(2) (2005)Google Scholar
  8. 8.
    Findley, Monsell, Bell, Otto, Chen: New Capabilities and Methods of the X-12-ARIMA Seasonal Adjustment Program. Preprint version of JBES (1998)Google Scholar
  9. 9.
    Findley, M., Shulman, P.: Sliding Spans Diagnostics for Seasonal and Related Adjustments. Journal of the American Statistical Association 85, 345–355 (1990)CrossRefGoogle Scholar
  10. 10.
    Granger, C.W.J.: Seasonality: Causation, Interpretation, and Implications. In: Zellner, A. (ed.) NBER Book Seasonal Analysis of Economic Time Series, pp. 33–56 (1979)Google Scholar
  11. 11.
    Harvey, A.C.: Forecasting, Structural Time Series Models and the Kalman Filter. Cambridge University Press (1989)Google Scholar
  12. 12.
    Higginson, J.: F-test for the Presence of Moving Seasonality. Statistics Canada, Seasonal Adjustment Methods (1975)Google Scholar
  13. 13.
    Holt, C.C.: Forecasting trends and seasonals by exponentially weighted moving averages. International Journal of Forecasting 20(1), 5–10 (1957)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Hood, C.H., Monsell, B.C.: Getting Started with X-12-ARIMA Input Files on Your PC (2002), http://www.census.gov/ts/papers/gettingstartedx12.pdf
  15. 15.
  16. 16.
    Hyndman, R.J., Akram, M.D., Archibald, B.: The admissible parameter space for exponential smoothing models. Annals of Statistical Mathematics 60(2), 407–426 (2008)MathSciNetMATHCrossRefGoogle Scholar
  17. 17.
    Lothian, J., Morry, M.: A Test of Quality Control Statistics for the X-11-ARIMA Sea-sonal Adjustment Program. Research Paper. Seasonal Adjustment and Time Series Staff. Statistics Canada (1978)Google Scholar
  18. 18.
    Qian, Y., Xia, J., Fu, K., Zhang, R.: Network Traffic Forecasting by Support Vector Machines Based on Empirical Mode Decomposition Denoising. In: 2012 2nd International Conference on Consumer Electronics, Communications and Networks, CECNet (2012)Google Scholar
  19. 19.
    Seasonal Adjustment Diagnostics and Supporting Document A (Checklists). Census Bureau, https://www.census.gov/ts/papers/G18-0_v1.1_Seasonal_Adjustment.pdf
  20. 20.
    Winters, P.R.: Forecasting sales by exponentially weighted moving averages. Management Science 6, 324–342 (1960)MathSciNetMATHCrossRefGoogle Scholar
  21. 21.
    X-12-ARIMA Seasonal Adjustment Program, http://www.census.gov/srd/www/x12a/
  22. 22.
    X-12-ARIMA Version 0.3 Reference Manual (2006), http://www.census.gov/ts/x12a/v03/x12adocV03.pdf
  23. 23.
    Zhao, H., Ansari, N.: Wavelet Transform-based Network Traffic Prediction: A Fast On-line Approach. Journal of Computing and Information Technology 20(1), 15–25 (2012)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Kejia Hu
    • 1
    • 2
  • Alex Sim
    • 1
  • Demetris Antoniades
    • 3
  • Constantine Dovrolis
    • 3
  1. 1.Lawrence Berkeley National LaboratoryUSA
  2. 2.University of California at DavisUSA
  3. 3.Georgia Institute of TechnologyUSA

Personalised recommendations