Abstract
Taqqu’s Theorem plays a fundamental role in Internet traffic modeling, for two reasons: First, its theoretical formulation matches closely and in a meaningful manner some of the key network mechanisms controlling traffic characteristics; Second, it offers a plausible explanation for the origin of the long range dependence property in relation with the heavy tail nature of the traffic components. Numerous attempts have since been made to observe its predictions empirically, either from real Internet traffic data or from numerical simulations based on popular traffic models, yet rarely has this resulted in satisfactory quantitative agreements. This raised in the literature a number of comments and questions, ranging from the adequacy of the theorem to real world data to the relevance of the statistical tools involved in practical analyses. The present contribution aims at studying under which conditions this fundamental theorem can be actually seen at work on real or simulated data. To do so, numerical simulations based on standard traffic models are analyzed in a wavelet framework. The key time scales involved are derived, enabling a discussion of the origin and nature of the difficulties encountered in attempts to empirically observe Taqqu’s Theorem.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Leland, W. E., Taqqu, M. S., Willinger, W., & Wilson, D. V. (1994). On the self-similar nature of Ethernet traffic (extended version). ACM/IEEE Transactions Networking, 2(1), 1–15.
Willinger, W., Taqqu, M. S., Sherman, R., & Wilson, D. V. (1997). Self-similarity through high-variability: statistical analysis of Ethernet lan traffic at the source level. IEEE/ACM Transactions on Networking, 5(1), 71–86.
Abry, P., & Veitch, D. (1998). Wavelet analysis of long-range dependent traffic. IEEE Transactions on Information Theory, 44(1), 2–15.
Park, K., & Willinger, W. (2000). Self-similar network traffic and performance evaluation. New York: Wiley.
Park, K., Kim, G., & Crovella, M. (1996). On the relationship between file sizes, transport protocols, and self-similar network traffic. In Int. conf. on network protocols (p. 171). Washington: IEEE Computer Society.
Crovella, M. E., & Bestavros, A. (1997). Self-similarity in World Wide Web traffic: evidence and possible causes. IEEE/ACM Transactions on Networking, 5(6), 835–846.
Hohn, N., Veitch, D., & Abry, P. (2003). Cluster processes, a natural language for network traffic. IEEE Transactions on Signal Processing—Special Issue on Signal Processing in Networking, 8(51), 2229–2244.
Barakat, C., Thiran, P., Iannaccone, G., Diot, C., & Owezarski, P. (2002). A flow-based model for Internet backbone traffic. In ACM/SIGCOMM Internet measurement workshop (pp. 35–47). New York: ACM Press.
Downey, A. B. (2001). Evidence for long-tailed distributions in the Internet. In IMW’01: proceedings of the 1st ACM SIGCOMM workshop on Internet measurement (pp. 229–241). New York: ACM Press.
Taqqu, M. S., Willinger, W., & Sherman, R. (1997). Proof of a fundamental result in self-similar traffic modeling. ACM SIGCOMM—Computer Communication Review, 27(2), 5–23.
Malone, D., Duffy, K., & King, C. (2007). Some remarks on LD plots for heavy-tailed traffic. ACM SIGCOMM—Computer Communication Review, 37(1), 41–42.
Ricciato, F. (2006). Some remarks to recent papers on traffic analysis: or the case for public wiki-like platforms for commenting published papers. ACM SIGCOMM—Computer Communication Review, 36(3), 99–102.
Roughan, M., & Veitch, D. (2007). Some remarks on unexpected scaling exponents. CCR Online, URL: http://ccr.sigcomm.org/online/?q=node/289
Adler, R. J., Feldman, R. E., & Taqqu, M. S. (1998). A practical guide to heavy tails. New York: Chapman and Hall.
Samorodnitsky, G., & Taqqu, M. (1994). Stable non-Gaussian random processes. New York: Chapman & Hall.
Lee, I. W. C., & Fapojuwo, A. (2005). Estimating heavy-tails in long-range dependent wireless traffic. In IEEE vehicular technology conference (Vol. 4, pp. 2132–2136).
Beran, J. (1994). Statistics for long-memory processes. New York: Chapman & Hall.
Doukhan, P., Oppenheim, G., & Taqqu, M. (2003). Long-range dependence: theory and applications. Boston: Birkhäuser.
Embrechts, P., & Maejima, M. (2002). Selfsimilar processes. Princeton: Princeton University Press.
Mallat, S. (1999). A wavelet tour of signal processing. San Diego: Academic Press.
Abry, P., Gonçalves, P., & Flandrin, P. (1995). Wavelets, spectrum analysis and 1/f processes. In Lecture notes in statistics : Vol. 103. Wavelets and statistics (pp. 15–29). Berlin: Springer.
Veitch, D., & Abry, P. (1999). A wavelet based joint estimator of the parameters of long-range dependence. IEEE Transactions on Information Theory—special issue on “Multiscale Statistical Signal Analysis and its Applications”, 45(3), 878–897.
Abry, P., Flandrin, P., Taqqu, M., & Veitch, D. (2000). Wavelets for the analysis, estimation and synthesis of scaling data. In K. Park & W. Willinger (Eds.), Self-similar network traffic and performance evaluation. New York: Wiley.
Veitch, D., & Abry, P. (2001). A statistical test for the time constancy of scaling exponents. IEEE Transactions on Signal Processing, 49(10), 2325–2334.
Flandrin, P. (1992). Wavelet analysis and synthesis of fractional Brownian motion. IEEE Transaction on Information Theory, 38(2), 910–917.
Likhanov, N., Tsybakov, B., & Georganas, N. (1995). Analysis of an ATM buffer with self-similar (“fractal”) input traffic. In Proceedings of INFOCOM’95 (pp. 985–992).
Cho, K., Mitsuya, K., & Kato, A. (2000). Traffic data repository at the WIDE project. In USENIX 2000 annual technical conference: FREENIX track (pp. 263–270).
Veitch, D., Abry, P., & Taqqu, M. S. (2003). On the automatic selection of the onset of scaling. Fractals, 4(11), 377–390.
Roughan, M., Yates, J., & Veitch, D. (1999). The mystery of the missing scales: pitfalls in the use of fractal renewal processes to simulate LRD processes. In American Statistical Association and the Institute of Mathematical Statistics (ASA-IMS) conference on applications of heavy tailed distributions in economics, engineering and statistics. American University, Washington, DC.
Lowen, S. B., & Teich, M. C. (2005). Fractal-based point processes. New York: Wiley.
Bouchaud, J. P., & Mezard, M. (1997). Universality classes for extreme value statistics. Journal of Physics A, 30, 7997.
NS-2. The network simulator. http://isi.edu/nsnam/ns/.
Ricciato, F., Coluccia, A., D’Alconzo, A., Veitch, D., Borgnat, P., & Abry, P. (2009). On the role of flows and sessions in Internet traffic. In: IEEE Globecom 2009, Honolulu, Hawaii, USA
Dewaele, G., Fukuda, K., Borgnat, P., Abry, P., & Cho, K. (2007). Extracting hidden anomalies using sketch and non Gaussian multiresolution statistical detection procedure. In SIGCOMM LSAD’07 (pp. 145–152).
Borgnat, P., Dewaele, G., Fukuda, K., Abry, P., & Cho, K. (2009). Seven years and one day: sketching the evolution of Internet traffic. In INFOCOM’09, Rio de Janeiro, Brasil.
Loiseau, P., Gonçalves, P., Dewaele, G., Borgnat, P., Abry, P., & Vicat-Blanc Primet, P. (2008). Investigating self-similarity and heavy-tailed distributions on a large scale experimental facility. Technical Report http://hal.inria.fr/inria-00263634 April 2008
Gonçalves, P., & Riedi, R. (2005). Diverging moments and parameter estimation. Journal of American Statistical Association, 100(472), 1382–1393.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Abry, P., Borgnat, P., Ricciato, F. et al. Revisiting an old friend: on the observability of the relation between long range dependence and heavy tail. Telecommun Syst 43, 147–165 (2010). https://doi.org/10.1007/s11235-009-9205-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11235-009-9205-6