Abstract
Most proxy caches for streaming videos do not cache the entire video but only a portion of it. This is partly due to the large size of video objects. Another reason is that the popularity of different parts of a video can be different, e.g., the prefix is generally more popular. Therefore, the development of efficient cache mechanisms requires an understanding of the internal popularity characteristics of streaming videos. This paper has two major contributions. Firstly, we analyze two 6-month long traces of RTSP video requests recorded at different streaming video servers of an entertainment video-on-demand provider, and show that the traces provide evidence that the internal popularity of the majority of the most popular videos obeys a k-transformed Zipf-like distribution. Secondly, we propose a caching algorithm which exploits this empirical internal popularity distribution. We find that this algorithm has similar performance compared with fine-grained caching but requires significantly less state information.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Sen S., Rexford J., Towsley D. Proxy prefix caching for multimedia streams. In: Proceedings of the IEEE INFOCOM99, March 1999
Chae Y., Guo K., Buddhikot M., Suri S., Zegura E. (2002) Silo, rainbow, and caching token: schemes for scalable fault tolerant streaming caching. IEEE J. Selected Areas Commun. 20(7): 1328–1344
Wu K.L., Yu P.S., Wolf J.L.: Segmentation of multimedia streams for proxy caching. IEEE Trans. Multimedia 5 (2004)
Streaming Video with RealMedia. http://www.mediacollege.com /video/streaming/formats/real-media.html
Helix Universal Server Administrator Guide. http://www.realnetworks.com/resources/documentation:RealNetworks, Inc., 2004
Cherkasova L., Gupta M.: Analysis of enterprise media server workloads: access patterns, locality, content evolution, and rates of change ACM/IEEE J. Trans. Networking 781–794 (2004)
Mena A. Heidemann J.: An empirical study of real audio traffic. In: Proceedings of the IEEE INFOCOMédbb00, March 2000
Acharya S., Smith, B., Parnes P.: Characterizing user access to videos on the world wide web. In: Proceedings of the ACM/SPIE Multimedia Computing and Networking, 2000
Jain R. (1991) The art of computer systems performance analysis. Wiley, NY
Tang W., Fu Y., Cherkasova L., Vahdat A.: Long-term streaming media server workload analysis and modeling. HP Laboratories Palo Alto, Technical Report HPL-2003-23, January 2003
Everett H. (1963) Generalized lagrange multiplier method for solving problems of optimum allocation of resources. Oper. Res. 11, 399–417
Ortego A., Ramchandran K.: Rate-distortion methods for image and video compression. Signal Process. Mag. IEEE 23, (1998)
Bertsekas D.P. (1999) Nonlinear programming. Athena Scientific
Shoham Y., Gersho A.: Efficient bit allocation for an set of quantizers [speech coding]. IEEE Trans Acoustics, Speech, Signal Process [see also IEEE Transactions on Signal Processing] 1445 (1998)
Wu K., Yu P., Wolf J.: Segment-based proxy caching of streams. In: Proceedings of the 10th International World Wide Web Conference (WWW’01), May 2001
Liu J., Chu X., Xu J.: Proxy cache management of scalable video streaming. In: Proceedings of the IEEE INFOCOM04, 2004
Wang B., Sen S., Adler M., Towsley D.: Optimal proxy cache allocation for efficient streaming media distribution. In: Proceedings of the IEEE INFOCOMédbb02, June 2002
Almeida J.M., krueger J., Eager D.L., Vernon M.K.: Analysis of educational media server workloads. In: Proceedings of the 11th International Workshop on Network and Operating Systems Support for Digital Audio and Video. ACM Press, Port Jefferson, June 2001
Chesire M., Wolman A., Voelker G., Levy H.: Measurement and analysis of a streaming-media workload. In: Proceedings of the USENIX Symposium on Internet Technologies and Systems, March 2001
Cherkasova L., Gupta M.: Analysis of enterprise media server workloads: access patterns, locality, dynamics, rate of change. Internet Systems and Storage Laboratory, HP Laboratories Palo Alto, Technical Report HPL-2002-56, March 2001
Kuang T., Williamson C.: A measurement study of realmedia streaming traffic. In: Proceedings of ITCOM, July 2002
Almeida J., Eager D., Ferris M., Vernon M.K.: Provisioning content distribution networks for streaming media. In: Proceedings of the IEEE INFOCOM02, 2002
Venkatramani C., Verscheure O., Frossard P., Lee K.: Optimal proxy management for multimedia streaming in content distribution networks. In: Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV), May 2002
Rejaia R., Yu H., Handley M., Estrin D.: Multimedia proxy caching mechanism for quality adaptive streaming applications in the internet. In: Proceedings of the IEEE INFOCOM’00, March 2000
Hofmann M., Ng E., Guo K., Paul S., Zhang H.: Caching techniques for streaming multimedia over the internet. Bell Laboratories, Technical Report BL011345-990409-04TM, April 1999
Chen S., Shen B., Wee S., Zhang X.: Adaptive and lazy segmentation based proxy caching for streaming media delivery. In: Proceedings NOSSDAV’03, June 2003
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yu, J., Chou, C.T., Yang, Z. et al. A dynamic caching algorithm based on internal popularity distribution of streaming media. Multimedia Systems 12, 135–149 (2006). https://doi.org/10.1007/s00530-006-0045-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00530-006-0045-x