Skip to main content
Log in

Designing Efficient and Robust Caching Algorithms for Streaming-on-Demand Services on the Internet

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

Content Delivery Networks (CDN) have been used on the Internet to cache media content so as to reduce the load on the original media server, network congestion, and latency. Due to the large size of media content compared to normal web objects, current caching algorithms used in the Internet are no longer suitable. This paper presents a high-performance prefetch system that accommodates user time-varying behavior. A hybrid caching technique, which combines prefetch and replacement algorithms, is also introduced. The robustness of the cache system against imperfect user request information is evaluated using three request noise models. Two prefetch performance indices are also presented to help content administrators in deciding when to update the user request profile for caching algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. S. Acharya and B. Smith, “MiddleMan: A video caching proxy server,” in Proc. 10th International Workshop Network and Operating System Support for Digital Audio and Video (NOSSDAV), June 2000.

  2. CA*netII (Canada’s coast to coast broadband research network), sanitized log files, parent cache, available at http://ardnoc41.canet2.net/cache/squid/rawlogs/

  3. P. Cao, E. W. Felten, A. R. Karlin, and K. Li, “A study of integrated prefetching and caching strategies,” in Proc. of the ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, 1995.

  4. R. L. Carroll and D. M. Davis, Electronic Media Programming: Strategies and Decision Making, McGraw-Hill, 1993, pp. 62, 289–291.

  5. A. L. Chervenak, “Tertiary storage: An evaluation of new applications,” Ph.D. Thesis, University of California at Berkeley, Computer Science Division Technical Report UDB/CSD 94/847, December 1994.

  6. M. Chesire, A. Wolman, G. M. Voelker, and H. M. Levy, “Measurement and analysis of a streaming media workload,” in Proc. Usenix Sympos. Internet Technologies & Systems (USITS), March 2001.

  7. Cisco Systems, Inc., “Cisco content engines for the Internet content delivery network,” http://www.cisco.com/warp/public/cc/so/neso/cxne/cceng_ds.pdf

  8. Cisco Systems, Inc., “Cisco content networking technology,” http://www.cisco.com/warp/public/44/solutions/network/content_networking.shtml

  9. A. Dan, D. Sitaram, and P. Shahabuddin, “Scheduling policies for an on-demand video server with batching,” in Proc. 2nd Annual ACM Multimedia Conference and Exposition, San Francisco, CA, 1994.

  10. D. Duchamp, “Prefetching hyperlinks,” in Proc. of the 2nd USENIX Symposium on Internet Technologies and Systems (USITS’99), Boulder, CO, 1999.

  11. J. Griffioen and R. Appleton, “Reducing file system latency using a predictive approach,” in Proc. of USENIX Summer Conf., 1994, pp. 197–207.

  12. J. Kangasharju, F. Hartanto, M. Reisslein, and K. W. Ross, “Distributing layered encoded video through caches,” IEEE Transactions on Computers 51(6), 2002, 622–636.

    Article  Google Scholar 

  13. E. P. Markatos and C. E. Chironaki, “A Top 10 approach for prefetching the Web,” in Proc. of INET’98: Internet Global Summit, 1998.

  14. T. Palpanas and A. Mendelzon, “Web prefetching using partial match prediction,” in Web Caching Workshop, San Diego, CA, 1999.

  15. M. Reisslein, F. Hartanto, and K. W. Ross, “Interactive video streaming with proxy servers,” Information Sciences 140(1–2), Special Issue on Interactive Virtual Environment and Distance Education, 2001, 3–31.

    Article  Google Scholar 

  16. R. Rejaie, H. Yu, M. Handley, and D. Estrin, “Multimedia proxy caching mechanism for quality adaptive streaming applications in the Internet,” in Proc. IEEE INFOCOM 2000, 2, March 2000, pp. 980–989.

  17. Q. Yang and H. H. Zhang, “Integrating Web prefetching and caching using prediction models,” World Wide Web 4(4), 2001, 299–321.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Leung, K.Y., Wong, E.W.M. & Yeung, K.H. Designing Efficient and Robust Caching Algorithms for Streaming-on-Demand Services on the Internet. World Wide Web 7, 297–314 (2004). https://doi.org/10.1023/B:WWWJ.0000028182.49617.09

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:WWWJ.0000028182.49617.09

Navigation