Advertisement

Multimedia Systems

, Volume 9, Issue 4, pp 337–352 | Cite as

Design considerations for the symphony integrated multimedia file system

  • Prashant ShenoyEmail author
  • Pawan Goyal
  • Sriram Rao
  • Harrick M. Vin
OriginalPaper

Abstract.

A multimedia file system supports diverse application classes that access data with heterogeneous characteristics. In this paper, we describe our experiences in the design and implementation of the Symphony multimedia file system. We first discuss various methodologies for designing multimedia file systems and examine their trade-offs. We examine the design requirements for such file systems and argue that to efficiently manage the heterogeneity in application requirements and data characteristics, a multimedia file system should enable the coexistence of multiple data-type-specific and application-specific techniques. We describe the architecture and novel features of Symphony and then demonstrate their efficacy through an experimental evaluation. Our results show that Symphony yields a factor of 1.9 improvement in text response time over conventional disk scheduling algorithms while continuing to meet the real-time requirements of video clients. Finally, we reflect upon the lessons learned from the Symphony project.

Keywords

Response Time Experimental Evaluation Schedule Algorithm Access Data File System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Almeida J, Eager D, Vernon M (2001) Hybrid caching strategy for streaming media files. In: Proceedings of ACM/SPIE Multimedia computing and networking 2001, San Jose, January 2001, pp 200-212Google Scholar
  2. 2.
    Anastasiadis SV, Sevcik K, Stumm M (2001) Disk-striping scalability in the Exedra media server. In: Proceedings of ACM/SPIE Multimedia computing and networking 2001, San Jose, January 2001, pp 175-189Google Scholar
  3. 3.
    Anderson D, Osawa Y, Govindan R (1992) A file system for continuous media. ACM Trans Comput Sys 10(4):311-337Google Scholar
  4. 4.
    Bach MJ (1986) The design of the Unix operating system. Prentice-Hall, New YorkGoogle Scholar
  5. 5.
    Bacon J, Moody K, Thomson S, Wilson T (1991) A multi-service storage architecure. ACM SIGOPS Operat Sys Rev 25(4):47-65Google Scholar
  6. 6.
    Bershad B, Savage S, Pardyak P, Sirer E, Fiuczynski M, Becker D, Chambers C, Eggers S (1995) Extensibility, safety, and performance in the SPIN operating system. In: Proceedings of the 15th ACM symposium on operating systems principles, Copper Mountain, CO, December 1995, pp 267-284Google Scholar
  7. 7.
    Buddhikot M, Parulkar G, Cox J (1994) Design of a large scale multimedia storage server. J Comput Netw ISDN Sys pp 504--524Google Scholar
  8. 8.
    Cao P (1996) Application controlled file caching and prefetching. PhD thesis, Princeton UniversityGoogle Scholar
  9. 9.
    Chang E, Zakhor A (1994) Scalable video placement on parallel disk arrays. In: Proceedings of IS&T/SPIE international symposium on electronic imaging: science and technology, San Jose, January 1997, pp 208-221Google Scholar
  10. 10.
    Chen PM, Lee EK, Gibson GA, Katz RH, Patterson DA (1994) RAID: high-performance, reliable secondary storage. ACM Comput Surv 26(2):pp 145-185Google Scholar
  11. 11.
    Coffman EG, Klimko LA, Ryan B (1972) Analysis of scanning policies for reducing disk seek times. SIAM J Comput 1(3):269-279Google Scholar
  12. 12.
    Dan A, Sitaram D (1996) A generalized interval caching policy for mixed interactive and long video workloads. In: Proceedings of the conference on multimedia computing and networking (MMCN), San Jose, January 1996, pp 344-351Google Scholar
  13. 13.
    Danskin JM, Davies GM, Song X (1995) Fast lossy Internet image transmission. In: Proceedings of the 3rd ACM conference on multimedia, San Francisco, November 1995, pp 321-332Google Scholar
  14. 14.
    Engler D, Kaashoek M, O’Toole J (1995) Exokernel: an operating system architecture for application-level resource management. In: Proceedings of the 15th ACM symposium on operating systems principles, Copper Mountain, CO, December 1995, pp 251-266Google Scholar
  15. 15.
    Gribble SD, Manku G, Roselli D, Brewer E, Gibson T, Miller E (1998) Self-similarity in file systems. In: Proceedings of ACM SIGMETRICS ‘98, Madison, WI, June 1996, pp 141-150Google Scholar
  16. 16.
    Haskin R (1998) Tiger Shark-a scalable file system for multimedia. IBM J Res Develop 42(2):185-197Google Scholar
  17. 17.
    Holton M, Das R (1996) XFS: a next generation journalled 64-bit file system with guaranteed rate I/O. Technical report, Silicon Graphics. Available online at http://www.sgi.com/software/xfsGoogle Scholar
  18. 18.
    International Organisation for Standardisation (1994) Information technology - generic coding of moving pictures and associated audio systems: systems, video and audio, international standard (MPEG2), ISO/IEC 13818Google Scholar
  19. 19.
    Jardetzky PW (1992) Network file server design for continuous media. PhD thesis, University of CambridgeGoogle Scholar
  20. 20.
    Jonge W, Kaashoek MF, Hsieh WC (1993) The logical disk: a new approach to improving file systems. In: Proceedings of the 14th symposium on operating systems principles, Asheville, NC, December 1993, pp 15-28Google Scholar
  21. 21.
    Khalidi Y, Nelson M (1993) Extensible file systems in spring. In: Proceedings of the 14th ACM symposium on operating systems principles, Asheville, NC, December 1993, pp 1-14Google Scholar
  22. 22.
    Knuth DE (1973) The art of computer programming, vol 1: Fundamental algorithms. Addison-Wesley, Reading, MAGoogle Scholar
  23. 23.
    Leffler SJ, McKusick MK, Karels MJ, Quartermann JS (1989) The design and implementation of the 4.3BSD Unix operating system. Addison-Wesley, Reading MAGoogle Scholar
  24. 24.
    Lehoczky JP, Ramos-Thuel S (1992) An optimal algorithm for scheduling soft-aperiodic tasks in fixed-priority preemptive systems. In: Proceedings of the real-time systems symposium, Phoenix, AZ, December 1992, pp 110-123Google Scholar
  25. 25.
    Martin C, Narayan PS, Ozden B, Rastogi R, Silberschatz A (1996) The Fellini multimedia storage server. In: Chung SM (ed) Multimedia information storage and management, Kluwer, AmsterdamGoogle Scholar
  26. 26.
    McKusick MK, Joy WN, Leffler SJ, Fabry RS (1984) A fast file system for UNIX. ACM Trans Comput Sys 2(3):181-197Google Scholar
  27. 27.
    McVoy L, Klieman S (1990) Extent-like performance from a UNIX file system. In: Proceedings of summer USENIX conference, Anaheim, CA, June 1990, pp 137-144Google Scholar
  28. 28.
    Narasimha Reddy AL, Wyllie J (1993) Disk scheduling in multimedia I/O system. In: Proceedings of ACM Multimedia’93, Anaheim, CA, October 1991, pp 225-234Google Scholar
  29. 29.
    Niranjan T, Chiueh T, Schloss G (1997) Implementation and evaluation of a multimedia file system. In: Proceedings of ICMCS’97, Ottawa, Canada, June 1997, pp 169-276Google Scholar
  30. 30.
    Noble B, Satyanarayanan M, Narayanan D, Tilton J, Flinn J, Walker K (1997) Agile application-aware adaptation for mobility. In: Proceedings of the 16th ACM symposium on operating system principles, St Malo, France, October 1997, pp 276-287Google Scholar
  31. 31.
    Patterson D, Gibson G, Katz R (1988) A case for redundant array of inexpensive disks (RAID). In: Proceedings of ACM SIGMOD’88, pp 109-116Google Scholar
  32. 32.
    Patterson RH(1995) Informed prefetching and caching. In: Proceedings of the 15th ACM symposium on operating systems principles, Copper Mountain, CO, December 1995, pp 79-95Google Scholar
  33. 33.
    Rao SS, Vin HM, Tarafdar A (1996) Comparative evaluation of server-push and client-pull architectures for multimedia servers. In: Proceedings of the workshop on network and operating system support for digital audio and video (NOSSDAV’96), Zushi, Japan, April 1996, pp 45-48Google Scholar
  34. 34.
    Rejaie R, Kangasharju J (2001) Mocha: a quality adaptive multimedia proxy cache for Internet streaming. In: Proceedings of the workshop on network and operating system support for digital audio and video (NOSSDAV 2001), Port Jefferson, NY, June 2001, pp 3-10Google Scholar
  35. 35.
    Roscoe T (1995) The structure of a multi-service operating system. PhD thesis, University of Cambridge Computer Laboratory. Available as Technical Report No. 376Google Scholar
  36. 36.
    Rosenblum M, Ousterhout J (1991) The design and implementation of a log-structured file system. In: Proceedings of the 13th ACM symposium on operating systems principles, Anaheim, CA, October 1991, pp 1-15Google Scholar
  37. 37.
    Santos J, Muntz R, Ribeiro-Neto B (2000) Comparing random data allocation and data striping in multimedia servers. In: Proceedings of ACM SIGMETRICS 2000, Santa Clara, CA, June 2000, pp 44-55Google Scholar
  38. 38.
    Shenoy P, Vin HM (1999a) Efficient striping techniques for variable bit rate continuous media file servers. Perform Eval J 38(3):175-199Google Scholar
  39. 39.
    Shenoy P, Vin HM (1999b) Efficient support for interactive operations in multi-resolution video servers. ACM/Springer Multimedia Sys J 7(3):241-253Google Scholar
  40. 40.
    Shenoy P, Vin H (2002) Cello: a disk scheduling framework for next generation operating systems. Real Time Sys J (Special issue on flexible scheduling of real-time systems) 22:9-47Google Scholar
  41. 41.
    Shenoy P, Goyal P, Vin HM (2002) Architectural considerations for next generation file systems. ACM/Springer Multimedia Sys J 8(4):270-283Google Scholar
  42. 42.
    Shenoy PJ, Goyal P, Rao S, Vin HM (1997) Design and implementation of Symphony: an integrated multimedia file system. Technical Report TR97-09, Department of Computer Sciences, University of Texas at AustinGoogle Scholar
  43. 43.
    Tewari R, Vin HM, Dan A, Sitaram D (1996) Caching in bandwidth and space constrained hierarchical hyper-media servers. Technical Report TR96-30, Department of Computer Sciences, University of Texas at AustinGoogle Scholar
  44. 44.
    Tobagi FA, Pang J, Baird R, Gang M (1993) Streaming RAID - a disk array management system for video files. In: Proceedings of ACM Multimedia ‘93, Anaheim, CA, pp 393-400Google Scholar
  45. 45.
    Venkat Rangan P, Vin HM (1991) Designing file systems for digital video and audio. In: Proceedings of the 13th symposium on operating systems principles (SOSP’91), Operat Sys Rev 25(5):81-94Google Scholar
  46. 46.
    Vernick M, Venkatramini C, Chiueh T (1996) Adventures in building the Stony Brook video server. In: Proceedings of ACM Multimedia’96, Boston, November 1996, pp 287-295Google Scholar
  47. 47.
    Vin HM, Goyal P, Goyal A (1994) A statistical admission control algorithm for multimedia servers. In: Proceedings of ACM Multimedia’94, San Francisco, October 1994, pp 33-40Google Scholar
  48. 48.
    Vin HM, Goyal A, Goyal P (1995a) Algorithms for designing large-scale multimedia servers. Comput Commun 18(3):192-203Google Scholar
  49. 49.
    Vin HM, Shenoy PJ, Rao S (1995b) Efficient failure recovery in multi-disk multimedia servers. In: Proceedings of the 25th international symposium on fault tolerant computing systems, Pasadena, CA, June 1995, pp 12-21Google Scholar
  50. 50.
    Vin HM, Rao SS, Goyal P (1995c) Optimizing the placement of multimedia objects on disk arrays. In: Proceedings of the 2nd IEEE international conference on multimedia computing and systems, Washington, DC, May 1995, pp 158-165Google Scholar
  51. 51.
    Wijayaratne R, Narasimha Reddy A (2001) System support for providing integrated services from networked multimedia servers. In: Proceedings of ACM Multimedia 2001, Ottowa, Canada, October 2001, pp 270-279Google Scholar

Copyright information

© Springer-Verlag Berlin/Heidelberg 2003

Authors and Affiliations

  • Prashant Shenoy
    • 1
    Email author
  • Pawan Goyal
    • 2
  • Sriram Rao
    • 3
  • Harrick M. Vin
    • 3
  1. 1.Department of Computer ScienceUniversity of MassachusettsAmherstUSA
  2. 2.IBM Research DivisionAlmaden Research CenterSan JoseUSA
  3. 3.Department of Computer SciencesUniversity of TexasAustinUSA

Personalised recommendations