Multimedia Systems

, Volume 2, Issue 4, pp 181–190 | Cite as

On architectures for video compositing

Article

Abstract

Video compositing, the editing and integrating of many video sequences into a single presentation, is an integral part of advanced multimedia services. Single-user compositing systems have been suggested in the past, but when they are extended to accommodate many users, the amount of memory required quickly grows out of hand. We propose two new architectures for digital video compositing in a multiuser environment that are memory-efficient and can operate in real time. Both architectures decouple the task of memory management from compositing processing. We show that under hard throughput and bandwidth constraints, a memory less solution for transferring data from many video sources to many users does not exist. We overcome this using (i) a dynamic memory buffering architecture and (ii) a constant memory bandwidth solution that transforms the sources-to-users transfer schedule into two schedules, then pipelines the computation. The architectures support opaque overlapping of images, arbitrarily shaped images, and images whose shapes dynamically change from frame to frame.

Key words

Video compositing Structured video Multiple users Memory scheduling 
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    CITT Recommendation H.261 (1990) Video codec for audiovisual services atp×64kbits/s. CDM XV-R37-EGoogle Scholar
  2. 2.
    Wallace G (1991) The JPEG still picture compression standard. Commun ACM 34(4): 30–44Google Scholar
  3. 3.
    Committee Draft of Standard ISO 1 1 172 (1990) Coding of moving pictures and associated audio. ISO/ MPEG 90/176Google Scholar
  4. 4.
    CCITT Draft Recommendation I.150 (1992) B-ISDN Asynchronous transfer mode functional characteristics. CCITT SG XVIII, TD 65Google Scholar
  5. 5.
    Lyles JB, Swinehart DC (1992) The emerging gigabit environment and the role of local ATM. IEEE Commun Magazine 30(4):52–58Google Scholar
  6. 6.
    Chen MS, Barzilai T, Vin, HM (1992) Software architecture of DiCE: A distributed collaboration environment. 4th IEEE Com-Soc International Workshop on Multimedia Communications, Monterey, Calif, pp 172–185Google Scholar
  7. 7.
    Rosenberg J., Kraut RE, Gomez, L., Buzzard, CA (1992) Multimedia communications for users. IEEE Commun Magazine 30(5):20–36Google Scholar
  8. 8.
    Chen WL, Haskell P, Messerschmitt DG, Yun LC (1993) Structured video: concept and display architecture. Submitted for publicationGoogle Scholar
  9. 9.
    Kamata H, Katsuyama T, Sizuki T, Minakuchi Y, Yano K (1989) Communication workstations for BISDN: monster kaufmultimedia oriented super terminal). Proceedings of Global Communivations Conference Dallas, pp 959–964Google Scholar
  10. 10.
    Katseff HP, Gaglianello RD, London TB, Robinson BS, Swicker DB (1991) Experiences with the Liaison Network Multimedia Workstation. Proceedings of the USENIX Symposium on Experiences with Distributed and Multiprocessor Systems, Atlanta, pp 341–350Google Scholar
  11. 11.
    Electronic Engineering Times (1992) Pixel, S3 field advanced graphics chips, ISS. no 704, pp 4, Aug 3Google Scholar
  12. 12.
    Vin HM, Rangan PV, Ranmanathan S (1991) Hierarchical conferencing architectures for inter-group multimedia collaboration. Proceedings of the ACM Conference on Organizational Computing Systems, Atlanta, GeorgiaGoogle Scholar
  13. 13.
    Ramanathan S, Rangan PV, Vin HM, Kaeppner T (1992) Optimal communication architectures for multimedia conferencing in distributed systems. Proceedings of the 12th International Conference on Distributed Computing Systems, Yokohama, JapanGoogle Scholar
  14. 14.
    Rangan PV, Vin HM, Ramanathan S (1993) Communication architectures and algorithms for media mixing in multimedia conferences. IEEE/ACM Trans, on Networking, vol 1, no 1Google Scholar
  15. 15.
    Smith BC, Rowe L (1993) Algorithms for manipulating compressed images. IEEE Computer Graphics and Applications, Vol 13, No 5, Sept 1993, pp 34–43Google Scholar
  16. 16.
    Chang SF, Chen WL, Messerschmitt DG (1992) Video compositing in the DCT domain. IEEE Workshop on Visual Signal Processing and Communications, Raleigh, NCGoogle Scholar
  17. 17.
    Chang, SF, Messerschmitt DG (1992) Compositing motioncompensated video within the networks. IEEE 4th Workshop on Multimedia Communications, Monterey, CalifGoogle Scholar
  18. 18.
    Porter T, Duff T (1984) Compositing digital images. Computer Graphics 18(3):253–259Google Scholar
  19. 19.
    Lukacs, M (1992) An advanced digital network video bridge for multipoint with individual customer control. Private communication, Bell Communications Research, NJGoogle Scholar
  20. 20.
    Cypress Semiconductor BiCMOS/CMOS Databook (1993) Commercial and Military Specs., San Jose, CalifGoogle Scholar
  21. 21.
    Salters, RH (1992) Fast DRAMs for sharper TV. IEEE Spectrum 10:40–42Google Scholar
  22. 22.
    Jones, F (1992) A new era of fast dynamic RAMs. IEEE Spectrum 10:43–49Google Scholar
  23. 23.
    Mirsky L, Perfect H (1966) System of representatives. J Math Anal Appl 15:520–568Google Scholar
  24. 24.
    Huizer CM, Baker K, Mehtani R, DeBlock J, Dijkstra H, Hynes PJ, Lammerts JAM, Lecoutere MM, Popp A, van Roermund AHM, Sheridan P, Sluyter RJ, Welten FP (1989) A programmable 1400 MOPS video signal processor. Proceedings of IEEE Custom Integrated Circuits Conference, pp 24.3.1–24.3.4, San Diego, CalifGoogle Scholar
  25. 25.
    Kaufman A, Cohen D, Yagel R (1993) Volume Graphics. IEEE Computer 26(7):51–64Google Scholar
  26. 26.
    Karlsson G, Vetterli M (1990) Packet video and its integration into the network architecture. IEEE J Select Areas Comm 7(5):739–751Google Scholar

Copyright information

© Springer-Verlag 1994

Authors and Affiliations

  1. 1.Department of Electrical Engineering and Computer SciencesUniversity of California at BerkeleyBerkeleyUSA

Personalised recommendations