Advertisement

Synchronization in multimedia documents

  • Peter King
  • Helen Cameron
  • Howard Bowman
  • Simon Thompson
Part III: EP'98 Time Management and Multimedia
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1375)

Abstract

This paper presents a taxonomy of possible synchronization relationships between pairs of items in multimedia documents. Several existing approaches to the synchronization of entire items are reviewed. We then discuss classes of synchronization based upon dynamic events or conditions occurring within media items and their internal structure. We present a taxonomy of seventy-two possible such relations, which are illustrated by numerous examples and which are formalized in the authors' temporal logic notation, Mexitl. The ideas are then applied to provide a description of the lip-synchronization problem.

Keywords

Temporal Logic Video Segment Multimedia Document Multimedia Presentation Media Item 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [All83]
    James F. Allen. Maintaining knowledge about temporal intervals. Communications of the ACM, 26(11), November 1983.Google Scholar
  2. [BBBC94]
    Howard Bowman, Lynne Blair, Gordon S. Blair, and Amanda G. Chetwynd. A formal description technique supporting expression of quality of service and media synchronization. In Multimedia Transport and Teleservices International COST 237 Workshop, {iVienna, Austria}, pages 145–167, November 1994. Appears as Volume 882, Lecture Notes in Computer Science, Springer-Verlag.Google Scholar
  3. [BBBC95]
    Lynne Blair, Gordon Blair, Howard Bowman, and Amanda Chetwynd. Formal specification and verification of multimedia systems in open distributed processing. Computer Standards and Interfaces, 17:413–436, 1995.CrossRefGoogle Scholar
  4. [BCKT97a]
    Howard Bowman, Helen Cameron, Peter King, and Simon Thompson. Mexitl: Multimedia in Executable Interval Temporal Logic. Technical Report 3-97 (Kent), Computing Laboratory, University of Kent, 1997.Google Scholar
  5. [BCKT97b]
    Howard Bowman, Helen Cameron, Peter King, and Simon Thompson. Specification and prototyping of structured multimedia documents using interval temporal logic. In International Conference on Temporal Logic 1997, 1997.Google Scholar
  6. [BZ93]
    M. Cecelia Buchanan and Polle T. Zellweger. Automatic temporal layout mechanisms. In ACM Multimedia 93, pages 341–350, 1993.Google Scholar
  7. [CD96]
    J.-P. Courtiat and R.C. De Oliveira. Proving temporal consistency in a new multimedia synchronization model. In ACM Multimedia 96, pages 141–152, 1996.Google Scholar
  8. [Erf93]
    Robert Erfle. Specification of temporal constraints in multimedia documents using HyTime. Electronic Publishing, 6(4), pages 397–411, December 1993.Google Scholar
  9. [HB95]
    Lynda Hardman and Dick C.A. Bulterman. Authoring support for durable interactive multimedia presentations. In State of The Art Report in Eurographics '95, Maastricht, The Netherlands, 28 August–1 September, pages 119–143, 1995.Google Scholar
  10. [JLSI97]
    Muriel Jourdan and Nabil Layaïda and Loay Sabry-Ismail. Time representation and management in MADEUS: an authoring environment for multimedia documents. In Proceedings of Multimedia Computing and Networking 1997 SPIE 3020, San-Jose, February, 1997.Google Scholar
  11. [KD96]
    Chérif Keramane and Andrzej Duda. Interval expressions — a functional model for interactive dynamic multimedia presentations. In IEEE International Conference on Multimedia Computing Systems (Multimedia '96), June 1996.Google Scholar
  12. [Kin96]
    P.R. King. A logic based formalism for temporal constraints in multimedia documents. In PODP 96, September 1996. Revised version to appear in LNCS, Springer Verlag.Google Scholar
  13. [KS95]
    Michelle Y. Kim and Junehwa Song. Multimedia documents with elastic time. In ACM Multimedia, San Francisco, CA USA, pages 143–154, 1995. Revised version to appear in LNCS, Springer Verlag.Google Scholar
  14. [MHM96]
    Elina Megalou, Thanasis Hadzilacos, and Nikos Mamoulis. Conceptual title abstractions: Modeling and querying very large interactive multimedia repositories. In J.P. Courtiat, M. Diaz, and P. Sénac, editors, Multimedia Modeling: Towards the Information Superhighway, pages 323–338. World Scientific, 1996.Google Scholar
  15. [Reg93]
    T. Regan. Multimedia in temporal LOTOS, a lip synchronisation algorithm. In Proceedings of the 13th International Symposium on Protocol Specification, Testing and Verification (PSTV XIII). Elsevier Science, 1993.Google Scholar
  16. [SHH92]
    J.-B. Stefani, L. Hazard, and F. Horn. Computational model for distributed multimedia applications based on a synchronous programming language. Computer Communications (Special Issue on FDTs), 15(2), March 1992.Google Scholar
  17. [SHT96]
    Timothy K. Shih, Lian-Jinn Hwang, and Jich-Yan Tsai. Formal model of temporal properties underlying multimedia presentations. In J.P. Courtiat, M. Diaz, and P. Sénac, editors, Multimedia Modeling: Towards the Information Superhighway, pages 135–150. World Scientific, 1996.Google Scholar
  18. [WR94]
    Thomas Wahl and Kurt Rothermel. Representing time in multimedia-systems. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems, pages 538–543, 1994.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1998

Authors and Affiliations

  • Peter King
    • 1
  • Helen Cameron
    • 1
  • Howard Bowman
    • 2
  • Simon Thompson
    • 2
  1. 1.Department of Computer ScienceUniversity of ManitobaWinnipegCanada
  2. 2.Computing LaboratoryUniversity of Kent at CanterburyCanterburyUK

Personalised recommendations