Multimedia Tools and Applications

, Volume 11, Issue 3, pp 311–331 | Cite as

Multimedia Montage—Counterpoint Synthesis of Movies

  • Ryotaro Suzuki
  • Yuichi Iwadate
  • Ryohei Nakatsu
  • Michihiko Mihoh


In this paper, we propose “Multimedia Montage”, which is the structural synthesis in time and space of multimedia components, such as movies and sounds, as a new image expression method for communications. In this study, we introduce the counterpoint theory in music to compose movie structures, and we use scripts to describe the structures. The nature of counterpoints lies in the parallelism of autonomous elements and they fit today's multimedia technologies very well. We confirm the effectiveness of our method by making example movies based on the counterpoint theory, developing a prototype system, and conducting movie synthesis experiments using the prototype. Our next goal is to achieve automatic synchronization among multimedia components based on their internal rhythms, which we have observed in experiments.

multimedia languages multimedia authoring tools art and multimedia 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    P. Ackermann, Developing Object-Oriented Multimedia Software-Based on the MET++ Application Framework, dpunkt Verlag, 1996.Google Scholar
  2. 2.
    Apple Computer Inc., QuickTime3 Reference, Apple Computer Inc., 1998.Google Scholar
  3. 3.
    S. Beckett, Quad, Curtis brown Ltd., 1984.Google Scholar
  4. 4.
    S.M. Eisenstein, The Works of Sergei Eisenstein Part 2, Kinema-Junposha Inc., 1980-1993.Google Scholar
  5. 5.
    S. Gibbs, “Composite multimedia and active objects,” in Proc. OOPSLA'91, 1991, pp. 97-112.Google Scholar
  6. 6.
    B.S. Greenberg, Johann Sebastian Bach FAQ, USENET Newsgroup,, 1996-1997.Google Scholar
  7. 7.
    G. Guertin (Ed.), Glenn Gould Pluriel, Verdun, Quebec: Louise Courteau, editrice inc, 1988.Google Scholar
  8. 8.
    ISO/IEC 14772-1, The Virtual Reality Modeling Language, ISO, 1998.Google Scholar
  9. 9.
    ISO/IEC 14478, Presentation Environments for Multimedia Objects (PREMO), ISO, 1998.Google Scholar
  10. 10.
    H. Lieberman, “Using prototypical objects to implement shared behavior in object oriented systems,” in Proc. OOPSLA'86, 1986, pp. 214-223.Google Scholar
  11. 11.
    J.J. Nattiez, Musicologie generale et emiologie, Christian Bourgois Editeur, 1987.Google Scholar
  12. 12.
    F.M. Naumann, New York Dada 1915-23, Harry N. Abrams Inc., 1994.Google Scholar
  13. 13.
    T. Page (Ed.), The Glenn Gould Reader, Vintage Books, 1990.Google Scholar
  14. 14.
    F.D. Peat, Synchronicity, Bantam Books Inc., 1987.Google Scholar
  15. 15.
    K.H. Pribram, Languages of the Brain, Prentice-Hall Inc., 1971.Google Scholar
  16. 16.
    R. Suzuki and S. Inoue, “Dance Canonica” in The 6th ACM International Multimedia Conference-Art Demos-Technical Demos-Poster Papers, 1998, p. 37.Google Scholar
  17. 17.
    R. Suzuki and Y. Iwadate, “Multimedia Montage-Counterpoint synthesis of movies,” in Proc. IEEE Multimedia Systems '99, 1999, Vol. 1, pp. 433–438.Google Scholar
  18. 18.
    R. Suzuki and Y. Iwadate, “INVENTION-A study of counterpoint structure description,” in Proc. IEEE Symposium on Visual Languages '99, 1999. Poster papers.Google Scholar
  19. 19.
    R. Suzuki, Y. Iwadate, and M. Minoh, “Image wave-A study on image synchronization,” in The 7th ACM International Multimedia Conference, 1999. Poster papers.Google Scholar
  20. 20.
    J. Wernecke, The Inventor Mentor, Addison-Wesley Publishing Co., 1994.Google Scholar
  21. 21.
    W3C, Synchronized Multimedia Integration Language (SMIL) 1.0 Specification, W3C, 1998.Google Scholar

Copyright information

© Kluwer Academic Publishers 2000

Authors and Affiliations

  • Ryotaro Suzuki
    • 1
  • Yuichi Iwadate
    • 2
  • Ryohei Nakatsu
    • 3
  • Michihiko Mihoh
    • 4
  1. 1.ATR Media Integration & Communications Research Laboratories, Seika-cho, Soraku-gunKyoto-fuJapan
  2. 2.ATR Media Integration & Communications Research Laboratories, Seika-cho, Soraku-gunKyoto-fuJapan
  3. 3.ATR Media Integration & Communications Research Laboratories, Seika-cho, Soraku-gunKyoto-fuJapan
  4. 4.Center for Information and Multimedia StudiesKyoto University, Yoshidahonmachi, Sakyo-ku, Kyoto-shiKyoto-fuJapan

Personalised recommendations