Advertisement

Poetry of Separation: The Aesthetics of Spatial Montage and Generative Editing for Multi-layered Screens

  • So Jung Bahng
  • Doo Won Yoo
  • Patrick Hutchings
  • Chung Kon Shi
  • Graham WakefieldEmail author
Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 145)

Abstract

Poetry of Separation’ is a media artwork that utilizes an algorithmic generative editing system, selecting shots in real-time to be rendered over four screens arranged in layers. Editing in cinema reconstructs images by montage, deriving meaning from the juxtaposition of multiple shots. Although multi-screen projections have been used to present sectional montages that stress the simultaneity of events, spatially separated screens can disrupt attentiveness and affective involvement; the layered architecture avoids disruptive fragmentation. The generative editing system selects shots for the layered screens stochastically, with authorial constraints and probabilities using pre-determined shot criteria. Narrative flow and authorial intents are not damaged due to these criteria, but nevertheless unexpected effects arose from the stochastic system. The authorial intentions of improvisation and separation in the film content of ‘Poetry of Separations’ find resonance with the automatism of the generative editing system and multi-dimensionality of the screens.

Keywords

Generative montage Generative cinema Spatial montage Complexity editing Multi-layered screens Database cinema New media art 

Notes

Acknowledgments

We would like to express our great appreciations to all the contributing artists: performers Kyung Hwang, Tae Geon Lee, Jongook Wang, visual supervisor Kyung Suk Park, art and music director Sae On Im, cinematographer Won Suk Choi, assistant director Hyo Kyung Noh, jimmy jib operator Ju Cheon Moon, production managers Hyo Jin Sin, Hye Jin Kim, Hyn Jin Oh. We would also like to extend our thanks to Prof. Jin Hee Kim and Prof. Yi Kyung Kim and Rooni Lee who provided insights and improvement for this research.

References

  1. 1.
    Zettl, H.: Sight, Sound, Motion: Applied Media Aesthetics. Cengage Learning, USA (2013)Google Scholar
  2. 2.
    Orpen, V.: Film Editing: The Art of the Expressive, vol. 16. Wallflower Press, UK (2003)Google Scholar
  3. 3.
    Marchessault, J., Lord, S.: Multi-screens and future cinema: the labyrinth project at Expo 67. In: Marchessault, J., Lord, S. (eds.) Fluid Screens Expanded Cinema, pp. 29–51. University of Toronto Press, UK (2007)Google Scholar
  4. 4.
    Boden, M.A., Edmonds, E.A.: What is generative art? Digital Creativity 20(1–2), 21–46 (2009)CrossRefGoogle Scholar
  5. 5.
    Lobb, I.: Generative Cinema and Dialogue. University of Plymouth (2003)Google Scholar
  6. 6.
    Eisenstein, S.: A dialectic approach to film form. In: Leyda, J. (ed.) Film Form: Essays in Film Theory, pp. 45–63. Harcourt Inc, San Diego (1977)Google Scholar
  7. 7.
    Eisenstein, S., Gerould, D.: Montage of attractions: for enough stupidity in every wiseman. The Drama Review: TDR 18, 77–85 (1974)CrossRefGoogle Scholar
  8. 8.
    Bordwell, D.: The idea of montage in Soviet art and film. Cine. J. 11(2), 9–17 (1972)CrossRefGoogle Scholar
  9. 9.
    Trifonova, T.: A nonhuman eye: deleuze on cinema. SubStance 33(2), 134–152 (2004)CrossRefGoogle Scholar
  10. 10.
    Deleuze, G.: Cinema 2: The Time-Image (trans: Tomlinson, H., Galeta, R.), p. 77. University of Minnesota Press, Minneapolis (1989) Google Scholar
  11. 11.
    Bubb, J.: Back to the future: multi-image screen narrative in a digital age. J. Media Pract. 13(1), 45–60 (2012)CrossRefGoogle Scholar
  12. 12.
    Perrin, D.G.: A theory of multiple-image communication. Education Tech. Research Dev. 17(4), 368–382 (1969)Google Scholar
  13. 13.
    Manovich, L.: The language of new media. MIT press, Cambridge (2001)Google Scholar
  14. 14.
    Suzuki, R., Iwadate, Y., Nakatsu, R., Mihoh, M.: Multimedia Montage—Counterpoint synthesis of movies. Multimedia Tools Appl. 11(3), 311–331 (2000)zbMATHCrossRefGoogle Scholar
  15. 15.
    Bizzocchi, J.: The fragmented frame: the poetics of the split-screen. la Web del Massachusets Intiture of Technology (2009). http://web.mit.edu/commforum/mit6/papers/Bizzocchi.pdf
  16. 16.
    Dorin, A.: Chance and complexity: stochastic and generative processes in art and creativity. In: Proceedings of the Virtual Reality International Conference: Laval Virtual, p. 19. ACM (2013)Google Scholar
  17. 17.
    Leggett, M.: Generative systems and the cinematic spaces of film and installation art. Leonardo 40(2), 123–128 (2007)MathSciNetCrossRefGoogle Scholar
  18. 18.
    Manovich, L., Kratky, A.: Soft Cinema Navigating the Database. DVD & Booklet. MIT press, Cambridge (2005)Google Scholar
  19. 19.
    Alain, L.: Galatema: A Framework for Generative Cinema. GA2010 – XIII Generative Art Conference – Politecnico di Milano University, Italy (2010)Google Scholar
  20. 20.
    Jasinschi, R.S., Moura, J.M.F.: Nonlinear editing by generative video. In: 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP-1996, vol. 2, pp. 1220-1223. IEEE (1996)Google Scholar
  21. 21.
    Petrovic, N., Ivanovic, A., Jojic, N.: Recursive estimation of generative models of video. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 79-86. IEEE (2006)Google Scholar
  22. 22.
    Carter, C.L.: Improvisation in dance. J. Aesthet. Art Criticism 58, 181–190 (2000)CrossRefGoogle Scholar
  23. 23.
    Riedl, M.O.: Incorporating authorial intent into generative narrative systems. In: AAAI Spring Symposium: Intelligent Narrative Technologies II, pp. 91-94 (2009)Google Scholar
  24. 24.
    Hosale, M.D.: Nonlinear media as interactive narrative. University of California at Santa Barbara (2008)Google Scholar
  25. 25.
    Deren, M., Miller, A., Thomas, D., Tyler, P.: Poetry and the film: a symposium. Film Culture 29, 55–63 (1963)Google Scholar

Copyright information

© Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2015

Authors and Affiliations

  • So Jung Bahng
    • 1
  • Doo Won Yoo
    • 1
  • Patrick Hutchings
    • 1
  • Chung Kon Shi
    • 1
  • Graham Wakefield
    • 1
    Email author
  1. 1.Graduate School of Culture TechnologyKAISTDaejeonKorea

Personalised recommendations