Advertisement

Game Cinematography: From Camera Control to Player Emotions

  • Paolo Burelli
Chapter
First Online:
Part of the Socio-Affective Computing book series (SAC, volume 4)

Abstract

Building on the definition of cinematography (Soanes and Stevenson, Oxford dictionary of English. Oxford University Press, Oxford/New York, 2005), game cinematography can be defined as the art of visualizing the content of a computer game. The relationship between game cinematography and its traditional counterpart is extremely tight as, in both cases, the aim of cinematography is to control the viewer’s perspective and affect his or her perception of the events represented. However, game events are not necessarily pre-scripted and player interaction has a major role on the quality of a game experience; therefore, the role of the camera and the challenges connected to it are different in game cinematography as the virtual camera has to both dynamically react to unexpected events to correctly convey the game story and take into consideration player actions and desires to support her interaction with the virtual world. This chapter provides an overview of the evolution of the research in virtual and game cinematography, ranging from its early focus on how to control and animate the virtual camera to support interaction to its relationship with player experience and emotions. Furthermore, we will show and discuss a number of emerging research directions.

Keywords

Computer Game Virtual Environment Camera Movement Virtual Camera Player Interaction 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

References

  1. 1.
    Arijon D (1991) Grammar of the film language. Silman-James Press, Los AngelesGoogle Scholar
  2. 2.
    Bares WH, Lester JC (1997) Cinematographic user models for automated realtime camera control in dynamic 3D environments. In: International conference on user modeling, Chia Laguna. Springer, pp 215–226CrossRefGoogle Scholar
  3. 3.
    Bares WH, McDermott S, Boudreaux C, Thainimit S (2000) Virtual 3D camera composition from frame constraints. In: ACM multimedia, Marina del Rey. ACM, pp 177–186Google Scholar
  4. 4.
    Bares WH, Zettlemoyer LS, Rodriguez DW, Lester JC (1998) Task-sensitive cinematography interfaces for interactive 3D learning environments. In: International conference on intelligent user interfaces, San Francisco. ACM, pp 81–88Google Scholar
  5. 5.
    Beckhaus S, Ritter F, Strothotte T (2000) CubicalPath – dynamic potential fields for guided exploration in virtual environments. In: Pacific conference on computer graphics and applications, Hong Kong, pp 387–459Google Scholar
  6. 6.
    Bleszinski C (2007) Gears of WarGoogle Scholar
  7. 7.
    Blinn J (1988) Where am I? What am I looking at? IEEE Comput Graph Appl 8(4):76–81CrossRefGoogle Scholar
  8. 8.
    Blizzard Entertainment (1998) StarcraftGoogle Scholar
  9. 9.
    Blizzard Entertainment (2004) World of warcraftGoogle Scholar
  10. 10.
    Bourne O, Sattar A, Goodwin S (2008) A constraint-based autonomous 3D camera system. J Constraints 13(1–2):180–205CrossRefGoogle Scholar
  11. 11.
    Bungie Studios (2001) Halo: combat evolvedGoogle Scholar
  12. 12.
    Burelli P (2013) Virtual cinematography in games: investigating the impact on player experience. In: International conference on the foundations of digital games, Chania. Society for the Advancement of the Science of Digital Games, pp 134–141Google Scholar
  13. 13.
    Burelli P, Di Gaspero L, Ermetici A, Ranon R (2008) Virtual camera composition with particle swarm optimization. In: Butz A, Fisher B, Krüger A, Olivier P, Christie M (eds) International symposium on smart graphics. Volume 5166 of lecture notes in computer science. Springer, Berlin/Heidelberg, pp 130–141Google Scholar
  14. 14.
    Burelli P, Jhala A (2009) Dynamic artificial potential fields for autonomous camera control. In: AAAI conference on artificial intelligence in interactive digitale entertainment conference, Palo Alto. AAAIGoogle Scholar
  15. 15.
    Burelli P, Yannakakis GN (2010) Global search for occlusion minimisation in virtual camera control. In: IEEE congress on evolutionary computation, Barcelona. IEEE, pp 1–8CrossRefGoogle Scholar
  16. 16.
    Burelli P, Yannakakis GN (2011) Towards adaptive virtual camera control in computer games. In: Dickmann L, Volkmann G, Malaka R, Boll S, Krüger A, Olivier P (eds) International symposium on smart graphics, Bremen. Volume 6815 of lecture notes in computer science. Springer, Berlin/Heidelberg, pp 25–36Google Scholar
  17. 17.
    Burelli P, Yannakakis GN (2015) Adaptive virtual camera control trough player modelling. User Model User-Adapt InteractGoogle Scholar
  18. 18.
    Cage D (2010) Heavy rainGoogle Scholar
  19. 19.
    Charles F, Lugrin J-l, Cavazza M, Mead SJ (2002) Real-time camera control for interactive storytelling. In: International conference for intelligent games and simulations, London, pp 1–4Google Scholar
  20. 20.
    Chrisley R (2003) Embodied artificial intelligence. Artif Intell 149(1):131–150CrossRefGoogle Scholar
  21. 21.
    Christianson D, Anderson S, He L-w, Salesin DH, Weld D, Cohen MF (1996) Declarative camera control for automatic cinematography. In: AAAI, Portland. AAAI Press, pp 148–155Google Scholar
  22. 22.
    Christie M, Normand J-M, Olivier P (2012) Occlusion-free camera control for multiple targets. In: ACM SIGGRAPH/Eurographics symposium on computer animation. Eurographics Association, pp 59–64Google Scholar
  23. 23.
    Christie M, Olivier P, Normand JM (2008) Camera control in computer graphics. In: Computer graphics forum, vol 27, pp 2197–2218Google Scholar
  24. 24.
    Core Design (1996) Tomb RaiderGoogle Scholar
  25. 25.
    Dominguez M, Young RM, Roller S (2011) Design and evaluation of afterthought, a system that automatically creates highlight cinematics for 3D games. In: AAAI conference on artificial intelligence in interactive digitale entertainmentGoogle Scholar
  26. 26.
    Eco U (1984) Semiotics and the philosophy of language. Indiana University Press, BloomingtonCrossRefGoogle Scholar
  27. 27.
    El-Nasr MS (2002) Story visualization techniques for interactive drama. In: AAAI spring symposium, pp 23–28Google Scholar
  28. 28.
    Enticknap L (2005) Moving image technology: from zoetrope to digital. Wallflower Press, LondonGoogle Scholar
  29. 29.
    Frazier SJ, Riedl MO (2014) Toward using games and artificial intelligence to proactively sense the real world. In: AI & GAME symposium, London. AISBGoogle Scholar
  30. 30.
    Haigh-Hutchinson M (2009) Real-time cameras. ElsevierGoogle Scholar
  31. 31.
    Halper N, Helbing R, Strothotte T (2001) A camera engine for computer games: managing the trade-off between constraint satisfaction and frame coherence. Comput Graph Forum 20(3):174–183CrossRefGoogle Scholar
  32. 32.
    Hamaide J (2008) A versatile constraint-based camera system. In: AI game programming wisdom 4, pp 467–477Google Scholar
  33. 33.
    Hanjalic A, Xu LQ (2005) Affective video content representation and modeling. IEEE Trans Multimed 7(1):143–154CrossRefGoogle Scholar
  34. 34.
    He L-w, Cohen MF, Salesin DH (1996) The virtual cinematographer: a paradigm for automatic real-time camera control and directing. In ACM SIGGRAPH, New Orleans. ACM, pp 217–224Google Scholar
  35. 35.
    He ZHZ, Iyer R, Chandler P (2006) Vision-based UAV flight control and obstacle avoidance. In: American control conference, Minneapolis. IEEE, pp 2166–2170Google Scholar
  36. 36.
    Id Software (1993) DoomGoogle Scholar
  37. 37.
    Irwin DE (2004) Fixation location and fixation duration as indices of cognitive processing (chapter 3). In: Henderson JM, Ferreira F (eds) The interface of language, vision, and action: eye movements and the visual world. Psychology Press, New York, pp 105–133Google Scholar
  38. 38.
    Jhala A, Young RM (2005) A discourse planning approach to cinematic camera control for narratives in virtual environments. In: AAAI, Pittsburgh, number July. AAAI, pp 307–312Google Scholar
  39. 39.
    Jhala A, Young RM (2010) Cinematic visual discourse: representation, generation, and evaluation. IEEE Trans Comput Intell AI Games 2(2):69–81CrossRefGoogle Scholar
  40. 40.
    Kamiya H (2001) Devil may cryGoogle Scholar
  41. 41.
    Kojima H (1998) Metal gear solidGoogle Scholar
  42. 42.
    Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, Lake Tahoe. Neural Information Processing Systems Foundation, pp 1097–1105Google Scholar
  43. 43.
    Lasseter J (1995) Toy storyGoogle Scholar
  44. 44.
    Liapis A, Yannakakis GN, Togelius J (2012) Adapting models of visual aesthetics for personalized content creation. IEEE Trans Comput Intell AI Games 4(3):213–228CrossRefGoogle Scholar
  45. 45.
    Lino C, Christie M, Lamarche F, Schofield G, Olivier P (2010) A real-time cinematography system for interactive 3D environments. In: ACM SIGGRAPH/Eurographics symposium on computer animation, pp 139–148Google Scholar
  46. 46.
    Martinez HP, Jhala A, Yannakakis GN (2009) Analyzing the impact of camera viewpoint on player psychophysiology. In: International conference on affective computing and intelligent interaction and workshops. IEEE, pp 1–6Google Scholar
  47. 47.
    McDermott S, Li J, Bares WH (2002) Storyboard frame editing for cinematic composition. In: International conference on intelligent user interfaces, San Francisco. ACM, pp 206–207Google Scholar
  48. 48.
    Meier L, Tanskanen P, Heng L, Lee GH, Fraundorfer F, Pollefeys M (2012) PIXHAWK: a micro aerial vehicle design for autonomous flight using onboard computer vision. Auton Robot 33:21–39CrossRefGoogle Scholar
  49. 49.
    Mikami S (1996) Resident evilGoogle Scholar
  50. 50.
    Olivier P, Halper N, Pickering J, Luna P (1999) Visual composition as optimisation. In: Artificial intelligence and simulation of behaviourGoogle Scholar
  51. 51.
    Picardi A, Burelli P, Yannakakis GN (2011) Modelling virtual camera behaviour through player gaze. In: International conference on foundations of digital games, Bordeaux. ACM, pp 107–114Google Scholar
  52. 52.
    Pickering J (2002) Intelligent camera planning for computer graphics. PhD thesis, University of YorkGoogle Scholar
  53. 53.
    Ranon R, Urli T (2014) Improving the efficiency of viewpoint composition. IEEE Trans Vis Comput Graph 2626(c):1–1Google Scholar
  54. 54.
    Raynal F (1992) Alone in the darkGoogle Scholar
  55. 55.
    Remedy Entertainment (2001) Max PayneGoogle Scholar
  56. 56.
    Shaker N, Yannakakis GN, Togelius J (2010) Towards automatic personalized content generation for platform games. In: AAAI conference on artificial intelligence in interactive digitale entertainmentGoogle Scholar
  57. 57.
    Simons RF, Detenber BH, Roedema TM, Reiss JE (1999) Emotion processing in three systems: the medium and the message. Psychophysiology 36(5):619–627CrossRefPubMedGoogle Scholar
  58. 58.
    Soanes C, Stevenson A (2005) Oxford dictionary of English. Oxford University Press, Oxford/New YorkGoogle Scholar
  59. 59.
    Sun K, Yu J (2007) Video affective content representation and recognition using video affective tree and hidden Markov models. In: Paiva A, Prada R, Picard R (eds) Affective computing and intelligent interaction, Lisbon. Springer, pp 594–605CrossRefGoogle Scholar
  60. 60.
    Sundstedt V, Stavrakis E, Wimmer M, Reinhard E (2008) A psychophysical study of fixation behavior in a computer game. In: Symposium on applied perception in graphics and visualization, Los Angeles. ACM, pp 43–50CrossRefGoogle Scholar
  61. 61.
    Thawonmas R, Oda K, Shuda T (2010) Rule-based camerawork controller for automatic comic generation from game log. In: IFIP international conference on entertainment computing, Seoul, pp 326–333Google Scholar
  62. 62.
    Thorson E (1994) Using eyes on screen as a measure of attention to television. In: Lang A (ed) Measuring psychological responses to media messages. Routledge, New YorkGoogle Scholar
  63. 63.
    Togelius J, Champandard AJ, Lanzi PL, Mateas M, Paiva A, Preuss M, Stanley KO (2013) Procedural content generation: goals, challenges and actionable steps. In: Artificial and computational intelligence in games, vol 6, pp 61–75Google Scholar
  64. 64.
    Tomlinson B, Blumberg B, Nain D (2000) Expressive autonomous cinematography for interactive virtual environments. In: International conference on autonomous agents, Barcelona, p 317Google Scholar
  65. 65.
    Toyama K (1999) Silent HillGoogle Scholar
  66. 66.
    Ware C, Osborne S (1990) Exploration and virtual camera control in virtual three dimensional environments. ACM SIGGRAPH 24(2):175–183CrossRefGoogle Scholar
  67. 67.
    Yannakakis GN, Martínez HP, Jhala A (2010) Towards affective camera control in games. User Model User-Adapt Interact 20:313–340CrossRefGoogle Scholar
  68. 68.
    Yannakakis GN, Togelius J (2011) Experience-driven procedural content generation. IEEE Trans Affect Comput 2:147–161CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Aalborg UniversityKøbenhavnDenmark

Personalised recommendations

Cite chapter

Buy options