Abstract
Building on the definition of cinematography (Soanes and Stevenson, Oxford dictionary of English. Oxford University Press, Oxford/New York, 2005), game cinematography can be defined as the art of visualizing the content of a computer game. The relationship between game cinematography and its traditional counterpart is extremely tight as, in both cases, the aim of cinematography is to control the viewer’s perspective and affect his or her perception of the events represented. However, game events are not necessarily pre-scripted and player interaction has a major role on the quality of a game experience; therefore, the role of the camera and the challenges connected to it are different in game cinematography as the virtual camera has to both dynamically react to unexpected events to correctly convey the game story and take into consideration player actions and desires to support her interaction with the virtual world. This chapter provides an overview of the evolution of the research in virtual and game cinematography, ranging from its early focus on how to control and animate the virtual camera to support interaction to its relationship with player experience and emotions. Furthermore, we will show and discuss a number of emerging research directions.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Arijon D (1991) Grammar of the film language. Silman-James Press, Los Angeles
Bares WH, Lester JC (1997) Cinematographic user models for automated realtime camera control in dynamic 3D environments. In: International conference on user modeling, Chia Laguna. Springer, pp 215–226
Bares WH, McDermott S, Boudreaux C, Thainimit S (2000) Virtual 3D camera composition from frame constraints. In: ACM multimedia, Marina del Rey. ACM, pp 177–186
Bares WH, Zettlemoyer LS, Rodriguez DW, Lester JC (1998) Task-sensitive cinematography interfaces for interactive 3D learning environments. In: International conference on intelligent user interfaces, San Francisco. ACM, pp 81–88
Beckhaus S, Ritter F, Strothotte T (2000) CubicalPath – dynamic potential fields for guided exploration in virtual environments. In: Pacific conference on computer graphics and applications, Hong Kong, pp 387–459
Bleszinski C (2007) Gears of War
Blinn J (1988) Where am I? What am I looking at? IEEE Comput Graph Appl 8(4):76–81
Blizzard Entertainment (1998) Starcraft
Blizzard Entertainment (2004) World of warcraft
Bourne O, Sattar A, Goodwin S (2008) A constraint-based autonomous 3D camera system. J Constraints 13(1–2):180–205
Bungie Studios (2001) Halo: combat evolved
Burelli P (2013) Virtual cinematography in games: investigating the impact on player experience. In: International conference on the foundations of digital games, Chania. Society for the Advancement of the Science of Digital Games, pp 134–141
Burelli P, Di Gaspero L, Ermetici A, Ranon R (2008) Virtual camera composition with particle swarm optimization. In: Butz A, Fisher B, Krüger A, Olivier P, Christie M (eds) International symposium on smart graphics. Volume 5166 of lecture notes in computer science. Springer, Berlin/Heidelberg, pp 130–141
Burelli P, Jhala A (2009) Dynamic artificial potential fields for autonomous camera control. In: AAAI conference on artificial intelligence in interactive digitale entertainment conference, Palo Alto. AAAI
Burelli P, Yannakakis GN (2010) Global search for occlusion minimisation in virtual camera control. In: IEEE congress on evolutionary computation, Barcelona. IEEE, pp 1–8
Burelli P, Yannakakis GN (2011) Towards adaptive virtual camera control in computer games. In: Dickmann L, Volkmann G, Malaka R, Boll S, Krüger A, Olivier P (eds) International symposium on smart graphics, Bremen. Volume 6815 of lecture notes in computer science. Springer, Berlin/Heidelberg, pp 25–36
Burelli P, Yannakakis GN (2015) Adaptive virtual camera control trough player modelling. User Model User-Adapt Interact
Cage D (2010) Heavy rain
Charles F, Lugrin J-l, Cavazza M, Mead SJ (2002) Real-time camera control for interactive storytelling. In: International conference for intelligent games and simulations, London, pp 1–4
Chrisley R (2003) Embodied artificial intelligence. Artif Intell 149(1):131–150
Christianson D, Anderson S, He L-w, Salesin DH, Weld D, Cohen MF (1996) Declarative camera control for automatic cinematography. In: AAAI, Portland. AAAI Press, pp 148–155
Christie M, Normand J-M, Olivier P (2012) Occlusion-free camera control for multiple targets. In: ACM SIGGRAPH/Eurographics symposium on computer animation. Eurographics Association, pp 59–64
Christie M, Olivier P, Normand JM (2008) Camera control in computer graphics. In: Computer graphics forum, vol 27, pp 2197–2218
Core Design (1996) Tomb Raider
Dominguez M, Young RM, Roller S (2011) Design and evaluation of afterthought, a system that automatically creates highlight cinematics for 3D games. In: AAAI conference on artificial intelligence in interactive digitale entertainment
Eco U (1984) Semiotics and the philosophy of language. Indiana University Press, Bloomington
El-Nasr MS (2002) Story visualization techniques for interactive drama. In: AAAI spring symposium, pp 23–28
Enticknap L (2005) Moving image technology: from zoetrope to digital. Wallflower Press, London
Frazier SJ, Riedl MO (2014) Toward using games and artificial intelligence to proactively sense the real world. In: AI & GAME symposium, London. AISB
Haigh-Hutchinson M (2009) Real-time cameras. Elsevier
Halper N, Helbing R, Strothotte T (2001) A camera engine for computer games: managing the trade-off between constraint satisfaction and frame coherence. Comput Graph Forum 20(3):174–183
Hamaide J (2008) A versatile constraint-based camera system. In: AI game programming wisdom 4, pp 467–477
Hanjalic A, Xu LQ (2005) Affective video content representation and modeling. IEEE Trans Multimed 7(1):143–154
He L-w, Cohen MF, Salesin DH (1996) The virtual cinematographer: a paradigm for automatic real-time camera control and directing. In ACM SIGGRAPH, New Orleans. ACM, pp 217–224
He ZHZ, Iyer R, Chandler P (2006) Vision-based UAV flight control and obstacle avoidance. In: American control conference, Minneapolis. IEEE, pp 2166–2170
Id Software (1993) Doom
Irwin DE (2004) Fixation location and fixation duration as indices of cognitive processing (chapter 3). In: Henderson JM, Ferreira F (eds) The interface of language, vision, and action: eye movements and the visual world. Psychology Press, New York, pp 105–133
Jhala A, Young RM (2005) A discourse planning approach to cinematic camera control for narratives in virtual environments. In: AAAI, Pittsburgh, number July. AAAI, pp 307–312
Jhala A, Young RM (2010) Cinematic visual discourse: representation, generation, and evaluation. IEEE Trans Comput Intell AI Games 2(2):69–81
Kamiya H (2001) Devil may cry
Kojima H (1998) Metal gear solid
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, Lake Tahoe. Neural Information Processing Systems Foundation, pp 1097–1105
Lasseter J (1995) Toy story
Liapis A, Yannakakis GN, Togelius J (2012) Adapting models of visual aesthetics for personalized content creation. IEEE Trans Comput Intell AI Games 4(3):213–228
Lino C, Christie M, Lamarche F, Schofield G, Olivier P (2010) A real-time cinematography system for interactive 3D environments. In: ACM SIGGRAPH/Eurographics symposium on computer animation, pp 139–148
Martinez HP, Jhala A, Yannakakis GN (2009) Analyzing the impact of camera viewpoint on player psychophysiology. In: International conference on affective computing and intelligent interaction and workshops. IEEE, pp 1–6
McDermott S, Li J, Bares WH (2002) Storyboard frame editing for cinematic composition. In: International conference on intelligent user interfaces, San Francisco. ACM, pp 206–207
Meier L, Tanskanen P, Heng L, Lee GH, Fraundorfer F, Pollefeys M (2012) PIXHAWK: a micro aerial vehicle design for autonomous flight using onboard computer vision. Auton Robot 33:21–39
Mikami S (1996) Resident evil
Olivier P, Halper N, Pickering J, Luna P (1999) Visual composition as optimisation. In: Artificial intelligence and simulation of behaviour
Picardi A, Burelli P, Yannakakis GN (2011) Modelling virtual camera behaviour through player gaze. In: International conference on foundations of digital games, Bordeaux. ACM, pp 107–114
Pickering J (2002) Intelligent camera planning for computer graphics. PhD thesis, University of York
Ranon R, Urli T (2014) Improving the efficiency of viewpoint composition. IEEE Trans Vis Comput Graph 2626(c):1–1
Raynal F (1992) Alone in the dark
Remedy Entertainment (2001) Max Payne
Shaker N, Yannakakis GN, Togelius J (2010) Towards automatic personalized content generation for platform games. In: AAAI conference on artificial intelligence in interactive digitale entertainment
Simons RF, Detenber BH, Roedema TM, Reiss JE (1999) Emotion processing in three systems: the medium and the message. Psychophysiology 36(5):619–627
Soanes C, Stevenson A (2005) Oxford dictionary of English. Oxford University Press, Oxford/New York
Sun K, Yu J (2007) Video affective content representation and recognition using video affective tree and hidden Markov models. In: Paiva A, Prada R, Picard R (eds) Affective computing and intelligent interaction, Lisbon. Springer, pp 594–605
Sundstedt V, Stavrakis E, Wimmer M, Reinhard E (2008) A psychophysical study of fixation behavior in a computer game. In: Symposium on applied perception in graphics and visualization, Los Angeles. ACM, pp 43–50
Thawonmas R, Oda K, Shuda T (2010) Rule-based camerawork controller for automatic comic generation from game log. In: IFIP international conference on entertainment computing, Seoul, pp 326–333
Thorson E (1994) Using eyes on screen as a measure of attention to television. In: Lang A (ed) Measuring psychological responses to media messages. Routledge, New York
Togelius J, Champandard AJ, Lanzi PL, Mateas M, Paiva A, Preuss M, Stanley KO (2013) Procedural content generation: goals, challenges and actionable steps. In: Artificial and computational intelligence in games, vol 6, pp 61–75
Tomlinson B, Blumberg B, Nain D (2000) Expressive autonomous cinematography for interactive virtual environments. In: International conference on autonomous agents, Barcelona, p 317
Toyama K (1999) Silent Hill
Ware C, Osborne S (1990) Exploration and virtual camera control in virtual three dimensional environments. ACM SIGGRAPH 24(2):175–183
Yannakakis GN, Martínez HP, Jhala A (2010) Towards affective camera control in games. User Model User-Adapt Interact 20:313–340
Yannakakis GN, Togelius J (2011) Experience-driven procedural content generation. IEEE Trans Affect Comput 2:147–161
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Burelli, P. (2016). Game Cinematography: From Camera Control to Player Emotions. In: Karpouzis, K., Yannakakis, G. (eds) Emotion in Games. Socio-Affective Computing, vol 4. Springer, Cham. https://doi.org/10.1007/978-3-319-41316-7_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-41316-7_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41314-3
Online ISBN: 978-3-319-41316-7
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)