User Modeling and User-Adapted Interaction

, Volume 25, Issue 2, pp 155–183 | Cite as

Adapting virtual camera behaviour through player modelling

  • Paolo BurelliEmail author
  • Georgios N. Yannakakis


Research in virtual camera control has focused primarily on finding methods to allow designers to place cameras effectively and efficiently in dynamic and unpredictable environments, and to generate complex and dynamic plans for cinematography in virtual environments. In this article, we propose a novel approach to virtual camera control, which builds upon camera control and player modelling to provide the user with an adaptive point-of-view. To achieve this goal, we propose a methodology to model the player’s preferences on virtual camera movements and we employ the resulting models to tailor the viewpoint movements to the player type and her game-play style. Ultimately, the methodology is applied to a 3D platform game and is evaluated through a controlled experiment; the results suggest that the resulting adaptive cinematographic experience is favoured by some player types and it can generate a positive impact on the game performance.


Virtual camera control Gaze interaction Player modelling  Computer games 


  1. Arijon, D.: Grammar of the Film Language. Silman-James Press, Los Angeles (1991)Google Scholar
  2. Bares, W.H., Lester, J.C.: Cinematographic user models for automated realtime camera control in dynamic 3D environments. In: International Conference on User Modeling, pp. 215–226. Springer, Chia Laguna (1997a)Google Scholar
  3. Bares, W.H., Lester, J.C.: Realtime generation of customized 3D animated explanations for knowledge-based learning environments. In: Conference on Innovative Applications of Artificial Intelligence, pp. 347–354. AAAI Press, Providence (1997b)Google Scholar
  4. Bares, W.H., Zettlemoyer, L.S., Rodriguez, D.W., Lester, J.C.: Task-sensitive cinematography interfaces for interactive 3D learning environments. In: International Conference on Intelligent User Interfaces, pp. 81–88. ACM Press, San Francisco (1998)Google Scholar
  5. Bernhard, M., Stavrakis, E., Wimmer, M.: An empirical pipeline to derive gaze prediction heuristics for 3D action games. ACM Trans. Appl. Percept. 8(1), 4:1–4:30 (2010)CrossRefGoogle Scholar
  6. Blinn, J.: Where am I? What am I looking at? IEEE Comput. Graph. Appl. 8(4), 76–81 (1988)CrossRefGoogle Scholar
  7. Bourne, O., Sattar, A., Goodwin, S.: A constraint-based autonomous 3D camera system. J. Constraints 13(1–2), 180–205 (2008)CrossRefzbMATHGoogle Scholar
  8. Bungie Studios.: Halo: Combat evolved. Microsoft Game Studios (2001)Google Scholar
  9. Burelli, P.: Interactive Virtual Cinematography. Ph.D. thesis, IT University Of Copenhagen (2012)Google Scholar
  10. Burelli, P.: Virtual cinematography in games : investigating the impact on player experience. In: International Conference On The Foundations Of Digital Games, pp. 134–141. Society for the Advancement of the Science of Digital Games, Chania (2013)Google Scholar
  11. Burelli, P., Yannakakis, G.N.: Combining local and global optimisation for virtual camera control. In: IEEE Symposium on Computational Intelligence and Games, pp. 403–410 (2010)Google Scholar
  12. Burelli, P., Yannakakis, G.N.: Towards adaptive virtual camera control in computer games. In: Dickmann, L., Volkmann, G., Malaka, R., Boll, S., Krüger, A., Olivier, P. (eds.) International Symposium on Smart Graphics. Lecture Notes in Computer Science, vol. 6815, pp. 25–36. Springer, Berlin (2011)CrossRefGoogle Scholar
  13. Christianson, D., Anderson, S., He, L.-W., Salesin, D.H., Weld, D., Cohen, M.F.: Declarative camera control for automatic cinematography. In: AAAI, pp. 148–155. AAAI Press, Portland (1996)Google Scholar
  14. Christie, M., Olivier, P., Normand, J.M.: Camera control in computer graphics. In: Computer Graphics Forum, vol. 27, pp. 2197–2218 (2008)Google Scholar
  15. Core Design. : Tomb raider. Eidos Interactive (1996)Google Scholar
  16. Divgi, D.R.: Calculation of the tetrachoric correlation coefficient. Psychometrika 44(2), 169–172 (1979)CrossRefzbMATHGoogle Scholar
  17. Drucker, S.M., Zeltzer, D.: Intelligent camera control in a virtual environment. In: Graphics Interface, pp. 190–199. ACM, Alberta (1994)Google Scholar
  18. El-Nasr, M.S., Yan, S.: Visual attention in 3D video games. In: ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, vol. 31, p. 22. ACM Press, Hollywood (2006)Google Scholar
  19. He, L.-W., Cohen, M.F., Salesin, D.H.: The virtual cinematographer: a paradigm for automatic real-time camera control and directing. In: ACM SIGGRAPH, pp. 217–224. ACM Press, New Orleans (1996)Google Scholar
  20. Irwin, D.E.: Fixation location and fixation duration as indices of cognitive processing. In: The Interface of Language, Vision, and Action: Eye Movements and the Visual World, Chapter 3, pp. 105–133. Psychology Press, New York (2004)Google Scholar
  21. Jhala, A., Young, R.M.: A discourse planning approach to cinematic camera control for narratives in virtual environments. In: AAAI, number July, pp. 307–312. AAAI Press, Pittsburgh (2005)Google Scholar
  22. Kamiya, H.: Devil may cry. Capcom (2001)Google Scholar
  23. Kittler, J.: Feature set search algorithms. In: Chen, C. H. (ed.) Pattern recognition and signal processing, pp. 41–60. Springer,Paris (1978)Google Scholar
  24. Land, M.F.: Vision, eye movements, and natural behavior. Vis. Neurosci. 26(1), 51–62 (2009)CrossRefGoogle Scholar
  25. Lino, C., Christie, M.: Efficient composition for virtual camera control. In: ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 65–70. Eurographics Association, Lausanne (2012)Google Scholar
  26. Mahlmann, T., Drachen, A., Togelius, J., Canossa, A., Yannakakis, G.N.: Predicting player behavior in Tomb Raider: Underworld. In: IEEE Conference on Computational Intelligence and Games, pp. 178–185. IEEE, Copenhagen (2010)Google Scholar
  27. Miyamoto, S.: Mario 64. Nintendo (1996)Google Scholar
  28. Phillips, C.B., Badler, N.I., Granieri, J.: Automatic viewing control for 3D direct manipulation. In: ACM SIGGRAPH Symposium on Interactive 3D graphics, pp. 71–74. ACM Press, Cambridge (1992)Google Scholar
  29. Picardi, A., Burelli, P., Yannakakis, G.N.: Modelling virtual camera behaviour through player gaze. In: International Conference on Foundations of Digital Games, pp. 107–114. ACM Press, Bordeaux (2011)Google Scholar
  30. Pinelle, D., Wong, N., Stach, T.: Heuristic evaluation for games: usability principles for video game design. In: ACM CHI. CHI ’08, pp. 1453–1462. ACM Press, Florence (2008)Google Scholar
  31. Pontriagin, L.S.: Mathematical Theory of Optimal Processes. Interscience Publishers, New York (1962)Google Scholar
  32. Ranon, R., Urli, T.: Improving the efficiency of viewpoint composition. IEEE Trans. Vis. Comput. Graph. 2626(c), 1–1 (2014)Google Scholar
  33. Riedmiller, M., Braun, H.: A direct adaptive method for faster backpropagation learning: the RPROP algorithm. IEEE (1993)Google Scholar
  34. Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning internal representations by error propagation. Nature 323, 533–536 (1986)CrossRefGoogle Scholar
  35. Sundstedt, V., Stavrakis, E., Wimmer, M., Reinhard, E.: A psychophysical study of fixation behavior in a computer game. In: Symposium on Applied Perception in Graphics and Visualization, pp. 43–50. ACM, Los Angeles (2008)Google Scholar
  36. Togelius, J., Kastbjerg, E., Schedl, D., Yannakakis, G.N.: What is procedural content generation? Mario on the borderline. In: International Workshop on Procedural Content Generation in Games, p. 6. Bordeaux, France (2011)Google Scholar
  37. Tomlinson, B., Blumberg, B., Nain, D.: Expressive autonomous cinematography for interactive virtual environments. In: International Conference on Autonomous Agents, p. 317. Barcelona, Spain (2000)Google Scholar
  38. Ware, C., Osborne, S.: Exploration and virtual camera control in virtual three dimensional environments. ACM SIGGRAPH 24(2), 175–183 (1990)CrossRefGoogle Scholar
  39. Wolf, M.J.P.: Genre and the video game. In: Wolf, M.J.P. (ed.) The Medium of the Video Game, chap. 6, pp. 113–134. University of Texas Press, Austin (2001)Google Scholar
  40. Yannakakis, G.N., Hallam, J.: Rating vs. preference: a comparative study of self-reporting. In: Affective Computing and Intelligent Interaction Conference, pp. 437–446. Springer, Memphis (2011)Google Scholar
  41. Yannakakis, G.N., Hallam, J., Lund, H.H.: Entertainment capture through heart rate activity in physical interactive playgrounds. User Model. User-Adap. Inter. 18(1–2), 207–243 (2008)CrossRefGoogle Scholar
  42. Yannakakis, G.N., Martínez, H.P., Jhala, A.: Towards affective camera control in games. User Model. User-Adap. Inter. 20, 313–340 (2010)CrossRefGoogle Scholar
  43. Yarbus, A.L.: Eye Movements and Vision. Plenum press, New York (1967)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2015

Authors and Affiliations

  1. 1.Department of Architecture, Design and Media TechnologyAalborg University CopenhagenCopenhagenDenmark
  2. 2.Institute of Digital GamesUniversity Of MaltaMsidaMalta

Personalised recommendations