This paper describes a study that examines the impact that procedurally generated content has on the quality of gaming experience. To that end, an experimental study has been undertaken where gamers play two versions of an otherwise identical game, the only difference being that in one version the game levels are designed by a human designer and in the second version they are procedurally generated. A game immersion questionnaire is used to capture the quality of the gameplay experience and the results across the two groups compared. Whilst there are observable differences in perceived total immersion, statistical analysis using one way ANOVA testing suggests that the difference is not statistically significant. Detailed analysis of the questionnaire responses identifies where variation between the two groups is statistically significant.
This is a preview of subscription content,to check access.
Access this article
Arsenault, D. & Perron, B. In the frame of the magic cycle: The circle(s) of gameplay. In: B. Perron & M. J. P. Wolf (Eds.) The video game theory reader 2. New York: Routledge.
Ashlock, D., Lee, C., & McGuinness, C. (2011). Search-based procedural generation of maze-like levels. IEEE Transactions on Computational Intelligence and AI in Games, 3, 260–273.
Barreto, N., Cardoso, A., & Roque, L. (2014). Computational creativity in procedural content generation: A state of the art survey. In Proceedings of the 2014 conference of science and art of video games.
Bentley, P. J., & Wakefield, J. P. (1998). Finding acceptable solutions in the pareto-optimal range using multiobjective genetic algorithms. Soft computing in engineering design and manufacturing. London: Springer.
Blow, J. (2004). Game development: Harder than you think. Queue, 1, 28–37.
Bourke, P. & Shier, J. (2013). Space filling: A new algorithm for procedural creation of game assets. In Proceedings of the 5th annual international conference on computer games multimedia & allied technology.
Brown, E. & Cairns, P. (2004). A grounded investigation of game immersion. CHI’04 extended abstracts on human factors in computing systems. ACM (pp. 1297–1300).
Call, J., Whitlock, K., & Voorhees, G. (2012). From dungeons to digital denizens. Dungeons, dragons, and digital denizens: The digital role-playing game. New York: Continuum.
Cardamone, L., Loiacono, D., & Lanzi, P. L. (2011). Interactive evolution for the procedural generation of tracks in a high-end racing game. In Proceedings of the 13th annual conference on genetic and evolutionary computation. Dublin, Ireland: ACM.
Connor, A. M., Clarkson, P. J., Shapar, S., & Leonard, P. (2000). Engineering design optimization using Tabu search. In Design for excellence: Engineering design conference 2000. Wiley (pp. 371–378).
Denisova, A. & Cairns, P. (2015). The placebo effect in digital games: Phantom perception of adaptive artificial intelligence. In Proceedings of the 2015 annual symposium on computer–human interaction in play. ACM (pp. 23–33).
Dormans, J. (2010). Adventures in level design: generating missions and spaces for action adventure games. In Proceedings of the 2010 workshop on procedural content generation in games. ACM (pp. 1).
Dragert, C., Kienzle, J., Vangheluwe, H., & Verbrugge, C. (2011). Generating extras: Procedural AI with statecharts. Technical Report SOCS-TR-2011.1.
Edwards, R. (2006). The economics of game publishing. IGN Entertainment Inc.
Greig, T. J. (2016). Evaluating the perceived immersion of procedurally generated game levels, Master of Creative Technologies, Auckland University of Technology. http://aut.researchgateway.ac.nz/handle/10292/10109. Accessed 6 Aug 2017.
Harman, M. (2007). The current state and future of search based software engineering. 2007 Future of Software Engineering. IEEE Computer Society (pp. 342–357).
Haywood, N., & Cairns, P. (2006). Engagement with an interactive museum exhibit. In T. Mcewan, J. Gulliksen, & D. Benyon (Eds.), People and computers XIX—The bigger picture: Proceedings of HCI 2005. London: Springer.
Hendrikx, M., Meijer, S., Van Der Velden, J., & Iosup, A. (2013). Procedural content generation for games: A survey. ACM Transactions on Multimedia Computing, Communications, and Applications, 9, 1.
Iosup, A. (2011). POGGI: Generating puzzle instances for online games on grid infrastructures. Concurrency and Computation: Practice and Experience, 23, 158–171.
Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., et al. (2008). Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies, 66, 641–661.
Khaled, R., Nelson, M. J., & Barr, P. (2013). Design metaphors for procedural content generation in games. In Proceedings of the SIGCHI conference on human factors in computing systems. Paris, France: ACM.
Köhler, B., Haladjian, J., Simeonova, B., & Ismailović, D. (2012). Feedback in low vs. high fidelity visuals for game prototypes. In Second international workshop on games and software engineering: Realizing user engagement with game engineering techniques, 2–9 June 2012 Zurich, Switzerland IEEE (pp. 42–47).
Kruse, J., Sosa, R., & Connor, A. (2016). Procedural urban environments for FPS games. In Proceedings of the Australasian computer science week multiconference. Canberra, Australia: ACM.
Kuo, A., Hiler, J. L., & Lutz, R. J. (2017). From Super Mario to Skyrim: A framework for the evolution of video game consumption. Journal of Consumer Behaviour, 16, 101–120.
Lee, Y. S., & Cho, S. B. (2011). Context-aware petri net for dynamic procedural content generation in role-playing game. IEEE Computational Intelligence Magazine, 6, 16–25.
Liapis, A., Yannakakis, G. N., & Togelius, J. (2015). Constrained novelty search: A study on game content generation. Evolutionary Computation, 23, 101–129.
Mark, B. & Berechet, T. (2014). Procedural 3D cave generation. MA Thesis. IT University of Copenhagen, 2014. http://benjaminmark.dk/Procedural_3D_Cave_Generation.pdf.
Merrick, K. E., Isaacs, A., Barlow, M., & Gu, N. (2013). A shape grammar approach to computational creativity and procedural content generation in massively multiplayer online role playing games. Entertainment Computing, 4, 115–130.
Raffe, W. L., Zambetta, F., Li, X., & Stanley, K. O. (2015). Integrated approach to personalized procedural map generation using evolutionary algorithms. IEEE Transactions on Computational Intelligence and AI in Games, 7, 139–155.
Roden, T. & Parberry, I. (2004). From artistry to automation: A structured methodology for procedural content creation. In Entertainment computing—ICEC 2004. Springer.
Shaker, M., Sarhan, M. H., Al Naameh, O., Shaker, N., & Togelius, J. (2013). Automatic generation and analysis of physics-based puzzle games. In 2013 IEEE conference on computational intelligence in games (CIG). IEEE (pp. 1–8).
Smelik, R., Tutenel, T., De Kraker, K. J., & Bidarra, R. (2010). Integrating procedural generation and manual editing of virtual worlds. In Proceedings of the 2010 workshop on procedural content generation in games. ACM (pp. 2).
Smith, J. (2016). The musical parameters of immersion and flow: Involving the player, emotionally and physically, in a video-game. Masters Thesis, University of Huddersfield.
Smith, A. M., & Mateas, M. (2011). Answer set programming for procedural content generation: A design space approach. IEEE Transactions on Computational Intelligence and AI in Games, 3, 187–200.
Smith, G., Whitehead, J., & Mateas, M. (2010). Tanagra: A mixed-initiative level design tool. In Proceedings of the fifth international conference on the foundations of digital games. ACM (pp. 209–216).
Togelius, J., Champandard, A. J., Lanzi, P. L., Mateas, M., Paiva, A., Preuss, M., et al. (2013). Procedural content generation: Goals, challenges and actionable steps. In S. M. Lucas, M. Mateas, M. Preuss, P. Spronck, & J. Togelius (Eds.), Artificial and computational intelligence in games. Dagstuhl: Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik.
Togelius, J., Kastbjerg, E., Schedl, D., & Yannakakis, G. N. (2011a). What is procedural content generation? Mario on the borderline. In Proceedings of the 2nd international workshop on procedural content generation in games. Bordeaux, France: ACM.
Togelius, J., Preuss, M., & Yannakakis, G. N. (2010a). Towards multiobjective procedural map generation. In Proceedings of the 2010 workshop on procedural content generation in games. ACM (pp. 3).
Togelius, J., Yannakakis, G. N., Stanley, K. O., & Browne, C. (2010b). Search-based procedural content generation. Applications of evolutionary computation. Berlin: Springer.
Togelius, J., Yannakakis, G. N., Stanley, K. O., & Browne, C. (2011b). Search-based procedural content generation: A taxonomy and survey. IEEE Transactions on Computational Intelligence and AI in Games, 3, 172–186.
Treanor, M., Blackford, B., Mateas, M., & Bogost, I. (2012). Game-o-matic: Generating videogames that represent ideas. In Procedural content generation workshop at the foundations of digital games conference.
Whitehead, J. (2010). Toward procedural decorative ornamentation in games. In Proceedings of the 2010 workshop on procedural content generation in games. ACM (pp. 9).
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
About this article
Cite this article
Connor, A.M., Greig, T.J. & Kruse, J. Evaluating the Impact of Procedurally Generated Content on Game Immersion. Comput Game J 6, 209–225 (2017). https://doi.org/10.1007/s40869-017-0043-6