Skip to main content
SpringerLink
Log in

Evaluating the Impact of Procedurally Generated Content on Game Immersion

The Computer Games Journal

Cite this article

Abstract

This paper describes a study that examines the impact that procedurally generated content has on the quality of gaming experience. To that end, an experimental study has been undertaken where gamers play two versions of an otherwise identical game, the only difference being that in one version the game levels are designed by a human designer and in the second version they are procedurally generated. A game immersion questionnaire is used to capture the quality of the gameplay experience and the results across the two groups compared. Whilst there are observable differences in perceived total immersion, statistical analysis using one way ANOVA testing suggests that the difference is not statistically significant. Detailed analysis of the questionnaire responses identifies where variation between the two groups is statistically significant.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

References

  • Arsenault, D. & Perron, B. In the frame of the magic cycle: The circle(s) of gameplay. In: B. Perron & M. J. P. Wolf (Eds.) The video game theory reader 2. New York: Routledge.

  • Ashlock, D., Lee, C., & McGuinness, C. (2011). Search-based procedural generation of maze-like levels. IEEE Transactions on Computational Intelligence and AI in Games, 3, 260–273.

    Article  Google Scholar 

  • Barreto, N., Cardoso, A., & Roque, L. (2014). Computational creativity in procedural content generation: A state of the art survey. In Proceedings of the 2014 conference of science and art of video games.

  • Bentley, P. J., & Wakefield, J. P. (1998). Finding acceptable solutions in the pareto-optimal range using multiobjective genetic algorithms. Soft computing in engineering design and manufacturing. London: Springer.

    Google Scholar 

  • Blow, J. (2004). Game development: Harder than you think. Queue, 1, 28–37.

    Article  Google Scholar 

  • Bourke, P. & Shier, J. (2013). Space filling: A new algorithm for procedural creation of game assets. In Proceedings of the 5th annual international conference on computer games multimedia & allied technology.

  • Brown, E. & Cairns, P. (2004). A grounded investigation of game immersion. CHI’04 extended abstracts on human factors in computing systems. ACM (pp. 1297–1300).

  • Call, J., Whitlock, K., & Voorhees, G. (2012). From dungeons to digital denizens. Dungeons, dragons, and digital denizens: The digital role-playing game. New York: Continuum.

    Google Scholar 

  • Cardamone, L., Loiacono, D., & Lanzi, P. L. (2011). Interactive evolution for the procedural generation of tracks in a high-end racing game. In Proceedings of the 13th annual conference on genetic and evolutionary computation. Dublin, Ireland: ACM.

  • Connor, A. M., Clarkson, P. J., Shapar, S., & Leonard, P. (2000). Engineering design optimization using Tabu search. In Design for excellence: Engineering design conference 2000. Wiley (pp. 371–378).

  • Denisova, A. & Cairns, P. (2015). The placebo effect in digital games: Phantom perception of adaptive artificial intelligence. In Proceedings of the 2015 annual symposium on computer–human interaction in play. ACM (pp. 23–33).

  • Dormans, J. (2010). Adventures in level design: generating missions and spaces for action adventure games. In Proceedings of the 2010 workshop on procedural content generation in games. ACM (pp. 1).

  • Dragert, C., Kienzle, J., Vangheluwe, H., & Verbrugge, C. (2011). Generating extras: Procedural AI with statecharts. Technical Report SOCS-TR-2011.1.

  • Edwards, R. (2006). The economics of game publishing. IGN Entertainment Inc. 

  • Greig, T. J. (2016). Evaluating the perceived immersion of procedurally generated game levels, Master of Creative Technologies, Auckland University of Technology. http://aut.researchgateway.ac.nz/handle/10292/10109. Accessed 6 Aug 2017.

  • Harman, M. (2007). The current state and future of search based software engineering. 2007 Future of Software Engineering. IEEE Computer Society (pp. 342–357).

  • Haywood, N., & Cairns, P. (2006). Engagement with an interactive museum exhibit. In T. Mcewan, J. Gulliksen, & D. Benyon (Eds.), People and computers XIX—The bigger picture: Proceedings of HCI 2005. London: Springer.

    Google Scholar 

  • Hendrikx, M., Meijer, S., Van Der Velden, J., & Iosup, A. (2013). Procedural content generation for games: A survey. ACM Transactions on Multimedia Computing, Communications, and Applications, 9, 1.

    Article  Google Scholar 

  • Iosup, A. (2011). POGGI: Generating puzzle instances for online games on grid infrastructures. Concurrency and Computation: Practice and Experience, 23, 158–171.

    Article  Google Scholar 

  • Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., et al. (2008). Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies, 66, 641–661.

    Article  Google Scholar 

  • Khaled, R., Nelson, M. J., & Barr, P. (2013). Design metaphors for procedural content generation in games. In Proceedings of the SIGCHI conference on human factors in computing systems. Paris, France: ACM.

  • Köhler, B., Haladjian, J., Simeonova, B., & Ismailović, D. (2012). Feedback in low vs. high fidelity visuals for game prototypes. In Second international workshop on games and software engineering: Realizing user engagement with game engineering techniques, 2–9 June 2012 Zurich, Switzerland IEEE (pp. 42–47).

  • Kruse, J., Sosa, R., & Connor, A. (2016). Procedural urban environments for FPS games. In Proceedings of the Australasian computer science week multiconference. Canberra, Australia: ACM.

  • Kuo, A., Hiler, J. L., & Lutz, R. J. (2017). From Super Mario to Skyrim: A framework for the evolution of video game consumption. Journal of Consumer Behaviour, 16, 101–120.

    Article  Google Scholar 

  • Lee, Y. S., & Cho, S. B. (2011). Context-aware petri net for dynamic procedural content generation in role-playing game. IEEE Computational Intelligence Magazine, 6, 16–25.

    Article  Google Scholar 

  • Liapis, A., Yannakakis, G. N., & Togelius, J. (2015). Constrained novelty search: A study on game content generation. Evolutionary Computation, 23, 101–129.

    Article  Google Scholar 

  • Mark, B. & Berechet, T. (2014). Procedural 3D cave generation. MA Thesis. IT University of Copenhagen, 2014. http://benjaminmark.dk/Procedural_3D_Cave_Generation.pdf.

  • Merrick, K. E., Isaacs, A., Barlow, M., & Gu, N. (2013). A shape grammar approach to computational creativity and procedural content generation in massively multiplayer online role playing games. Entertainment Computing, 4, 115–130.

    Article  Google Scholar 

  • Raffe, W. L., Zambetta, F., Li, X., & Stanley, K. O. (2015). Integrated approach to personalized procedural map generation using evolutionary algorithms. IEEE Transactions on Computational Intelligence and AI in Games, 7, 139–155.

    Article  Google Scholar 

  • Roden, T. & Parberry, I. (2004). From artistry to automation: A structured methodology for procedural content creation. In Entertainment computing—ICEC 2004. Springer.

  • Shaker, M., Sarhan, M. H., Al Naameh, O., Shaker, N., & Togelius, J. (2013). Automatic generation and analysis of physics-based puzzle games. In 2013 IEEE conference on computational intelligence in games (CIG). IEEE (pp. 1–8).

  • Smelik, R., Tutenel, T., De Kraker, K. J., & Bidarra, R. (2010). Integrating procedural generation and manual editing of virtual worlds. In Proceedings of the 2010 workshop on procedural content generation in games. ACM (pp. 2).

  • Smith, J. (2016). The musical parameters of immersion and flow: Involving the player, emotionally and physically, in a video-game. Masters Thesis, University of Huddersfield.

  • Smith, A. M., & Mateas, M. (2011). Answer set programming for procedural content generation: A design space approach. IEEE Transactions on Computational Intelligence and AI in Games, 3, 187–200.

    Article  Google Scholar 

  • Smith, G., Whitehead, J., & Mateas, M. (2010). Tanagra: A mixed-initiative level design tool. In Proceedings of the fifth international conference on the foundations of digital games. ACM (pp. 209–216).

  • Togelius, J., Champandard, A. J., Lanzi, P. L., Mateas, M., Paiva, A., Preuss, M., et al. (2013). Procedural content generation: Goals, challenges and actionable steps. In S. M. Lucas, M. Mateas, M. Preuss, P. Spronck, & J. Togelius (Eds.), Artificial and computational intelligence in games. Dagstuhl: Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik.

    Google Scholar 

  • Togelius, J., Kastbjerg, E., Schedl, D., & Yannakakis, G. N. (2011a). What is procedural content generation? Mario on the borderline. In Proceedings of the 2nd international workshop on procedural content generation in games. Bordeaux, France: ACM.

  • Togelius, J., Preuss, M., & Yannakakis, G. N. (2010a). Towards multiobjective procedural map generation. In Proceedings of the 2010 workshop on procedural content generation in games. ACM (pp. 3).

  • Togelius, J., Yannakakis, G. N., Stanley, K. O., & Browne, C. (2010b). Search-based procedural content generation. Applications of evolutionary computation. Berlin: Springer.

    Google Scholar 

  • Togelius, J., Yannakakis, G. N., Stanley, K. O., & Browne, C. (2011b). Search-based procedural content generation: A taxonomy and survey. IEEE Transactions on Computational Intelligence and AI in Games, 3, 172–186.

    Article  Google Scholar 

  • Treanor, M., Blackford, B., Mateas, M., & Bogost, I. (2012). Game-o-matic: Generating videogames that represent ideas. In Procedural content generation workshop at the foundations of digital games conference.

  • Whitehead, J. (2010). Toward procedural decorative ornamentation in games. In Proceedings of the 2010 workshop on procedural content generation in games. ACM (pp. 9).

Download references

Author information

Authors and Affiliations

  1. Auckland University of Technology, Private Bag 92006, Wellesley Street, Auckland, 1010, New Zealand

    Andy M. Connor, Taura J. Greig & Jan Kruse

Authors
  1. Andy M. Connor
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Taura J. Greig
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jan Kruse
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andy M. Connor.

Ethics declarations

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Connor, A.M., Greig, T.J. & Kruse, J. Evaluating the Impact of Procedurally Generated Content on Game Immersion. Comput Game J 6, 209–225 (2017). https://doi.org/10.1007/s40869-017-0043-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40869-017-0043-6

Keywords

search

Navigation