Skip to main content

Advertisement

Log in

Cognitive Load in Real-Time Strategy Gaming: Human Opponent Versus AI Opponent

  • Published:
The Computer Games Journal

Abstract

This paper examines the cognitive load in real-time strategy gaming subjects along with physiological and subjective measurements. The subjects were college students from a northeastern university in China. This paper is a study into players’ cognitive load measurement when playing against human opponents and game artificial intelligences (game AIs). Using eye trackers, action per minute recorders and questionnaires, we collected qualitative data from participants about their cognitive load through playing against human opponents and game AI opponents. The results indicate that players have more cognitive load when playing against human opponents than against game AI opponents. Secondly, as the players’ gaming skill increased, their cognitive load did not differ substantially when they switched from playing against human players to playing against game AI opponents. A deeper understanding of players’ cognitive load can enable a developer to design a more appropriate game experience.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Alexander, J. T., Sear, J., & Oikonomou, A. (2013). An investigation of the effects of game difficulty on player enjoyment. Entertainment Computing, 4(1), 53–62.

    Article  Google Scholar 

  • Anderson, C. A., Gentile, D. A., & Buckley, K. E. (2007). Violent video game effects on children and adolescents: Theory, research, and public policy. Oxford: Oxford University Press.

    Book  Google Scholar 

  • Anderson, E. W., Potter, K. C., Matzen, L. E., Shepherd, J. F., Preston, G. A., & Silva, C. T. (2011). A user study of visualization effectiveness using EEG and cognitive load. Computer Graphics Forum, 30(3), 791–800.

    Article  Google Scholar 

  • Ang, C. S., Zaphiris, P., & Mahmood, S. (2007). A model of cognitive loads in massively multiplayer online role playing games. Interacting with Computers, 19(2), 167–179.

    Article  Google Scholar 

  • Aponte, M. V., Levieux, G., & Natkin, S. (2011). Measuring the level of difficulty in single player video games. Entertainment Computing, 2(4), 205–213.

    Article  Google Scholar 

  • Bailey, B. P., & Iqbal, S. T. (2008). Understanding changes in mental workload during execution of goal-directed tasks and its application for interruption management. ACM Transactions on Computer–Human Interaction, 14(4), 21.

    Article  Google Scholar 

  • Chalmers, P. A. (2003). The role of cognitive theory in human–computer interface. Computers in Human Behavior, 19(5), 593–607.

    Article  Google Scholar 

  • Chang, C. C. (2013). Examining users’ intention to continue using social network games: A flow experience perspective. Telematics and Informatics, 30, 311–321.

    Article  Google Scholar 

  • Chen, S., Epps, J., Ruiz, N., & Chen, F. (2011). Eye activity as a measure of human mental effort in HCI. In Proceedings of the 16th international conference on Intelligent user interfaces (pp. 315–318).

  • Chou, C., & Tsai, M. J. (2007). Gender differences in Taiwan high school students’ computer game playing. Computers in Human Behavior, 23, 812–824.

    Article  Google Scholar 

  • Colwell, J. (2007). Needs met through computer game play among adolescents. Personality and Individual Differences, 43, 2072–2082.

    Article  Google Scholar 

  • Csikszentmihalyi, M. (1975). Beyond boredom and anxiety. San Francisco: Josey-Bass.

    Google Scholar 

  • Dong, M., & Ma, R. (1998). Application of multistage evaluation scale in subjective assessment of mental workload. Hang tian, 11(3), 202–204.

    Google Scholar 

  • Engl, S., & Nacke, L. E. (2013). Contextual influences on mobile player experience—A game user experience model. Entertainment Computing, 4(1), 83–91.

    Article  Google Scholar 

  • Feinberg, S., & Murphy, M. (2000). Applying cognitive load theory to the design of web-based instruction. In IEEE professional communication society international professional communication conference (pp. 353–360).

  • Frostling-Henningsson, M. (2009). First-person shooter games as a way of connecting to people: ‘Brothers in blood’. Cyberpsychology and Behaviour, 12(5), 557–562.

    Article  Google Scholar 

  • Fujita, H., & Wu, I. (2012). A special issue on artificial intelligence in computer games: AICG. Knowledge-Based Systems, 34, 1–2.

    Article  Google Scholar 

  • Gevins, A., Smith, M. E., Leong, H., McEvoy, L., Whitfield, S., Du, R., & Rush, G. (1998). Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Human Factors: The Journal of the Human Factors and Ergonomics Society, 40(1), 79–91.

    Article  Google Scholar 

  • Hagelback, J., & Johansson, S. J. (2009). Measuring player experience on runtime dynamic difficulty scaling in an RTS game. In IEEE symposium on computational intelligence and games (pp. 46–52).

  • Hou, J., Nam, Y., Peng, W., & Lee, K. M. (2012). Effects of screen size, viewing angle, and players’ immersion tendencies on game experience. Computers in Human Behavior, 28(2), 617–623.

    Article  Google Scholar 

  • Jansz, J., Avis, C., & Vosmeer, M. (2010). Playing The Sims2: An exploration of gender differences in players’ motivations and patterns of play. New Media & Society, 12(2), 235–251.

    Article  Google Scholar 

  • Klimmt, C., Schmid, H., & Orthmann, J. (2009). Exploring the enjoyment of playing browser games. Cyberpsychology and Behaviour, 12(2), 231–234.

    Article  Google Scholar 

  • Lavie, N. (2005). Distracted and confused? Selective attention under load. Trends in Cognitive Sciences, 9(2), 75–82.

    Article  Google Scholar 

  • Lin, Y. L., & Lin, H. W. (2011). A study on the goal value for massively multiplayer online role-playing games players. Computers in Human Behavior, 27, 2153–2160.

    Article  Google Scholar 

  • Llargues Asensio, J. M., Peralta, J., Arrabales, R., Bedia, M. G., Cortez, P., & Peña, A. L. (2014). Artificial Intelligence approaches for the generation and assessment of believable human-like behaviour in virtual characters. Expert Systems with Applications, 41, 7281–7290.

    Article  Google Scholar 

  • Lucas, K., & Sherry, J. L. (2004). Sex differences in video game play: A communication-based explanation. Communication Research, 31(5), 499–523.

    Article  Google Scholar 

  • Mandryk, R. L., Inkpen, K. M., & Calvert, T. W. (2006). Using psychophysiological techniques to measure user experience with entertainment technologies. Behaviour & Information Technology, 25(2), 141–158.

    Article  Google Scholar 

  • McGonigal, J. (2011). Reality is broken: Why games make us better and how they can change the world. Harmondsworth: Penguin.

    Google Scholar 

  • O’Donnell, R. D., & Eggmeier, F. T. (1986). Workload assessment methodology. In J. P. Thomas & L. Kaufman (Eds.), Handbook of perception and human performance (Vol. 2). New York: Wiley Interscience.

    Google Scholar 

  • Paas, F., Renkl, A., & Sweller, J. (2004). Cognitive load theory: Instructional implications of the interaction between information structures and cognitive architecture. Instructional Science, 32(1), 1–8.

    Article  Google Scholar 

  • Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38(1), 63–71.

    Article  Google Scholar 

  • Palinko, O., Kun, A. L., Shyrokov, A., & Heeman, P. (2010). Estimating cognitive load using remote eye tracking in a driving simulator. In Proceedings of the 2010 symposium on eye-tracking research and applications (pp. 141–144).

  • Sax, L. (2009). Boys adrift: The five factors driving the growing epidemic of unmotivated boys and underachieving young men. New York: Basic Books.

    Google Scholar 

  • Shi, Y., Ruiz, N., Taib R., Choi, E., & Chen, F. (2007). Galvanic skin response (GSR) as an index of cognitive load. In CHI’07 extended abstracts on human factors in computing systems (pp. 2651–2656).

  • Suznjevic, M., & Matijasevic, M. (2010). Why MMORPG players do what they do: Relating motivations to action categories. International Journal of Advanced Media and Communication, 4(4), 405.

    Article  Google Scholar 

  • Sweetser, P., & Wyeth, P. (2005). Game flow: A model for evaluating player enjoyment in games. ACM Computers in Entertainment, 3(3), 1–24.

    Article  Google Scholar 

  • Sweller, J., Van Merrienboer, J. J., & Paas, F. G. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10(3), 251–256.

    Article  Google Scholar 

  • Van Gerven, P. W., Paas, F., Van Merriënboer, J. J., & Schmidt, H. G. (2004). Memory load and the cognitive pupillary response in aging. Psychophysiology, 41(2), 167–174.

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported by National Key Technology Support Program in China (ID: 2012BAH66F01).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yang Chen.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, Y., Ou, J. & Whittinghill, D.M. Cognitive Load in Real-Time Strategy Gaming: Human Opponent Versus AI Opponent. Comput Game J 4, 19–30 (2015). https://doi.org/10.1007/s40869-015-0002-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40869-015-0002-z

Keywords

Navigation