Abstract
To date, number of scales have been used to study online gaming addiction. Aside from their quantity, their uncertain psychometric properties are among the issues that this field of research faces. This study aims at a more detailed assessment of the frequently used Addiction-Engagement Questionnaire (Charlton & Danforth, 2010) that can uniquely discriminate pathological and non-pathological intensive gaming. An online questionnaire was administered thrice during a period of one year to a sample of online gamers (N = 5080). A series of factor analysis models was used to re-evaluate the original suggested models and formulate new models. Measurement invariance of the final selected model was evaluated in terms of preferred genres (MMORPG and MOBA), age groups, and waves of data collection. The original model did not exhibit a solid fit to data. Few changes were suggested as remedies to improve model fit. The revised model keeps the original two-factor solution, however, we found little support for the so-called peripheral components of addiction with the exception of tolerance. The revised model was found to be invariant over the selected groups. With only few modifications, the Addiction-Engagement Questionnaire was found to be usable for survey-type research purposes, showing a mid-high internal consistency and test-retest reliability.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Billieux, J., Schimmenti, A., Khazaal, Y., Maurage, P., & Heeren, A. (2015). Are we overpathologizing everyday life? A tenable blueprint for behavioral addiction research. Journal of Behavioral Addictions, 4(3), 119–123. https://doi.org/10.1556/2006.4.2015.009.
Billieux, J., Flayelle, M., Rumpf, H. J., & Stein, D. J. (2019). High involvement versus pathological involvement in video games: A crucial distinction for ensuring the validity and utility of gaming disorder. Current Addiction Reports, 6(3), 323–330. https://doi.org/10.1007/s40429-019-00259-x.
Blinka, L., & Mikuška, J. (2014). The role of social motivation and sociability of gamers in online game addiction. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 8(2). https://doi.org/10.5817/CP2014-2-6.
Blinka, L., Škařupová, K., & Mitterová, K. (2016). Dysfunctional impulsivity in online gaming addiction and engagement. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 10(3). https://doi.org/10.5817/CP2016-3-5.
Brunborg, G. S., Mentzoni, R. A., Melkevik, O. R., Torsheim, T., Samdal, O., Hetland, J., Andreassen, C. S., & Palleson, S. (2013). Gaming addiction, gaming engagement, and psychological health complaints among Norwegian adolescents. Media Psychology, 16(1), 115–128. https://doi.org/10.1080/15213269.2012.756374.
Carter, B. L., & Tiffany, S. T. (1999). Meta-analysis of cue-reactivity in addiction research. Addiction, 94(3), 327–340. https://doi.org/10.1046/j.1360-0443.1999.9433273.x.
Charlton, J. P. (2002). A factor-analytic investigation of computer ‘addiction’ and engagement. British Journal of Psychology, 93(3), 329–344. https://doi.org/10.1348/000712602760146242.
Charlton, J. P., & Danforth, I. D. (2004). Differentiating computer-related addictions and high engagement. WIT Transactions on Information and Communication Technologies, 31, 10. https://doi.org/10.2495/CI040071.
Charlton, J. P., & Danforth, I. D. (2007). Distinguishing addiction and high engagement in the context of online game playing. Computers in Human Behavior, 23(3), 1531–1548. https://doi.org/10.1016/j.chb.2005.07.002.
Charlton, J. P., & Danforth, I. D. (2010). Validating the distinction between computer addiction and engagement: Online game playing and personality. Behaviour & Information Technology, 29(6), 601–613. https://doi.org/10.1080/01449290903401978.
Deleuze, J., Long, J., Liu, T. Q., Maurage, P., & Billieux, J. (2018). Passion or addiction? Correlates of healthy versus problematic use of videogames in a sample of French-speaking regular players. Addictive Behaviors, 82, 114–121. https://doi.org/10.1016/j.addbeh.2018.02.031.
Dong, G., Lin, X., & Potenza, M. N. (2015). Decreased functional connectivity in an executive control network is related to impaired executive function in internet gaming disorder. Progress in Neuro-Psychopharmacology and Biological Psychiatry, 57(supplement C), 76–85. https://doi.org/10.1016/j.pnpbp.2014.10.012.
Griffiths, M. (2005). A ‘components’ model of addiction within a biopsychosocial framework. Journal of Substance Use, 10(4), 191–197. https://doi.org/10.1080/14659890500114359.
Hellström, C., Nilsson, K. W., Leppert, J., & Åslund, C. (2012). Influences of motives to play and time spent gaming on the negative consequences of adolescent online computer gaming. Computers in Human Behavior, 28(4), 1379–1387. https://doi.org/10.1016/j.chb.2012.02.023.
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.
Jelenchick, L. A., Becker, T., & Moreno, M. A. (2012). Assessing the psychometric properties of the Internet Addiction Test (IAT) in US college students. Psychiatry Research, 196(2), 296–301. https://doi.org/10.1016/j.psychres.2011.09.007.
Kardefelt-Winther, D., Heeren, A., Schimmenti, A., van Rooij, A., Maurage, P., Carras, M., Edman, J., Blaszczynski, A., Khazaal, Y., & Billieux, J. (2017). How can we conceptualize behavioural addiction without pathologizing common behaviours? Addiction, 112(10), 1709–1715. https://doi.org/10.1111/add.13763.
King, D. L., Haagsma, M. C., Delfabbro, P. H., Gradisar, M., & Griffiths, M. D. (2013). Toward a consensus definition of pathological video-gaming: A systematic review of psychometric assessment tools. Clinical Psychology Review, 33(3), 331–342. https://doi.org/10.1016/j.cpr.2013.01.002.
King, D. L., Delfabbro, P. H., Perales, J. C., Deleuze, J., Király, O., Krossbakken, E., & Billieux, J. (2019). Maladaptive player-game relationships in problematic gaming and gaming disorder: A systematic review. Clinical Psychology Review, 73, 101777. https://doi.org/10.1016/j.cpr.2019.101777.
King, D. L., Chamberlain, S. R., Carragher, N., Billieux, J., Stein, D., Mueller, K., et al. (2020). Screening and assessment tools for gaming disorder: A comprehensive systematic review. Clinical Psychology Review, 77, 101831. https://doi.org/10.1016/j.cpr.2020.101831.
Kirby, A., Jones, C., & Copello, A. (2014). The impact of massively multiplayer online role playing games (MMORPGs) on psychological wellbeing and the role of play motivations and problematic use. International Journal of Mental Health and Addiction, 12(1), 36–51. https://doi.org/10.1007/s11469-013-9467-9.
Krossbakken, E., Pallesen, S., Mentzoni, R. A., King, D. L., Molde, H., Finserås, T. R., & Torsheim, T. (2018). A cross-lagged study of developmental trajectories of video game engagement, addiction, and mental health. Frontiers in Psychology, 9, 2239. https://doi.org/10.3389/fpsyg.2018.02239.
Kuss, D. J., & Griffiths, M. D. (2012). Internet gaming addiction: A systematic review of empirical research. International Journal of Mental Health and Addiction, 10(2), 278–296. https://doi.org/10.1007/s11469-011-9318-5.
Laconi, S., Pirès, S., & Chabrol, H. (2017). Internet gaming disorder, motives, game genres and psychopathology. Computers in Human Behavior, 75, 652–659. https://doi.org/10.1016/j.chb.2017.06.012.
Lehenbauer-Baum, M., & Fohringer, M. (2015). Towards classification criteria for internet gaming disorder: Debunking differences between addiction and high engagement in a German sample of world of Warcraft players. Computers in Human Behavior, 45, 345–351. https://doi.org/10.1016/j.chb.2014.11.098.
Lehenbauer-Baum, M., Klaps, A., Kovacovsky, Z., Witzmann, K., Zahlbruckner, R., & Stetina, B. U. (2015). Addiction and engagement: An explorative study toward classification criteria for internet gaming disorder. Cyberpsychology, Behavior and Social Networking, 18(6), 343–349. https://doi.org/10.1089/cyber.2015.0063.
Lemmens, J. S., Valkenburg, P. M., & Gentile, D. A. (2015). The internet gaming disorder scale. Psychological Assessment, 27(2), 567–582. https://doi.org/10.1037/pas0000062.
Loton, D., Borkoles, E., Lubman, D., & Polman, R. (2016). Video game addiction, engagement and symptoms of stress, depression and anxiety: The mediating role of coping. International Journal of Mental Health and Addiction, 14(4), 565–578. https://doi.org/10.1007/s11469-015-9578-6.
Metcalf, O., & Pammer, K. (2011). Attentional bias in excessive massively multiplayer online role-playing gamers using a modified Stroop task. Computers in Human Behavior, 27(5), 1942–1947. https://doi.org/10.1016/j.chb.2011.05.001.
Metcalf, O., & Pammer, K. (2014a). Impulsivity and related neuropsychological features in regular and addictive first person shooter gaming. Cyberpsychology, Behavior and Social Networking, 17(3), 147–152. https://doi.org/10.1089/cyber.2013.0024.
Metcalf, O., & Pammer, K. (2014b). Physiological arousal deficits in addicted gamers differ based on preferred game genre. European Addiction Research, 20(1), 23–32. https://doi.org/10.1159/000349907.
Müller, K. W., Beutel, M. E., Dreier, M., & Wölfling, K. (2019). A clinical evaluation of the DSM-5 criteria for Internet Gaming Disorder and a pilot study on their applicability to further internet-related disorders. Journal of Behavioral Addictions, 8(1), 16–24. https://doi.org/10.1556/2006.7.2018.140.
Peters, C. S., & Malesky Jr., L. A. (2008). Problematic usage among highly-engaged players of massively multiplayer online role playing games. Cyberpsychology & Behavior, 11(4), 481–484. https://doi.org/10.1089/cpb.2007.0140.
Petry, N. M., Rehbein, F., Gentile, D. A., Lemmens, J. S., Rumpf, H.-J., Mößle, T., Bischof, G., Tao, R., Fung, D. S. S., Borges, G., Auriacombe, M., González Ibáñez, A., Tam, P., & O'Brien, C. P. (2014). An international consensus for assessing internet gaming disorder using the new DSM-5 approach. Addiction, 109(9), 1399–1406. https://doi.org/10.1111/add.12457.
Pontes, H. M., & Griffiths, M. D. (2015). Measuring DSM-5 internet gaming disorder: Development and validation of a short psychometric scale. Computers in Human Behavior, 45, 137–143. https://doi.org/10.1016/j.chb.2014.12.006.
Quinones, C., & Kakabadse, N. K. (2015). Self-concept clarity, social support, and compulsive Internet use: A study of the US and the UAE. Computers in Human Behavior, 44, 347–356. https://doi.org/10.1016/j.chb.2014.11.019.
R Core Team. (2017). R: A language and environment for statistical computing [computer software]. R Foundation for Statistical Computing.
Rehbein, F., Kliem, S., Baier, D., Mößle, T., & Petry, N. M. (2015). Prevalence of internet gaming disorder in German adolescents: Diagnostic contribution of the nine DSM-5 criteria in a state-wide representative sample. Addiction, 110(5), 842–851. https://doi.org/10.1111/add.12849.
Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36.
Şalvarlı, Ş. İ., & Griffiths, M. D. (2019). The association between internet gaming disorder and impulsivity: A systematic review of literature. International Journal of Mental Health and Addiction, 1–27. https://doi.org/10.1007/s11469-019-00126-w.
Satorra, A. (2000). Scaled and adjusted restricted tests in multi-sample analysis of moment structures. In R. D. H. Heijmans, D. S. G. Pollock, & A. Satorra (Eds.), Innovations in multivariate statistical analysis. Springer.
Seok, S., & DaCosta, B. (2012). The world’s most intense online gaming culture: Addiction and high-engagement prevalence rates among south Korean adolescents and young adults. Computers in Human Behavior, 28(6), 2143–2151. https://doi.org/10.1016/j.chb.2012.06.019.
Škařupová, K., & Blinka, L. (2016). Interpersonal dependency and online gaming addiction. Journal of Behavioral Addictions, 5(1), 108–114. https://doi.org/10.1556/2006.5.2016.002.
Škařupová, K., Blinka, L., & Ťápal, A. (2018). Gaming under the influence: An exploratory study. Journal of Behavioral Addictions, 7(2), 493–498. https://doi.org/10.1556/2006.7.2018.27.
Skoric, M. M., Teo, L. L. C., & Neo, R. L. (2009). Children and video games: Addiction, engagement, and scholastic achievement. Cyberpsychology & Behavior, 12(5), 567–572. https://doi.org/10.1089/cpb.2009.0079.
Starcevic, V. (2016). Tolerance and withdrawal symptoms may not be helpful to enhance understanding of behavioural addictions. Addiction, 111(7), 1307–1308. https://doi.org/10.1111/add.13381.
Steinberg, L., Albert, D., Cauffman, E., Banich, M., Graham, S., & Woolard, J. (2008). Age differences in sensation seeking and impulsivity as indexed by behavior and self-report: Evidence for a dual systems model. Developmental Psychology, 44(6), 1764–1778. https://doi.org/10.1037/a0012955.
Toker, S., & Baturay, M. H. (2016). Antecedents and consequences of game addiction. Computers in Human Behavior, 55, 668–679. https://doi.org/10.1016/j.chb.2015.10.002.
Widyanto, L., & McMurran, M. (2004). The psychometric properties of the internet addiction test. Cyberpsychology & Behavior, 7(4), 443–450. https://doi.org/10.1089/cpb.2004.7.44.
Funding
This research was supported by Czech Science Foundation (project GA21-30769S).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institution and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Conflict of Interest
Lukas Blinka, Adam Ťápal, and Kateřina Škařupová declare that they have no conflict of interest.
Experiment Participants
This study included human subject participants. The current study was performed in accordance with the ethical standards for human subjects research.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Blinka, L., Ťápal, A. & Škařupová, K. Evaluating the Psychometric Properties and Measurement Invariance of the Addiction-Engagement Questionnaire Using a Longitudinal Sample. J Psychopathol Behav Assess 43, 757–765 (2021). https://doi.org/10.1007/s10862-021-09907-x
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10862-021-09907-x