Skip to main content
SpringerLink
Log in

Measurement Invariance of the Lemmens Internet Gaming Disorder Scale-9 Across Age, Gender, and Respondents

  • Original Paper
  • Published:
Psychiatric Quarterly Aims and scope Submit manuscript

Abstract

Although Internet gaming disorder (IGD) has gained increased attention in scientific, clinical, and community contexts, there is still a lack of consensus regarding the best assessment tools (i.e., self-report or other reports) for assessing its symptoms. The present study aimed to investigate the reliability, validity, and measurement invariance of both versions (youth and parent) of The Lemmens Internet Gaming Disorder Scale-9. To achieve this goal, we recruited between June and October 2019 from five Romanian highschools a total of 697 adolescents (11–19 years old) and one of their parents (N = 391). The internal consistency was good in both versions of the instrument (α = 0.772 for the youth version and α = 0.781 for the parent version). Construct validity assessed through confirmatory factor analysis showed support for the one factor structure of the scales, while multigroup confirmatory factor analysis endorsed the invariance across age, gender, and respondents (i.e., parent vs. youth report). The current research identifies both IGD scales to be reliable and valid, arguing for their utility for assessing IGD symptomatology among adolescents. Implications for theory, assessment, and future directions are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. The World Bank. Individuals using the internet (% of population). World Bank Open Data; 2023. https://data.worldbank.org

  2. Branscombe M. (2020, april 14). The Network Impact of the Global COVID-19 Pandemic. The New Stack. https://thenewstack.io/the-network-impact-of-the-global-covid-19-pandemic/

  3. Ruckwongpatr K, Chirawat P, Ghavifekr S, Gan WY, Tung SE, Nurmala I, Nadhiroh SR, Pramukti I, Lin C-Y. Problematic internet use (PIU) in youth: a brief literature review of selected topics. Curr Opin Behav Sci. 2022;46:101150. https://doi.org/10.1016/j.cobeha.2022.101150

    Article  Google Scholar 

  4. Lin C-Y, Ratan ZA, Pakpour AH. Collection of smartphone and internet addiction. BMC Psychiatry. 2023;23(1):427. https://doi.org/10.1186/s12888-023-04915-5

    Article  PubMed  PubMed Central  Google Scholar 

  5. Alimoradi Z, Lotfi A, Lin C-Y, Griffiths MD, Pakpour AH. Estimation of behavioral addiction prevalence during COVID-19 pandemic: a systematic review and Meta-analysis. Curr Addict Rep. 2022;9(4):486–517. https://doi.org/10.1007/s40429-022-00435-6

    Article  PubMed  PubMed Central  Google Scholar 

  6. American Psychiatric Association. (2013). Diagnostic and Statistical Manual of Mental Disorders (5th ed.) https://doi.org/10.1176/appi.books.9780890425596

  7. World Health Organization (WHO). (2019). 6C51 Gaming disorder. https://icd.who.int/browse11/l-m/en#/http://id.who.int/icd/entity/1448597234

  8. Wang Q, Ren H, Long J, Liu Y, Liu T. Research progress and debates on gaming disorder. Gen Psychiatry. 2019;32(3):e100071. https://doi.org/10.1136/gpsych-2019-100071

    Article  Google Scholar 

  9. Darvesh N, Radhakrishnan A, Lachance CC, Nincic V, Sharpe JP, Ghassemi M, Straus SE, Tricco AC. Exploring the prevalence of gaming disorder and internet gaming disorder: a rapid scoping review. Syst Reviews. 2020;9(1):68. https://doi.org/10.1186/s13643-020-01329-2

    Article  Google Scholar 

  10. Fam JY. Prevalence of internet gaming disorder in adolescents: a meta-analysis across three decades. Scand J Psychol. 2018;59(5):524–31. https://doi.org/10.1111/sjop.12459

    Article  PubMed  Google Scholar 

  11. Gentile DA, Bailey K, Bavelier D, Brockmyer JF, Cash H, Coyne SM, Doan A, Grant DS, Green CS, Griffiths M, Markle T, Petry NM, Prot S, Rae CD, Rehbein F, Rich M, Sullivan D, Woolley E, Young K. Internet gaming disorder in children and adolescents. Pediatrics. 2017;140(Suppl 2):81–S85. https://doi.org/10.1542/peds.2016-1758H

    Article  Google Scholar 

  12. Rehbein F, Kliem S, Baier D, Mößle T, Petry NM. Prevalence of internet gaming disorder in German adolescents: diagnostic contribution of the nine DSM-5 criteria in a state-wide representative sample. Addiction (Abingdon England). 2015;110(5):842–51. https://doi.org/10.1111/add.12849

    Article  PubMed  Google Scholar 

  13. Müller KW, Janikian M, Dreier M, Wölfling K, Beutel ME, Tzavara C, Richardson C, Tsitsika A. Regular gaming behavior and internet gaming disorder in European adolescents: results from a cross-national representative survey of prevalence, predictors, and psychopathological correlates. Eur Child Adolesc Psychiatry. 2015;24(5):565–74. https://doi.org/10.1007/s00787-014-0611-2

    Article  PubMed  Google Scholar 

  14. Mak K-K, Lai C-M, Watanabe H, Kim D-I, Bahar N, Ramos M, Young KS, Ho RCM, Aum N-R, Cheng C. Epidemiology of internet behaviors and addiction among adolescents in six Asian countries. Cyberpsychology Behav Social Netw. 2014;17(11):720–8. https://doi.org/10.1089/cyber.2014.0139

    Article  Google Scholar 

  15. Mentzoni RA, Brunborg GS, Molde H, Myrseth H, Skouverøe KJM, Hetland J, Pallesen S. Problematic video game use: estimated Prevalence and associations with Mental and Physical Health. Cyberpsychology Behav Social Netw. 2011;14(10):591–6. https://doi.org/10.1089/cyber.2010.0260

    Article  Google Scholar 

  16. Maftei A, Enea V. Symptoms of internet gaming disorder and parenting styles in Romanian adolescents. Psihologija. 2020;53:307–18. https://doi.org/10.2298/PSI190808008M

    Article  Google Scholar 

  17. Granic I, Lobel A, Engels RCME. The benefits of playing video games. Am Psychol. 2014;69(1):66–78. https://doi.org/10.1037/a0034857

    Article  PubMed  Google Scholar 

  18. Raith L, Bignill J, Stavropoulos V, Millear P, Allen A, Stallman HM, Mason J, De Regt T, Wood A, Kannis-Dymand L. Massively Multiplayer Online games and Well-Being: a systematic literature review. Front Psychol. 2021;12. https://doi.org/10.3389/fpsyg.2021.698799

  19. Männikkö N, Ruotsalainen H, Miettunen J, Pontes HM, Kääriäinen M. Problematic gaming behaviour and health-related outcomes: a systematic review and meta-analysis. J Health Psychol. 2020;25(1). https://doi.org/10.1177/1359105317740414

  20. Kakul F, Javed S. Internet Gaming Disorder: An Interplay of Cognitive Psychopathology. Asian Journal of Social Health & Behavior, 2023;6(1), 36-45. https://doi.org/10.4103/shb.shb_209_22

  21. Lin C-Y, Potenza MN, Pontes HM, Pakpour AH. Psychometric properties of the Persian Gaming Disorder Test and relationships with psychological distress and insomnia in adolescents. BMC Psychol. 2023;11(1):326. https://doi.org/10.1186/s40359-023-01368-z

    Article  PubMed  PubMed Central  Google Scholar 

  22. Lee K-Y, Chen C-Y, Chen J-K, Liu C-C, Chang K-C, Fung XCC, Chen J-S, Kao Y-C, Potenza MN, Pakpour AH, Lin C-Y. Exploring mediational roles for self-stigma in associations between types of problematic use of internet and psychological distress in youth with ADHD. Res Dev Disabil. 2023;133:104410. https://doi.org/10.1016/j.ridd.2022.104410

    Article  PubMed  Google Scholar 

  23. Bener A, Yildirim E, Torun P, Çatan F, Bolat E, Alıç S, Akyel S, Griffiths MD. Internet addiction, fatigue, and sleep problems among adolescent students: a large-scale study. Int J Mental Health Addict. 2019;17(4):959–69. https://doi.org/10.1007/s11469-018-9937-1

    Article  Google Scholar 

  24. Kamolthip R, Yang Y-N, Latner JD, O’Brien KS, Chang Y-L, Lin C-C, Pakpour AH, Lin C-Y. The effect of time spent sitting and excessive gaming on the weight status, and perceived weight stigma among Taiwanese young adults. Heliyon. 2023;9(3):e14298. https://doi.org/10.1016/j.heliyon.2023.e14298

    Article  PubMed  PubMed Central  Google Scholar 

  25. Puolitaival T, Sieppi M, Pyky R, Enwald H, Korpelainen R, Nurkkala M. Health behaviours associated with video gaming in adolescent men: a cross-sectional population-based MOPO study. BMC Public Health. 2020;20(1):415. https://doi.org/10.1186/s12889-020-08522-x

    Article  PubMed  PubMed Central  Google Scholar 

  26. Chang C-W, Chen J-S, Huang S-W, Potenza MN, Su J-A, Chang K-C, Pakpour AH, Lin C-Y. Problematic smartphone use and two types of problematic use of the internet and self-stigma among people with substance use disorders. Addict Behav. 2023;147:107807. https://doi.org/10.1016/j.addbeh.2023.107807

    Article  PubMed  Google Scholar 

  27. Benjet C, Orozco R, Albor YC, Contreras EV, Monroy-Velasco IR, Hernández Uribe PC, Báez Mansur PM, Covarrubias Díaz Couder MA, Quevedo Chávez GE, Gutierrez-García RA, Machado N, Andersson C, Borges G. A longitudinal study on the impact of internet gaming disorder on self-perceived health, academic performance, and social life of first-year college students. Am J Addictions. 2023;32(4):343–51. https://doi.org/10.1111/ajad.13386

    Article  Google Scholar 

  28. Islam MI, Biswas RK, Khanam R. Effect of internet use and electronic game-play on academic performance of Australian children. Sci Rep. 2020;10(1). https://doi.org/10.1038/s41598-020-78916-9

  29. Griffiths MD. (2016). Gaming addiction and internet gaming disorder. The video game debate: Unravelling the physical, social, and psychological effects of digital games (pp. 74–93). Routledge/Taylor & Francis Group.

  30. Vaccaro AG, Potenza MN. Diagnostic and classification considerations regarding Gaming Disorder: neurocognitive and neurobiological features. Front Psychiatry. 2019;10. https://doi.org/10.3389/fpsyt.2019.00405

  31. Clinical Psychology Review, 77, 101831. https://doi.org/10.1016/j.cpr.2020.101831.

  32. Stevens MW, Dorstyn D, Delfabbro PH, King DL. Global prevalence of gaming disorder: a systematic review and meta-analysis. Australian & New Zealand Journal of Psychiatry. 2020;0004867420962851. https://doi.org/10.1177/0004867420962851

  33. Wölfling K, Beutel ME, Müller KW. Construction of a standardized clinical interview to assess internet addiction: first findings regarding the usefulness of AICA-C. J Addict Res Ther. 2012. https://doi.org/10.4172/2155-6105.S6-003

    Article  Google Scholar 

  34. Lemmens JS, Valkenburg PM, Peter J. Development and validation of a game addiction scale for adolescents. Media Psychol. 2009;12(1):77–95. https://doi.org/10.1080/15213260802669458

    Article  Google Scholar 

  35. Király O, Tóth D, Urbán R, Demetrovics Z, Maraz A. Intense video gaming is not essentially problematic. Psychol Addict Behav. 2017;31(7):807–17. https://doi.org/10.1037/adb0000316

    Article  PubMed  Google Scholar 

  36. Pontes HM, Griffiths MD. Measuring DSM-5 internet gaming disorder: development and validation of a short psychometric scale. Comput Hum Behav. 2015;45:137–43. https://doi.org/10.1016/j.chb.2014.12.006

    Article  Google Scholar 

  37. Poon LYJ, Tsang HWH, Chan TYJ, Man SWT, Ng LY, Wong YLE, Lin C-Y, Chien C-W, Griffiths MD, Pontes HM, Pakpour AH. Psychometric properties of the internet gaming disorder scale-short-form (IGDS9-SF): systematic review. J Med Internet Res. 2021;23(10):e26821. https://doi.org/10.2196/26821

    Article  PubMed  PubMed Central  Google Scholar 

  38. Lemmens JS, Valkenburg PM, Gentile DA. The internet gaming disorder scale. Psychol Assess. 2015;27(2):567–82. https://doi.org/10.1037/pas0000062

    Article  PubMed  Google Scholar 

  39. Baiumy S, Elella EA, Hewedi D, Elkholy H. Internet gaming disorder scale: arabic version validation. Middle East Current Psychiatry. 2018;25(1):13–5. https://doi.org/10.1097/01.XME.0000526696.50303

    Article  Google Scholar 

  40. Sioni SR, Burleson MH, Bekerian DA. Internet gaming disorder: Social phobia and identifying with your virtual self. Comput Hum Behav. 2017;71:11–5. https://doi.org/10.1016/j.chb.2017.01.044

    Article  Google Scholar 

  41. Stockdale L, Coyne SM. Video game addiction in emerging adulthood: cross-sectional evidence of pathology in video game addicts as compared to matched healthy controls. J Affect Disord. 2018;225:265–72. https://doi.org/10.1016/j.jad.2017.08.045

    Article  PubMed  Google Scholar 

  42. Wartberg L, Kriston L, Kramer M, Schwedler A, Lincoln TM, Kammerl R. Internet gaming disorder in early adolescence: associations with parental and adolescent mental health. Eur Psychiatry. 2017;43:14–8. https://doi.org/10.1016/j.eurpsy.2016.12.013

    Article  CAS  PubMed  Google Scholar 

  43. Wartberg L, Zieglmeier M, Kammerl R. Accordance of adolescent and parental ratings of internet gaming disorder and their associations with Psychosocial aspects. Cyberpsychology Behav Social Netw. 2019;00(00):1–7. https://doi.org/10.1089/cyber.2018.0456

    Article  Google Scholar 

  44. Wartberg L, Kriston L, Kammerl R. Associations of Social Support, friends only known through the internet, and Health-Related Quality of Life with Internet Gaming Disorder in Adolescence. Cyberpsychology Behav Social Netw. 2017;20(7):436–41. https://doi.org/10.1089/cyber.2016.0535

    Article  Google Scholar 

  45. Putnick DL, Bornstein MH. Measurement Invariance conventions and reporting: the state of the art and future directions for Psychological Research. Dev Review: DR. 2016;41:71–90. https://doi.org/10.1016/j.dr.2016.06.004

    Article  PubMed  Google Scholar 

  46. Su W, Han X, Yu H, Wu Y, Potenza MN. Do men become addicted to internet gaming and women to social media? A meta-analysis examining gender-related differences in specific internet addiction. Comput Hum Behav. 2020;113:106480. https://doi.org/10.1016/j.chb.2020.106480

    Article  Google Scholar 

  47. Aebi M, Kuhn C, Banaschewski T, Grimmer Y, Poustka L, Steinhausen H-C, Goodman R. The contribution of parent and youth information to identify mental health disorders or problems in adolescents. Child Adolesc Psychiatry Mental Health. 2017;11(1):23. https://doi.org/10.1186/s13034-017-0160-9

    Article  Google Scholar 

  48. Cain MK, Zhang Z, Yuan K-H. Univariate and multivariate skewness and kurtosis for measuring nonnormality: prevalence, influence and estimation. Behav Res Methods. 2017;49(5):1716–35. https://doi.org/10.3758/s13428-016-0814-1

    Article  PubMed  Google Scholar 

  49. Bowen KN, Masa DR. Conducting measurement invariance tests with Ordinal Data: A Guide for Social Work Researchers. Journal of the Society for Social Work and Research. 2015;6(2):229–249. https://doi.org/10.1086/681607

  50. Widaman KF, Reise SP. (1997). Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 281–324). American Psychological Association. https://doi.org/10.1037/10222-009

  51. Muthén B, Muthén L. Mplus. Handbook of Item Response Theory. Chapman and Hall/CRC; 2017.

  52. Li C-H. Confirmatory factor analysis with ordinal data: comparing robust maximum likelihood and diagonally weighted least squares. Behav Res Methods. 2016;48(3):936–49. https://doi.org/10.3758/s13428-015-0619-7

    Article  ADS  PubMed  Google Scholar 

  53. Beauducel A, Herzberg PY. On the performance of Maximum Likelihood Versus means and Variance Adjusted weighted least squares estimation in CFA. Struct Equation Modeling: Multidisciplinary J. 2006;13(2):186–203. https://doi.org/10.1207/s15328007sem1302_2

    Article  MathSciNet  Google Scholar 

  54. Satorra A, Bentler PM. A scaled difference chi-square test statistic for moment structure analysis. Psychometrika. 2001;66(4):507–14. https://doi.org/10.1007/BF02296192

    Article  MathSciNet  Google Scholar 

  55. Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107(2):238–46. https://doi.org/10.1037/0033-2909.107.2.238

    Article  CAS  PubMed  Google Scholar 

  56. Bentler P, Bonett D. Significance tests and Goodness-of-Fit in analysis of Covariance structures. Psychol Bull. 1980;88:588–606. https://doi.org/10.1037/0033-2909.88.3.588

    Article  Google Scholar 

  57. Steiger JH. A note on multiple sample extensions of the RMSEA fit index. Struct Equation Modeling: Multidisciplinary J. 1998;5(4):411–9. https://doi.org/10.1080/10705519809540115

    Article  Google Scholar 

  58. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6(1):1–55. https://doi.org/10.1080/10705519909540118

    Article  Google Scholar 

  59. Browne MW, Cudeck R. Alternative ways of assessing Model Fit. Sociol Methods Res. 1992;21(2). https://doi.org/10.1177/0049124192021002005

  60. Hoelter JW. The analysis of Covariance structures: goodness-of-fit indices. Sociol Methods Res. 1983;11(3). https://doi.org/10.1177/0049124183011003003

  61. Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model. 2002;9(2):233–55. https://doi.org/10.1207/S15328007SEM0902_5

    Article  MathSciNet  Google Scholar 

  62. Svetina D, Rutkowski L, Rutkowski D. Multiple-group invariance with categorical outcomes using updated guidelines: an illustration using Mplus and the lavaan/semTools packages. Struct Equation Modeling: Multidisciplinary J. 2020;27(1):111–30. https://doi.org/10.1080/10705511.2019.1602776

    Article  Google Scholar 

  63. Dimitrov DM. Testing for Factorial Invariance in the Context of Construct Validation. Meas Evaluation Couns Dev. 2010;43(2):121–49. https://doi.org/10.1177/0748175610373459

    Article  Google Scholar 

  64. Alavi M, Visentin DC, Thapa DK, Hunt GE, Watson R, Cleary M. Chi-square for model fit in confirmatory factor analysis. J Adv Nurs. 2020;76(9):2209–11. https://doi.org/10.1111/jan.14399

    Article  PubMed  Google Scholar 

  65. Bergh D. Chi-Squared Test of Fit and Sample Size-A comparison between a Random Sample Approach and a Chi-Square Value Adjustment Method. J Appl Meas. 2015;16(2):204–17.

    PubMed  Google Scholar 

  66. Chen FF. Sensitivity of goodness of fit indexes to lack of Measurement Invariance. Struct Equation Modeling: Multidisciplinary J. 2007;14(3):464–504. https://doi.org/10.1080/10705510701301834

    Article  MathSciNet  Google Scholar 

  67. Evren C, Dalbudak E, Topcu M, Kutlu N, Evren B. The Psychometric properties of the Turkish version of the internet gaming disorder scale. Dusunen Adam The Journal of Psychiatry and Neurological Sciences. 2017;316–24. https://doi.org/10.5350/DAJPN2017300405

  68. Vandenberg RJ, Lance CE. A review and synthesis of the Measurement Invariance Literature: suggestions, practices, and recommendations for Organizational Research. Organizational Res Methods. 2000;3(1):4–70. https://doi.org/10.1177/109442810031002

    Article  Google Scholar 

  69. Cuong VM, Assanangkornchai S, Wichaidit W, Hanh VTM, Hanh HTM. Associations between gaming disorder, parent-child relationship, parental supervision, and discipline styles: findings from a school-based survey during the COVID-19 pandemic in Vietnam. J Behav Addictions. 2021;10(3):722–30. https://doi.org/10.1556/2006.2021.00064

    Article  Google Scholar 

  70. Schneider LA, King DL, Delfabbro PH. Family factors in adolescent problematic internet gaming: a systematic review. J Behav Addictions. 2017;6(3):321–33. https://doi.org/10.1556/2006.6.2017.035

    Article  Google Scholar 

  71. Adamkovič M, Martončik M, Karhulahti V-M, Ropovik I. Network structures of internet gaming disorder and gaming disorder: Symptom operationalization causes variation. Psychology of addictive behaviors. No Pagination Specified-No Pagination Specified; 2023. https://doi.org/10.1037/adb0000960

  72. Karhulahti V-M, Martončik M, Adamkovič M. Measuring internet gaming disorder and gaming disorder: a qualitative content validity analysis of validated scales. Assessment. 2023;30(2):402–13. https://doi.org/10.1177/10731911211055435

    Article  PubMed  Google Scholar 

  73. Pontes HM, Schivinski B, Sindermann C, Li M, Becker B, Zhou M, Montag C. Measurement and Conceptualization of Gaming Disorder According to the World Health Organization Framework: the development of the Gaming Disorder Test. Int J Mental Health Addict. 2021;19(2):508–28. https://doi.org/10.1007/s11469-019-00088-z

    Article  Google Scholar 

  74. Ghazi FR, Gan WY, Tung SEH, Chen I-H, Poon WC, Siaw Y-L, Ruckwongpatr K, Chen J-S, Huang S-W, Griffiths MD, Lin C-Y. Problematic gaming in Malaysian University students: translation and psychometric evaluation of the malay Language versions of Gaming Disorder Test and Gaming Disorder Scale for Young adults. Eval Health Prof. 2023;01632787231185845. https://doi.org/10.1177/01632787231185845

  75. Wu T-Y, Huang S-W, Chen J-S, Ruckwongpatr K, Kukreti S, Strong C, Pontes HM, Lin I-C, Lin C-Y, Potenza MN, Pakpour AH. Translation and validation of the Gaming Disorder Test and Gaming Disorder Scale for adolescents into Chinese for Taiwanese Young adults. Compr Psychiatr. 2023;124:152396. https://doi.org/10.1016/j.comppsych.2023.152396

    Article  Google Scholar 

  76. Chen IH, Chang YL, Yang YN, Yeh YC, Ahorsu DK, Adjorlolo S, Strong C, Hsieh YP, Huang PC, Pontes HM, Griffiths MD, Lin CY. Psychometric properties and development of the Chinese versions of Gaming Disorder Test (GDT) and gaming disorder scale for adolescents (GADIS-A). Asian J Psychiatry. 2023;86(103638). https://doi.org/10.1016/j.ajp.2023.103638

  77. Yen J-Y, Higuchi S, Lin P-Y, Lin P-C, Chou W-P, Ko C-H. Functional impairment, insight, and comparison between criteria for gaming disorder in the International classification of diseases, 11 Edition and internet gaming disorder in Diagnostic and Statistical Manual of Mental disorders, Fifth Edition. J Behav Addictions. 2022;11(4):1012–23. https://doi.org/10.1556/2006.2022.00079

    Article  Google Scholar 

  78. Starcevic V, Choi TY, Kim TH, Yoo S-K, Bae S, Choi B-S, Han DH. Internet gaming disorder and gaming disorder in the context of seeking and not seeking treatment for video-gaming. J Psychiatr Res. 2020;129:31–9. https://doi.org/10.1016/j.jpsychires.2020.06.007

    Article  PubMed  Google Scholar 

  79. Kim HS, Son G, Roh E-B, Ahn W-Y, Kim J, Shin S-H, Chey J, Choi K-H. Prevalence of gaming disorder: a meta-analysis. Addict Behav. 2022;126:107183. https://doi.org/10.1016/j.addbeh.2021.107183

    Article  PubMed  Google Scholar 

  80. Hofstede G, Hofstede GJ, Minkov M. (2010). Cultures and organizations: Software of the mind: Intercultural cooperation and its importance for survival. McGraw-Hill

  81. Achenbach TM, McConaughy SH, Howell CT. Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychol Bull. 1987;213–32. https://doi.org/10.1037/0033-2909.101.2.213

  82. Chiorri C, Hall J, Casely-Hayford J, Malmberg L-E. Evaluating measurement Invariance between Parents using the strengths and difficulties Questionnaire (SDQ). Assessment. 2016;23(1):63–74. https://doi.org/10.1177/1073191114568301

    Article  PubMed  Google Scholar 

  83. Mellor D, Wong J, Xu X. Interparent agreement on the strengths and difficulties questionnaire: a Chinese study. Journal of Clinical Child & Adolescent Psychology 2011;40(6):890–896. https://doi.org/10.1080/15374416.2011.614580. 

    Article  Google Scholar 

  84. Tan C-L. Toward an integrated framework for examining the addictive use of smartphones among young adults. Asian J Social Health Behav. 2023;6(3):119. https://doi.org/10.4103/shb.shb_206_23

    Article  MathSciNet  Google Scholar 

  85. Yang Q, Wang H, Wu H, Li W, Zhang Y, Yao Y, Yuan X, Chen C, Wang Y, Zhong Y, Wang W, Zhang M, Yang Y, Liu H, Zhang K. Effect of online game policy on smartphone game play time, addiction, and emotion in rural adolescents of China. BMC Psychiatry. 2023;23(1):814. https://doi.org/10.1186/s12888-023-05325-3

    Article  PubMed  PubMed Central  Google Scholar 

  86. Poetar C-R, Dobrean A, Florean IS. Problematic smartphone use and Mental Health problems: a Network analysis of Romanian adolescents. Youth & Society. 2023;0044118X231218295. https://doi.org/10.1177/0044118X231218295

  87. Nurmala I, Nadhiroh SR, Pramukti I, Tyas LW, Zari AP, Griffiths MD, Lin C-Y. Reliability and validity study of the Indonesian smartphone application-based addiction scale (SABAS) among college students. Heliyon. 2022;8(8). https://doi.org/10.1016/j.heliyon.2022.e10403

Download references

Acknowledgements

Part of this work was supported by a grant of the Romanian Ministry of Education and Research, CNCS - UEFISCDI, project number PN-III-P4-ID-PCE-2020-2417, within PNCDI III awarded to dr. Dobrean.

Author information

Authors and Affiliations

  1. International Institute for The Advanced Studies of Psychotherapy and Applied Mental Health, Babeș-Bolyai University, Republicii Street 37, Cluj-Napoca, 400015, Romania

    Iulia Maria Coșa & Anca Dobrean

  2. Evidence Based Psychological Assessment and Interventions Doctoral School, Babeș-Bolyai University, Cluj-Napoca, Romania

    Iulia Maria Coșa

  3. Department of Clinical Psychology and Psychotherapy, Babeş-Bolyai University, Republicii Street 37, Cluj-Napoca, 400015, Romania

    Anca Dobrean

  4. Department of Psychology, Babeș-Bolyai University, No. 37, Republicii Street, Cluj-Napoca, 40015, Romania

    Robert Balazsi

Authors
  1. Iulia Maria Coșa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anca Dobrean
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Robert Balazsi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed equally to the manuscript. Specifically, author contributions are as follows (with author initials): IC: Methodology, Investigation, Formal analysis, Writing - original draft; AD: Conceptualization, Methodology, Writing - review and editing, supervision; RB: Methodology, Formal analysis, Writing - review and editing, supervision.

Corresponding author

Correspondence to Anca Dobrean.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Compliance with Ethical Standards

All procedures were approved by the Research Ethics Board of Babeș-Bolyai University and were conducted according to the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.

Informed Consent

All subjects were informed about the study and parents provided informed consent.

Open Data

The data that support the findings of this study are openly available in OSFRegistries at https://osf.io/afrtu/?view_only=3d9318977e554214a576b5c2055493c3.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Coșa, I.M., Dobrean, A. & Balazsi, R. Measurement Invariance of the Lemmens Internet Gaming Disorder Scale-9 Across Age, Gender, and Respondents. Psychiatr Q 95, 137–155 (2024). https://doi.org/10.1007/s11126-024-10066-x

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11126-024-10066-x

Keywords

Search

Navigation