Introduction

Over the past decades, internet use has grown exponentially among all age groups, with more than 4 billion internet users worldwide as of 2021 (Internet World Stats, 2021). Along with the popularity of internet use is the increasing number of people with problematic internet use. Recent evidence shows that the estimated prevalence of problematic internet use (PIU) ranged from 20.0 to 44.6% in different regions (Chia et al., 2020; Endomba et al., 2022), and this phenomenon was found to be more prominent during the COVID-19 pandemic (Masaeli & Farhadi, 2021). Such findings have heightened concerns about the potential adverse impact of problematic internet use on various aspects of mental health, such as depressive symptoms, anxiety, loneliness, and subjective well-being (Peng et al., 2021; Shan et al., 2021; Yang et al., 2022). Given the accessibility to the internet, the lack of self-control and immaturity of physical and psychological development of students, it is imperative that researchers pay special attention to the issue as related to student population (Dong et al., 2020; Hwang et al., 2020). Thus, this study examines the overall relationship between problematic internet use and students’ mental health outcomes.

Although some meta-analytic reviews have focused on the relationship between problematic internet use and one or more aspects of mental health (e.g., Lei et al., 2020; Saadati et al., 2021, See Table 1), there are obvious deficiencies in existing meta-analytic reviews, such as a small number of primary studies included in these reviews, inconsistent inclusion criteria (e.g., sample, region), and lack of moderator analyses to explore possible factors contributing to the inconsistent findings across studies. As a result, these reviews provided us with a relatively limited and fragmented understanding about the issue. To address such research gaps, this study synthesized empirical studies examining the relationships between problematic internet use and the major mental health outcomes of students. Specifically, the present study conducted five meta-analyses, with each focusing on one of five different mental health outcomes (i.e., depressive symptoms, anxiety, loneliness, subjective well-being, and other mental health outcomes) as discussed in Tang et al. (2021), such that this study could provide a more comprehensive and robust review of this issue among students.

Table 1 Meta-analyses on the relationships between problematic internet use and mental health

Problematic internet use is characterized by excessive use of the internet, which may lead to significant impairment or distress (Laconi et al., 2014; Shaw & Black, 2008). Mental health, on the other hand, involves both negative (e.g., depressive symptoms, anxiety, loneliness, etc.) and positive indicators (e.g., life satisfaction, subjective well-being, etc.). Two theories about the associations between problematic internet use and mental health outcomes were discussed. According to the internet use displacement hypothesis (Nie et al., 2002), the amount of time available to an individual is more or less fixed. Time spent on the internet replaces face-to-face interaction, which could be detrimental to interpersonal relationships with friends and family in real life, thus leading to a sense of alienation. This sense of alienation, in turn, could have a negative impact on the mental health of the individual. On the other hand, however, drawing on the uses and gratification theory of Parker and Plank (2000), some researchers posited that the convenience, entertainment, anonymity, and other characteristics of the internet can satisfy the cognitive and emotional needs of students, which could effectively reduce their sense of loneliness and improve their life satisfaction (Boylu & Günay, 2019; Serin, 2011).

In general, problematic internet use was shown to have positive relationship with negative mental health indicators, and negative relationship with positive mental health indicators. But the empirical findings from many individual studies have been far from being consistent. With regard to problematic internet use’s association with negative mental health indicators (e.g., depressive symptoms, anxiety, loneliness), while relatively strong positive associations were reported in many studies (e.g., Bousono et al., 2017; Przepiorka et al., 2021; Sultana & Uddin, 2019), very weak or even non-significant associations were revealed by some other studies (e.g., Javaeed et al., 2019; Shen et al., 2021; Turan et al., 2020). With respect to problematic internet use’s relationship with positive mental health indicators (e.g., subjective well-being), similar inconsistencies were observed, with some studies reporting strong negative correlations between problematic internet use and subjective well-being (e.g., Agbaria & Bdier, 2021; Dalton & Cassidy, 2020), while there are other studies reporting close to zero or even positive associations between problematic internet use and subjective well-being (e.g., Serin, 2011; Turan et al., 2020; Zeng et al., 2021). Taken together, the empirical findings on the strengths and directions of the relationships between problematic internet use and mental health outcomes are largely inconsistent. Thus, a systematic and comprehensive meta-analytic review is warranted to further enhance our understanding of this issue.

From the individual studies, little insight can be gained about why the findings in one study differed from those in another. The research literature related to quantitative synthesis of individual studies, however, suggests that the characteristics associated with different studies (e.g., methodological and contextual variations across the studies) may often have played a role in contributing to the inconsistencies of findings across the individual studies. As a result, in a meta-analysis study, the study characteristics of the individual studies may often be considered as potential “moderators” that may partially explain the inconsistencies observed across the studies. Based on some previous meta-analytic studies and on the consideration for information availability from the empirical studies in this area, a few variables of study characteristics were selected as potential moderators that could have contributed to the inconsistency in prior findings regarding the associations between problematic internet use and mental health outcomes, as detailed below (i.e., school grade, region, measure of problematic internet use, measure of mental health, publication year, and gender).

School Grade

The associations between problematic internet use and mental health outcomes showed some variations across school grade levels. Some studies reported statistically significant, positive, and strong associations between problematic internet use and depressive symptoms for undergraduate students (e.g., r = 0.64; Dong & Li, 2020). Yet other studies show statistically non-significant associations between problematic internet use and mental health outcomes for secondary students (e.g., Cerruti et al., 2017). Similar phenomenon was observed from other empirical studies (e.g., Awasthi et al., 2020; Ha & Hwang, 2014; Yadav et al., 2013). Thus, “school grade” was proposed as a potential moderator variable in our moderator analyses. More specifically, “school grade” was coded as “secondary” for an included study with its sample consisting of students from middle or high schools, “undergraduate” if the sample consisted of college students, and “others” if the sample consisted of students from primary schools or mixed groups (i.e., both primary and secondary schools, both secondary schools and universities).

Region

Research on the relationship between problematic internet use and mental health has been carried out globally (e.g., U.S.A., China, Turkey, Korea). There has been some evidence that the prevalence rate of problematic internet use varied across different nations. For example, a meta-analysis was conducted to estimate the prevalence of problematic internet use in 31 nations and revealed that problematic internet use rates were the highest in the Middle East (10.9%) and the lowest in Northern and Western Europe (2.6%) (Cheng & Li, 2014). Past empirical studies also implied that there were regional differences in the associations of problematic internet use with mental health outcomes, such as anxiety and loneliness (Akhter et al., 2020; Vigna-Taglianti et al., 2017; Zhang et al., 2013). Thus, it would be meaningful to include region as a potential moderator. In this meta-analysis, depending on where the study was conducted, “region” was coded into five categories: Eastern Asia (e.g., China, Japan, Korea), Western Asia (e.g., Turkey, Iran, Israel), Southern Asia (e.g., India, Bangladesh), Europe (e.g., Spanish, Finland, the UK), and others (e.g., America, Chile).

Measure of Problematic Internet Use

A variety of measures has been used to assess problematic internet use. These measures were based on diverse theoretical models and differed in the dimension or diagnostic criteria (Laconi et al., 2014), which might lead to different findings across studies that used different measurement tools. In Schoenfeld and Zheng (2012), two measures (Young’s Internet Addiction Test and Caplan’s Generalized Problematic Internet Use Scale) were used to estimate the prevalence rate of problematic internet use among undergraduate students, and the study revealed that the proportion of students identified at risk for problematic internet use varied considerably between the two instruments (18.3% vs 50.4%). Similarly, a meta-analysis also showed that the prevalence of problematic internet use differed by assessment tools (Li et al., 2018). As a result, the measure of problematic internet use could be a potential moderator that might have resulted in the heterogeneity of the findings across previous studies. In this synthesis, for the included primary studies, “measure of problematic internet use” was coded as five categories to reflect the most widely used measures for problematic internet use: Internet Addiction Test, Chen Internet Addiction Scale, Young’s Diagnostic Questionnaire, Online Cognition Scale, and others.

Measures of Mental Health

Depending on the mental health outcomes of interest (e.g., depressive symptoms, anxiety), various measures could be used for evaluating the mental health outcomes. There has been some evidence that the measures for mental health outcomes used in a study could affect the associations between problematic internet use and mental health indicators in empirical studies (e.g., Cai et al., 2021; Shen et al., 2021; Zhang et al., 2021). For example, Zafar et al. (2018) indicated that there was a significant and strong positive correlation between mental health assessed by the Mental Health Inventory and problematic internet use (r = 0.73), while Mamun et al. (2020) showed a statistically significant weak relationship between psychological health evaluated by the General Health Questionnaire and problematic internet use (r = 0.14). Therefore, the measure for mental health was proposed and included as a potential moderator in the present meta-analysis study. In this regard, we coded this study feature only in the studies that assessed depressive symptoms or anxiety as the mental health outcomes, due to the limited categories of measures for other mental health outcomes. More specifically, for studies that focused on depressive symptoms and anxiety, “measure of mental health” was coded as these categories: Beck Depression Inventory, Children’s Depression Inventory, Centre for Epidemiologic Studies Depression Scale, Depression Anxiety Stress Scale, Symptom Checklist-90, Self-Rating Depression scale, Patient Health Questionnaire, Beck Anxiety Inventory, Liebowitz Social Anxiety Scale, Self-Rating Anxiety Scale, and others.

Publication Year

With the increasing popularity and rapid development of the internet, the number of internet users has been growing rapidly. In many societies, the internet has become an indispensable part of people’s daily life. The research has suggested that the prevalence rate of problematic internet use is also increasing (Modara et al., 2017; Shao et al., 2018). Moreover, research suggested that, with the society’s more dependence on the internet, the connection between internet habits and mental health, such as depressive symptoms, could be stronger than before (Tokunaga, 2017). Consequently, the research findings on the issue of problematic internet use and mental health could change over time, thus publication year of a study was considered as a potential moderator variable in the present study, and this potential moderator was coded as a continuous variable (i.e., year in which a study was published).

Gender

There is growing amount of evidence that differences can be found in internet use and the prevalence rate of problematic internet use between males and females, which may contribute to distinct psychological problems (Ha & Hwang, 2014; Lozano-Blasco & Cortes-Pascual, 2020; Ostovar et al., 2016). Some studies showed that the relationships of problematic internet use with depressive symptoms, anxiety, and subjective well-being were stronger for females than males (Baloglu et al., 2018; Ha & Hwang, 2014; Lei et al., 2020), but findings to the opposite (Lozano-Blasco & Cortes-Pascual, 2020), as well as findings of no difference between gender groups (Tokunaga, 2017), also existed. With regard to these inconsistent findings, it is prudent to consider the potential moderating effect of gender in the relationship between problematic internet use and mental health outcomes in this study. Operationally, the proportion of females in the study sample was used in the moderator analysis in this meta-analysis.

Current Study

Many studies have been conducted to investigate the relationship between problematic internet use and mental health, and considerable inconsistencies in the findings have emerged across the individual studies. Such a situation calls for a comprehensive synthesis of the relevant individual studies for the purpose of developing a better understanding of the overall relationship between problematic internet use and mental health outcomes, as well as a better understanding of how and why the findings of the individual studies varied. This meta-analysis aimed to estimate the overall relationships between problematic internet use and different mental health outcomes (i.e., depressive symptoms, anxiety, loneliness, subjective well-being, and other mental health outcomes) of students. Then, moderator analyses were conducted to explore whether some study characteristics (i.e., school grade, region, measure of problematic internet use, measure of mental health, publication year, and gender) could have contributed to the observed inconsistent findings across the individual studies.

Methods

Literature Search

This study used five online databases, namely Web of Science, PubMed, PsycINFO, ProQuest and Scopus, and systematically searched for the research literature related to the relationship between PIU and mental health outcomes. The terms used were: (“internet addiction” OR “pathological internet use” OR “problematic internet use” OR “internet dependency” OR “internet disorder” OR “compulsive internet use” OR “excessive internet use” OR “internet overuse”) AND (“mental health” OR “anxiety” OR “loneliness” OR “depression” OR “subjective well-being” OR “life satisfaction” OR “stress” OR “psychopathology” OR “suicide” OR “aggression” OR “unhappiness” OR “positive affect” OR “negative affect”). Furthermore, relevant studies were also identified by using Google Scholar, and those from the reference lists in the included studies, from previous reviews or meta-analyses. The search covered the research literature up to February 2022.

Inclusion and Exclusion Criteria

To be included in this meta-analysis, a study met the following criteria:

  1. (1)

    The study examined the association between PIU and mental health outcomes (e.g., depressive symptoms, anxiety, loneliness, subjective well-being, suicide, aggression, hostility, stress, etc.).

  2. (2)

    The PIU measurement used in a primary study assessed generalized PIU rather than specific subtype of PIU (e.g., internet gaming disorder, smartphone addiction, etc.). For measuring generalized PIU, the items focus on the overall internet use (e.g., “How often do you choose to spend your time online rather than going out with others?” and “How often do you spend time online when you’d rather sleep?”), rather than a specific aspect of the network use (e.g., “I have slept less than 4 h more than one time due to using smartphone.” and “I find that I am becoming more and more dependent on smartphone longer and longer.”).

  3. (3)

    The study sample consisted of students from elementary, middle, high schools, and colleges.

  4. (4)

    The study reported zero-order correlation r between PIU and mental health outcome, or provided other statistical information (e.g., t, χ2, F values), to allow us to derive the correlation between PIU and mental health outcome.

  5. (5)

    This meta-analysis focused on the studies involving normal population. Studies involving clinical populations were excluded. For example, the study by Alpaslan et al. (2016) involved adolescents with major depressive disorders, and such or similar studies were not included in this meta-analysis.

  6. (6)

    If a study used a longitudinal design to record the data at different time points, we only used the information of the first measurement. For instance, in the longitudinal study by Ciarrochi et al. (2016), the relationship between compulsive internet use and mental health was measured four times at Grade 8, 9, 10 and 11, respectively. Only the results measured at Grade 8 were used in our meta-analysis.

  7. (7)

    The study was published in an English academic journal.

Study Selection

The selection procedure was described graphically in Fig. 1. More specifically, in the initial search, 4475 non-duplicate studies were obtained. After screening all titles and abstracts, 468 studies were identified as being relevant for further consideration. Two authors of this study read these articles carefully based on the aforementioned inclusion criteria, and 245 studies were excluded due to various reasons (e.g., no sufficient data, no PIU or mental health outcomes, reviews). Then, the authors of 68 studies that did not report the zero-order correlation between PIU and mental health in their articles were contacted to request this information, and only six responses were received to provide us with the data. Eventually, a total of 223 studies published from 2002 to 2022 were included in the present meta-analysis. The characteristics and citations of all studies were presented in Online Appendix A and Online Appendix C respectively.

Fig. 1
figure 1

PRISMA flow chart of the selection of studies for the meta-analysis

Coding Process

Two authors of this study coded the primary studies. They first independently coded 30% of the 223 studies, and verified the coding information together. The inter-rater reliability was assessed by intraclass correlation coefficients (ICC) for continuous variables and Cohen’s Kappa (κ) for categorical variables. Specifically, the internal consistency values of moderator variables were: school grade (κ = 0.974), region (κ = 1.000), measure of PIU (κ = 1.000), measure of mental health (κ = 0.948), publication year (ICC = 0.999), and gender (ICC = 0.998). These results showed high inter-rater reliability among the coders.

Quality Appraisal

Davids et al. (2017) presented the Methodological Quality Appraisal Tool for evaluating the quality of non-randomized, cross-sectional studies in psychology or other social sciences. This measure was adapted in recent meta-analytic reviews for the purpose of assessing the quality of included studies in a systematic review (e.g. He et al., 2020a, 2020b). In this study, the same approach for quality appraisal of the included studies was used. Specifically, this tool includes 6 items, reflecting five domains of study quality (sampling methods, measurement tool, the data sources used, whether PIU or mental health outcomes were examined, and whether the relationship between PIU and mental health was discussed). Each of the six items was rated as either “yes” or “no” and assigned a score of “1” or “0”, respectively. The quality appraisal score was then obtained by dividing the total score by total number of items multiplied by 100 (expressed as a percentage). As discussed previously (e.g., Davids et al., 2017; Roman & Frantz, 2013), appraisal scores of 0–33%, 34–66%, and 67–100% indicate bad, satisfactory, and good methodological quality, respectively. The quality assessment was conducted by two authors independently and discrepancies were resolved through discussion between the two evaluators.

Data Analysis

As mentioned earlier, mental health is multi-faceted, and different studies covered different aspects of mental health. In the current meta-analysis, studies that covered negative (depressive symptoms, anxiety, loneliness, suicide, aggression, hostility, stress, etc.) and positive (subjective well-being) indicators of mental health were included. These five categories of mental health outcomes (i.e., depressive symptoms, anxiety, loneliness, subjective well-being, and other mental health outcomes) were treated as different outcomes, and a meta-analysis was conducted for each of these five mental health outcomes. So essentially, the current synthesis study consists of five meta-analyses.

In our meta-analysis, the zero-order correlation coefficient rs from the included studies between PIU and a specific mental health outcome were treated as effect sizes. When studies reported other types of statistical results, those were transformed into correlation coefficients based on well-documented statistical conversion formulas (Yap & Jorm, 2014). For a negative mental health outcome (e.g., depressive symptoms), a positive r indicated that the higher level of PIU was associated with more serious mental health problems. For the positive mental health outcome (i.e., subjective well-being), a negative r indicated that the higher level of PIU was associated with lower level of subjective well-being, thus more serious mental health issue. Since correlation coefficients were not normally distributed, all effect sizes were initially converted to Fisher’s z-scores for computations. After all the computations, the Fisher’s z-scores were transformed back to correlation coefficients for easier interpretation.

The traditional approach to meta-analysis assumes that the effect sizes are independent of each other. However, some studies included in our meta-analysis reported multiple effect sizes based on the same sample and these effect sizes were related. Therefore, a three-level meta-analysis was performed to deal with interdependency of effect sizes (Assink & Wibbelink, 2016). In the current meta-analysis, three different sources of variances were distinguished in the three-level meta-analytic model: sampling variance at level 1; variance across effect sizes within the same study at level 2; variance across effect sizes between studies al level 3 (Cheung, 2014). The appropriateness and the advantages of using this meta-analytic model over traditional approach for such data have been discussed and supported in the literature (Assink & Wibbelink, 2016). All statistical analyses were conducted by using Viechtbauer’s (2010) metafor package in the R statistical platform.

Assessment for Publication Bias

Analysis for potential publication bias was conducted as preliminary analysis prior to meta-analysis. In meta-analysis research literature, publication bias was assumed that studies reporting statistically significant results were easier to get published than those with statistically non-significant findings, and this is also called “file-drawer problem” (Rosenthal, 1979). This assumption, if correct, may lead to estimation error for the true effect size. With this consideration, several widely accepted methods in meta-analysis research literature were used to assess the likelihood that such a problem existed in our data in the current meta-analysis. First, the funnel plot was applied to estimate the presence or absence of publication bias. If effect sizes of studies were symmetrically distributed on both sides of the mean effect sizes, the absence of publication bias would be supported (Borenstein et al., 2009). Moreover, the trim-and-fill method was also used to assess this problem (Duval & Tweedie, 2000), as proposed by Fernández-Castilla et al. (2021), to detect the potential publication bias.

Results

Characteristics of Included Studies

In total, 223 studies involving 498,167 participants met the inclusion criteria and 512 effect sizes were obtained in the present meta-analysis. More specifically, for depressive symptoms, there were 131 studies with 159 effect sizes that involved a cumulative total of 336,642 participants. For anxiety, there were 67 studies with 91 effect sizes that involved a cumulative total of 92,205 participants. For loneliness, there were 56 studies with 69 effect sizes that involved a cumulative total of 79,921 participants. For subjective well-being, there were 29 studies with 38 effect sizes that involved a cumulative total of 208,968 participants. Finally, for other mental health outcomes, there were 76 studies with 155 effect sizes that involved a cumulative total of 217,028 participants.

Quality Appraisal

The methodological appraisal scores of the included studies ranged from 50 to 100%, indicating overall adequate quality for the included studies. The details of the quality evaluation of each study were presented in Online Appendix B.

Overall Analysis

The overall analysis results for the relationships between PIU and mental health outcomes are shown in Table 2. More concretely, overall, the four negative mental health outcomes (depressive symptoms, anxiety, loneliness, and other mental health outcomes) were all positively associated with PIU (r = 0.313, p < 0.001; r = 0.277, p < 0.001; r = 0.252, p < 0.001; r = 0.289, p < 0.001, respectively). The positive mental health outcome, subjective well-being, was negatively associated to PIU with similar magnitude (r = − 0.213, p < 0.001). These summary findings indicated that higher levels of PIU were associated with more serious mental health issues (depressive symptoms, anxiety, loneliness, and other mental health outcomes), and with lower level of subjective well-being. According to Cohen’s (1992) guidelines that the r value of 0.1, 0.3, and 0.5 refer to small, medium, and large effects respectively, these overall meta-analysis findings indicated moderate relationships between PIU and mental health outcomes across many individual studies.

Table 2 Results for the overall analysis of the relation between problematic internet use and mental health outcomes

The results of the likelihood-ratio tests for heterogeneity across the effect sizes revealed that there was statistically significant within-study effect size heterogeneity (i.e., statistically significant level-2 variances) or statistically significant between-study effect size heterogeneity (i.e., statistically significant level-3 variances) for the five mental health outcomes (i.e., depressive symptoms, anxiety, loneliness, subjective well-being, and other mental health outcomes). Thus, we conducted moderator analyses to explore whether some study characteristics could have moderated the association between PIU and mental health outcomes for these five domains (i.e., depressive symptoms, anxiety, loneliness, subjective well-being, and other mental health outcomes).

Moderator Analyses

Depressive Symptoms

As shown in Table 3, across the studies that examined the relationship between depressive symptoms and PIU, three study characteristics appeared to be moderators for the heterogeneity of the effect sizes: school grade (F(2, 156) = 5.054, p = 0.007), region (F(4, 154) = 2.668, p = 0.034), and publication year (F(1, 157) = 5.482, p = 0.020). More specifically, this association was stronger in the studies involving samples of undergraduate students (r = 0.353) than in those involving samples of secondary school students (r = 0.281). For region as a moderator, this relationship appeared to be weaker in the studies involving samples in East Asia (r = 0.282) than those in other regions. Additionally, the moderation analysis result of publication year showed that the magnitude of the “PIU-depressive symptoms” association became stronger over time. No moderating effects were found for other coded moderator variables (measure of PIU, measure of depressive symptoms, and gender).

Table 3 Results for the moderator analysis of the relation between problematic internet use and depressive symptoms

Anxiety

Table 4 showed the moderator analysis results for anxiety, and only measure of PIU appeared to be a moderator for the heterogeneity of the effect sizes (F(3, 87) = 2.904, p = 0.039). More precisely, the association between PIU and anxiety was the strongest when PIU was assessed with YDQ (r = 0.377). Other moderators (school grade, region, measure of anxiety, publication year, gender) appeared not to have accounted for any statistically significant amount of between-study effect-size heterogeneity.

Table 4 Results for the moderator analysis of the relation between problematic internet use and anxiety

Loneliness

The results of the moderator analyses of the connection between PIU and loneliness were shown in Table 5. Two study features turned out to be statistical moderators for the effect size heterogeneity across the studies that examined the relationship between PIU and loneliness: region (F(4, 64) = 2.807, p = 0.033) and gender (F(1, 64) = 5.180, p = 0.026). The averaged effect size (r = 0.174) from the studies involving samples in West Asia, and that (r = 0.409) from studies involving samples in South Asia were the smallest and the largest respectively, with the effect sizes conducted in other regions being somewhere in-between. For gender (operationalized as the proportion of females in a study sample) as a moderator, the studies with larger proportions of females showed weaker association between PIU and loneliness, and this observation is to be discussed later. Other coded moderator variables (school grade, measure of PIU, publication year) showed no statistical moderation effects.

Table 5 Results for the moderator analysis of the relation between problematic internet use and loneliness

Subjective Well-Being

The results of the moderator analyses for subjective well-being were presented in Table 6, and only publication year was found to be a significant moderator (F(1, 36) = 10.355, p = 0.003). The correlation between PIU and subjective well-being became smaller over time. No moderating effects were found for other coded moderator variables (school grade, region, measure of PIU, gender).

Table 6 Results for the moderator analysis of the relation between problematic internet use and subjective well-being

Other Mental Health Outcomes

As shown in Table 7, region (F(4, 150) = 4.321, p = 0.002) and publication year (F(1, 153) = 5.385, p = 0.022) showed statistically significant moderating effects on the heterogeneity of the effect sizes from the studies that examined the relationship between PIU and other mental health outcomes. More specifically, larger effect sizes were found in the studies involving samples from Europe (r = 0.356), South Asia (r = 0.352), and West Asia (r = 0.344) than in the studies involving samples from East Asia (r = 0.217) and “Others” (r = 0.270). The moderating effect of publication year indicated that the relationship between PIU and other mental health outcomes was stronger in more recent studies. Other coded study features (school grade, measure of PIU, gender) did not show statistical effect on the heterogeneity of the effect sizes across the studies.

Table 7 Results for the moderator analysis of the relation between problematic internet use and other mental health outcomes

Publication Bias

As can be seen in Figs. 2, 3, 4, 5 and 6, the funnel plots of the five mental health outcomes (i.e., depressive symptoms, anxiety, loneliness, subjective well-being, other mental health outcomes) were basically symmetrically distributed, suggesting little evidence for publication bias. Furthermore, as suggested by Fernández-Castilla et al. (2021) for trim-and-fill method, the optimal values for indicating publication bias would vary based on the magnitude of effect sizes (r = 0.213 to 0.313 in this review) and the number of effect sizes (38 to 159 in this review) included in an analysis. Under our data conditions, for “depressive symptoms” and “other mental health outcomes”, the publication bias would be suggested if \({L}_{0}^{+}\) is greater than 3. For “anxiety”, “loneliness”, and “subjective well-being”, the publication bias would be suggested if \({L}_{0}^{+}\) is greater than 2. Our results of the trim-and-fill method for depressive symptoms (\({L}_{0}^{+}=0)\), anxiety \({(L}_{0}^{+}=0)\), loneliness \({(L}_{0}^{+}=0)\), subjective well-being (\({L}_{0}^{+}=0.347)\) and other mental health outcomes \({(L}_{0}^{+}=0)\) indicated a lack of evidence for publication bias.

Fig. 2
figure 2

Funnel plot for the association between problematic internet use and depressive symptoms

Fig. 3
figure 3

Funnel plot for the association between problematic internet use and anxiety

Fig. 4
figure 4

Funnel plot for the association between problematic internet use and loneliness

Fig. 5
figure 5

Funnel plot for the association between problematic internet use and subjective well-being

Fig. 6
figure 6

Funnel plot for the association between problematic internet use and other mental health outcomes

Discussion

Despite a growing body of research suggesting that problematic internet use is associated with various mental health problems, there has been a lack of understanding about the similarities and differences between problematic internet use and different mental health indicators. Therefore, this study conducted five meta-analyses to estimate the overall associations between problematic internet use and each of five mental health outcomes for students of different grades; and it also sought to examine whether certain study characteristics could have contributed to the heterogeneity of the findings across previous individual studies. The results indicated that higher levels of problematic internet use were related to higher levels of depressive symptoms, anxiety, loneliness, and other negative mental health outcomes, but to lower levels of subjective well-being. The strength of such relationships between problematic internet use and mental health outcomes were moderated by school grade, region, measure of problematic internet use, publication year, and gender.

Overall Associations Between PProblematic Internet Use and Mental Health Outcomes

The results of three-level meta-analysis showed moderate positive correlations between problematic internet use and depressive symptoms (r = 0.313), anxiety (r = 0.277), loneliness (r = 0.252), other mental health outcomes (r = 0.289) and a moderate negative relation with subjective well-being (r = − 0.213). In other words, despite the considerable variations in the findings across the many studies included in this meta-analysis, overall, individuals who reported higher levels of problematic internet use were more likely to have reported higher levels of negative mental health problems, and to have reported lower levels of subjective well-being, a positive indicator of mental health. These findings were generally consistent with previous studies in this area and provided evidence for the internet use displacement hypothesis (e.g., Cikrikci, 2016; Lei et al., 2020; Lozano-Blasco & Cortes-Pascual, 2020; Tokunaga, 2017). At the same time, some studies pointed out that the negative mental health problems might be potential risk factors for problematic internet use (Cikrikci, 2019; Liang et al., 2016; Lu et al., 2017). Individuals suffering from mental health issues are more inclined to use the internet to alleviate their negative emotions. The psychological dependence on the Internet and maladaptive cognition of the virtual world led them to spend more time on the internet. Additionally, similar to the findings in some previous studies (Carli et al., 2013; Cheung et al., 2018; Erceg et al., 2018; Li et al., 2019), the association between problematic internet use and depressive symptoms appeared to be relatively strong and robust. This result has important implications for future practice.

Potential Implications of Moderators

School Grade

Regarding school grade, our results suggested that, in the reported association between problematic internet use and depressive symptoms, there was significant difference between the studies involving secondary school students and those involving undergraduates, but no significant differences were found for other mental health outcomes (anxiety, loneliness, subjective well-being, and other mental health outcomes). It could be likely that, compared with secondary school students, college students could be more likely to experience the symptom of problematic internet use because they have abundant time to surf the Internet without the supervision of parents and teachers, which might be prone to trigger depressive symptoms (Tian et al., 2017). Furthermore, in addition to facing the same academic pressure as secondary school students, college students are exposed to more stressors, such as interpersonal pressure, parental expectations, and work pressure, which could contribute to higher levels of problematic internet use and mental health problems (Buizza et al., 2022).

Region

The study feature region turned out to be a statistical moderator for the observed heterogeneity in the correlations of problematic internet use with depressive symptoms, loneliness, and other mental health outcomes across the studies. More specifically, these associations were stronger in the studies conducted in South Asia and Europe than those conducted in other regions coded in this meta-analysis (Europe, West Asia, and East Asia). There could be two relevant factors in play for this finding. On one hand, there was some indication that the prevalence rate of problematic internet use was higher in some South Asia nations (e.g., Nepal and India; Balhara et al., 2019) than in some other countries. On the other hand, some policy and prevention approaches for problematic internet use prevention adopted in some other areas (e.g., China, Japan, South Korea, Germany, Australia, USA, UK; King et al., 2018) could also have made some difference for the association between problematic internet use and mental health outcomes. Nevertheless, this finding is not in line with some previous studies reporting that the prevalence of problematic internet use was relatively low in European countries (Balhara et al., 2019; Cheng & Li, 2014). This issue should receive more attention in future studies.

Measure of Problematic Internet Use

No statistically significant amount of the effect-size heterogeneity across the studies was explained by the different measuring instruments for problematic internet use used in the primary studies for four mental health outcomes (depressive symptoms, anxiety, loneliness, subjective well-being, and other mental health outcomes), indicating that this connection between problematic internet use and these mental health outcomes was robust with regard to different problematic internet use measures. However, the measure of problematic internet use could affect the relationship between problematic internet use and anxiety, with this association being the strongest when problematic internet use was assessed with YDQ. Compared with IAT and OCS, YDQ was less used to measure problematic internet use in the studies included in the meta-analysis. Due to the limited number of effect sizes, this result should be interpreted with caution.

Measure of Mental Health

In addition to the findings related to problematic internet use measures described above, the findings also indicated that different measures for depressive symptoms and anxiety used in different primary studies played no “moderating” role in the relationships between problematic internet use and depressive symptoms; nor did the play a role between problematic internet use and anxiety. Although there were differences in measures for depressive symptoms and anxiety, these tools had good internal consistency reliability to accurately evaluate the degree of depressive symptoms and anxiety of participants. This lack of “moderating” effect of mental health measures provides support for the robustness of the problematic internet use’s respective relationships with depressive symptoms and anxiety.

Publication Year

The time when different primary studies were published showed no moderating effect on problematic internet use’s respective relationships with two mental health outcomes examined in this synthesis (anxiety and loneliness), indicating that these associations were robust regarding when the studies were conducted. However, the strength of the association between problematic internet use and depressive symptoms, and the association between problematic internet use and other mental health outcomes (e.g., aggression, hostility, suicide, etc.), was stronger in more recent studies. In line with the stronger relationship of problematic internet use with negative mental health indicators in more recent studies described above, the association between problematic internet use and the positive mental health indicator, i.e., subjective well-being, was weaker in more recent studies. A possible explanation for this might be that, as mentioned earlier, the prevalence of problematic internet use has significantly increased in recent years, and the internet is often used to cope with life stress or difficulties, which makes internet users more likely to escape from reality and suffer from mental health problems. Additionally, the coronavirus 2019 (COVID-19) has a significant impact on life style and the mental health of students (Aranda & Rodriguez-Cuevas, 2021; Cui et al., 2022), which might also contribute to this trend.

Gender

The moderator analysis results revealed that the relationship between problematic internet use and loneliness was weaker in samples with a higher percentages of females; in other words, the strength of this association tended to be stronger for males than for females. One possible reason for this finding could be related to gender difference in internet usage: more females tended to use the internet for social communication, leading to lower level of loneliness feeling; whereas more males tended to spend more time on online gaming, or even as escape from the real life, further increasing their loneliness (Dufour et al., 2016). With regard to the relationships of problematic internet use with the other four mental health outcomes (depressive symptoms, anxiety, subjective well-being, and other mental health outcomes), gender was not shown to have any “moderating” role in those relationships, which was consistent with some previous research findings (e.g., Huang, 2010; Tokunaga, 2017). Some studies, however, reported that gender played a role in problematic internet use’s respective relationships with depressive symptoms and subjective well-being (Lei et al., 2020; Lozano-Blasco & Cortes-Pascual, 2020), suggesting that more research may be warranted with regard to this issue.

Limitations and Future Directions

The present study has some limitations. First, almost all the studies included in this meta-analysis had cross-sectional design, which limited the possibility of making inferences about possible causal relationship between problematic internet use and mental health outcomes. Future studies would benefit from longitudinal design to examine problematic internet use and mental health outcomes for shedding light on the nature of relationships between problematic internet use and a range of mental health indicators.

Second, the current meta-analysis examined the direct connection between problematic internet use and mental health outcomes, but could not address the issues of any possible mediating or moderating mechanisms of this association (e.g., social support, self-control, and personality), due to the very limited number of primary studies that considered mediating/moderating mechanisms (Floros et al., 2014; He et al., 2014; Song & Park, 2019) for such associations. Future studies in this area may need to consider potential mediating/moderating mechanisms for better understanding of the link between problematic internet use and mental health outcomes.

Third, with regard to problematic internet use and mental health outcomes, the majority of the studies included in this meta-analysis involved samples of secondary school students or college students, and too few studies had samples of elementary school students. However, with the substantial infiltration of internet in the society, internet users are becoming younger, and even very young students have ready access to the internet. As a result, it is becoming more likely that very young students may develop problematic internet use (Wang & Cheng, 2019). Consequently, in future research, it is important that samples of elementary school students should be included, with the hope that problematic internet use problem could be prevented at earlier age.

Finally, this study generally examined the associations between problematic internet use and different mental health problems (i.e., depressive symptoms, anxiety, loneliness, subjective well-being, and other mental health outcomes). However, due to the small number of primary studies, some mental health indicators (e.g., suicide, aggression, and hostility) were aggregated into “other mental health outcomes”, and the present study is unable to investigate the relationship between problematic internet use and each of these specific mental health outcomes. Future research is needed to involve these more specific mental health problems.

Conclusion

Several studies have focused on the relationship between problematic internet use and mental health; however, there has been little discussion about various mental health issues. The current meta-analysis quantitatively synthesized the empirical studies on the relationships between problematic internet use and different mental health outcomes for students. The findings from this synthesis showed that problematic internet use was positively related to depressive symptoms, anxiety, loneliness, and other mental health outcomes, while negatively related to subjective well-being. In addition, the association between problematic internet use and depressive symptoms appeared to be relatively robust. Furthermore, several study features (i.e., school grade, region, measure of problematic internet use, publication year, and gender) were shown to account for the variations in the relationships between problematic internet use and mental health outcomes across the individual studies. More specifically, the results showed that (1) undergraduates with high levels of problematic internet use reported more depressive symptoms than secondary school students; (2) the strength of the associations between problematic internet use and depressive symptoms, loneliness, and other mental health outcomes were stronger in the studies conducted in South Asia and Europe; (3) the links of problematic internet use with depressive symptoms, subjective well-being, and other mental health outcomes were stronger in more recent studies; and (4) males with higher levels of problematic internet use reported more loneliness than females. This study’s findings shed light on more nuanced relationships between problematic internet use and different aspects of mental health, which contributes to our better understanding about how problematic internet use and different mental health outcomes were related. Such understanding could have useful implications in helping researchers design intervention mechanisms for problematic internet use for improving the mental health of adolescents. Researchers are encouraged to explore the causal relationships between problematic internet use and mental health outcomes by using longitudinal designs.