Abstract
Problematic smartphone use (PSU) is an emerging public and social issue, potentially connected to the significant increase in smartphone applications. Different scales have been designed and developed to identify the risk of smartphone addiction, and the 10-item Smartphone Addiction Scale - Short Version (SAS-SV) is one of the most used instruments to assess the risk of PSU. The main objective of the present study was to provide further psychometric properties of the Italian version of the SAS-SV. The study was conducted with a convenience sample of 858 Italian university students. Parallel and confirmatory factor analyses were performed to confirm if the one-factor structure fitted the data well. In addition, because previous studies have emphasised gender and age differences in the SAS-SV, measurement invariance was also tested. Network analysis, predictive validity, and convergent validity were also explored. The parallel analysis results suggested removing Item 3 (feeling pain) because its factor loading was low, resulting in a nine-item SAS-SV. The measurement invariance showed that the SAS-SV performed similarly for gender and age. However, partial scalar invariance across gender and age was observed. Furthermore, gender differences indicated that more females than males scored higher on SAS-SV. No significant age differences were found. The receiver operating characteristic (ROC) curve results indicated a cut-off of 29 points as the best for the SAS-SV (AUC = 0.85). Moreover, among males, the cut-off was 25 (AUC = 0.84), and among females, the cut-off was 30 (AUC = 0.84). The SAS-SV showed a strong association with problematic social media use (PSMU) and other variables related to smartphone use (e.g., time spent on Facebook, Instagram, and WhatsApp). Overall, the present study results indicate that the nine-item SAS-SV appears to be a valid and reliable instrument to assess PSU risk among Italian university students.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Smartphones have become a popular technological device through which individuals can communicate, process, and share information and access the internet via various mobile applications. Given the increasing awareness concerning technology-related addictions, the extant literature has reported negative consequences of smartphone overuse, including an association with anxiety and depression (Elhai et al., 2017), as well as social problems, such as low-income family and peer relationships (e.g., Hawi & Samaha, 2019; Wang et al., 2017), potentially fatal injuries from traffic accidents (Kim et al., 2017), and problematic social media use (e.g., Rozgonjuk et al., 2018).
The construct of problematic smartphone use (PSU) has been much debated, particularly its conceptualization as a behavioural addiction (see Busch & McCarthy, 2021, for a review). Due to insufficient support from an addiction framework (Panova & Carbonell, 2018), some researchers have identified the disorder as ‘problematic smartphone use’ rather than ‘smartphone addiction’ (SA). According to Kuss and Griffiths (2017), SA might best be used as an umbrella term (like ‘internet addiction’) to describe the totality of problematic smartphone behaviours rather than the addiction to the physical device itself.
Moreover, a newly revised taxonomy underlying Internet Use Disorders (IUDs) by Montag and colleagues (Montag et al., 2021) defined smartphone use disorder (SmUD)/problematic smartphone use (PSU) as a specific ‘mobile form’ of IUD and referred to excessive smartphone use as PSU rather than SA. In the present study, and in line with previous researchers, the term ‘problematic smartphone use’ is used to indicate a compulsive and dependent smartphone use that interferes with users’ daily lives (Billieux et al., 2015; Elhai et al., 2019; Huang et al., 2021; Panova & Carbonell, 2018). Although PSU has not yet been considered a specific mental health disorder in the latest (fifth) edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5; American Psychiatric Association, 2013), prior research focused on the development and adaptation of screening instruments designed to examine specific patterns of the problematic use with clinical symptoms among adolescents and young adults, as well as to identify those most vulnerable to PSU (e.g., Fryman & Romine, 2021; Harris et al., 2020a). The results of a recent systematic review identified 78 different scales developed to assess, identify, or characterize the risk of smartphone addiction and/or PSU, which have evaluated their theoretical foundation and psychometric properties (Harris et al., 2020b). However, despite the richness of self-report instruments devoted to assessing the construct, most developed scales lack sufficient reliability and test-retest consistency.
One of the most used scales in this research field is the Smartphone Addiction Scale (SAS) (Kwon et al., 2013b), which was developed in South Korea. The original SAS version includes 33 items assessing six factors (daily-life disturbance, positive anticipation, withdrawal, cyberspace-oriented relationship, overuse, and tolerance). Moreover, to reduce the burden on respondents, the SAS was shortened to 10 items (SAS-SV; Kwon et al., 2013a), which has already been validated in different international samples, including French-speaking Belgian and Spanish adults (Lopez-Fernandez, 2017), Italian adolescents and young adults (De Pasquale et al., 2017), Moroccan adults (Sfendla et al., 2018), Chinese adults (Luk et al., 2018), Egyptian adolescents (Fathalla, 2019), Indonesian junior high school students (Arthy et al., 2019), Pakistani colleges and university students (Khalily et al., 2019), Chinese children and adolescents in Hong Kong (Cheung et al., 2019), Iranian adolescents (Fallahtafti et al., 2020), Brazilian university students and general adult population adults (Andrade et al., 2020), Mexican university students (Escalera-Chávez & Rojas-Kramer, 2020), American adults (Harris et al., 2020a), and Serbian medical students (Nikolic et al., 2022).
According to Lopez-Fernandez (2017), the SAS-SV includes 10 items assessing the risk of six-related PSU symptoms: ‘loss of control’ (Items 1 and 8), ‘disruption’ (Items 2 and 10), ‘disregard’ (Items 3 and 7), ‘withdrawal’ (Items 4 and 5), ‘preoccupation’ (Item 6), and ‘tolerance’ (Item 9). These criteria were established based on the symptoms of dependence on substance use and disorders related to pathological gambling from the DSM-III and DSM-IV (Andrade et al., 2020; Lopez-Fernandez, 2017).
Within the Italian context, De Pasquale et al. (2017) initially explored the factor structure of the SAS-SV using a sample comprised predominantly of adolescents with a mean age of 18 years. The confirmatory factor analysis results indicated that Item 1 (missing work), Item 2 (hard time concentrating), and Item 3 (feeling pain) exhibited low factor loadings and item-total correlation, indicating the need to conduct more robust statistical analyses. However, no further Italian studies have been carried out on samples of emerging adults (i.e., young adults aged over 18 years). Moreover, because the preliminary Italian study has assessed only the reliability coefficients of the SAS-SV, this does not mean that the items are related to the construct or possess the established validity (Harris et al., 2020a). Finally, the psychometric evaluation of the Italian adaptation of the SAS-SV did not examine either convergent or divergent validity. Therefore, the purpose of the present study was to address these gaps by providing more robust validity evidence for the Italian version of the SAS-SV.
Based on the extant literature, the present study was expected to confirm the original one-factor structure of the SAS-SV because it is the most prevalent factor solution reported (H1). Regarding smartphone use, the results of a recent systematic literature review reported inconsistent findings in the relationship between PSU and socio-demographic variables such as gender and age (Busch & McCarthy, 2021). Moreover, it was expected that females would have higher PSU scores than males (H2) (Casale et al., 2021; Cheung et al., 2019; Servidio et al., 2021b; Sfendla et al., 2018). To date, although several prior studies have explored gender differences in PSU, results are still inconclusive, as suggested in a recent review (Busch & McCarthy, 2021). Therefore, the present study also tested the scale’s measurement invariance. This step is essential given the number of prior psychometric studies that have validated the SAS-SV but have overlooked gender and age-related measurement issues. Moreover, to better explore the psychometric properties of the Italian version of the SAS-SV, a network analysis was performed to evaluate the strength of the associations between items. This statistical approach was adopted in a previous SAS-SV validation study (i.e., Andrade et al., 2020).
Regarding the predictive validity of the SAS-SV, a Receiver Operating Characteristics (ROC) analysis was conducted. However, no specific predictions were made about the cut-offs of the scale because no previous studies in the Italian context have ever explored the diagnostics of the scale. Finally, the convergent validity of the SAS-SV was tested through its relationship with problematic social media use (PSMU) and other related variables (e.g., use of Facebook, Instagram, and WhatsApp). Positive associations between PSU and these variables were expected (H3). It has previously been demonstrated that smartphones and social media are inextricably related because of the social component in contemporary smartphone use (Cleary et al., 2020; Kuss & Griffiths, 2017) and other related variables.
Method
Participants and procedure
An initial sample of 867 Italian-speaking university students was mainly recruited online and in-person during university lectures. At the end of the data cleaning procedures, the final sample size comprised 858 participants aged 18 and 43 years (M = 22.68, SD = 3.70; 72.1% females). After informing participants that taking part in the study was voluntary and anonymous, they provided informed consent according to the Helsinki declaration, the ethical rules of the Italian Psychological Association, as well as formal approval by the research team’s university ethics committee.
Measures
The survey included socio-demographic questions concerning gender, age, and daily time spent on Facebook, Instagram, and WhatsApp via their smartphones.
The short Italian version of the Smartphone Addiction Scale (SAS-SV) was used to assess smartphone addiction risk (De Pasquale et al., 2017; original version: Kwon et al., 2013a). The SAS comprises ten items (e.g., “Having my smartphone in my mind even when I am not using it”) concerning daily-life disturbance, positive anticipation, withdrawal, cyberspace-oriented relationships, overuse, and tolerance. Each item is rated on a six-point Likert-type scale from 1 (strongly disagree) to 6 (strongly agree). A total score is computed, with higher scores indicating greater problematic smartphone use. In the present study, the scale showed good internal consistency: McDonald’s ω = 0.799, M = 2.63, SD = 0.56, 95% CI [0.79, 0.82], and Cronbach’s α = 0.801, M = 2.63, SD = 0.56, 95% CI [0.78, 0.82].
The Italian version of the Bergen Social Media Addiction Scale (BSMAS) was used to assess problematic social media use (Monacis et al., 2017; original version: Andreassen et al., 2016). The instrument comprises six items (e.g., “How often during the last year have you tried to cut down on the use of social media without success?”) reflecting core addiction elements (i.e., salience, mood modification, tolerance, withdrawal, conflict, and relapse) (Griffiths, 2005). Each item is rated on a five-point Likert-type scale from 1 (very rarely) to 5 (very often). A total score is calculated, with higher scores indicating a greater risk of problematic social media use. In the present study, the scale showed good internal consistency: McDonald’s ω = 0.74, M = 2.17, SD = 0.50, 95% CI [0.71, 0.76], and Cronbach α = 0.73, M = 2.17, SD = 0.50, 95% CI [0.71, 0.76].
Data analysis
Statistical analyses included the following steps: (i) data cleaning was performed. The response to the items of the main variables was required to progress in the online survey, and therefore, there were no missing data; (ii) univariate normality of the SAS-SV was assessed by examining skewness and kurtosis values for each item. Nine participants on the SAS-SV had absolute values of skewness > 3.0 and kurtosis > 8.0 and were therefore removed from the data analysis (final sample size for all subsequent analyses comprised 858 participants); (iii) to explore whether the assumption of multivariate normality was met, the Mardia index of multivariate skewness and kurtosis was computed. The Mardia’s skewness index for the collected data was 8.13, and the Mardia’s kurtosis was 130.34, indicating that data were not multivariate normally distributed (Mardia, 1970).
Other statistical analyses involved: (i) descriptive statistics of the sample characteristics, and patterns of problematic smartphone use and problematic social media use; (ii) parallel factor analysis (PFA) with optimal implementation was run to ascertain the suitability of the data for the subsequent statistical analyses; (iii) confirmatory factor analysis (CFA). Given the ordinal nature of SAS-SV items, diagonal weighted least squares (DWLS) was used as a parameter estimation method, which produces more accurate estimates (Li, 2016) to ascertain the model fit of the factorial structure of the SAS-SV. For the CFA, multiple indices (Hu & Bentler, 1999) were used to evaluate the model fit (adopted cut-offs in parentheses): the chi-square (χ2) test value with the associated p-value (p > 0.05), comparative fit index (CFI ≥ 0.95), Tucker-Lewis Index (TLI ≥ 0.95), root-mean-squared error of approximation (RMSEA ≤ 0.06) and its 90% confidence interval, and standardized root mean square residual (SRMR < 0.08); (iv) reliability of the SAS was evaluated using two different indicators of internal consistency (McDonald’s ω and Cronbach’s alpha); (v) multigroup confirmatory factor analysis (MG-CFA) (van de Schoot et al., 2012) was performed to test measurement invariance across gender and age groups on a set of nested models. The analysis included configural, metric, and scalar invariance. According to Cheung and Rensvold (2002), invariance can be assumed when the value is 0.01 or less, in absolute values. Because the χ2 difference is sensitive to model complexity and sample size, the comparison of two nested models is recommended using cut-offs values of ΔCFI < 0.01 and ΔRMSEA < 0.015 for metric and scalar invariances (Chen, 2007); (vi) network analysis was used to estimate which items were grouped through their correlation strength (internal consistency). The analysis was performed using EBICglasso estimator (Extended Bayesian Information Criterion Graphical Least Absolute Shrinkage and Selection Operator) with at least absolute shrinkage and selection operator (LASSO) regularization method to estimate a network of partial correlations between items. This method allows small edge weights to shrink to zero to avoid the multiplicity problem with spurious correlations for a parsimonious network (Epskamp et al., 2018). Blue lines represent positive partial correlations between nodes/variables, while orange lines represent negative partial correlations. Thicker edges show stronger correlations, and the thinner edges indicate weaker correlations. Three measures of centrality were assessed in the present study: (a) betweenness: to identify the connection strength between two items; (b) closeness: to identify the proximity between two items in the network; and (c) degree: to identify the number of connections each node has based on all possible links; (vii) predictive validity was analysed by comparing the total score of the SAS-SV with the total score of the BSMAS using the Receiver Operating Characteristics (ROC) analysis. The SAS-SV scores were compared with the BSMAS classification based on the proposed cut-off of 19 (Bányai et al., 2017), which identifies the risk of problematic social media use. More specifically, the area under the curve (AUC) measures the performance to classify smartphone use as problematic. Further analysis computed the deciles to identify the baseline of the PSU risk. Therefore, participants who scored in the 90th percentile can be classified at risk of PSU at baseline; and (viii) convergent validity was analysed using Pearson correlational analysis between the total SAS-SV scores, the BSMAS scores, and time spent on Facebook, Instagram, and WhatsApp.
Descriptive analyses were performed using SPSS version 26. The exploratory factor analysis was computed with the Software Factor version 11.05 (Lorenzo-Seva & Ferrando, 2006). Confirmatory factor analysis and invariance measurement were conducted using the lavaan R-package (Rosseel, 2012). Estimates and plots from the network analysis were performed with JASP version 0.16, and with R-packages bootnet, qgraph (Epskamp et al., 2012). NetworkComparisonTest (van Borkulo et al., 2016) was used to test the invariant network structure, the invariant edge strength, and the invariant global strength between groups (Epskamp et al., 2018). The R package pRoc was used to compute the ROC curve (Robin et al., 2011).
Results
Descriptive statistics
The current results showed that females (total score: 24.69, SD = 8.28) scored higher on the SAS-SV than males (total score: 22.91, SD = 7.56), which were significantly different: t(856) = -2.87, p < 0.01, d = − 0.22. The average time spent per day on smartphone social applications was 2.11 h on Facebook (Mmale = 1.50, Mfemale = 2.33), 3.11 h on Instagram (Mmale = 1.83, Mfemale = 3.59), and 5.45 h on WhatsApp (Mmale = 3.69, Mfemale = 6.11). As for age, the scores obtained on SAS-SV were 24.36 (SD = 8.08) for young adults and 23.65 (SD = 8.25) for adults, respectively, indicating no statistically significant differences (p = 0.28).
Parallel factor analysis
The Bartlett test indicated a significant correlation between the ten items of the SAS-SV: χ2(45) = 2.323.15, p < 0.001, and the KMO criterion was also good (0.81). The communalities suggested that each item shared some common variance with the other scale items and ranged from 0.31 to 0.77. The cumulative proportion of variance was 0.48%. Factor loadings varied between 0.47 and 0.70. Following the rule in exploratory factor analysis, items with factor loadings < 0.40 were not retained (Kline, 2016). More specifically, all the SAS-SV items loaded 0.47 or higher except for Item 3 (0.33; “Feeling pain in the wrists or at the back of the neck while using a smartphone”), which was excluded for the subsequent analyses (see Table 1). Therefore, the parallel factor analysis results indicated that nine out of ten items assessed the same latent construct and were suitable for the CFA.
Confirmatory factor analysis and reliability
A CFA was run to assess the adequacy of the one-factor solution with nine items. The results provided an unsatisfactory fit to the data, χ2 (27, N = 858) = 325.83, p < 0.001, CFI = 0.904, TLI = 0.873, RMSEA = 0.114, 90% CI [0.10, 0.12], SRMR = 0.096. After the analysis, the modification fit indices (Byrne, 2012) suggested the inclusion of the correlation between error terms for Item 1 and Item 2 (MI = 153.22), Item 1 and Item 9 (MI = 34.31), and Item 9 and Item 10 (MI = 38.62). The results of the new analysis indicated an improvement in the fit of the model, χ2 (24, N = 858) = 98.31, p < 0.001, CFI = 0.976, TLI = 0.964, RMSEA = 0.060, 90% CI [0.05, 0.073], SRMR = 0.052. All item factor loadings were significantly positive (p < 0.001), with standardized coefficients ranging from 0.27 to 0.69, on the latent factor. The results of the reliability analyses are shown in Table 1.
Multigroup confirmatory factor analysis
Two measurement invariance analyses were performed on the Italian short version of the nine-item SAS-SV. The first model for gender was tested by estimating the SAS-SV model separately for males and females and the second for age (young adults vs. adults). The fit indices of the unconstrained models (see Table 2) indicated configural invariance across gender, χ2 (48, N = 858) = 109.95, p < 0.001, CFI = 0.980, TLI = 0.970, RMSEA = 0.055, 90% CI [0.041, 0.068], SRMR = 0.050 and age, χ2 (48, N = 858) = 107.00, p < 0.001, CFI = 0.981, TLI = 0.972, RMSEA = 0.054, 90% CI [0.040, 0.067], SRMR = 0.050, and therefore a satisfactory fit for both groups. Given the lack of scalar invariance, the possibility of partial invariance was evaluated, as recommended by Byrne (2012). The modification indices (MI) for the inter-group intercept constraints from the scalar model were explored to identify if any specific constraints were notably contributing to the lack of fit. The MI suggested that for gender, Item 7 and Item 8 were statistically significant, whereas Item 1 was significant for age. Therefore, two partial invariance models were estimated, including the relaxing of the items mentioned above. Overall, except for Item 1, Item 7, and Item 8, the result suggested that both gender and age had the same basic conceptualization of problematic smartphone use and interpreted the items similarly.
Network analysis
The EBICglasso domain-level network of the Italian short version of the nine-item of SAS-SV is shown in Fig. 1. The network’s colour was based on the six symptoms proposed by Lopez-Fernandez (2017). Most of the items (nodes) exhibited positive correlations, indicating that the increase in the score of one item led to an increase in the scores of other scale items. The withdrawal symptoms (S4 and S5) showed a weak correlation in both groups (rmale = 0.17; rfemale = 0.26). The nodes S1 and S8 (loss of control) were weakly related among males (r = 0.12), but not in females (r = 0.00). The remaining nodes underlying each symptom showed poor associations.
Significant associations were observed between nodes underlying different symptoms: the nodes S5 (Feeling impatient and fretful when I am not holding my smartphone) and S6 (Having my smartphone in my mind even when I am not using it) (rmale = 0.28; rfemale = 0.37), which evaluated respectively symptoms of withdrawal and preoccupation, showed a strong correlation, probably due to their cognitive content. Furthermore, the nodes S4 (Won’t be able to stand not having a smartphone) and S7 (I will never give up using my smartphone even when my daily life is already greatly affected by it) which assessed symptoms of withdrawal and disregard for the physical or psychological consequences due to the smartphone use respectively, were significantly associated (rmale = 0.35; rfemale = 0.30). This association underlined the role of withdrawal symptoms in the risk of developing behavioural addictions. Finally, the nodes S9 (Using my smartphone longer than I had intended) and S10 (The people around me tell me that I use my smartphone too much), which evaluated symptoms of tolerance and family/work/school disruption respectively, were significantly associated (rmale = 0.29; rfemale = 0.33).
The strength of correlations amongst males (Fig. 1a) was between nodes S1 and S2 (r = 0.49), nodes S4 and S7 (r = 0.35), nodes S5 and S6 (r = 0.28), nodes S4 and S5 (r = 0.17), and nodes S9 and S10 (r = 0.29). Among females (Fig. 1b), the strongest correlations were between nodes S1 and S2 (r = 0.56), nodes S4 and S7 (r = 0.30), nodes S6 and S5 (r = 0.37), nodes S4 and S5 (r = 0.26), and nodes S9 and S10 (r = 0.33). According to the centrality plot (Fig. 2), Item S5 was one of the most important for females because it had higher connectivity and proximity to other items and exhibited a more central position in the network. Among females, Item S5 was the most influential because it satisfied the criteria of all the three centrality measures. Among males, Item S7 was the most meaningful. Moreover, the global strength between the networks was not significant (S = 0.27, p = 0.12).
Predictive validity: ROC and decile results
The ROC curve showed that the general cut-off for the Italian short version of SAS-SV (nine-item) was 29 (sensitivity = 76.92%; specificity = 77.59%; AUC = 0.85, CI [0.81, 0.88]; Youden index J = 0.54). Moreover, among males, the cut-off value was 25 (sensitivity = 90.91%; specificity = 63.39%; AUC = 0.84, CI [0.73, 0.96]; Youden index J = 0.54). Among females, the cut-off value was 30 (sensitivity = 75.27%; specificity = 79.43%; AUC = 0.84, CI [0.81, 0.88]; Youden index J = 0.55). Additionally, considering that there are currently no available diagnostic criteria for PSU-SV, the ROC criteria for determining cut-offs with the deciles of the distribution of the PSU-SV scores were compared. Those in the top 10 decile were used to define the high risk of problematic smartphone use. Based on the results, participants who scored in the 90th decile of PSU-SV (males score ≥ 32; female score ≥ 36) were classified as at high risk of developing the PSU (see S1 for more details). When the criterion of 75th centile (upper quartile) was used as the cut-off, for females, the score was near 30, equivalent to the cut-off obtained from the ROC curve, while the score was near 28 for males (higher than that obtained from ROC curve).
Convergent validity
Table 3 shows the results of the convergent validity. As expected, SAS-SV was positively associated with the time spent on mobile apps (i.e., Facebook, Instagram, and WhatsApp). In addition, a significant positive association was found between SAS-SV and problematic social media use (BSMAS).
Discussion
The present study contributes to the growing field of problematic smartphone use (PSU) by further exploring the psychometric properties of the SAS-SV in the Italian context. The present study had the following aims to: (i) provide robust evidence about the factorial structure of the Italian version of the SAS-SV, (ii) evaluate scale reliability, (iii) establish gender and age measurement invariance, (iv) estimate the strength of the correlations between the items of the SAS-SV by applying network analysis, (v) provide diagnostic criteria of the SAS-SV for predicting smartphone addiction among the Italian sample, and (vi) investigate convergent reliability with existing measures in the smartphone use literature. The revised (nine-item) Italian version of the SAS-SV appeared to be a reliable and valid measure for PSU assessment with good psychometric properties and invariance across gender and age among a sample of Italian participants. Furthermore, results from measurement invariance supported the three levels of analysis (configural, metric, and scalar), suggesting that the SAS-SV is comparable across the two groups. Finally, mean differences indicated that females scored higher on PSU than males, consistent with the previous literature (Busch & McCarthy, 2021; Casale et al., 2021; Cheung et al., 2019; Servidio et al., 2021b, 2022; Sfendla et al., 2018). Using latent class analysis, one study indicated that gender differences depended on the kind of device used (Lee et al., 2018). More specifically, females had greater problematic smartphone behaviour because they spent more time on their smartphones, while males had greater problematic internet use (associated with internet gaming disorder) because they spent more time on their computers. Similar findings were also found in a largescale study of over 23,000 Norwegian participants indicating that females were significantly more likely to experience problematic social media use and males were significantly more likely to experience problematic online gaming (Andreassen et al., 2016). Given that most social media use takes place on smartphones and online gaming is more likely to take place on computers and dedicated gaming consoles, the gender differences are arguably what would be expected. Furthermore, in line with a previous study, no significant difference emerged among the age of the participants (Fallahtafti et al., 2020).
The results of the analyses provided evidence of the validity and reliability of the one-factor structure of the SAS-SV, confirming the original version of the scale and the existing data reported in the literature (Andrade et al., 2020; De Pasquale et al., 2017; Luk et al., 2018; Servidio, 2019, 2021). However, the parallel factor analysis results suggested removing Item 3 because it had a low factor loading. This finding is partially consistent with previous studies. More specifically, some researchers have retained Item 3 even though it had a low factor loading (Andrade et al., 2020; De Pasquale et al., 2017; Fallahtafti et al., 2020). However, in another study, Item 3 was removed from the final scale (Escalera-Chávez & Rojas-Kramer, 2020). Therefore, H1 was partially confirmed because Item 3 on the SAS-SV did not have a significant factor loading among the present sample of Italian participants. However, this result could be attributed to the difference in the lifestyle of Italian individuals, and further studies should be conducted to explain the observed lack of significance of this item.
The configural and metric invariance results suggested that the SAS-SV factor structure was partially the same across gender and age groups, providing support for the one-factor structure of the scale. Therefore, the same factor pattern structure was established. Even though complete scalar invariance across groups was not confirmed, a partial scalar invariance model showed a good fit, with the only two non-invariant parameters being the threshold of Item 7 and Item 8 for the gender group and Item 1 for the age group. Because partial invariance is sufficient to compare groups on a latent variable (Byrne, 2012) and most items on the SAS-SV factor were invariant across groups (gender and age), the results demonstrated that the SAS-SV is an appropriate instrument to assess differences in problematic smartphone use about gender and age. However, non-scalar invariance may indicate potential measurement bias and suggests that participants systematically rated the items either higher or lower during the different administration of the SAS-SV. Although the SAS-SV demonstrated measurement invariance, findings suggest significant differences between males and females (supporting H2). Indeed, the results indicated that males and females were dissimilar in their endorsement of the SAS-SV, with females exhibiting higher scores than males, contributing to the current body of PSU literature concerning gender differences (Cheung et al., 2019; Servidio et al., 2021a; Sfendla et al., 2018).
Based on the network analysis results, partial correlations were found among items assessing withdrawal, disregard, and preoccupation symptoms, and tolerance and disruption, suggesting high levels of concerns about mobile devices, indicating the importance of these symptoms in assessing the risk of the use of mobile devices PSU. Similar findings were reported in a previous study Andrade et al. (2020). Although smartphone addiction is not included in the DSM-5 (APA, 2013), it has been recognized that excessive use, withdrawal, tolerance and negative repercussions are all factors that many addicted to their smartphones may experience (Fryman & Romine, 2021). For example, individuals who cannot access their smartphones can experience impatience, anxiety, and intolerance, increasing the risk of developing problematic smartphone use. As regards the mean values of the nine-item SAS-SV, only Item 5 (Feeling impatient and fretful when I am not holding my smartphone) showed higher connectivity (betweenness) with the other items, shorter connection with other items (closeness), and a higher frequency of strong correlation (degree). This result is partially consistent with the findings of a previous study, suggesting that items related to withdrawal, tolerance, and disregard should be considered with attention since these symptoms refer to the cognitive dimension of problematic use of mobile devices (Andrade et al., 2020). Additionally, Item 6 (Having my smartphone in my mind even when I am not using it) and Item 7 (I will never give up using my smartphone even when my daily life is already greatly affected by it) exhibited higher betweenness, closeness, and degree, only among males; in contrast, a higher closeness and degree was observed for both males and females. Therefore, based on the results of the present study, differences emerged between males and females, indicating the importance to consider gender differentiation in assessing the risk of PSU.
The present study’s predictive validity results suggested a different cut-off value for gender based on the ROC analysis using the BSMAS as the gold standard. The general cut-off value of the SAS-SV was 29. Meanwhile, the cut-off value based on ROC was 25 for males and 30 for females. Moreover, the data utilizing deciles indicated that participants who scored higher than 32 among males and 36 among females could be considered at very high risk of PSU. These cut-offs, considering differences based on gender, could be helpful when conducting clinical screening interviews to investigate the potential risk of technological addiction.
Regarding convergent validity, the SAS-SV correlated positively with all the variables related to smartphone use (supporting H3). These results are in line with previous studies indicating a positive association between SAS-SV score and measures related to internet disorders (Andrade et al., 2020; Nikolic et al., 2022; Servidio et al., 2021a). Indeed, a strong and positive association was found between the total SAS-SV score and its symptoms (as proposed by Lopez-Fernandez (2017) and the BSMAS score. These findings corroborate the view that smartphone use and social media use are inextricably linked because their use covers individuals’ social connection needs (Cleary et al., 2020). Therefore, these measures are helpful to assess the risk of technological addictions.
The contribution of the present study is threefold. First, to the best of the current authors’ knowledge, the study is the first to evaluate the psychometric properties of the Italian version of the SAS-SV based on different validity models (criterion, convergent, and predictive validity) and by using robust statistical methods. Second, using different statistical analyses (e.g., parallel factor analysis, confirmatory factor analysis, and network analysis) provides more robust conclusions about the SAS-SV’s psychometric properties and estimating and monitoring the risk of PSU among the Italian population. Third, the conformation of a validated instrument with good psychometric properties can be used confidently in future Italian studies. Overall, it would be helpful to examine the effectiveness of prevention and treatment protocols and compare data with results from other countries.
Limitations and conclusion
The present study has several limitations. Firstly, the lack of internal consistency of the scale, such as test-retest reliability and its limited generalizability to the broader population, because of the study’s convenience sample of university students. Another potential limitation is using self-report scales and potential bias related to self-report methods (e.g., social desirability). Therefore, future studies should combine self-report methods and objective measures to collect smartphone usage data. Furthermore, the present sample included more females than males. Therefore, more gender-representative samples are required to increase the generalizability of the current results. Finally, since problematic smartphone use appears to have specific patterns according to the age of the participants (Csibi et al., 2021) and the present study did not examine older age groups (e.g., adults aged 55–60 + years who are beginning to use social media more). Future studies should examine the role of different age groups in the development of the PSU risk which would ensure that preventive measures can be more age targeted. Despite these limitations, the nine-tem Italian version of the SAS-SV appears to be a psychometrically robust measure for assessing PSU risk among Italian university students.
Data availability
The datasets generated during this study are available from the corresponding author on reasonable request.
References
Andrade, A. L. M., Scatena, A., Martins, G. D. G., Pinheiro, B., de Silva, O. B., Enes, A., de Oliveira, C. C., & Kim, D. J. (2020). Validation of Smartphone Addiction Scale – Short Version (SAS-SV) in Brazilian adolescents. Addictive Behaviors, 110, 106540. https://doi.org/10.1016/j.addbeh.2020.106540
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders: DSM-5 (5th ed.). American Psychiatric Publishing.
Andreassen, C. S., Billieux, J., Griffiths, M. D., Kuss, D. J., Demetrovics, Z., Mazzoni, E., & Pallesen, S. (2016). The relationship between addictive use of social media and video games and symptoms of psychiatric disorders: A large-scale cross-sectional study. Psychology of Addictive Behaviors, 30(2), 252–262. https://doi.org/10.1037/adb0000160
Arthy, C. C., Effendy, E., Amin, M. M., Loebis, B., Camellia, V., & Husada, M. S. (2019). Indonesian version of addiction rating scale of smartphone usage adapted from Smartphone Addiction Scale-Short Version (SAS-SV) in junior high school. Open Access Macedonian Journal of Medical Sciences, 7(19), 3235–3239. https://doi.org/10.3889/oamjms.2019.691
Bányai, F., Zsila, Á., Király, O., Maraz, A., Elekes, Z., Griffiths, M. D., Andreassen, C. S., & Demetrovics, Z. (2017). Problematic social media use: results from a large-scale nationally representative adolescent sample. PLoS One, 12(1), e0169839. https://doi.org/10.1371/journal.pone.0169839
Billieux, J., Maurage, P., Lopez-Fernandez, O., Kuss, D. J., & Griffiths, M. D. (2015). Can disordered mobile phone use be considered a behavioral addiction? An update on current evidence and a comprehensive model for future research. Current Addiction Reports, 2(2), 156–162. https://doi.org/10.1007/s40429-015-0054-y
Busch, P. A., & McCarthy, S. (2021). Antecedents and consequences of problematic smartphone use: A systematic literature review of an emerging research area. Computers in Human Behavior, 114, 106414. https://doi.org/10.1016/j.chb.2020.106414
Byrne, B. M. (2012). Structural equation modeling with Mplus: Basic concepts, applications, and programming. Routledge Academic.
Casale, S., Fioravanti, G., & Spada, M. M. (2021). Modelling the contribution of metacognitions and expectancies to problematic smartphone use. Journal of Behavioral Addictions, 10(3), 788–798. https://doi.org/10.1556/2006.2021.00066
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
Cheung, T., Lee, R. L. T., Tse, A. C. Y., Do, C. W., So, B. C. L., Szeto, G. P. Y., & Lee, P. H. (2019). Psychometric properties and demographic correlates of the Smartphone Addiction Scale-Short Version among Chinese children and adolescents in Hong Kong. Cyberpsychology Behavior and Social Networking, 22(11), 714–723. https://doi.org/10.1089/cyber.2019.0325
Csibi, S., Griffiths, M. D., Demetrovics, Z., & Szabo, A. (2021). Analysis of problematic smartphone use across different age groups within the ‘components model of addiction’. International Journal of Mental Health and Addiction, 19(3), 616–631. https://doi.org/10.1007/s11469-019-00095-0
Cleary, M., West, S., & Visentin, D. (2020). The mental health impacts of smartphone and social media use. Issues in Mental Health Nursing, 41(8), 755–757. https://doi.org/10.1080/01612840.2020.1748484
De Pasquale, C., Sciacca, F., & Hichy, Z. (2017). Italian validation of Smartphone Addiction Scale Short Version for adolescents and young adults (SAS-SV). Psychology, 08(10), 1513–1518. https://doi.org/10.4236/psych.2017.810100
Elhai, J. D., Hall, B. J., Levine, J. C., & Dvorak, R. D. (2017). Types of smartphone usage and relations with problematic smartphone behaviors: The role of content consumption vs. social smartphone use. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 11(2), https://doi.org/10.5817/CP2017-2-3
Elhai, J. D., Levine, J. C., & Hall, B. J. (2019). The relationship between anxiety symptom severity and problematic smartphone use: A review of the literature and conceptual frameworks. Journal of Anxiety Disorders, 62, 45–52. https://doi.org/10.1016/j.janxdis.2018.11.005
Epskamp, S., Borsboom, D., & Fried, E. I. (2018). Estimating psychological networks and their accuracy: A tutorial paper. Behavior Research Methods, 50(1), 195–212. https://doi.org/10.3758/s13428-017-0862-1
Epskamp, S., Cramer, A. O. J., Waldorp, L. J., Schmittmann, V. D., & Borsboom, D. (2012). qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software, 48(4). https://doi.org/10.18637/jss.v048.i04
Escalera-Chávez, M. E., & Rojas-Kramer, C. A. (2020). SAS-SV Smartphone Addiction Scale in Mexican university students. Education Research International, 2020, 1–10. https://doi.org/10.1155/2020/8832858
Fallahtafti, S., Ghanbaripirkashani, N., Alizadeh, S. S., & Rovoshi, R. S. (2020). Psychometric properties of the Smartphone Addiction Scale – Short Version (SAS-SV) in a sample of Iranian adolescents. International Journal of Developmental Science, 14(1–2), 19–26. https://doi.org/10.3233/DEV-200002
Fathalla, M. M. (2019). Egyptian validation of Smartphone Addiction Scale Short Version for adolescents (SAS-SV). Psycho-Educational Research Reviews, 8(3), 7–10.
Fryman, S., & Romine, W. (2021). Measuring smartphone dependency and exploration of consequences and comorbidities. Computers in Human Behavior Reports, 4, 100108. https://doi.org/10.1016/j.chbr.2021.100108
Griffiths, M. (2005). A ‘components’ model of addiction within a biopsychosocial framework. Journal of Substance Use, 10(4), 191–197. https://doi.org/10.1080/14659890500114359
Harris, B., McCredie, M., & Fields, S. (2020a). Examining the psychometric properties of the Smartphone Addiction Scale and its short version for use with emerging adults in the U.S. Computers in Human Behavior Reports, 1, 100011. https://doi.org/10.1016/j.chbr.2020.100011
Harris, B., Regan, T., Schueler, J., & Fields, S. A. (2020b). Problematic mobile phone and smartphone use scales: a systematic review. Frontiers in Psychology, 11, 672. https://doi.org/10.3389/fpsyg.2020.00672
Hawi, N., & Samaha, M. (2019). Identifying commonalities and differences in personality characteristics of Internet and social media addiction profiles: Traits, self-esteem, and self-construal. Behaviour & Information Technology, 38(2), 110–119. https://doi.org/10.1080/0144929X.2018.1515984
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Huang, S., Lai, X., Xue, Y., Zhang, C., & Wang, Y. (2021). A network analysis of problematic smartphone use symptoms in a student sample. Journal of Behavioral Addictions, 9(4), 1032–1043. https://doi.org/10.1556/2006.2020.00098
Khalily, M. T., Saleem, T., Bhatti, M. M., Ahmad, I., & Hussain, B. (2019). An Urdu adaptation of smartphone addiction scale-short version (SAS-SV). JPMA The Journal of the Pakistan Medical Association, 69(5), 700–710.
Kim, H. J., Min, J. Y., Kim, H. J., & Min, K. B. (2017). Accident risk associated with smartphone addiction: A study on university students in Korea. Journal of Behavioral Addictions, 6(4), 699–707. https://doi.org/10.1556/2006.6.2017.070
Kline, R. B. (2016). Principles and practice of structural equation modeling (4th edition). The Guilford Press.
Kuss, D., & Griffiths, M. (2017). Social networking sites and addiction: Ten lessons learned. International Journal of Environmental Research and Public Health, 14(3), 311. https://doi.org/10.3390/ijerph14030311
Kwon, M., Kim, D. J., Cho, H., & Yang, S. (2013a). The Smartphone Addiction Scale: development and validation of a short version for adolescents. PLoS One, 8(12), e83558. https://doi.org/10.1371/journal.pone.0083558
Kwon, M., Lee, J. Y., Won, W. Y., Park, J. W., Min, J. A., Hahn, C., Gu, X., Choi, J. H., & Kim, D. J. (2013b). Development and validation of a Smartphone Addiction Scale (SAS). PLoS One, 8(2), e56936. https://doi.org/10.1371/journal.pone.0056936
Lee, S. Y., Lee, D., Nam, C. R., Kim, D. Y., Park, S., Kwon, J. G., … Choi, J. S. (2018). Distinct patterns of internet and smartphone-related problems among adolescents by gender: latent class analysis. Journal of Behavioral Addictions, 7(2), 454–465. https://doi.org/10.1556/2006.7.2018.28
Li, C. H. (2016). The performance of ML, DWLS, and ULS estimation with robust corrections in structural equation models with ordinal variables. Psychological Methods, 21(3), 369–387. https://doi.org/10.1037/met0000093
Lopez-Fernandez, O. (2017). Short version of the Smartphone Addiction Scale adapted to Spanish and French: towards a cross-cultural research in problematic mobile phone use. Addictive Behaviors, 64, 275–280. https://doi.org/10.1016/j.addbeh.2015.11.013
Lorenzo-Seva, U., & Ferrando, P. J. (2006). FACTOR: a computer program to fit the exploratory factor analysis model. Behavior Research Methods, 38(1), 88–91. https://doi.org/10.3758/BF03192753
Luk, T. T., Wang, M. P., Shen, C., Wan, A., Chau, P. H., Oliffe, J., Viswanath, K., Chan, S. S., & Lam, T. H. (2018). Short version of the Smartphone Addiction Scale in Chinese adults: psychometric properties, sociodemographic, and health behavioral correlates. Journal of Behavioral Addictions, 7(4), 1157–1165. https://doi.org/10.1556/2006.7.2018.105
Mardia, K. V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57(3), 519–530. https://doi.org/10.1093/biomet/57.3.519
Monacis, L., de Palo, V., Griffiths, M. D., & Sinatra, M. (2017). Social networking addiction, attachment style, and validation of the Italian version of the Bergen Social Media Addiction Scale. Journal of Behavioral Addictions, 6(2), 178–186. https://doi.org/10.1556/2006.6.2017.023
Montag, C., Wegmann, E., Sariyska, R., Demetrovics, Z., & Brand, M. (2021). How to overcome taxonomical problems in the study of internet use disorders and what to do with “smartphone addiction”? Journal of Behavioral Addictions, 9(4), 908–914. https://doi.org/10.1556/2006.8.2019.59
Nikolic, A., Bukurov, B., Kocic, I., Soldatovic, I., Mihajlovic, S., Nesic, D., Vukovic, M., Ladjevic, N., & Grujicic, S. S. (2022). The validity and reliability of the Serbian Version of the Smartphone Addiction Scale—Short Version. International Journal of Environmental Research and Public Health, 19(3), 1245. https://doi.org/10.3390/ijerph19031245
Panova, T., & Carbonell, X. (2018). Is smartphone addiction really an addiction? Journal of Behavioral Addictions, 7(2), 252–259. https://doi.org/10.1556/2006.7.2018.49
Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J. C., & Müller, M. (2011). pROC: an open-source package for R and S + to analyze and compare ROC curves. BMC Bioinformatics, 12(1), 77. https://doi.org/10.1186/1471-2105-12-77
Rosseel, Y. (2012). lavaan: an R package for structural equation modeling. Journal of Statistical Software, 48(2). https://doi.org/10.18637/jss.v048.i02
Rozgonjuk, D., Kattago, M., & Täht, K. (2018). Social media use in lectures mediates the relationship between procrastination and problematic smartphone use. Computers in Human Behavior, 89, 191–198. https://doi.org/10.1016/j.chb.2018.08.003
Servidio, R. (2021). Fear of missing out and self-esteem as mediators of the relationship between maximization and problematic smartphone use. Current Psychology. https://doi.org/10.1007/s12144-020-01341-8
Servidio, R., Griffiths, M. D., & Demetrovics, Z. (2021a). Dark triad of personality and problematic smartphone use: A preliminary study on the mediating role of fear of missing out. International Journal of Environmental Research and Public Health, 18(16), 8463. https://doi.org/10.3390/ijerph18168463
Servidio, R., Sinatra, M., Griffiths, M. D., & Monacis, L. (2021b). Social comparison orientation and fear of missing out as mediators between self-concept clarity and problematic smartphone use. Addictive Behaviors, 107014. https://doi.org/10.1016/j.addbeh.2021.107014
Servidio, R., Koronczai, B., Griffiths, M. D., & Demetrovics, Z. (2022). Problematic smartphone use and problematic social media use: The predictive role of self-construal and the mediating effect of fear missing out. Frontiers in Public Health, 10, 814468. https://doi.org/10.3389/fpubh.2022.814468
Servidio, R. (2019). Self-control and problematic smartphone use among Italian University students: The mediating role of the fear of missing out and of smartphone use patterns. Current Psychology, 40, 4101–4111. https://doi.org/10.1007/s12144-019-00373-z
Sfendla, A., Laita, M., Nejjar, B., Souirti, Z., Touhami, A. A. O., & Senhaji, M. (2018). Reliability of the Arabic Smartphone Addiction Scale and Smartphone Addiction Scale-Short Version in two different Moroccan samples. Cyberpsychology Behavior and Social Networking, 21(5), 325–332. https://doi.org/10.1089/cyber.2017.0411
van Borkulo, C. D., Epskamp, S., & Millner, A. (2016). Network comparison test: Statistical comparison of two networks based on three invariance measures. R package version 2.0. 1. [Computer software]. https://CRAN.Rproject.org/package=NetworkComparisonTest
van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492. https://doi.org/10.1080/17405629.2012.686740
Wang, P., Zhao, M., Wang, X., Xie, X., Wang, Y., & Lei, L. (2017). Peer relationship and adolescent smartphone addiction: The mediating role of self-esteem and the moderating role of the need to belong. Journal of Behavioral Addictions, 6(4), 708–717. https://doi.org/10.1556/2006.6.2017.079
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they do not have any interests that could constitute a real, potential or apparent conflict of interest with respect to their involvement in the publication. The authors also declare that they do not have any financial or other relations (e.g. directorship, consultancy or speaker fee) with companies, trade associations, unions or groups (including civic associations and public interest groups) that may gain or lose financially from the results or conclusions in the study. Sources of funding are acknowledged.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Servidio, R., Griffiths, M.D., Di Nuovo, S. et al. Further exploration of the psychometric properties of the revised version of the Italian smartphone addiction scale – short version (SAS-SV). Curr Psychol 42, 27245–27258 (2023). https://doi.org/10.1007/s12144-022-03852-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12144-022-03852-y