Abstract
Background
To support longitudinal research into mood in adolescents we sought to assess the feasibility of collecting mood data via Short Message Service (SMS) over 3 years, and to investigate the relationship between SMS data and self-report measures of depression.
Methods
Prospective cohort study of young people aged 9 to 14 years at baseline. Participants completed Short Mood and Feelings Questionnaire (SMFQ) and the Youth Self Report Anxious/Depressed ((YSR)/AD) and Withdrawn/Depressed (YSR/WD) scales at baseline and annually for 3 years. In addition, at 3 monthly intervals they responded to an SMS asking them to rate their mood from 0 to 9 (9 highest).
Results
277 young people (43% female) completed all four waves of the survey. There was a 87% response rate to requests for SMS Mood ratings. Mean SMS Mood decreased over time for females (p = 0.006) but not males (p = 0.45). We found an inverse association between SMS Mood and the SMFQ, YSR/AD and YSR/WD, scales in females and the SMFQ and YSR/WD scales in males. 45% of participants reported at least one SMS Mood rating score below 5, while 5% reported clusters of low SMS scores. Clusters of low SMS Mood scores were associated with SMFQ scores in the clinical range at 24 (OR = 4.45) and 36 months (OR = 4.72), and YSR/WD in the clinical range at 36 months (OR = 4.61).
Conclusions
SMS Mood ratings represent a feasible means to augment but not replace assessment of mood obtained using standard instruments.
Similar content being viewed by others
Background
The 12-month prevalence of Major Depressive Disorder among adolescents aged 13–18 years in the US is 7.5% [1]. The prevalence of depression increases with age through the adolescent period, more so in females than males [2]. Historically, the tracking of mood disorder over time has required the repeat administration of clinical interviews or mood questionnaires. The logistics of doing this limit the frequency with which assessments can be undertaken, risking the possibility that brief episodes will be missed. There is also limited capacity to determine time of onset and offset of disorder. Brief scales delivered via text messaging offer a promising alternative for capturing mood data. Text messaging via Short Message Service (SMS) has been demonstrated to be an ‘adolescent-friendly’ and effective method of maintaining young research participants in longitudinal studies as well as a useful reminder tool [3]. Due to high cellular phone ownership and the ubiquity of text messaging as a means of communication among adolescents, SMS may also be effective as a data collection tool in longitudinal research, provided that the information requested does not require a complex response. Simple and frequently obtained measures of mood in adolescents, if valid, afford the opportunity for a more fine-grained examination of the relationship between mood and other events such as puberty onset. In addition, such measures may provide a more accurate indication of the onset and duration of mood disorder in young people participating in longitudinal research. Text messaging offers a number of advantages over pen and paper methods of mood monitoring, as demonstrated in a study of high school students in Ireland [4]. Compliance rates are higher with SMS than pencil and paper, and the ratings are more likely to be contemporaneous rather than retrospective. Compliance is probably higher because SMS texting affords more privacy than pencil and paper methods, and because young people typically have a mobile phone with them, while the pencil and paper format requires carrying ‘special equipment’ [4]. SMS Mood monitoring has been validated against the Patient Health Questionnaire-9 (PHQ-9), a standardized measure of depression, in adults [5, 6], but not to our knowledge against depression measures designed for young people. Thirty-three adults received daily automated text messages measuring their mood (What is your mood right now on a scale of 1–9?) and inquiring about thoughts and activities as part of their participation in group cognitive behavioural therapy for depression in a public sector clinic. During this time, they also received a PHQ-9 each week that they attended the therapy group. There was a significant relationship between daily mood scores and 1-week average mood scores and PHQ-9 scores controlling for linear change in depression scores, but the relationship between the 2-week average mood and PHQ-9 scores was non-significant [6]. In a randomised controlled trial of acupuncture for depression in adults SMS Mood scores were obtained weekly for 16 weeks. At week 16 post-randomisation, 220 participants responded to the weekly depression text within 6 days of completing the PHQ-9 paper questionnaire. The two measures were moderately correlated at that point (Kendall’s tau-b = 57, p < 001) [7]. To our knowledge SMS has not been used to track mood over long periods in young people or adults.
The aim of the current study was to assess the feasibility of collecting mood data at intervals over a period of 3 years via text message, as well as to describe the patterns and stability of the data in a cohort of rural young people. A further aim was to investigate the relationship of the mood data to self-report measures of depression obtained at baseline and at yearly intervals for 3 years. We hypothesized that better SMS Mood ratings would be associated with fewer depression symptoms on standard rating scales. Finally, we sought to determine, through exploratory analyses, whether clusters or runs of low SMS Mood ratings are associated with subsequent scores in the ‘clinical’ range on other depression measures.
Methods
The Adolescent Rural Cohort study of Hormones, health, Education, environments and Relationships (ARCHER) commenced in 2011, with the aim of examining the effect of pubertal hormone changes on adolescent health and well-being in a rural Australian cohort. Its protocol has been detailed previously [8]. Adolescents (9–14 years of age) and their parents were recruited from the community in two large regional towns in Australia, and their surrounding areas. Lack of parental competence in English or adolescent intellectual disability were exclusion criteria [8]. As part of the protocol, study participants completed self-report Short Mood and Feelings Questionnaires (SMFQ) [9] and youth self report (YSR) [10] questionnaires at baseline and at 12-monthly intervals for 3 years. In addition a text message was sent every 3 months via an automated SMS service to the nominated mobile phone asking the participant to rate their current mood.
The SMFQ is a 13-item subscale from a longer 33-item questionnaire (the original MFQ) validated for children and young people aged between 6 and 17 years. The questions asked on the survey are based on the Diagnostic and Statistical Manual criteria for depression. Respondents are asked to indicate the extent to which each item applied to them over the previous 2 weeks on the following scale: 0 (not true), 1 (sometimes), 2 (true). We defined caseness on the SMFQ as a score of 11 or greater as recommended by Patton et al. [11]. The YSR is a well validated and reliable assessment tool that measures emotional and mental wellbeing in 11–18 year olds. The scale contains 113 items, and respondents rated the extent to which each item applied to them on the following scale: 0 (not true), 1 (somewhat or sometimes true), 2 (very true or often true). The current analysis used scores from the Anxious/Depressed (YSR/AD) and Withdrawn/Depressed (YSR/WD) subscales. YSR subscale percentile scores were categorized to three levels as per the developers of the instrument: 0 (non-clinical), 1 (borderline), and 2 (clinical). To enable binary analyses the borderline and clinical categories were collapsed into one ‘clinical’ category. The SMS comprised a standard text: “Hi «First Name» «Last Name». On a scale from 0 to 9 (with 9 = best ever), what is your mood now? Thanks «Investigator Name».” This message is a linear analogue self-assessment scale of mood to assess mood fluctuation, modelled on previous SMS studies [5, 6]. Replies were sent to the automated service and downloaded to the study database.
Statistical analyses
Comparisons between those adolescents who did or did not complete all four study waves were made using a Chi square analysis for gender and Mann–Whitney U tests (MW U z) for age and Tanner stage (due to significant distributional skew and ordinal data, respectively). Analyses over time of the rate of SMS Mood measure completion and the proportion ‘low’ range SMS Mood scores [see below for method] were explored using Cochran’s Q tests. Because the data comprised repeated measures we examined time effects on the four respective mood measure variables (SMS Mood, SMFQ, YSR/AD, YSR/WD) using linear regression models fitted via general estimating equations (GEEs) assuming an exchangeable correlation structure. For the SMS Mood scores the time effect analyses included 13 time points, and for SMFQ, YSR/AD and YSR/WD only four time points. Given known gender effects, analyses were repeated and results reported separately for males and females. A series of generalised linear models (GLMs) was conducted to explore the relationship between SMS Moods scores (measured at the four time points corresponding to the four study waves) and the other mood measures. Time and gender were included as covariates in these models, and analyses were repeated within each gender separately.
To determine whether clusters or runs of low SMS Mood ratings are associated with subsequent scores in the ‘clinical’ range on other depression measures we first needed to identify a suitable cut-point for the SMS Mood rating. Using the first 12 months of data Receiver Operating Curve analysis determined that a cut-score of 4 on SMS Mood ratings offered the best sensitivity and specificity for detecting clinical caseness on the SMFQ. Hence, a binary variable was created for SMS Mood, where a coding of 0 represented a mood rating of 5 or higher, and a coding of 1 represented low mood (≤ 4). For the purpose of analyses, we defined a cluster as three or more scores below 5 on the SMS Mood rating, separated by no more than one score either in the normal range or missing. The association between SMS Mood clusters and SMFQ scores in the clinical range was determined for each study wave by producing odds ratios with 95% confidence intervals. Data were analysed using SPSS Version 24. Alpha was set at 0.05 for all analyses.
Results
Participants
Baseline characteristics of the sample, and a comparison of those who did and did not complete all four waves of data collection, are summarized in Table 1. The median age of the 342 young participants at baseline was 11 years, 45% were female and 11% were Indigenous. The sample was representative of the region in terms of gender (proportion in region 49% female), but underrepresented youth of Indigenous background (proportion in region 17%). In comparison to the region, participating families were generally more likely to have at least one adult in employment (87% vs region 81%) and to own their own dwelling (80% vs region 68%). Parents were also more likely to have completed tertiary education (49% vs region parents 20%). Fifty-six percent of females and 49% of males rated themselves as pre-pubertal or early-pubertal (Tanner stage 1 to 2). Data were analysed for participants with responses to all four waves of 12 monthly data collection (n = 277, 119 (43%) female). Baseline differences between the group that completed the study and the non-completers in age, gender and self-reported Tanner stage were not statistically significant (see Table 1).
Descriptive data
There was an 87% response rate to requests for SMS Mood ratings. Response rates varied as a percentage across the 13 collection points as follows; 86, 87, 93, 94, 94, 91, 88, 89, 91, 81, 83, 81, 78 (Cochran’s Q = 108, df = 12, p < 0.001). Response rates declined towards the end of the study period (logistic regression, where the dependent variable was SMS compliant (yes/no), and the predictor was time produced an odds ratio of 0.92 (95% CI 0.90–0.95).The mean SMS Mood score was 6.6 (SD 1.4, range 0–9). The mean SMS Mood score decreased over time for females but not males (see Table 2 and Fig. 1a). The percentage of SMS Mood scores falling in the ‘low’ range at each collection point did not vary significantly (range 5–9.3%, p = 0.50). One hundred and twenty-five participants (45%) had at least one SMS Mood score falling in the low range. Of these, 74 participants had a single low score and 51 had two or more low scores. Fifteen participants (5%) had clusters of low SMS Mood scores. Seven had such clusters commencing in year 1, three in year 2 and five in year 3.
Mean SMFQ scores increased (more depression symptoms) over time for females but not males (see Table 2 and Fig. 1b). The percentage of participants scoring in the clinical range on the SMFQ at baseline and at subsequent 12 monthly data collection points was 12.6, 9.7, 14.4 and 17.3 respectively.
Mean YSR/AD scores increased (more depression symptoms) over time for females and decreased over time for males (see Table 2 and Fig. 1c). The percentage of participants scoring in the clinical range on the YSR/AD at baseline and at subsequent 12 monthly data collection points was 12.3, 11.9, 11.6 and 16.2 respectively.
Mean YSR/WD scores increased (more depression symptoms) over time for females and decreased over time for males (see Table 2 and Fig. 1d). The percentage of participants scoring in the clinical range on the YSR/WD at baseline and at subsequent 12 monthly data collection points was 6.9, 7.9, 8.3 and 11.2 respectively.
Relationship between SMS Mood scores and other measures of mood
Linear regression analyses of continuous data found an inverse association between SMS Mood and SMFQ and YSR/WD, but not the YSR/AD (see Table 3). Subgroup analysis found an association between SMS Mood and the YSR/AD for females but not males. Risk analyses of binary data, expressed as odds ratios (OR), found an association between having a cluster of SMS Mood scores in the low range any time in the study period, and having an SMFQ score in the clinical range at both 24 (OR = 4.45, 95% CI 1.49 to 13.29) and 36 months (OR = 4.72, 95% CI 1.62 to 13.72). There was also a statistically significant association between having a cluster of SMS Mood scores in the low range any time in the study period and having a YSR/WD in the clinical range at 24 months (OR = 4.61, 95% CI 1.34 to 15.88).
Discussion
Participants who completed all four waves of the present study responded to 87% of the 3-monthly SMS text requests for a mood rating, demonstrating its feasibility for use in longitudinal research with young people. SMS Mood scores followed a similar trajectory over time as the SMFQ and YSR depression scales, with a worsening of mood among females while mood in males remained unchanged or even improved. The findings of the present study contrast with research using different depression scales which found gender difference remained constant over time [12, 13]), There was a robust and consistent relationship between SMS Mood scores and the depression scales in females, while the relationship was less consistent in males. The findings point to the SMS Mood scale being a more useful proxy measure for mood disturbance among adolescent females than males.
Having a cluster of SMS Mood scores in the low range occurred in only five percent of participants, but was associated with having SMFQ scores in the clinical range at 24 and 36 months. A series of low SMS Mood scores may be a precursor to depression identified by other means. If this is the case, a series of low SMS Mood scores could be used in longitudinal research to capture more accurately the onset of a depressive episode. The prevalence of clusters of low SMS Mood scores was similar to that of Major Depressive Disorder in adolescents, lending credibility to the proposition the two are associated. Isolated SMS Mood scores in the low range, on the other hand, were common (40% of participants), and their clinical significance is unknown. Single low SMS Mood scores may represent normal variation in mood, responses to environmental stress, biological events such as infection or possibly even hormonal change. In the present study, peri-menstrual dysphoria is unlikely to account for low SMS scores because females were no more likely than males to score in the low range on the SMS Mood scale (p = 0.42).
Strengths of the study include the high retention rate of participants over 3 years, and their high response rate to the request for SMS Mood ratings. Limitations to the study must also be acknowledged. The technology we used was, by current standards, primitive. Sophisticated apps to record and store mood information are now available for smartphones and other devices. The sample comprised volunteers from a specific region of rural Australia and may therefore not be representative of adolescents in general. The sample was modest in size for a community study, and therefore lacked the power to detect small effects. The study obtained only self-report of mood measures. It is known that adolescent reports of mood symptoms are inflated compared with corroborative reports from parents. However, this is a minor concern for the present study as we were interested in the relationship between measures and patterns over time rather than estimates of prevalence. The cut-score for low range SMS Mood scores was derived from ROC analyses of its association with the SMFQ, therefore introducing potential bias to subsequent analyses examining the relationship between the two measures when treated as binary variables. Owing to the low prevalence of clusters of low SMS Mood scores we were unable to perform more fine-grained analyses of their temporal association with the SMFQ and YSR.
Conclusion
SMS Mood ratings represent a low cost means to augment but not replace assessment of mood obtained using standard instruments. Frequency of assessment can be tailored to the needs of the study. Clusters of low SMS Mood scores map on to high mood disturbance scores on standard mood measures, while the significance of isolated low SMS Mood scores is presently unknown.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Abbreviations
- ARCHER:
-
Adolescent Rural Cohort study of Hormones, health, Education, environments and Relationships
- OR:
-
odds ratio
- PHQ-9:
-
Patient Health Questionnaire-9
- SMFQ:
-
Short Mood and Feelings Questionnaire
- SMS:
-
short messaging service
- YSR:
-
youth self report
- YSR/AD:
-
youth self report anxious/depressed
- YSR/WD:
-
youth self report withdrawn/depressed
References
Avenevoli S, Swendsen J, He JP, Burstein M, Merikangas KR. Major depression in the national comorbidity survey-adolescent supplement: prevalence, correlates, and treatment. J Am Acad Child Adolesc Psychiatry. 2015;54(1):37–44.e2.
Thapar A, Collishaw S, Pine DS, Thapar AK. Depression in adolescence. Lancet. 2012;379:1056–67.
Balzer BW, Kelly PJ, Hazell P, Paxton K, Hawke C, Steinbeck KS. Text messaging is a useful reminder tool. Arch Dis Child. 2014;99:666–7.
Matthews M, Doherty G, Sharry J, Fitzpatrick C. Mobile phone mood charting for adolescents. Br J Guid Counc. 2008;36:113–29.
Keding A, Bohnke JR, Croudace TJ, Richmond SJ, MacPherson H. Validity of single item responses to short message service texts to monitor depression: an mHealth sub-study of the UK ACUDep trial. BMC Med Res Methodol. 2015;15:56.
Aguilera A, Schueller SM, Leykin Y. Daily mood ratings via text message as a proxy for clinic based depression assessment. J Affect Disord. 2015;175:471–4.
Richmond SJ, Keding A, Hover M, Gabe R, Cross B, Torgerson D, et al. Feasibility, acceptability and validity of SMS text messaging for measuring change in depression during a randomised controlled trial. BMC Psychiatry. 2015;15:68.
Steinbeck K, Hazell P, Cumming RG, Skinner SR, Ivers R, Booy R, et al. The study design and methodology for the ARCHER study–adolescent rural cohort study of hormones, health, education, environments and relationships. BMC Pediatr. 2012;12:143.
Angold A, Costello EJ, Messer SC, Pickles A, Winder F, Silver D. Development of a short questionnaire for use in epidemiological studies of depression in children and adolescents. Int J Methods Psychiatr Res. 1995;5:237–49.
Achenbach TM, Rescorla LA. Manual for the ASEBA school-age forms & profiles. Burlington: University of Vermont, Research Center for Children, Youth, & Families; 2001.
Patton GC, Olsson C, Bond L, Toumbourou JW, Carlin JB, Hemphill SA, et al. Predicting female depression across puberty: a two-nation longitudinal study. J Am Acad Child Adolesc Psychiatry. 2008;47:1424–32.
Maciejewski DF, van Lier PA, Branje SJ, Meeus WH, Koot HM. A daily diary study on adolescent emotional experiences: measurement invariance and developmental trajectories. Psychol Assess. 2017;29:35–49.
Moneta GB, Schneider B, Csikszentmihalyi M. A longitudinal study of the self-concept and eperiential components of self-worth and affect across adolescence. Appl Dev Sci. 2001;5:125–42.
Acknowledgements
In addition to the authorship, substantial contributions to study conception, design protocols and questionnaire development were made by Adrian Bauman, David L Bennett, Robert Booy, Ngiare Brown, Robert Cumming, Gregory Fulcher, David Handelsman, Mary Lam, Andrew Martin, Geoffrey Morgan, Margot Rawsthorne and Jean Starling. The investigators gratefully acknowledge research assistants, Janet Symons and Lisa Riley, for day to day running of the study, Mourin Sanjida for data cleaning and the ARCHER participants and their families for contributing their time and effort, and the schools and communities of the Central West of NSW, Australia who were key to recruitment of this cohort. We thank Bruce Robinson, for his encouragement and for giving us access to a Medical Foundation grant.
Funding
The ARCHER study is supported by an Australian National Health and Medical Research Council Project Grant (#1003312). The authors gratefully acknowledge the Sydney Medical School’s Medical Foundation Grant (No. 999) that supported the initial feasibility studies. An Australian Rotary District 9650 Youth Depression Grant (No. 9650) supported the final feasibility study for the ARCHER study.
Author information
Authors and Affiliations
Contributions
PH, CH, RI, RS and KS contributed to the design of the study. PH, BB, PK and GL contributed to data management and analyses. KP was responsible for recruitment and data collection. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Full ethics approval and informed consent were obtained prior to conduct of this study (University of Sydney HREC Number 13094).
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Hazell, P., Balzer, B., Kelly, P. et al. Serial measurement of mood via text messaging in young people. Child Adolesc Psychiatry Ment Health 14, 5 (2020). https://doi.org/10.1186/s13034-020-0313-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13034-020-0313-0