Skip to main content

Advertisement

SpringerLink
Log in

Measuring Psychiatric Symptoms Remotely: a Systematic Review of Remote Measurement-Based Care

  • Public Policy and Public Health (G Norquist, Section Editor)
  • Published:
Current Psychiatry Reports Aims and scope Submit manuscript

Abstract

Purpose of Review

This article systematically reviews studies examining remote measurement-based care (RMBC), defined as using technology to measure patients’ psychiatric symptoms outside the context of a clinical encounter.

Recent Findings

Thirty-six studies were identified that measured patients’ psychiatric symptoms remotely and provided feedback to treatment providers. The majority were single group designs. There was evidence supporting the short-term feasibility and acceptability of RMBC, although long-term sustainability was less clear. Thirteen randomized controlled trials were identified. RMBC was typically implemented as part of a multicomponent intervention (e.g., internet-based cognitive behavioral therapy with feedback to provider). Three studies experimentally isolated the clinical effects of RMBC, with two reporting no statistically significant differences between the RMBC and control conditions and one reporting greater symptom improvement associated with RMBC.

Summary

RMBC appears feasible and acceptable and may be a promising intervention for improving mental health care, but additional experimental studies are needed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

Papers of particular interest, published recently, have been highlighted as: • Of importance •• Of major importance

  1. Fortney JC, Unützer J, Wrenn G, Pyne JM, Smith GR, Schoenbaum M, et al. A tipping point for measurement-based care. Psychiatr Serv. 2017;68(2):179–88. https://doi.org/10.1176/appi.ps.201500439.

    Article  PubMed  Google Scholar 

  2. Harding KJK, Rush AJ, Arbuckle M, Trivedi MH, Pincus HA. Measurement-based care in psychiatric practice: a policy framework for implementation. J Clin Psychiatry. 2011;72(8):1136–43.

    Article  PubMed  Google Scholar 

  3. Guo T, Xiang YT, Xiao L, Hu CQ, Chiu HF, Ungvari GS, et al. Measurement-based care versus standard care for major depression: a randomized controlled trial with blind raters. Am J Psychiatry. 2015;172(10):1004–13.

    Article  PubMed  Google Scholar 

  4. Knaup C, Koesters M, Schoefer D, Becker T, Puschner B. Effect of feedback of treatment outcome in specialist mental healthcare: a meta-analysis. Br J Psychiatry. 2009;195:15–22. https://doi.org/10.1192/bjp.bp.108.053967.

    Article  PubMed  Google Scholar 

  5. Shimokawa K, Lambert MJ, Smart DW. Enhancing treatment outcome of patients at risk of treatment failure: meta-analytic and mega-analytic review of a psychotherapy quality assurance system. J Consult Clin Psychol. 2010;78(3):298–311. https://doi.org/10.1037/a0019247.

    Article  PubMed  Google Scholar 

  6. Krägeloh CU, Czuba KJ, Billington DR, Kersten O, Siegert RJ. Using feedback from patient-report outcome measures in mental health services: a scoping study and typology. Psychiatr Serv. 2015;66:224–41. https://doi.org/10.1176/appi.ps.201400141.

    Article  PubMed  Google Scholar 

  7. Douglas S, Button S, Casey SE. Implementing for sustainability: promoting use of a measurement feedback system for innovation and quality improvement. Adm Policy Ment Health Mental Health Services Res. 2016;43(3):286–91.

    Article  Google Scholar 

  8. Tracey TJG, Wampold BE, Lichtenberg JW, Goodyear RK. Expertise in psychotherapy: an elusive goal? Am Psychol. 2014;69(3):218–29. https://doi.org/10.1037/a0035099.

    Article  PubMed  Google Scholar 

  9. Mojtabai R, Olfson M, Sampson NA, Jin R, Druss B, Wang PS, et al. Barriers to mental health treatment: results from the National Comorbidity Survey Replication. Psychol Med. 2011;41(8):1751–61.

    Article  CAS  PubMed  Google Scholar 

  10. Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol. 2008;4:1–32. https://doi.org/10.1146/annurev.clinpsy.3.022806.091415.

    Article  PubMed  Google Scholar 

  11. Myin-Germeys I, van Os J. Stress-reactivity in psychosis: evidence for an affective pathway to psychosis. Clin Psychol Rev. 2007;27:409–24. https://doi.org/10.1016/j.cpr.2006.09.005.

    Article  PubMed  Google Scholar 

  12. Hilty DM, Chan S, Hwang T, Wong A, Bauer AM. Advances in mobile mental health: opportunities and implications for the spectrum of e-mental health services. mHealth. 2017;3(34):1–18. https://doi.org/10.21037/mhealth.2017.06.02.

    Article  Google Scholar 

  13. Mohr DC, Zhang M, Schueller SM. Personal sensing: understanding mental health using ubiquitous sensors and machine learning. Annu Rev Clin Psychol. 2017;13:23–47. https://doi.org/10.1146/annurev-clinpsy-032816-044949.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Wang R, Aung MS, Abdullah S, Brian R, Campbell AT, Choudhury T, et al. CrossCheck: toward passive sensing and detection of mental health changes in people with schizophrenia. UbiComp. 2016:886–97. https://doi.org/10.1145/2971648.2971740.

  15. Španiel F, Vohlídka P, Hrdlička J, Kožený J, Novák T, Motlová L, et al. ITAREPS: information technology aided relapse prevention programme in schizophrenia. Schizophr Res. 2008;98(1):312–7.

    Article  PubMed  Google Scholar 

  16. Gustafson DH, McTavish FM, Chih MY, Atwood AK, Johnson RA, Boyle MG, et al. A smartphone application to support recovery from alcoholism: a randomized clinical trial. JAMA Psychiatry. 2014;71(5):566–72. https://doi.org/10.1001/jamapsychiatry.2013.4642.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Newby J, Robins L, Wilhelm K, Smith J, Fletcher T, Gillis I, et al. Web-based cognitive behavior therapy for depression in people with diabetes mellitus: a randomized controlled trial. J Med Internet Res. 2017;19(5):e157. https://doi.org/10.2196/jmir.7274.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Chen RY, Feltes JR, Tzeng WS, Lu ZY, Pan M, Zhao N, et al. Phone-based interventions in adolescent psychiatry: a perspective and proof of concept pilot study with a focus on depression and autism. JMIR Res Protoc. 2017;6(6):e114. https://doi.org/10.2196/resprot.7245.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Simon GE, Ralston JD, Savarino J, Pabiniak C, Wentzel C, Operskalski BH. Randomized trial of depression follow-up care by online messaging. J Gen Intern Med. 2011;26(7):698–704. https://doi.org/10.1007/s11606-011-1679-8.

    Article  PubMed  PubMed Central  Google Scholar 

  20. •• Aharonovich E, Sarvet A, Stohl M, DesJarlais D, Tross S, Hurst T, et al. Reducing non-injection drug use in HIV primary care: a randomized trial of brief motivational interviewing, with and without HealthCall, a technology-based enhancement. J Subst Abus Treat. 2017;74:71–9. This study experimentally isolates the effect of adding remote measurement-based care to motivational interviewing for reducing non-injection drug use, showing that symptoms decreased in both groups decreased

    Article  Google Scholar 

  21. • Aguilera A, Bruehlman-Senecal E, Demasi O, Avila P. Automated text messaging as an adjunct to cognitive behavioral therapy for depression: a clinical trial. J Med Internet Res. 2017;19(5):e148. https://doi.org/10.2196/jmir.6914. This randomized controlled trial demonstrated lower treatment drop-out for in-person cognitive behavioral therapy when augmented with text message-based mood monitoring, medication reminders, and treatment-related content.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Watts S, Mackenzie A, Thomas C, Griskaitis A, Mewton L, Williams A, et al. CBT for depression: a pilot RCT comparing mobile phone vs. computer. BMC Psychiatry. 2013;13(1):49.

    Article  PubMed  PubMed Central  Google Scholar 

  23. • Bauer AM, Iles-Shih M, Ghomi RH, Rue T, Grover T, Kincler N, et al. Acceptability of mHealth augmentation of collaborative care: a mixed methods pilot study. Gen Hosp Psychiatry. 2018;51:22–9. This article demonstrates the short-term feasibility and acceptability of a mobile health application for remotely monitoring depression and anxiety symptoms in the context of collaborative care

    Article  PubMed  Google Scholar 

  24. • Ben-Zeev D, Scherer EA, Gottlieb JD, Rotondi AJ, Brunette MF, Achtyes ED, et al. mHealth for schizophrenia: patient engagement with a mobile phone intervention following hospital discharge. JMIR Ment Health. 2016;3(3):e34. https://doi.org/10.2196/mental.6348. This article demonstrates the feasibility of implementing a multicomponent mobile health intervention that includes remote measurement-based care in a large sample of individuals with psychosis.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Burns MN, Begale M, Duffecy J, Gergle D, Karr CJ, Giangrande E, et al. Harnessing context sensing to develop a mobile intervention for depression. J Med Internet Res. 2011;13(3):e55. https://doi.org/10.2196/jmir.1838.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Robertson L, Smith M, Castle D, Tannenbaum D. Using the Internet to enhance the treatment of depression. Australas Psychiatry. 2006;14(4):413–7.

    Article  PubMed  Google Scholar 

  27. Kumar D, Tully LM, Iosif AM, Zakskorn LN, Nye KE, Zia A, et al. A mobile health platform for clinical monitoring in early psychosis: implementation in community-based outpatient early psychosis care. JMIR Mental Health. 2018;5(1):e15. https://doi.org/10.2196/mental.8551.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Ben-Zeev D, Brenner CJ, Begale M, Duffecy J, Mohr DC, Mueser KT. Feasibility, acceptability, and preliminary efficacy of a smartphone intervention for schizophrenia. Schizophr Bull. 2014;40(6):1244–53.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Sheeran T, Rabinowitz T, Lotterman J, Reilly CF, Brown S, Donehower P, et al. Feasibility and impact of telemonitor-based depression care management for geriatric homecare patients. Telemed e-Health. 2011;17(8):620–6.

    Article  Google Scholar 

  30. Haug S, Lucht MJ, John U, Meyer C, Schaub MP. A pilot study on the feasibility and acceptability of a text message-based aftercare treatment programme among alcohol outpatients. Alcohol Alcohol. 2015;50(2):188–94.

    Article  CAS  PubMed  Google Scholar 

  31. Niendam TA, Tully LM, Iosif AM, Kumar D, Nye KE, Denton JC, et al. Enhancing early psychosis treatment using smartphone technology: a longitudinal feasibility and validity study. J Psychiatr Res. 2018;96:239–46. https://doi.org/10.1016/j.jpsychires.2017.10.017.

    Article  PubMed  Google Scholar 

  32. Tolin DF, McGrath PB, Hale LR, Weiner DN, Gueorguieva R. A multisite benchmarking trial of capnometry guided respiratory intervention for panic disorder in naturalistic treatment settings. Appl Psychophysiol Biofeedback. 2017;42(1):51–8. https://doi.org/10.1007/s10484-017-9354-4.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Forchuk C, Donelle L, Ethridge P, Warner L. Client perceptions of the mental health engagement network: a secondary analysis of an intervention using smartphones and desktop devices for individuals experiencing mood or psychotic disorders in Canada. JMIR Mental Health. 2015;2(1):e1. https://doi.org/10.2196/mental.3926.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Mohr DC, Montague E, Stiles-Shields C, Kaiser SM, Brenner C, Carty-Fickes E, et al. MedLink: a mobile intervention to address failure points in the treatment of depression in general medicine. Int Conf Pervasive Comput Technol Healthc. 2015;2015:100–7.

    PubMed  PubMed Central  Google Scholar 

  35. Pramana G, Parmanto B, Kendall PC, Silk JS. The SmartCAT: an m-health platform for ecological momentary intervention in child anxiety treatment. Telemed e-Health. 2014;20(5):419–27. https://doi.org/10.1089/tmj.2013.0214.

    Article  Google Scholar 

  36. • Hantsoo L, Criniti S, Khan A, Moseley M, Kincler N, Faherty LJ, et al. A mobile application for monitoring and management of depressed mood in a vulnerable pregnant population. Psychiatr Serv. 2018;69(1):104–7. This randomized controlled trial evaluates a mood tracking mobile health application for monitoring depressive symptoms during pregnancy, showing higher self-rated ability to manage health in the remote measurement-based care condition relative to treatment-as-usual

    Article  PubMed  Google Scholar 

  37. Mavandadi S, Benson A, DiFilippo S, Streim JE, Oslin D. A telephone-based program to provide symptom monitoring alone vs symptom monitoring plus care management for late-life depression and anxiety: a randomized clinical trial. JAMA Psychiatry. 2015;72(12):1211–8.

    Article  PubMed  Google Scholar 

  38. Reid SC, Kauer SD, Hearps SJ, Crooke AH, Khor AS, Sanci LA, et al. A mobile phone application for the assessment and management of youth mental health problems in primary care: a randomised controlled trial. BMC Fam Pract. 2011;12(1):131.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Reid SC, Kauer SD, Hearps SJ, Crooke AH, Khor AS, Sanci LA, et al. A mobile phone application for the assessment and management of youth mental health problems in primary care: health service outcomes from a randomised controlled trial of mobiletype. BMC Fam Pract. 2013;14(1):84.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Volker D, Zijlstra-Vlasveld MC, Anema JR, Beekman AT, Brouwers EP, Emons WH, et al. Effectiveness of a blended web-based intervention on return to work for sick-listed employees with common mental disorders: results of a cluster randomized controlled trial. J Med Internet Res. 2015;17(5):e116.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Meglic M, Furlan M, Kuzmanic M, Kozel D, Baraga D, Kuhar I, et al. Feasibility of an eHealth service to support collaborative depression care: results of a pilot study. J Med Internet Res. 2010;12(5):e63. https://doi.org/10.2196/jmir.1510.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Insel TR. Digital phenotyping: technology for a new science of behavior. JAMA. 2017;318(13):1215–6. https://doi.org/10.1001/jama.2017.11295.

    Article  PubMed  Google Scholar 

  43. Aikens JE, Trivedi R, Heapy A, Pfeiffer PN, Piette JD. Potential impact of incorporating a patient-selected support person into mHealth for depression. J Gen Intern Med. 2015;30(6):797–803. https://doi.org/10.1007/s11606-015-3208-7.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Bauer M, Glenn T, Keil M, Bauer R, Marsh W, Grof P, et al. Brief depressive symptoms in patients with bipolar disorder: analysis of long-term self-reported data. Aust N Z J Psychiatry. 2012;46(11):1068–78. https://doi.org/10.1177/0004867412452017.

    Article  PubMed  Google Scholar 

  45. Depp CA, Mausbach B, Granholm E, Cardenas V, Ben-Zeev D, Patterson TL, et al. Mobile interventions for severe mental illness: design and preliminary data from three approaches. J Nerv Meant Dis. 2010;198(10):715–21. https://doi.org/10.1097/NMD.0b013e3181f49ea3.

    Article  Google Scholar 

  46. Glass JE, McKay JR, Gustafson DH, Kornfield R, Rathouz PJ, McTavish FM, et al. Treatment seeking as a mechanism of change in a randomized controlled trial of a mobile health intervention to support recovery from alcohol use disorders. J Subst Abus Treat. 2017;77:57–66. https://doi.org/10.1016/j.jsat.2017.03.011.

    Article  Google Scholar 

  47. McTavish FM, Chih MY, Shah D, Gustafson DH. How patients recovering from alcoholism use a smartphone intervention. J Dual Diagn. 2012;8(4):294–304. https://doi.org/10.1080/15504263.2012.723312.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Ivanova E, Lindner P, Ly KH, Dahlin M, Vernmark K, Andersson G, et al. Guided and unguided acceptance and commitment therapy for social anxiety disorder and/or panic disorder provided via the Internet and a smartphone application: a randomized controlled trial. J Anxiety Disord. 2016;44:27–35. https://doi.org/10.1016/j.janxdis.2016.09.012.

    Article  PubMed  Google Scholar 

  49. Lazarou I, Karakostas A, Stavropoulos TG, Tsompanidis T, Meditskos G, Kompatsiaris I, et al. A novel and intelligent home monitoring system for care support of elders with cognitive impairment. J Alzheimers Dis. 2016;54(4):1561–91. https://doi.org/10.3233/JAD-160348.

    Article  PubMed  Google Scholar 

  50. • Mares ML, Gustafson DH, Glass JE, Quanbeck A, McDowell H, McTavish F, et al. Implementing an mHealth system for substance use disorders in primary care: a mixed methods study of clinicians’ initial expectations and first year experiences. BMC Med Inform Decis Mak. 2016;16(1):126. This study evaluated the long-term feasibility and acceptability (11-month follow-up) of a mobile health application with health tracking content for individuals receiving treatment for substance use

    Article  PubMed  PubMed Central  Google Scholar 

  51. Miklowitz DJ, Price J, Holmes EA, Rendell J, Bell S, Budge K, et al. Facilitated integrated mood management for adults with bipolar disorder. Bipolar Disord. 2012;14(2):185–97. https://doi.org/10.1111/j.1399-5618.2012.00998.x.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Mohr DC, Duffecy J, Jin L, Ludman EJ, Lewis A, Begale M, et al. Multimodal e-mental health treatment for depression: a feasibility trial. J Med Internet Res 2010:12(5).

    Article  PubMed  PubMed Central  Google Scholar 

  53. Reid SC, Kauer SD, Khor AS, Hearps SJ, Sanci LA, Kennedy AD, et al. Using a mobile phone application in youth mental health: an evaluation study. Aust Fam Physician. 2012;41(9):711–4.

    PubMed  Google Scholar 

  54. Simon J, Budge K, Price J, Goodwin GM, Geddes JR. Remote mood monitoring for adults with bipolar disorder: an explorative study of compliance and impact on mental health service use and costs. Eur Psychiatry. 2017;45:14–9. https://doi.org/10.1016/j.eurpsy.2017.06.007.

    Article  CAS  PubMed  Google Scholar 

  55. Smith B, Harms WD, Burres S, Korda H, Rosen H, Davis J. Enhancing behavioral health treatment and crisis management through mobile ecological momentary assessment and SMS messaging. Health Informatics J. 2012;18(4):294–308. https://doi.org/10.1177/1460458212445349.

    Article  PubMed  Google Scholar 

  56. Španiel F, Vohlídka P, Kožený J, Novák T, Hrdlička J, Motlová L, et al. The information technology aided relapse prevention programme in schizophrenia: an extension of a mirror-design follow-up. Int J Clin Pract. 2008;62(12):1943–6.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Volker D, Zijlstra-Vlasveld MC, Brouwers EP, van der Feltz-Cornelis CM. Process evaluation of a blended web-based intervention on return to work for sick-listed employees with common mental health problems in the occupational health setting. J Occup Rehabil. 2017;27(2):186–94. https://doi.org/10.1007/s10926-016-9643-4.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Sarah Safranek at the University of Washington Health Sciences Library for her assistance in conducting our search.

Disclaimer

The views expressed in this article are solely those of the authors and do not reflect an endorsement or the official policy or position of the Department of Veterans Affairs.

Funding

Dr. Goldberg was supported by a VA Office of Academic Affiliations’ Advanced Fellowship in Health Services Research and Development (TPH 61-000-24). Dr. Fortney was supported by a VA Health Services Research and Development Research Career Scientist Award.

Author information

Author notes

  1. Simon B. Goldberg

    Present address: Department of Counseling Psychology, University of Wisconsin, Madison, WI, USA

Authors and Affiliations

  1. Health Services Research & Development (HSR&D) Center of Innovation (COIN), VA Puget Sound Health Care System, 1660 South Columbian Way, Seattle, WA, 98108, USA

    Simon B. Goldberg & John C. Fortney

  2. Department of Health Services, University of Washington, Seattle, WA, USA

    Simon B. Goldberg

  3. VA Puget Sound Health Care System, Seattle, WA, USA

    Benjamin Buck

  4. Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA

    Benjamin Buck

  5. School of Medicine, University of Washington, Seattle, WA, USA

    Shiri Raphaely

  6. Department of Psychiatry & Behavioral Sciences, University of Washington, Seattle, WA, USA

    John C. Fortney

Authors
  1. Simon B. Goldberg
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Benjamin Buck
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shiri Raphaely
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. John C. Fortney
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Simon B. Goldberg.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Human and Animal Rights and Informed Consent

This article does not contain any studies with human or animal subjects performed by any of the authors.

Additional information

This article is part of the Topical Collection on Public Policy and Public Health

Electronic Supplementary Material

ESM 1

(DOCX 63 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Goldberg, S.B., Buck, B., Raphaely, S. et al. Measuring Psychiatric Symptoms Remotely: a Systematic Review of Remote Measurement-Based Care. Curr Psychiatry Rep 20, 81 (2018). https://doi.org/10.1007/s11920-018-0958-z

Download citation

  • Published:

  • DOI: https://doi.org/10.1007/s11920-018-0958-z

Keywords

Search

Navigation