Skip to main content
SpringerLink
Log in

How to Build, Evaluate, and Increase Your e-Mental Health Program Efficiency

  • Chapter
e-Mental Health

  • 2376 Accesses

Abstract

Objective: This chapter discusses the prioritization of outcomes and evaluation in the provision of synchronous telemedicine (i.e., videoconferencing, STM) services. Methods: This organizational approach may be a shift from seeing what happens with planned services to planning the outcomes and then designing the services—in advance. Results: Basic and advanced areas of evaluation (e.g., satisfaction, technology, cost, clinical and other outcomes) are suggested and involve the many participants in STM in a systematic framework. It also offers suggestions on how to do a needs assessment and how to adjust priorities based on specific needs and available resources in a program. Examples of project improvement apply ideas from theory to clinical and other associated outcomes. References and resources of information are provided for further review. Conclusion: The readers acquire knowledge, skill, and a framework to improve existing programs and help their many participants.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 129.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Hilty DM, Ferrer D, Callahan EJ, et al. The effectiveness of telemental health: a 2013 review. Telemed J E Health. 2013;19(6):444–54.

    Article  PubMed Central  PubMed  Google Scholar 

  2. Fortney JC, Pyne JM, Mouden SP, et al. Practice-based versus telemedicine-based collaborative care for depression in rural federally qualified health centers: a pragmatic randomized comparative effectiveness trial. Am J Psychiatry. 2013;170(4):414–25.

    Article  PubMed  Google Scholar 

  3. Katon W, Von Korff M, Lin E, et al. Collaborative management to achieve depression treatment guidelines. J Clin Psychiatry. 1997;58 Suppl 1:20–4.

    PubMed  Google Scholar 

  4. Moreno FA, Chong J, Dumbauld J, et al. Use of standard webcam and Internet equipment for telepsychiatry treatment of depression among underserved Hispanics. Psychiatr Serv. 2012;63(12):1213–7.

    Article  PubMed  Google Scholar 

  5. Unutzer J, Choi Y, Cook IA, et al. A web-based data management system to improve care for depression in a multicenter clinical trial. Psychiatr Serv. 2002;53:671–8.

    Article  PubMed  Google Scholar 

  6. Geyer J, Myers K, Vander Stoep A, et al. Implementing a low-cost web-based clinical trial management system for community studies: a case study. Clin Trials. 2011;8:634–44.

    Article  PubMed  Google Scholar 

  7. Yellowlees PM, Odor A, Burke MM, et al. A feasibility study of asynchronous telepsychiatry for psychiatric consultations. Psychiatr Serv. 2010;61(8):838–40.

    Article  PubMed  Google Scholar 

  8. Ottawa ON. Personal wireless device use for wound care consultation: a review of safety, clinical benefits and guidelines [Internet]. Canadian Agency for Drugs and Technologies in Health, May, 2014. 28 Feb 2005. At http://www.cadth.ca/en/products/rapid-response.

  9. Hilty DM, Liu W, Marks SL, et al. Effectiveness of telepsychiatry: a brief review. Can Psychiat Asso Bull. 2003;35(5):10–17.

    Google Scholar 

  10. Yellowlees PM, Shore JH, Roberts L, et al. Practice guidelines for videoconferencing-based telemental health. Telemed J E Health. 2010;16(10):1074–89.

    Article  PubMed  Google Scholar 

  11. Shore JH, Mishkind MC, Bernard J, et al. A lexicon of assessment and outcome measures for telemental health, ATA, 2013. 28 Feb 2015. At http://www.americantelemed.org/practice/standards/ata-standards-guidelines/a-lexicon-of-assessment-and-outcome-measurements-for-telemental-health#.UwF5Dv0_3-Y OR http://www.americantelemed.org/resources/standards/ata-standards-guidelines/a-lexicon-of-assessment-and-outcome-measurements-for-telemental-health#.U2bG2xYrfdk.

  12. Hilty DM, Yellowlees PM, Nasatir SEH, et al. Program evaluation and practical, step-by-step program modification in telemental health. In: Behavioral telehealth series volume 1- clinical video conferencing: program development and practice. Springer Press, New York. 2014. pp. 75–104.

    Google Scholar 

  13. Hilty DM, Nesbitt TS, Hales RE, et al. The use of telemedicine by academic psychiatrists for the provision of care in the primary care setting. Medscape Mental Health. 2000;5:1–11.

    Google Scholar 

  14. Myers KM. Effectiveness of a telehealth service delivery model for treating attention-deficit hyperactivity disorder: results of a community-based randomized controlled trial. J Am Acad Child Adolesc Psychiatry. 2015;54(4):263–74.

    Article  PubMed  Google Scholar 

  15. Koenig HG, Cohen HJ, Goli V, et al. Major depression and the NIMH Diagnostic Interview Schedule: validation in medically ill hospitalized patients. Int J Psychiatry Med. 1989;19:123–32.

    Article  CAS  PubMed  Google Scholar 

  16. Wells KB, Burnam MA, Leake B, et al. Agreement between face-to-face and telephone administered versions of the depression section of the NIMH Diagnostic Interview Schedule. J Psychiatr Res. 1988;22:207–20.

    Article  CAS  PubMed  Google Scholar 

  17. Hilty DM, Yellowlees PM, Cobb HC, et al. Models of telepsychiatric consultation-liaison service to rural primary care. Psychosomatics. 2006;47(2):152–7.

    Article  PubMed  Google Scholar 

  18. World Health Organization: telemedicine opportunities and developments in member states. Results of the second global survey on eHealth. Geneva: WHO Press; 2011.

    Google Scholar 

  19. Hilty DM, Marks SL, Urness D, et al. Clinical and educational applications of telepsychiatry: a review. Can J Psychiatr. 2004;49(1):12–23.

    Google Scholar 

  20. Dobbins ML, Roberts N, Vicari SK, et al. The consulting conference: a new model of collaboration for child psychiatry and primary care. Acad Psychiatry. 2011;35:260–2.

    Article  PubMed  Google Scholar 

  21. Hilty DM, Yellowlees PM, Nesbitt TS. Evolution of telepsychiatry to rural sites: change over time in types of referral and PCP knowledge, skill, and satisfaction. Gen Hosp Psychiatry. 2006;28(5):367–73.

    Article  PubMed  Google Scholar 

  22. Hilty DM, Nesbitt TS, Kuenneth TA, et al. Telepsychiatric consultation to primary care: rural vs. suburban needs, utilization and provider satisfaction. J Rural Health. 2007;23(2):163–5.

    Article  PubMed  Google Scholar 

  23. Manian FA, Janssen DA. Curbside consultations. JAMA. 1996;275:145–6.

    Article  CAS  PubMed  Google Scholar 

  24. Gruppen LD, Wolf FM, Van Voorhees CV, et al. Information-seeking strategies and differences among primary care physicians. Mobius. 1987;7:18–26.

    CAS  PubMed  Google Scholar 

  25. Ely JW, Burch RJ, Vinson DC. The information needs of family physicians: case specific clinical questions. J Fam Pract. 1992;25:265–9.

    Google Scholar 

  26. Gorman PN, Ash J, Wykoff L. Can primary care physicians’ questions be answered using the medical journal literature? Bull Med Libr Assoc. 1994;82:140–6.

    PubMed Central  CAS  PubMed  Google Scholar 

  27. Dee C, Blazek R. Information needs of the rural physician. A descriptive study. Bull Med Libr Assoc. 1993;81:259–64.

    PubMed Central  CAS  PubMed  Google Scholar 

  28. Bergus GR, Sinift D, Randall CS, et al. Use of an e-mail curbside consultation service by family physicians. J Fam Pract. 1998;47(5):357–60.

    CAS  PubMed  Google Scholar 

  29. Hilty DM, Ingraham RL, Yang RP, et al. Multispecialty phone and email consultation to primary care providers for patients with developmental disabilities in rural California. Telemed J E Health. 2004;10:413–21.

    Article  PubMed  Google Scholar 

  30. Cerda GC, Hilty DM, Hales RE, et al. Use of telemedicine with ethnic groups (letter). Psychiatr Serv. 1999;50:1364.

    Article  CAS  PubMed  Google Scholar 

  31. Yellowlees PM, Marks SL, Hilty DM, et al. Using e-health to enable culturally appropriate mental health care in rural areas. Telemed J E Health. 2008;14(5):486–92.

    Article  PubMed Central  PubMed  Google Scholar 

  32. Ayers K, Yellowlees PM. Mental health considerations during a pandemic influenza outbreak. Int J Rescue Disast Med. 2009;9(1). doi:10.5580/1481.

  33. Neufeld JD, Bourgeois JA, Hilty DM, et al. The e-Mental Health Consult Service: providing enhanced primary care mental health services through telemedicine. Psychosomatics. 2007;48:135–41.

    Article  PubMed  Google Scholar 

  34. Yellowlees PM, Hilty DM, Marks SL, et al. A retrospective analysis of child and adolescent e-mental health. J Am Acad Child Adolsc Psychiatry. 2008;47(1):1–5.

    Article  Google Scholar 

  35. Hilty DM, Marks SL, Wegeland JE, et al. A randomized controlled trial of disease management modules, including telepsychiatric care, for depression in rural primary care. Psychiatry. 2007;4(2):58–65.

    PubMed Central  PubMed  Google Scholar 

  36. Yellowlees PM, Odor A, Patrice K, et al. Transcultural psychiatry made simple: asynchronous telepsychiatry as an approach to providing culturally relevant care. Telemed J E Health. 2013;19(4):1–6.

    Google Scholar 

  37. Yellowlees PM, Odor A, Patrice K, et al. PsychVACS: a system for asynchronous telepsychiatry. Telemed J E Health. 2011;17(4):299–303.

    Article  PubMed  Google Scholar 

  38. Butler TN, Yellowlees P. Cost analysis of store-and-forward telepsychiatry as a consultation model for primary care. Telemed J E Health. 2012;18(1):74–7.

    Article  PubMed  Google Scholar 

  39. Fortney JC, Pyne JM, Edlund MJ, et al. A randomized trial of telemedicine-based collaborative care for depression. J Gen Intern Med. 2007;22(8):1086–93.

    Article  PubMed Central  PubMed  Google Scholar 

  40. Richardson L, McCauley E, Katon W. Collaborative care for adolescent depression: a pilot study. Gen Hosp Psychiatry. 2009;31:36–45.

    Article  PubMed Central  PubMed  Google Scholar 

  41. Weinstein MC, Stason WB. Foundations of cost-effectiveness analysis for health and medical practices. N Engl J Med. 1977;296(13):716–21.

    Article  CAS  PubMed  Google Scholar 

  42. Hilty DM, Shoemaker EZ, Myers KM., et al. Issues and steps toward a clinical guideline for telemental health for care of children and adolescents. J Child Adol Psychopharm. In Press.

    Google Scholar 

  43. Richardson LK, Frueh BC, Grubaugh AL, et al. Current directions in videoconferencing tele-mental health research. Clin Psychol. 2009;16(3):323–8.

    Google Scholar 

  44. Ruskin PE, Silver-Aylaian M, Kling MA, et al. Treatment outcomes in depression: comparison of remote treatment through telepsychiatry to in in-person treatment. Am J Psychiatry. 2004;161:1471–6.

    Article  PubMed  Google Scholar 

  45. Morland LA, Greene CJ, Rosen C, et al. Issues in the design of a randomized noninferiority clinical trial of telemental health psychotherapy for rural combat veterans with PTSD. Contemp Clin Trials. 2009;30(6):513–52.

    Article  PubMed  Google Scholar 

  46. Morland LA, Greene CJ, Rosen CS, et al. Telemedicine for anger management therapy in a rural population of combat veterans with posttraumatic stress disorder: a randomized noninferiority trial. J Clin Psychiatry. 2010;71:855–63.

    Article  CAS  PubMed  Google Scholar 

  47. Morland LA, Hynes AK, Mackintosh MA, et al. Group cognitive processing therapy delivered to veterans via telehealth: a pilot cohort. J Trauma Stress. 2011;24(4):465–9.

    Article  PubMed  Google Scholar 

  48. Frueh BC, Monnier J, Yim E, et al. Randomized trial for post-traumatic stress disorder. J Telemed Telecare. 2007;13:142–7.

    Article  PubMed  Google Scholar 

  49. Frueh BC, Henderson S, Myrick H. Telehealth service delivery for persons with alcoholism. J Telemed Telecare. 2005;11(7):372–5.

    Article  PubMed  Google Scholar 

  50. Szeftel R, Federico C, Hakak R, et al. Improved access to mental health evaluation for patients with developmental disabilities using telepsychiatry. J Telemed Telecare. 2012;18(6):317–21.

    Article  PubMed  Google Scholar 

  51. Hall RC. Global assessment of functioning: a modified scale. Psychosomatics. 1995;36(3):267–75.

    Article  CAS  PubMed  Google Scholar 

  52. Myers KM, Palmer NB, Geyer JR. Research in child and adolescent telemental health. Child Adolesc Psychiatr Clin N Am. 2011;20(1):155–71.

    Article  PubMed  Google Scholar 

  53. Pakyurek M, Yellowlees PM, Hilty DM. The child and adolescent telepsychiatry consultation: can it be a more effective clinical process for certain patients than conventional practice? Telemed J E Health. 2010;16(3):289–92.

    Article  PubMed  Google Scholar 

  54. Boydell K, Volpe T, Pignatello A. A qualitative study of young people’s perspectives on receiving psychiatric services via televideo. J Can Acad Child Adolesc Psychiatry. 2010;19:5–11.

    Article  PubMed Central  PubMed  Google Scholar 

  55. AACAP. Practice parameter for telepsychiatry with children and adolescents. J Am Acad Child Adolesc Psychiatry. 2007;47(12):1468–83.

    Google Scholar 

  56. Botsis T, Demiris G, Peterson S, et al. Home telecare technologies for the elderly. J Telemed Telecare. 2008;14:333–7.

    Article  PubMed  Google Scholar 

  57. Sheeran T, Dealy J, Rabinowitz T. Geriatric telemental health. In: Myers K, Turvey CL, editors. Telemental health. New York: Elsevier; 2013. p. 171–95.

    Chapter  Google Scholar 

  58. Shore JH, Hilty DM, Yellowlees PM. Emergency management guidelines for telepsychiatry. Gen Hosp Psychiatry. 2007;29:199–206.

    Article  PubMed Central  PubMed  Google Scholar 

  59. Yellowlees PM, Burke MM, Marks SL, et al. Emergency telepsychiatry. J Telemed Telecare. 2008;14:277–81.

    Article  PubMed  Google Scholar 

  60. Sorvaniemi M, Ojanen E, Santamaki O. Telepsychiatry in emergency consultations: a follow-up study of sixty patients. Telemed J E Health. 2005;11(4):439–41.

    Article  PubMed  Google Scholar 

  61. Williams M, Pfeffee M, Boyle, et al. Telepsychiatry in the emergency department: Overview and case studies. California HealthCare Foundation. December, 2010. 28 Feb 2015. At http://www.chcf.org/publications/2009/12/telepsychiatry-in-the-emergency-department-overview-and-case-studies.

  62. Beck AT, Ward CH, Mendelson M. An inventory for measuring depression. Arch Gen Psychiatry. 1961;18:561–7.

    Article  Google Scholar 

  63. Beck AT, Steer RA, Garbin MG. Psychometric properties of the Beck Depression Inventory: twenty-five years of evaluation. Clin Psychol Rev. 1988;8:77–100.

    Article  Google Scholar 

  64. Derogatis LR, Rickels K, Rock AF. The SCL-90 and the MMPI: a step in the validation of a new self-report scale. Br J Psychiatry. 1976;128:280–9.

    Article  CAS  PubMed  Google Scholar 

  65. Saunders JB, Aasland OG, Babor TF, et al. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO collaborative project on identification and treatment of persons with harmful alcohol consumption, phase II. Addiction. 1993;88:791–804.

    Article  CAS  PubMed  Google Scholar 

  66. Ewing JA. Detecting alcoholism: the CAGE Questionnaire. J Am Med Assoc. 1984;252:1905–7.

    Article  CAS  Google Scholar 

  67. Steer RA, Ball R, Ranieri RF, et al. Dimensions of the Beck depression inventory-II in clinically depressed outpatients. J Clin Psychol. 1999;55(1):117–28.

    Article  CAS  PubMed  Google Scholar 

  68. Steer RA, Rissmiller DJ, Beck AT. Use of the Beck Depression Inventory with depressed geriatric patients. Behav Res Ther. 2000;38(3):311–8.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgments

American Telemedicine Association, and in particular, the Mental Health Interest Group

University of Southern California Department of Psychiatry and Behavioral Sciences

UC Davis Department of Psychiatry and Behavioral Sciences

Author information

Authors and Affiliations

  1. Keck School of Medicine, University of Southern California, Los Angeles, CA, USA

    Donald M. Hilty MD

  2. Department of Psychiatry and Behavioral Sciences, Keck School of Medicine at USC and LAC + USC Medical Center, Los Angeles, CA, USA

    Erica Z. Shoemaker MD

  3. University of Colorado Depression Center, Aurora, CO, USA

    Jay Shore MD, MPH

  4. Centers for American Indian and Alaska Native Health University of Colorado, Aurora, CO, USA

    Jay Shore MD, MPH

Authors
  1. Donald M. Hilty MD
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Erica Z. Shoemaker MD
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jay Shore MD, MPH
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Donald M. Hilty MD .

Editor information

Editors and Affiliations

  1. The Little Prince Psychiatric Centre, Copenhagen, Denmark

    Davor Mucic

  2. Keck School of Medicine University of Southern California, Los Angeles, California, USA

    Donald M. Hilty

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Hilty, D.M., Shoemaker, E.Z., Shore, J. (2016). How to Build, Evaluate, and Increase Your e-Mental Health Program Efficiency. In: Mucic, D., Hilty, D. (eds) e-Mental Health. Springer, Cham. https://doi.org/10.1007/978-3-319-20852-7_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-20852-7_4

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-20851-0

  • Online ISBN: 978-3-319-20852-7

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics

Search

Navigation