Advertisement

Journal of Technology in Behavioral Science

, Volume 2, Issue 3–4, pp 171–189 | Cite as

Telebehavioral Health, Telemental Health, e-Therapy and e-Health Competencies: the Need for an Interprofessional Framework

  • Donald M. Hilty
  • Marlene M. Maheu
  • Kenneth P. Drude
  • Katherine M. Hertlein
  • Karen Wall
  • Richard P. Long
  • Tracy L. Luoma
Review

Abstract

Telebehavioral health (TBH) in the form of synchronous video is effective, well received and a standard way to practice. Current guidelines and policies discuss the importance of good clinical, technical, and administrative components to care. A review of the TBH evidence-based literature across psychiatry/medicine, psychology, social work, counseling, marriage/family, behavioral analysis, and other behavioral sciences found no common TBH competencies across disciplines. The scope of professional guidelines and standards about technology are broad (e.g., practice of telepsychology; Internet and social media use in social work practice), to mid-range (e.g., American Telemedicine (ATA), American Counseling Association (ACA)), to narrow (e.g., preliminary “guidelines” for asynchronous communication such as e-mail and texts). There is only one set of competencies for telepsychiatry, which discusses skills, training and evaluation. These competencies suggested (1) novice/advanced beginner, competent/proficient, and expert levels; (2) domains of patient care, communications, system-based practice, professionalism, practice-based improvement, knowledge and technological know-how; and (3) pedagogical methods to teach and evaluate skills. Revisions to this framework and technology-specific competencies with additional domains may be needed. A challenge to competencies across disciplines may be finding consensus, due to varying scopes of practice, training differences and faculty development priorities. Disciplines and organizations involved with TBH need to consider certification/accreditation and ensure quality care.

Keywords

Telebehavioral health Telemental health e-therapy Competencies Competency framework Interprofessional Interdisciplinary 

Notes

Acknowledgements

The study was based on information and input from The Coalition for Technology in Behavioral Science, The American Association of Clinical Social Workers Office on Policy, American Association of Marriage and Family Therapists, American Counseling Association, American Psychiatric Association and the Board of Trustees Committee on Telepsychiatry, American Psychological Association and The American Psychological Association Legal Office, The Association of State and Provincial Psychology Boards, National Association for Alcoholism and Drug Abuse Counselors (now called, the Association for Addiction Professionals or AAP, National Association of Social Workers, and American Telemedicine Association and the Telemental Health Interest Group.

Compliance with Ethical Standards

Conflict of Interest

The authors report no financial conflicts of interest. Co-author Marlene Maheu runs the for-profit Telebehavioral Health Institute (https://telehealth.org/about-draft/), which expressly sells Certification Programs (see https://telehealth.org/faq/, http://telehealth.org/telemental-health-certification) that this paper is expressly advocating for in its Abstract. Tracy Luoma is Executive Director at Optum Behavioral Health Salt Lake County. And Richard Long runs a potentially commercial supervision site that could potentially benefit from certification processes (see http://mentalhealth-connect.com/process for pricing). The authors alone are responsible for the content and writing of the paper.

References

  1. Accreditation Council on Graduate Medical Education (2013). Common Program Requirements. Retrieved from https://www.acgme.org/acgmeweb/Portals/0/PFAssets/ProgramRequirements/CPRs2013.pdf. Accessed 15 Aug 2017.
  2. American Association for Marriage and Family Therapy (2015). Standard VI technology-assisted professional services. Retrieved from https://www.aamft.org/iMIS15/AAMFT/Content/legal_ethics/code_of_ethics.aspx. Accessed 15 Aug 2017.
  3. American Association of Medical Colleges (2014). Core entrustable professional activities for entering residency. Retrieved from https://www.aamc.org/download/427456/data/spring2015updatepptpdf.pdf. Accessed 15 Aug 2017.
  4. American Counseling Association (2014). Code of ethics. Retrieved from https://www.counseling.org/resources/aca-code-of-ethics.pdf. Accessed 15 Aug 2017.
  5. American Medical Association (2011). Opinion 9.124 - Professionalism in the Use of Social Media. AMA Code of Medical Ethics. Retrieved from http://www.ama-assn.org/ama/pub/physician-resources/medical-ethics/code-medical-ethics/opinion9124.page. Accessed 15 Aug 2017.
  6. American Psychological Association Guideline for the Practice of Telepsychology (2013). Retrieved from http://www.apapracticecentral.org/ce/guidelines/telepsychology-guidelines.pdf. Accessed 15 Aug 2017.
  7. American Telemedicine Association (2009). Practice guidelines for videoconferencing-based telemental health. Retrieved from http://www.americantelemed.org/docs/default-source/standards/practice-guidelines-for-videoconferencing-based-telemental-health.pdf?sfvrsn=6. Accessed 15 Aug 2017.
  8. American Telemedicine Association (2013). Practice guidelines for video-based online mental health services. Retrieved from http://www.americantelemed.org/docs/default-source/standards/practice-guidelines-for-video-based-online-mental-health-services.pdf?sfvrsn=6. Accessed 15 Aug 2017.
  9. American Telemedicine Association (2017). Practice guidelines for telemental health with children and adolescents. Retrieved from: https://higherlogicdownload.s3.amazonaws.com/AMERICANTELEMED/618da447-dee1-4ee1-b941-c5bf3db5669a/UploadedImages/Practice%20Guideline%20Covers/NEW_ATA%20Children%20&%20Adolescents%20Guidelines.pdf. Accessed 15 Aug 2017.
  10. Andersson, G., Carlbring, P., Holmstrom, A., Sparthan, E., Furmark, T., Nilsson-Ihrfelt, E., & Ekselius, L. (2006). Internet-based self-help with therapist feedback and in vivo group exposure for social phobia: a randomized controlled trial. Journal of Consulting and Clinical Psychology, 74(4), 677–686.CrossRefPubMedGoogle Scholar
  11. Association of Marital and Family Therapy Regulatory Boards. (2015). 2015 AMFTRB national marital and family therapy examination: handbook for candidates. Retrieved from http://www.amftrb.org/exam.cfm. Accessed 15 Aug 2017.
  12. Association of State and Provincial Psychology Boards (2014). Maintenance of Competence for Licensure (MOCL) White Paper. Retrieved from http://c.ymcdn.com/sites/www.asppb.net/resource/resmgr/Guidelines/Maintenance_of_Competence_fo.pdf. Accessed 15 Aug 2017.
  13. Australian Psychological Society (2011). Guidelines for Providing Psychological Services and Products Using the Internet and Telecommunications Technology Retrieved from: https://aaswsocialmedia.wikispaces.com/file/view/EG-Internet.pdf.
  14. Backhaus, A., Agha, Z., Maglione, M. L., Repp, A., Ross, B., Zuest, D., Rice-Thorp, N. M., Lohr, J., & Thorp, S. R. (2012). Videoconferencing psychotherapy: a systematic review. Psychological Services, 9(2), 111–131.CrossRefPubMedGoogle Scholar
  15. Bashook, P. G. (2005). Best practices for assessing competence and performance of the behavioral health workforce. Administration and Policy in Mental Health, 32, 563–592.CrossRefPubMedGoogle Scholar
  16. Behnke, S. (2008). Ethics in the age of the internet. Monitor on Psychology, 39(7), 74.Google Scholar
  17. Bishop, M., Yellowlees, P., Gates, C., & Silberman, G. (2011). Facebook goes to the doctor. ACM Press, 978-1-4503-1082-6/11/12, pp.13–20. Retrieved from http://nob.cs.ucdavis.edu/bishop/papers/2011-gtip/socmed.ps. Accessed 15 Aug 2017.
  18. Brenner, P. (1984). From novice to expert. Boston: Addison-Wesley Publishing Co..Google Scholar
  19. British Psychological Society (2009). The Provision of Psychological Services via the Internet and Other Non-direct Means. Retrieved from The provision of psychological services via the Internet. Accessed 15 Aug 2017 http://www.bps.org.uk/system/files/Public%20files/psychological_services_over_the_internet.pdf
  20. Brown, M. (1994). An introduction to the discourse on competency-based training (CBT) in Deakin University Course Development Centre (Ed.), A collection of readings related to competency-based training (pp. 1–17). Victoria, Australia: Victorian Education Foundation, Deakin University. Retrieved from http://files.eric.ed.gov/fulltext/ED384695.pdf. Accessed 15 Aug 2017.
  21. Callan, J., Maheu, M., & Bucky, S. (2016). Crisis in the behavioral health classroom: enhancing knowledge, skills, and attitudes in telehealth training. In M. Maheu, K. Drude, & S. Wright (Eds.), Field guide to evidence-based, technology careers in behavioral health: Professional opportunities for the 21st century. New York: Springer.Google Scholar
  22. Cassel, C. K. (2004). Quality of care and quality of training: a shared vision for internal medicine? Annals of Internal Medicine, 140(11), 927–928.CrossRefPubMedGoogle Scholar
  23. Celio, A. A., Winzelberg, A. J., Wilfley, D. E., Eppstein-Herald, D., Springer, E. A., Dev, P., & Taylor, C. B. (2000). Reducing risk factors for eating disorders: Comparison of an Internet- and a classroom-delivered psychoeducational program. Journal of Consulting and Clinical Psychol, 68(4), 650–657.CrossRefGoogle Scholar
  24. Christensen, H., Griffiths, K., & Evans, K. (2002). E-mental health in Australia: implications of the internet and related technologies for policy. Canberra, Commonwealth Department of Health and Ageing. Retrieved from http://unpan1.un.org/intradoc/groups/public/documents/apcity/unpan046316.pdf. Accessed 15 Aug 2017.
  25. Christensen, H., Griffiths, K., Groves, C., & Korten, A. (2006). Free range users and one hit wonders: community users of an Internet-based cognitive behaviour therapy program. Australian New Zealand Journal of Psychiatry, 40(1), 9–62.CrossRefGoogle Scholar
  26. Clarke, G., Eubanks, D., Reid, E., Kelleher, C., O'Connor, E., DeBar, L. L., Lynch, F., & Gullion, C. (2005). Overcoming depression on the Internet (ODIN) (2): a randomized trial of a self-help depression skills program with reminders. Journal of Medical Internet Research, 7(2), e16.CrossRefPubMedPubMedCentralGoogle Scholar
  27. Dreyfus, S. E., & Dreyfus, S. L. (1980). A five-stage model of the mental activities involved in directed skill acquisition. Retrieved from http://www.dtic.mil/dtic/tr/fulltext/u2/a084551.pdf. Accessed 15 Aug 2017.
  28. Epstein, R. M., & Hundert, M. (2002). Defining and assessing professional competence. Journal of the American Medical Association, 287, 226–235.CrossRefPubMedGoogle Scholar
  29. Ferreira-Lay, P., & Miller, S. (2008). The quality of internet information on depression for lay people. Psychiatric Bulletin, 32 , 170–173.CrossRefGoogle Scholar
  30. Ford, K. (2014). Competency-based education, history, opportunities, and challenges. UMUC Center for Innovation in Learning and Student Success (CILSS). Retrieved from https://www.umuc.edu/innovatelearning/upload/cbe-lit-review-ford.pdf. Accessed 15 Aug 2017.
  31. Frank, J. R. (2005). The CanMEDS 2005 Physician Competency Framework. Retrieved from http://rcpsc.medical.org/canmeds/CanMEDS2005/ CanMEDS2005_e.pdf. Accessed 15 Aug 2017.
  32. Frank, J. R., Mungroo, R., Ahmad, Y., Wang, M., De Rossi, S., & Horsley, T. (2010). Toward a definition of competency-based education in medicine: a systematic review of published definitions. Medical Teacher, 32(8), 631–637.  https://doi.org/10.3109/0142159X.2010.500898.CrossRefPubMedGoogle Scholar
  33. Fouad, N. A., Grus, C. L., Hatcher, R. L., Kaslow, N. J., Hutchings, P. S., Madson, M. B., & Crossman, R. E. (2009). Competency benchmarks: A model for understanding and measuring competence in professional psychology across training levels. Training and Education in Professional Psychology, 3(4, Suppl), S5-S26.Google Scholar
  34. Frydman, G. J. (2010). A patient-centric definition of participatory medicine. Retrieved from http://e-patients.net/archives/2010/04/a-patient-centric-definition-of-participatory-medicine.html. Accessed 15 Aug 2017.
  35. Glueck, D. (2013). Establishing therapeutic rapport in telemental health. In K. Myers & C. L. Turvey (Eds.), Telemental health (pp. 29–46). New York: Elsevier pp.CrossRefGoogle Scholar
  36. Harden, R. M., Crosby, J. R., & Davis, M. H. (1999). AMEE guide no. 14: outcome-based education: part 1—an introduction to outcome-based education. Medical Teacher, 21, 7–14.CrossRefGoogle Scholar
  37. Hilty, D. M., Marks, S. L., & Nesbitt, T. S. (2002). How telepsychiatry affects the doctor-patient relationship: communication, satisfaction, and additional clinically relevant issues. Primary Psychiatry, 9(9), 29–34.Google Scholar
  38. Hilty, D. M., Liu, W., Marks, S. L., & Callahan, E. C. (2003). Effectiveness of telepsychiatry: a brief review. Canadian Psychiatric Association Bulletin,, 35 10–17.Google Scholar
  39. Hilty, D. M., Ferrer, D. C., Parish, M. B., Johnston, B., Callahan, E. J., & Yellowlees, P. M. (2013a). The effectiveness of telemental health: a 2013 review. Telemedicine Journal and E-Health, 19(6), 444–454.  https://doi.org/10.1089/tmj.2013.0075.CrossRefPubMedPubMedCentralGoogle Scholar
  40. Hilty, D. M., Srinivasan, M., Xiong, G. L., Ferranti, J., & Li, S. T. (2013b). Lessons from psychiatry and psychiatric education for medical learners and teachers. International Review of Psychiatry, 25, 329–337.CrossRefPubMedGoogle Scholar
  41. Hilty, D. M., Belitsky, R., Cohen, M. B., Cabaniss, D. L., Dickstein, L. J., Bernstein, C. A., & Silberman, E. K. (2015a). Impact of the information age residency training: the impact of the generation gap. Academic Psychiatry, 39(1), 104–107.  https://doi.org/10.1007/s40596-014-0196-6.CrossRefPubMedGoogle Scholar
  42. Hilty, D. M., Chan, S., Torous, J., Mahautmr, J., & Mucic, D. M. (2015b). New frontiers in healthcare and technology: Internet- and web-based mental options emerge to complement in-person and telepsychiatric care options. Journal of Health and Medical Informatics, 6(4), 1–14.Google Scholar
  43. Hilty, D. M., Green, J., Nasatir-Hilty, S. E., Johnston, B., & Bourgeois, J. A. (2015c). Mental healthcare to rural and other underserved primary care settings: benefits of telepsychiatry, integrated care, stepped care and interdisciplinary team models. Journal of Nursing Care, 4, 2.  https://doi.org/10.4172/2167-1168.1000237.Google Scholar
  44. Hilty D. M., Rabinowitz, T., Shoemaker, E. Z., Snowdy, C., & Turvey, C. (2015d). Telepsychiatry’s evidence base shows effectiveness: new models (asynchronous), more psychotherapy, and innovations with special populations (Child, Gero, Other), Symposium, American Psychiatric Association, Toronto, Canada.Google Scholar
  45. Hilty, D. M., Yellowlees, P. M., Parish, M. B., & Chan, S. (2015e). Telepsychiatry: effective, evidence-based and at a tipping point in healthcare delivery. Psychiatric Clinics of North American, 38(3), 559–592.CrossRefGoogle Scholar
  46. Hilty, D. M., Crawford, A., Teshima, J., Chan, S., Sunderji, N., Yellowlees, P. M., Kramer, G., O’Neill, P., Fore, C., Luo, J. S., & Li, S. T. (2015f). A framework for telepsychiatric training and e-health: competency-based education, evaluation and implications. International Review of Psychiatry, 27(6), 569–592.CrossRefPubMedGoogle Scholar
  47. Hilty D.M., Rabinowitz T.R., McCarron R.M., Katzelnick D.J., Chang T., Fortney J., & Katon, W. J. (2017 Submitted). Telepsychiatry and e-mental health models leverage stepped, collaborative, and integrated services to primary care. Psychosomatics.Google Scholar
  48. Horvath, A. O., del Re, A. C., Fluckiger, C., & Symonds, D. (2011). Alliance in individual psychotherapy. Psychotherapy, 48, 9–16.CrossRefPubMedGoogle Scholar
  49. Institute of Medicine. (2000). To err is human: building a safer health system. Washington, DC: National Academic Press.Google Scholar
  50. Institute of Medicine. (2001). Crossing the quality chasm: a new health system for the 21 st century. Washington, DC: National Academic Press.Google Scholar
  51. Jenkins-Guarnieri, M. A., Pruitt, L. D., Luxton, D. D., & Johnson, K. (2015). Patient perceptions of telemental health: systematic review of direct comparisons to in-person psychotherapeutic treatments. Telemedicine Journal and E-Health, 21(8), 652–660.CrossRefPubMedGoogle Scholar
  52. Johnson, G. (2014). Toward uniform competency standards in telepsychology: a proposed framework for Canadian psychologists. Canadian Psychology/Psychologie Canadienne, 55(4), 291–302.CrossRefGoogle Scholar
  53. Kalk, N. J., & Pothier, D. D. (2008). Patient information on schizophrenia on the Internet. Psychiatric Bulletin, 32, 409–411.CrossRefGoogle Scholar
  54. Kaslow, N. J. (2007). The competency movement within psychology: an historical perspective. Professional Psychology: Research and Practice, 38, 452–462.CrossRefGoogle Scholar
  55. Kirkpatrick, J., & Kirkpatrick, W. (2009). The Kirkpatrick four levels: a fresh look after 50 years, 1959–2009. Retrieved from http://www.kirkpatrickpartners.com/Portals/0/Resources/Kirkpatrick%20Four%20Levels%20white%20paper.pdf. Accessed 15 Aug 2017.
  56. Kolb, D. A. (1984). Experiential learning: experience as the source of learning and development. Englewood Cliffs: Prentice-Hall.Google Scholar
  57. Laranjo, L., Arguel, A., Neves, A. L., Gallagher, A. M., & Kaplan, R. (2015). The influence of social networking sites on health behavior change: a systematic review and meta-analysis. Journal of the American Medical Informatics Associations, 22(1), 243–256.CrossRefGoogle Scholar
  58. Leigh, I. W., Bebeau, M. J., Neslon, P. D., Rubin, N. J., Smith, I. L., Lichtenberg, J. W., Portnoy, S., & Kaslow, N. J. (2007). Competency assessment models. Professional Psychology, 38(5), 463–473.CrossRefGoogle Scholar
  59. Lichtenberg, J., Portnoy, S., Bebeau, M., Leigh, I. W., Nelson, P. D., Rubin, N. J., Smith, I. L., & Kaslow, N. J. (2007). Challenges to the assessment of competence and competencies. Professional Psychology: Research and Practice, 38, 474–478.CrossRefGoogle Scholar
  60. Ljotsson, B., Lundin, C., Mitsell, K., Carlbring, P., Ramklint, M., & Ghaderi, A. (2007). Remote treatment of bulimia nervosa and binge eating disorder: a randomized trial of internet-assisted cognitive behavioural therapy. Behavioral Research Therapy, 45(4), 649–661.CrossRefGoogle Scholar
  61. Luxton, D., Nelson, E., & Maheu, M. (2016). Telemental health best practices. Washington, DC: American Psychological Association.Google Scholar
  62. Maheu, M. (2001). Exposing the risk yet moving forward: a behavioral e-health model. Journal of Computer-Mediated Communication, 6(4). http://onlinelibrary.wiley.com/doi/10.1111/j.1083-6101.2001.tb00130.x/full.
  63. Maheu, M., Whitten, P., & Allen, A. (2001). eHealth, Telehealth & Telemedicine: a guide to startup and success. New York: Jossey-Bass.Google Scholar
  64. Maheu, M., Pulier, M., Wilhelm, F., McMenamin, J., & Brown-Connolly, N. (2004). The mental health professional and the new technologies: a handbook for practice today. Mahwah: Erlbaum.Google Scholar
  65. Maheu, M., Drude, K., Hertlein, K., Lipschutz, R., Wall, K. Long, ..., & D.M. Hilty: (2017) An interdisciplinary framework for telebehavioral health competencies. J Technology in Behav Sci, In PressGoogle Scholar
  66. Miller, G. (1990). The assessment of clinical skills/competence/performance. Academic Medicine`, 65(Suppl), S63–S67.Google Scholar
  67. Marrelli, A. F., Tondora, J., & Hoge, M. A. (2005). Strategies for developing competency models. Administration and Policy in Mental Health, 32(5–6), 533–560.CrossRefPubMedGoogle Scholar
  68. Moskowitz, D. S., & Young, S. N. (2006). Ecological momentary assessment: what it is and why it is a method of the future in clinical psychopharmacology. Journal of Psychiatry and Neurosciences JPN, 31(1), 13–20.Google Scholar
  69. Mucic, D., & Hilty, D. M. (2015). Key issues in e-mental health. New York: Springer Publishing.Google Scholar
  70. Mucic, D., Hilty, D. M., Parrish, M. B., & Yellowlees, P. M. (2015). Web- and Internet-based services: education, support, self-care and formal treatment approaches. In D. Mucic & D. M. Hilty (Eds.), Key issues in e-mental health (pp. 173–192). New York: Springer Publishing.Google Scholar
  71. Myers, K., van der Stoep, A., Zhou, C., McCarty, C. A., & Katon, W. (2015). Effectiveness of a telehealth service delivery model for treating attention-deficit hyperactivity disorder: results of a community-based randomized controlled trial. Journal of the American Association of Child and Adolescent Psychiatry, 54(4), 263–274.  https://doi.org/10.1016/j.jaac.2015.01.009.CrossRefGoogle Scholar
  72. National Association of Social Workers, Association of Social Work Boards, Council on Social Work Education, and Clinical Social Work Association (2017). Standards for Technology in Social Work Practice. Retrieved from https://www.naswpress.org/publications/standards/technology.html. Accessed 15 Aug 2017.
  73. National Association of Social Workers Standards for Technology and Social Work Practice (2005). Retrieved from http://www.socialworkers.org/practice/standards/naswtechnologystandards.pdf. Accessed 15 Aug 2017.
  74. Nelson, E., Duncan, A., Peacock, G., & Bui, T. (2012). School-based telemedicine and adherence to national guidelines for ADHD evaluation. Psychological Services, 9(3), 293–297.Google Scholar
  75. Nelson, E. L., Duncan, A. B., & Lillis, T. (2013). Special considerations for conducting psychotherapy via videoconferencing. In K. Myers & C. L. Turvey (Eds.), Telemental health: clinical, technical and administrative foundations for evidenced-based practice (pp. 295–314). San Francisco: Elsevier.Google Scholar
  76. Nemoto, K., Tachikawa, H., Sodeyama, N., Endo, G., Hashimoto, K., Mizukami, K., & Asada, T. (2007). Quality of Internet information referring to mental health and mental disorders in Japan. Psychiatry and Clinical Neurosciences, 61(3), 243–248.CrossRefPubMedGoogle Scholar
  77. Norman, G. R. (1985). Defining competence: a methodological review. In V. R. Neufeld & G. R. Norman (Eds.), Assessing clinical competence (pp. 15–35). New York: Springer.Google Scholar
  78. Ohio Psychological Association (2013). Areas of competence for psychologists in telepsychology. Retrieved from http://www.ohpsych.org/about/files/2012/03/FINAL_COMPETENCY_DRAFT.pdf. Accessed 15 Aug 2017.
  79. Ostrowski, J., & Collins T., (2016). A comparison of telemental health terminology used across mental health state licensure boards. Professional Counselor. Retrieved from: http://tpcjournal.nbcc.org/a-comparison-of-telemental-health- terminology-used-across-mental-health-state-licensure-boards/. Accessed 15 Aug 2017.
  80. Rabinowitz, T., Murphy, K. M., Amour, J. L., Ricci, M. A., Caputo, M. P., & Newhouse, P. A. (2010). Benefits of a telepsychiatry consultation service for rural nursing home residents. Telemedicine Journal and E-Health, 16(1), 34–40.CrossRefPubMedGoogle Scholar
  81. Richardson, L. K., Frueh, B. C., Grubaugh, A. L., Egede, L., & Elhai, J. D. (2009). Current directions in videoconferencing telemental health research. Clinical Psychology, 16(3), 323–328.PubMedPubMedCentralGoogle Scholar
  82. Ritterband, L. M., & Thorndike, F. (2006). Internet interventions or patient education web sites? Journal of Medical Internet Research, 8(3), e18.  https://doi.org/10.2196/jmir.8.3.e18).CrossRefPubMedPubMedCentralGoogle Scholar
  83. Rodolfa, E., Bent, R., Eisman, E., Nelson, P., Rehm, L., & P. Ritchie. (2005). Professional Psychology: Research and Practice, 3, 347–354.Google Scholar
  84. Rodolfa, E. R., Greenberg, S., Hunsley, J., Smith-Zoeller, M., Cox, D., Sammons, M., Caro, C., & Spivank, H. (2013). A competency model for the practice of psychology. Training and Education in Professional Psychology, 7(2), 71–83.CrossRefGoogle Scholar
  85. Rouse, D. N. (2011). Employing Kirkpatrick's evaluation framework to determine the effectiveness of health information management courses and programs. Perspectives in Health Informatics Management, 8(Spring), 1c (Retrieved from http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3070232/. Accessed 15 Aug 2017.
  86. Royal College of Physicians and Surgeons, CanMEDS Framework (2005). Retrieved from http://www.royalcollege.ca/portal/page/portal/rc/canmeds/framework. Accessed 15 Aug 2017.
  87. Rubin, N. J., Bebeau, M. J., Leigh, I. W., Lichtenberg, J. W., Nelson, P. D., Portnoy, S. M., Smith, L., & Kaslow, N. J. (2007). The competency movement within psychology: an historical perspective. Professional Psychology: Research and Practice, 38(5), 452–462.CrossRefGoogle Scholar
  88. Sunderji, N., Crawford, C., & Jovanovic, M. (2015). Telepsychiatry in graduate medical education: a narrative review. Academic Psychiatry, 39, 55–62.CrossRefPubMedGoogle Scholar
  89. Tekian, A., Hodges, B.D., Roberts, T.E., Schuwirth., L., Norcini, J. (2015). Assessing competencies using milestones along the way. Medical Teacher, 37(4), 399-402.Google Scholar
  90. Ternullo, J. L., & Locke, S. E. (2016). Tackling changes in mental health practice: the impact of information-age healthcare. In M. Maheu, K. Drude, & S. Wright (Eds.), Field guide to evidence-based, technology careers in behavioral health: professional opportunities for the 21st century. New York: Springer.Google Scholar
  91. Torous, J., Staples, P., Shanahan, M., Lin, C., Peck, P., Keshavan, M., Onnela J. P. (2015). Utilizing a custom application on personal smartphones to assess PHQ-9 depressive symptoms in patients with major depressive disorder Journal of Medical Internet Research Mental Health 2(1), e8. At: http://mental.jmir.org/2015/1/e8/. Accessed 15 Aug 2017.Google Scholar
  92. Tseng, E. K., & Hicks, L. K. (2016). Value based care and patient-centered care: divergent or complementary? Current Hematological Malignancy Report, 11(4), 303–307.CrossRefGoogle Scholar
  93. Tuxworth, E. (1994). Competence-based education and training: background and origins. In Deakin University Course Development Centre (Ed.), A collection of readings related to competency-based training (pp. 109–123). Victoria: Victorian Education Foundation, Deakin University. Original work published in 1989. Retrieved from http://files.eric.ed.gov/fulltext/ED384695.pdf.
  94. U.S. National Association of Social Workers (2005). Standards for technology and social work practice. http://www.socialworkers.org/practice/standards/naswtechnologystandards.pdf.
  95. World Health Organization. (2011). Telemedicine opportunities and developments in member states. Results of the second global survey on eHealth. Geneva: WHO Press.Google Scholar
  96. Yellowlees, P. M., Odor, A., Iosif, A., Parish, M. B., Nafiz, N., Patrice, K., … & Hilty, D.M. (2013). Transcultural psychiatry made simple: asynchronous telepsychiatry as an approach to providing culturally relevant care. Telemedicine Journal and E-Health, 19(4), 1–6.  https://doi.org/10.1089/tmj.2012.0077.

Copyright information

© Springer International Publishing AG, part of Springer Nature 2017

Authors and Affiliations

  • Donald M. Hilty
    • 1
  • Marlene M. Maheu
    • 1
  • Kenneth P. Drude
    • 1
  • Katherine M. Hertlein
    • 1
  • Karen Wall
    • 1
  • Richard P. Long
    • 1
  • Tracy L. Luoma
    • 1
  1. 1.KDMC Veterans Affairs Northern California and USCSacramentoUSA

Personalised recommendations