Abstract
Background
Innovative technology can enhance patient access to healthcare but must be successfully implemented to be effective.
Objective
We evaluated Department of Veterans Affairs’ (VA’s) implementation of My VA Images, a direct-to-patient asynchronous teledermatology mobile application enabling established dermatology patients to receive follow-up care remotely instead of in-person.
Design /Participants/Approach
Following pilot testing at 3 facilities, the app was introduced to 28 facilities (4 groups of 7) every 3 months using a stepped-wedge cluster-randomized design. Using the Organizational Theory of Implementation Effectiveness, we examined the app’s implementation using qualitative and quantitative data consisting of encounter data from VA’s corporate data warehouse; app usage from VA’s Mobile Health database; bi-monthly reports from facility representatives; phone interviews with clinicians; and documented communications between the operational partner and facility staff.
Key Results
Implementation policies and practices included VA’s vision to expand home telehealth and marketing/communication strategies. The COVID-19 pandemic dominated the implementation climate by stressing staffing, introducing competing demands, and influencing stakeholder attitudes to the app, including its fit to their values. These factors were associated with mixed implementation effectiveness, defined as high quality consistent use. Nineteen of 31 exposed facilities prepared to use the app; 10 facilities used it for actual patient care, 7 as originally intended. Residents, nurse practitioners, and physician assistants were more likely than attendings to use the app. Facilities exposed to the app pre-pandemic were more likely to use and sustain the new process.
Conclusions
Considerable heterogeneity existed in implementing mobile teledermatology, despite VA’s common mission, integrated healthcare system, and stakeholders’ broad interest. Identifying opportunities to target favorable facilities and user groups (such as teaching facilities and physician extenders, respectively) while addressing internal implementation barriers including incomplete integration with the electronic health record as well as inadequate staffing may help optimize the initial impact of direct-to-patient telehealth. The COVID pandemic was a notable extrinsic barrier.
Clinical Trials Registration
NCT03241589
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
INTRODUCTION
Telehealth, including teledermatology, is an important tool for improving access to healthcare.1, 2 Asynchronous or store-and-forward teledermatology utilizes relatively low-cost, simple equipment that can be easy to use while providing clinically useful images. Additionally, the asynchronous nature allows it to be more flexibly integrated into busy clinical practices of both referring clinicians and dermatologists. The Department of Veterans Affairs (VA) operates one of the largest and longest running consultative asynchronous teledermatology programs, primarily reliant on in-clinic imaging of patients.3,4,5 The process, facilitated by its enterprise-wide electronic health record (EHR), is typically initiated by primary care providers who, upon identifying a patient with a skin concern, order a teledermatology imaging consult. Trained imagers respond by generally requiring the patient to come to the clinic for imaging. Images of the skin problem and its associated history are then uploaded into the EHR and a teledermatology reading consult is placed, alerting a VA dermatologist to review and document evaluation of the case. The alerted referring provider then conveys the consult results to the patient and executes any recommendations.
Direct-to-patient forms of asynchronous teledermatology have also emerged, allowing patients to submit their own skin photos and to communicate with dermatologists directly.6, 7 VA’s Office of Connected Care (OCC) identified the need and developed its own patient-facing asynchronous mobile telehealth application, My VA Images (MVAI), to mediate direct-to-patient telehealth, including a teledermatology-specific functionality allowing VA dermatologists to request eligible established patients to follow-up remotely. Upon initiation of a request by a dermatologist using the clinician-facing telehealth portal, Virtual Care Manager (VCM), which is distinct from VA’s EHR, MVAI prompts patients to submit interval skin history and guides them in taking images of specific anatomic sites (Figure 1). Dermatologists then use VCM to review patient-submitted data, document the clinical progress note and encounter in the EHR, and asynchronously communicate findings and instructions directly to patients through MVAI.
Mobile teledermatology workflow. VA clinicians use VCM to create teledermatology requests in MVAI for patients, to evaluate patient submissions, to give patients feedback and instructions, and to document the work in the EHR. Patients use MVAI to respond to requests for photos and history, and to read the dermatologists’ opinion and recommendations.
Despite teledermatology’s growth, particularly during the COVID-19 pandemic, there has been little systematic effort to study and guide mobile teledermatology implementation according to established theories. Expanding on initial work by Klein and Sorra, the Organizational Theory of Implementation Effectiveness (OTIE) has been helpful in understanding integration of new technologies in healthcare.8,9,10 OTIE posits that an innovation’s impact arises from implementation effectiveness, which in turn is a result of an organization’s readiness for change (ORC), which drives its policies and practices, the climate arising from those policies and practices, and the extent to which users of the intervention perceive that it fulfills their values (Figure 2).
As part of a larger study examining the effect of teledermatology mobile apps on access, we examined MVAI’s introduction to multiple VA facilities.11 We previously reported that ORC scores appeared to correlate with successful MVAI activity, and we identified antecedent factors associated with MVAI readiness.12 The current work examines the other downstream OTIE components. The results systematically document implementation of a new technology in the VA’s asynchronous teledermatology ecosystem and identify both challenges and opportunities, even for an organization with relatively mature telehealth operations.
METHODS
The study was approved by San Francisco, Durham, Providence, and Boston VA Medical Center Institutional Review Boards.
Study Design
The study of implementation was part of a stepped-wedge cluster-randomized trial to understand the impact of VA mobile teledermatology applications, previously described in detail.11 Inclusion criteria required facilities to have prior asynchronous teledermatology experience, defined as being ≥9% of all fiscal year (FY)18 dermatology encounters. The exclusion criterion was lack of an in-person dermatology clinic in FY18. Following technical pilot testing at 3 facilities, 4 groups of 7 facilities (28 total) were sequentially exposed to MVAI every 3 months. Groups were balanced to have facilities with comparable geographic and medical complexity distribution.11 The 3 pilot facilities, which also fit the inclusion and exclusion criteria, continued to use MVAI, contributing data for the duration of the study.
Data Collection
We used qualitative and quantitative data throughout the study to understand the implementation. To allow facilities time to learn about MVAI and organize local implementation, data collection commenced 3 months following each facility’s initial exposure to MVAI and continued through the end of September 2020. Data included the following: (1) Quantitative data from VA’s corporate data warehouse (CDW) which hosts data from VA’s EHR, as well as from VA’s mobile health database which tracks mobile device activity. We examined total number of attempted and completed encounters and of each type of clinician submitting these encounters from May 2019 to September 2020 for the 3 pilot and 28 randomized facilities; (2) bi-monthly written reports from 19 facilities completed by consenting telehealth and clinical leads between September 2019 and November 2020 using links in email invitations. Reports included responses to open- and closed-ended questions assessing implementation and sustainment, including facilitators and barriers, concerns of key stakeholders about resources and support, reports to leadership, and self-reported ratings of implementation progress on a 10-stage scale associated with pre-implementation (discussion and initial engagement), implementation (resource availability), and sustainability (competency and dissemination) based on concepts in the Stages of Implementation Completion framework (see Supplementary Materials);13,14,15 (3) 12 interviews with clinical staff, clinical leads, and operational facilitators, guided by OTIE concepts, at the pilot facilities midway through the study, and with 7 dermatologists and 3 support staff at 4 additional facilities and one pilot facility at study’s end; and (4) field notes collected throughout the study, documenting conversations with and emails from facility staff at all exposed facilities and question/answer sessions during OCC webinars.
Quantitative Data Analysis
We matched encounter data from CDW to MVAI activity in VA’s Mobile Health database to identify and verify completed requests and instances where app use deviated from intended implementation. Univariate and bivariate statistics of VA CDW encounter data and quantitative data in the bi-monthly reports were performed regularly throughout the study.
Qualitative Data Analysis
Interviews were recorded, transcribed verbatim, and summarized using rapid analysis techniques.16 Open and focused coding combined with matrix techniques facilitated analysis and presentation enabling us to examine commonalities and differences.17,18,19 Core concepts associated with OTIE were identified, including whether these positively or negatively impacted implementation effectiveness. The matrices, with data from the multiple qualitative sources, enabled (1) grouping by characteristics (facility, region, staff type), (2) OTIE constructs (implementation policies and practices, climate, values fit, implementation effectiveness), and (3) time (pre/post COVID-19, changes over time).
RESULTS
Implementation Policies and Practices
Consistent with VA’s strategic goal to provide telehealth in the home, OCC began MVAI development in 2015, engaging multiple specialty clinicians, including dermatology, and individuals from information technology (IT), clinical informatics, business, and telehealth leadership. Upon successful pilot testing for technical functionality between May and June 2019 at 3 pilot sites, MVAI was additionally released to groups of 7 new facilities every 3 months beginning July 1, 2019, for a total of 4 groups and 28 facilities.11 Release constituted the opportunity to use MVAI, but OCC did not require facilities to do so and no incentives were offered other than the apps’ intrinsic merits.
To alert and engage key stakeholders, OCC established multiple mechanisms to introduce and monitor MVAI. Two weeks before official release at each facility, OCC sent a brief email to inform the dermatology chief. On the day of release, OCC sent official emails to facility leaders: the dermatology chief, telehealth coordinator, chief of staff, and director, as well as the regional network telehealth coordinator and any other known facility teledermatology champions dedicated to advocating for MVAI. The email provided (1) introductory information; (2) a checklist of tasks aligned with VA’s informatics policy and practice that were necessary to enable interface with the VA EHR; (3) electronic copies of promotional/instructional materials for clinician and patient end-users; (4) links to online videos demonstrating the workflow; and (5) invitations to live online OCC training webinars and biweekly check-in sessions. At least one key individual from each of the exposed facilities attended a webinar, confirming receipt of the emails by each facility. Field notes from webinars and responses to the emails captured a general sense of excitement among participants to implement MVAI, though concerns and skepticism were occasionally expressed.
Clinical champions, who by definition were interested in and dedicated to advocating for change,20 facilitated implementation of policies and practice locally. Champions were largely dermatologists or telehealth leads who self-selected to help complete the set-up process, encourage others to try MVAI, and create systems to provide marketing/training materials to patients. Of the 19 facilities completing at least one bi-monthly report (a 61% response rate), 6 documented that support from clinical champions was instrumental for implementation. Field notes also captured the importance of clinical champions; at one facility, lack of senior leadership support almost led to program discontinuance but for the champion stepping in.
Anticipating the need to capture clinical workload and to facilitate tracking MVAI usage according to VA’s usual practice, OCC created traditional clinical informatics tools and new mechanisms in VCM and other databases to monitor key milestones for MVAI encounters, which were distinct from informatics processes and required separate user workflows.
Reception of these policies and practices were mixed. Once exposed to MVAI, interviewed clinicians found it user-friendly and the workflow straightforward, “It was easy to use…easy to initiate,” “nice to email securely with patients….” Clinicians appreciated MVAI’s intended use cases for both short-term (e.g., “to see how an incision is healing 1-3 weeks later”) and longer-term follow-ups (e.g., for patients with rashes and on biologics). They also found it beneficial not just as a substitute for an in-person visit but to supplement a separate VA-developed app (VA Video Connect or VVC), mediating home video visits. In such cases, MVAI contributed “clearer images for diagnoses.” When clinicians mentioned image quality, most stated that patient-submitted photos “were very good.” Nevertheless, one facility reported image quality concerns, preferring VA’s standard consultative teledermatology utilizing in-clinic imaging.
MVAI’s incomplete integration with VA’s pre-existing EHR, such as the inability to upload images directly to the EHR, concerned some clinicians. For example, VCM enabled clinicians and staff to track MVAI cases but required an extra step outside of the usual EHR workflow. Clinicians’ frustration that patients often did not respond to MVAI requests was an additional barrier identified in all qualitative sources.
All facilities experienced some technical difficulties with MVAI. Uncoordinated system upgrades to VA’s EHR and mobile health infrastructure, which were each overseen by separate VA offices, created brief user problems. Idiosyncrasies with local IT infrastructure ultimately led two facilities to discontinue MVAI use.
Implementation Climate
MVAI was introduced at facilities that were specifically chosen to have expertise in teledermatology and telehealth in general (see the “Methods” section). Thus, the majority of administrative and clinical support staff, involved in preparing the EHR for MVAI, reported in bi-monthly reports no concerns with their involvement or resources available. Interestingly, the fraction of staff with concerns was greater at facilities introduced to MVAI after the onset of the COVID-19 pandemic (40%) than those exposed pre-pandemic (≤33%). Some concerns arose from misunderstandings, such as when one facility delayed MVAI implementation because it believed MVAI was not an approved protocol during the pandemic.
Patient eligibility was a significant factor in determining climate. Since additional clinic time was not allocated to screen for patient eligibility, use VCM, or educate patients, interviewed clinicians viewed MVAI as a disruption. It was “one more thing… More work without taking away anything.” Highlighting that only ~50% of patients were already enrolled in VA’s mobile health program and that not every patient owned or was proficient with a mobile device, one interviewed clinician stated that it was difficult to “find the ideal patient.” To address these concerns, some facilities used administrative data to pre-identify eligible patients or utilized support staff to assist dermatology clinicians with VCM by creating MVAI requests and to assist patients with MVAI.
The COVID-19 pandemic significantly affected implementation climate. For example, the timing of facilities’ exposure to the app correlated with the rate of achieving implementation milestones (Figure 3). Nearly twice as many facilities introduced to the app pre-COVID achieved each milestone relative to post-COVID facilities, and differences in sustaining use were noticeable. Multiple reasons appeared to explain this phenomenon.
Implementation tracking for MVAI. Facilities were grouped into those exposed to MVAI 6 months or more prior to the onset of the COVID-19 pandemic (group 1); 3 months prior (group 2); at the start of the pandemic (group 3); and 2 months after (group 4). Key milestones for facilities were documented. Sustainment was defined as a facility having a minimum of 2 patients complete a visit and demonstrable evidence of app usage at the end of the study.
First, apart from the time-consuming demands of identifying patients noted above, inadequate staffing itself was a limitation that the pandemic magnified. Nine facilities reported staff shortages, contributing to delays or stoppage in MVAI use. Field notes captured that a facility attempted to implement MVAI but loss of one dermatologist precluded its use. Qualitative data from all sources revealed some concern about the lack of on-site staffing to assist patients. In-person clinic closures due to COVID-19 additionally burdened staff who spent extra time sending brochures/instructions to patients instead of giving them in-person. The common use of part-time physicians also made it difficult for facilities to train all clinicians together with the new workflow (“All seven of us doctors are part time…hard to find time to train”).
Second, competing demands existed. Qualitative data sources from all facilities captured telehealth staff narratives about being tasked with setting up other programs in response to COVID-19, increasing demands on their time and delaying preparations. Facilities also reported either increasing their consultative teledermatology program capacity and/or trying other remote options such as VVC or encrypted emails to receive photos directly from patients at home, both of which were strongly promoted by VA during these years. One Chief of Medicine said using “the app would take away from … clinical obligations.” All qualitative data sources indicated that clinicians experienced increased demands or reassignments associated with COVID-19. One clinician stated, “I can’t run two new programs at the same time.” Clinicians had less time to train for the new workflow.
Attitudes of stakeholders are an important factor in determining implementation climate. Concerns regarding support and resources for the mobile apps from dermatology chiefs, nurses, and facility leadership decreased after COVID-19’s onset, though differences among groups existed. Of 14 facilities responding to a question on the bi-monthly report about whether dermatology clinicians had concerns, 4 (29%) identified major concerns in at least one, though this response did not correlate with when a facility was exposed to MVAI. In contrast, at 4 of 12 facilities responding to a question on the bi-monthly about whether senior leadership had concerns, 3 were among the groups exposed pre-pandemic. Senior facility leadership’s engagement, often important in funding continued operations, is instrumental in creating a strong implementation climate.21 However, using reporting as an indicator of engagement, we found no association between reporting to leadership and use of MVAI at their facility.
Fit to Values
Possibly reflecting VA’s strong mission to serve Veterans, bi-monthly reports and interviews elicited that dermatology clinicians were primarily interested in adopting MVAI to improve access, to increase patient convenience, and to make in-person appointments available. They felt MVAI would particularly benefit patients who lived far from a dermatology clinic or who did not want to wait for the next in-person visit.
COVID-19 influenced facilities’ interest in MVAI. Many dermatology clinicians were “committed to implementing whatever telehealth resources were available.” MVAI enabled clinicians to “manage simple patient concerns” remotely to address “the growing backlog of patients” due to appointment cancellations.
Implementation Effectiveness
During the 17-month study period, 10 (32%) facilities used MVAI to care for 466 unique patients with a total 474 encounters. Nineteen of 31 facilities (61%) implemented MVAI by setting up clinics according to CDW data: 10 of the 19 facilities used MVAI for actual patient care by completing encounters in the EHR; 9 tested it only, reflected by VA mobile health data activity but no formal EHR encounters. Two hundred twenty of 474 (46%) encounters occurred at 7 facilities using MVAI as originally intended with patient-submitted images and history. Six facilities generated MVAI teledermatology encounters technically correctly but deviated by requesting patient-submitted photos without history (9% of all visits)—one facility reported that they adapted MVAI to augment video visits with VVC, suggesting others did as well. Testing accounted for 32% of usage, reflecting intent to implement, while the remaining MVAI encounters (13%) reflected various errors in app usage (Figure 4A).
Based on CDW data, use varied by clinician type. An adaptive strategy used by some facilities was to encourage use by residents, nurse practitioners, and physician assistants (NP/PAs), with NP/PAs using MVAI more frequently than attendings. Most MVAI clinicians were resident/fellow trainees, followed by dermatology attendings (Figure 4B). Consistent with these results, two VA facilities that were academic teaching affiliates contributed 84.4% of all MVAI encounters. However, the additional time required to train residents about MVAI was also identified as a burden by 4 facilities in bi-monthly reports.
Although not universal, clinicians increasingly used MVAI as in-person clinics closed due to COVID-19 (Figure 5). To understand the variability in use, we examined self-reported implementation progress, and found that facilities with lower initial implementation stages were associated with the onset of COVID-19 (Figure 6). Of 8 facilities that provided at least one bi-monthly report after the pandemic started, 4 reduced their implementation completion stage, 2 stayed the same, and 2 increased their stage.
Time-dependence of MVAI usage. MVAI piloting was followed by rollout according to a cluster-randomized stepped-wedge design over 17 months. Bars represent the number of facilities recording any MVAI requests for real patients with actual number of facilities stated above each bar. The solid line represents actual number of MVAI requests ordered over all exposed sites. Arrows denote when groups of facilities were exposed to MVAI, starting with pilot sites in May 2019. Asterisk denotes the shelter-in-place orders at the start of COVID-19 pandemic.
Stages of implementation completion (SIC). Bi-monthly reports were used to assess SIC scores for each group (Grp) or cohort of facilities throughout the study period. Mean scores and standard deviations are plotted for each group for each reporting period following exposure to MVAI. Note that because each group was surveyed only after MVAI exposure, Group 1 facilities had the opportunity to complete up to 6 bi-monthly reports, whereas subsequent groups had progressively fewer opportunities. A higher score denotes greater implementation completion.
Of the 10 facilities that used MVAI with patients, 7 sustained usage through the end of the study period, with 3 stopping due to technological barriers or leadership prioritizing other goals.
DISCUSSION
Home-based telehealth has had an increasing presence in VA and in healthcare generally.22,23,24,25,26,27 Direct-to-patient asynchronous teledermatology has been studied in research settings with defined diseases and populations.28,29,30 However, differences in how innovative interventions are implemented among different organizations may exist.31, 32 Here we attempt to systematically study implementation of direct-to-patient asynchronous teledermatology in a natural setting within a large national healthcare system using the context of implementation theory. Components of the OTIE have been used to understand a variety of health interventions, though its application to telehealth has been limited.12, 33,34,35 This work examines OTIE elements downstream of ORC to better understand MVAI’s varied implementation effectiveness.
As a federal integrated healthcare system whose facilities, workforce, and patients share many commonalities, VA has potential strengths in implementing new healthcare technology.36 Telehealth technology such as MVAI is governed by overall VA IT and telehealth policies and guidelines. However, individual facilities can still differ in local policies and priorities, leading to heterogeneous implementation microclimates.37, 38 We have previously reported ORC varied among our pilot sites, and this result presaged the implementation effectiveness heterogeneity we observed in this study.12, 35
MVAI was wholly developed by and for the healthcare system that implemented it, and thus aligned with the perspective of most employees that MVAI fit with VA values. Knowledge of VA’s mission, policies, structure, and clinical practice idiosyncrasies was largely incorporated into MVAI’s design, including partial integration with the VA’s EHR. Therefore, previously identified institutional barriers associated with mobile teledermatology such as lack of compatibility with the EHR and the lack of legal and regulatory policies to protect patient privacy and define practitioners’ risk were not of concern.35, 39, 40 The significance of incomplete integration with the EHR, however, may have been underestimated as an important factor in implementation practice. Potential users faced the burden of learning about and using an additional parallel platform. VA has subsequently improved MVAI’s integration for end-users by creating quality improvement tools that are more familiar and accessible to staff responsible for monitoring, and by enabling images to be uploaded into the EHR to ease the integration barrier.
Implementation plans recognized the heterogeneity among facilities by providing guidance rather than proscriptive mandates for many implementation decisions and by encouraging local decisions such as which dermatology clinics would deploy MVAI first. As a result, some facilities with supportive implementation climates innovated adaptations that fit their needs and available resources, such as by using MVAI, not as a standalone teledermatology platform as it was originally intended, but as a complement to VVC. Facilities also innovated by leveraging non-dermatologists to screen for eligible patients. These adaptations may be useful to incorporate in future MVAI marketing.
Implementation did not of course anticipate the onset of the COVID-19 pandemic, which had significant effects on implementation climate. Ironically, while telehealth was a critical healthcare delivery strategy during the pandemic, which increased dermatologists’ interest in MVAI’s potential value, numerous competing demands on staff by VA, including promotion of other telehealth pathways, also increased during the pandemic, leading to a fragmented or distracted implementation climate at some facilities.22, 41 Thus, we observed that facilities that had been exposed to MVAI before the pandemic had implementation climates that were better prepared for MVAI usage and more likely to achieve key milestones.
Staffing practices emerged as an important consideration, consistent with prior studies.42 Facilities that were academic affiliates who had resident trainees accounted for most MVAI activity. NP/PAs were also important end-user adopters of MVAI. These types of clinicians perhaps had more capacity than part-time attending dermatologists to accommodate the initial extra workload of learning about and acclimating to new processes. It may be useful to target these types of clinicians as an implementation practice in future telehealth programs to optimize initial adoption. The importance of non-clinician support staff to assist with performing administrative and routine tasks including determining patient eligibility, entering MVAI requests into VCM, and distributing education and instructions to patients was also an important practice contributing to a positive implementation climate.
Determining eligibility proved to be a significant systemic policy and practice barrier, as security policies required Veterans to have been enrolled in VA’s mobile health program. Only about half of all Veterans were eligible during the study period. On the other hand, concerns reported elsewhere regarding addressing multiple skin disorders, gathering adequate medical history, the possibility of misdiagnosis, and the limited ability to counsel patients with sensitive or complicated diagnoses were not raised by our study participants, perhaps because MVAI was marketed as a tool for follow-up of established rather than new patients.43,44,45,46
Leadership during implementation emerged as another climate facilitator, as has been well-documented.12, 36, 47, 48 We found clinical champions are important in the initial phases of implementation, but for sustained use senior leaders’ support results in a stronger implementation climate. With good innovation-values fit, facilities with leaders that created strong implementation climates experienced consistent use. Our measure of senior leadership involvement was not associated with sustainment, possibly because of the relatively small sample (5) or the brief duration of our study. Additionally, while MVAI was designed to be a general direct-to-patient telehealth tool, its implementation at our study sites was restricted to dermatology. Thus, dermatology clinical champion efforts were largely isolated and could not synergize with activities of champions in other specialties as part of a facility-wide campaign. Similarly, while VA’s OCC leadership supported MVAI’s limited release, MVAI did not benefit from national marketing, training resources, and interactions among the community of practitioners that normally accompany a VA-wide rollout of a new telehealth program.23, 49, 50
LIMITATIONS
Facilities were selected based on the requirement for significant pre-existing experience with consultative teledermatology and may not be representative of all VA facilities. Variable response rates with questions on the bi-monthly reports may have influenced the reproducibility of results. COVID-19 reduced the uniformity of the implementation environment due to our time-dependent stepped-wedge design. Finally, this study did not directly examine implementation from the important perspective of patients.
CONCLUSION
While there was success in implementing MVAI at some sites, the heterogeneity of implementation illustrates challenges in deploying new technologies supplementing usual healthcare workflows. These challenges occurred despite VA’s highly functioning integrated national healthcare system and its culture of supporting telehealth innovation. As usage among staff varied, targeting higher-end users such as trainees and NP/PAs may be a useful initial strategy for future telehealth implementation. Leveraging other support staff to assist with usage can also be an important facilitator to mitigate competing demands. While some barriers arose due to intrinsic factors associated with using new technology and workflows, others occurred due to extrinsic factors, specifically the effect of the COVID-19 pandemic. With increasing use of technology in healthcare, addressing intrinsic barriers through technology and implementation design are important to minimize the impact of extrinsic factors.
References
McKoy K, Halpern S, Mutyambizi K. International teledermatology review. Curr Dermatol Rep. 2021;10(3):55-66. doi:https://doi.org/10.1007/s13671-021-00333-6
Garfan S, Alamoodi AH, Zaidan BB, et al. Telehealth utilization during the Covid-19 pandemic: A systematic review. Comput Biol Med. 2021;138:104878. doi:https://doi.org/10.1016/j.compbiomed.2021.104878
Darkins AW. The growth of telehealth services in the Veterans Health Administration between 1994 and 2014: A study in diffusion of innovation. Telemedicine and e-Health. 2014;20:761-768.
Landow SM, Oh DH, Weinstock MA. Teledermatology within the Veterans Health Administration, 2002–2014. Telemedicine and e-Health. 2015;21(10):769-773. doi:https://doi.org/10.1089/tmj.2014.0225
Oh DH, Jackson GL, Prentice JC, et al. Implementation of Store-and-Forward Teledermatology Programs to Serve Rural Patients: An Evaluation Based on the RE-AIM Framework. VHA Office of Rural Health Annual Report; 2017.
Flaten H, St Claire C, Schlager E, Dunnick C, Dellavalle R. Growth of mobile applications in Dermatology - 2017 update. Dermatology Online Journal. 24(2):13030.
Fiks AG, Fleisher L, Berrigan L, et al. Usability, acceptability, and impact of a pediatric teledermatology mobile health application. Telemedicine and e-Health. 2018;24(3):236-245. doi:https://doi.org/10.1089/tmj.2017.0075
Weiner BJ, Lewis MA, Linnan LA. Using organization theory to understand the determinants of effective implementation of worksite health promotion programs. Health Education Research. 2008;24(2):292-305. doi:https://doi.org/10.1093/her/cyn019
Burns A, Gutta J, Kooreman H, Spitznagle M, Yeager VA. Strategic use of tobacco treatment specialists as an innovation for tobacco cessation health systems change within health care organizations. Health Care Management Review. 2023;48(4):323-333.
Klein KJ, Sorra JS. The Challenge of Innovation Implementation. Academy of Management Review. 1996;21(4):1055-1080. doi:https://doi.org/10.5465/amr.1996.9704071863
Done N, Oh DH, Weinstock MA, et al. VA Telederm study: protocol for a stepped-wedge cluster randomised trial to compare access to care for a mobile app versus a workstation-based store-and-forward teledermatology process. BMJ Open. 2018;8(12)022218. https://doi.org/10.1136/bmjopen-2018-022218
Peracca SB, Fonseca AS, Lachica O, et al. Organizational readiness for patient-facing mobile teledermatology to care for established veteran patients in the United States. Telemed J E Health. 2023;29(1):72-90. doi:https://doi.org/10.1089/tmj.2022.0009
Saldana L. Predicting program start-up using the stages of implementation measure. Administration and Policy in Mental Health. 2012;39:419-425.
Chamberlain P, Brown CH, Saldana L. Observational measure of implementation progress in community based settings: The stages of implementation completion (SIC). Implementation Science. 2011;6(116). doi:https://doi.org/10.1186/1748-5908-6-116
Saldana L. The stages of implementation completion for evidence-based practice: protocol for a mixed methods study. Implementation Science. 2014;9(43). doi:https://doi.org/10.1186/1748-5908-9-43
Vindrola-Padros C, Johnson GA. Rapid techniques in qualitative research: A critical review of the literature. Qualitative Health Research. 2020;30(10):1596-1604. doi:https://doi.org/10.1177/1049732320921835
Weiss RS. Learning from Strangers: The Art and Method of Qualitative Interview Studies. New York: Free Press; 1995.
Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277-1288.
Emerson RM, Fretz RI, Shaw LL. Writing Ethnographic Fieldnotes. Chicago: The University of Chicago Press; 1995.
Morena AL, Gaias LM, Larkin C. Understanding the Role of Clinical Champions and Their Impact on Clinician Behavior Change: The Need for Causal Pathway Mechanisms. Front Health Serv. 2022;2:896885. doi:https://doi.org/10.3389/frhs.2022.896885
Fixsen DL, Blase KA, Naoom SF, Wallace F. Core implementation components. Research on Social work practice. 2009;19(5):531-540.
Castillo F, Peracca S, Oh DH, Twigg AR. The utilization and impact of live Interactive and store-and-forward teledermatology in a Veterans Affairs Medical Center during the COVID-19 Pandemic. Telemed J E Health. 2022;28(8):1186-1192. doi:https://doi.org/10.1089/tmj.2021.0275
Hogan TP, Etingen B, Lipschitz JM, et al. Factors associated with self-reported use of web and mobile health apps among US Military Veterans: Cross-sectional survey. JMIR mHealth and uHealth. 2022;10(12):e41767. doi:https://doi.org/10.2196/41767
Khoong EC, Olazo K, Rivadeneira NA, et al. Mobile health strategies for blood pressure self-management in urban populations with digital barriers: systematic review and meta-analyses. NPJ Digit Med. 2021;4(1):114. doi:https://doi.org/10.1038/s41746-021-00486-5
Steinhubl SR, Muse ED, Topol EJ. Can mobile health technologies transform health care? JAMA. 2013;310(22):2395-2396. doi:https://doi.org/10.1001/jama.2013.281078
Wosik J, Fudim M, Cameron B, et al. Telehealth transformation: COVID-19 and the rise of virtual care. Journal of the American Medical Informatics Association. 2020;27(6):957-962. doi:https://doi.org/10.1093/jamia/ocaa067
Tuckson RV, Edmunds M, Hodgkins ML. Telehealth. N Engl J Med. 2017;377(16):1585-1592. doi:https://doi.org/10.1056/NEJMsr1503323
Jeyamohan SR, Maoye MS, Srivastava D, Nijhawan R. Patient-acquired photographs for the management of postoperative concerns. JAMA Dermatology. 2017;153(2):226-228. doi:https://doi.org/10.1001/jamadermatol.2016.4012
Watson AJ, Bergman H, Williams CM, Kvedar JC. A randomized trial to evaluate the efficacy of online follow-up visits in the management of acne. Arch Dermatol. 2010;146(4):406-411. doi:https://doi.org/10.1001/archdermatol.2010.29
Frühauf J, Schwantzer G, Ambros-Rudolph CM, et al. Pilot study on the acceptance of mobile teledermatology for the home monitoring of high-need patients with psoriasis. Australas J Dermatol. 2012;53(1):41-46. doi:https://doi.org/10.1111/j.1440-0960.2011.00852.x
Jackson GL, Williams JW. Does PCMH “Work”?--The need to use implementation science to make sense of conflicting results. JAMA Intern Med. 2015;175(8):1369-1370. doi:https://doi.org/10.1001/jamainternmed.2015.2067
Jackson GL, Cutrona SL, Kilbourne AM, White BS, Everett C, Damschroder LJ. Implementation science: Helping healthcare systems improve. Journal of the American Academy of PAs. 2020;33(1):51-53.
Jackson GL, Roumie CL, Rakley SM, et al. Linkage between theory-based measurement of organizational readiness for change and lessons learned conducting quality improvement-focused research. Learn Health Syst. 2017;1(2):e10013. doi:https://doi.org/10.1002/lrh2.10013
Dorsey S, Gray CL, Wasonga AI, et al. Advancing successful implementation of task-shifted mental health care in low-resource settings (BASIC): protocol for a stepped wedge cluster randomized trial. BMC Psychiatry. 2020;20(1):10. doi:https://doi.org/10.1186/s12888-019-2364-4
Peracca SB, Fonseca A, Hines A, et al. Implementation of mobile teledermatology: challenges and opportunities. Telemedicine and e-Health. 2021;27(12):1416-1422. doi:https://doi.org/10.1089/tmj.2020.0500
Peracca SB, Jackson GL, Weinstock MA, Oh DH. Implementation of teledermatology: Theory and practice. Curr Derm Rep. 2019;8(2):35-45. doi:https://doi.org/10.1007/s13671-019-0252-2
Nevedal AL, Reardon CM, Jackson GL, et al. Implementation and sustainment of diverse practices in a large integrated health system: a mixed methods study. Implement Sci Commun. 2020;1:61. doi:https://doi.org/10.1186/s43058-020-00053-1
Jackson GL, Cutrona SL, White BS, et al. Merging implementation practice and science to scale up promising practices: The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program. Jt Comm J Qual Patient Saf. 2021;47(4):217-227. doi:https://doi.org/10.1016/j.jcjq.2020.11.014
Coates SJ, Kvedar J, Granstein RD. Teledermatology: From historical perspective to emerging techniques of the modern era. Journal of the American Academy of Dermatology. 2015;72(4):563-574. doi:https://doi.org/10.1016/j.jaad.2014.07.061
Kho J, Gillespie N, Horsham C, et al. Skin doctor consultations using mobile teledermoscopy: Exploring virtual care business models. Telemed J E Health. 2020;26(11):1406-1413. doi:https://doi.org/10.1089/tmj.2019.0228
Yeboah CB, Harvey N, Krishnan R, Lipoff JB. The impact of COVID-19 on teledermatology: A review. Dermatol Clin. 2021;39(4):599-608. doi:https://doi.org/10.1016/j.det.2021.05.007
Yakovchenko V, Hogan TP, Houston TK, et al. Automated text messaging with patients in Department of Veterans Affairs specialty clinics: Cluster randomized trial. Journal of Medical Internet Research. 2019;21(8):e14750. doi:https://doi.org/10.2196/14750
Fogel AL, Sarin KY. A survey of direct-to-consumer teledermatology services available to US patients: Explosive growth, opportunities and controversy. Journal of Telemedicine and Telecare. 2017;23(1):19-25. doi:https://doi.org/10.1177/1357633X15624044
Kochmann M, Locatis C. Direct to consumer mobile teledermatology apps: An exploratory study. Telemedicine and e-Health. 2016;22(8):689-693. doi:https://doi.org/10.1089/tmj.2015.0189
Manuelyan K, Shahid M, Vassilev V, Drenovska K, Vassileva S. Direct patient-to-physician teledermatology: Not a flash in the pan(demic). Clin Dermatol. 2021;39(1):45-51. doi:https://doi.org/10.1016/j.clindermatol.2020.12.011
Resneck JS, Abrouk M, Steuer M, et al. Choice, transparency, coordination, and quality among direct-to-consumer telemedicine websites and apps treating skin disease. JAMA Dermatology. 2016;152(7):768. doi:https://doi.org/10.1001/jamadermatol.2016.1774
Peracca SB, Jackson GL, Lamkin RP, et al. Implementing teledermatology for rural Veterans: An evaluation using the RE-AIM Framework. Telemedicine and e-Health. 2021;27(2):218-226. doi:https://doi.org/10.1089/tmj.2020.0013
Helfrich CD, Weiner BJ, McKinney MM, Minasian L. Determinants of implementation effectiveness: Adapting a framework for complex innovations. Medical Care Research and Review. 2007;64(3):279-303. doi:https://doi.org/10.1177/1077558707299887
Yakovchenko V, McInnes DK, Petrakis BA, et al. Implementing automated text messaging for patient self-management in the Veterans Health Administration: Qualitative study applying the Nonadoption, Abandonment, Scale-up, Spread, and Sustainability Framework. JMIR Mhealth Uhealth. 2021;9(11):e31037. doi:https://doi.org/10.2196/31037
Zulman DM, Wong EP, Slightam C, et al. Making connections: nationwide implementation of video telehealth tablets to address access barriers in veterans. JAMIA Open. 2019;2(3):323-329. doi:https://doi.org/10.1093/jamiaopen/ooz024
Acknowledgements
We thank Phillip DeDionisio, Noelle Yarn and Steffi Yang for the assistance with data processing and manuscript preparation, and Sara Derycke and others at VA’s Office of Connected Care.
Funding
This work was funded by award HX002450 (to DHO and MAW) by VA Office of Research and Development, Health Services Research and Development; Field Enterprise Research Support Service Contract with VA Office of Research and Development; the Durham Center of Innovation to Accelerate Discovery and Practice Transformation (CIN 13-410, GLJ); and Center for Healthcare Organization and Implementation Research (CHOIR) (CIN 13-403, ALG).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Disclaimer
The views expressed in this report are those of the authors and do not reflect the position or policy of the Department of Veterans Affairs or the United States government.
Conflict of Interest
No conflicts of interest declared.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Prior Presentations
This work was presented at the Annual Academy Health Research Meeting June 14–17, 2021; Annual Academy Health Conference on the Science of Dissemination and Implementation in Health, December 11–14, 2022; VA’s Health Services Research and Development/Quality Enhancement Research Initiative National Conference, February 8–10, 2023; and University California San Francisco Health Services Research Symposium, May 23, 2023.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Peracca, S.B., Lachica, O., Lamkin, R.P. et al. Implementation of Direct-to-Patient Mobile Teledermatology in VA. J GEN INTERN MED 39 (Suppl 1), 97–105 (2024). https://doi.org/10.1007/s11606-023-08480-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11606-023-08480-1