Skip to main content

Provider confidence in the telemedicine spine evaluation: results from a global study

Abstract

Purpose

To utilize data from a global spine surgeon survey to elucidate (1) overall confidence in the telemedicine evaluation and (2) determinants of provider confidence.

Methods

Members of AO Spine International were sent a survey encompassing participant’s experience with, perception of, and comparison of telemedicine to in-person visits. The survey was designed through a Delphi approach, with four rounds of question review by the multi-disciplinary authors. Data were stratified by provider age, experience, telemedicine platform, trust in telemedicine, and specialty.

Results

Four hundred and eighty-five surgeons participated in the survey. The global effort included respondents from Africa (19.9%), Asia Pacific (19.7%), Europe (24.3%), North America (9.4%), and South America (26.6%). Providers felt that physical exam-based tasks (e.g., provocative testing, assessing neurologic deficits/myelopathy, etc.) were inferior to in-person exams, while communication-based aspects (e.g., history taking, imaging review, etc.) were equivalent. Participants who performed greater than 50 visits were more likely to believe telemedicine was at least equivalent to in-person visits in the ability to make an accurate diagnosis (OR 2.37, 95% C.I. 1.03–5.43). Compared to in-person encounters, video (versus phone only) visits were associated with increased confidence in the ability of telemedicine to formulate and communicate a treatment plan (OR 3.88, 95% C.I. 1.71–8.84).

Conclusion

Spine surgeons are confident in the ability of telemedicine to communicate with patients, but are concerned about its capacity to accurately make physical exam-based diagnoses. Future research should concentrate on standardizing the remote examination and the development of appropriate use criteria in order to increase provider confidence in telemedicine technology.

Introduction

Though COVID-19 accelerated the worldwide adoption of remote health care, recent trends had already established telemedicine as a fast-growing clinical tool [1]. The last two decades have witnessed the expansion of telemedicine in general surgery, medical education, and surgical subspecialties [2, 3], a trend now cemented in place by current COVID-19 restrictions. Spine surgery has also experienced similar growth and adoption of this practice change [4].

Certain challenges are inevitable in the widespread adoption of any “new” mode of care delivery, especially with the incorporation of new technology. Barriers to the adoption of telemedicine in spine surgery include the implementation of novel technology, lack of technological literacy, new medicolegal territory, negative financial implications, and regulatory concerns [5]. However, as with any new technology, the largest barrier to widespread adoption is user confidence in the clinical utility of telemedicine. Whether telemedicine will play a large or small part in the overall patient evaluation remains to be seen. One controversial aspect of telemedicine is the ability to perform accurate physical examination, as experts diverge on how best to examine patients and how much faith can be placed in these virtual evaluations [6,7,8].

Understanding surgeon confidence in telemedicine will be necessary to develop appropriate use criteria, improve deficient areas, and standardize the telemedicine evaluation. International perspectives are particularly valuable as they offer the widest array of experience and opinion. The purpose of this study was to utilize data from a global spine surgeon survey to elucidate (1) overall confidence in the telemedicine evaluation and (2) determinants of provider confidence in this novel method of patient evaluation.

Methods

Survey design

The data utilized in this study were retrieved from a cross-sectional, global survey designed to capture spine surgeons’ perspectives on telemedicine. The survey was designed through a Delphi approach, in which all questions underwent four rounds of review by the multi-disciplinary study authors [9]. The final survey consisted of 42 questions encompassing seven major categories: demographics, usage of telemedicine, patient perception, trust in telemedicine, challenges and benefits, comparison to in-person visits, and training and research (Appendix 1). The survey was anonymous, as no identifying information was collected from respondents.

Study sample

The survey entitled “Telemedicine & the Spine Surgeon—Perspectives and Practices Worldwide” was distributed through email to members of AO Spine starting May 15, 2020, with closure of the survey on May 31, 2020. AO Spine is the largest international society dedicated to spine surgery, consisting of over 30,000 professionals, of which greater than 6000 are practicing spine surgeons (www.aospine.org). The survey was distributed to the 3805 surgeons who opted in to receive email surveys.

Statistical analyses

Survey respondents were grouped into five geographical regions: Africa, Asia–Pacific, Europe, North America, and South America. All questions were considered optional; thus, pairwise deletion was utilized for missing data points. In order to present the large content of the survey in a concise manner, statistical analyses were divided into four major themes: global perspectives, challenges and benefits, telemedicine evaluation, and training and research. Thus, the current analysis focuses specifically on survey questions pertaining to the telemedicine evaluation.

The data were stratified by region, provider age, telemedicine platform, experience with telemedicine, specialty, and trust in telemedicine, and compared. To determine participants’ sense of trust in telemedicine, the survey query: “If you or a family member were a patient, do you believe the initial visit can be performed through telemedicine?" was utilized as an anchor question, with a response of “agree” or “strongly agree” classified as a positive response. Likert scale questions were analyzed as both categorical and continuous variables. Categorical variables were compared using Pearson’s Chi-square test and continuous variables were compared using Mann–Whitney U tests or ANOVA test as appropriate. To control for confounding and isolate factors independently associated with confidence in the telemedicine evaluation, multivariate logistic regressions were performed for each survey question. Odds ratios (OR) and 95% confidence intervals (CI) were assessed for precision. Hosmer–Lemeshow tests were used to ensure appropriate goodness of fit for all models. All statistical analyses were performed using SPSS version 25.0 (IBM, Armonk, NY), and the threshold for statistical significance was established at p < 0.05.

Results

Survey sample

In total, 485 spine surgeons participated in the survey. Most survey participants were between 35–44 (68.7%) and 45–54 (33.0%) years old, and the vast majority were male (94.5%). Responses were split between Africa (19.9%), Asia Pacific (19.7%), Europe (24.3%), North America (9.4%), and South America (26.6%). Videoconferencing platforms (EMR-integrated or non-secure) were utilized by 57.5%, while 34.6% of respondents used telephone calls only for telemedicine. At the time of the survey, most participants had performed fewer than 50 visits (77.8%), with less than a quarter of having performed over 50 telehealth visits (22.2%) (Table 1).

Table 1 Survey respondent demographics
Table 2 Equivalency of telemedicine evaluation and entire sample
Table 3 Confidene in telemedicine evaluation, stratified by age, platform, experience and speciality
Table 4 Confidence in telemedicine evaluation, stratified by provider trust in telemedicine
Table 5 Independent predictors of confidence in telemedicine evaluation

Confidence in the telemedicine evaluation—overall responses

Participants were asked to compare telemedicine to in-person visits among multiple facets of the patient evaluation (i.e., history taking, examination, imaging review, diagnosis). Analysis of the mean Likert scale responses demonstrated an overall leftward skew of provider opinion toward telemedicine evaluation (Fig. 1, Table 2). Most respondents felt that telemedicine was at least equivalent to in-person visits for communicative tasks, such as taking a patient history (64.3%), reviewing and explaining imaging (72.3%), and formulating and communicating a treatment plan (67.7%). Respondents had significantly less confidence in the physical exam portions of the evaluation; telemedicine was worse or much worse in assessing neurologic deficits (94.6%), provocative testing (89.5%) and myelopathy (89.0%) (Fig. 2 and Table 2).

Fig. 1
figure 1

Provider confidence in various patient evaluation tasks, stratified by region. There were no significant differences in responses by region (p > 0.05 for all comparisons)

Fig. 2
figure 2

Equivalency of telemedicine for patient evaluations, stratified by region. The only significant difference was noted in the equivalency of telemedicine to localize pain (p = 0.045, p > 0.05 for all other comparisons)

Region

In almost all analyses, region was not associated with differences in participant confidence in telemedicine (Figs. 1, 2). The significant differences noted in univariate analysis were all small and not significant after multivariate adjustment.

Age

On univariate analyses, participant age was not found to be associated with confidence in the telemedicine evaluation (Table 3). However, multivariate adjustment demonstrated that participants > 55 years old were more likely to believe telemedicine was equivalent or better to in-person visits for the assessment of spinal deformity (OR: 2.51, 95% CI: 1.02–6.15) (Table 5).

Telemedicine Platform

Compared with telephone (audio only), the use of videoconferencing technology was associated with increased confidence in the ability of telemedicine to formulate and communicate a treatment plan when compared to in-person visits (−0.08 ± 0.69 vs. −0.41 ± 0.68, p < 0.001) (Table 3). This relationship was sustained in the multivariate model (OR: 3.88, 95% CI: 1.71–8.84) (Table 5).

Provider experience

Providers who had performed > 50 telemedicine visits demonstrated increased confidence in the ability of telemedicine to formulate and communicate a treatment plan (0.02 ± 0.80 vs. −0.32 ± 0.69, p = 0.018) and make an accurate diagnosis (−0.63 ± 0.88 vs. −0.88 ± 0.69, p = 0.049) (Table 3). On multivariate analysis, respondents experienced with telemedicine were more likely to believe telemedicine was equivalent or better than in-person visits in the ability to make an accurate diagnosis (OR: 2.37, 95% CI: 1.03–5.43).

Specialty

Univariate analyses did not support a difference between orthopedic and neurosurgery in participant confidence in telemedicine evaluation. However, those with neurosurgery training described increased confidence in telemedicine for imaging review and explanation (OR: 3.67, 95% CI: 1.39–9.71), compared to their orthopedic-trained colleagues.

Provider trust in telemedicine

Our anchor question for provider trust in telemedicine revealed that most respondents (74.9%) believed that the initial visit could be performed through telemedicine. An affirmative response to the anchor question was associated with slightly increased confidence in telemedicine in almost all facets of the patient evaluation, with the exception of the assessment of myelopathy and imaging review (Table 4). However, none of these relationships were sustained in the multivariate analyses (Table 5).

Discussion

Our global survey of 485 spine surgeons demonstrates that the use of telemedicine in spine surgery is still in the early stages, with most participants having conducted relatively few telehealth visits at the time of the survey (Table 1). Overall, there remains considerable skepticism. Specifically, compared to in-person visits, spine surgeons generally felt that telemedicine was inferior for every aspect of the patient evaluation (Fig. 1). However, there was a clear divergence between communication- and examination-based aspects of the patient evaluation.

The majority of survey respondents felt that telemedicine was at least equivalent to in-person visits for taking a patient history, reviewing and explaining imaging, and formulating and communicating a treatment plan (Fig. 2, Table 2). Although telemedicine remains in the early stages of adoption, these data are largely in keeping with the existing literature [10,11,12,13]. Agha et al. [12] conducted a non-inferiority, randomized controlled trial (RCT) of 221 patients seen in a medical office. They used a validated questionnaire to demonstrate that patient-centered communication tasks and clinical competence were perceived equally regardless of visit type (in-person or telemedicine). On the physician side, Buvik et al. [13] surveyed orthopedic surgeons and found that provider assessment of communication was nearly identical between remote and in-person orthopedic consultations.

Importantly, both of these studies used videoconferencing. Additionally, because these studies were conducted by early adopters of telemedicine, it is likely that these providers were more experienced with telemedicine. These factors (the use of video and prior experience) were independently associated with increased confidence in telemedicine in our survey (Table 4).

Taken together, these data suggest that (when feasible) video conferencing should be the recommended platform for telemedicine visits. Additionally, as institutions integrate telemedicine into their practices, it will be important to provide exposure to this new technology in a graduated fashion. When possible, institutional adoption of telemedicine should include training on the differences between telemedicine and in-person visits, simulated visits, exposure of house staff to telemedicine and accounting for an “adjustment phase” for new providers [6, 7, 16], similar to the steps taken when onboarding a new provider to the practice.

In contrast to communication-based tasks, surgeon confidence in physical-exam-based patient evaluation (e.g., assessment of myelopathy, neurologic deficits, and provocative testing) was universally low. Almost all physicians (~ 90%) considered telemedicine slightly to be much worse than in-person visits for these tasks.

The inability of telemedicine to replicate the hands-on physical exam is probably the largest limitation to its adoption [8]. Interestingly, the need for “advanced physical exam maneuvers” has even been employed as an exclusion criterion from participation in orthopedic telemedicine RCTs [13]. Several authors have suggested strategies to improve the remote physical exam: asking patients to use weights (or body-weight maneuvers) and self-rate the required effort [6, 14], using composite movements [15] and utilizing technology to make reproducible measurements [16].

While our survey results leave little doubt about the telemedicine physical exam, it is certainly possible that a good patient history, imaging review, and a limited physical exam might be sufficient to make an accurate initial diagnosis in some patients [17]. In the situation where the diagnosis is not clear or surgical intervention is warranted, the provider may consider a follow-up in-person evaluation to supplement the telemedicine encounter. Certainly, there appears to be a learning curve to this type of visit (Table 5). In this sense, we expect providers to become more facile with their own telemedicine-based indications. Just as with any “new” technology, appropriate use criteria will have to be created for telemedicine, and the COVID19 pandemic makes this task ever more urgent. Expert consensus and high-quality research in this area are essential.

Our analysis is not without limitations. While there were several strengths of our survey population (international cohort split between regions, wide age range and years of practice, multiple spine surgery specialties and levels of experience with telemedicine, etc.), we only made the survey available for two weeks, capturing only a small portion of AO Spine members as a whole (485 [12.7%] of 3805) and all response items were optional. Thus, the population may have strong opinions about telemedicine which influenced their decision to participate. In addition, the participants were mainly from large, urban areas; these are populous regions that have traditionally not relied on telemedicine [18]. Furthermore, the timing of the survey (during COVID-19) must be considered when interpreting our findings. It is difficult to predict whether surgeon opinion on telemedicine will change once the pandemic is under better control, especially if pre-pandemic regulations are re-instituted [5]. Finally, the study was not powered to rule out associations; thus, negative findings should be interpreted cautiously.

Conclusions

In conclusion, our global survey demonstrated that spine surgeons were confident in the ability of telemedicine to communicate with patients, but were concerned about its capacity to accurately make physical exam-based diagnoses. Video technology was strongly associated with increased confidence and should be used when available. Provider experience allows for increased confidence in how and when to use telemedicine. Given the limitations in the telemedicine physical exam, further research is needed to standardize physical examination methods and develop appropriate use criteria for this new tool.

References

  1. 1.

    (2020) U.S. Telemedicine Market Statistics 2019–2025: Share Forecasts, Trends & Growth drivers. In: MarketWatch

  2. 2.

    Dinesen B, Nonnecke B, Lindeman D et al (2016) Personalized telehealth in the future: A global research agenda. J Med Internet Res**

  3. 3.

    Forbes RC, Solorzano CC, Concepcion BP (2020) Surgical telemedicine here to stay: more support from a randomized controlled trial on postoperative surgery visits. Am J Surg. https://doi.org/10.1016/j.amjsurg.2020.03.033

    Article  PubMed  PubMed Central  Google Scholar 

  4. 4.

    Louie PK, Harada GK, McCarthy MH et al (2020) The impact of COVID-19 Pandemic on Spine Surgeons Worldwide. Glob Spine J 10:534–552. https://doi.org/10.1177/2192568220925783

    Article  Google Scholar 

  5. 5.

    Makhni M, Riew G, Sumathipala M (2020) Telemedicine in orthopaedic surgery. J Bone Jt Surg A 102:1109–1115. https://doi.org/10.2106/JBJS.F.01426

    Article  Google Scholar 

  6. 6.

    Yoon JW, Welch R, Alamin T et al (2020) Remote virtual spinal evaluation in the Era of COVID-19. Int J Spine Surg 14:7057. https://doi.org/10.14444/7057

    Article  Google Scholar 

  7. 7.

    Franco D, Montenegro T, Gonzalez GA et al (2020) Telemedicine for the Spine Surgeon in the age of COVID-19: multicenter experiences of feasibility and implementation strategies. Glob Spine J. https://doi.org/10.1177/2192568220932168

    Article  Google Scholar 

  8. 8.

    Donnally CJ, Vaccaro AR, Schroeder GD, Divi SN (2020) Is evaluation with telemedicine sufficient before spine surgery? Clin Spine Surg 00:1–4. https://doi.org/10.1097/BSD.0000000000001027

    Article  Google Scholar 

  9. 9.

    Okoli C, Pawlowski SD (2004) The Delphi method as a research tool: an example, design considerations and applications. Inf Manag 42:15–29. https://doi.org/10.1016/j.im.2003.11.002

    Article  Google Scholar 

  10. 10.

    Grandizio LC, Mettler AW, Caselli ME, Pavis EJ (2020) Telemedicine after upper extremity surgery: a prospective study of program implementation. J Hand Surg Am. https://doi.org/10.1016/j.jhsa.2020.06.002

    Article  PubMed  PubMed Central  Google Scholar 

  11. 11.

    Debono B, Bousquet P, Sabatier P et al (2016) Postoperative monitoring with a mobile application after ambulatory lumbar discectomy: an effective tool for spine surgeons. Eur Spine J. https://doi.org/10.1007/s00586-016-4680-4

    Article  PubMed  Google Scholar 

  12. 12.

    Agha Z, Schapira RM, Laud PW et al (2009) Patient satisfaction with physician-patient communication during telemedicine. Telemed e-Health. https://doi.org/10.1089/tmj.2009.0030

    Article  Google Scholar 

  13. 13.

    Buvik A, Bugge E, Knutsen G et al (2016) Quality of care for remote orthopaedic consultations using telemedicine: a randomised controlled trial. BMC Health Serv Res 16:1–11. https://doi.org/10.1186/s12913-016-1717-7

    Article  Google Scholar 

  14. 14.

    Tanaka MJ, Oh LS, Martin SD, Berkson EM (2020) Telemedicine in the era of COVID-19: the virtual orthopaedic examination. J Bone Joint Surg A 102(12):e57. https://doi.org/10.2106/JBJS.20.00609

    Article  Google Scholar 

  15. 15.

    Palacín-Marín F, Esteban-Moreno B, Olea N et al (2013) Agreement between telerehabilitation and face-to-face clinical outcome assessments for low back pain in primary care. Spine (Phila. Pa. 1976) 38:947–952

    Article  Google Scholar 

  16. 16.

    Wochatz M, Tilgner N, Mueller S et al (2019) Reliability and validity of the Kinect V2 for the assessment of lower extremity rehabilitation exercises. Gait Posture 70:330–335. https://doi.org/10.1016/j.gaitpost.2019.03.020

    Article  PubMed  Google Scholar 

  17. 17.

    Olldashi F, Latifi R, Parsikia A et al (2019) Telemedicine for neurotrauma prevents unnecessary transfers: an update from a nationwide program in Albania and analysis of 590 patients. World Neurosurg 128:e340–e346. https://doi.org/10.1016/j.wneu.2019.04.150

    Article  PubMed  Google Scholar 

  18. 18.

    Call VRA, Erickson LD, Dailey NK et al (2015) Attitudes toward telemedicine in urban, rural, and highly rural communities. Telemed e-Health. https://doi.org/10.1089/tmj.2014.0125

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to extend their sincere gratitude to Kaija Kurki-Suonio and Fernando Kijel from AO Spine (Davos, Switzerland) for their assistance with circulating the survey to AO Spine members.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Sravisht Iyer.

Ethics declarations

Conflict of interest

The authors have no financial or competing interests to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix 1: Survey

Appendix 1: Survey

Telemedicine & the Spine Surgeon – Spine Surgeon Perspectives and Practices Worldwide

Purpose: Given the need for social distancing with COVID-19, telemedicine services have expanded around the world. We define telemedicine in this survey as clinical care provided remotely through videoconferencing or telephone. This survey seeks to determine:

  1. 1.

    1.The extent of spine surgeon adoption of telemedicine

  2. 2.

    Satisfaction with telemedicine

  3. 3.

    Comparison of telemedicine to in-person visits

  4. 4.

    The use of telemedicine in research and training

  5. 5.

    Variations in perspectives and practices worldwide

The survey will not take more than 5–10 min to complete.Information obtained from this survey will be kept strictly confidential. The identity of all survey participants will remain anonymous. The findings of this survey will be disseminated via social media, journals, and other media platforms. Deadline to respond is May 31, 2020. Thank you in advance for taking the time to fill out this survey.

Demographic data

figurea
figureb
figurec
figured
figuree
figuref

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Lovecchio, F., Riew, G.J., Samartzis, D. et al. Provider confidence in the telemedicine spine evaluation: results from a global study. Eur Spine J 30, 2109–2123 (2021). https://doi.org/10.1007/s00586-020-06653-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00586-020-06653-8

Keywords

  • Telemedicine
  • Spine surgery
  • Examination
  • International
  • Survey