Advertisement

Neuropsychology Review

, Volume 27, Issue 2, pp 174–186 | Cite as

Neuropsychological Test Administration by Videoconference: A Systematic Review and Meta-Analysis

  • Timothy W. Brearly
  • Robert D. Shura
  • Sarah L. Martindale
  • Rory A. Lazowski
  • David D. Luxton
  • Brian V. Shenal
  • Jared A. Rowland
Review

Abstract

The purpose of the current systematic review and meta-analysis was to assess the effect of videoconference administration on adult neurocognitive tests. We investigated whether the scores acquired during a videoconference administration were different from those acquired during on-site administration. Relevant counterbalanced crossover studies were identified according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Twelve studies met criteria for analysis. Included samples consisted of healthy adults as well as those with psychiatric or neurocognitive disorders, with mean ages ranging from 34 to 88 years. Heterogenous data precluded the interpretation of a summary effect for videoconference administration. Studies including particpants with a mean age of 65–75, as well as studies that utilized a high speed network connection, indicated consistent performance across videoconference and on-site conditions, however studies with older participants and slower connections were more variable. Subgroup analyses indicated that videoconference scores for untimed tasks and those allowing for repetition fell 1/10th of a standard deviation below on-site scores. Test specific analyses indicated that verbally-mediated tasks including digit span, verbal fluency, and list learning were not affected by videoconference administration. Scores for the Boston Naming Test fell 1/10th of a standard deviation below on-site scores. Heterogenous data precluded meaningful interpretation of tasks with a motor component. The administration of verbally-mediated tasks by qualified professionals using existing norms was supported, and the use of visually-dependent tasks may also be considered. Variability in previous studies indicates a need for further investigation of motor-dependent tasks. We recommend the development of clinical best practices for conducting neuropsychological assessments via videoconference, and advocate for reimbursement structures that allow consumers to benefit from the increased access, convenience, and cost-savings that remote assessment provides.

Keywords

Teleneuropsychology Telepsychology Telehealth Telemedicine Mhealth Assessment 

Notes

Acknowledgements

This research was supported by the Department of Veterans Affairs Office of Academic Affiliations Advanced Fellowship Program in Mental Illness, Research, and Treatment and the Mid-Atlantic Mental Illness Research, Education, and Clinical Center (VISN 6 MIRECC) of the Department of Veterans Affairs Office of Mental Health Services. Special thanks to Larry A. Tupler for his support of this and other related teleneuropsychology investigations within the VISN 6 MIRECC.

Supplementary material

11065_2017_9349_MOESM1_ESM.pdf (299 kb)
ESM 1 (PDF 298 kb)

References

  1. Acierno, R., Gros, D. F., Ruggiero, K. J., Hernandez-Tejada, B. M. A., Knapp, R. G., Lejuez, C. W., et al. (2016). Behavioral activation and therapeutic exposure for posttraumatic stress disorder: a noninferiority trial of treatment delivered in person versus home-based telehealth. Depression and Anxiety. doi: 10.1002/da.22476.
  2. Adjorlolo, S. (2015). Can teleneuropsychology help meet the neuropsychological needs of western Africans? The case of Ghana. Applied Neuropsychology: Adult, 22(5), 388–398. doi: 10.1080/23279095.2014.949718.CrossRefGoogle Scholar
  3. Backhaus, A., Agha, Z., Maglione, M. L., Repp, A., Ross, B., Zuest, D., et al. (2012). Videoconferencing psychotherapy: a systematic review. Psychological Services, 9(2), 111–131. doi: 10.1037/a0027924.CrossRefPubMedGoogle Scholar
  4. Ball, C. J., Scott, N., McLaren, P. M., & Watson, J. P. (1993). Preliminary evaluation of a low-cost videoconferencing (LCVC) system for remote cognitive testing of adult psychiatric patients. British Journal of Clinical Psychology, 32(3), 303–307. doi: 10.1111/j.2044-8260.1993.tb01060.x.CrossRefPubMedGoogle Scholar
  5. Barak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008). A comprehensive review and a meta-analysis of the effectiveness of internet-based psychotherapeutic interventions. Journal of Technology in Human Services, 26(2–4), 109–160. doi: 10.1080/15228830802094429.CrossRefGoogle Scholar
  6. Barton, C., Morris, R., Rothlind, J., & Yaffe, K. (2011). Video-telemedicine in a memory disorders clinic: evaluation and management of rural elders with cognitive impairment. Telemedicine and e-Health, 17(10), 789–793.CrossRefPubMedGoogle Scholar
  7. Bashshur, R. L., Shannon, G. W., Bashshur, N., & Yellowlees, P. M. (2015). The empirical evidence for telemedicine interventions in mental disorders. Telemedicine and e-Health. doi: 10.1089/tmj.2015.0206.
  8. Begg, C. B., & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50(4), 1088–1101. doi: 10.2307/2533446.CrossRefPubMedGoogle Scholar
  9. Beglinger, L. J., Gaydos, B., Tangphao-Daniels, O., Duff, K., Kareken, D. A., Crawford, J., et al. (2005). Practice effects and the use of alternate forms in serial neuropsychological testing. Archives of Clinical Neuropsychology, 20(4), 517–529. doi: 10.1016/j.acn.2004.12.003.CrossRefPubMedGoogle Scholar
  10. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1(2), 97–111. doi: 10.1002/jrsm.12.CrossRefPubMedGoogle Scholar
  11. Cernich, A. N., Brennana, D. M., Barker, L. M., & Bleiberg, J. (2007). Sources of error in computerized neuropsychological assessment. Archives of Clinical Neuropsychology, 22(Suppl 1), S39–S48. doi: 10.1016/j.acn.2006.10.004.CrossRefPubMedGoogle Scholar
  12. Cheung, M. W.-L., & Vijayakumar, R. (2016). A guide to conducting a meta-analysis. Neuropsychology Review, 1–8. doi: 10.1007/s11065-016-9319-z.
  13. Ciemins, E., Halloway, B., Coon, P. J., McClosky-Armstrong, T., & Min, S. (2009). Telemedicine and the Mini-mental state Examination: Assessment from a distance. Telemedicine and e-Health. doi: 10.1089/tmj.2008.0144.
  14. Cohen, J. (1988). Statistical power analysis for the behavioral Sciences. Hillsdale: L. Erlbaum Associates.Google Scholar
  15. Cullum, C., Weiner, M., Gehrmann, H., & Hynan, L. (2006). Feasibility of telecognitive assessment in dementia. Assessment, 13(4), 385–390. doi: 10.1177/1073191106289065.CrossRefPubMedGoogle Scholar
  16. Cullum, C., Hynan, L., Grosch, M., Parikh, M., & Weiner, M. (2014). Teleneuropsychology: evidence for video teleconference-based neuropsychological assessment. Journal of the International Neuropsychological Society, 20(10), 1028–1033. doi: 10.1017/S1355617714000873.CrossRefPubMedCentralGoogle Scholar
  17. Czaja, S. J. (2016). Long-term care services and support systems for older adults: the role of technology. American Psychologist, 71(4), 294–301. doi: 10.1037/a0040258.CrossRefPubMedGoogle Scholar
  18. Davis, L. E., Coleman, J., Harnar, J., & King, M. K. (2014). Teleneurology: successful delivery of chronic neurologic care to 354 patients living remotely in a rural state. Telemedicine and e-Health, 20(5), 473–477. doi: 10.1089/tmj.2013.0217.CrossRefPubMedGoogle Scholar
  19. DeYoung, N., Belkonen, S., Luci, K., Slater, M., Quigley, T., & Shenal, B. (2015). The reliability and accuracy of administering the Montreal cognitive assessment over telehealth. Presented at the 43rd annual meeting of the International neuropsychological Society, Denver, CO.Google Scholar
  20. Ding, H., Hu, G. L., Zheng, X. Y., Chen, Q., Threapleton, D. E., & Zhou, Z. H. (2015). The method quality of cross-over studies involved in Cochrane systematic reviews. PloS One, 10(4). doi: 10.1371/journal.pone.0120519.
  21. Duff, K. (2012). Evidence-based indicators of neuropsychological change in the individual patient: relevant concepts and methods. Archives of Clinical Neuropsychology, 27(3), 248–261. doi: 10.1093/arclin/acr120.
  22. Fordyce, M. A., Chen, F. M., Doescher, M. P., & Hart, L. G. (2007). 2005 physician supply and distribution in rural areas of the United States. Final report, 116. http://depts.washington.edu/uwrhrc/uploads/RHRC%20FR116%20Fordyce.pdf. Accessed 20 July 2016.
  23. Fortney, J. C., Pyne, J. M., Turner, E. E., Farris, K. M., Normoyle, T. M., Avery, M. D., et al. (2015). Telepsychiatry integration of mental health services into rural primary care settings. International Review of Psychiatry, 27(6), 525–539. doi: 10.3109/09540261.2015.1085838.CrossRefPubMedGoogle Scholar
  24. Galusha-Glasscock, J. M., Horton, D. K., Weiner, M. F., & Cullum, C. M. (2015). Video teleconference administration of the Repeatable Battery for the assessment of neuropsychological status. Archives of Clinical Neuropsychology. doi: 10.1093/arclin/acv058.
  25. Gros, D. F., Morland, L. A., Greene, C. J., Acierno, R., Strachan, M., Egede, L. E., et al. (2013). Delivery of evidence-based psychotherapy via video telehealth. Journal of Psychopathology and Behavioral Assessment, 35(4), 506–521. doi: 10.1007/s10862-013-9363-4.CrossRefGoogle Scholar
  26. Grosch, M. C., Gottlieb, M. C., & Cullum, C. M. (2011). Initial practice recommendations for teleneuropsychology. The Clinical Neuropsychologist, 25(7), 1119–1133. doi: 10.1080/13854046.2011.609840.CrossRefPubMedGoogle Scholar
  27. Grosch, M. C., Weiner, M. F., Hynan, L. S., Shore, J., & Cullum, C. M. (2015). Video teleconference-based neurocognitive screening in geropsychiatry. Psychiatry Research, 225(3), 734–735. doi: 10.1016/j.psychres.2014.12.040.CrossRefPubMedPubMedCentralGoogle Scholar
  28. Harrell, K. M., Wilkins, S. S., Connor, M. K., & Chodosh, J. (2014). Telemedicine and the evaluation of cognitive impairment: the additive value of neuropsychological assessment. Journal of the American Medical Directors Association, 15(8), 600–606. doi: 10.1016/j.jamda.2014.04.015.CrossRefPubMedGoogle Scholar
  29. Higgins, J. P., & Green, S. (2011). Cochrane handbook for systematic reviews of interventions. http://handbook.cochrane.org/front_page.htm. Accessed 8 Apr 2016.
  30. Higgins, J. P. T., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539–1558. doi: 10.1002/sim.1186.CrossRefPubMedGoogle Scholar
  31. Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ: British Medical Journal, 327(7414), 557–560.CrossRefPubMedPubMedCentralGoogle Scholar
  32. Hildebrand, R., Chow, H., Williams, C., Nelson, M., & Wass, P. (2004). Feasibility of neuropsychological testing of older adults via videoconference: implications for assessing the capacity for independent living. Journal of Telemedicine and Telecare, 10(3), 130–134.CrossRefPubMedGoogle Scholar
  33. Hilty, D. M., Nesbitt, T. S., Kuenneth, C. A., Cruz, G. M., & Hales, R. E. (2007). Rural versus suburban primary care needs, utilization, and satisfaction with telepsychiatric consultation. The Journal of Rural Health, 23(2), 163–165. doi: 10.1111/j.1748-0361.2007.00084.x.CrossRefPubMedGoogle Scholar
  34. Hilty, D. M., Ferrer, D. C., Parish, M. B., Johnston, B., Callahan, E. J., & Yellowlees, P. M. (2013). The effectiveness of telemental health: a 2013 review. Telemedicine and e-Health, 19(6), 444–454. doi: 10.1089/tmj.2013.0075.CrossRefPubMedPubMedCentralGoogle Scholar
  35. Jacobsen, S. E., Sprenger, T., Andersson, S., & Krogstad, J.-M. (2003). Neuropsychological assessment and telemedicine: a preliminary study examining the reliability of neuropsychology services performed via telecommunication. Journal of the International Neuropsychological Society, 9(3), 472–478. doi: 10.1017/S1355617703930128.CrossRefPubMedGoogle Scholar
  36. Johnson, K. A., Meyer, J., Yazar, S., & Turner, A. W. (2015). Real-time teleophthalmology in rural Western Australia. Australian Journal of Rural Health, 23(3), 142–149. doi: 10.1111/ajr.12150.CrossRefPubMedGoogle Scholar
  37. Kirkwood, K. T., Peck, D. F., & Bennie, L. (2000). The consistency of neuropsychological assessments performed via telecommunication and face to face. Journal of Telemedicine and Telecare, 6, 147–151.CrossRefPubMedGoogle Scholar
  38. Lilly, C. M., Zubrow, M. T., Kempner, K. M., Reynolds, H. N., Subramanian, S., Eriksson, E. A., et al. (2014). Critical care telemedicine: evolution and state of the art*. Critical Care Medicine, 42(11), 2429–2436. doi: 10.1097/CCM.0000000000000539.CrossRefPubMedGoogle Scholar
  39. Loh, P., Ramesh, P., Maher, S., Saligari, J., Flicker, L., & Goldswain, P. (2004). Can patients with dementia be assessed at a distance? The use of telehealth and standardised assessments. Internal Medicine Journal, 34(5), 239–242.CrossRefPubMedGoogle Scholar
  40. Loh, P., Donaldson, M., Flicker, L., Maher, S., & Goldswain, P. (2007). Development of a telemedicine protocol for the diagnosis of Alzheimer’s disease. Journal of Telemedicine and Telecare, 13(2), 90–94. doi: 10.1258/135763307780096159.CrossRefPubMedGoogle Scholar
  41. Luxton, D. D., Pruitt, L. D., & Osenbach, J. E. (2014). Best practices for remote psychological assessment via telehealth technologies. Professional Psychology: Research and Practice, 45(1), 27–35. doi: 10.1037/a0034547.CrossRefGoogle Scholar
  42. McEachern, W., Kirk, A., Morgan, D. G., Crossley, M., & Henry, C. (2008). Reliability of the MMSE administered in-person and by telehealth. Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques, 35(5), 643–646. doi: 10.1017/S0317167100009458.CrossRefPubMedGoogle Scholar
  43. Menon, A. S., Kondapavalru, P., Krishna, P., Chrismer, J. B., Raskin, A., Hebel, J. R., & Ruskin, P. E. (2001). Evaluation of a portable low cost videophone system in the assessment of depressive symptoms and cognitive function in elderly medically ill veterans. The Journal of Nervous and Mental Disease, 189(6), 399–401.CrossRefPubMedGoogle Scholar
  44. Montani, C., Billaud, N., Tyrrell, J., Fluchaire, I., Malterre, C., Lauvernay, N., et al. (1997). Psychological impact of a remote psychometric consultation with hospitalized elderly people. Journal of Telemedicine and Telecare, 3(3), 140–145. doi: 10.1258/1357633971931048.
  45. Parikh, M., Grosch, M. C., Graham, L. L., Hynan, L. S., Weiner, M., Shore, J. H., & Cullum, C. M. (2013). Consumer acceptability of brief videoconference-based neuropsychological assessment in older individuals with and without cognitive impairment. The Clinical Neuropsychologist, 27(5), 808–817. doi: 10.1080/13854046.2013.791723.CrossRefPubMedPubMedCentralGoogle Scholar
  46. Shores, M. M., Ryan-Dykes, P., Williams, R. M., Mamerto, B., Sadak, T., Pascualy, M., et al. (2004). Identifying undiagnosed dementia in residential care veterans: comparing telemedicine to in-person clinical examination. International Journal of Geriatric Psychiatry, 19(2), 101–108. doi: 10.1002/gps.1029.CrossRefPubMedGoogle Scholar
  47. Temple, V., Drummond, C., Valiquette, S., & Jozsvai, E. (2010). A comparison of intellectual assessments over video conferencing and in-person for individuals with ID: preliminary data. Journal of Intellectual Disability Research, 54(6), 573–577. doi: 10.1111/j.1365-2788.2010.01282.x.CrossRefPubMedGoogle Scholar
  48. Tensen, E., van der Heijden, J. P., Jaspers, M. W. M., & Witkamp, L. (2016). Two decades of teledermatology: current status and integration in national healthcare systems. Current Dermatology Reports, 5(2), 96–104. doi: 10.1007/s13671-016-0136-7.CrossRefPubMedPubMedCentralGoogle Scholar
  49. Turkstra, L. S., Quinn-Padron, M., Johnson, J. E., Workinger, M. S., & Antoniotti, N. (2012). In-person versus telehealth assessment of discourse ability in adults with traumatic brain injury. The Journal of Head Trauma Rehabilitation, 27(6), 424–432. doi: 10.1097/HTR.0b013e31823346fc.CrossRefPubMedPubMedCentralGoogle Scholar
  50. Turner, T. H., Horner, M. D., Vankirk, K. K., Myrick, H., & Tuerk, P. W. (2012). A pilot trial of neuropsychological evaluations conducted via telemedicine in the veterans health administration. Telemedicine Journal and E-Health: The Official Journal of the American Telemedicine Association, 18(9), 662–667. doi: 10.1089/tmj.2011.0272.CrossRefGoogle Scholar
  51. Vahia, I. V., Ng, B., Camacho, A., Cardenas, V., Cherner, M., Depp, C. A., et al. (2015). Telepsychiatry for neurocognitive testing in older rural Latino adults. The American Journal of Geriatric Psychiatry, 23(7), 666–670. doi: 10.1016/j.jagp.2014.08.006.CrossRefPubMedGoogle Scholar
  52. Vestal, L., Smith-Olinde, L., Hicks, G., Hutton, T., & Hart Jr., J. (2006). Efficacy of language assessment in Alzheimer’s disease: comparing in-person examination and telemedicine. Clinical Interventions in Aging, 1(4), 467.CrossRefPubMedPubMedCentralGoogle Scholar
  53. Wadsworth, H. E., Galusha-Glasscock, J. M., Womack, K. B., Quiceno, M., Weiner, M. F., Hynan, L. S., et al. (2016). Remote neuropsychological assessment in rural American Indians with and without cognitive impairment. Archives of Clinical Neuropsychology, acw030. doi: 10.1093/arclin/acw030.
  54. Wechsler, L. R. (2015). Advantages and limitations of teleneurology. JAMA Neurology, 72(3), 349–354. doi: 10.1001/jamaneurol.2014.3844.CrossRefPubMedGoogle Scholar
  55. Wennergren, J., Munshi, I., Fajardo, A. D., & George, V. V. (2014). Implementation of clinical video telemedicine (CVT) within a VA medical center is cost effective and well received by veterans. International Journal of Clinical Medicine, 5(12), 711–716. doi: 10.4236/ijcm.2014.512097.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York (outside the USA) 2017

Authors and Affiliations

  • Timothy W. Brearly
    • 1
    • 2
    • 3
  • Robert D. Shura
    • 1
    • 2
    • 3
  • Sarah L. Martindale
    • 1
    • 2
    • 3
  • Rory A. Lazowski
    • 4
  • David D. Luxton
    • 5
  • Brian V. Shenal
    • 6
    • 7
  • Jared A. Rowland
    • 1
    • 3
    • 8
    • 9
  1. 1.VA Mid-Atlantic Mental Illness Research, Education, and Clinical Centers (MIRECC)W. G. “Bill” Hefner Veterans Affairs Medical CenterSalisburyUSA
  2. 2.Mental Health and Behavioral Sciences Service LineW. G. “Bill” Hefner Veterans Affairs Medical CenterSalisburyUSA
  3. 3.Department of Psychiatry and Behavioral SciencesWake Forest School of MedicineWinston-SalemUSA
  4. 4.The College BoardYardleyUSA
  5. 5.Department of Psychiatry and Behavioral SciencesUniversity of Washington School of MedicineSeattleUSA
  6. 6.Mental Health Service LineSalem Veterans Affairs Medical CenterSalemUSA
  7. 7.Virginia Tech Carilion School of MedicineRoanokeUSA
  8. 8.Research and Education Service LineW. G. “Bill” Hefner Veterans Affairs Medical CenterSalisburyUSA
  9. 9.Department of Neurobiology and Anatomy, Wake Forest School of MedicineMedical Center BoulevardWinston-SalemUSA

Personalised recommendations