Abstract
Individuals with acquired brain injury (ABI) commonly present with impairments in cognitive abilities. As these competencies seem to be predictive of patients’ abilities to reintegrate into the everyday settings, it is crucial to assess them properly. However, previous research has indicated that patients may perform relatively well on standard tests of cognitive functioning, but may nonetheless encounter significant difficulties in organizing and executing everyday tasks. In order to overcome this issue, virtual reality (VR) methods have been introduced in clinical practice with the aim of creating assessments that simulate real-world activities and thus, provide a clearer picture of patients’ functioning in everyday settings. This review offers an overview of VR assessment tools described in the scientific literature between 2010 and 2019. Overall, 38 relevant records describing 31 different tools were found. Among these tools, 16 assessed executive functions and prospective memory, while the other 15 assessed visuo-spatial abilities. Although promising results have been reported, our analysis indicated that about half of the tools deliver tasks that differ from everyday activities, thus limiting the generalizability of patients’ performance to the real-world. Moreover, a variety of methodological shortfalls related to study Internal and External Validity have been highlighted, which hamper the possibility of drawing definite recommendations on tool choice. These limitations suggest the importance of putting considerable efforts into the improvement or development of VR tools for patients with ABI for both research and clinical purposes, considering the great potential of this form of assessment.
Similar content being viewed by others
Data Availability
The data reported in the manuscript will be made available upon reasonable request to the corresponding author.
Notes
Hedges'g was calculated by authors of this review based on means and standard deviations of measures reported in the original article. If only errors of the mean (SE) were provided, SD were calculated by applying the following formula SD = SE × √n.
References
Adams, R., Finn, P., Moes, E., Flannery, K., & Rizzo, A. S. (2009). Distractibility in attention/deficit/hyperactivity disorder (ADHD): The virtual reality classroom. Child Neuropsychology, 15(2), 120–135. https://doi.org/10.1080/09297040802169077
Abedi, A., Mokkink, L. B., Zadegan, S. A., Paholpak, P., Tamai, K., Wang, J. C., & Buser, Z. (2019). Reliability and validity of the AOSpine Thoracolumbar injury classification system: A systematic review. Global Spine Journal, 9(2), 231–242. https://doi.org/10.1177/2192568218806847
Alcantara, J., Ohm, J., & Alcantara, J. (2017). Comparison of pediatric self reports and parent proxy reports utilizing PROMIS?: Results from a chiropractic practice-based research network. Complementary Therapies in Clinical Practice, 29, 48–52. https://doi.org/10.1016/j.ctcp.2017.08.003
Alderman, N., Burgess, P. W., Knight, C., & Henman, C. (2003). Ecological validity of a simplified version of the multiple errands shopping test. Journal of the International Neuropsychological Society, 9(1), 31–44. https://doi.org/10.1017/s1355617703910046
Andrade, C. (2018). Internal, external, and ecological validity in research design, conduct, and evaluation. Indian Journal of Psychological Medicine, 40(5), 498–499. https://doi.org/10.4103/IJPSYM.IJPSYM_334_18
Arrazola, A., Begiristain, J. M., & Mar, J. (2005). Hospital care of cerebrovascular accident and the state of patients 12 months after. Revista de neurologia, 40(6), 326–330.
Arvind Pala, P., N’Kaoua, B., Mazaux, J.-M., Simion, A., Lozes, S., Sorita, E., et al. (2014). Everyday-like memory and its cognitive correlates in healthy older adults and in young patients with traumatic brain injury: A pilot study based on virtual reality. Disability and Rehabilitation: Assistive Technology, 9(6), 463–473. https://doi.org/10.3109/17483107.2014.941952
Baker, E. K., Kurtz, M., & Astur, R. S. (2006). Virtual reality assessment of medication compliance in patients with schizophrenia. Cyberpsychology & Behavior, 9, 224–229. https://doi.org/10.1089/cpb.2006.9.224
Banville, F., & Nolin, P. (2012). Using Virtual reality to assess prospective memory and executive functions after traumatic brain injury. Journal of Cybertherapy & Rehabilitation, 5(1), 45–56.
Banville, F., Nolin, P., Lalonde, S., Henry, M., Dery, M.-P., & Villemure, R. (2010). Multitasking and prospective memory: Can virtual reality be useful for diagnosis? Behavioural Neurology, 23, 209–211. https://doi.org/10.3233/BEN-2010-0297
Banville, F., Nolin, P., Rosinvil, T., Verhulst, E., & Allain, P. (2019). Assessment and rehabilitation after traumatic brain injury using virtual reality: A systematic review and discussion concerning human-computer interaction. In A. Rizzo & S. Bouchard (Eds.), Virtual Reality for Psychological and Neurocognitive Interventions (pag (pp. 327–360). Springer.
Baum, C. M., Connor, L. T., Morrison, T., Hahn, M., Dromerick, A. W., & Edwards, D. F. (2008). Reliability, validity, and clinical utility of the executive function performance test: A measure of executive function in a sample of people with stroke. American Journal of Occupational Therapy, 62, 446–455. https://doi.org/10.5014/ajot.62.4.446
Baum, C. M., Morrison, T., Hahn, M., & Edwards, D. F. (2003). Test manual: Executive Function Performance Test. Washington University.
Benedictus, M. R., Spikman, J. M., & Van der Naalt, J. (2010). Cognitive and behavioral impairment in traumatic brain injury related to outcome and return to work. Archives of Physical Medicine and Rehabilitation, 91(9), 1436–1441. https://doi.org/10.1016/j.apmr.2010.06.019
Besnard, J., Richard, P., Banville, F., Nolin, P., Aubin, G., Le Gall, D., et al. (2016). Virtual reality and neuropsychological assessment: The reliability of a virtual kitchen to assess daily-life activities in victims of traumatic brain injury. Applied Neuropsychology: Adult, 23(3), 223–235. https://doi.org/10.1080/23279095.2015.1048514
Birckhead, B., Khalil, C., Liu, X., Conovitz, S., Rizzo, A., Danovitch, I., et al. (2019). Recommendations for methodology of virtual reality clinical trialsin health care by an international working group: Iterative study. JMIR Mental Health, 6(1), e11973. https://doi.org/10.2196/11973
Bivona, U., DʼIppolito, M., Giustini, M., Vignally, P., Longo, E., Taggi, F., , et al. (2012). Return to driving after severe traumatic brain injury: increased risk of traffic accidents and personal responsibility. Journal of Head Trauma Rehabilitation, 27(3), 210–215. https://doi.org/10.1097/HTR.0b013e31822178a9
Bottari, C., Lamothe, M. P., Gosselin, N., Gélinas, I., & Ptito, A. (2012). Driving difficulties and adaptive strategies: the perception of individuals having sustained a mild traumatic brain injury. Rehabilitation Research and Practice. https://doi.org/10.1155/2012/837301
Bouchard, S., Coté, S., & Richard, S.C.D. (2007). Virtual reality applications for exposure. In D.C.S. Richard and D. Lauterbach (eds), Handbook of Exposures Therapy 16, 347–388.
Bouchard, S., Loranger, C., Giroux, I., Jacques, C., & Robillard, G. (2014). Using virtual reality to provide a naturalistic setting for the treatment of pathological gambling. In C. S. Lányi (Ed.), The Thousand Faces of Virtual Reality (Chapter 1). IntechOpen. https://doi.org/10.5772/59240
Bowen, D. J., Kreuter, M., Spring, B., Cofta-Woerpel, L., Linnan, L., Weiner, D., et al. (2009). How we design feasibility studies. American Journal of Preventive Medicine, 36, 452–557. https://doi.org/10.1016/j.amepre.2009.02.002
Brouwer, W. H., Withaar, F. K., Tant, M. L. M., & van Zomeren, A. H. (2002). Attention and driving in traumatic brain injury: A question of coping with time-pressure. The Journal of Head Trauma Rehabilitation, 17(1), 1–15. https://doi.org/10.1097/00001199-200202000-00003
Brown, A. W., Elovic, E. P., Kothari, S., Flanagan, S. R., & Kwasnica, C. (2008). Congenital and acquired brain injury. 1. Epidemiology, pathophysiology, prognostication, innovative treatments, and prevention. Archives of Physical Medicine and Rehabilitation, 89(3), 3–8. https://doi.org/10.1016/j.apmr.2007.12.001
Brunswik, E. (1956). Perception and the representative design of psychological experiments (2nd ed.). University of California Press.
Brysbaert, M. (2019). How many participants do we have to include in properly powered experiments? A tutorial of power analysis with reference tables. Journal of Cognition, 2(1), 16. https://doi.org/10.5334/joc.72
Buccellato, K., Nordsrtom, M., Murphy, J. M., Burdea, G. C., Polistico, K., House, G., et al. (2019). A randomized feasibility trial of a novel, integrative, and intensive virtual rehabilitation program for service members post-acquired brain injury. Military medicine, 185(1–2), 203–211. https://doi.org/10.1093/milmed/usz150
Burgess, P. W., Alderman, N., Forbes, C., Costello, A., Coates, L.M.-A., Dawson, D. R., et al. (2006). The case for the development and use of “ecologically valid” measures of executive function in experimental and clinical neuropsychology. Journal of the International Neuropsychological Society, 12, 194–209. https://doi.org/10.1017/S1355617706060310
Buxbaum, L. J., Dawson, A. M., & Linsley, D. (2012). Reliability and validity of the virtual reality lateralized attention test in assessing hemispatial neglect in right-hemisphere stroke. Neuropsychology, 26(4), 430–441. https://doi.org/10.1037/a0028674
Buxbaum, L. J., Palermo, M. A., Mastrogiovanni, D., Read, M. S., Rosenberg-Pitonyak, E., Rizzo, A. A., & Coslett, H. B. (2008). Assessment of spatial attention and neglect with a virtual wheelchair navigationtask. Journal of Clinical and Experimental Neuropsychology, 30, 650–660. https://doi.org/10.1080/13803390701625821
Calamia, M., Markon, K., & Tranel, D. (2013). The robust reliability of neuropsychological measures: Meta-analyses of test-retest correlations. The clinical Neuropsychologist, 27(7), 1077–1105. https://doi.org/10.1080/13854046.2013.809795
Canty, A. L., Fleming, J., Patterson, F., Green, H. J., Man, D., & Shum, D. H. K. (2014). Evaluation of a virtual reality prospective memory task for use with individuals with severe traumatic brain injury. Neuropsychological Rehabilitation: An International Journal, 24(2), 238–265. https://doi.org/10.1080/09602011.2014.881746
Carelli, L., Rusconi, M. L., Scarabelli, C., Stampatori, C., Mattioli, F., & Riva, G. (2011). The transfer from survey (map-like) to route representations into Virtual Reality Mazes: Effect of age and cerebral lesion. Journal of NeuroEngineering and Rehabilitation, 8(6). https://doi.org/10.1186/1743-0003-8-6
Chaytor, N., & Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology Review, 13(4), 181–197. https://doi.org/10.1023/B:NERV.0000009483.91468.fb
Chaytor, N., Schmitter-Edgecombe, M., & Burr, R. (2006). Improving the ecological validity of executive functioning assessment. Archives of Clinical Neuropsychology, 21(3), 217–227. https://doi.org/10.1016/j.acn.2005.12.002
Chevignard, M., Pillon, B., Pradat-Diehl, P., Taillefer, C., Rousseau, S., Le Bras, C., et al. (2000). An ecological approach to planning dysfunction: Script execution. Cortex, 36, 649–669. https://doi.org/10.1016/s0010-9452(08)70543-4
Chevignard, M., Soo, C., Galvin, J., Catroppa, C., & Eren, S. (2012). Ecological assessment of cognitive functions in children with acquired brain injury: A systematic review. Brain Injury, 26(9), 1033–1057. https://doi.org/10.3109/02699052.2012.666366
Chin, C. L., & Yao G. (2014). Convergent Validity. In: A.C. Michalos (Ed.), Encyclopedia of Quality of Life and Well-Being Research. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-0753-5_573
Cicerone, K. D., Dahlberg, C., Kalmar, K., Langenbahn, D. M., Malec, J. F., Bergquist, T. F., et al. (2000). Evidence-based cognitive rehabilitation: Recommendations for clinical practice. Archives of Physical Medicine and Rehabilitation, 81, 1596–1615. https://doi.org/10.1053/apmr.2000.19240
Classen, S., Levy, C., Meyer, D. L., Bewernitz, M., Lanford, D. N., & Mann, W. C. (2011). Simulated driving performance of combat veterans with mild traumatic brain injury and posttraumatic stress disorder: A pilot study. American Journal of Occupational Therapy, 65, 419–427. https://doi.org/10.5014/ajot.2011.000893
Claessen, M. H. G., van der Ham, I. J. M., Jagersma, E., & Visser-Meily, J. M. A. (2015). Navigation strategy training using virtual reality in six chronic stroke patients: A novel and explorative approach to the rehabilitation of navigation impairment. Neuropsychological Rehabilitation: An International Journal. https://doi.org/10.1080/09602011.2015.1045910
Clune-Ryberg, M., Blanco-Campal, A., Carton, S., Pender, N., O’brien, D., Phillips, et al. (2011). The contribution of retrospective memory, attention and executive functions to the prospective and retrospective components of prospective memory following TBI. Brain Injury, 25(9), 819–831. https://doi.org/10.3109/02699052.2011.589790
Cognè, M., Taillade, M., N’Kaoua, B., Tarruella, A., Klinger, E., Larrue, F., et al. (2017). The contribution of virtual reality to the diagnosis of spatial navigation disorders and to the study of the role of navigational aids: A systematic literature review. Annals of Physical and Rehabilitation Medicine, 60(3), 164–176. https://doi.org/10.1016/j.rehab.2015.12.004
Corti, C., Manfredi, V., Massimino, M., Bardoni, A., Borgatti, R., & Poggi, G. (2018a). Cognitive functioning of pediatric patients with brain tumor: an investigation of the role of gender. Child’s Nervous System, 34(12), 2415–2423. https://doi.org/10.1007/s00381-018-3982-8
Corti, C., Oldrati, V., Oprandi, C. M., Ferrari, E., Poggi, G., Borgatti, R., et al. (2019). Remote technology-based training programs for children with acquired brain Injury: A systematic review and a meta-analytic exploration. Behavioral neurology. https://doi.org/10.1155/2019/1346987
Corti, C., Poggi, G., Romaniello, R., Strazzer, S., Urgesi, C., Borgatti, R., et al. (2018b). Feasibility of a home-based computerized cognitive training for pediatric patients with congenital or acquired brain damage: An explorative study. PLoS ONE, 13(6), e0199001. https://doi.org/10.1371/journal.pone.0199001
Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957
Cuberos-Urbano, G., Caracuel, A., Vilar-López, R., Valls-Serrano, C., Bateman, A., & Verdejo-García, A. (2013). Ecological validity of the multiple errands test using predictive models of dysexecutive problems in everyday life. Journal of Clinical and Experimental Neuropsychology, 35(3), 329–336. https://doi.org/10.1080/13803395.2013.776011
de Freitas Cardoso, M. G., Faleiro, R. M., de Paula, J. J., Kummer, A., Caramelli, P., Teixeira, A. L. et al., (2019) Cognitive impairment following acute mild traumatic brain injury. Frontiers in Neurology. 10. https://doi.org/10.3389/fneur.2019.001982019.00198
de Frias, C., Dixon, R., & Strauss, E. (2006). Structure of four executive functioning tests in healthy older adults. Neuropsychology, 20(2), 206–214. https://doi.org/10.1037/0894-4105.20.2.206
Delis, D., Kramer, J., Kaplan, E., & Holdnack, J. (2004). Reliability and validity of the Delis-Kaplan executive function system: An update. Journal of the International Neuropsychological Society, 10(2), 301–303. https://doi.org/10.1017/S1355617704102191
Denmark, T., Fish, J., Jansari, A., Tailor, J., Ashkan, K., & Morris, R. (2017). Using Virtual Reality to investigate multitasking ability in individuals with frontal lobe lesions. Neuropsychological Rehabilitation. https://doi.org/10.1080/09602011.2017.1330695
Edwards, J., Vess, J., Reger, G., & Cernich, A. (2014). The use of virtual reality in the military’s assessment of service members with traumatic brain injury: Recent developments and emerging opportunities. Applied Neuropsychology: Adult, 21(3), 220–230. https://doi.org/10.1080/09084282.2013.796554
Emmanouel, A., Mouza, E., Kessels, R., & Fasotti, L. (2014). Validity of the dysexecutive questionnaire (DEX). Ratings by patients with brain injury and their therapists. Brain Injury, 28(12), 1581–1589. https://doi.org/10.3109/02699052.2014.942371
Eslinger, P. J., & Damasio, A. R. (1985). Severe disturbance of higher cognition after bilateral frontal lobe ablation: Patient EVR. Neurology, 35, 1731–1741. https://doi.org/10.1212/wnl.35.12.1731
Fietze, I., & Diefenbach, K. (2003). Healthy sleepers are rare: problems and success rates in establishing a control group for sleep studies. Neuropsychopharmacology, 28, 558–561. https://doi.org/10.1038/sj.npp.1300082
Fish, J., Wilson, B. A., & Manly, T. (2010). The assessment and rehabilitation of prospective memory problems in people with neurological disorders: A review. Neuropsychological Rehabilitation: An International Journal, 20(2), 161–179. https://doi.org/10.1080/09602010903126029
Fisk, G. D., Schneider, J. J., & Novack, T. A. (1998). Driving following traumatic brain injury: Prevalence, exposure, advice and evaluations. Brain Injury, 12(8), 683–695. https://doi.org/10.1080/026990598122241
Fong, K., Chow, K., Chan, B., Lam, K., Lee, J., Li, T., et al. (2010). Usability of a virtual reality environment simulating an automated teller machine for assessing and training persons with acquired brain injury. Journal of Neuro Engineering and Rehabilitation, 7(19). https://doi.org/10.1186/1743-0003-7-19
Fortin, S., Godbout, L., & Braun, C. M. (2003). Cognitive structure of executive deficits in frontally lesioned head trauma patients performing activities of daily living. Cortex, 39(2), 273–291. https://doi.org/10.1016/s0010-9452(08)70109-6
Freeman, D., Reeve, S., Robinson, A., Ehlers, A., Clark, D., Spanlang, B., et al. (2017). Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychological Medicine, 47, 2393–2400. https://doi.org/10.1017/S003329171700040X
Friston, K. (2013). Sample size and the fallacies of classical inference. NeuroImage, 81, 503–504. https://doi.org/10.1016/j.neuroimage.2013.02.057
Fritz, A., Scherndl, T., & Kuhberger, A. (2012). A comprehensive review of reporting practices in psychological journals - Are effect sizes really enough? Theory & Psychology, 23(1), 98–122. https://doi.org/10.1177/0959354312436870
García-Pérez, M. A. (2012). Statistical conclusion validity: some common threats and simple remedies. Frontiers in Psychology, 3, 325. https://doi.org/10.3389/fpsyg.2012.00325
Garcia-Ruiz, M. A., Edwards, A., Aquino-Santos, R., El-Seoud, S., & Vargas Martin, M. (2011). Desktop virtual reality applications for training personnel of small businesses. IGI Global. https://doi.org/10.4018/978-1-60960-100-3.ch311
Geraldo, A., Dores, A. R., Coelho, B., Ramião, E., Castro-Caldas, A., & Barbosa, F. (2018). Efficacy of ICT-Based neurocognitive rehabilitation programs for acquired brain injury. European Psychologist, 23(3), 250–264. https://doi.org/10.1027/1016-9040/a000319
Gilboa, Y., Jansari, A., Kerrouche, B., Uçak, E., Tiberghien, A., Benkhaled, O., et al. (2017). Assessment of executive functions in children and adolescents with acquired brain injury (ABI) using a novel complex multi-tasking computerised task: The Jansari assessment of executive functions for children (JEF-C©). Neuropsychological Rehabilitation, 29(9), 1359–1382. https://doi.org/10.1080/09602011.2017.1411819
Gilboa, Y., Kerrouche, B., Longaud-Vales, A., Kieffer, V., Tiberghien, A., Aligon, D., et al. (2015). Describing the attention profile of children and adolescents with acquired brain injury using the virtual classroom. Brain Injury, 29(13–14), 1691–1700. https://doi.org/10.3109/02699052.2015.1075148
Gilboa, Y., Rosenblum, S., Fattal-Valevski, A., Toledano-Alhadef, H., & Josman, N. (2011). Using a virtual classroom environment to describe the attention deficits profile of children with neurofibromatosis type 1. Research in Developmental Disabilities, 32(6), 2608–2613. https://doi.org/10.1016/j.ridd.2011.06.014
Gioia, G. A., & Isquith, P. K. (2004). Ecological assessment of executive function in traumatic brain injury. Developmental Neuropsychology, 25(1–2), 135–158. https://doi.org/10.1080/87565641.2004.9651925
Goodrich-Hunsaker, N. J., Livingstone, S. A., Skelton, R. W., & Hopkins, R. O. (2010). Spatial deficits in a virtual water maze in amnesic participants with hippocampal damage. Hippocampus, 20, 481–491. https://doi.org/10.1002/hipo.20651
Greenwald, B. D., Burnett, D. M., & Miller, M. A. (2003). Congenital and acquired brain injury. 1. Brain injury: epidemiology and pathophysiology. Archives of Physical Medicine and Rehabilitation. 84, 3 Suppl 1, 3–7. https://doi.org/10.1053/apmr.2003.50052
Grimes, D. A., & Schulz, K. F. (2005). Compared to what? Finding controls for case-control studies. Lancet, 365(9468), 1429–1433. https://doi.org/10.1016/S0140-6736(05)66379-9
Gwet, K. L. (2014). Intrarater Reliability. Wiley Encyclopedia of Clinical Trials. https://doi.org/10.1002/9781118445112.stat06882
Hadad, S., Fung, J., Weiss, P. L., Pérez, C., Mazer, B., Levin, M. F. et al. (2012). Rehabilitation tools along the reality continuum: From mock-up to virtual interactive shopping to a living lab. Conference paper. 9th Intl Conf. Disability, Virtual Reality and Associated Technologies. Accessed 12 Sep 2012.
Häggström, A., & Lund, M. L. (2008). The complexity of participation in daily life: A qualitative study of the experiences of persons with acquired brain injury. Journal of Rehabilitation Medicine, 40(2), 89–95. https://doi.org/10.2340/16501977-0138
Hall, K. M., Bushnik, T., Lakisic-Kazazic, B., Wright, J., & Cantagallo, A. (2001). Assessing traumatic brain injury outcome measures for long-term follow-up of community-based individuals. Archives of Physical Medicine and Rehabilitation, 82(3), 367–374. https://doi.org/10.1053/apmr.2001.21525
Hankey, G. J. (2005). Stroke treatment and prevention: An evidence-based approach (pp. 1–8). Cambridge University Press.
Hegarty, M., Montello, D. R., Richardson, A. E., Ishikawa, T., & Lovelace, K. (2006). Spatial abilities at different scales: Individual differences in aptitude-test performance and spatial-layout learning. Intelligence, 34, 151–176. https://doi.org/10.1016/j.intell.2005.09.005
Howie, S., & Gilardi, M. (2019). Virtual reality training: Observational assessment software. Conference paper. SICSA Demofest 2019. https://www.sicsa.ac.uk/events/sicsa-demofest-2019-bringing-research-to-life/ Published 4 Nov 2019.
Hubley, A. M. (2014). Discriminant Validity. In: A. C. Michalos (Ed.), Encyclopedia of Quality of Life and Well-Being Research. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-0753-5_751
Hugues, O., Fuchs, P., & Nannipieri, O. (2011). New augmented reality taxonomy: technologies and features of augmented environment. In: Furth B, editor. Handbook of Augmented Reality. New York: Springer; p. 47–63.
Hung, Y., Vetivelu, A., Hird, M. A., Yan, M., Tam, F., Graham, S. J., et al. (2014). Using fMRI virtual-reality technology to predict driving ability after brain damage: A preliminary report. Neuroscience Letters, 558, 41–46. https://doi.org/10.1016/j.neulet.2013.10.065
Imhoff, S., Lavallière, M., Teasdale, N., & Fait, P. (2016). Driving assessment and rehabilitation using a driving simulator in individuals with traumatic brain injury: A scoping review. NeuroRehabilitation, 39, 239–251. https://doi.org/10.3233/NRE-161354
Jansari, A. S., Devlin, A., Agnew, R., Akesson, K., Murphy, L., & Leadbetter, T. (2014). Ecological assessment of executive functions: A new virtual reality paradigm. Brain Impairment, 15(2), 71–87. https://doi.org/10.1017/BrImp.2014.14
Jaspers, M. E. H., van Haasterecht, L., van Zuijlen, P. P. M., & Mokkink, L. B. (2019). A systematic review on the quality of measurement techniques for the assessment of burn wound depth or healing potential. Burns, 45(2), 261–281. https://doi.org/10.1016/j.burns.2018.05.015
John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23(5), 524–532. https://doi.org/10.1177/0956797611430953
Josman, N., Kizony, R., Hof, E., Goldenberg, K., Weiss, P. L., & Klinger, E. (2014). Using the virtual action planning-supermarket for evaluating executive functions in people with stroke. Journal of Stroke and Cerebrovascular Diseases, 23(5), 879–887. https://doi.org/10.1016/j.jstrokecerebrovasdis.2013.07.013
Jourdan, C., Azouvi, P., Genêt, F., Selly, N., Josseran, L., & Schnitzler, A. (2018). Disability and health consequences of traumatic brain injury: National prevalence. Annals of Physical and Rehabilitation, 97(5), 323–331. https://doi.org/10.1097/PHM.0000000000000848
Jovanovski, D., Zakzanis, K., Campbell, Z., Erb, S., & Nussbaum, D. (2012a). Development of a novel, ecologically oriented virtual reality measure of executive function: The Multitasking in the City Test. Applied Neuropsychology, 19(3), 171–182. https://doi.org/10.1080/09084282.2011.643955
Jovanovski, D., Zakzanis, K., Ruttan, L., Campbell, Z., Erb, S., & Nussbaum, D. (2012b). Ecologically valid assessment of executive dysfunction using a novel virtual reality task in patients with acquired brain injury. Applied Neuropsychology, 19(3), 207–220. https://doi.org/10.1080/09084282.2011.643956
Kahani, M., Beadle, P. (1997). Comparing immersive and non-immersive virtual reality user interfaces for management of telecommunication networks. In A. Lazar, Saracco, R., & Stadler, R. (Eds.) Integrated Network Management V: Integrated management in a virtual world Proceedings of the Fifth IFIP/IEEE International Symposium on Integrated Network Management (pp.383–395). San Diego, California, U.S.A. https://doi.org/10.1007/978-0-387-35180-3
Kan, K. C., Subramaniam, P., Shahrizaila, N., Kamaruzzaman, S. B., Razali, R., & Ghazali, S. E. (2019). Validation of the Malay version of addenbrooke’s cognitive examination III in detecting mild cognitive impairment and dementia. Dementia and Geriatric Cognitive Disorders, 9, 66–76. https://doi.org/10.1159/000495107
Kanchan, A., Singh, A., Khan, N. A., Jahan, M., Raman, R., & Rao, T. S. S. (2018). Impact of neuropsychological rehabilitation on activities of daily living and community reintegration of patients with traumatic brain injury. Indian Journal Psychiatry, 60(1), 38–48. https://doi.org/10.4103/psychiatry.IndianJPsychiatry_118_17
Katz, N., Tadmor, I., Felzen, B., & Hartman-Maeir, A. (2007). The Behavioural Assessment of the Dysexecutive Syndrome (BADS) in schizophrenia and its relation to functional outcomes. Neuropsychological Rehabilitation, 17(2), 192–205.
Kennedy, R. S., Fowlkes, J. E., Berbaum, K. S., & Lilienthal, M. G. (1992). Use of a motion sickness history questionnaire for prediction of simulator sickness. Aviation, Space, and Environmental Medicine, 63, 588–593.
Kim, D. Y., Ku, J., Chang, W. H., Park, T. H., Lim, J. Y., Han, K., et al. (2010). Assessment of post-stroke extrapersonal neglect using a three-dimensional immersive virtual street crossing program. Acta Neurologica Scandinavica, 121(3), 171–177. https://doi.org/10.1111/j.1600-0404.2009.01194.x
Knight, C., Alderman, N., & Burgess, P. W. (2002). Development of a simplified version of the Multiple Errands Test for use in hospital settings. Neuropsychological Rehabilitation, 12, 231–255. https://doi.org/10.1080/09602010244000039
Kristensen, L. Q., Muren, M. A., Petersen, A. K., van Tulder, M. W., & Oestergaard, L. G. (2019). Measurement properties of performance-based instruments to assess mental function during activity and participation in traumatic brain injury: A systematic review. Scandinavian Journal of Occupational Therapy, 14, 1–16. https://doi.org/10.1080/11038128.2019.1689291
Kuhberger, A., Fritz, A., & Scherndl, T. (2014). Publication bias in psychology: A diagnosis based on the correlation between effect size and sample size. PLoS ONE, 9(9), e105825. https://doi.org/10.1371/journal.pone.0105825
Kurtz, M. M., Baker, E., Pearlson, G. D., & Astur, R. S. (2007). A virtual reality apartment as a measure of medication management skills in patients with schizophrenia: A pilot study. Schizophrenia Bulletin, 33, 1162–1170. https://doi.org/10.1093/schbul/sbl039
Lajeunesse, A., Potvin, M. J., Audy, J., Paradis, V., Giguère, J.-F., & Rouleau, I. (2019). Prospective memory assessment in acute mild traumatic brain injury. The Clinical Neuropsychologist. https://doi.org/10.1080/13854046.2019.1598500
Lalonde, G., Henry, M., Drouin-Germain, A., Nolin, P., & Beauchamp, M. H. (2013). Assessment of executive function in adolescence: A comparison of traditional and virtual reality tools. Journal of Neuroscience Methods, 219(1), 76–82. https://doi.org/10.1016/j.jneumeth.2013.07.005
Leon-Carrion, J., Dominguez-Morales, M. R., & Martin, J. M. (2005). Driving with cognitive deficits: Neurorehabilitation and legal measures are needed for driving again after severe traumatic brain injury. Brain Injury, 19(3), 213–219. https://doi.org/10.1080/02699050400017205
Levac, D., Colquhoun, H., & O’Brien, K. (2010). Scoping studies: Advancing the methodology. Implementation Science, 5, 69. https://doi.org/10.1186/1748-5908-5-69
Levy, C. E., Miller, D. M., Akande, C. A., Lok, B., Marsiske, M., & Halan, S. (2019). V-Mart, a Virtual Reality Grocery Store, a focus group study of a promising intervention for mild traumatic brain injury and posttraumatic stress disorder. American Journal of Physical Medicine & Rehabilitation, 98(3), 191–198. https://doi.org/10.1097/PHM.0000000000001041
Lo Priore, C., Castelnuovo, G., & Liccione, D. (2003). Experience with V-STORE: considerations on presence in virtual environments for effective neuropsychological rehabilitation of executive functions. Cyberpsychology & Behavior, 6, 281–287.
Ma, M., & Zheng, H. (2011). Virtual reality and serious games in healthcare. In: S. Brahnam & L. C. Jain (Eds.) Advanced Computational Intelligence Paradigms in Healthcare 6. Virtual Reality in Psychotherapy, Rehabilitation, and Assessment. Studies in Computational Intelligence (vol. 337). Berlin, Heidelberg: Springer.
Mar, J., Arrospide, A., Begiristain, J. M., Larrañaga, I., Elosegui, E., & Oliva-Moreno, J. (2011). The impact of acquired brain damage in terms of epidemiology, economics and loss in quality of life. BMC Neurology, 11, 46. https://doi.org/10.1186/1471-2377-11-46
Meißner, M., Pfeiffer, J., Pfeiffer, T., & Oppewal, H. (2019). Combining virtual reality and mobile eye tracking to provide a naturalistic experimental environment for shopper research. Journal of Business Research, 100, 445–458. https://doi.org/10.1016/j.jbusres.2017.09.028
Mesa-Gresa, P., Lozano, J. A., Llórens, R., Alcañiz, M., Navarro, M. D., & Noé, E. (2011). Clinical validation of a virtual environment test for safe street crossing in the assessment of acquired brain injury patients with and without neglect. In Campos, P., et al. (Eds.), Human-Computer Interaction – INTERACT 2011, Part 2: 13th IFIP TC 13 International Conference, Lisbon, Portugal, September 5–9, 2011, Proceedings, (part 2, pp. 44–51). New York Inc: Springer-Verlag. https://doi.org/10.1007/978-3-642-23771-3_4
Messmer Uccelli, M., Traversa, S., & Ponzio, M. (2016). A survey study comparing young adults with MS and healthy controls on self-esteem, self-efficacy, mood and quality of life. Journal of the Neurological Sciences, 368, 369–373. https://doi.org/10.1016/j.jns.2016.07.039
Milleville-Pennel, I., Pothier, J., Hoc, J.-M., & Mathé, J.-F. (2010). Consequences of cognitive impairments following traumatic brain injury: Pilot study on visual exploration while driving. Brain Injury, 24(4), 678–691. https://doi.org/10.3109/02699051003692159
Mokkink, L. B., Terwee, C. B., Knol, D. L., Stratford, P. W., Alonso, J., Patrick, D. L., et al. (2010a). The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: A clarification of its content. BMC Medical Research Methodology, 10(22). https://doi.org/10.1186/1471-2288-10-22
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., et al. (2010b). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology, 63, 737–745. https://doi.org/10.1016/j.jclinepi.2010.02.00
Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018). Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Medical Research Methodology, 18(143). https://doi.org/10.1186/s12874-018-0611-x
Navarro, M.-D., Lloréns, R., Noé, E., Ferri, J., & Alcañiz, M. (2013). Validation of a low-cost virtual reality system for training street-crossing. A comparative study in healthy, neglected and non-neglected stroke individuals. Neuropsychological Rehabilitation: An International Journal, 23(4), 597–618. https://doi.org/10.1080/09602011.2013.806269
Neguț, A., Matu, S. A., Sava, F. A., & David, D. (2016). Virtual reality measures in neuropsychological assessment: A meta-analytic review. The Clinical Neuropsychologist, 30, 165–184. https://doi.org/10.1080/13854046.2016.1144793
Nezami, E., & Butcher, J. N. (2000). Objective personality assessment. In Goldstein, G. & Hersen, M. (Eds.), Handbook of Psychological Assessment 3rd Edition. Pergamon.
Nielsen, L. M., Kirkegaard, H., Østergaard, L. G., Bovbjerg, K., Breinholt, K., & Maribo, T. (2016). Comparison of self-reported and performance-based measures of functional ability in elderly patients in an emergency department?: Implications for selection of clinical outcome measures. BMC Geriatrics, 16(1), 99. https://doi.org/10.1186/s12877-016-0376-1
Nilsson, N. C., Nordahl, R., & Serafin, S. (2016). Immersion revisited: A review of existing definitions of immersion and their relation to different theories of presence. Human Technology, 12, 108–134. https://doi.org/10.17011/ht/urn.201611174652
Nir-Hadad, S. Y., Weiss, P. L., Waizman, A., Schwartz, N., & Kizony, R. (2017). A virtual shopping task for the assessment of executive functions: Validity for people with stroke. Neuropsychological Rehabilitation, 27(5), 808–833. https://doi.org/10.1080/09602011.2015.1109523
Noë, A. (2004). Action in perception. MIT Press.
Nolin, P., Besnard, J., Allain, P., & Banville, F. (2019). Assessment and rehabilitation using virtual reality after stroke: A literature review. In A. Rizzo & S. Bouchard (Eds.), Virtual Reality for Psychological and Neurocognitive Interventions (pp. 307–326). Springer.
Okahashi, S., Mizumoto, H., Komae, A., Ueno, K., Yokoyama, M., Nagano, A., et al. (2014). An fNIRS-Based Study on prefrontal cortex activity during a Virtual Shopping Test with different task difficulties in brain-damaged patients. Journal of Behavioral and Brain Science, 4, 247–255. https://doi.org/10.4236/jbbs.2014.46026
Okahashi, S., Seki, K., Nagano, A., Luo, Z., Kojima, M., & Futaki, T. (2013). A virtual shopping test for realistic assessment of cognitive function. Journal of NeuroEngineering and Rehabilitation, 10(59). https://doi.org/10.1186/1743-0003-10-59
Oliveira, J., Gamito, P., Alghazzawi, D., Fardoun, H., Rosa, P., Sousa, T., et al. (2018). Performance on naturalistic virtual reality tasks depends on global cognitive functioning as assessed via traditional neurocognitive tests. Applied Neuropsychology: Adult, 25(6), 555–561. https://doi.org/10.1080/23279095.2017.1349661
Ovbiagele, B., & Nguyen-Huynh, M. N. (2011). Stroke epidemiology: Advancing our understanding of disease mechanism and therapy. Neurotherapeutics, 8, 319. https://doi.org/10.1007/s13311-011-0053-1
Parikh, R., Mathai, A., Parikh, S., Chandra Sekhar, G., & Thomas, R. (2008). Understanding and using sensitivity, specificity and predictive values. Indian journal of ophthalmology, 56(1), 45–50. https://doi.org/10.4103/0301-4738.37595
Park, M. O. (2019). Driving scene-based driving errors in brain injury patients and their relevance to cognitive-perceptual function and functional activity level. A cross-sectional study. Medicine. 98, 27(e16315). https://doi.org/10.1097/MD.0000000000016315
Parsons, T. D. (2015). Virtual reality for enhanced ecological validity and experimental control in the clinical, affective and social neurosciences. Frontiers in Human Neuroscience, 9, 660. https://doi.org/10.3389/fnhum.2015.00660
Parsons, T. D., Bowerly, T., Buckwalter, J. G., & Rizzo, A. A. (2007). A controlled clinical comparison of attention performance in children with ADHD in a virtual reality classroom compared to standard neuropsychological methods. Child Neuropsychology, 13(4), 363–381. https://doi.org/10.1080/13825580600943473
Parsons, T. D., Carlew, A. R., Magtoto, J., & Stonecipher, K. (2017a). The potential of function-led virtual environments for ecologically valid measures of executive function in experimental and clinical neuropsychology. Neuropsychological Rehabilitation, 27(5), 777–807. https://doi.org/10.1080/09602011.2015.1109524
Parsons, T. D., Gaggioli, A., & Riva, G. (2017b). Virtual Reality for Research in Social Neuroscience. Brain Sciences, 7(4), 42. https://doi.org/10.3390/brainsci7040042
Pedersen, P. M., Jorgesen, H. S., Nakayama, H., Raaschov, H. O., & Olsen, T. S. (1996). Orientation in the acute and chronic stroke patient: Impact on ADL and social activities. The Copenhagen Stroke Study. Archives of Physical Medicine and Rehabilitation, 77, 336–339. https://doi.org/10.1016/s0003-9993(96)90080-5
Peskine, A., Rosso, C., Box, N., Galland, A., Caron, E., Rautureau, G., et al. (2011). Virtual reality assessment for visuospatial neglect: importance of a dynamic task. Journal of Neurology, Neurosurgery, and Psychiatry, 82(12), 1407–1409. https://doi.org/10.1136/jnnp.2010.217513
Poncet, F., Swaine, B., Dutil, E., Chevignard, M., & Pradat-Diehl, P. (2017). How do assessments of activities of daily living address executive functions: A scoping review. Neuropsychological Rehabilitation, 27(5), 618–666. https://doi.org/10.1080/09602011.2016.1268171
Potvin, M.-J., Rouleau, I., Audy, J., Charbonneau, S., & Giguère, J.-F. (2011). Ecological prospective memory assessment in patients with traumatic brain injury. Brain Injury, 25(2), 192–205. https://doi.org/10.3109/02699052.2010.541896
Radianti, J., Majchrzak, T., Fromm, J., Wohlgenannt, I. (2020) A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Computers & Education. 147. https://doi.org/10.1016/j.compedu.2019.1037782019.103778
Rajendran, G., Law, A. S., Logie, R. H., van der Meulen, M., Fraser, D., & Corley, M. (2011). Investigating multitasking in high-functioning adolescents with autism spectrum disorders using the virtual errands task. Journal of Autism and Developmental Disorders, 41(11), 1445–1454. https://doi.org/10.1007/s10803-0101151-3
Rand, D., Basha-Abu Rukan, S., Weiss, P. L., & Katz, N. (2009). Validation of the Virtual MET as an assessment tool for executive functions. Neuropsychological Rehabilitation, 4, 583–602. https://doi.org/10.1080/09602010802469074
Rand, D., Katz, N., & Weiss, P. L. (2007). Evaluation of virtual shopping in the VMall: Comparison of post-stroke participants to healthy control groups. Disability and Rehabilitation, 29(22), 1710–1719. https://doi.org/10.1080/09638280601107450
Raspelli, S., Carelli, L., Morganti, F., Poletti, B., Corra, B., Silani, V., et al. (2010). Implementation of the Multiple Errands Test in a NeuroVR-supermarkets: A possible research. In B. K. Wiederhold, G. Riva, & S. Kim (Eds.), Annual Review of Cybertherapy and Telemedicine 2010. Washington DC: Ios Press.
Raspelli, S., Pallavicini, F., Carelli, L., Morganti, F., PedrolI, E., Cipresso, P., et al. (2013). Validating the Neuro VR-Based Virtual Version of the Multiple Errands Test: Preliminary results. Presence Teleoperators & Virtual Environments, 21(1), 31–42. https://doi.org/10.1162/PRES_a_00077
Raspelli, S., Pallavicini, F., Carelli, L., Morganti, F., Poletti, B., Corra, B., et al. (2011). Validation of a neuro virtual reality-based version of the Multiple Errands Test for the assessment of executive functions. In B.K. Wiederhold et al. (Eds.), Annual Review of Cybertherapy and Telemedicine. pp. 92–98. https://doi.org/10.3233/978-1-60750-766-6-92
Renison, B., Ponsford, J., Testa, R., & Jansari, A. S. (2008). The use of virtual reality in assessment of executive function following traumatic brain injury. Brain Impairment, 9(1), 47.
Renison, B., Ponsford, J., Testa, R., Richardson, B., & Brownfield, K. (2012). The ecological and construct validity of a newly developed measure of executive function: The Virtual Library Task. Journal of the International Neuropsychological Society, 18, 440–450. https://doi.org/10.1017/S1355617711001883
Ring, H., Feder, M., Schwartz, J., & Samuels, G. (1997). Functional measures of first-stroke rehabilitation inpatients: Usefulness of the functional independence measure total score with a clinical rationale. Archives of Physical Medicine and Rehabilitation, 78, 630–635. https://doi.org/10.1016/s0003-9993(97)90429-9
Rizzo, A., & Bouchard, S. (2019). Virtual Reality for Psychological and Neurocognitive Interventions. Springer.
Rizzo, A., Buckwalter, J. C., & Van der Zaag, C. (2002). Virtual environment applications in clinical neuropsychology. In K. Stanney (Ed.), The Handbook of Virtual Environments (pp. 1027–1064). Lawrence Erlbaum Associates Inc.
Rizzo, A., Schultheis, M., Kerns, K., & Mateer, C. (2004). Analysis of assets for virtual reality applications in neuropsychology. Neuropsychological Rehabilitation, 14, 207–239. https://doi.org/10.1080/09602010343000183
Schnitzler, A., Jourdan, C., Josseran, L., Azouvi, P., Jacob, L., & Genêt, F. (2019). Participation in work and leisure activities after stroke: A national study. Annals of Physical and Rehabilitation, 62(5), 351–355. https://doi.org/10.1016/j.rehab.2019.04.005
Schultheis, M. T., & Rizzo, A. A. (2001). The application of virtual reality technology in rehabilitation. Rehabilitation Psychology, 46, 296–311. https://doi.org/10.1037/0090-5550.46.3.296
Schulz, K. F., & Grimes, D. A. (2002). Case-control studies: Research in reverse. Lancet, 359(9304), 431–434. https://doi.org/10.1016/S0140-6736(02)07605-5
Shallice, T., & Burgess, P. W. (1991). Deficits in strategy application following frontal lobe damage in man. Brain, 114, 727–741. https://doi.org/10.1093/brain/114.2.727
Shen, J. H. Q., Shen, Q., Yu, H., Lai, J.-S., Beaumont, J. L., Zhang, Z., et al. (2014). Validation of an Alzheimer’s disease assessment battery in Asian participants with mild to moderate Alzheimer’s disease. American Journal of Neurodegenerative Disease, 3(3), 158–169.
Slater, M. (2009). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical transactions of the Royal Society of London Series B, Biological sciences, 364(1535), 3549–3557. https://doi.org/10.1098/rstb.2009.0138
Sorita, E., N’Kaoua, B., Larrue, F., Criquillon, J., Simion, A., Sauzéon, H., et al. (2013). Do patients with traumatic brain injury learn a route in the same way in real and virtual environments? Disability & Rehabilitation, 35(16), 1371–1379. https://doi.org/10.3109/09638288.2012.738761
Sweeney, S., Kersel, D., Morris, R. G., Manly, T., & Evans, J. J. (2010). The sensitivity of a virtual reality task to planning and prospective memory impairments: Group differences and the efficacy of periodic alerts on performance. Neuropsychological Rehabilitation: An International Journal, 20(2), 239–263. https://doi.org/10.1080/09602010903080531
Tate, R. L., Godbee, K., & Sigmundsdottir, L. (2013). A systematic review of assessment tools for adults used in traumatic brain injury research and their relationship to the ICF. NeuroRehabilitation, 32, 729–750. https://doi.org/10.3233/NRE-130898
Teel, E., Gay, M., Johnson, B., & Slobounov, S. (2016). Determining Sensitivity/specificity of virtual reality-based neuropsychological tool for detecting residual abnormalities following sport-related concussion. Neuropsychology, 30(4), 474–483.
Terwee, C. B., Mokkink, L. B., Knol, D. L., Ostelo, R. W., Bouter, L. M., & de Vet, H. C. (2012). Rating the methodological quality in systematic reviews of studies on measurement properties: A scoring system for the COSMIN checklist. Quality of Life Research, 21, 651–657. https://doi.org/10.1007/s11136-011-9960-1
van der Ham, I. J. M., Van Zandvoort, M. J. E., Meilinger, T., Bosch, S. E., Kant, N., & Postma, A. (2010). Spatial and temporal aspects of navigation in two neurological patients. NeuroReport, 21, 685–689. https://doi.org/10.1097/WNR.0b013e32833aea78
Van Velzen, J. M., van Bennekom, C. A. M., Edelaar, M. J. A., Sluiter, J. K., & Frings-Dresen, J. K. (2009). How many people return to work after acquired brain injury?: A systematic review. Brain Injury, 23(6), 473–488. https://doi.org/10.1080/02699050902970737
Wagenmakers, E.-J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14, 779–804. https://doi.org/10.3758/bf03194105
Wechsler, D. (1976). Manual for the Weschsler Intelligence Scale - Revised (WISC-R). Psychological Corporation.
Werner, P., Rabinowitz, S., Klinger, E., Korczyn, A. D., & Josman, N. (2009). Use of the virtual action planning supermarket for the diagnosis of mild cognitive impairment: a preliminary study. Dementia and Geriatric Cognitive Disorders, 27(4), 301–309. https://doi.org/10.1159/000204915
White, S. J., Burgess, P. W., & Hill, E. L. (2009). Impairments on “open-ended” executive function tests in autism. Autism Research, 2(3), 138–147. https://doi.org/10.1002/aur.78
Wise, E. K., Mathews-Dalton, C., Dikmen, S., Temkin, N., Machamer, J., Bell, K., & Powell, J. M. (2010). Impact of traumatic brain injury on participation in leisure activities. Archives of Physical Medicine and Rehabilitation, 91(9), 1357–1362. https://doi.org/10.1016/j.apmr.2010.06.009
Yip, B., & Man, D. (2013). Virtual reality-based prospective memory training program for people with acquired brain injury. NeuroRehabilitation, 32(1), 103–115. https://doi.org/10.3233/NRE-130827
Yuviler-Gavish, N., Rodríguez, J., Gutiérrez, T., Sánchez, E., & Casado, S. (2014). Improving the Efficiency of Virtual Reality Training by Integrating Partly Observational Learning. Journal of Interactive Learning Research, 25(4), 487–507.
Zanier, E. R., Zoerle, T., Di Lernia, D., & Riva, G. (2018). Virtual reality for traumatic brain injury. Frontiers in Neurology, 9, 345. https://doi.org/10.3389/fneur.2018.00345
Zagheri Tafreshi, M., & Yaghmaie, F. (2006). Factor analysis of construct validity: A review of nursing articles. Journal of Medical Education. 10(1). https://doi.org/10.22037/jme.v10i1.704
Zhang, Y., Chapman, A. M., Plested, M., Jackson, D., & Purroy, F. (2012). The incidence, prevalence, and mortality of stroke in France, Germany, Italy, Spain, the UK, and the US: A literature review. Stroke Research and Treatment. https://doi.org/10.1155/2012/436125
Zhu X. L., Poon W. S., Chan C. C., Chan S. S. (2007). Does intensive rehabilitation improve the functional outcome of patients with traumatic brain injury (TBI)? A randomized controlled trial. Brain Injury, 21(7), 681–90. https://doi.org/10.1080/02699050701468941
Acknowledgements
This study was supported by the Italian Ministry of Health (Ricerca Finalizzata NET-2013-02356160 to Romina Romaniello; Ricerca Corrente 2020 to Sandra Strazzer) and by the “5 per mille” funds 2018/2019 for biomedical research to Alessandra Bardoni.
Funding
This study was supported by the Italian Ministry of Health (Ricerca Finalizzata NET-2013-02356160 to Romina Romaniello; Ricerca Corrente 2020 to Sandra Strazzer) and by '5 per mille' funds 2018/2019 for biomedical research to Alessandra Bardoni.
Author information
Authors and Affiliations
Contributions
C.C. and M.C.O. performed the literature search and data analysis; C.C., M.C.O. and M.M. prepared tables; C.C., V.O. drafted the manuscript; M.C., A.J., A.B., S.S., R.R. and E.F. critically revised the work.
Corresponding author
Ethics declarations
Ethics Approval
Ethic Committee Approval was obtained by the Ethical Committee of Istituto Superiore di Sanità, Roma, Italy (Protocol PRE-190/17) on 14 March 2017 and by the Ethical Committee of Scientific Institute, IRCCS E. Medea, Bosisio Parini, Lecco, Italy (Protocol Number 17/18 – CE) on 16 February 2018 with respect to study 350 (Ricerca Finalizzata NET-2013-02356160). The study was performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Corti, C., Oprandi, M.C., Chevignard, M. et al. Virtual-Reality Performance-Based Assessment of Cognitive Functions in Adult Patients With Acquired Brain Injury: A Scoping Review. Neuropsychol Rev 32, 352–399 (2022). https://doi.org/10.1007/s11065-021-09498-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11065-021-09498-0