Immersive Mirror for Pain Control and Treatment
  • Francesco CarrinoEmail author
  • Omar Abou Khaled
  • Elena Mugellini
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10851)


We present an overview of IMPACT, a system that uses virtual and augmented reality to enhance the mirror therapy for the treatment of phantom limb pain and stroke rehabilitation. The system tracks users’ movements and the head position using a combination of depth cameras and inertial sensors. This information is then fused together in a 3D full-body human model able to adapt to the patient’s characteristics (e.g., skin color, limb size) and avoid unnatural movements due to possible bad tracking (e.g., a joint bended in an unnatural way). IMPACT includes three serious games that can be played in first-person point of view and that allow different levels of immersion according to the needs of the treatment.


Augmented reality Virtual reality Mirror therapy Phantom limb pain 



This research project was supported by the Hasler Stiftung and by the University of Applied Sciences Western Switzerland. In addition, the authors would like to thank Elisa Nannini, Vincent Brodard, Quentin Seydoux, Luc Francey, and Charlotte Junod for their contribution to develop the system and games.


  1. 1.
    Kooijman, C.M., Dijkstra, P.U., Geertzen, J.H.B., Elzinga, A., van der Schans, C.P.: Phantom pain and phantom sensations in upper limb amputees: an epidemiological study. Pain 87, 33–41 (2000)CrossRefGoogle Scholar
  2. 2.
    Tzionas, D., Vrenas, K., Eleftheriadis, S., Georgoulis, S., Petrantonakis, P., Hadjileontiadis, L.: Phantom limb pain management using facial expression analysis, biofeedback and augmented reality interfacing. In: Proceedings of the 3rd International Conference on Software Development for Enhancing Accessibility and Fighting Info-exclusion (DSAI 2010). UTAD & SAE Institute, Oxford, United Kingdom (2010)Google Scholar
  3. 3.
    McCabe, C.S., Haigh, R.C., Ring, E.F.J., Halligan, P.W., Wall, P.D., Blake, D.R.: A controlled pilot study of the utility of mirror visual feedback in the treatment of complex regional pain syndrome (type 1). Rheumatology 42, 97–101 (2003)CrossRefGoogle Scholar
  4. 4.
    Ramachandran, V.S., Rogers-Ramachandran, D.: Synaesthesia in phantom limbs induced with mirrors (1996)CrossRefGoogle Scholar
  5. 5.
    Ezendam, D., Bongers, R.M., Jannink, M.J.: Systematic review of the effectiveness of mirror therapy in upper extremity function. Disabil. Rehabil. 31, 2135–2149 (2009)CrossRefGoogle Scholar
  6. 6.
    Moseley, G.L.: Graded motor imagery is effective for long-standing complex regional pain syndrome: a randomised controlled trial. Pain 108, 192–198 (2004)CrossRefGoogle Scholar
  7. 7.
    Murray, C.D., Pettifer, S., Howard, T., Patchick, E.L., Caillette, F., Kulkarni, J., Bamford, C.: The treatment of phantom limb pain using immersive virtual reality: three case studies. Disabil. Rehabil. 29, 1465–1469 (2007)CrossRefGoogle Scholar
  8. 8.
    Rizzo, A. “Skip”, Kim, G.J.: A SWOT analysis of the field of virtual reality rehabilitation and therapy. Presence Teleoperators Virtual Environ. 14, 119–146 (2005)CrossRefGoogle Scholar
  9. 9.
    Shen, Y., Ong, S., Nee, A.: An augmented reality system for hand movement rehabilitation. In: Proceedings of the 2nd International Convention on Rehabilitation Engineering & Assistive Technology, pp. 189–192. Singapore Therapeutic, Assistive & Rehabilitative Technologies (START) Centre (2008)Google Scholar
  10. 10.
    Desmond, D.M., O’Neill, K., De Paor, A., McDarby, G., MacLachlan, M.: Augmenting the reality of phantom limbs: three case studies using an augmented mirror box procedure. JPO J. Prosthetics Orthot. 18, 74 (2006)CrossRefGoogle Scholar
  11. 11.
    Ortiz-Catalan, M., Sander, N., Kristoffersen, M.B., Håkansson, B., Brånemark, R.: Treatment of phantom limb pain (PLP) based on augmented reality and gaming controlled by myoelectric pattern recognition: A case study of a chronic PLP patient. Front. Neurosci. 8, 1–7 (2014)CrossRefGoogle Scholar
  12. 12.
    Ortiz-Catalan, M., Guðmundsdóttir, R.A., Kristoffersen, M.B., Zepeda-Echavarria, A., Caine-Winterberger, K., Kulbacka-Ortiz, K., Widehammar, C., Eriksson, K., Stockselius, A., Ragnö, C., Pihlar, Z., Burger, H., Hermansson, L.: Phantom motor execution facilitated by machine learning and augmented reality as treatment for phantom limb pain: a single group, clinical trial in patients with chronic intractable phantom limb pain. Lancet 388, 2885–2894 (2016)CrossRefGoogle Scholar
  13. 13.
    Gregory-Dean, A.: Amputations: statistics and trends. Ann. R. Coll. Surg. Engl. 73, 137–142 (1991)Google Scholar
  14. 14.
    Carrino, F., Rizzotti, D., Gheorghe, C., Kabasu Bakajika, P., Francescotti-Paquier, F., Mugellini, E.: Augmented reality treatment for phantom limb pain. In: Shumaker, R., Lackey, S. (eds.) VAMR 2014, Part II. LNCS, vol. 8526, pp. 248–257. Springer, Cham (2014). Scholar
  15. 15.
    Lewis, J.R., Sauro, J.: The factor structure of the system usability scale. In: Kurosu, M. (ed.) HCD 2009. LNCS, vol. 5619, pp. 94–103. Springer, Heidelberg (2009). Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Francesco Carrino
    • 1
    Email author
  • Omar Abou Khaled
    • 1
  • Elena Mugellini
    • 1
  1. 1.University of Applied Sciences and Arts Western SwitzerlandFribourgSwitzerland

Personalised recommendations