Design and Development of a Forearm Rehabilitation System Based on an Augmented Reality Serious Game

  • Vitoantonio Bevilacqua
  • Antonio Brunetti
  • Giuseppe Trigiante
  • Gianpaolo Francesco Trotta
  • Michele Fiorentino
  • Vito Manghisi
  • Antonio Emmanuele Uva
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 587)


In this paper, we propose a forearm rehabilitation system based on a serious game in Augmented Reality (AR). We designed and developed a simplified AR arcade brick breaking game to induce rehabilitation of the forearm muscles. We record the electromyographic signals using a low cost device to evaluate the applied force. We collected and analysed data in order to find a relationship between the applied force and the difficulty of the game. This research focuses on the de-hospitalization of subjects in the middle or final stages of their rehabilitation where the new technologies, like Virtual and Augmented Reality, may improve the experience of repetitive exercises.

The results achieved prove that the force applied by the user to hit the virtual sphere with real cardboard cube is related to sphere speed. In a rehabilitation scenario the results could be used to evaluate the improvements analysing the performance history.


Rehabilitation Virtual and Augmented Reality Brick serious games 


  1. 1.
    Goldstein, L.B., Bushnell, C.D., Adams, R.J., Appel, L.J., Braun, L.T., Chaturvedi, S., Creager, M.A., Culebras, A., Eckel, R.H., Hart, R.G., et al.: Guidelines for the primary prevention of stroke a guideline for healthcare professionals from the american heart association/american stroke association. Stroke 42(2), 517–584 (2011)CrossRefGoogle Scholar
  2. 2.
    James, R.: Patterson and Martin Grabois. Locked-in syndrome: a review of 139 cases. Stroke 17(4), 758–764 (1986)CrossRefGoogle Scholar
  3. 3.
    Reaz, M.B.I., Hussain, M.S., Mohd-Yasin, F.: Techniques of emg signal analysis: detection, processing, classification and applications. Biol. Proced. Online 8(1), 11–35 (2006)CrossRefGoogle Scholar
  4. 4.
    Nguyen, K.D., Chen, I., Luo, Z., Yeo, S.H., Duh, H.B.-L., et al.: A wearable sensing system for tracking and monitoring of functional arm movement. IEEE/ASME Trans. Mechatron. 16(2), 213–220 (2011)CrossRefGoogle Scholar
  5. 5.
    Yeh, S.-C., Lee, S.-H., Wang, J.-C., Chen, S., Chen, Y.-T., Yang, Y.-Y., Chen, H.-R., Hung, Y.-P.: Virtual reality for post-stroke shoulder-arm motor rehabilitation: Training system & assessment method. In: 2012 IEEE 14th International Conference on e-Health Networking, Applications and Services (Healthcom), pp. 190–195. IEEE (2012)Google Scholar
  6. 6.
    Loconsole, C., Stroppa, F., Bevilacqua, V., Frisoli, A.: A robust real-time 3D tracking approach for assisted object grasping. In: Auvray, M., Duriez, C. (eds.) EuroHaptics 2014, Part I. LNCS, vol. 8618, pp. 400–408. Springer, Heidelberg (2014)Google Scholar
  7. 7.
    Nef, T., Riener, R.: Armin-design of a novel arm rehabilitation robot. In: 9th International Conference on Rehabilitation Robotics, ICORR 2005, pp. 57–60. IEEE (2005)Google Scholar
  8. 8.
    Khademi, M., Hondori, H.M., Lopes, C.V., Dodakian, L., Cramer, S.C.: Haptic augmented reality to monitor human arm’s stiffness in rehabilitation. In: 2012 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES), pp. 892–895. IEEE (2012)Google Scholar
  9. 9.
    Hondori, H.M., Khademi, M., Dodakian, L., Cramer, S.C., Lopes, C.V.: A spatial augmented reality rehab system for post-stroke hand rehabilitation. In: MMVR, pp. 279–285 (2013)Google Scholar
  10. 10.
    Bevilacqua, V., Brunetti, A., de Biase, D., Tattoli, G., Santoro, R., Trotta, G.F., Cassano, F., Pantaleo, M., Mastronardi, G., Ivona, F., et al.: A p300 clustering of mild cognitive impairment patients stimulated in an immersive virtual reality scenario. In: Intelligent Computing Theories and Methodologies, pp. 226–236. Springer (2015)Google Scholar
  11. 11.
    Ricci, K., Delussi, M., Montemurno, A., Brunetti, A., de Biase, D., Tattoli, G., Trotta, G.F., Cassano, F., Santoro, R., Pantaleo, M., Mastronardi, G., Ivona, F., Bevilacqua, V., de Tommaso, M.: A p300 clustering of old patients stimulated in an immersive virtual reality scenario with oculus rift. Neuropsychological Trends (2015)Google Scholar
  12. 12.
    Fiorentino, M., Debernardis, S., Uva, A.E., Monno, G.: Augmented reality text style readability with see-through head-mounted displays in industrial context. Presence Teleoperators Virtual Environ. 22(2), 171–190 (2013)CrossRefGoogle Scholar
  13. 13.
    Debernardis, S., Fiorentino, M., Gattullo, M., Monno, G., Uva, A.E.: Text readability in head-worn displays: Color and style optimization in video versus optical see-through devices. IEEE Trans. Vis. Comput. Graph. 20(1), 125–139 (2014)CrossRefGoogle Scholar
  14. 14.
    Burke, J.W., McNeill, M.D.J., Charles, D.K., Morrow, P.J., Crosbie, J.H., McDonough, S.M.: Augmented reality games for upper-limb stroke rehabilitation. In: 2010 Second International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES), pp. 75–78. IEEE (2010)Google Scholar
  15. 15.
    Fiorentino, M., Uva, A.E., Monno, G., Radkowski, R.: Augmented technical drawings: a novel technique for natural interactive visualization of computer-aided design models. J. Comput. Inf. Sci. Eng. 12(2), 024503 (2012)CrossRefGoogle Scholar
  16. 16.
    Fiorentino, M., Monno, G., Uva, A.E.: Tangible digital master for product lifecycle management in augmented reality. Int. J. Interact. Des. Manufact. (IJIDeM) 3(2), 121–129 (2009)CrossRefGoogle Scholar
  17. 17.
  18. 18.
    Milner-Brown, H.S., Stein, R.B.: The relation between the surface electromyogram and muscular force. J. Physiol. 246(3), 549–569 (1975)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Vitoantonio Bevilacqua
    • 1
  • Antonio Brunetti
    • 1
  • Giuseppe Trigiante
    • 1
  • Gianpaolo Francesco Trotta
    • 1
  • Michele Fiorentino
    • 2
  • Vito Manghisi
    • 2
  • Antonio Emmanuele Uva
    • 2
  1. 1.Dipartimento di Ingegneria Elettrica e dell’InformazionePolitecnico di BariBariItaly
  2. 2.Dipartimento di Ingegneria Meccanica, Matematica e ManagementPolitecnico di BariBariItaly

Personalised recommendations