Learning Manual Skills with Smart Wearables

  • Ekaterina KutafinaEmail author
  • Marko Jovanović
  • Klaus Kabino
  • Stephan M. Jonas


Intensive development of e-learning methods still struggles with domains where feedback on manual and physical skills is necessary, for example, crafts or physiotherapy movements. Most of such training is currently done exclusively through direct teacher-student interaction. The traditional approach minimizes the possibilities for remote learning, requires large time investments, and contributes to high costs of education. While human feedback remains very important, modern wearable sensors allow to transfer part of the workload to e-learning. In this chapter, we present an overview of available solutions with particular focus on wearable sensors. We argue that wearable devices have the ability to enable a new step in e-learning, not only allowing the acquisition of theoretical knowledge but also training of manual and physical skills.



The authors would like to express their gratitude to PD. Dr. Cord Spreckelsen for fruitful discussions on e-learning.

This work was partially funded by the German Federal Ministry of Education and Research and the European Social Fund as part of the digital media in vocational education (DIMEBB2) initiative (funding number 01P15013).

This work was partially supported by the Faculty of Applied Mathematics AGH UST statutory tasks within subsidy of the Polish Ministry of Science and Higher Education.


  1. Adidas miCoach Smart Soccer Ball – White | adidas US. (n.d.). Retrieved December 29, 2017 from
  2. Aminoff, M. J. (Ed.). (2012). Aminoff’s electrodiagnosis in clinical neurology (6th ed.). Philadelphia: Elsevier Saunders. (OCLC: 934736824).Google Scholar
  3. Anupindi, R., Deshmukh, S. D., Chopra, S., Mieghem, J. V., & Zemel, E. (1999). Managing business process flows (1st ed.). Upper Saddle River: Prentice-Hall, Inc.Google Scholar
  4. Attwell, G. (2006). Evaluating e-learning: A guide to the evaluation of e-learning (Evaluate Europe handbook series, Vol. 2, pp. 1610–0875). Bremen: ITB, Bremen.Google Scholar
  5. Australian Master OHS and Environment Guide. (2007). CCH Australia Limited. (Google-Books-ID: TtIBIuVhXoYC).Google Scholar
  6. Baraldi, L., Paci, F., Serra, G., Benini, L., & Cucchiara, R. (2015). Gesture recognition using wearable vision sensors to enhance visitors’ Museum experiences. IEEE Sensors Journal, 1–1. Retrieved February 08, 2018, from,
  7. Biofeedback – About – Mayo Clinic. (n.d.). Retrieved February 12, 2018, from
  8. Bishop, C. (2006). Pattern recognition and machine learning. New York: Springer. Retrieved February 06, 2018, from //
  9. BlueTea. (n.d.). Retrieved January 15, 2018, from
  10. Chun, S., Kang, D., Choi, H.-R., Park, A., Lee, K.-K., & Kim, J. (2014). A sensor-aided self coaching model for uncocking improvement in golf swing. Multimedia Tools and Applications, 72(1), 253–279. Retrieved January 17, 2018, from Scholar
  11. Diamond Kinetics – Engineering Better Players. (n.d.). Retrieved December 29, 2017, from
  12. Dimitrios Ververidis. (n.d.). Hand simulation in WebGL with Myo interface. Retrieved February 14, 2018, from
  13. Ebner, M., & Spot, N. (2016). Game-based learning with the leap motion controller (pp. 555–565). Retrieved February 09, 2018, from
  14. Erasmus, V., Daha, T. J., Brug, H., Richardus, J. H., Behrendt, M. D., Vos, M. C., & Beeck, E. F. V. (2010). Systematic review of studies on compliance with hand hygiene guidelines in hospital care. Infection Control & Hospital Epidemiology, 31(3), 283–294. Retrieved February 06, 2018, from,
  15. Escobar-Castillejos, D., Noguez, J., Neri, L., Magana, A., & Benes, B. (2016). A review of simulators with haptic devices for medical training. Journal of Medical Systems, 40(4), 104. Retrieved February 06, 2018, from Scholar
  16. Frey, G., Lu, H., & Powers, J. (2005). Effect of mixing methods on mechanical properties of alginate impression materials. Journal of Prosthodontics, 14(4), 221–225. Retrieved January 29, 2018, from Scholar
  17. Grandjean, E., & Kroemer, K. H. E. (1997). Fitting the task to the human, fifth edition: A textbook of occupational ergonomics (5th ed.). London/Bristol: CRC Press.Google Scholar
  18. Gurusamy, K., Aggarwal, R., Palanivelu, L., & Davidson, B. R. (2008). Systematic review of randomized controlled trials on the effectiveness of virtual reality training for laparoscopic surgery. British Journal of Surgery, 95(9), 1088–1097. Retrieved January 29, 2018, from Scholar
  19. Hannig, A., Kuth, N., Özman, M., Jonas, S., & Spreckelsen, C. (2012). eMedOffice: A web-based collaborative serious game for teaching optimal design of a medical practice. BMC Medical Education, 12(1), 104. Retrieved April 29, 2015, from,
  20. Hannig, A., Lemos, M., Spreckelsen, C., Ohnesorge-Radtke, U., & Rafai, N. (2013). Skills-O-Mat: Computer supported interactive motion- and game-based training in mixing alginate in dental education. Retrieved May 24, 2017, from Scholar
  21. Higgins, A., & Hannan, M. M. (2013). Improved hand hygiene technique and compliance in healthcare workers using gaming technology. Journal of Hospital Infection, 84(1), 32–37. Retrieved January 15, 2018, from,
  22. Hindle, K. B., Whitcomb, T. J., Briggs, W. O., & Hong, J. (2012). Proprioceptive neuromuscular facilitation (PNF): Its mechanisms and effects on range of motion and muscular function. Journal of Human Kinetics, 31, 105–113. Retrieved January 23, 2018, from,
  23. Hu, X., & Nenov, V. (2004). Multivariate AR modeling of electromyography for the classification of upper arm movements. Clinical Neurophysiology, 115(6), 1276–1287. CrossRefGoogle Scholar
  24. iMotions: Biometric research, simplified. (n.d.). Retrieved January 23, 2018, from
  25. Jovanović, M., Seiffarth, J., Kutafina, E., & Jonas, S. M. (2018). Automated error detection in physiotherapy training. Studies in Health Technology and Informatics, 248, 164–171. Scholar
  26. Kovacs, G. (1997). Procedural skills in medicine: Linking theory to practice. Journal of Emergency Medicine, 15(3), 387–391.CrossRefGoogle Scholar
  27. Kutafina, E., Laukamp, D., Bettermann, R., Schroeder, U., & Jonas, S. M. (2016). Wearable sensors for eLearning of manual tasks: Using forearm EMG in hand hygiene training. Sensors, 16(8), 1221. Retrieved December 29, 2017, from,
  28. Lopes, P., You, S., Cheng, L.-P., Marwecki, S., & Baudisch, P. (2017). Providing haptics to walls & heavy objects in virtual reality by means of electrical muscle stimulation (pp. 1471–1482). ACM Press. Retrieved January 24, 2018, from,
  29. McAtamney, L., & Nigel Corlett, E. (1993). RULA: A survey method for the investigation of work-related upper limb disorders. Applied Ergonomics, 24(2), 91–99.CrossRefGoogle Scholar
  30. McDaniel, T. F., Kramer, R. T., Im, F., & Snow, D. (2013). Effects of mixing technique on bubble formation in alginate impression material. General Dentistry, 61(6), 35–39.Google Scholar
  31. McGorry, R., Young, S. L., Murphy, P., & Brogmus, G. (2000). Experimental appraisal of a manual task evaluator. International Journal of Industrial Ergonomics, 25(3), 265–274. Retrieved February 07, 2018, from,
  32. Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: A meta-analysis. Computers & Education, 70, 29–40. Retrieved January 29, 2018, from,
  33. Murphy, P., McGorry, R., Teare, P., & Brogmus, G. (2000). Design and performance of a manual task evaluator. International Journal of Industrial Ergonomics, 25(3), 257–264. Retrieved January 29, 2018, from,
  34. Myo Gesture Control Armband. (n.d.). Retrieved December 29, 2017, from
  35. Nazir, S., Kluge, A., & Manca, D. (2014). Can immersive virtual environments make the difference in training industrial operators? In Proceedings of the Human Factors and Ergonomics Society Europe Chapter 2013 Annual Conference (pp. 251–265).Google Scholar
  36. Neto, L. B., Grijalva, F., Maike, V. R. M. L., Martini, L. C., Florencio, D., Baranauskas, M. C. C., …Goldenstein, S. (2017). A kinect-based wearable face recognition system to aid visually impaired users. IEEE Transactions on Human-Machine Systems, 47(1), 52–64.
  37. NormaTec Recovery. (n.d.). Retrieved January 24, 2018, from
  38. Pacchierotti, C., Sinclair, S., Solazzi, M., Frisoli, A., Hayward, V., & Prattichizzo, D. (2017). Wearable haptic systems for the fingertip and the hand: Taxonomy, review, and perspectives. IEEE Transactions on Haptics, 10(4), 580–600. Scholar
  39. Patel, S., Park, H., Bonato, P., Chan, L., & Rodgers, M. (2012). A review of wearable sensors and systems with application in rehabilitation. Journal of NeuroEngineering and Rehabilitation, 9, 21. Retrieved January 15, 2018, from,
  40. Peters, J. R. (2007). Machine learning of motor skills for robotics. (Ph.D. Thesis), University of Southern California.Google Scholar
  41. Pfeiffer, M., & Rohs, M. (2017). Haptic feedback for wearables and textiles based on electrical muscle stimulation. In Smart textiles (pp. 103–137). Cham: Springer. Retrieved January 24, 2018, from Scholar
  42. Powerdot Smart Electric Muscle Stimulator. (n.d.). Retrieved February 06, 2018, from
  43. Rabiner, L. R. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2), 257–286. Scholar
  44. RAPAEL Smart Glove | NEOFECT. (n.d.). Retrieved February 12, 2018, from
  45. Roussos, M. (1997). Issues in the design and evaluation of a virtual reality learning environment. Unpublished master’s thesis, University of Illinois at Chicago.Google Scholar
  46. Saha, S. (2013). Gesture recognition from dance video for e-learning application. Unpublished master’s thesis.Google Scholar
  47. Shin, J.-H., Kim, M.-Y., Lee, J.-Y., Jeon, Y.-J., Kim, S., Lee, S., …Choi, Y. (2016). Effects of virtual reality-based rehabilitation on distal upper extremity function and health-related quality of life: A single-blinded, randomized controlled trial. Journal of NeuroEngineering and Rehabilitation, 13, 17. Retrieved February 05, 2018, from
  48. Valedo®Motion. (n.d.). Retrieved January 15, 2018, from
  49. Ververidis, D., Karavarsamis, S., Nikolopoulos, S., & Kompatsiaris, I. (2016). Pottery gestures style comparison by exploiting Myo sensor and forearm anatomy. In Proceedings of the 3rd International Symposium on Movement and Computing (pp. 3:1–3:8). New York: ACM. Retrieved February 06, 2018, from
  50. Vignais, N., Miezal, M., Bleser, G., Mura, K., Gorecky, D., & Marin, F. (2013). Innovative system for real-time ergonomic feedback in industrial manufacturing. Applied Ergonomics, 44(4), 566–574. Retrieved December 27, 2017, from,
  51. Wearable Sensors 2018–2028: Technologies, Markets & Players. (2017). Retrieved December 27, 2017, from
  52. WHO Guidelines on Hand Hygiene in Health Care: First Global Patient Safety Challenge Clean Care Is Safer Care. (2009). Geneva: World Health Organization. Retrieved February 06, 2018, from
  53. Yeh, C.-W., Pan, T.-Y., & Hu, M.-C. (2017). A sensor-based official basketball referee signals recognition system using deep belief networks. In MultiMedia modeling (pp. 565–575). Cham: Springer. Retrieved January 17, 2018, from$4_4$6.CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Ekaterina Kutafina
    • 1
    • 2
    Email author
  • Marko Jovanović
    • 3
  • Klaus Kabino
    • 3
  • Stephan M. Jonas
    • 4
  1. 1.Department of Medical InformaticsUniklinik RWTH AachenAachenGermany
  2. 2.Faculty of Applied MathematicsAGH University of Science and TechnologyKrakowPoland
  3. 3.Department of Medical InformaticsUniklinik RWTH AachenAachenGermany
  4. 4.Department of InformaticsTechnical University of MunichMünchenGermany

Personalised recommendations