Low Cost Hand-Tracking Devices to Design Customized Medical Devices

  • Giorgio Colombo
  • Giancarlo Facoetti
  • Caterina Rizzi
  • Andrea Vitali
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9179)


This paper concerns the development of a Natural User Interface (NUI) for lower limb prosthesis design. The proposed solution exploits the Leap Motion device to emulate traditional design tasks manually performed by the prosthetist. We first illustrate why hand-tracking devices can be adopted to design socket of lower limb prosthesis using virtual prototyping tools. Then, we introduce the developed NUI and its features mainly with regards to ergonomics and ease of use. Finally, preliminary tests are illustrated as well as results reached so far.


Augmented interaction Hand-tracking devices SMA 


  1. 1.
    Bordegoni, M., Ferrise, F.: Designing interaction with consumer products in a multisensory virtual reality environment. Virtual Phy. Prototyp. 8(1), 51–64 (2013)CrossRefGoogle Scholar
  2. 2.
    Colombo, G., Facoetti, G., Morotti, R., Rizzi, C.: Physically based modelling and simulation to innovate socket design. Comput. Aided Des. Appl. 8(4), 617–631 (2011)Google Scholar
  3. 3.
    Colombo, G., Facoetti, G., Rizzi, C.: A digital patient for computer-aided prosthesis design. Interface Focus 3(2), 20120082 (2013)CrossRefGoogle Scholar
  4. 4.
    Colombo, G., Facoetti, G., Rizzi, C., Vitali, A.: Socket virtual design based on low cost hand tracking and haptic devices. In: Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry, pp. 63–70. ACM (2013)Google Scholar
  5. 5.
    Colombo, G., Facoetti, G., Rizzi, C., Vitali, A.: SimplyNURBS: a software library to model nurbs for medical applications. In: CAD 2014: International CAD Conference and Exhibition, Hong Kong (China), 23–26 June 2014. CAD Solution (2014)Google Scholar
  6. 6.
    Colombo, G., Facoetti, G., Rizzi, C., Vitali, A., Zanello, A.: Automatic 3D reconstruction of transfemoral residual limb from MRI images. In: Duffy, V.G. (ed.) HCII 2013 and DHM 2013, Part II. LNCS, vol. 8026, pp. 324–332. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  7. 7.
    Colombo, G., Rizzi, C., Facoetti, G., Vitali, A.: A preliminary study of new interaction devices to enhance virtual socket design. In: ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, p. V01BT02A036. American Society of Mechanical Engineers (2014)Google Scholar
  8. 8.
    Delimarschi, D., Swartzendruber, G., Kagdi, H.H.: Enabling integrated development environments with natural user interface interactions. In: ICPC, pp. 126–129 (2014)Google Scholar
  9. 9.
    Facoetti, G., Vitali, A., Colombo, G., Rizzi, C.: A low cost haptic mouse for prosthetic socket modeling. In: Duffy, V.G. (ed.) DHM 2014. LNCS, vol. 8529, pp. 508–515. Springer, Heidelberg (2014)Google Scholar
  10. 10.
    Fontana, M., Carubelli, A., Rizzi, C., Cugini, U.: Cloth assembler: a cad module for feature-based garment pattern assembly. Comput. Aided Des. Appl. 2(6), 795–804 (2005)Google Scholar
  11. 11.
    Hodson, H.: Leap motion hacks show potential of new gesture tech. New Sci. 218(2911), 21 (2013)CrossRefGoogle Scholar
  12. 12.
    Kaltenborn, K.F., Rienhoff, O.: Virtual reality in medicine. Methods Inf. Med. 32(5), 407–417 (1993)Google Scholar
  13. 13.
    Kaushik, M., Jain, R., et al.: Natural user interfaces: trend in virtual interaction. arXiv: 1405.0101 (2014)Google Scholar
  14. 14.
    Leap Motion Devices.
  15. 15.
    Meier, U., López, O., Monserrat, C., Juan, M.C., Alcaniz, M.: Real-time deformable models for surgery simulation: a survey. Comput. Methods Programs Biomed. 77(3), 183–197 (2005)CrossRefGoogle Scholar
  16. 16.
  17. 17.
    Oikonomidis, I., Kyriazis, N., Argyros, A.A.: Efficient model- based 3d tracking of hand articulations using kinect. In: BMVC, vol. 1, p. 3 (2011)Google Scholar
  18. 18.
    Qt Project (2013).
  19. 19.
  20. 20.
  21. 21.
    Wang, R.Y.,Popović, J.: Real-time hand-tracking with a color glove. ACM Trans. Graph. (TOG) 28(3), 63 (2009)Google Scholar
  22. 22.
    Wigdor, D., Wixon, D.: Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Elsevier, Amsterdam (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Giorgio Colombo
    • 1
  • Giancarlo Facoetti
    • 2
  • Caterina Rizzi
    • 2
  • Andrea Vitali
    • 2
  1. 1.Department of Mechanical EngineeringPolytechnic of MilanMilanItaly
  2. 2.Department of Management, Information and Production EngineeringUniversity of Bergamo (BG)DalmineItaly

Personalised recommendations