Skip to main content
SpringerLink
Log in

A Multi-Modal Haptic Interface for Virtual Reality and Robotics

  • Published:
Journal of Intelligent and Robotic Systems Aims and scope Submit manuscript

Abstract

In this paper we present an innovative haptic device that combines the electro-tactile stimulation with the force and visual feedbacks in order to improve the perception of a virtual world. We discuss the sensation evoked in a user by the haptic, force, and the visual interface as provided by this device, implemented as a special glove, equipped with sensors and actuators connected to a PC. The techniques used to recreate tactile and kinesthetic sensations are based on an innovative use of cutaneous stimulation integrated with actuators and 3D modelling techniques. We discuss about the specificity of haptic interfaces, their controllers, their open problems. We present results about generating the sensation of touching virtual objects with our device. Experiments show also that, using a multi-modal sensorial pattern of stimulation, the subject perceives more realistically the virtual object. We discuss the possible use of the same technique as a way to interface intelligent robots.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Heller Morton, A.: Tactile picture perception in sighted and blind people. Behav. Brain Res. 135(1–2), 65–68 (2002) September

    Article  Google Scholar 

  2. Asamura N., Tomori N., Shinoda H.: A tactile feeling display based on selective stimulation to skin receptors. In: Proc. IEEE Virtual Reality Annual International Symposium, Atlanta, 14–18 March 1998

  3. Caldwell D.G., Tsagarakis N., Giesler C.: Integrated tactile/shear feedback array for stimulation of finger mechanoreceptor. In: Proc. IEEE International Conference on Robotics and Automation, vol. 1, pp. 287–292. IEEE, Piscataway (1999)

  4. Yoshikawa T., Nagura A.: A touch force display system for haptic interface. Presence: Teleoperators and Virtual Environments 10(2), 225–235 (2001) April

    Article  Google Scholar 

  5. Kaczmarek, K.A., Webster, J.G.: Voltage-current characteristics of the electrotactile skin.electrode interface. In: IEEE Engineering in Medicine and Biology Society 11TH Annual International Conference. IEEE, Piscataway (1989)

  6. Kaczmarek, K.A., Haase, S.J.: Pattern identification as a function of stimulation current on a fingertip-scanned electrotactile display. IEEE Trans. Neural Syst. Rehabil. Eng. 11(3), 269–275 (2003) September

    Article  Google Scholar 

  7. Kajimoto H., Kawakami N., Tachi S., Inami M.: Smarttouch: electric skin to touch the untouchable. IEEE Comput. Graph. Appl. 24(1), 36–43 (2004) January–February

    Article  Google Scholar 

  8. Kajimoto, H., Kawakami, N., Maeda, T., Tachi, S.: Tactile feeling display using functional electrical stimulation. In: Proc. ICAT’99, Tokyo, December 1999

  9. Poletto, C.J., Van Doren, C.L.: A high voltage, constant current stimulator for electrocutaneous stimulation through small electrodes. IEEE Trans. Biomed. Eng. 46(8), 929–936 (1999) August

    Article  Google Scholar 

  10. Perez C.A., Holzmann C.A., Osorio M.E.: Optimization of the envelope of a short duty cycle pulse waveform for tactile stimulation. In: IEEE Proc. Engineering in Medicine and Biology Society 17th Annual Conference, vol. 2, pp. 1137–1138. IEEE, Piscataway, September 1995

  11. Salisbury, K.J.: Making graphics physically tangible. Commun. ACM 42(8), 75–81 (1999) August

    Article  Google Scholar 

  12. Ruspini, D., Khatib, O.: A framework for multi-contact multi-body dinamic simulation and haptic display. In: International Conference on Intelligent Robots and Systems, Takamatsu, October 2000

  13. Folgheraiter, M., Baragiola, I., Gini, G.: Teaching grasping to a humanoid hand as a generalization of human grasping data. Lect. Notes Comput. Sci. 3303, 139 (2004)

    Article  Google Scholar 

  14. Mark, W.R., Randolph, S.C., Finch, M., Van Verth, J.M., Taylor II, R.M.: Adding force feedback to graphics systems issues and solutions. In: Proceedings of SIGGRAPH 96, Computer Graphics Proceedings, Annual Conference Series, pp. 447–452. New Orleans, Louisiana, ACM SIGGRAPH. ISBN 0-201-94800-1. Addison Wesley, Redwood City, August 1996

  15. Adams, R.J., Hannaford, B.: Stable haptic interaction with virtual environments. IEEE Trans. Robot. Autom. 15(3), 465–474 (1999)

    Article  Google Scholar 

  16. Hannaford, B., Ryu, J.-H.: Time domain passivity control of haptic interfaces. IEEE Trans. Robot. Autom. 18, 1–10 (2002) February

    Article  Google Scholar 

  17. Johnson, K.O., Yoshioka, T., Vega-Bermudez, F.: Tactile functions of mechanoreceptive afferents innervating the hand. J. Clin. Neurophysiol. 17(6), 539–558 (2000) November

    Article  Google Scholar 

  18. Wheat, H.E., Salo, L.M., Goodwin, A.W.: Human ability to scale and discriminate forces typical of those occurring during grasp and manipulation. J. Neurosci. 24(13), 3394–3401 (2004) March

    Article  Google Scholar 

  19. Brisben, A.J., Hsiao, S.S., Johnson, K.O.: Detection of vibration transmitted through an object grasped in the hand. J. Neurophysiol. 81, 1548–1558 (1999) April

    Google Scholar 

  20. Collins, D.F., Prochazka, A.: Movement illusions evoked by ensemble cutaneous input from the dorsum of the human hand. J. Physiol. 496(3), 857–871 (1996)

    Google Scholar 

  21. Kaczmarek, K.A., Webster, J.G.: Voltage-current characteristics of the electrotactile skin-electrode interface. In: IEEE Proceeding Annual International Conference Eng. Med. Biol. Soc., 11. IEEE, Piscataway (1989)

  22. Hudson, T., Lin, M., Cohen, J., Gottschalk, S., Manocha, D.: V-collide: accelerated collision detection for vrml. In: Proc. of VRML ’97 (1997)

  23. Kaczmarek, K.A.: Electrotactile adaptation on the abdomen: preliminary results. IEEE Trans. Rehabil. Eng. 8(4), 499–505 (2000) December

    Article  Google Scholar 

  24. Hahn, J.F.: Tactile adaptation. In: Kenshalo, D.R. (ed.) The Skin Senses. C.C. Thomas, Springfield (1968)

  25. Bach-Y-Rita, P., Tyler, M.E., Kaczmarek, K.A.: Seeing with the brain. Int. J. Hum.-Comput. Interact. 15(2), 285–295 (2003)

    Article  Google Scholar 

  26. Stevens, S.S.: Neural events and the psychophysical law. Science 170(962), 1043–1050 (1970) December

    Article  Google Scholar 

  27. Hodgkin, A.L., Huxley, A.F.: A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. 117(4), 500–544 (1952)

    Google Scholar 

  28. Kajimoto, H., Kawakami, N., Maeda, T., Tachi, S.: Tactile feeling display using functional electrical stimulation. In: Proc. ICAT’99, Tokyo, December 1999

Download references

Author information

Authors and Affiliations

  1. Dipartimento di Elettronica e Informazione (DEI), Politecnico di Milano (Technical University of Milan), Piazza Leonardo da Vinci 32, 1-20133, Milano, Italy

    Michele Folgheraiter, Giuseppina Gini & Dario Vercesi

Authors
  1. Michele Folgheraiter
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Giuseppina Gini
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dario Vercesi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Giuseppina Gini.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Folgheraiter, M., Gini, G. & Vercesi, D. A Multi-Modal Haptic Interface for Virtual Reality and Robotics. J Intell Robot Syst 52, 465–488 (2008). https://doi.org/10.1007/s10846-008-9226-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-008-9226-5

Keywords

Search

Navigation