A Proof of Concept Integrated Multi-systems Approach for Large Scale Tactile Feedback in VR

  • Daniel BriceEmail author
  • Thomas McRobertsEmail author
  • Karen RaffertyEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11613)


It is well understood that multi-sensory stimulation can be used to enhance immersion in virtual environments such as Virtual Reality (VR) and Augmented Reality (AR). State of the art VR technologies have enhanced visual stimulation in aspects such as pixel density in recent years, whilst the area of haptics has remained less developed. The Ultrahaptics Evaluation Kit is a relatively new technology that consists of a \(16\times 16\) array of ultrasound transducers used to create ultrasound haptic sensations. We have developed a proof of concept large scale haptic system by integrating this device with an HTC VIVE, Leap Motion and Rethink Robotics’ Baxter Robot to provide ultrasound haptic feedback in a volume greater than 1.5 m\(^3\) for VR users. The system was evaluated through a user study with 19 participants. The study focused on users’ assessments of the location of the haptics produced by the system. The results of the study offer a means of validating the system, as well as providing comparisons in accuracy for a haptic perception task vs a visual perception task. There have been opportunities recognised for improving accuracy of the system. However, the system has been deemed suitable in creating haptic feedback for low fidelity models within large volumes in VR.


Haptics Ultrasound Virtual Reality Immersion System integration 


  1. 1.
    Blake, J., Gurocak, H.B.: Haptic glove with mr brakes for virtual reality. IEEE/ASME Trans. Mechatron. 14(5), 606–615 (2009). Scholar
  2. 2.
    Brice, D., Devine, S., Rafferty, K.: A novel force feedback haptics system with applications in phobia treatment (2017)Google Scholar
  3. 3.
    Carter, T., Seah, S., Long, B., Drinkwater, B., Subramanian, S.: Ultrahaptics: multi-point mid-air haptic feedback for touch surfaces. In: UIST 2013 Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST 2013. Association for Computing Machinery (ACM), October 2013.
  4. 4.
    Corbett-Davies, S., Dünser, A., Clark, A.: Interactive AR exposure therapy. In: Proceedings of the 13th International Conference of the NZ Chapter of the ACM’s Special Interest Group on Human-Computer Interaction, CHINZ 2012, p. 98. ACM, New York (2012).
  5. 5.
    Covarrubias, M., Bordegoni, M.: Immersive VR for natural interaction with a haptic interface for shape rendering. In: 2015 IEEE 1st International Forum on Research and Technologies for Society and Industry Leveraging a Better Tomorrow (RTSI), pp. 82–89, September 2015.
  6. 6.
    Cremer, S., Mastromoro, L., Popa, D.O.: On the performance of the Baxter research robot. In: 2016 IEEE International Symposium on Assembly and Manufacturing (ISAM), pp. 106–111, August 2016.
  7. 7.
    Dexmo: Dexmo (2008). Accessed 14 Feb 2018
  8. 8.
    Dunbar, B., et al.: Augmenting human spatial navigation via sensory substitution. In: 2017 IEEE MIT Undergraduate Research Technology Conference (URTC), pp. 1–4, November 2017.
  9. 9.
    Garage, W.: MoveIt (2008). Accessed 14 Feb 2018
  10. 10.
    Geomagic: Phantom Omni (2011). Accessed 14 Feb 2018
  11. 11.
    Guo, J., Guo, S.: A haptic interface design for a VR-based unskilled doctor training system in vascular interventional surgery. In: 2014 IEEE International Conference on Mechatronics and Automation, pp. 1259–1263, August 2014.
  12. 12.
    Han, P.H., et al.: OoEs: playing in the immersive game with augmented haptics. In: ACM SIGGRAPH 2016 VR Village, SIGGRAPH 2016, p. 15:1. ACM, New York (2016).
  13. 13.
    Hoshi, T., Takahashi, M., Iwamoto, T., Shinoda, H.: Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Trans. Haptics 3(3), 155–165 (2010). Scholar
  14. 14.
    HTC: HTC Vive (2011). Accessed 14 Feb 2018
  15. 15.
    Iwamoto, T., Tatezono, M., Shinoda, H.: Non-contact method for producing tactile sensation using airborne ultrasound. In: Ferre, M. (ed.) EuroHaptics 2008. LNCS, vol. 5024, pp. 504–513. Springer, Heidelberg (2008). Scholar
  16. 16.
    de Jesus Oliveira, V.A., Brayda, L., Nedel, L., Maciel, A.: Experiencing guidance in 3D spaces with a vibrotactile head-mounted display. In: 2017 IEEE Virtual Reality (VR), pp. 453–454, March 2017.
  17. 17.
    Knopp, S., Lorenz, M., Pelliccia, L., Klimant, P.: Using industrial robots as haptic devices for VR-training. In: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 607–608, March 2018.
  18. 18.
    Long, B., Seah, S.A., Carter, T., Subramanian, S.: Rendering volumetric haptic shapes in mid-air using ultrasound. ACM Trans. Graph. 33(6), 181:1–181:10 (2014). Scholar
  19. 19.
    Ma, Z., Ben-Tzvi, P.: RML glove–an exoskeleton glove mechanism with haptics feedback. IEEE/ASME Trans. Mechatron. 20(2), 641–652 (2015). Scholar
  20. 20.
    Martínez, J., García, A., Oliver, M., Molina, J.P., González, P.: Identifying virtual 3D geometric shapes with a vibrotactile glove. IEEE Comput. Graph. Appl. 36(1), 42–51 (2016). Scholar
  21. 21.
    Motion, L.: Leap Motion (2008). Accessed 12 June 2018
  22. 22.
    Neupert, C., Matich, S., Scherping, N., Kupnik, M., Werthschützky, R., Hatzfeld, C.: Pseudo-haptic feedback in teleoperation. IEEE Trans. Haptics 9(3), 397–408 (2016). Scholar
  23. 23.
    Peng, W., Xiao, N., Guo, S., Wang, Y.: A novel force feedback interventional surgery robotic system. In: 2015 IEEE International Conference on Mechatronics and Automation (ICMA), pp. 709–714, August 2015.
  24. 24.
    de Ribaupierre, S., Eagleson, R.: Editorial: challenges for the usability of AR and VR for clinical neurosurgical procedures. Healthc. Technol. Lett. 4(5), 151–151 (2017). Scholar
  25. 25.
    Rethink Robotics: Baxter specifications (2008). Accessed 14 Feb 2018
  26. 26.
    Sodhi, R., Poupyrev, I., Glisson, M., Israr, A.: AIREAL: interactive tactile experiences in free air. ACM Trans. Graph. 32(4), 134:1–134:10 (2013). Scholar
  27. 27.
    Strickland, D., Hodges, L., North, M., Weghorst, S.: Overcoming phobias by virtual exposure. Commun. ACM 40(8), 34–39 (1997). Scholar
  28. 28.
    Suzuki, Y., Kobayashi, M.: Air jet driven force feedback in virtual reality. IEEE Comput. Graph. Appl. 25(1), 44–47 (2005). Scholar
  29. 29.
    Thanh, V.D.H., Pui, O., Constable, M.: Room VR: A VR therapy game for children who fear the dark. In: SIGGRAPH Asia 2017 Posters, SA 2017, pp. 52:1–52:2. ACM, New York (2017).
  30. 30.
    Tsai, W.L.: Personal basketball coach: tactic training through wireless virtual reality. In: Proceedings of the 2018 ACM on International Conference on Multimedia Retrieval, ICMR 2018, pp. 481–484. ACM, New York (2018).
  31. 31.
    Ultrahaptics: Ultrahaptics technical white paper. Technical report, Bristo, l United Kingdom (2018)Google Scholar
  32. 32.
    van Wyk, E., de Villiers, R.: Virtual reality training applications for the mining industry. In: Proceedings of the 6th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa, AFRIGRAPH 2009, pp. 53–63. ACM, New York (2009).

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Queen’s University BelfastBelfastUK

Personalised recommendations