Advertisement

A Proof of Concept Integrated Multi-systems Approach for Large Scale Tactile Feedback in VR

  • Daniel BriceEmail author
  • Thomas McRobertsEmail author
  • Karen RaffertyEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11613)

Abstract

It is well understood that multi-sensory stimulation can be used to enhance immersion in virtual environments such as Virtual Reality (VR) and Augmented Reality (AR). State of the art VR technologies have enhanced visual stimulation in aspects such as pixel density in recent years, whilst the area of haptics has remained less developed. The Ultrahaptics Evaluation Kit is a relatively new technology that consists of a \(16\times 16\) array of ultrasound transducers used to create ultrasound haptic sensations. We have developed a proof of concept large scale haptic system by integrating this device with an HTC VIVE, Leap Motion and Rethink Robotics’ Baxter Robot to provide ultrasound haptic feedback in a volume greater than 1.5 m\(^3\) for VR users. The system was evaluated through a user study with 19 participants. The study focused on users’ assessments of the location of the haptics produced by the system. The results of the study offer a means of validating the system, as well as providing comparisons in accuracy for a haptic perception task vs a visual perception task. There have been opportunities recognised for improving accuracy of the system. However, the system has been deemed suitable in creating haptic feedback for low fidelity models within large volumes in VR.

Keywords

Haptics Ultrasound Virtual Reality Immersion System integration 

References

  1. 1.
    Blake, J., Gurocak, H.B.: Haptic glove with mr brakes for virtual reality. IEEE/ASME Trans. Mechatron. 14(5), 606–615 (2009).  https://doi.org/10.1109/TMECH.2008.2010934CrossRefGoogle Scholar
  2. 2.
    Brice, D., Devine, S., Rafferty, K.: A novel force feedback haptics system with applications in phobia treatment (2017)Google Scholar
  3. 3.
    Carter, T., Seah, S., Long, B., Drinkwater, B., Subramanian, S.: Ultrahaptics: multi-point mid-air haptic feedback for touch surfaces. In: UIST 2013 Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST 2013. Association for Computing Machinery (ACM), October 2013.  https://doi.org/10.1145/2501988.2502018
  4. 4.
    Corbett-Davies, S., Dünser, A., Clark, A.: Interactive AR exposure therapy. In: Proceedings of the 13th International Conference of the NZ Chapter of the ACM’s Special Interest Group on Human-Computer Interaction, CHINZ 2012, p. 98. ACM, New York (2012).  https://doi.org/10.1145/2379256.2379282
  5. 5.
    Covarrubias, M., Bordegoni, M.: Immersive VR for natural interaction with a haptic interface for shape rendering. In: 2015 IEEE 1st International Forum on Research and Technologies for Society and Industry Leveraging a Better Tomorrow (RTSI), pp. 82–89, September 2015.  https://doi.org/10.1109/RTSI.2015.7325075
  6. 6.
    Cremer, S., Mastromoro, L., Popa, D.O.: On the performance of the Baxter research robot. In: 2016 IEEE International Symposium on Assembly and Manufacturing (ISAM), pp. 106–111, August 2016.  https://doi.org/10.1109/ISAM.2016.7750722
  7. 7.
    Dexmo: Dexmo (2008). http://www.dextarobotics.com/. Accessed 14 Feb 2018
  8. 8.
    Dunbar, B., et al.: Augmenting human spatial navigation via sensory substitution. In: 2017 IEEE MIT Undergraduate Research Technology Conference (URTC), pp. 1–4, November 2017.  https://doi.org/10.1109/URTC.2017.8284172
  9. 9.
    Garage, W.: MoveIt (2008). http://moveit.ros.org/. Accessed 14 Feb 2018
  10. 10.
    Geomagic: Phantom Omni (2011). http://www.geomagic.com/en/products/phantom-omni/overview. Accessed 14 Feb 2018
  11. 11.
    Guo, J., Guo, S.: A haptic interface design for a VR-based unskilled doctor training system in vascular interventional surgery. In: 2014 IEEE International Conference on Mechatronics and Automation, pp. 1259–1263, August 2014.  https://doi.org/10.1109/ICMA.2014.6885880
  12. 12.
    Han, P.H., et al.: OoEs: playing in the immersive game with augmented haptics. In: ACM SIGGRAPH 2016 VR Village, SIGGRAPH 2016, p. 15:1. ACM, New York (2016).  https://doi.org/10.1145/2929490.2929895
  13. 13.
    Hoshi, T., Takahashi, M., Iwamoto, T., Shinoda, H.: Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Trans. Haptics 3(3), 155–165 (2010).  https://doi.org/10.1109/TOH.2010.4CrossRefGoogle Scholar
  14. 14.
    HTC: HTC Vive (2011). https://www.vive.com/uk/. Accessed 14 Feb 2018
  15. 15.
    Iwamoto, T., Tatezono, M., Shinoda, H.: Non-contact method for producing tactile sensation using airborne ultrasound. In: Ferre, M. (ed.) EuroHaptics 2008. LNCS, vol. 5024, pp. 504–513. Springer, Heidelberg (2008).  https://doi.org/10.1007/978-3-540-69057-3_64CrossRefGoogle Scholar
  16. 16.
    de Jesus Oliveira, V.A., Brayda, L., Nedel, L., Maciel, A.: Experiencing guidance in 3D spaces with a vibrotactile head-mounted display. In: 2017 IEEE Virtual Reality (VR), pp. 453–454, March 2017.  https://doi.org/10.1109/VR.2017.7892375
  17. 17.
    Knopp, S., Lorenz, M., Pelliccia, L., Klimant, P.: Using industrial robots as haptic devices for VR-training. In: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 607–608, March 2018.  https://doi.org/10.1109/VR.2018.8446614
  18. 18.
    Long, B., Seah, S.A., Carter, T., Subramanian, S.: Rendering volumetric haptic shapes in mid-air using ultrasound. ACM Trans. Graph. 33(6), 181:1–181:10 (2014).  https://doi.org/10.1145/2661229.2661257CrossRefGoogle Scholar
  19. 19.
    Ma, Z., Ben-Tzvi, P.: RML glove–an exoskeleton glove mechanism with haptics feedback. IEEE/ASME Trans. Mechatron. 20(2), 641–652 (2015).  https://doi.org/10.1109/TMECH.2014.2305842CrossRefGoogle Scholar
  20. 20.
    Martínez, J., García, A., Oliver, M., Molina, J.P., González, P.: Identifying virtual 3D geometric shapes with a vibrotactile glove. IEEE Comput. Graph. Appl. 36(1), 42–51 (2016).  https://doi.org/10.1109/MCG.2014.81CrossRefGoogle Scholar
  21. 21.
    Motion, L.: Leap Motion (2008). https://www.leapmotion.com/. Accessed 12 June 2018
  22. 22.
    Neupert, C., Matich, S., Scherping, N., Kupnik, M., Werthschützky, R., Hatzfeld, C.: Pseudo-haptic feedback in teleoperation. IEEE Trans. Haptics 9(3), 397–408 (2016).  https://doi.org/10.1109/TOH.2016.2557331CrossRefGoogle Scholar
  23. 23.
    Peng, W., Xiao, N., Guo, S., Wang, Y.: A novel force feedback interventional surgery robotic system. In: 2015 IEEE International Conference on Mechatronics and Automation (ICMA), pp. 709–714, August 2015.  https://doi.org/10.1109/ICMA.2015.7237572
  24. 24.
    de Ribaupierre, S., Eagleson, R.: Editorial: challenges for the usability of AR and VR for clinical neurosurgical procedures. Healthc. Technol. Lett. 4(5), 151–151 (2017).  https://doi.org/10.1049/htl.2017.0077CrossRefGoogle Scholar
  25. 25.
    Rethink Robotics: Baxter specifications (2008). http://www.rethinkrobotics.com/baxter/tech-specs/. Accessed 14 Feb 2018
  26. 26.
    Sodhi, R., Poupyrev, I., Glisson, M., Israr, A.: AIREAL: interactive tactile experiences in free air. ACM Trans. Graph. 32(4), 134:1–134:10 (2013).  https://doi.org/10.1145/2461912.2462007CrossRefGoogle Scholar
  27. 27.
    Strickland, D., Hodges, L., North, M., Weghorst, S.: Overcoming phobias by virtual exposure. Commun. ACM 40(8), 34–39 (1997).  https://doi.org/10.1145/257874.257881CrossRefGoogle Scholar
  28. 28.
    Suzuki, Y., Kobayashi, M.: Air jet driven force feedback in virtual reality. IEEE Comput. Graph. Appl. 25(1), 44–47 (2005).  https://doi.org/10.1109/MCG.2005.1CrossRefGoogle Scholar
  29. 29.
    Thanh, V.D.H., Pui, O., Constable, M.: Room VR: A VR therapy game for children who fear the dark. In: SIGGRAPH Asia 2017 Posters, SA 2017, pp. 52:1–52:2. ACM, New York (2017).  https://doi.org/10.1145/3145690.3145734
  30. 30.
    Tsai, W.L.: Personal basketball coach: tactic training through wireless virtual reality. In: Proceedings of the 2018 ACM on International Conference on Multimedia Retrieval, ICMR 2018, pp. 481–484. ACM, New York (2018).  https://doi.org/10.1145/3206025.3206084
  31. 31.
    Ultrahaptics: Ultrahaptics technical white paper. Technical report, Bristo, l United Kingdom (2018)Google Scholar
  32. 32.
    van Wyk, E., de Villiers, R.: Virtual reality training applications for the mining industry. In: Proceedings of the 6th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa, AFRIGRAPH 2009, pp. 53–63. ACM, New York (2009).  https://doi.org/10.1145/1503454.1503465

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Queen’s University BelfastBelfastUK

Personalised recommendations