Abstract
Ultrasound haptic feedback is typically used to augment the multi-sensory experience with spatiotemporal patterns projected on the users’ hands. Many studies have considered the usability of such techniques on the users’ palms as it is more sensitive to ultrasound stimuli. Studies exploring the ultrasound feedback on the users’ fingertips have utilized large ultrasound phased arrays to project perceptible haptic stimuli. Spatiotemporal patterns at the fingertips using smaller phased arrays have been largely unexplored due to their weaker sensations. In this chapter, we first present a survey of ultrasound stimuli patterns that have considered the users’ fingers for haptic feedback. Then, a set of spatiotemporal stimuli for ultrasound feedback on the finger is presented along with results from a user study and associated examples of mid-air gestures. In the end, the prospect of ultrasound haptic sensations at the fingertip is summarized from a survey.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Carter T, Seah SA, Long B, Drinkwater B, Subramanian S (2013) UltraHaptics: multi-point mid-air haptic feedback for touch surfaces. In: Proceedings of the 26th annual ACM symposium on user interface software and technology. (St. Andrews, Scotland, United Kingdom) (UIST ’13). Association for Computing Machinery, New York, NY, USA, pp 505-514. https://doi.org/10.1145/2501988.2502018
Chilles J, Frier W, Abdouni A, Giordano M, Georgiou O (2019) Laser Doppler vibrometry and FEM simulations of ultrasonic mid-air haptics. In: 2019 IEEE World Haptics Conference (WHC), pp 259–264. https://doi.org/10.1109/WHC.2019.8816097
Culbertson H, Schorr SB, Okamura AM (2018) Haptics: the present and future of artificial touch sensation. In: Annual review of control, robotics, and autonomous systems, vol 1, issue 1, pp 385–409. https://doi.org/10.1146/annurev-control-060117-105043
Frier W, Pittera D, Ablart D, Obrist M, Subramanian S (2019) Sampling strategy for ultrasonic mid-air haptics. Association for Computing Machinery, New York, NY, USA, pp 1–11. https://doi.org/10.1145/3290605.3300351
Grandhi Sukeshini A, Gina J, Irene M (2011) Understanding naturalness and intuitiveness in gesture production: insights for touchless gestural interfaces. Association for Computing Machinery, New York, NY, USA, pp 821–824. https://doi.org/10.1145/1978942.1979061
Pacchierotti C, Sinclair S, Solazzi M, Frisoli A, Hayward V, Prattichizzo D (2017) Wearable haptic systems for the fingertip and the hand: taxonomy, review, and perspectives. IEEE Trans Haptics 10:580–600. https://doi.org/10.1109/TOH.2017.2689006
Hajas D, Pittera D, Nasce A, Georgiou O, Obrist M (2020) Mid-air haptic rendering of 2D geometric shapes with a dynamic tactile pointer. IEEE Trans Haptics 13(4):806–817. https://doi.org/10.1109/TOH.2020.2966445
Keisuke H, Hiroyuki S (2013) A method for distribution control of aerial ultrasound radiation pressure for remote vibrotactile display. SICE Ann Conf 2013:223–228. https://ieeexplore.ieee.org/abstract/document/6736163
Hoshi T, Takahashi M, Iwamoto T, Shinoda H (2010) Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Trans Haptics 3(3):155–165. https://doi.org/10.1109/TOH.2010.4
Howard T, Gallagher G, Lécuyer A, Pacchierotti C, Marchal M (2019) Investigating the recognition of local shapes using mid-air ultrasound haptics. In: 2019 IEEE World Haptics Conference (WHC), pp 503–508. https://doi.org/10.1109/WHC.2019.8816127
Kappus B, Long B (2018) Spatiotemporal modulation for mid-air haptic feedback from an ultrasonic phased array. J Acoustical Soc Am 143(3):1836–1836. https://doi.org/10.1121/1.5036027
Georgios K, Mohamad E (2016) Haptogram: ultrasonic point-cloud tactile stimulation. IEEE Access 4:7758–7769. https://doi.org/10.1109/ACCESS.2016.2608835
Koutsabasis P, Vogiatzidakis P (2019) Empirical research in mid-air interaction: a systematic review. Int J Human-Comput Interaction 35(18):1747–1768. https://doi.org/10.1080/10447318.2019.1572352
Long B, Seah SA, Carter T, Subramanian S (2014) Rendering volumetric haptic shapes in mid-air using ultrasound. ACM Trans Graph 33(6), Article 181, 10 pages. https://doi.org/10.1145/2661229.2661257
Lundborg G, Rosén B (2004) The two-point discrimination test–time for a re-appraisal? J Hand Surg 29(5):418–422. https://doi.org/10.1016/J.JHSB.2004.02.008
Matsubayashi A, Yasutoshi M, Hiroyuki S (2019) Direct finger manipulation of 3D object image with ultrasound haptic feedback. Association for Computing Machinery, New York, NY, USA, pp 1–11. https://doi.org/10.1145/3290605.3300317
Palovuori K, Rakkolainen I, Sand A (2014) Bidirectional touch interaction for immaterial displays. In: Proceedings of the 18th international academic MindTrek conference: media business, management, content and services (AcademicMindTrek ’14) Association for Computing Machinery, New York, NY, USA, pp 74–76. https://doi.org/10.1145/2676467.2676503
Rakkolainen I, Freeman E, Sand A, Raisamo R, Brewster S (2021) A survey of mid-air ultrasound haptics and its applications. IEEE Trans Haptics 14(1):2–19. https://doi.org/10.1109/TOH.2020.3018754
Rutten I, Frier W, Van den Bogaert L, Geerts D (2019) Invisible touch: how identifiable are mid-air haptic shapes? In: Extended abstracts of the 2019 CHI conference on human factors in computing systems. (Glasgow, Scotland Uk) (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, pp 1–6. https://doi.org/10.1145/3290607.3313004
Sand A, Rakkolainen I, Isokoski P, Kangas J, Raisamo R, Palovuori K (2015) Head-mounted display with mid-air tactile feedback. In: Proceedings of the 21st ACM symposium on virtual reality software and technology (VRST ’15), Association for Computing Machinery, New York, NY, USA, pp 51–58. https://doi.org/10.1145/2821592.2821593
Sun C, Nai W, Sun X (2019) Tactile sensitivity in ultrasonic haptics: do different parts of hand and different rendering methods have an impact on perceptual threshold? Virtual Reality Intelli Hardware 1(3):265–275. https://doi.org/10.3724/SP.J.2096-5796.2019.0009
Takahashi R, Hasegawa K, Shinoda H (2018) Lateral modulation of midair ultrasound focus for intensified vibrotactile stimuli. In: International conference on human haptic sensing and touch enabled computer applications. Springer, Heidelberg, pp 276–288. https://doi.org/10.1007/978-3-319-93399-3_25
Takahashi R, Hasegawa K, Shinoda H (2020) Tactile stimulation by repetitive lateral movement of midair ultrasound focus. IEEE Trans Haptics 13(2):334–342. https://doi.org/10.1109/TOH.2019.2946136
Triscoli C, Croy I, Olausson H, Sailer U (2017) Touch between romantic partners: being stroked is more pleasant than stroking and decelerates heart rate. Physiol Behav 177:169–175. https://doi.org/10.1016/j.physbeh.2017.05.006
Wilson G, Carter T, Subramanian S, Brewster SA (2014) Perception of ultrasonic haptic feedback on the hand: localisation and apparent motion. In: Proceedings of the SIGCHI conference on human factors in computing systems. (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, pp 1133–1142. https://doi.org/10.1145/2556288.2557033
Zhang C, Sahoo DR, Pearson J, Robinson S, Holton MD, Hopkins P, Jones M (2020) Active PinScreen: exploring spatio-temporal tactile feedback for multi-finger interaction. In: 22nd International conference on human-computer interaction with mobile devices and services. (Oldenburg, Germany) (MobileHCI ’20). Association for Computing Machinery, New York, NY, USA, Article 18, 11 pages. https://doi.org/10.1145/3379503.3403531
Acknowledgements
This work was partly supported by Engineering and Physical Sciences Research Council grant EP/M022722/1.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Pan, K., Frier, W., Sahoo, D. (2022). Ultrasound Mid-Air Haptic Feedback at the Fingertip. In: Georgiou, O., Frier, W., Freeman, E., Pacchierotti, C., Hoshi, T. (eds) Ultrasound Mid-Air Haptics for Touchless Interfaces. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-031-04043-6_13
Download citation
DOI: https://doi.org/10.1007/978-3-031-04043-6_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-04042-9
Online ISBN: 978-3-031-04043-6
eBook Packages: Computer ScienceComputer Science (R0)