Advertisement

Comparing Lateral Modulation and Amplitude Modulation in Phantom Sensation

Open Access
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12272)

Abstract

Phantom Sensation (PhS) is a tactile illusion in which a single sensation is elicited by stimulating two distant points. That sensation moves continuously between the two stimuli by changing the amplitude ratio. In this paper, we compared PhS for two types of tactile stimuli: lateral modulation (LM) of 20 Hz and amplitude modulation (AM) of 200 Hz. In LM, a stimulus point is moved periodically and laterally by several millimeters. In AM, the pressure is changed periodically at a fixed stimulation point. LM and AM are produced by ultrasound radiation pressure, where the force intensity of LM and AM were changed with the same temporal pattern. The results showed that the continuity and the localization of PhS elicited by LM at 20 Hz were significantly smaller than those elicited by AM at 200 Hz in 18 out of 24 conditions. However, PhS remained in all conditions that we used, regardless of LM or AM, even for an extremely long duration of 7.5 s and a short duration of 0.5 s.

Keywords

Phantom sensation Tactile receptor Ultrasound. 

1 Introduction

When stimulating two distant points on the human skin, a single sensation is felt between them. This phenomenon is called Phantom Sensation (PhS). In PhS, a continuous tactile motion is presented by changing the amplitude ratio between the distant stimulation points  [7]. The illusion is useful to minimize the number of stimulators that simplify the tactile display device  [1, 9]; however, the mechanism and properties are not well clarified.

In this study, we examined the conditions to elicit PhS using ultrasound radiation pressure that can control the stimulus quantitatively with high reproducibility and controllability. In particular, we compared PhS elicited by lateral modulation (LM) [6] and amplitude modulation (AM) [4] presented by ultrasound. LM is the stimulus in which an ultrasound focus is moved periodically and laterally by several millimeters. AM is the stimulus in which the pressure amplitude of an ultrasound focus is modulated periodically at a fixed point. The details of LM and AM are described in Sect. 2.2. LM is clearly perceived even below 50 Hz, and AM is strongly perceived above 100 Hz. As the authors’ subjective view, LM is perceived to be small and localized near the stimulus point, and AM is perceived as more widespread.

In the experimental design, we considered that low-frequency LM and high-frequency AM are typical stimuli that selectively stimulate type-\(\mathrm {I}\) and FA\(\mathrm {II}\) mechanoreceptors, respectively, where type-I includes fast-adapting (FA\(\mathrm {I}\)) and slowly adapting (SA\(\mathrm {I}\)) mechanoreceptors and FA\(\mathrm {II}\) indicates fast-adapting type-\(\mathrm {II}\) mechanoreceptors. The selectivity has not been evaluated quantitatively. However, we tentatively assumed it because it is plausible from the temporal characteristics of the threshold and the perceived spatial area. In the following experiments, we compared the difference in the perceived tactile motion continuity and localization of PhS elicited by LM and AM, changing the intensity of LM and AM equally with the same temporal pattern.

Some studies have been conducted on PhS using non-vibratory stimuli as well as various vibrotactile stimuli at 100 Hz and 30 Hz  [1, 2]. However, there is no comparison between the different types of stimuli under the same conditions. In this paper, we carefully measured the pressure pattern on the skin, and equalized the temporal profile of the stimulus between LM and AM.

2 Principle

2.1 Phantom Sensation

In our experiment, we simultaneously stimulated two points on the palm to elicit PhS by airborne ultrasound phased array (AUPA)  [5]. AUPA creates an ultrasound focus (stimulus point) of approximately 1 cm\(^2\). The maximum force of AUPA we used is approximately 4.8 g, as shown in Fig. 5 (right) and higher than the perception threshold on the hand  [8]. AUPA is described in Appendix.
Fig. 1.

A) & B) Changes in pressure linearly and logarithmically (\(P^{\mathrm {Linear}}_k\) and \(P^{\mathrm {log}}_k\)). C) Schematic illustration of Phantom Sensation evaluated in this paper. D) Schematic illustration of lateral modulation.

Figure 1 (C) shows a schematic illustration of the PhS evaluated in this paper. The presented pressure was changed linearly and logarithmically by 5 and 6 described in Appendix. Linear and logarithmic changes have been widely used in PhS experiments  [1, 9, 10]. In Fig. 1, \(L_p\) is the length between two stimulated points, and \(\textit{\textbf{u}}{_p}\) is the moving direction vector of PhS (\(\Vert \textit{\textbf{u}}{_p}\Vert =1\)). \(P^{\mathrm {Linear}}_1\) and \(P^{\mathrm {Linear}}_2\) are the pressures presented at \(\textit{\textbf{r}}{_\mathrm {f}}{_{1}}\) and \(\textit{\textbf{r}}{_\mathrm {f}}{_{2}}\), respectively, when changing the pressure linearly. When changing the pressure logarithmically, the corresponding pressure is defined as \(P^{\mathrm {log}}_1\) and \(P^{\mathrm {log}}_2\). \(P^{\mathrm {Linear}}_k\) and \(P^{\mathrm {log}}_k\) (\(k = 1, 2\)), are shown in Fig. 1 (A and B) and given by
$$\begin{aligned} P^{\mathrm {Linear}}_k(t)= & {} P^{\mathrm {max}}_k(2-k+\frac{t}{d_p}),\end{aligned}$$
(1)
$$\begin{aligned} P^{\mathrm {log}}_k(t)= & {} P^{\mathrm {max}}_k\log _2[3-k+(-1)^{k}\frac{t}{d_p}], \end{aligned}$$
(2)
where \(d_p\) is the duration of PhS and \(P^{\mathrm {max}}_k\) is the maximum pressure that AUPAs can present. The range of \(t\) is \(0\le t\le d_p\).

2.2 Lateral Modulation and Amplitude Modulation

Amplitude modulation: AM is the method to present a vibrotactile stimulus by periodically modulating the pressure amplitude of an ultrasound focus  [4]. Previous research showed that the sensitivity of RA\(\mathrm {II}\) is highest at approximately 200 Hz and higher than that of RA\(\mathrm {I}\) and SA\(\mathrm {I}\) at the same frequency  [3]. Therefore, AM at 200 Hz is considered to stimulate RA\(\mathrm {II}\) more strongly than RA\(\mathrm {I}\) and SA\(\mathrm {I}\).

Lateral modulation: LM is the ultrasound stimulus method that moves an ultrasound focus periodically and laterally several millimeters while maintaining the intensity constant [6] (Fig. 1-D). LM at 20 Hz is more strongly perceived than AM at the same frequency [6]. Moreover, at 20 Hz, the sensitivity of RA\(\mathrm {II}\) is lower than that of RA\(\mathrm {I}\) and SA\(\mathrm {I}\) [3]. Therefore, we used LM at 20 Hz to stimulates RA\(\mathrm {I}\) and SA\(\mathrm {I}\) more strongly than RA\(\mathrm {II}\).
Fig. 2.

Left: Experimental setup presenting Phantom Sensation. Right: Video of participants’ hand captured by a depth camera with markers.

3 Experimental Methods

In this experiment, we compared PhS elicited by LM and AM in terms of continuity and localization. Continuity and localization are typical elements of PhS that have been evaluated in many previous studies  [1, 2, 9, 10].

Stimulus: The experimental setup is shown in Fig. 2 (left). The setup consists of 6 AUPAs and a depth camera (Intel Real Sense D435). The coordinate system is a right-handed system with an origin at the lower left of AUPAs. We presented two ultrasound foci to \(\textit{\textbf{r}}{_\mathrm {f}}{_{1}}= (308,151.4,z_{h1})\) mm and \(\textit{\textbf{r}}{_\mathrm {f}}{_{2}}= (268,151.4,z_{h2})\) mm, then \(\textit{\textbf{u}}{_p}=(1,0,0)\). We also presented the foci to \(\textit{\textbf{r}}{_\mathrm {f}}{_{1}}= (288,131.4,z_{h1})\) mm and \(\textit{\textbf{r}}{_\mathrm {f}}{_{2}}= (288,171.4,z_{h2})\) mm, then \(\textit{\textbf{u}}{_p}=(0,1,0)\). \(z_{h1}\) and \(z_{h2}\) are the heights of the participants’ hand measured by the depth camera. In PhS, we used \(L_p= 40\) mm, \(d_p= 1.5, 2.5, 4.0\) s, and a linear and logarithmic function shown in Fig. 1 (A and B) as the amplitude change. The stimulus type was LM and AM stimuli. The pressure of AM at a 200 Hz sinusoidal wave, where the perception threshold of RA\(\mathrm {II}\) is less than -10 dB  [3]. In LM, the ultrasound focus was moved laterally at a constant speed and periodically at 20 Hz. The movement width was 6 mm. The motion direction of LM was perpendicular to \(\textit{\textbf{u}}{_p}\). AM and LM had the same maximum pressure. As a whole, we varied the stimulus type (LM or AM), the type of amplitude change (linear or logarithm), \(d_p\), and \(\textit{\textbf{u}}{_p}\). Therefore, there were \(2 \times 2 \times 3 \times 2 = 24\) trials for each set. Each participant performed three sets. All trials were performed in the same order, which was randomized once.

Procedure: 10 male participants (ages 23 – 27) were included in the experiment. Participants put their hands toward the radiation surface of AUPAs. Participants saw the video of the hand captured by the depth camera. The video is shown in Fig. 2 (right). Participants adjusted the position of their hand so that the center of the circle-shaped markers added to the video was aligned with the center of their hand. The direction of PhS was also indicated by a green arrow in the video. After adjustment, PhS was presented, and participants answered the following two questions using a 7-grade Likert scale (1–7): Q. 1) The presented stimulus is continuously moving stimulation, Q. 2) The presented stimulus consisted of only one stimulus point. We intended that Q. 1 and Q. 2 evaluated the continuity and the localization of PhS, respectively. After answering the questions, the participants readjusted the position of their hands and proceeded to the next trial.
Fig. 3.

Average scores of Q. 1 (continuity) and Q. 2 (localization). Error bars mean standard deviation. A) Stimulus duration \(d_p=1.5, 2.5, 4.0\) s. B) \(d_p=0.5,7.5\) s.

3.1 Result

The average scores of Q. 1 (continuity) and Q. 2 (localization) are shown in Fig. 3 (A). The AM score was higher than the LM score in all conditions. Wilcoxon signed-rank test showed that the differences between the AM scores and the LM scores were significant in the Q. 1-linear case (\(p<0.05\)). In the Q. 2-logarithm case, the differences were significant when {\(\textit{\textbf{u}}{_p}=(1,0,0)\) and \(d_p=2.5\) s}, and {\(\textit{\textbf{u}}{_p}=(0,1,0)\) and \(d_p=1.5, 2.5, 4.0\) s}. In the Q. 2-linear case, the differences were significant when {\(\textit{\textbf{u}}{_p}=(1,0,0)\) and \(d_p=4.0\) s}, and {\(\textit{\textbf{u}}{_p}=(0,1,0)\) and \(d_p=1.5, 2.5\) s}. The significant differences with \(p<0.05\), \(p<0.005\), and \(p<0.0005\) were indicated by *, **, and ***, respectively, in Fig. 3.
Fig. 4.

Left: Experimental setup. Right: Measured sound distribution of the two ultrasound foci.

Fig. 5.

Left: Measured change in sound pressure, according to \(G{_1}\) and \(G{_2}\). The results of linear regression \(H{_1}\) and \(H{_2}\) were also added. Center & Right: Calculated sound pressure and radiation pressure in \(0 \le G{_1}\le 1, 0 \le G{_2}\le 1\).

We applied ANOVA to the results with the fore factors: the type of stimulus, the type of amplitude change, \(\textit{\textbf{u}}{_p}\), and \(d_p\). We observed that the type of stimulus (\(F(1, 714)= 173.3640, ~p= 6.6093\times 10^{-17}<0.0001\)) and \(d_p\) (\(F(2,714)= 4.9319,~p= 7.4604\times 10^{-3}<0.05\)) had significant effects on the scores of Q. 1. We also observed that only the type of stimulus (\(F(1, 714)=106.2125,~p= 2.5904\times 10^{-23}<0.0001\)) had significant effects on the scores of Q. 2.

3.2 Discussion

Originally, we expected that LM cannot elicit PhS because LM is perceived to be localized near the stimulus point. The results showed that AM elicited PhS more easily than LM, but PhS remained in the LM conditions. Therefore, we compared LM and AM again with extremely long or short durations of PhS (\(d_p=0.5,7.5\) s), where eliciting PhS may be difficult. Our results and previous studies showed that the stimulus duration \(d_p\) has significant effects on PhS [10].

However, contrary to the authors’ expectations, LM and AM still elicited PhS under extreme conditions. Moreover, the localization of LM was greater than that of AM in \(\textit{\textbf{u}}{_p}=(1,0,0)\), \(d_p= 7.5\) s. The results are shown in Fig 3 (B). 5 males (ages 24 – 26) participated in the second experiment. The experimental procedure is the same as that described in Sect. 3.

These results indicated that AM tends to elicit PhS more easily than LM, but both AM and LM can elicit PhS even under the extreme conditions. Note that there are differences in the stimulus area and perception intensity between LM and AM. The stimulus area of LM was larger than that of AM because of the movement of the stimulus points. The perceived intensities of LM and AM differ for the same driving power  [6]. In this experiment, we did not equalize the perceived intensities but maximized it in both cases to make the participants clearly perceive the stimuli. These differences should be explored in future work.

4 Conclusion

In this paper, we compared Phantom Sensation (PhS) elicited by lateral modulation (LM) of 20 Hz and amplitude modulation (AM) of 200 Hz in terms of continuity and localization. This comparison aims to clarify the conditions for eliciting PhS. LM and AM were produced by ultrasound with high reproducibility and controllability. The same temporal pattern was applied to the force intensities of LM and AM.

The results showed that the continuity and the localization of PhS elicited by LM were significantly smaller than those elicited by AM in 18 out of 24 conditions. However, Phs remained in all conditions we used, regardless of LM or AM, even when the stimulus duration of PhS having significant effects on PhS  [10] was extremely long or short (7.5 s or 0.5, s).

Appendix: Airborne Ultrasound Phased Array

In our experiment, the ultrasound stimulus was produced by an airborne ultrasound phased array (AUPA)  [5]. A single unit of AUPA that we used was provided with 249 ultrasound transducers. AUPA presents a non-contact force with about 1 cm\(^2\) circle area. The pressure is called acoustic radiation pressure. In this section, we measured the sound pressure by AUPA to change the intensity of LM and AM with the same temporal pattern (Eq. 1, 2).

Presenting PhS requires two-point stimuli [7]. When AUPA creates a focus at \(\textit{\textbf{r}}{_\mathrm {f}}{_{1}}\) and \(\textit{\textbf{r}}{_\mathrm {f}}{_{2}}\) simultaneously, the sound pressure \(p{_{\mathrm {f}}}\) at \(\textit{\textbf{r}}\) and \(t\) is as follows:
$$\begin{aligned} p{_{\mathrm {f}}}(t,\textit{\textbf{r}},\textit{\textbf{r}}{_\mathrm {f}}{_{1}},\textit{\textbf{r}}{_\mathrm {f}}{_{2}})= & {} \sum _{i=1}^{N{_{\mathrm {trans}}}}p{_{i}}(t, \textit{\textbf{r}})(G{_1}\mathrm {e}^{-\mathrm {j}\Vert \textit{\textbf{r}}{_\mathrm {f}}{_{1}}- \textit{\textbf{r}}{_{i}}\Vert }+G{_2}\mathrm {e}^{-\mathrm {j}\Vert \textit{\textbf{r}}{_\mathrm {f}}{_{2}}- \textit{\textbf{r}}{_{i}}\Vert }), \end{aligned}$$
(3)
$$\begin{aligned} p{_{i}}(t, \textit{\textbf{r}})= & {} \frac{AD(\theta {_{i}})}{\Vert \textit{\textbf{r}}- \textit{\textbf{r}}{_{i}}\Vert }\mathrm {e}^{-\beta \Vert \textit{\textbf{r}}-\textit{\textbf{r}}{_{i}}\Vert }\mathrm {e}^{\mathrm {j}(\nu \Vert \textit{\textbf{r}}- \textit{\textbf{r}}{_{i}}\Vert -\omega t)}, \end{aligned}$$
(4)
where \(\textit{\textbf{r}}{_{i}}\) is the position of each transducer, \(N{_{\mathrm {trans}}}\) is the total number of transducers, \(A\) is the maximum amplitude of a transducer, \(D\) is the directivity of a transducer, \(\omega \) is the frequency of ultrasound, \(\nu \) is the wavenumber of the ultrasound we used, \(\beta \) is the attenuation coefficient of air, \(\mathrm {j}\) is the imaginary unit, and \(\theta {_{i}}\) is the angle from the transducer centerline to a focus. \(G{_1}\) and \(G{_2}\) are coefficients to determine the amplitude of two foci, respectively; thus, \(0\le G{_1},0\le G{_2}, G{_1}+G{_2}\le 1\).

We measured the sound distribution of two foci created by 6 AUPAs at \(\textit{\textbf{r}}{_\mathrm {f}}{_{1}}=(258, 151.4, 310)\) mm and \(\textit{\textbf{r}}{_\mathrm {f}}{_{2}}=(318, 151.4, 310)\) mm using Eq. 3. The experimental setup is shown in Fig. 4 (left). The sound distribution was measured by a microphone (Brüel & Kjær Type 2670) moved by a three-axis stage in 100 mm \(\times \) 100 mm (\(238 \le x \le 338, 101.4 \le y \le 201.4, z = 310\) mm) by 1.5 mm. The AUPAs output was 6.2% of the maximum value (\(G{_1}= 0.031\) and \(G{_2}= 0.031\)) because the maximum sound pressure which the microphone can measure is about 316 Pa. The measured sound distribution is shown in Fig. 4 (right).

To change the radiation pressure accurately and obtain \(P^{\mathrm {max}}_k\) of 6 AUPAs, we measured the change in sound pressure according to \(\textit{\textbf{G}}=(G{_1}, G{_2})\). The experimental setup is the same as that shown in Fig. 4 (left). 6 AUPAs created two foci at \(\textit{\textbf{r}}{_\mathrm {f}}{_{1}}=(258, 151.4, 310)\) mm and \(\textit{\textbf{r}}{_\mathrm {f}}{_{2}}=(318, 151.4, 310)\) mm. We changed \(\textit{\textbf{G}}\) from (0.086, 0) to (0, 0.086) by \((-0.0078,0.0078)\) and measured the sound pressure at \(\textit{\textbf{r}}{_\mathrm {f}}{_{1}}\) and \(\textit{\textbf{r}}{_\mathrm {f}}{_{2}}\) in each case. The measured sound pressure and the result of linear regression are shown in Fig. 5 (left). \(H{_1}\) and \(H{_2}\), which are sound pressure according to \(\textit{\textbf{G}}\) at \(\textit{\textbf{r}}{_\mathrm {f}}{_{1}}\) and \(\textit{\textbf{r}}{_\mathrm {f}}{_{2}}\), respectively, are as follows:
$$\begin{aligned} H{_1}(G{_1})= & {} 1.7323 \times 10^{6}G{_1}- 17.0363,\end{aligned}$$
(5)
$$\begin{aligned} H{_2}(G{_2})= & {} 1.7182 \times 10^{6}G{_2}- 1.3803. \end{aligned}$$
(6)
The sound pressure and calculated radiation pressure [5] in \(0 \le G{_1}\le 1,0 \le G{_2}\le 1 \) are shown in Fig. 5 (center and right).

References

  1. 1.
    Alles, D.S.: Information transmission by phantom sensations. IEEE Trans. Man Mach. Syst. 11(1), 85–91 (1970)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Culbertson, H., Nunez, C.M., Israr, A., Lau, F., Abnousi, F., Okamura, A.M.: A social haptic device to create continuous lateral motion using sequential normal indentation. In: 2018 IEEE Haptics Symposium (HAPTICS), pp. 32–39. IEEE (2018)Google Scholar
  3. 3.
    Gescheider, A., Bolanowski, S.J., Hardick, K.R.: The frequency selectivity of information-processing channels in the tactile sensory system. Somatosens. Mot. Res. 18(3), 191–201 (2001)CrossRefGoogle Scholar
  4. 4.
    Hasegawa, K., Shinoda, H.: Aerial vibrotactile display based on multiunit ultrasound phased array. IEEE Trans. Haptics 11(3), 367–377 (2018)CrossRefGoogle Scholar
  5. 5.
    Hoshi, T., Takahashi, M., Iwamoto, T., Shinoda, H.: Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Trans. Haptics 3(3), 155–165 (2010)CrossRefGoogle Scholar
  6. 6.
    Takahashi, R., Hasegawa, K., Shinoda, H.: Tactile stimulation by repetitive lateral movement of midair ultrasound focus. IEEE Transactions on Haptics 13, 334–342 (2019)CrossRefGoogle Scholar
  7. 7.
    Von Békésy, G.: Neural funneling along the skin and between the inner and outer hair cells of the cochlea. J. Acoust. Soc. Am. 31(9), 1236–1249 (1959)CrossRefGoogle Scholar
  8. 8.
    Weinstein, S.: Intensive and extensive aspects of tactile sensitivity as a function of body part, sex and laterality. The skin senses (1968)Google Scholar
  9. 9.
    Yatani, K., Truong, K.N.: Semfeel: a user interface with semantic tactile feedback for mobile touch-screen devices. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 111–120. ACM (2009)Google Scholar
  10. 10.
    Yun, G., Oh, S., Choi, S.: Seamless phantom sensation moving across a wide range of body. In: 2019 IEEE World Haptics Conference (WHC), pp. 616–621. IEEE (2019)Google Scholar

Copyright information

© The Author(s) 2020

Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

Authors and Affiliations

  1. 1.The University of TokyoKashiwa-shiJapan

Personalised recommendations