Abstract
Kinesthetic sensation is important for improving presence and immersion in VR environments. However, presenting kinesthetic sensation usually requires a large space so as to avoid users colliding with objects or other users. One of the ways to tackle this issue is to use kinesthetic illusion, which is a way of presenting kinesthetic sensation without physical motion. However, realizing dynamic motion and fast movement remains difficult. Considering that multiple synergist muscles are usually involved in a movement such as walking or even simple arm movement, stimulating multiple synergist muscles might enhance the illusion. Thus, we investigated whether multi-point vibratory stimulation to multiple synergist muscles enhances induced kinesthetic illusions. We found that stimulating multiple synergist muscles created more vivid illusions. Additionally, we found that our method was effective for inducing steady illusions. We also calculated the contribution of each proposed stimulation point to the illusion.
You have full access to this open access chapter, Download conference paper PDF
Similar content being viewed by others
Keywords
1 Introduction
Presenting proprioception and kinesthetic sensation is important for improving presence and immersion in VR environments. Usually, kinesthetic sensation is presented using equipment that incorporates actual user motion such as walking. However, this requires a large space. Otherwise users might collide with objects and other people.
These issues can be resolved by inducing only kinesthetic sensation without physical motion. Kinesthetic illusions, which are illusions of the position and movement of one’s own body and induced by stimulating proprioceptors such as muscle spindles [1], can achieve this goal.
Kinesthetic illusions are often induced using about ~100-Hz tendon vibrations [4]. Although skin deformation [2] and electrical stimulation of tendons [5] can induce movement illusion, tendon vibration is more effective, considering that muscle spindles contribute a great deal to kinesthetic sensation [7]. The intensity of the illusion depends primarily on the vibration frequency and amplitude [8, 10]. The preload force of the vibrator is also known to affect the threshold of vibration amplitude for eliciting the illusion [3].
However, the intensity of the illusion induced by tendon vibration is not enough for realizing dynamic and fast movement. One reason might be that the stimulation point is limited. Yaguchi et al. [14] reported that kinesthetic illusion was enhanced by stimulating two synergist muscles or tendons at both ends. Even though previous studies have examined stimulating one or two synergist muscles, actual movement involves many synergist muscles. Therefore, stimulating multiple synergist muscles can induce the more natural and large kinesthetic illusion.
In our previous report [13], we preliminarily confirmed that multi-point vibratory stimulation induced more steady illusion than the illusion induced by one or two points of stimulation. In this paper, we investigate the effects of multi-point vibration in more detail as well as the contribution of each vibration position to the illusion.
2 Methods
Twelve participants (10 men and 2 women; aged 21 to 25 years old; all right-handed) took part in the experiment. We presented vibration stimulation to seven positions on the left chest, upper arm, and forearm to induce the arm extension illusion, and Fig. 1 (left) shows the vibrator positions (1 to 7) over the same tendons that we tested in our previous report [13]. We hypothesized that each vibratory stimulation would contribute differently to the illusion and illusions induced by each vibration could be composited linearly as the vector model of the illusion [9, 11].
Optical motion capture (OptiTrack V120:Duo) was used to measure participant movement. Figure 1 (right) shows seven positions on the neck, shoulders, elbows, and wrists where we placed retroreflective markers. The marker positions were recorded in a left-handed coordinate system, as shown in Fig. 1 (center).
2.1 Vibratory Stimulation
The vibrator (Acouve Lab VP 210) was hung on three springs (overall stiffness: 1.2 N/mm) in the vibrator case (Fig. 1, center) The bottom of the vibrator case was covered by a sponge to avoid pain, and the case was mounted with rubber bands and a supporter (Fig. 1, left). The preload force of vibrators was adjusted from 1.2 N to 2.4N by observing the displacement of the head contacting the skin. Based on a previous study [8], we set the vibration frequency to 70 Hz. The acceleration amplitude was adjusted to 90 m/s\(^2\) with an accelerometer (Sparkfun LIS331). The input signal to the vibrators was generated with the same system as in our previous report [13].
2.2 Procedure
The experiments were carried out over two days by dividing the trials of presenting vibration in half so as to prevent participants’ fatigue.
Participants were told the posture during the experiment and asked to wear the experiment devices. In particular, the vibrator cases were mounted on the target positions identified by touch. Each vibrator’s acceleration amplitude and each OptiTrack marker were calibrated. After that, we measured the ability to express movement, and collected data of the vibration-induced illusions.
Measurement of the Ability to Express Movement. Preliminarily, we measured the ability to mirror the movement of the left arm with the right arm in order to screen out participants who cannot accurately evaluate the illusions by this method.
The experimenter moved the participant’s left arm sinusoidally around the shoulder in two directions (flexion/extension and adduction/abduction) and participants mirrored the movement with their right arm. Six trials (three in each direction) were carried out randomly. The three trials in each direction included two trials of slow movement (about 3\(^\circ \)/s) and one trial of fast movement (about 10\(^\circ \)/s). The order of trials was different for each participant. The duration per one trial was 10 s.
Data Collection of Induced Illusions. We applied 127 vibration patterns (2\(^7\)-1), which included all combinations of the seven vibrators. Each vibration pattern was applied one time and the order of patterns differed across participants. Vibration was applied for 5 s with closed eyes. A 5-s interval divided each trial and a 1-min interval separated every 10 trials. Participants were alerted to the timing of the next trial via headphones, which also served to mask sound cues via white noise.
During the vibration, participants were asked to express the perceived illusion by their right arm. After the vibration, participants answered three questions on a scale of 1 to 10 (Table 1), based on previous studies [6, 12]
Prior to data collection, participants became accustomed to the measurement procedure through a practice stage in which the five trials were carried out. The order of vibration patterns differed from those in the actual measurement.
2.3 Data Analysis
We calculated the angular velocity by dividing the angle difference between the initial and the end arm position by the vibration duration. The arm angle was calculated using the arm vector from shoulder position to wrist position measured by OptiTrack. The flexion/extension (y-z plain; extension is the positive direction) and adduction/abduction (x-z plain; abduction is the positive direction) directions were used for analysis.
3 Results
3.1 Measurement of the Ability to Express Movement
We calculated the error angle of right arm movement with respect to the left arm movement. In the flexion/extension direction, the average error was 1.92± 5.43\(^\circ \). In the adduction/abduction direction, the average error was −5.79± 3.91\(^\circ \).
There was no participant who was not able to mirror both arms at all. Thus, we used the data of all participants for analyzing.
3.2 Data Collection of Induced Illusion
The 0.72\(\%\) data (11 trials/1524 trials) was excluded from data analysis because tracking was lost during vibration. We analyzed the angular velocity of the right arm movement that expressed the illusory movement of the left arm.
The angular velocity in the extension/flexion direction is represented by \(\omega _{yz}\) and the angular velocity in the adduction/abduction direction is represented by \(\omega _{xy}\). Figure 2 shows the average angular velocity of each vibration pattern in each direction. Vertical vibration patterns on the horizontal axis indicate which vibrators used (1 to 7 from the top). The open circles indicate a vibrator was not used and closed circles indicate that it was.
A multiple regression analysis of the average angular velocity in each direction based on the vibration pattern (each vibrator was coded as ON = 1, OFF = 0) yielded the coefficients shown in Table 2. The regression equations for each angular velocity were statistically significant (\(\omega _{yz}\) model: F\(_{(7, 119)}\) = 32.942, p <0.001, the adjusted R\(^2\) = 0.640, \(\omega _{xy}\) model: F\(_{(7, 119)}\) = 29.204, p < 0.001, the adjusted R\(^2\) = 0.610) and expressed as follows: \(\omega _{yz} = -0.042v_{1} + 0.385v_{2} + 0.112v_{3} + 0.254v_{4} + 0.441v_{5} + 0.138v_{6} + 0.292v_{7} -0.347\), \(\omega _{xy} = -0.005v_{1} + 0.229v_{2} + 0.038v_{3} + 0.216v_{4} + 0.023v_{5} + 0.112v_{6} + 0.171v_{7} + 0.111\) (\(v_{i}\): vibrator i).
Figure 3 shows scatter plots of correlation coefficients between the average value of each evaluation scale and the applied vibration points. Subjective evaluation values were averaged for each vibration pattern.
4 Discussion
4.1 Multiple Regression Analysis of Average Angular Velocity Based on Vibration Pattern
In \(\omega _{yz}\) model (Table 2), vibrators 5, 2, and 7 had the highest standardized coefficients, in that order. Actually, vibrators 5 and 2 were always included in the higher order patterns in Fig. 2 (above). In \(\omega _{xy}\) model, vibrators 2, 4 and 7 had the highest standardized coefficients in that order. Vibrators 2, 4 and 7 were always included in the higher order patterns in Fig. 2 (below).
It was common for vibrators 2 and 7 to have large effects in each model. The main difference was that vibrator 5 had the largest effect in the \(\omega _{yz}\) model and vibrator 4 had a relatively small effect, while in the \(\omega _{xy}\) model, the vibrator 4 had one of the largest effects. This can be understood by considering a vector model of muscle spindles [9, 11], that is composed of the vectors of expected illusion directions and magnitudes when the muscle is stimulated. The coracobrachialis (vibrators 2 and 4), and the wrist flexors (vibrator 7) have vectors that point toward the compounded direction of extension and abduction, and the biceps brachii (vibrator 5) have a vector purely in the extension direction.
More interestingly, wrist flexors, which are not related to the motion of the shoulder joint directly, contributed a great deal to the illusion. We considered it is possibility because vibration applied to wrist flexors induced a motor image similar to what is experienced when the arm is moved by external force exerted on the hand. This image could have enhanced the kinesthetic illusion. The participants actually commented that they felt passive arm movements.
In Fig. 2, the minus value means that participants expressed flexion. This is because tonic vibration reflex (TVR) was evoked in the experiment accidentally. In some participants, the reflex was induced even for the vibration patterns that induced strong illusions in others. These data decreased the accuracy of the models of multiple regression analysis.
4.2 Relationship Between the Strength of the Illusion and the Points of Vibration
We found significantly positive correlations between each subjective evaluation scale and the vibration points (Fig. 3). This means that vivid and large kinesthetic illusions can be induced by multi-point vibratory stimulation. It also suggests that even though vivid illusions can be induced by strong vibration applied to single point, the same effect can be elicited by mild vibration distributed over several points.
4.3 Tendons and Muscles of the Stimulation Points
In this experiment, the tendons were not stimulated directly in all positions. Albeit the tendons of the coracobrachialis were located under the deltoid (vibrator 2) and biceps brachii (vibrator 4), each position was effective for illusion. This result indicates that the illusion was elicited by indirect vibration to the tendon, and the muscle spindles can be stimulated effectively through coracoid process (located in vibrator 2). In particular, the vibrator 4 contributed differently to the direction of the illusion than vibrator 5 did. Kinesthetic illusion can be induced even by stimulating muscle belly [3, 4]. This implies that the deltoid contributed to the illusion induced by vibrator 2 and the biceps brachii also contributed to the illusion induced by vibrator 4.
5 Conclusion and Future Work
The purpose of the present study was to investigate the effect that increasing the number of vibratory stimuli has on the kinesthetic illusion. Vibrators were placed at seven positions on the synergist muscles around the chest, upper arm, and forearm, and all vibration combinations were tested. We found that multi-point vibration induced illusions steadily and found the optimized vibration pattern which evoke more rapid illusion than the illusion induced by seven vibratory stimuli (Fig. 2).
In this experiment, the average angular velocity of the illusion was about 2 deg/s at most. Thus, we think that the limit of vibration-induced illusions is suggested. In future, further analysis of the data needs to be performed, and combinations with other modalities should be investigated.
References
Burke, D., Hagbarth, K.E., Löfstedt, L., Wallin, B.G.: The responses of human muscle spindle endings to vibration of non-contracting muscles. J. Physiol. 261(3), 673–693 (1976)
Collins, D.F., Refshauge, K.M., Todd, G., Gandevia, S.C.: Cutaneous receptors contribute to kinesthesia at the index finger, elbow, and knee. J. Neurophysiol. 94(3), 1699–1706 (2005)
Ferrari, F., Clemente, F., Cipriani, C.: The preload force affects the perception threshold of muscle vibration-induced movement illusions. Exp. Brain Res. 237(1), 111–120 (2019)
Goodwin, G.M., Mccloskey, D.I., Matthews, P.B.: The contribution of muscle afferents to kinestesthesia shown by vibration induced illusions of movement and by the effects of paralysing joint afferents. Brain 95(4), 705–748 (1972)
Kajimoto, H.: Illusion of motion induced by tendon electrical stimulation. In: World Haptics Conference, pp. 555–558 (2013)
Naito, E., Ehrsson, H.H., Geyer, S., Zilles, K., Roland, P.E.: Illusory arm movements activate cortical motor areas: a positron emission tomography study. J. Neurosci. 19(14), 6134–6144 (1999)
Proske, U., Gandevia, S.C.: The proprioceptive senses: their roles in signaling body shape, body position and movement, and muscle force. Physiol. Rev. 92, 1651–1697 (2012)
Roll, J.P., Vedel, J.P.: Kinaesthetic role of muscle afferents in man, studied by tendon vibration and microneurography. Exp. Brain Res. 47(2), 177–190 (1982)
Roll, J.P., Albert, F., Thyrion, C., Ribot-Ciscar, E., Bergenheim, M., Mattei, B.: Inducing any virtual two-dimensional movement in humans by applying muscle tendon vibration. J. Neurophysiol. 101(2), 816–23 (2009)
Schofield, J.S., Dawson, M.R., Carey, J.P., Hebert, J.S.: Characterizing the effects of amplitude, frequency and limb position on vibration induced movement illusions: implications in sensory-motor rehabilitation. Technol. Health Care 23(2), 129–141 (2015)
Thyrion, C., Roll, J.P.: Predicting any arm movement feedback to induce three-dimensional illusory movements in humans. J. Neurophysiol. 104(2), 949–959 (2010)
Tidoni, E., Fusco, G., Leonardis, D., Frisoli, A., Bergamasco, M., Aglioti, S.M.: Illusory movements induced by tendon vibration in right- and left-handed people. Exp. Brain Res. 233(2), 375–383 (2014)
Ushiyama, K., Tanaka, S., Takahashi, A., Kajimoto, H.: Reinforcement of kinesthetic illusion by simultaneous multi-point vibratory stimulation. In: SIGGRAPH Asia 2019 Posters, pp. 1–2 (2019)
Yaguchi, H., Fukayama, O., Suzuki, T., Mabuchi, K.: Effect of simultaneous vibrations to two tendons on velocity of the induced illusory movement. In: Proceedings of IEEE International Conference of Engineering in Medicine and Biology Society (EMBC), pp. 5851–5853 (2010)
Acknowledgement
This research was supported by JSPS KAKENHI Grant Number JP18H04110.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Supplementary material 1 (mp4 45764 KB)
Rights and permissions
Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.
The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
Copyright information
© 2020 The Author(s)
About this paper
Cite this paper
Ushiyama, K., Tanaka, S., Takahashi, A., Kajimoto, H. (2020). The Effects of Simultaneous Multi-point Vibratory Stimulation on Kinesthetic Illusion. In: Nisky, I., Hartcher-O’Brien, J., Wiertlewski, M., Smeets, J. (eds) Haptics: Science, Technology, Applications. EuroHaptics 2020. Lecture Notes in Computer Science(), vol 12272. Springer, Cham. https://doi.org/10.1007/978-3-030-58147-3_21
Download citation
DOI: https://doi.org/10.1007/978-3-030-58147-3_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-58146-6
Online ISBN: 978-3-030-58147-3
eBook Packages: Computer ScienceComputer Science (R0)