Abstract
Stereoscopic imaging techniques have also become used for not only amusement but also in the industrial, medical care, and educational fields, however, symptoms due to the stereopsis have been reported. In this study, we especially focus on the effect of background motions on the equilibrium function. The body sway was recorded while/after viewing a sphere as a visual target synchronized/unsynchronized with periodic motion of the view point. Statistical analysis was conducted for the stabilograms.
You have full access to this open access chapter, Download conference paper PDF
Similar content being viewed by others
Keywords
- Body sway
- Total locus length
- Area of sway
- Total locus length per unit area
- Sparse density
- Stereopsis
- Synchronized/unsynchronized motion
1 Introduction
In these days when developments in the graphical technology has produced an increase in the chance to view 3D video clips, visually induced motion sickness (VIMS) has been widely reported as a negative result from the developments. The onset of the VIMS is explained by some hypothesis; overstimulation theory and sensory conflict theory [1]. The overstimulation theory cannot explain the space motion sickness [2,3,4,5,6,7] and the simulator sickness with no vestibular stimulation. Along with the later [8,9,10,11,12], disagreement between the convergence and lens accommodation has been pointed out as a cause of visually induced motion sickness (VIMS) with stereopsis [13]. We conducted simultaneous measurements of lens accommodation and the convergence in a dark room >1 lx [14,15,16,17,18]. According to these researches, the time sequences have showed that the lens accommodation also follows the convergence in case of the stereoscopic vision. The lens accommodation is not fixed at the surface of objects/displays. 3D sickness might not be caused by the disagreement between the convergence and lens accommodation. Also, we investigated the effect of long-term exposure to 3D video clips on the visual function [19] and the body sway [20, 21].
However, the cause of the VIMS does not have been proved yet whereas dizziness and nausea are regarded as symptoms of the VIMS. Previous researches showed that the exposure to blurred/rotational images induces the motion sickness [22] which is also induced while viewing 3D video clips in dark environment on the head-mounted displays [23,24,25,26]. The body balance function is affected by the peripheral vision of a 3D video clip compared to a 2D video clip [27]. The authors investigated the effect of the blurred background, especially in the periodic motion, on the equilibrium function [28].
In prior work, background images with 3D images in the peripheral visual field are shown to affect the body’s equilibrium system [29]. Furthermore, when viewing images with background instability, the equilibrium system is shown to be affected more when a visual target is present than when there is not [28]. However, the effect on the human body of the connection between visual target movement and background instability is an issue that remains unsolved at present. The objective of the present paper is to study how the body’s equilibrium system is affected by background instability in video containing a visual target, that is periodic motion in the backgrounds. A comparative experiment was conducted to experimentally assess the impact on the equilibrium system of the following: video clips with/without a stationary visual target; and video clips that show a spherical visual target moving back and forth quasi-periodically between near and far-distance, while moving from side to side and up and down, showing the visual target movement synchronized with/without the periodic viewpoint changing from side to side (synchronized/unsynchronized movement).
One of the methods to assess motion sickness is stabilometry [30], which is an effective way for the quantitative assessment of the effect of 3D video viewing on the equilibrium system. The present paper therefore makes use of stabilometry.
2 Materials and Methods
The gravicoder was used to record the x-y coordinates for the centre of pressure (CoP) for all sampling times, namely while subjects watched the video clips for 1 min and while they stood with their eyes closed for 2 min in the Experiment 1; and for 1 min in the Experiment 2. CoP data were divided into those for x (right is positive) and y (forward is positive) directions, converted into time series and generated as stabilograms (Fig. 1). The indices; total locus length; area of sway; total locus length per unit area; and sparse density were assessed. Total locus length, area of sway and total locus length per unit area were used as analytical indices for stabilograms in previous studies, and they have been calculated based on the equations that were defined by the Japan Society for Equilibrium Research as well as in the present paper [31]. Sparse density is an index proposed by Takada et al. indicating the density of sampling points distributed in each division on the plane, and is considered to be linked to stability of the body’s equilibrium system [32].
2.1 Experiment 1
The experiment was conducted with nine healthy males aged 21–24 years. Consumption of alcohol and caffeine as well as smoking were prohibited for the two hours prior to the experiment, and written consent was obtained upon full explanation of the details of the experiment. Subjects were shown the following sequence with the periodic motion in the backgrounds: a 2D video clip (VC) without a visual target (VC-1); a 3D video clip without a visual target (VC-2); a 2D video clip with a fixed visual target in the centre (VC-3); a 3D video clip with a fixed visual target in the centre (VC-4); a 2D video clip with unsynchronized movement of the visual target (VC-5); a 3D video clip with unsynchronized movement of the visual target (VC-6); a 2D video clip with synchronized movement of the visual target (VC-7); a 3D video with synchronized movement of the visual target (VC-8). Additionally, subjects were shown a control image (Pre) showing a white dot against a gray background. The experiment is performed with subjects assuming the upright Romberg’s posture, and the display used is the 40″ KDL-40HX80R 3D display (Sony, Tokyo). For the stabilometry, a Gravicoder GS-3000 (Anima, Tokyo) was used. Sampling rate was set at 20 Hz. Stabilometry was performed for a total of 3 min: 1 min while viewing the video, followed by 2 min of rest with eyes closed.
2.2 Experiment 2
This experiment was conducted with 116 subjects, male and female, aged 15–89 years. Three groups were formed, of young, middle-aged and elderly subjects, and compared. They were shown a 3D video clip showing uncoordinated movement of the visual target and the viewpoint (VC-I), and a 3D video showing back and forth (coordinated) movement of the visual target and the viewpoint (VC-II). Additionally, subjects were shown a comparison-video (Pre) showing a white dot against a gray background. By changing the background periodically from side to side, subjects’ viewpoint alone is altered without any input into the vestibular system, provoking sensory discordance and increasing the load when using peripheral vision. Specifically in video II, the visual target moving back and forth changes appearance with the changes in viewpoint, and appears to be displaying more complex motion.
The experiment is performed with subjects assuming the upright Romberg’s posture, and the display used is the 50” 3D TH-P50VT5 display (Panasonic, Osaka). For the stabilometry, a gravicoder GS-3000 (Anima, Tokyo) was used. Sampling rate was set at 20 Hz. Stabilometry was performed for a total of 2 min: 1 min while viewing the video, followed by 1 min of rest with eyes closed.
3 Results
3.1 Experiment 1
Sway values were obtained from stabilograms while/after viewing video clips (Fig. 2, 3 and 4).
Comparing stabilograms with/without visual target while eyes were open, the value of the total locus length was significantly higher when viewing VC-1 and VC-2 than when viewing the static image (Pre) (p < 0.05), and the same statistical tendency was also seen in the sparse density (p < 0.10). For the 2 min with closed eyes, the value of the total locus length per unit area tended to be significantly lower when viewing VC-2 compared to the Pre (p < 0.10), and significantly lower when viewing VC-4 (p < 0.05).
A comparison of the static/dynamic visual target shows that, with their eyes closed for first 1 min, the value of the total locus length was significantly higher in VC-2 compared to VC-4 (p < 0.05). With their eyes open, the value of the total locus length was significantly higher while viewing VC-6 than that of the Pre (p < 0.05) and tended to be greater while viewing VC-3 and VC-5 (p < 0.10). However, no significant results were found when viewing VC-4. Moreover, with their eyes closed for first 1 min, more statistical tendency was observed in VC-6 compared to VC-5, for the area of sway, the total locus length per unit area and sparse density (p < 0.10).
Comparing total locus length while viewing 3D video clips with synchronized/unsynchronized movement of the visual target, the value in VC-6 was significantly higher than that in Pre but no significant difference was seen in VC-8 (p < 0.05). Furthermore, with their eyes open, the value of the total locus length per unit area while viewing VC-8 was significantly lower compared to VC-6 (p < 0.05). With their eyes closed, the value of the total locus length per unit area tended to be lower for VC-7 compared to for VC-5 (p < 0.10).
3.2 Experiment 2
Subjects were divided into a young, middle-aged and an elderly group, and the analytical indices were calculated from the stabilograms recorded when subjects viewed the videos (Figs. 5, 6 and 7). Results showed that for all age groups, sway values were significantly higher when watching the videos than for the Pre.
In the young group, the value of the total locus length with their eyes open was significantly higher while viewing VC-II than in the Pre (p < 0.05), and it tended to be statistically higher while viewing VC-I (p < 0.10). With their eyes closed, the value of the area of sway was larger after viewing VC-I than in the Pre (p < 0.05), and the value of the total locus length per unit area was significantly lower (p < 0.05). After viewing VC-II, total locus length per unit area tended to be lower compared to Pre (p < 0.10). Moreover, the value of the total locus length per unit area tended to be statistically higher after viewing VC-II than that for VC-I (p < 0.10).
In the middle-aged group, with their eyes open, the values of the total locus length, the area of sway, the total locus length per unit area, and the sparse density were significantly higher while viewing VC-I and VC-II compared to the Pre (p < 0.05). With their eyes closed, the values of the area of sway and the sparse density were significantly higher after viewing VC-I and VC-II compared to the Pre (p < 0.05). Moreover, results for the total locus length per unit area were significantly lower after viewing VC-I and VC-II than that of the Pre (p < 0.05).
In the elderly group, with their eyes open, values of the total locus length and the sparse density were significantly higher while viewing VC-II compared to the Pre (p < 0.05), and the value of the area of sway tended to be statistically higher (p < 0.10), With their eyes closed, the value of the total locus length per unit area tended to be statistically lower after viewing VC-II compared to the Pre (p < 0.10).
4 Discussion
4.1 Experiment 1
Since body sway was higher when viewing 3D video clips than when viewing 2D video clips, regardless of a visual target being present in the video or not, it is believed that background instability when viewing 3D video videos impacted more on the equilibrium system. Results were obtained showing that sway values when viewing video clips without a visual target was significantly increased compared to viewing Pre, regardless of solidity of the video clip (2D or 3D) with their eyes open/closed. However, when viewing video with visual targets, no significant differences were seen regardless of the solidity, and thus it is believed that when viewing video with a visual target, the effect due to background instability on the equilibrium system is reduced. We surmise that this may be due to stationary visual targets assisting in balance control in the upright posture. Total locus length when viewing 3D video is shown to be significantly lower after viewing video clip for 2 min with a visual target compared to viewing video without a visual target. Based on this, it can be concluded that, the 3D video clip without a visual target impacts more on the equilibrium than video with a visual target. We surmise that this may be because, since the video clip is in 3D, the visual target is felt to be nearer, thus assisting in balance control in the upright posture.
For viewing the 3D video clip except for the abovementioned comparison, the total locus length results are believed to be more perturbed due to the exposure to the video clips with a visual target. However, since opposite results are found for the area of sway and the total locus length per unit area, we can conclude that although there is an increase in slight sway variation, the range within which the centre of gravity changes has narrowed. It is surmised that this is because controlling one’s CoP does not involve an attempt to stay in one spot, but rather it is controlled by swaying within a constant range while matching the movement of the visual target.
Compared to video clips with synchronized movement of the visual target, viewing video with unsynchronized movement of the visual target results in significantly higher total locus length than when viewing Pre. However, based on the results for the area of sway and the total locus length per unit area, statistically increased sway tended to be seen for the exposure to the video clip with synchronized movement of the visual target compared to that with unsynchronized movement. This leads us to conclude that although there is an increase in micro-sway, the range of motion of the CoP has narrowed for the exposure to the video clip with unsynchronized movement. It is believed that this is because, although the total locus length is increased when viewing the unsynchronized movement by swaying the body to match the movement of the visual target, the effect of the exposure to the video clip on the equilibrium system is increased when viewing video clip with the synchronized movement of the visual target.
Compared to video with a static visual target, video clips without a visual target affected the equilibrium system more. Additionally, we can say that the connection between the background and visual target when there is a visual target that functions as an aid to balance control changes the effect on the equilibrium system. This is based on the following: video clips with a moving visual target affected the equilibrium system more than video clips with a static visual target, and it is believed that the impact on the equilibrium system of a moving visual target was severer when viewing video with the synchronized movement of the visual target. Furthermore, in relation to the video clips used in the present paper, motion sickness was more likely to be induced when viewing the visual target movement synchronized with the background motion.
4.2 Experiment 2
Hardly any significant differences were seen between the video clips throughout the age groups. However, regarding the total locus length in the young group, for subjects showing statistical trends when viewing VC-I compared to the Pre, significant differences were seen for VC-II, and for the elderly group no differences were found for viewing VC-I compared to Pre, although significant differences were found in the case of viewing VC-II. Therefore, it is possible that viewing VC-II strongly affects the equilibrium. Since only the young group showed statistical trends between the video clips (Fig. 5c), it is possible that the young group is considered to have sensitive balance function for the VIMS.
In measurements of the middle-aged group, we could find a number of significant differences or statistical tendencies and lack of these in measurements of the elderly group. Deterioration in the stereopsis due to the aging also affect the statistical results in this study.
References
Reason, J.T., Brand, J.J.: Motion Sickness. Academic Press, London (1975)
Homick, J.L.: Space motion sickness. Acta Astronautica 6, 1259–1272 (1979)
Graybiel, A.: Space motion sickness: skylab revisited. Aviat Space Environ. Med. 51, 814–822 (1980)
Talbot, J.M., Fisher, K.D.: Space sickness. Physiologist 27, 423–429 (1984)
Leich, R.J., Daroff, R.B.: Space motion sickness: etiological hypotheses and a proposal for diagnostic clinical examination. Aviat Space Environ. Med. 56, 469–473 (1985)
Oman, C.M., Lichtenberg, B.K., Money, K.E., McCoy, R.K.: MIT/Canadian vestibular experiments on Spacelab-1 mission: 4. Space motion sickness: symptoms, stimuli and predictability. Exp. Brain Res. 64, 316–334 (1986)
Davis, J.R., Vanderploeg, J.M., Santy, P.A., Jennings, R.T., Stewart, D.F.: Space motion sickness during 24 flights of the space shuttle. Aviat Space Environ. Med. 59, 1185–1189 (1988)
Money, K.E.: Motion sickness. Physiol. Rev. 50, 1–39 (1970)
Johnson, W.H., Jongkees, L.B.W., Kornhuber, H.H.: Vestibular system part 2: psychophysics, applied aspects and general interpretations. In: Kornhuber, H.H. (ed.) Motion sickness. Handbook of Sensory Physiology, vol. 6/2. Springer, Heidelberg (1974). https://doi.org/10.1007/978-3-642-65920-1_10
Benson, A.J.: Motion sickness. In: Dix, M.R., Hood, J.D. (eds.) Vertigo, pp. 391–426. Wiley, New York (1984)
Stott, J.R.R.: Mechanisms and treatment of motion illness. In: Davis, C.J., Lake-Bakaar, G.V., Grahame-Smith, D.G. (eds.) Nausea and Vomiting: Mechanisms and Treatment. Advances in Applied Neurological Sciences, vol. 3. Springer, Heidelberg (1986). https://doi.org/10.1007/978-3-642-70479-6_9
Reason, J.T.: Motion sickness: a special case of sensory rearrangement. Adv. Sci. 26, 386–393 (1970)
Ukai, K., Howarth, P.A.: Visual fatigue caused by viewing stereoscopic motion images: background, theories, and observations. Displays 29, 106–116 (2008)
Shiomi, T., Ishio, H., Hori, H., Takada, H., Omori, M., Hasegawa, S., Matsunuma, S., Hasegawa, A., Kanda, T., Miyao, M.: Simultaneous measurement of lens accommodation and convergence to real objects. In: Shumaker, R. (ed.) VMR 2011. LNCS, vol. 6773, pp. 363–370. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-22021-0_40
Shiomi, T., Uemoto, K., Kojima, T., Sano, S., Ishio, H., Takada, H., Omori, M., Watanabe, T., Miyao, M.: Simultaneous measurement of lens accommodation and convergence in natural and artificial 3D vision. J. SID. (2013). https://doi.org/10.1002/jsid.156
Kojima, T., Matsuura, Y., Miyao, M., Shiomi, T., Takada, H.: Comparison by simultaneous measurement of lens accommodation and convergence in 3D vision and their distributions. Int. J. Biosci. Biochem. Bioinfo. 3(6), 635–638 (2013)
Shiomi, T., Hori, H., Hasegawa, S., Takada, H., Omori, M., Matsuura, Y., Ishio, H., Hasegawa, A., Kanda, T., Miyao, M.: Simultaneous measurement of lens accommodation and convergence to objects. Forma 29(S), S77–S81 (2014)
Kimura, R., et al.: Measurement of lens focus adjustment while wearing a see-through head-mounted display. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2016. LNCS, vol. 9738, pp. 271–278. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40244-4_26
Ishio, H., Kojima, T., Oohashi, T., Okada, Y., Takada, H., Miyao, M.: Effects of long-time 3D viewing on the eye function of accommodation and convergence. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2013. LNCS, vol. 8010, pp. 269–274. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39191-0_30
Takada, M., Murakami, K., Kunieda, Y., Hirata, T., Matsuura, Y., Iwase, S., Miyao, M., Takada, H.: Effect of hour-long stereoscopic film on equilibrium function. In: Proceedings of IMID 2011 Digest, pp. 737–738 (2011)
Yoshikawa, K., Takada, H., Miyao, M.: Effect of display size on body sway in seated posture while viewing an hour-long stereoscopic film. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2013. LNCS, vol. 8010, pp. 336–341. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39191-0_38
International Standard Organization: IWA3:2005 image safety-reducing determinism in a time series. Phys. Rev. Lett. 70, 530–582 (1993)
Takada, H., Fujikake, K., Watanabe, T., Hasegawa, S., Omori, M., Miyao, M.: A method for evaluating motion sickness induced by watching stereoscopic images on a head-mounted display. In: Proceedings of SPIE 7237, Stereoscopic Displays and Applications XX, 72371P (2009). https://doi.org/10.1117/12.807144
Fujikake, K., Miyao, M., Watanabe, T., Hasegawa, S., Omori, M., Takada, H.: Evaluation of body sway and the relevant dynamics while viewing a three-dimensional movie on a head-mounted display by using stabilograms. In: Shumaker, R. (ed.) VMR 2009. LNCS, vol. 5622, pp. 41–50. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02771-0_5
Takada, H., Fujikake, K., Miyao, M.: Metamorphism in potential function while maintaining upright posture during exposure to a three-dimensional movie on an head-mounted display. In: Proceedings of 31st EMBS, pp. 4906–4912 (2009)
Takada, H., Matsuura, Y., Fujikake, K., Miyao, M.: Bioresponse to stereoscopic movies presented via a head-mounted display. In: Proceedings of the 4th BIOSTEC 2011, pp. 433–437 (2011)
Takada, M., Fukui, Y., Matsuura, Y., Sato, M., Takada, H.: Peripheral viewing during exposure to a 2D/3D video clip: effects on the human body. Environ. Health Prev. Med. 20(2), 79–89 (2015)
Amano, N., Kinoshita, F., Takayuki, H., Takada, H.: Mathematical model of equilibrium function while viewing a 3D object in a moving background. Proc. the 81st Sympo. Social Science Format, p. 36 (2016). (in Japanese)
Takada, H., Mori, Y., Miyakoshi, T.: Effect of background viewing on equilibrium systems. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2015. LNCS, vol. 9176, pp. 255–263. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20681-3_24
Balaban, C.D., Poster, J.D.: Neuroanatomic substrates for vestibulo-autonomic interactions. J. Vestib. Res. 8, 7–16 (1998)
Japan Society for Equilibrium Research: A standard of stabilometry. Equip. Res. 42, 367–369 (1983). (in Japanese)
Takada, H., Miyao, M.: Visual fatigue and motion sickness induced by 3D video clip. Forma 27(S), S67–S76 (2012)
Acknowledgements
This work was supported in part by the Japan Society for the Promotion of Science, Grant-in-Aid for Research Activity Start-up Number 15H06711, Grant-in-Aid for Young Scientists (B) Number 16K16105, and that for Scientific Research (C) Number 17K00715.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Amano, N. et al. (2018). Analysis of the Body Sway While/After Viewing Visual Target Movement Synchronized with Background Motion. In: Antona, M., Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Virtual, Augmented, and Intelligent Environments . UAHCI 2018. Lecture Notes in Computer Science(), vol 10908. Springer, Cham. https://doi.org/10.1007/978-3-319-92052-8_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-92052-8_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-92051-1
Online ISBN: 978-3-319-92052-8
eBook Packages: Computer ScienceComputer Science (R0)