Saliency-Driven Tactile Effect Authoring for Real-Time Visuotactile Feedback
New-generation media such as the 4D film have appeared lately to deliver immersive physical experiences, yet the authoring has relied on content artists, impeding the popularization of such media. An automated approach for the authoring becomes increasingly crucial in lowering production costs and saving user interruption. This paper presents a fully automated framework of authoring tactile effects from existing video images to render synchronized visuotactile stimuli in real time. The spatiotemporal features of video images are analyzed in terms of visual saliency and translated into tactile cues that are rendered on tactors installed on a chair. A user study was conducted to evaluate the usability of visuotactile rendering against visual-only presentation. The result indicated that the visuotactile rendering can improve the movie to be more interesting, immersive, appealing, and understandable.
KeywordsTactile Effect Visual Saliency 4D Film Multimedia
Unable to display preview. Download preview PDF.
- 2.C.I.E: Recommendations on uniform colour spaces, colour difference equations, psychometric colour terms, supplement No.2 to CIE publication No.15 (E.-1.3.1) 1971/(TC-1.3.) (1978)Google Scholar
- 4.Connor, C.E., Egeth, H.E., Yantis, S.: Visual attention: Bottom-up versus top-down. Current Biology 14(19), R850–R852 (2004)Google Scholar
- 6.Hamed, H.M., Hema, R.A.: The Application of the 4-D Movie Theater System in Egyptian Museums for Enhancing Cultural Tourism. Journal of Tourism 10(1), 37–53 (2009)Google Scholar
- 10.Koch, C., Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology 4(4), 219–227 (1985)Google Scholar
- 12.Lemmens, P., Crompvoets, F., Brokken, D., van den Eerenbeemd, J., De Vries, G.: A body-conforming tactile jacket to enrich movie viewing. In: Third Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 7–12 (2009)Google Scholar
- 13.Oh, E., Lee, M., Lee, S.: How 4D Effects cause different types of Presence experience? In: Proc. the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, pp. 375–378 (2011)Google Scholar