Abstract
Haptic simulation of materials is one of the most important challenges in human-computer interaction. A fundamental step to achieve it regards the definition of how human beings can encode the information acquired by different sensorial channels’ stimulation. In this context, this paper presents the study, implementation and evaluation of a multi-modal cutaneous feedback device (CFD) for the simulation of material textures. In addition to tactile stimulation, two further sensory components (e.g. eyesight and hearing) are integrated to support the user to better recognize and discriminate different classes of materials and then, overcome previous identified drawbacks. An experimental protocol is tuned to assess the relevance of each stimulated channel in material texture recognition. Tests are carried out with real and virtual materials. Result comparison is used to validate the proposed approach and verify the realism of simulation.
Chapter PDF
Similar content being viewed by others
References
Peruzzini, M., Germani, M., Mengoni, M.: Electro-tactile device for texture simulation. In: 2012 IEEE/ASME International Conference on Mechatronics and Embedded Systems and Applications (MESA), July 8-10, pp. 178–183 (2012)
Germani, M., Mengoni, M., Peruzzini, M.: Electro-tactile device for material texture simulation. International Journal of Advanced Manufacturing Technolog 68(9), 2185–2203 (2013) ISSN 0268-3768 (DOI 10.1007/s00170-013-4832-1)
Frisoli, A., Solazzi, M., Reiner, M., Bergamasco, M.: The contribution of cutaneous and kinesthetic sensory modalities in haptic perception of orientation. Brain Research Bulletin 85(5), 260–266 (2011) ISSN 0361-9230
Burch, D., Pawluk, D.: Using multiple contacts with texture-enhanced graphics. In: 2011 IEEE World Haptics Conference (WHC), June 21-24, pp. 287–292 (2011)
Marchuk, N.D., Colgate, J.E., Peshkin, M.A.: Friction measurements on a Large Area TPaD. In: 2010 IEEE Haptics Symposium, pp. 317–320 (2010)
Konyo, M., Tadokoro, S., Yoshida, A., Saiwaki, N.: A tactile synthesis method using multiple frequency vibrations for representing virtual touch. In: 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2005), pp. 3965–3971 (2005)
Torres, J.C.B., Petraglia, M.R., Tenenbaum, R.A.: HRTF modeling for efficient auralization. In: 2003 IEEE International Symposium on Industrial Electronics ISIE 2003, June 9-11, vol. 2, pp. 919–923 (2003)
Abraira, V.E., Ginty, D.D.: The sensory neurons of touch. Neuron 79(4), 618–639 (2013), doi:10.1016/j.neuron.2013.07.051
Altinsoy, M.E., Merchel, S.: Electrotactile Feedback for Handheld Devices with Touch Screen and Simulation of Roughness. IEEE Transactions on Haptics 5(10), 1–8 (2012)
Caldwell, D.G., Lawther, S., Wardle, A.: Tactile Perception and its Application to the Design of Multi-modal Cutaneous Feedback Systems. In: International Conference on Robotics and Automation Minneapolis, Minnesota (April 1996)
Hughes, B., Wang, J., Rosic, D., Palmer, K.: Texture Gradients and Perceptual Constancy under Haptic Exploration. In: Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC 2007), pp. 66–71 (2007), doi:10.1109/WHC.2007.109
Kim, S.-C., Israr, A., Poupyrev, I.: Tactile rendering of 3D features on touch surfaces. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology - UIST 2013, pp. 531–538 (2013), doi:10.1145/2501988.2502020
Koritnik, T., Koenig, A., Bajd, T., Riener, R., Munih, M.: Comparison of visual and haptic feedback during training of lower extremities. Gait & Posture 32, 540–546 (2010), doi:10.1016/j.gaitpost.2010.07.017
Kyung, K., Kim, S., Kwon, D., Srinivasan, M.: Texture Display Mouse KAT: Vibrotactile Pattern and Roughness Display. In: 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 478–483 (2006), doi:10.1109/IROS.2006.282440
Lévesque, V., Oram, L., Maclean, K., Cockburn, A., Marchuk, N.D., Johnson, D., Peshkin, M.A.: Enhancing Physicality in Touch Interaction with Programmable Friction. In: CHI 2011, Vancouver, BC, Canada, May 7–12 (2011)
Marchuk, N.D., Colgate, J.E., Peshkin, M.A.: Friction measurements on a Large Area TPaD. In: 2010 IEEE Haptics Symposium, pp. 317–320 (2010), doi:10.1109/HAPTIC.2010.5444636
Spence, C.: Audiovisual multisensory integration. Acoustical Science and Technology 28(2), 61–70 (2007), doi:10.1250/ast.28.61
Turchet, L., Serafin, S.: Semantic congruence in audio–haptic simulation of footsteps. Applied Acoustics 75, 59–66 (2013), doi:10.1016/j.apacoust.2013.06.016
Vitense, H.S., Jacko, J.A., Emery, V.K.: Foundation for improved interaction by individuals with visual impairments through multimodal feedback. Univ. Access. Inf. Soc., 76–87 (2002)
Fukuyama, K., Takahashi, N., Zhao, F., Sawada, H.: Tactile display using the vibration of SMA wires and the evaluation of perceived sensations. In: 2009 2nd Conference on Human System Interactions, pp. 685–690 (2009)
Ikei, Y., Tsu, K.W.: Texture Presentation by Vibratory Tactile Display, pp. 199–205 (1997)
Takasaki, M., Kotani, H., Nara, T.: SAW Excitation On Glass Plates For A Tactile Display Application 00(c), pp. 819–822 (2005)
Yamamoto, A., Nagasawa, S., Yamamoto, H., Higuchi, T.: Electrostatic tactile display with thin film slider and its application to tactile telepresentation systems. IEEE Transactions on Visualization and Computer Graphics 12(2), 168–177 (2006)
Olivier Bau, Poupyrev, I., Israr, A., & Harrison, C, TeslaTouch: Electrovibration for Touch Surfaces. In: Disney Research (internal), Pittsburgh (2010)
Weiss, T., Straube, T., Boettcher, J., Hecht, H., Spohn, D., Miltner, W.H.R.: Brain activation upon selective stimulation of cutaneous C- and Aδ-fibers. NeuroImage 41(4), 1372–1381 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Cavalieri, L., Germani, M., Mengoni, M. (2014). Multi-modal Interaction System to Tactile Perception. In: Shumaker, R., Lackey, S. (eds) Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments. VAMR 2014. Lecture Notes in Computer Science, vol 8525. Springer, Cham. https://doi.org/10.1007/978-3-319-07458-0_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-07458-0_3
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07457-3
Online ISBN: 978-3-319-07458-0
eBook Packages: Computer ScienceComputer Science (R0)