Abstract
Non-verbal cues used during social interactions, such as facial expressions, are largely inaccessible to individuals who are blind. This work explores the use of affective haptics for communicating emotions displayed during social interactions. We introduce a novel haptic device, called the Haptic Face Display (HFD), consisting of a two-dimensional array of vibration motors capable of displaying rich spatiotemporal vibrotactile patterns presented through passive or active interaction styles. This work investigates users’ emotional responses to vibrotactile patterns using a passive interaction style in which the display is embedded on the back of an ergonomic chair. Such a technology could enhance social interactions for individuals who are blind in which emotions of interaction partners, once recognized by a frontend system such as computer vision algorithms, are conveyed through the HFD. We present the results of an experiment exploring the relationship between vibrotactile pattern design and elicited emotional response. Results indicate that pattern shape, duration, among other dimensions, influence emotional response, which is an important consideration when designing technologies for affective haptics.
Chapter PDF
Similar content being viewed by others
Keywords
References
Knapp, M.L.: Nonverbal Communication in Human Interaction. Harcourt College Pub. (1996)
Krishna, S., Colbry, D., Black, J., Balasubramanian, V., Panchanathan, S.: A Systematic Requirements Analysis and Development of an Assistive Device to Enhance the Social Interaction of People Who are Blind or Visually Impaired. In: Proceedings of the Workshop on Computer Vision Applications for the Visually Impaired (CVAVI 2008), ECCV (2008)
McDaniel, T., Krishna, S., Balasubramanian, V., Colbry, D., Panchanathan, S.: Using a Haptic Belt to Convey Non-Verbal Communication Cues during Social Interactions to Individuals who are Blind. In: Proceedings of the IEEE International Workshop on Haptic Audio Visual Environments and Games, pp. 13–18 (2008)
McDaniel, T.L., Krishna, S., Colbry, D., Panchanathan, S.: Using Tactile Rhythm to Convey Interpersonal Distances to Individuals who are Blind. In: Proceedings of the CHI 2009 Extended Abstracts on Human Factors in Computing Systems, pp. 4669–4674 (2009)
Krishna, S., Bala, S., McDaniel, T., McGuire, S., Panchanathan, S.: VibroGlove: An Assistive Technology Aid for Conveying Facial Expressions. In: Proceedings of the CHI 2010 Extended Abstracts on Human Factors in Computing Systems, pp. 3637–3642 (2010)
Krishna, S., Bala, S., Panchanathan, S.: Exploring the Dorsal Surface of the Fingers for Visio-Haptic Sensory Substitution. In: Proceedings of the IEEE International Symposium on Haptic Audio-Visual Environments and Games (HAVE), pp. 1–6 (2010)
Liu, L., Li, H.: Manifold of Facial Expressions for Tactile Perception. In: Proceedings of the IEEE 9th Workshop on Multimedia Signal Processing, pp. 239–242 (2007)
Tsetserukou, D., Neviarouskaya, A.: iFeel_IM!: Augmenting Emotions during Online Communication. IEEE Computer Graphics and Applications 30(5), 72–80 (2010)
Lemmens, P., Crompvoets, F., Brokken, D., van den Eerenbeemd, J., De Vries, G.-J.: A Body-Conforming Tactile Jacket to Enrich Movie Viewing. In: Proceedings of the Third Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 7–12 (2009)
Benali-Khoudja, M., Hafez, M., Sautour, A., Jumpertz, S.: Towards a New Tactile Language to Communicate Emotions. In: Proceedings of the IEEE International Conference Mechatronics and Automation, pp. 286–291 (2005)
Edwards, N., Rosenthal, J., Moberly, D., Lindsay, J., Blair, K., Krishna, S., McDaniel, T., Panchanathan, S.: A Pragmatic Approach to the Design and Implementation of a Vibrotactile Belt and its Applications. In: Proceedings of the IEEE International Workshop on Haptic Audio Visual Environments and Games, pp. 13–18 (2009)
Rosenthal, J., Edwards, N., Villanueva, D., Krishna, S., McDaniel, T., Panchanathan, S.: Design, Implementation, and Case Study of a Pragmatic Vibrotactile Belt. IEEE Transactions on Instrumentation and Measurement 60(1), 114–125 (2011)
Piateski, E., Jones, L.: Vibrotactile Pattern Recognition on the Arm and Torso. In: Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 90–95 (2005)
Geldard, F.A., Sherrick, C.E.: The Cutaneous ‘Rabbit’: A Perceptual Illusion. Science 178(4057), 178–179 (1972)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
McDaniel, T., Bala, S., Rosenthal, J., Tadayon, R., Tadayon, A., Panchanathan, S. (2014). Affective Haptics for Enhancing Access to Social Interactions for Individuals Who are Blind. In: Stephanidis, C., Antona, M. (eds) Universal Access in Human-Computer Interaction. Design and Development Methods for Universal Access. UAHCI 2014. Lecture Notes in Computer Science, vol 8513. Springer, Cham. https://doi.org/10.1007/978-3-319-07437-5_40
Download citation
DOI: https://doi.org/10.1007/978-3-319-07437-5_40
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07436-8
Online ISBN: 978-3-319-07437-5
eBook Packages: Computer ScienceComputer Science (R0)