Assistive Technologies as Effective Mediators in Interpersonal Social Interactions for Persons with Visual Disability

  • Sreekar Krishna
  • Sethuraman Panchanathan
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6180)


In this paper, we discuss the use of assistive technologies for enriching the social interactions of people who are blind and visually impaired with their sighted counterparts. Specifically, we describe and demonstrate two experiments with the Social Interaction Assistant for, a) providing rehabilitative feedback for reducing stereotypic body mannerisms which are known to impede social interactions, and b) provide an assistive technology for accessing facial expressions of interaction partners. We highlight the importance of these two problems in everyday social interactions of the visually disabled community. We propose novel use of wearable computing technologies (both sensing and actuating technologies) for augmenting sensory deficiencies of the user population, while ensuring that their cognitive faculties are not compromised in any manner. Computer vision, motion sensing and haptic technologies are combined in the proposed platform towards enhancing social interactions of the targeted user population.


Assistive Technology Social Interactions Dyadic Interpersonal Interaction Computer Vision Haptic Technology Motion Sensors 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Knapp, M.L., Hall, J.A.: Nonverbal Communication in Human Interaction. Wadsworth Publishing, Belmont (2005)Google Scholar
  2. 2.
    Krishna, S., Balasubramanian, V., Black, J., Panchanathan, S.: Person-Specific Characteristic Feature Selection for Face Recognition. In: Boulgoris, N.V. (ed.) Biometrics: Theory, Methods, and Applications (IEEE Press Series on Computational Intelligence). Wiley-IEEE Press (2009)Google Scholar
  3. 3.
    Shinohara, K., Tenenberg, J.: A blind person’s interactions with technology. Communications of the ACM 52, 58 (2009)CrossRefGoogle Scholar
  4. 4.
    Jindal-Snape, D.: Use of Feedback from Sighted Peers in Promoting Social Interaction Skills. Journal of Visual Impairment and Blindness 99, 1–16 (2005)Google Scholar
  5. 5.
    Réhman, S.U., Liu, L.: Vibrotactile Rendering of Human Emotions on the Manifold of Facial Expressions. Journal of Multimedia 3 (2008)Google Scholar
  6. 6.
    Krishna, S., Colbry, D., Black, J., Balasubramanian, V., Panchanathan, S.: A Systematic Requirements Analysis and Development of an Assistive Device to Enhance the Social Interaction of People Who are Blind or Visually Impaired. In: Workshop on Computer Vision Applications for the Visually Impaired, CVAVI 2008 (2008)Google Scholar
  7. 7.
    Krishna, S., McDaniel, T., Panchanathan, S.: Embodied Social Interaction Assistant, TR-10-001, Tempe, USA: Arizona State University (2010),
  8. 8.
    McDaniel, T., Krishna, S., Balasubramanian, V., Colbry, D., Panchanathan, S.: Using a haptic belt to convey non-verbal communication cues during social interactions to individuals who are blind. In: IEEE Intl. Workshop on Haptic Audio visual Environments and Games, HAVE 2008, pp. 13–18 (2008)Google Scholar
  9. 9.
    Krishna, S., Little, G., Black, J., Panchanathan, S.: A wearable face recognition system for individuals with visual impairments. In: Proc. 7th Intel ACM SIGACCESS Conf. on Computers and accessibility, pp. 106–113 (2005)Google Scholar
  10. 10.
    Eichel, V.J.: A taxonomy for mannerism of blind children. J. of Visual Impairment & Blindness 73, 167–178 (1979)Google Scholar
  11. 11.
    Krishna, S., Bala, S., McDaniel, T., McGuire, S., Panchanathan, S.: VibroGlove: An Assistive Technology Aid for Conveying Facial Expressions. In: Proc. 28th Intl. Conf. extended abstracts on Human factors in computing systems (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Sreekar Krishna
    • 1
  • Sethuraman Panchanathan
    • 1
  1. 1.Center for Cognitive Ubiquitous Computing (CubiC), Fulton School of EngineeringArizona State UniversityTempeUSA

Personalised recommendations