Sainet: An Image Processing App for Assistance of Visually Impaired People in Social Interaction Scenarios

  • Jesus Salido
  • Oscar Deniz
  • Gloria BuenoEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9656)


This work describes a mobile application (Sainet) for image processing as an assistive technology devoted to visually impaired users. The app is targeted to the Android platform and usually executed in a mobile device equipped with a back camera for image acquisition. Moreover, a wireless bluetooth headphone provides the audio feedback to the user. Sainet has been conceived as an assistance tool to the user in a social interaction scenario. It is capable of providing audible information about the number and position (distance and orientation) of the interlocutors in the user frontal scenario. For validation purposes the app has been tested by a blind user who has provided valuable insights about its strengths and weaknesses.


Image processing Mobile computing Visually impaired assistance 



This work describes the results for the project SAINET funded by a grant from the Indra-UCLM university Chair and the Adecco Foundation. The authors want to acknowledge the received collaboration from the VISILAB Research Group and specially to Sergio Vera, Francisco Torres and Jesús Manzano.


  1. 1.
    Baggio, D.L., Emami, S., et al.: Mastering OpenCV with Practical Computer Vision Projects. Packt Publishing, Birmingham (2012)Google Scholar
  2. 2.
    Deniz, O., Salido, J., Bueno, G.: Programación de Apps de Visión Artificial. Bubok Publishing S.L. (2013).
  3. 3.
    Deniz, O., et al.: A vision-based localization algorithm for an indoor navigation app. In: 8th International Conference on Next Generation Mobile Applications, Services and Technologies, pp. 7–12. IEEE (2014)Google Scholar
  4. 4.
    Bueno, G., Deniz, O., et al.: Learning Image Processing with OpenCV. Packt Publishing, Birmingham (2015)Google Scholar
  5. 5.
    Manduchi, R., Coughlan, J.: (Computer) vision without sight. Commun. ACM 55, 96–104 (2012)CrossRefGoogle Scholar
  6. 6.
    Dakopoulos, D., Bourbakis, N.G.: Wearable obstacle avoidance electronic travel aids for blind: a survey. Trans. Syst. Man Cybern. Part C 40(1), 25–35 (2010)CrossRefGoogle Scholar
  7. 7.
    Velázquez, R.: Wearable assistive devices for the blind. In: Lay-Ekuakille, A., Mukhopadhyay, S.C. (eds.) Wearable and Autonomous Biomedical Devices and Systems for Smart Environment. LNEE, vol. 75, pp. 331–349. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  8. 8.
    Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. (IJCV) 57(2), 137–154 (2004)CrossRefGoogle Scholar
  9. 9.
    Gade, L., Krishna, S., Panchanathan, S.: Person localization in a wearable camera platform towards assistive technology for social interactions. Special Issue on Media Solutions that Improving Accessibility to Disabled Users, Ubiquitous Computing and Communication Journal (2010)Google Scholar
  10. 10.
    Krishna, S., Colbry, D., et al.: A systematic requirements analysis and development of an assistive device to enhance the social interaction of people who are blind or visually impaired. In: Workshop on Computer Vision Applications for the Visually Impaired Conducted Along with European Computer Vision Conference (ECCV), Marseille, France (2008)Google Scholar
  11. 11.
    Krishna, S., Panchanathan, S.: Assistive technologies as effective mediators in interpersonal social interactions for persons with visual disability. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010, Part II. LNCS, vol. 6180, pp. 316–323. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  12. 12.
    Terven, J.R., Salas, J., Raducanu, B.: New opportunities for computer vision-based assistive technology systems for the visually impaired. J. Comput. 4, 52–58 (2014). IEEE Computer SocietyGoogle Scholar
  13. 13.
    Becker, S., Miron-Shatz, T., et al.: mHealth 2.0: experiences, possibilities, and perspectives. JMIR mHealth uHealth 2(2), 1–12 (2014)CrossRefGoogle Scholar
  14. 14.
    Zhu, X., Ramanan, D.: Face detection, pose estimation and landmark localization in the wild. In: Computer Vision and Pattern Recognition (CVPR) (2012)Google Scholar
  15. 15.
    Yi, C., et al.: Finding objects for assisting blind people. Netw. Model. Anal. Health. Inform. Bioinf. 2, 71–79 (2013). SpringerCrossRefGoogle Scholar
  16. 16.
    Ivanchenko, V., Coughlan, J.M., Shen, H.: Crosswatch: a camera phone system for orienting visually impaired pedestrians at traffic intersections. In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds.) ICCHP 2008. LNCS, vol. 5105, pp. 1122–1128. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  17. 17.
    Yang, X., Tian, Y.: Robust door detection in unfamiliar environments by combining edge and corner features. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 57–64 (2010)Google Scholar
  18. 18.
    Winlock, T., Christiansen, E., Belongie, S.: Toward real-time Grocery detection for the visually impaired. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 49–56 (2010)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Department of IEEACCastilla-La Mancha UniversityCiudad RealSpain

Personalised recommendations