Sainet: An Image Processing App for Assistance of Visually Impaired People in Social Interaction Scenarios
This work describes a mobile application (Sainet) for image processing as an assistive technology devoted to visually impaired users. The app is targeted to the Android platform and usually executed in a mobile device equipped with a back camera for image acquisition. Moreover, a wireless bluetooth headphone provides the audio feedback to the user. Sainet has been conceived as an assistance tool to the user in a social interaction scenario. It is capable of providing audible information about the number and position (distance and orientation) of the interlocutors in the user frontal scenario. For validation purposes the app has been tested by a blind user who has provided valuable insights about its strengths and weaknesses.
KeywordsImage processing Mobile computing Visually impaired assistance
This work describes the results for the project SAINET funded by a grant from the Indra-UCLM university Chair and the Adecco Foundation. The authors want to acknowledge the received collaboration from the VISILAB Research Group and specially to Sergio Vera, Francisco Torres and Jesús Manzano.
- 1.Baggio, D.L., Emami, S., et al.: Mastering OpenCV with Practical Computer Vision Projects. Packt Publishing, Birmingham (2012)Google Scholar
- 2.Deniz, O., Salido, J., Bueno, G.: Programación de Apps de Visión Artificial. Bubok Publishing S.L. (2013). http://visilab.etsii.uclm.es
- 3.Deniz, O., et al.: A vision-based localization algorithm for an indoor navigation app. In: 8th International Conference on Next Generation Mobile Applications, Services and Technologies, pp. 7–12. IEEE (2014)Google Scholar
- 4.Bueno, G., Deniz, O., et al.: Learning Image Processing with OpenCV. Packt Publishing, Birmingham (2015)Google Scholar
- 9.Gade, L., Krishna, S., Panchanathan, S.: Person localization in a wearable camera platform towards assistive technology for social interactions. Special Issue on Media Solutions that Improving Accessibility to Disabled Users, Ubiquitous Computing and Communication Journal (2010)Google Scholar
- 10.Krishna, S., Colbry, D., et al.: A systematic requirements analysis and development of an assistive device to enhance the social interaction of people who are blind or visually impaired. In: Workshop on Computer Vision Applications for the Visually Impaired Conducted Along with European Computer Vision Conference (ECCV), Marseille, France (2008)Google Scholar
- 11.Krishna, S., Panchanathan, S.: Assistive technologies as effective mediators in interpersonal social interactions for persons with visual disability. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010, Part II. LNCS, vol. 6180, pp. 316–323. Springer, Heidelberg (2010)CrossRefGoogle Scholar
- 12.Terven, J.R., Salas, J., Raducanu, B.: New opportunities for computer vision-based assistive technology systems for the visually impaired. J. Comput. 4, 52–58 (2014). IEEE Computer SocietyGoogle Scholar
- 14.Zhu, X., Ramanan, D.: Face detection, pose estimation and landmark localization in the wild. In: Computer Vision and Pattern Recognition (CVPR) (2012)Google Scholar
- 16.Ivanchenko, V., Coughlan, J.M., Shen, H.: Crosswatch: a camera phone system for orienting visually impaired pedestrians at traffic intersections. In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds.) ICCHP 2008. LNCS, vol. 5105, pp. 1122–1128. Springer, Heidelberg (2008)CrossRefGoogle Scholar
- 17.Yang, X., Tian, Y.: Robust door detection in unfamiliar environments by combining edge and corner features. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 57–64 (2010)Google Scholar
- 18.Winlock, T., Christiansen, E., Belongie, S.: Toward real-time Grocery detection for the visually impaired. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 49–56 (2010)Google Scholar