Abstract
This work describes a mobile application (Sainet) for image processing as an assistive technology devoted to visually impaired users. The app is targeted to the Android platform and usually executed in a mobile device equipped with a back camera for image acquisition. Moreover, a wireless bluetooth headphone provides the audio feedback to the user. Sainet has been conceived as an assistance tool to the user in a social interaction scenario. It is capable of providing audible information about the number and position (distance and orientation) of the interlocutors in the user frontal scenario. For validation purposes the app has been tested by a blind user who has provided valuable insights about its strengths and weaknesses.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Vision and Intelligent Systems Research Group at University of Castilla-La Mancha.
- 2.
This message is a translation for the actual Spanish implementation.
References
Baggio, D.L., Emami, S., et al.: Mastering OpenCV with Practical Computer Vision Projects. Packt Publishing, Birmingham (2012)
Deniz, O., Salido, J., Bueno, G.: Programación de Apps de Visión Artificial. Bubok Publishing S.L. (2013). http://visilab.etsii.uclm.es
Deniz, O., et al.: A vision-based localization algorithm for an indoor navigation app. In: 8th International Conference on Next Generation Mobile Applications, Services and Technologies, pp. 7–12. IEEE (2014)
Bueno, G., Deniz, O., et al.: Learning Image Processing with OpenCV. Packt Publishing, Birmingham (2015)
Manduchi, R., Coughlan, J.: (Computer) vision without sight. Commun. ACM 55, 96–104 (2012)
Dakopoulos, D., Bourbakis, N.G.: Wearable obstacle avoidance electronic travel aids for blind: a survey. Trans. Syst. Man Cybern. Part C 40(1), 25–35 (2010)
Velázquez, R.: Wearable assistive devices for the blind. In: Lay-Ekuakille, A., Mukhopadhyay, S.C. (eds.) Wearable and Autonomous Biomedical Devices and Systems for Smart Environment. LNEE, vol. 75, pp. 331–349. Springer, Heidelberg (2010)
Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. (IJCV) 57(2), 137–154 (2004)
Gade, L., Krishna, S., Panchanathan, S.: Person localization in a wearable camera platform towards assistive technology for social interactions. Special Issue on Media Solutions that Improving Accessibility to Disabled Users, Ubiquitous Computing and Communication Journal (2010)
Krishna, S., Colbry, D., et al.: A systematic requirements analysis and development of an assistive device to enhance the social interaction of people who are blind or visually impaired. In: Workshop on Computer Vision Applications for the Visually Impaired Conducted Along with European Computer Vision Conference (ECCV), Marseille, France (2008)
Krishna, S., Panchanathan, S.: Assistive technologies as effective mediators in interpersonal social interactions for persons with visual disability. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010, Part II. LNCS, vol. 6180, pp. 316–323. Springer, Heidelberg (2010)
Terven, J.R., Salas, J., Raducanu, B.: New opportunities for computer vision-based assistive technology systems for the visually impaired. J. Comput. 4, 52–58 (2014). IEEE Computer Society
Becker, S., Miron-Shatz, T., et al.: mHealth 2.0: experiences, possibilities, and perspectives. JMIR mHealth uHealth 2(2), 1–12 (2014)
Zhu, X., Ramanan, D.: Face detection, pose estimation and landmark localization in the wild. In: Computer Vision and Pattern Recognition (CVPR) (2012)
Yi, C., et al.: Finding objects for assisting blind people. Netw. Model. Anal. Health. Inform. Bioinf. 2, 71–79 (2013). Springer
Ivanchenko, V., Coughlan, J.M., Shen, H.: Crosswatch: a camera phone system for orienting visually impaired pedestrians at traffic intersections. In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds.) ICCHP 2008. LNCS, vol. 5105, pp. 1122–1128. Springer, Heidelberg (2008)
Yang, X., Tian, Y.: Robust door detection in unfamiliar environments by combining edge and corner features. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 57–64 (2010)
Winlock, T., Christiansen, E., Belongie, S.: Toward real-time Grocery detection for the visually impaired. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 49–56 (2010)
Acknowledgments
This work describes the results for the project SAINET funded by a grant from the Indra-UCLM university Chair and the Adecco Foundation. The authors want to acknowledge the received collaboration from the VISILAB Research Group and specially to Sergio Vera, Francisco Torres and Jesús Manzano.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Salido, J., Deniz, O., Bueno, G. (2016). Sainet: An Image Processing App for Assistance of Visually Impaired People in Social Interaction Scenarios. In: Ortuño, F., Rojas, I. (eds) Bioinformatics and Biomedical Engineering. IWBBIO 2016. Lecture Notes in Computer Science(), vol 9656. Springer, Cham. https://doi.org/10.1007/978-3-319-31744-1_42
Download citation
DOI: https://doi.org/10.1007/978-3-319-31744-1_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-31743-4
Online ISBN: 978-3-319-31744-1
eBook Packages: Computer ScienceComputer Science (R0)