Abstract
Photographs are a powerful medium for recording moments and sharing them with others. However, visually-impaired users have quite limited access to photograph’s benefits. In this paper, we present an integrated system TouchPhoto, which provides visual-audio-tactile assistive features to allow visually-impaired users to take and understand photographs independently. A user can take photographs with auditory guidance and record several audio tags to aid recall of the photograph’s content. For comprehension, a user can listen to the audio tags embedded in a photograph and also touch the photograph using an electrostatic friction display. The latter is done after salient features in the photograph, e.g., human faces, are extracted to facilitate tactile recognition.
This project has been supported by an X-Project program (2016R1E1A2914792), and an IITP program (2017-0-00179), all funded by Korea Government (MSIP).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ahlberg, J.: CANDIDE-3-an updated parameterised face. Linǒping University, Technical report (2001)
FacePlusPlus Inc.: Face++ cognitive services (2015). http://www.faceplusplus.com/
Harada, S., Sato, D., Adams, D.W., Kurniawan, S., Takagi, H., Asakawa, C.: Accessible photo album: enhancing the photo sharing experience for people with visual impairment. In: Proceedings of the 31st SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), pp. 2127–2136 (2013)
Jayant, C., Ji, H., White, S., Bigham, J.P.: Supporting blind photography. In: Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2011), pp. 203–210 (2011)
Kim, S.C., Israr, A., Poupyrev, I.: Tactile rendering of 3D features on touch surfaces. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST 2013), pp. 531–538 (2013)
Klazky, R.L., Lederman, S.J., Hamilton, C., Grindley, M., Swenesen, R.H.: Feeling texture through a probe: effects of probe and surface geometry and exploratory factors. Percept. Psychophys. 65(4), 613–631 (2003)
Osgouei, R.H., Kim, J.R., Choi, S.: Improving 3D shape recognition with electrostatic friction display. IEEE Trans. Haptics 10(4), 533–544 (2017). https://ieeexplore.ieee.org/abstract/document/7937894
Paterson, M.: The Senses of Touch: Haptics. Affects and Technologies. Bloomsbury Academic, London (2007)
Vázquez, M., Steinfeld, A.: An assisted photography framework to help visually impaired users properly aim a camera. ACM Trans. Comput.-Hum. Interact. (TOCHI) 21(5), 25:1–25:29 (2014)
Voykinska, V., Azenkot, S., Wu, S., Leshed, G.: How blind people interact with visual content on social networking services. In: Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW 2016), pp. 1584–1595 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Yoo, Y., Lim, J., Cho, H., Choi, S. (2019). TouchPhoto: Enabling Independent Picture-Taking and Understanding of Photos for Visually-Impaired Users. In: Kajimoto, H., Lee, D., Kim, SY., Konyo, M., Kyung, KU. (eds) Haptic Interaction. AsiaHaptics 2018. Lecture Notes in Electrical Engineering, vol 535. Springer, Singapore. https://doi.org/10.1007/978-981-13-3194-7_62
Download citation
DOI: https://doi.org/10.1007/978-981-13-3194-7_62
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-3193-0
Online ISBN: 978-981-13-3194-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)