Abstract
Data visualizations are an essential strategy for summarizing and comprehending large datasets. However, it is challenging for visually impaired people (VIP) to access visual representations of data. Current accessibility solutions fall short in providing comprehensive access to such visualizations. Most VIP must listen to datasets one cell at a time with a text-to-speech tool, which does not allow the user to gather the “gist” of the dataset. To address this gap, we designed and evaluated Sonify. Sonify is a sonification tool that makes data visualizations accessible to VIP through audio and tactile interactions on a mobile app. VIP use Sonify’s scrubbing interaction to explore patterns in data through pitch changes in sound. We evaluated Sonify’s interactions through contextual inquiries, with (n = 8) VIP. Through Sonify, we demonstrate how a novel scrubbing interaction technique makes 2-variable linear graphs accessible to a broader range of people, including VIP.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Apple Accessibility (2014). https://www.apple.com/accessibility/ios/
Walker, B.N., Ehrenstein, A.: Pitch and pitch change interact in auditory displays. J. Exp. Psychol. Appl. 6(1), 15–30 (2000). https://doi.org/10.1037/1076-898X.6.1.15
Beyer, H., Holtzblatt, K.: Contextual Design: Defining Customer-Centered Systems. Morgan Kaufmann, San Francisco (2009)
Chew, Y.C., Davison, B., Walker, B.N.: From design to deployment: an auditory graphing software for math education. In: Proceedings of the 29th Annual International Technology & Persons With Disabilities Conference, San Diego (2014)
Data-Driven DJ: An Introduction to Data-Driven DJ. datadrivendj.com
Allen, C.D., Ballman, D., Begg, V., Miller-Jacobs, H.H., Muller, M., Nielsen, J., Spool, J.: User involvement in the design process: why, when & how? pp. 251–254 (1993). https://doi.org/10.1145/169059.169203
Chew, Y.C.: Assessing the use of auditory graphs for middle school mathematics. Dissertation. https://www.cc.gatech.edu/~ychew3/assets/ChewDissertation.pdf
Summers, E., Langston, J., Allison, R., Cowley, J.: Using SAS/GRAPH® to Create Visualizations That Also Support Tactile and Auditory Interaction, SAS Institute Inc., Cary, North Carolina. https://analytics.ncsu.edu/sesug/2012/RI-15.pdf
Bell, E.C., Mino, N.M.: Employment Outcomes for Blind and Visually Impaired Adults. https://nfb.org/images/nfb/publications/jbir/jbir15/jbir050202.html
Freedom Scientific. BLINDNESS SOLUTIONS: JAWS®. Freedom Scientific. www.freedomscientific.com/Products/Blindness/JAWS
Hersh, M., Johnson, M.A.: Assistive Technology for Visually Impaired and Blind People. Springer, London (2014)
Flowers, J.H., Buhman, D.C., Turnage, K.D.: Cross-modal equivalence of visual and auditory scatterplots for exploring bivariate data samples. Hum. Factors 39, 341–351 (1997)
Batterman, J.M., Martin, V.F., Yeung, D., Walker, B.N.: Connected cane: tactile button input for controlling gestures of iOS voiceover embedded in a white cane. Assist. Technol. 30(2), 91–99 (2018). https://doi.org/10.1080/10400435.2016.1265024
Kondak, Z., Liang, T., Tomlinson, B., Walker, B.N.: Web sonification sandbox - an easy-to-use web application for sonifying data and equations. In: Proceedings of the 3rd Web Audio Conference, London, UK (2017). http://eecs.qmul.ac.uk/~keno/24.pdf
Leporini, B., Buzzi, M.C., Buzzi, M.: Interacting with mobile devices via VoiceOver: usability and accessibility issues, pp. 339–348 (2012). https://doi.org/10.1145/2414536.2414591
National Federation of the Blind: Statistical facts about blindness in the United States
Neuhoff, J.G., Knight, R., Wayand, J.: Pitch change, sonification, and musical expertise: which way is up? July 2002. http://hdl.handle.net/1853/51370
Clark, R.E., Feldon, D.F., van Merriënboer, J., Yates, K.A., Early, S.: Cognitive task analysis. In: Handbook of Research on Educational Communications and Technology, Routledge (2007)
Thinking Aloud: The #1 Usability Tool. Nielsen Norman Group. www.nngroup.com/articles/thinking-aloud-the-1-usability-tool/
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Ali, S., Muralidharan, L., Alfieri, F., Agrawal, M., Jorgensen, J. (2020). Sonify: Making Visual Graphs Accessible. In: Ahram, T., Taiar, R., Colson, S., Choplin, A. (eds) Human Interaction and Emerging Technologies. IHIET 2019. Advances in Intelligent Systems and Computing, vol 1018. Springer, Cham. https://doi.org/10.1007/978-3-030-25629-6_70
Download citation
DOI: https://doi.org/10.1007/978-3-030-25629-6_70
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-25628-9
Online ISBN: 978-3-030-25629-6
eBook Packages: EngineeringEngineering (R0)