Abstract
Designers create sketches, diagrams, and other visual media to both externalize a specific design concept as well as to explore design spaces. The largely visual and spatial nature of these diagrams used to support design activities poses several challenges for blind and visually impaired (BVI) designers to participate along sighted peers. This challenge includes the creation of tools to support the teaching of tactile graphics and their collaborative use in the context of design education. In efforts to address several of these challenges, we present PantoGuide, a low-cost system that provides audio and haptic guidance, via skin-stretch feedback to the dorsum of a user’s hand while the user explores a tactile graphic overlaid on a touchscreen. This system allows programming of haptic guidance patterns and cues for tactile graphics that can be experienced by students learning remotely or that can be reviewed by a student independently.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Baker, C. M., Milne, L. R., Scofield, J., Bennett, C. L., & Ladner, R. E. (2014). Tactile graphics with a voice: Using qr codes to access text in tactile graphics. In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility (pp. 75–82).
Beal, C. R., & Penny Rosenblum, L. (2018). Evaluation of the effectiveness of a tablet computer application (app) in helping students with visual impairments solve mathematics problems. Journal of visual impairment & blindness, 112(1), 5–19.
Bennett, C. L., Stangl, A., Siu, A. F., & Miele, J. A. (2019). Making nonvisually: Lessons from the field. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS’19 (pp. 279–285). New York, NY, USA: Association for Computing Machinery.
Campion G. (2005). The pantograph mk-ii: A haptic instrument. In The Synthesis of Three Dimensional Haptic Textures: Geometry, Control, and Psychophysics (pp. 45–58). Springer.
Chinello, F., Pacchierotti, C., Bimbo, J., Tsagarakis, N. G., & Prattichizzo, D. (2017). Design and evaluation of a wearable skin stretch device for haptic guidance. IEEE Robotics and Automation Letters, 3(1), 524–531.
Doush, I. A., Pontelli, E., Son, T. C., Simon, D., & Ma, O. (2010). Multimodal presentation of two-dimensional charts: An investigation using open office xml and microsoft excel. ACM Transactions on Accessible Computing (TACCESS), 3(2), 1–50.
Eppler, M. J., & Kernbach, S. (2016). Dynagrams: Enhancing design thinking through dynamic diagrams. Design Studies, 47, 91–117.
Fusco, G., & Morash, V. S. (2015). The tactile graphics helper: Providing audio clarification for tactile graphics using machine vision. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (pp. 97–106).
Goldschmidt, G. (1994). On visual design thinking: The vis kids of architecture. Design Studies, 15(2), 158–174.
Gorlewicz, J. L., Tennison, J. L., Palani, H. P., & Giudice, N. A. (2018). The graphical access challenge for people with visual impairments: Positions and pathways forward. In Interactive Multimedia-Multimedia Production and Digital Storytelling. IntechOpen.
Kernbach S., & Nabergoj, A. S. (2018). Visual design thinking: Understanding the role of knowledge visualization in the design thinking process. In 2018 22nd International Conference Information Visualisation (IV), pages 362–367. IEEE, 2018.
Landau, S., Russell, M., & Erin, J. N. (2006). Using the talking tactile tablet as a testing accommodation. RE: View, 38(1), 7.
Li, J., Kim, S., Miele, J. A., Agrawala, M., & Follmer, S. (2019). Editing spatial layouts through tactile templates for people with visual impairments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (pp. 1–11).
Lieberman, J., & Breazeal, C. (2007). Tikl: Development of a wearable vibrotactile feedback suit for improved human motor learning. IEEE Transactions on Robotics, 23(5), 919–926.
MacLean, K. E., Schneider, O. S., & Seifi, H. (2017). Multisensory haptic interactions: Understanding the sense and designing for it. In The Handbook of Multimodal-Multisensor Interfaces: Foundations, User Modeling, and Common Modality Combinations-Volume 1, pp. 97–142.
Melfi, G., Müller, K., Schwarz, T., Jaworek, G., & Stiefelhagen, R. (2020). Understanding what you feel: A mobile audio-tactile system for graphics used at schools with students with visual impairment. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1–12).
Méndez, E., Yoshida, S., Noma, H., Lindeman, R. W., Yanagida, Y., Masaki, S., & Hosaka, K. (2005). Haptic-assisted guidance system for navigating volumetric data sets. In First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference (pp. 531–534). IEEE.
Morash, V., & Mckerracher, A. (2014). The relationship between tactile graphics and mathematics for students with visual impairments. Terra Haptica, 4, 13–22.
Muehlbradt, A., Atreya, M., Guinness, D., & Kane, S. K. (2018). Exploring the design of audio-kinetic graphics for education. In Proceedings of the 20th ACM International Conference on Multimodal Interaction (pp. 455–463).
Nasser, A., Zhu, K., & Rao, P. V. M. (2018). Colortact: A finger wearable audio-tactile device using customizable color tagging. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers (pp. 178–181).
Norman, S. L., Doxon, A. J., Gleeson, B. T., & Provancher, W. R. (2014). Planar hand motion guidance using fingertip skin-stretch feedback. IEEE transactions on haptics, 7(2), 121–130.
Oron-Gilad, T., Downs, J. L., Gilson, R. D., & Hancock, P. A. (2007). Vibrotactile guidance cues for target acquisition. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 37(5), 993–1004.
Penny Rosenblum, L., Cheng, L., & Beal, C. R. (2018). Teachers of students with visual impairments share experiences and advice for supporting students in understanding graphics. Journal of visual impairment & blindness, 112(5), 475–487.
Penny Rosenblum, L., Ristvey, J., & Hospitál, L. (2019). Supporting elementary school students with visual impairments in science classes. Journal of Visual Impairment & Blindness, 113(1), 81–88.
Penny Rosenblum, L., Cheng, L., Zebehazy, K., Emerson, R. W., & Beal, C. R. (2020). Teachers’ descriptions of mathematics graphics for students with visual impairments: A preliminary investigation. Journal of Visual Impairment & Blindness, 114(3), 231–236.
Pölzer, S., Schnelle-Walka, D., Pöll, D., Heumader, P., & Miesenberger, K. (2013). Making brainstorming meetings accessible for blind users. In AAATE Conference, 2013.
Pongrac, H. (2006). Vibrotactile perception: Differential effects of frequency, amplitude, and acceleration. In 2006 IEEE International Workshop on Haptic Audio Visual Environments and Their Applications (HAVE 2006) (pp. 54–59). IEEE.
Regal, G., Mattheiss, E., Sellitsch, D., & Tscheligi, M. (2016). Talkingcards: Using tactile nfc cards for accessible brainstorming. In Proceedings of the 7th Augmented Human International Conference 2016 (pp. 1–7).
Rekimoto, J. (2014). Traxion: A tactile interaction device with virtual force sensation. In ACM SIGGRAPH 2014 Emerging Technologies (pp. 1–1).
Scheggi, S., Talarico, A., & Prattichizzo, D. (2014). A remote guidance system for blind and visually impaired people via vibrotactile haptic feedback. In 22nd Mediterranean Conference on Control and Automation, pages 20–23. IEEE, 2014.
Schnelle-Walka, D., Alavi, A., Ostie, P., Mühlhäuser, M., & Kunz, A. (2014). A mind map for brainstorming sessions with blind and sighted persons. In International Conference on Computers for Handicapped Persons (pp. 214–219). Springer.
Shen, H., Edwards, O., Miele, J., & Coughlan, J. M. (2013). Camio: A 3d computer vision system enabling audio/haptic interaction with physical objects by blind users. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (pp. 1–2).
Shinohara, K., Wobbrock, J. O., & Pratt, W. (2018). Incorporating social factors in accessible design. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (pp. 149–160).
Spiers, A. J., & Dollar, A. M. (2016). Outdoor pedestrian navigation assistance with a shapechanging haptic interface and comparison with a vibrotactile device. In 2016 IEEE Haptics Symposium (HAPTICS) (pp. 34–40). IEEE.
Suthers, D. D. (2001). Towards a systematic study of representational guidance for collaborative learing discourse. Journal of Universal Computer Science, 7(3), 254–277.
Suzuki, R., Stangl, A., Gross, M. D., & Yeh, T. Fluxmarker: Enhancing tactile graphics with dynamic tactile markers. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility, pages 190–199, 2017.
Torres M. J. R., & Barwaldt, R. (2019). Approaches for diagrams accessibility for blind people: A systematic review. In 2019 IEEE Frontiers in Education Conference (FIE) (pp. 1–7). IEEE.
Walker, J. M., Zemiti, N., Poignet, P., & Okamura, A. M. (2019). Holdable haptic device for 4-dof motion guidance. In 2019 IEEE World Haptics Conference (WHC) (pp. 109–114). IEEE.
Yem, V., Otsuki, M., & Kuzuoka, H. (2015). Development of wearable outer-covering haptic display using ball effector for hand motion guidance. In Haptic Interaction (pp. 85–89). Springer.
Yu, W., & Brewster, S. (2002). Comparing two haptic interfaces for multimodal graph rendering. In Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002 (pp. 3–9). IEEE.
Yu, W., Ramloll, R., Brewster, S., & Ridel, B. (2001). Exploring computer generated line graphs through virtual touch. In Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat. No. 01EX467) (Vol. 1, pp. 72–75). IEEE.
Zebehazy, K. T., & Wilton, A. P. (2014a). Quality, importance, and instruction: The perspectives of teachers of students with visual impairments on graphics use by students. Journal of visual impairment & blindness, 108(1), 5–16.
Zebehazy, K. T., & Wilton, A. P. (2014b). Charting success: The experience of teachers of students with visual impairments in promoting student use of graphics. Journal of Visual Impairment & Blindness, 108(4), 263–274.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Siu, A.F., Chase, E.D.Z., Kim, G.SH., Boadi-Agyemang, A., Gonzalez, E.J., Follmer, S. (2021). Haptic Guidance to Support Design Education and Collaboration for Blind and Visually Impaired People. In: Meinel, C., Leifer, L. (eds) Design Thinking Research . Understanding Innovation. Springer, Cham. https://doi.org/10.1007/978-3-030-76324-4_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-76324-4_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-76323-7
Online ISBN: 978-3-030-76324-4
eBook Packages: Business and ManagementBusiness and Management (R0)