Augmented Reality for People with Visual Impairments: Designing and Creating Audio-Tactile Content from Existing Objects

  • Lauren ThevinEmail author
  • Anke M. BrockEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10897)


Tactile maps and diagrams are widely used as accessible graphical media for people with visual impairments, in particular in the context of education. They can be made interactive by augmenting them with audio feedback. It is however complicated to create audio-tactile graphics that have rich and realistic tactile textures. To overcome these limitations, we propose a new augmented reality approach allowing novices to easily and quickly augment real objects with audio feedback. In our user study, six teachers created their own audio-augmentation of objects, such as a botanical atlas, within 30 min or less. Teachers found the tool easy to use and were confident about re-using it. The resulting augmented objects allow two modes: exploration mode provides feedback on demand about an element, while quiz mode provides questions and answers. We evaluated the resulting audio-tactile material with five visually impaired children. Participants found the resulting interactive graphics exciting to use independently of their mental imagery skills.



We thank the participants (teachers and students) especially C. Briant; and J. Laviole (Reality Tech) and J. Albouys for participating in the design of this tool. Done with the support of the EU Erasmus+ Pr. no 2016-1-EL01-KA201-023731.


  1. 1.
    Edman, P.: Tactile Graphics. American Foundation for the Blind, New York (1992)Google Scholar
  2. 2.
    Brock, A.M., Truillet, P., Oriola, B., Picard, D., Jouffrais, C.: Interactivity improves usability of geographic maps for visually impaired people. Hum. Comput. Interact. 30(2), 156–194 (2015)CrossRefGoogle Scholar
  3. 3.
    Ducasse, J., Brock, A.M., Jouffrais, C.: Accessible interactive maps for visually impaired users. In: Pissaloux, E., Velázquez, R. (eds.) Mobility of Visually Impaired People: Fundamentals and ICT Assistive Technologies, pp. 537–584. Springer, Cham (2018). Scholar
  4. 4.
    Cattaneo, Z., Vecchi, T.: Blind Vision: The Neuroscience of Visual Impairment. MIT Press, Cambridge (2011). Scholar
  5. 5.
    Tatham, A.F.: The design of tactile maps: theoretical and practical considerations. In: Rybaczak, K., Blakemore, M. (eds.) Proceedings of International Cartographic Association: Mapping the Nations, ICA, London, UK, pp. 157–166 (1991).
  6. 6.
    Gotzelmann, T.: LucentMaps 3D printed audiovisual tactile maps for blind and visually impaired people. In: The 18th ACM Conference ASSETS 2016, pp. 81–90 (2016)Google Scholar
  7. 7.
    Giraud, S., Brock, A.M., Macé, M.J.-M., Jouffrais, C.: Map learning with a 3D printed interactive small-scale model: improvement of space and text memorization in visually impaired students. Front. Psychol. 8, 930 (2017). Scholar
  8. 8.
    Klatzky, R.L., Lederman, S.J.: Touch. In: Handbook of Psychology (2003)Google Scholar
  9. 9.
    Albouys-Perrois, J., Laviole, J., Briant, C., Brock, A.: Towards a multisensory augmented reality map for blind and low vision people: a participatory design approach. In: International Conference CHI 2018 (2018)Google Scholar
  10. 10.
    Azuma, R., Behringer, R., Feiner, S., Julier, S., Macintyre, B.: Recent advances in augmented reality. In: IEEE CG&A 2011, pp. 1–27, December 2001. Scholar
  11. 11.
    Daudén Roquet, C., Kim, J., Yeh, T.: 3D Folded PrintGami: transforming passive 3D printed objects to interactive by inserted paper origami circuits. In: DIS 2016, pp. 187–191 (2016).
  12. 12.
    Shi, L., Zhao, Y., Azenkot, S.: Markit and Talkit: a low-barrier toolkit to augment 3D printed models with audio annotations. In: Proceedings of the 30th Annual Symposium UIST 2017, pp. 493–506 (2017).
  13. 13.
    Laviole, J., Hachet, M.: PapARt: interactive 3D graphics and multi-touch augmented paper for artistic creation. In: Proceedings of the IEEE 3DUI 2012, pp. 3–6 (2012).
  14. 14.
    Hart, S.G.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload. Advances in Psychology, vol. 52, chap. 12, 1st edn, pp. 139–183. Elsevier (1988). Scholar
  15. 15.
    Laugwitz, B., Held, T., Schrepp, M.: Construction and evaluation of a user experience questionnaire. In: Holzinger, A. (ed.) USAB 2008. LNCS, vol. 5298, pp. 63–76. Springer, Heidelberg (2008). Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Inria BordeauxTalenceFrance
  2. 2.ENAC - University ToulouseToulouseFrance

Personalised recommendations