Skip to main content

Designing Mobile Tasks to Improve Art Description Accessibility for People with Visual Impairments

  • Conference paper
  • First Online:
ArtsIT, Interactivity and Game Creation (ArtsIT 2021)

Abstract

All people should be able to experience museums, but there are barriers for people with visual impairments (VIs) including few museums that have accessibility accommodations and having to plan their visit. There are museum and technical efforts to supply accessible experiences, but they require curation by experts, making it difficult for these solutions to scale. To address this problem, we used the Art Beyond Sight (ABS) Accessibility Guidelines as a framework to develop mobile tasks to guide laypeople in composing accessible artwork descriptions. We compared the ratings of 31 people with VIs and four docents on curations from Amazon’s Mechanical Turk between two approaches: 1) baseline tasks inspired from prior museum HCI research, and 2) our designed tasks. Both people with VIs and docents rated the second descriptions higher than the first in understandability and adherence to the ABS Accessibility Guidelines. The second descriptions vivid details and orientation information. Our work shows the potential to bring these tasks to a museum space.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Our project had 10 artworks, but removed two due to errors in the survey of people with VIs.

  2. 2.

    The research in which we based our BL_Emotions task had participants write emotions on paper while they moved around the museum [4]. Therefore, we chose mobile device.

  3. 3.

    The research in which we based our BL_Story task had people author stories on stationary touchscreens in the exhibition [15]. While the touchscreen dimensions are not mentioned, Fig. 1 in the article shows they are larger than mobile devices. Thus, we chose computer.

  4. 4.

    The ABS Approach Artwork 3 had the descriptions but was missing the relative positions for ABS_General and ABS_Literal descriptions.

References

  1. Dragan Ahmetovic: Touch Screen Exploration of Visual Artwork for Blind People (2021). http://dragan.ahmetovic.it/pdf/ahmetovic2021touch.pdf

  2. Ahmetovic, D., Bernareggi, C., Keller, K., Mascetti, S.: MusA: artwork accessibility through augmented reality for people with low vision. In: Proceedings of the 18th International Web for All Conference (W4A 2021), pp. 1–9 (2021). https://doi.org/10.1145/3430263.3452441

  3. Ahmetovic, D., Gleason, C., Ruan, C., Kitani, K., Takagi, H., Asakawa, C.: NavCog: a navigational cognitive assistant for the blind. In: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2016), pp. 90–99 (2016). https://doi.org/10.1145/2935334.2935361

  4. Alelis, G., Bobrowicz, A., Ang, C.S.: Exhibiting emotion: capturing visitors’ emotional responses to museum artefacts. In: Marcus, A. (ed.) DUXU 2013. LNCS, vol. 8014, pp. 429–438. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39238-2_47

    Chapter  Google Scholar 

  5. Amazon Mechanical Turk: Amazon Mechanical Turk. https://www.mturk.com/. Accessed 24 Feb 2018

  6. Art Beyond Sight. AEB’s Guidelines for Verbal Description. http://www.artbeyondsight.org/handbook/acs-guidelines.shtml. Accessed 16 Feb 2019

  7. Art Beyond Sight: About Art Education for the Blind. http://www.artbeyondsight.org/sidebar/aboutaeb.shtml. Accessed 3 Aug 2020

  8. Art Beyond Sight: How Were These Tools Developed? Theory and Research. Retrieved August 3, 2020 from http://www.artbeyondsight.org/handbook/acs-toolsdeveloped.shtml. Accessed 3 Aug 2020

  9. Asakawa, S., Guerreiro, J., Ahmetovic, D., Kitani, K.M., Asakawa, C.: The present and future of museum accessibility for people with visual impairments. In: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility - ASSETS 2018, pp. 382–384 (2018). https://doi.org/10.1145/3234695.3240997

  10. Audio Description Project: American Council of the Blind. 2020. Museums Which Offer Audio Description. http://www.acb.org/adp/museums.html. Accessed 16 Apr 2020

  11. Bahram, S., Lavatelli, A.C.: Using Coyote to Describe the World – MW18: Museums and the Web 2018. https://mw18.mwconf.org/paper/using-coyote-to-describe-the-world/. Accessed 16 Mar 2019

  12. Bigham, J.P., et al.: VizWiz: nearly real-time answers to visual questions. In: Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology (UIST 2010), pp. 333–342 (2010). https://doi.org/10.1145/1866029.1866080

  13. Bigham, J.P., Jayant, C., Miller, A., White, B., Yeh, T.: VizWiz::LocateIt - enabling blind people to locate objects in their environment. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, pp. 65–72 (2010). https://doi.org/10.1109/CVPRW.2010.5543821

  14. Burton, M.A., Brady, E., Brewer, R., Neylan, C., Bigham, J.P., Hurst, A.: Crowdsourcing subjective fashion advice using VizWiz: challenges and opportunities. In: Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility (ASSETS 2012), pp.135–142. https://doi.org/10.1145/2384916.2384941

  15. Clarke, R., Vines, J., Wright, P., Bartindale, T., Shearer, J., McCarthy, J., Olivier, P.: MyRun: balancing design for reflection, recounting and openness in a museum-based participatory platform. In: Proceedings of the 2015 British HCI Conference (British HCI 2015), pp. 212–221 (2015). https://doi.org/10.1145/2783446.2783569

  16. Cock, M., Bretton, M., Fineman, A., France, R., Madge, C., Sharpe, M.: State of museum access 2018: does your museum website welcome and inform disabled visitors? VocalEyes (2018). https://vocaleyes.co.uk/state-of-museum-access-2018/. Accessed 8 Oct 2019

  17. Cosley, D., et al.: A tag in the hand: supporting semantic, social, and spatial navigation in museums. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2009), pp. 1953–1962 (2009). https://doi.org/10.1145/1518701.1518999

  18. Cosley, D., et al.: ArtLinks: fostering social awareness and reflection in museums. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2008), pp. 403–412 (2008). https://doi.org/10.1145/1357054.1357121

  19. Coyote. Coyote. Coyote. https://coyote.pics/. Accessed 7 Feb 2019

  20. Hoonlor, A., Ayudhya, S.P.N., Harnmetta, S., Kitpanon, S., Khlaprasit, K.: UCap: a crowdsourcing application for the visually impaired and blind persons on android smartphone. In: 2015 International Computer Science and Engineering Conference (ICSEC), pp. 1–6 (2015). https://doi.org/10.1109/ICSEC.2015.7401406

  21. Bartolome, J.I., Quero, L.C., Kim, S., Um, M.-Y., Cho, J.: Exploring art with a voice controlled multimodal guide for blind people. In: Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI 2019), pp. 383–390 (2019). https://doi.org/10.1145/3294109.3300994

  22. Lin, V.C.-W.: Slow looking: the art and practice of learning through observation. J. Museum Educ. 44(2), 218–222 (2019). https://doi.org/10.1080/10598650.2019.1576012

    Article  Google Scholar 

  23. MoMA: Accessibility|MoMA. The Museum of Modern Art. https://www.moma.org/visit/accessibility/#individuals-who-are-blind-or-have-low-vision. Accessed 4 Aug 2020

  24. Rector, K., Salmon, K., Thornton, D., Joshi, N., Morris, M.R.: Eyes-free art: exploring proxemic audio interfaces for blind and low vision art engagement. Proc. ACM. Interact. Mob. Wearable Ubiquit. Technol. 1(3), 1–21 (2017)

    Article  Google Scholar 

  25. Reich, C., Lindgren-Streicher, A., Beyer, M., Levent, N., Pursley, J., Mesiti, L.A.: Speaking Out on Art and Museums: A Study on the Needs and Preferences of Adults who Are Blind or Have Low Vision. Museum of Science, Boston and Art Beyond Sight (2011)

    Google Scholar 

  26. Sato, D., Oh, U., Naito, K., Takagi, H., Kitani, K., Asakawa, C.: NavCog3: an evaluation of a smartphone-based blind indoor navigation assistant with semantic features in a large-scale environment. In: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017), pp. 270–279 (2017). https://doi.org/10.1145/3132525.3132535

  27. Schweibenz, W.: Museums and Web 2.0: some thoughts about authority, communication, participation and trust. In: Styliaras, G., Koukopoulos, D., Lazarinis, F. (eds.) Handbook of Research on Technologies and Cultural Heritage: Applications and Environments, pp. 1–15. IGI Global (2011). https://doi.org/10.4018/978-1-60960-044-0.ch001

    Chapter  Google Scholar 

  28. Smithsonian American Art Museum: Verbal Description Tours. Smithsonian American Art Museum. https://americanart.si.edu/events/verbal-description-tours. Accessed 16 Mar 2019

  29. Smithsonian American Art Museum. Calendar. Smithsonian American Art Museum. https://americanart.si.edu/calendar. Accessed 7 Feb 2019

  30. The Andy Warhol Museum: Accessibility. The Andy Warhol Museum. https://www.warhol.org/accessibility-accommodations/. Accessed 8 Oct 2019

  31. Local Guides. https://maps.google.com/localguides/home. Accessed 14 Sep 2020

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kyle Rector .

Editor information

Editors and Affiliations

Appendix

Appendix

1.1 General Overview: Subject, Form, and Color

Table 6. * = p < 1.79e–3, ** = p < 1e–6, where significance is alpha/28

1.2 Orient the Viewer with Directions

Table 7. * = p < 1.79e–3, ** = p < 1e–6, where significance is alpha/28

1.3 Use Specific Words

Table 8. * = p < 1.79e–3, ** = p < 1e–6, where significance is alpha/28

1.4 Provide Vivid Details

Table 9. * = p < 1.79e–3, ** = p < 1e–6, where significance is alpha/28

1.5 Refer to Other Senses as Analogues for Vision

Table 10. * = p < 1.79e–3, ** = p < 1e–6, where significance is alpha/28

1.6 Explain Intangible Concepts with Analogies

Table 11. * = p < 1.79e–3, ** = p < 1e–6, where significance is alpha/28

1.7 Encourage Understanding Through Reenactment

Table 12. * = p < 1.79e–3, ** = p < 1e–6, where significance is alpha/28

Rights and permissions

Reprints and permissions

Copyright information

© 2022 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Corbett, M., Malik, J., Smith, V.R., Rector, K. (2022). Designing Mobile Tasks to Improve Art Description Accessibility for People with Visual Impairments. In: Wölfel, M., Bernhardt, J., Thiel, S. (eds) ArtsIT, Interactivity and Game Creation. ArtsIT 2021. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 422. Springer, Cham. https://doi.org/10.1007/978-3-030-95531-1_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-95531-1_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-95530-4

  • Online ISBN: 978-3-030-95531-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics