Skip to main content
SpringerLink
Log in

Usability and Accessibility Evaluation of the ICT Accessibility Requirements Tool Prototype

  • Conference paper
  • First Online:
Universal Access in Human-Computer Interaction. Novel Design Approaches and Technologies (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13308))

Included in the following conference series:

Abstract

The Accessibility Requirements Tool for Information and Communication Technologies (FRATIC) was developed within the work of a doctoral project, at the University of Trás-os-Montes and Alto Douro, and may be used at various stages of public procurement processes as well as projects and developments that include ICT products and services. This tool helps to consult, determine and assess the accessibility requirements for ICT products and services in European Standard EN 301 549 that supports the legislation in the field of public procurement for the countries of the European Union – Directive 2014/24/EU. This study focuses on the standardized usability and accessibility features evaluation of the FRATIC prototype, based on ISO 9241-11 metrics, other usability and accessibility evaluation criteria, as well as various standardized measurement tools and methods – such as Single Ease Question (SEQ) and System Usability Scale (SUS) – after conducting usability tests and interviews with 25 experts in the fields of accessibility, assistive technologies, and public procurement.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Designations of the three European standardization organizations: European Committee for Standardization (CEN), European Committee for Electrotechnical Standardization (CENELEC) and European Telecommunications Standards Institute (ETSI).

  2. 2.

    National Qualifications Framework - created in 2007 and regulated in June 2009, became effective in October 2010 (Decree No. 782/2009, July 23), with reference to the principles of the European Qualifications Framework (EQF).

References

  1. Comissão Europeia: People with disabilities have equal rights - TheEuropean Disability Strategy 2010–2020. Comissão Europeia. Comissão Europeia, Bruxelas (2010)

    Google Scholar 

  2. INE: Health and disabilities in Portugal: 2011. Instituto Nacional de Estatística, IP, Lisboa (2012)

    Google Scholar 

  3. Nações Unidas: Convenção sobre os Direitos das Pessoas com Deficiência. Nações Unidas, Nova York (2006)

    Google Scholar 

  4. Nações Unidas: Standard Rules on the Equalization of Opportunities forPersons with Disabilities. Nações Unidas, Nova York (1993)

    Google Scholar 

  5. Nações Unidas: Declaração de Salamanca sobre princípios, políticas e práticas na área das necessidades educativas especiais, Conferência Mund. Educ. Espec. (1994)

    Google Scholar 

  6. Martins, M., Gonçalves, R., Godinho, F., Novais, J.: Benefits of EN 301 549 for each group of People with Special Needs. In: Proceedings of the 8th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion, pp. 123–128 (2018)

    Google Scholar 

  7. ETSI, CEN, and CENELEC: EN 301 549 V3.1.1 - Accessibility requirements for ICT products and services. European Telecommunications Standards Institute (2019)

    Google Scholar 

  8. Parlamento Europeu: Diretiva (UE) 2014/24 do Parlamento Europeu e do Conselho de 26 de fevereiro de 2014 relativa aos contratos públicos e que revoga a Diretiva 2004/18/CE. Jornal Oficial da União Europeia. Estrasburgo, pp. 65–242 (2014)

    Google Scholar 

  9. McKinney, S., Horspool, A., Willers, R., Safie, O., Richlin, L.: Using Second Life with learning-disabled students in higher education. Innov. J. Online Educ. 5(2) (2008)

    Google Scholar 

  10. Foley, A., Ferri, B.A.: Technology for people, not disabilities: ensuring access and inclusion. J. Res. Spec. Educ. Needs 12(4), 192–200 (2012)

    Article  Google Scholar 

  11. Benfer, E.A.: The ADA Amendments Act: an overview of recent changes to the Americans with Disabilities Act. Advance 4, 53 (2010)

    Google Scholar 

  12. Architectural and Transportation Barriers Compliance Board: Telecommunications act accessibility guidelines (36 CFR Part 1193, RIN 3014-AA19). Federal Register, vol. 63, no. 22, pp. 5607–5641 (1998)

    Google Scholar 

  13. US Access Board: Electronic and information technology accessibility standards. Fed. Regist. 15, 2005 (2000)

    Google Scholar 

  14. US Access Board: Information and Communication Technology (ICT) - Revised 508 Standards and 255 Guidelines. US Federal Register, Washington (2017)

    Google Scholar 

  15. US Access Board: Information and Communication Technology (ICT) Standards and Guidelines, pp. 2912–2916 (2018)

    Google Scholar 

  16. Easton, C.: Website accessibility and the European Union: citizenship, procurement and the proposed Accessibility Act. Int. Rev. Law Comput. Technol. 27(1–2), 187–199 (2013)

    Google Scholar 

  17. ETSI, CEN, and CENELEC: EN 301 549 V1.1.1 - Accessibility requirements suitable for public procurement of ICT products and services in Europe. European Telecommunications Standards Institute. França (2014)

    Google Scholar 

  18. Lecerf, M.: Briefing - EU Legislation in Progress, European Accessibility Act. Parlamento Europeu, Bruxelas (2017)

    Google Scholar 

  19. Parlamento Europeu: Diretiva (UE) 2019/882, relativa aos requisitos de acessibilidade dos produtos e serviços. Jornal Oficial da União Europeia (2019). https://eur-lex.europa.eu/legal-content/PT/TXT/HTML/?uri=CELEX:32019L0882&from=EN. Accessed 30 May 2021

  20. Comissão Europeia: European Commission - Press release - Comissão saúda acordo para tornar mais acessíveis sítios Web e aplicações móveis do setor público. Comissão Europeia (2016)

    Google Scholar 

  21. Astbrink, G., Tibben, W.: ICT accessibility criteria in public procurement in OECD countries - the current situation. In: International Conference on Universal Access in Human-Computer Interaction, pp. 155–164 (2013)

    Google Scholar 

  22. Ahtonen, A., Pardo, R.: The Accessibility Act-Using the single market to promote fundamental rights. Eur. Policy Cent. 12 (2013)

    Google Scholar 

  23. Cohen, L., Manion, L., Morrison, K.: Research Methods in Education, 8th edn. Routledge, London (2017)

    Book  Google Scholar 

  24. ISO 9241-11: ISO 9241-11:2018 - Ergonomics of human-system interaction—Part 11: Usability: Definitions and concepts, Geneva, Switz. Int. Organ. Stand. (2018)

    Google Scholar 

  25. Sauro, J.: If you could only ask one question, use this one. MeasuringU (2010). https://measuringu.com/single-question/. Accessed 22 Apr 2020

  26. Sauro, J., Lewis, J.R.: Quantifying the User Experience: Practical Statistics for User Research. Morgan Kaufmann, Burlington (2016)

    Google Scholar 

  27. Padrini-Andrade, L., et al.: Evaluation of usability of a neonatal health information system according to the user’s perception. Rev. Paul. Pediatr. 37(1), 90–96 (2019)

    Google Scholar 

  28. Story, M., Mueller, J.L., Mace, R.L.: The universal design file: designing for people of all ages and abilities, Revised edn. (1998)

    Google Scholar 

  29. ISO 9241-11: ISO 9241-11 - Ergonomic requirements for office work with visual display terminals (VDTs), Geneva, Switz. Int. Organ. Stand., vol. 45, no. 9 (1998)

    Google Scholar 

  30. Sauro, J.: What is a good task-completion rate? MeasuringU (2011). https://measuringu.com/task-completion/. Accessed 09 Apr 2021

  31. Sauro, J.: 10 Benchmarks for user experience metrics. MeasuringU (2012)

    Google Scholar 

  32. Brooke, J.: SUS: a “quick and dirty’usability” usability scale. In: Usability Evaluation in Industry, p. 189 (1996)

    Google Scholar 

  33. Lewis, J.R.: Measuring perceived usability: the CSUQ, SUS, and UMUX. Int. J. Hum. Comput. Interact. 34(12), 1148–1156 (2018)

    Article  Google Scholar 

  34. Bangor, A., Kortum, P.T., Miller, J.T.: An empirical evaluation of the system usability scale. Int. J. Hum. Comput. Interact. 24(6), 574–594 (2008)

    Article  Google Scholar 

  35. Borsci, S., Federici, S., Lauriola, M.: On the dimensionality of the System Usability Scale: a test of alternative measurement models, no. July (2009)

    Google Scholar 

  36. Borsci, S., Federici, S., Bacci, S., Gnaldi, M., Bartolucci, F.: Assessing user satisfaction in the era of user experience: comparison of the SUS, UMUX and UMUX - LITE as a function of product experience, no. November (2015)

    Google Scholar 

  37. Lewis, J.R., Sauro, J.: The factor structure of the system usability scale. In: Kurosu, M. (ed.) HCD 2009. LNCS, vol. 5619, pp. 94–103. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02806-9_12

    Chapter  Google Scholar 

  38. Tenório, J.M., Cohrs, F.M., Sdepanian, V.L., Pisa, I.T., Marin, H.deF.: Desenvolvimento e avaliação de um protocolo eletrônico para atendimento e monitoramento do paciente com doença celíaca. Rev. Informática teórica e Apl. 17(2), 210–220 (2010)

    Google Scholar 

  39. Boucinha, R.M., Tarouco, L.M.R.: Avaliaçao de ambiente virtual de aprendizagem com o uso do sus-system usability scale. RENOTE-Revista Novas Tecnol. na Educ., vol. 11, no. 3 (2013)

    Google Scholar 

  40. Lynch, K.R., Schwerha, D.J., Johanson, G.A.: Development of a weighted heuristic for website evaluation for older adults. Int. J. Hum. Comput. Interact. 29(6), 404–418 (2013)

    Article  Google Scholar 

Download references

Acknowledgements

This work is financed by FCT Fundação para a Ciência e a Tecnologia (Portuguese Foundation for Science and Technology), supported by funding from POPH/FSE.

This article reflects the views only of the author, and FCT cannot be held responsible for any use which may be made of the information contained therein.

figure a

Author information

Authors and Affiliations

  1. INESC TEC and University of Trás-os-Montes and Alto Douro, Vila Real, Portugal

    Márcio Martins & Ramiro Gonçalves

  2. University of Trás-os-Montes and Alto Douro, Vila Real, Portugal

    Francisco Godinho & Pedro Gonçalves

Authors
  1. Márcio Martins
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Francisco Godinho
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pedro Gonçalves
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ramiro Gonçalves
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Márcio Martins .

Editor information

Editors and Affiliations

  1. Foundation for Research and Technology - Hellas (FORTH), Heraklion, Crete, Greece

    Margherita Antona

  2. University of Crete and Foundation for Research and Technology - Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Martins, M., Godinho, F., Gonçalves, P., Gonçalves, R. (2022). Usability and Accessibility Evaluation of the ICT Accessibility Requirements Tool Prototype. In: Antona, M., Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Novel Design Approaches and Technologies. HCII 2022. Lecture Notes in Computer Science, vol 13308. Springer, Cham. https://doi.org/10.1007/978-3-031-05028-2_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-05028-2_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-05027-5

  • Online ISBN: 978-3-031-05028-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation