Skip to main content
SpringerLink
Log in

Web accessibility investigation of Slovenian municipalities’ websites before and after the adoption of European Standard EN 301 549

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

Digitalization and technological innovations provide many benefits for citizens worldwide, increasing the quality of life in several ways, including by enhancing access to information. However, people with disabilities can face challenges when retrieving online information as they often use assistive technologies that might not be fully supported by web pages. Municipalities’ websites are an important source of information for all citizens, regardless of their individual characteristics. To be able to support all citizens’ needs, several standards provide support for web developers. One of the standards is “Standard EN 301 549–Accessibility requirements suitable for public procurement of ICT products and services” in Europe. This study addresses the accessibility of public government services, more specifically municipalities’ websites, where there are still accessibility challenges. With a systematic literature review, we found no studies that would analyze the government web pages’ compliance with Standard EN 301 549. Therefore, this research had two main research goals: (1) to verify whether the websites of Slovenian municipalities were compliant with the Standard EN 301 549 in the years 2017 and 2018, and (2) to compare the results before and after the adoption of Standard EN 301 549 in Slovenia. The answers to the research questions were obtained with an accessibility evaluation of 189 Slovenian municipalities’ websites. The results, based on a descriptive analysis, indicate that, in 2017, none of the evaluated websites were fully compliant with the web content requirements of Standard EN 301 549, while at the end of 2018, 62 websites (33%) were fully compliant with the aforementioned standard. Furthermore, the results from an extended statistical analysis indicate improvement in websites standard compliance in 2018, even significant improvement for some web requirements after the adoption of the standard. A secondary contribution of this research is twofold: (1) a detailed presentation of the accessibility evaluation procedure and (2) its application on a specific domain (government domain) and in a specific geographical area (Slovenia). The same procedure could be applied to other domains and other countries around Europe (or even around the world in case Standard EN 301 549 is replaced with a relevant accessibility standard that applies to the chosen area of research).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. World Health Organization: Disability and health. 2018. https://www.who.int/news-room/fact-sheets/detail/disability-and-health. Accessed 18 June (2019)

  2. Šumak B., Špindler M., Debeljak M., Heričko M., Pušnik M.: An empirical evaluation of a hands-free computer interaction for users with motor disabilities. J. Biomed. Inform., vol. 96, no. June, p. 103249 (2019)

  3. Ismailova, R., Inal, Y.: Web site accessibility and quality in use: a comparative study of government Web sites in Kyrgyzstan, Azerbaijan, Kazakhstan and Turkey. Univers. Access Inf. Soc. 16(4), 987–996 (2017)

    Article  Google Scholar 

  4. W3C WAI: Introduction to Web Accessibility. 2018. https://www.w3.org/WAI/fundamentals/accessibility-intro/. Accessed 18 June (2019)

  5. Department of Economic and Social Affairs Disability: Convention on the Rights of Persons with Disabilities. 2018. https://www.un.org/development/desa/disabilities/convention-on-the-rights-of-persons-with-disabilities.html. Accessed 18 June (2019)

  6. Acosta T., Acosta-Vargas P., Luján-mora S.: Accessibility of eGovernment Services in Latin America. In: Fifth International Conference on eDemocracy & eGovernment, pp. 67–74 (2018)

  7. W3C WAI: Web Accessibility Laws & Policies. 2018. https://www.w3.org/WAI/policies/. Accessed 18 June (2019)

  8. Domínguez, T., Elisa, V., González, A., Darcy, S.: Accessibility of tourism websites: the level of countries’ commitment. Univers. Access Inf. Soc. (2019)

  9. EUR-Lex: Accessibility of public sector websites and mobile apps. 2018. https://eur-lex.europa.eu/eli/dir/2016/2102/oj. Accessed 20 June (2019)

  10. United Nations: Convention on the rights of persons with disabilities, vol. 2515. p. 3 (2006)

  11. Boldyreff C., Burd E., Donkin J., Marshall S.: The case for the use of plain english to increase web accessibility. In: 3rd International Workshop on Web Site Evolution (WSE’01), vol. 1, pp. 42–48 (2001)

  12. Craven, J., Nietzio, A.: A task-based approach to assessing the accessibility of web sites. Perform. Meas. Metrics 8(2), 98–109 (2007)

    Article  Google Scholar 

  13. McCarthy, J.E., Swierenga, S.J.: What we know about dyslexia and Web accessibility: a research review. Univers. Access Inf. Soc. 9(2), 147–152 (2009)

    Article  Google Scholar 

  14. European Commission: Digital Agenda: Commission proposes rules to make government websites accessible for all. 2012. https://europa.eu/rapid/press-release_IP-12-1305_en.htm. Accessed 18 June (2019)

  15. Information Society Policy Link Initiative: ICT for all Technology supporting an inclusive world. Brussel, 2010 (2010)

  16. Lazar. J, Stein. M.A.: Disability, Human Rights, and Information Technology. University of Pennsylvania Press, 2017, (2017)

  17. European Telecommunications Standards Institute: ETSI EN 301 549 - V1.1.2 - Accessibility requirements suitable for public procurement of ICT products and services in Europe. pp. 1–134 (2015)

  18. CEN-CENELEC Management Centre: New European Standard will help to make ICT products and services accessible for all, 2014 (2014)

  19. International Organization for Standardization: ISO/IEC 40500:2012 Information technology - W3C Web Content Accessibility Guidelines (WCAG) 2.0. International Organization for Standarization, 2012 (2012)

  20. W3C WAI: What’s New in WCAG 2.1. 2019. https://www.w3.org/WAI/standards-guidelines/wcag/new-in-21/. Accessed 20 June (2019)

  21. Ismail A., Kuppusamy K. S.: Accessibility of Indian universities’ homepages: An exploratory study. J. King Saud Univ. - Comput. Inf. Sci (2016)

  22. Ahmi A., Mohamad R.: Web Accessibility of the Malaysian Public University Websites. In: Proceedings of the International Conference on E-Commerce (2015)

  23. Alahmadi T., Drew S.: An evaluation of the accessibility of top-ranking university websites: Accessibility rates from 2005 to 2015. In: DEANZ2016, p. 253 (2016)

  24. Kane S. K., Shulman J. A., Shockley T. J., Ladner R. E.: A web accessibility report card for top international university web sites. In: International World Wide Web Conference (2007)

  25. Martins J., Gonçalves R., Branco F.: A full scope web accessibility evaluation procedure proposal based on Iberian eHealth accessibility compliance. Comput. Human Behav., pp. 1–9 (2016)

  26. Kous K., Kuhar S., Pušnik M., Šumak B.: Comparative analysis of faculties ’ websites accessibility based on an automatic evaluation. In 42nd International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp. 1498–1502 (2019)

  27. Ochoa, R.L., Crovi, D.M.: Evaluation of accessibility in Mexican cybermedia. Univers. Access Inf. Soc. 18(2), 413–422 (2019)

    Article  Google Scholar 

  28. Barricelli, B.R., Sciarelli, P., Valtolina, S., Rizzi, A.: Web accessibility legislation in Italy: a survey 10 years after the Stanca Act. Univers. Access Inf. Soc. 17(1), 211–222 (2018)

    Article  Google Scholar 

  29. İşeri E.İ.: Accessibility of the cyprus island municipal websites. In: 9th International Conference on Computational Intelligence and Communication Networks, pp. 72–76 (2017)

  30. Al-Khalifa, H.S., Baazeem, I., Alamer, R.: Revisiting the accessibility of Saudi Arabia government websites. Univers. Access Inf. Soc. 16(4), 1027–1039 (2017)

    Article  Google Scholar 

  31. Acosta-Vargas, P., Lujan-Mora, S., Salvador-Ullauri, L.: Quality evaluation of government websites. In: Fourth International Conference on eDemocracy eGovernment (ICEDEG), pp. 8–14 (2017)

  32. Karaim, N.A., Inal, Y.: Usability and accessibility evaluation of Libyan government websites. Univers. Access Inf. Soc. 0123456789, 1–10 (2017)

    Google Scholar 

  33. Silva A., Goncalves M. J. A., Teixeira S., Silva A. M., Maia T.: accountability and web accessibility of the portuguese official municipal websites. In: Vision 2020: Innovation Management, Development Sustainability, and Competitive Economic Growth, pp. 3941–3952 (2016)

  34. Ahmi A., Mohamad R.: Current State of Web Accessibility of Malaysian Ministries Websites. In: Proceedings of the international conference on applied science and technology 2016 (icast ‘16), vol. 1761 (2016)

  35. Akgül Y., Vatansever K.: Web content accessibility of municipal web sites in Turkey. J. Adv. Inf. Technol., 7(1) (2016)

  36. King, B.A., Youngblood, N.E.: E-government in Alabama: an analysis of county voting and election website content, usability, accessibility, and mobile readiness. Gov. Inf. Q. 33(4), 715–726 (2016)

    Article  Google Scholar 

  37. Androniceanu A., Ciocan S.: The impact of WCAG 2.0 specifications on the level of accessibility of public social assistance and child protection websites in Romania. In: Proceedings of the 9th International Management Conference, pp. 432–445 (2015)

  38. Lujan-Mora S., Navarrete R., Penafiel M.: eGovernment and web accessibility in South America. In: First International Conference on eDemocracy & eGovernment (ICEDEG), pp. 77–82 (2014)

  39. Youngblood, N.E.: Revisiting Alabama state website accessibility. Gov. Inf. Q. 31(3), 476–487 (2014)

    Article  Google Scholar 

  40. Kamoun F., Almourad M. B.: Accessibility as an integral factor in e-government web site evaluation: The case of Dubai e-government. Inf. Technol. People, vol. 27, no. 2 (2014)

  41. Lazar, J., et al.: A longitudinal study of state government homepage accessibility in Maryland and the role of web page templates for improving accessibility. Gov. Inf. Q. 30(3), 289–299 (2013)

    Article  Google Scholar 

  42. De Souza, E.R., Mont’Alvão, C.: Web accessibility: evaluation of a website with different semi-automatic evaluation tools. Work 41, 1567–1571 (2012)

    Article  Google Scholar 

  43. Baowaly M. K., Bhuiyan M.: Accessibility analysis and evaluation of Bangladesh government websites. In: International Conference on Informatics, Electronics and Vision (ICIEV), pp. 46–51 (2012)

  44. Bakhsh M., Mehmood A.: Web accessibility for disabled: a case study of government websites in Pakistan. In: 10th International Conference on Frontiers of Information Technology, pp. 342–347 (2012)

  45. Pribeanu, C., Marinescu, R.D., Gheorghe-moisii, M., Fogarassy, P.: Web accessibility in Romania: the conformance of municipal web sites to web content accessibility guidelines. Inform. Econ. 16(December), 2012 (2015)

  46. Latif, M.H., Noorman, Masrek M.: Accessibility evaluation on Malaysian E-Government Websites. J. e-Government Stud. Best Pract. 2010, 11 (2010)

  47. Kuzma, J.M.: Accessibility design issues with UK e-government sites. Gov. Inf. Q. 27(2), 141–146 (2010)

    Article  Google Scholar 

  48. Hyun J., Moon J., Hong K.: Longitudinal study on web accessibility compliance of government websites in Korea. In: Asia-Pacific Conference on Computer Human Interaction, pp. 396–404 (2008)

  49. Lee, S., Kim, B. G., Kim, J. G.: Accessibility evaluation of Korean e-Government. In: Universal Access In Human-Computer Interaction, pp. 73–78 (2007)

  50. Shi, Y.: The accessibility of Chinese local government Web sites: An exploratory study. Gov. Inf. Q. 24(2), 377–403 (2007)

    Article  Google Scholar 

  51. Paris, M.: Website accessibility: A survey of local e-government websites and legislation in Northern Ireland. Univers. Access Inf. Soc. 4(4), 292–299 (2006)

    Article  Google Scholar 

  52. Hackett, S., Parmanto, B., Zeng, X.: A retrospective look at website accessibility over time. Behav. Inf. Technol. 24(6), 407–471 (2005)

    Article  Google Scholar 

  53. Potter, A.: Accessibility of Alabama government Web sites. J. Gov. Inf. 29(2002), 303–317 (2003)

    Google Scholar 

  54. Youngblood, N.E., Mackiewicz, J.: A usability analysis of municipal government website home pages in Alabama. Gov. Inf. Q. 29(4), 582–588 (2012)

    Article  Google Scholar 

  55. Ministry of Public Administration: Map of Slovene municipalities. 2019. http://www.mju.gov.si/en/local_self_government/slovene_municipalities_in_numbers/. Accessed 24 June (2019)

  56. Web Accessibility Checker: AChecker. 2011. https://achecker.ca/checker/index.php.Accessed 24 June (2019)

  57. Ismail A., Kuppusamy K. S.: Web accessibility investigation and identification of major issues of higher education websites with statistical measures: A case study of college websites. Comput. Inf. Sci (2019)

  58. W3C WAI: Understanding WCAG 2.0. 2016. https://www.w3.org/TR/UNDERSTANDING-WCAG20/Overview.html. Accessed 24 June (2019)

  59. Web Accessibility Checker: WCAG 2.0 (Level AA) Understanding WCAG 2.0. 2011. https://achecker.ca/guideline/view_guideline.php?id=8. Accessed 10 January (2020)

Download references

Acknowledgements

The authors acknowledge financial support from the Slovenian Research Agency (Research Core Funding No. P2-0057).

Author information

Authors and Affiliations

  1. Faculty of Electrical Engineering and Computer Science, University of Maribor, Koroška cesta 46, 2000, Maribor, Slovenia

    Katja Kous, Saša Kuhar, Marjan Heričko & Maja Pušnik

  2. mWS myWorld Solutions AG, Grazbachgasse 87-93, 8010, Graz, Austria

    Miha Pavlinek

Authors
  1. Katja Kous
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Saša Kuhar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Miha Pavlinek
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marjan Heričko
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Maja Pušnik
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Katja Kous.

Ethics declarations

Conflicts of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

APPENDIX 1 Web content requirements verified with AChecker as known problems including the information of Check ID, Requirements, Error, and Suggestions for repair [59] (see Table 11).

Table 11 The list of Check ID, Requirements, Error, and Suggestions for repair [59]
Full size table

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kous, K., Kuhar, S., Pavlinek, M. et al. Web accessibility investigation of Slovenian municipalities’ websites before and after the adoption of European Standard EN 301 549. Univ Access Inf Soc 20, 595–615 (2021). https://doi.org/10.1007/s10209-020-00732-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-020-00732-9

Keywords

Search

Navigation