Measuring Web Accessibility by Estimating Severity of Barriers

  • Giorgio Brajnik
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5176)


The paper addresses the issue of measuring web accessibility in such a way that differences in measurements reflect differences in the effectiveness experienced by disabled users. The paper presents the steps upon which a measuring methodology called MAMBO is based, and the data that are needed to compute the indexes, in addition to its conceptual rationale. An experimentation of MAMBO is then described, based on analysis of 14 accessibility reports; results are shown and discussed, including the effects that different severity judgments may have on the metric, how to estimate confidence intervals on the values, and how the metric can be used to estimate accessibility with respect to specific user groups.


Assistive Technology User Category Screen Reader Accessibility Index Conformance Testing 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Arrue, M., Vigo, M., Abascal, J.: Quantitative metrics for web accessibility evaluation. In: Proc. of the ICWE 2005 Workshop on Web Metrics and Measurement (2005)Google Scholar
  2. 2.
    Arrue, M., Vigo, M., Abascal, J.: Web accessibility awareness in search engines results. Int. Journal on Universal Access in the Information Society (2008); In pressGoogle Scholar
  3. 3.
    Bailey, J., Burd, E.: Tree-map visualization for web accessibility. In: COMPSAC 2005: Proceedings of the 29th Annual International Computer Software and Applications Conference (COMPSAC 2005), vol. 1, pp. 275–280. IEEE Computer Society, Washington (2005)CrossRefGoogle Scholar
  4. 4.
    Brajnik, G.: Web Accessibility Testing: When the Method is the Culprit. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2006. LNCS, vol. 4061, pp. 156–163. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  5. 5.
    Brajnik, G., Lomuscio, R.: SAMBA: a semi-automatic method for measuring barriers of accessibility. In: Trewin, S., Pontelli, E. (eds.) 9th Int. ACM SIGACCESS Conference on Computers and Accessibility, ASSETS, Tempe, AZ, October 2007. ACM Press, New York (2007)Google Scholar
  6. 6.
    Brajnik, G.: Web accessibility testing with barriers walkthrough (March 2006) (Visited May 2008),
  7. 7.
    DRC. Formal investigation report: web accessibility. Disability Rights Commission (March 2006) (Visited January 2006),
  8. 8.
    Gray, W.D., Salzman, M.C.: Damaged merchandise: a review of experiments that compare usability evaluation methods. Human–Computer Interaction 13(3), 203–261 (1998)CrossRefGoogle Scholar
  9. 9.
    Sears, A.: Heuristic walkthroughs: finding the problems without the noise. Int. Journal of Human-Computer Interaction 9(3), 213–234 (1997)CrossRefGoogle Scholar
  10. 10.
    Slatin, J., Rush, S.: Maximum Accessibility: Making Your Web Site More Usable for Everyone. Addison-Wesley, Reading (2003)Google Scholar
  11. 11.
    Sullivan, T., Matson, R.: Barriers to use: usability and content accessibility on the web’s most popular sites. In: Proc. of ACM Conference on Universal Usability, pp. 139–144 (2000)Google Scholar
  12. 12.
    Velleman, E., Velasco, C.A., Snaprud, M., Burger, D.: D-WAB4 Unified Web Evaluation Methodology (UWEM 1.0). Technical report, WAB Cluster (2006)Google Scholar
  13. 13.
    W3C/WAI. How people with disabilities use the web. World Wide Web Consortium — Web Accessibility Initiative (March 2004),
  14. 14.
    Zeng, X.: Evaluation of Enhancement of Web Content Accessibility for Persons with Disabilities. PhD thesis, University of Pittsburgh (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Giorgio Brajnik
    • 1
  1. 1.Dip. di Matematica e InformaticaUniversità di UdineItaly

Personalised recommendations