Universal Access in the Information Society

, Volume 3, Issue 3, pp 252–263

Comparing accessibility evaluation tools: a method for tool effectiveness

Long paper

DOI: 10.1007/s10209-004-0105-y

Cite this article as:
Brajnik, G. Univ Access Inf Soc (2004) 3: 252. doi:10.1007/s10209-004-0105-y


This paper claims that effectiveness of automatic tools for evaluating web site accessibility has to be itself evaluated, given the increasingly important role that these tools play. The paper presents a comparison method for a pair of tools that takes into account correctness, completeness and specificity in supporting the task of assessing the conformance of a web site with respect to established guidelines. The paper presents data acquired during a case study based on comparing LIFT Machine with Bobby. The data acquired from the case study is used to assess the strengths and weaknesses of the comparison method. The conclusion is that even though there is room for improvement of the method, it is already capable of providing accurate and reliable conclusions.


Web accessibility Accessibility assessments Automated evaluations Accessibility evaluation tools Tools effectiveness 

Copyright information

© Springer-Verlag 2004

Authors and Affiliations

  1. 1.Dip. di Matematica e InformaticaUniversità di UdineItaly

Personalised recommendations