Beyond Conformance: The Role of Accessibility Evaluation Methods
The topic I want to address is the role that accessibility evaluation methods can play in helping the transition from accessibility viewed as standard conformance, to a user-centered accessibility. As we will see, this change sets additional requirements on how evaluations of websites should be carried out.
This paper first discusses different problems that occur while dealing with accessibility. We will see that different people have radically different views of accessibility and how it should be assessed.
The first requirement is a clear definition of what accessibility is and how it should be assessed. The accessibility model discussed in Section 2.1 has precisely this role.
Several existing evaluation methods are then reviewed and discussed, a simple taxonomy is presented, and differences that occur when evaluating accessibility rather than usability are pinpointed.
Unable to display preview. Download preview PDF.
- 1.Brajnik, G.: Modeling content and expression of learning objects in multimodal learning management systems. In: HCI International 2007, FUITEL: Future Interfaces in Technology Enhanced Learning, Beijing, China (July 2007)Google Scholar
- 2.Brajnik, G.: Measuring web accessibility by estimating severity of barriers. In: 2nd International Workshop on Web Usability and Accessibility IWWUA 2008, Auckland, New Zealand (September 2008)Google Scholar
- 5.Brajnik, G.: Web accessibility testing with barriers walkthrough (March 2006) (Visited May 2008), http://www.dimi.uniud.it/giorgio/projects/bw
- 6.Brajnik, G., Lomuscio, R.: SAMBA: a semi-automatic method for measuring barriers of accessibility. In: Trewin, S., Pontelli, E. (eds.) 9th Int. ACM SIGACCESS Conference on Computers and Accessibility, ASSETS, Tempe, AZ. ACM Press, New York (2007)Google Scholar
- 7.Brajnik, G., Toppano, E.: Creare siti web multimediali: fondamenti di analisi e progettazione, Italy. Addison-Wesley/Pearson Education (2007)Google Scholar
- 8.Brajnik, G., Mulas, A., Pitton, C.: Effects of sampling methods on web accessibility evaluations. In: Trewin, S., Pontelli, E. (eds.) 9th Int. ACM SIGACCESS Conference on Computers and Accessibility, ASSETS, Tempe, AZ. ACM Press, New York (2007)Google Scholar
- 10.College of Design, North Carolina University. Principles of Universal Design. The Center for Universal Design (Febuary 1997) (Visited May 2008), http://www.design.ncsu.edu/cud/about_ud/udprincipleshtmlformat.html
- 11.Coyne, K.P., Nielsen, J.: How to conduct usability evaluations for accessibility: methodology guidelines for testing websites and intranets with users who use assistive technology. Nielsen Norman Group (October 2001), http://www.nngroup.com/reports/accessibility/testing
- 12.Dey, A.: Accessibility evaluation practices - survey results (2004) (Visited May 2008), http://deyalexander.com/publications/accessibility-evaluation-practices.html
- 13.DRC. Formal investigation report: web accessibility. Disability Rights Commission (April 2004) (Visited January 2006), www.drc-gb.org/publicationsandreports/report.asp
- 16.Henry, S.L., Grossnickle, M.: Just Ask: Accessibility in the User-Centered Design Process. Georgia Tech Research Corporation, Atlanta, Georgia, USA, On-line book (2004), http://www.UIAccess.com/AccessUCD
- 18.ISO. Ergonomics of human–system interaction — guidance on accessibility for human–computer interfaces. ISO/TS 16071. Technical report, International Standards Organization (2003), www.iso.ch
- 19.Italian Government. Requisiti tecnici e i diversi livelli per l’accessibilità agli strumenti informatici (July 2005) (G. U. n. 183 8/8/2005), www.pubbliaccesso.it/normative/DM080705.htm
- 20.Italian Parliament. Disposizioni per favorire l’accesso dei soggetti disabili agli strumenti informatici (January 2004) (Law n. 4, January 9 2004), http://www.parlamento.it/parlam/leggi/04004l.htm
- 21.Kelly, B., Sloan, D., Phipps, L., Petrie, H., Hamilton, F.: Forcing standardization or accomodating diversity? A framework for applying the WCAG in the real world. In: Harper, S., Yesilada, Y., Goble, C. (eds.) W4A 2005: Proc. of the 2005 international cross-disciplinary conference on Web accessibility, Chiba, Japan, April 2005, pp. 46–54. ACM, New York (2005)CrossRefGoogle Scholar
- 23.Lang, T.: Comparing website accessibility evaluation methods and learnings from usability evaluation methods (Visited May 2008) (2003), http://www.peakusability.com.au/about-us/pdf/website_accessibility.pdf
- 25.Nielsen, J.: Usability Engineering. Morgan Kaufmann, San Francisco (1994)Google Scholar
- 26.Nielsen, J.: Heuristic evaluation (2002) (Visited January 2008), http://www.useit.com/papers/heuristic
- 27.Nielsen Norman Group. Beyond ALT Text: Making the Web Easy to Use for Users with Disabilities (October 2001), http://www.nngroup.com/reports/accessibility/
- 28.Nielsen Norman Group. Web usability for senior citizens (April 2002), http://www.nngroup.com/reports
- 29.Petrie, H., Kheir, O.: The relationship between accessibility and usability of websites. In: Proc. CHI 2007, pp. 397–406. ACM, CA (2007)Google Scholar
- 31.Rubin, J.: Handbook of usability testing. Wiley, Technical Communication Library, Chichester (1994)Google Scholar
- 33.Slatin, J., Lewis, K.: Challenges of accessible web design: Standards, guidelines, and user testing. In: Technology and Persons with Disabilities Conference, Los Angeles, USA. CSUN, California State University Northridge (2002)Google Scholar
- 34.Slatin, J., Rush, S.: Maximum Accessibility: Making Your Web Site More Usable for Everyone. Addison-Wesley, Reading (2003)Google Scholar
- 35.Thatcher, J., Waddell, C., Henry, S., Swierenga, S., Urban, M., Burks, M., Regan, B., Bohman, P.: Constructing Accessible Web Sites. Glasshouse (2002)Google Scholar
- 36.Thatcher, J., Burks, M., Heilmann, C., Henry, S., Kirkpatrick, A., Lauke, P., Lawson, B., Regan, B., Rutter, R., Urban, M., Waddell, C.: Web Accessibility: Web Standards and Regulatory Compliance (2006); Friends of EDGoogle Scholar
- 38.Thevenin, D., Coutaz, J.: Plasticity of user interfaces: framework and research agenda. In: Sasse, A., Johnson, C. (eds.) Proceedings of Interact 1999, Edinburgh, UK, pp. 110–117 (1999)Google Scholar
- 39.U.S. Dept. of Justice. Section 508 of the Rehabilitation Act (2001), www.access-board.gov/sec508/guide/1194.22.htm
- 40.U.S. Government. SEC. 508. ELECTRONIC AND INFORMATION TECHNOLOGY, 1998 Amendment to Section 508 of the Rehabilitation Act, (1998) (Visited May 2008), www.section508.gov/index.cfm?FuseAction=Content&ID=14
- 41.Vigo, M., Kobsa, A., Arrue, M., Abascal, J.: User-tailored web accessibility evaluations. In: HyperText 2007, Manchester, UK, September 2007, pp. 95–104. ACM, New York (2007)Google Scholar
- 42.W3C/WAI. Conformance evaluation of web sites for accessibility (2008)(Visited May 2008), www.w3.org/WAI/eval/conformance.html
- 43.W3C/WAI. How people with disabilities use the web. World Wide Web Consortium — Web Accessibility Initiative (March 2004) (Visited May 2008), http://w3.org/WAI/EO/Drafts/PWD-Use-Web/20040302.html
- 44.W3C/WAI. Web accessibility evaluation tools: Overview. World Wide Web Consortium — Web Accessibility Initiative (2006) (Visited May 2008), http://www.w3.org/WAI/ER/tools/Overview.html
- 45.W3C/WAI. Web content accessibility guidelines 1.0. World Wide Web Consortium — Web Accessibility Initiative (May 1999), http://www.w3.org/TR/WCAG10
- 46.W3C/WAI. Web content accessibility guidelines 2.0 — w3c candidate recommendation 30 april 2008. World Wide Web Consortium — Web Accessibility Initiative (April 2008), http://www.w3.org/TR/2008/CR-WCAG20-20080430