Skip to main content
SpringerLink
Log in

Usability evaluation of navigation tasks by people with intellectual disabilities: a Google and SAPO comparative study regarding different interaction modalities

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

This paper presents a case study regarding the usability evaluation of navigation tasks by people with intellectual disabilities. The aim was to investigate the factors affecting usability, by comparing their user-Web interactions and underline the difficulties observed. For that purpose, two distinct study phases were performed: the first consisted in comparing interaction using two different search engines’ layouts (Google and SAPO) and the second phase consisted in a preliminary evaluation to analyze how users performed the tasks with the usual input devices (keyboard and mouse) and provide an alternative interface to help overcome possible interaction problems and enhance autonomy. For the latter, we compared two different interfaces: a WIMP-based one and speech-based one. The main results obtained showed that users had a better performance with Google (with a simpler layout) than with SAPO (with a complex layout), and despite displaying a good keyboard handling ability, they did not show autonomy using this input device (due to the need for reading/writing when handling this device). In this perspective, Google’s speech recognition application could indeed be considered an alternative for interaction. However, we found that the speech recognition interface is not as robust as it should be: it could be more precise and less prone to errors due to poor word pronunciation. After this two-phased study, we think we may be able to infer some recommendations to be used by developers in order to create more intuitive layouts for easy navigation regarding this group of people, and thereby facilitate digital inclusion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Alexa: Top 500 global sites http://www.alexa.com/topsites/ (2010)

  2. Aylett, M.P., Kristensson, P.O., Whittaker, S., Vazquez-Alvarez, Y.: None of a CHInd: relationship counselling for HCI and speech technology. In: Proceeding CHI’14 Extended Abstracts on Human Factors in Computing Systems, ACM New York, NY, USA, pp. 749–760, 2014. ISBN: 978-1-4503-2474-8. doi:10.1145/2559206.2578868. http://dl.acm.org/citation.cfm?id=2559206.2578868

  3. American Psychological Association (APA): DSM-V-The Diagnostic and Statistical Manual of Mental Disorders, vol. 5. http://www.dsm5.org/Pages/Default.aspx (2013)

  4. Blake, J.: The natural user interface revolution. In: Natural User Interfaces in .NET, 15th edn., pp. 1–43. Manning Publications (2012)

  5. Bohman, P.R.: Functional cognitive disabilities. http://paulbohman.com/accessibility/cognitive/functional (2007)

  6. Carey, C.C., Friedman, M.G., Bryen, D.N.: Use of electronic technologies by people with intellectual disabilities. Ment. Retard. 43(5), 322–333 (2005)

    Google Scholar 

  7. Dam, A.V.: Post-WIMP user interfaces. Commun. ACM 40(2), 63–67 (1997)

    Article  MathSciNet  Google Scholar 

  8. Davies, D.K., Stock, S.E., Wehmeyer, M.L.: Enhancing independent internet access for individuals with mental retardation through use of a specialized web browser: a pilot study. Educ. Train. Ment. Retard. Dev. Disabil. 1(36), 107–113 (2001)

    Google Scholar 

  9. Dewan, S., Ganley, D., Kraemer, K.L.: Across the digital divide: a cross-country multi-technology analysis of the determinants of IT penetration. J. Assoc. Inf. Syst. 6(12), 409–432 (2005)

    Google Scholar 

  10. Friedman, M., Bryen, D.: Web accessibility design recommendations for people with cognitive disabilities. Technol. Disabil. 9, 205–212 (2007). ISSN 1055-4181/07/$17.00

    Google Scholar 

  11. Godinho, F.: Uma nova abordagem para a formação em Engenharia de Reabilitação em Portugal, Ph.D. Thesis, University of Trás-os-Montes e Alto Douro (2010). http://repositorio.utad.pt/bitstream/10348/572/1/Phd_fafbgodinho.pdf

  12. Gorniak, P., Roy, D.: Augmenting user interfaces with adaptive speech commands. In: Proceedings of the 5th international conference on Multimodal interfaces—ICMI’03, New York, New York, USA, p. 176 (2003)

  13. Harrysson, B.: Internet Enabling Design for People with Cognitive Limitations. Lund University, Sweden (2003)

    Google Scholar 

  14. Harrysson, B., Svensk, A., Johansson, G.: How people with developmental disabilities navigate the internet. Br. J. Spec. Educ. 30(3), 138–142 (2004)

    Article  Google Scholar 

  15. Kim, J.: Describing and predicting information-seeking behavior on the Web. J. Am. Soc. Inf. Sci. Technol. 60(4), 679–693 (2009)

    Article  Google Scholar 

  16. Leroy, G., Xu, J., Chung, W., Eggers, S., Chen, H.: An end user evaluation of query formulation and results review tools in three medical meta-search engines. Int. J. Med. Inform. 76, 780–789 (2007). http://dx.doi.org/10.1016/j.ijmedinf.2006.08.001

  17. Lopes, C. T., Ribeiro, C.: Comparative evaluation of web search engines in health information retrieval. Online Inf. Rev. 35(60), 869–892 (2011). http://dx.doi.org/10.1108/14684521111193175

  18. Malik, S.: A comparative study of two major search engines: Google and Yahoo. Orient. J. Comp. Sci. Technol, 1(7) (2014). http://computerscijournal.org/?p=706

  19. Modesto, D.M., Ferreira, S.B.L.: Guidelines for search features development—a comparison between general users and users with low reading skills. In: 5th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion, DSAI 2013, vol. 27, pp. 334–342. Elsevier. Procedia Computer Science (2013)

  20. Nakano, T.: Flexible shortcuts. In: Proceeding of the Twenty-Sixth Annual CHI Conference Extended Abstracts on Human Factors in Computing Systems—CHI’08, New York, New York, USA, p. 2621 (2008)

  21. Nielsen, J.: Noncommand user interfaces. Commun. ACM 36(4), 83–99 (1993)

    Article  Google Scholar 

  22. Opitz, C.: The effects of implementing web accessibility standards on the success of secondary adolescents with learning disabilities. Ph.D. Thesis, Arizona State University (2003). http://worldcat.org/oclc/55135520

  23. Palanisamy, R.: Evaluation of search engines: a conceptual model and research issues. Int. J. Bus. Manag. Can. Cent. Sci. Educ. 8(6) (2013) ISSN 1833-3850 E-ISSN 1833-8119. http://www.ccsenet.org/journal/index.php/ijbm/article/view/20708

  24. Rangaswamy, A., Giles, C. L., Seres, S.: A strategic perspective on search engines: thought candies for practitioners and researchers. J. Interact. Mark. (23), 49–60 (2009). http://dx.doi.org/10.1016/j.intmar.2008.10.006

  25. Rocha, T.: Acessibilidade e Usabilidade na Internet para Pessoas com Deficiência Intelectual. M.Sc. Thesis, University of Trás-os-Montes e Alto Douro (2008)

  26. Rocha, T., Gonçalves, M., Godinho, F., Magalhães, L., Bessa, M.: Accessibility and usability in the internet for people with intellectual disabilities. In: Proceedings of 2nd International Conference on Software Development for Enhancing Accessibility and Fighting Info-exclusion. DSAI’2009, Lisboa, pp. 25–29 (2009)

  27. Rocha, T., Bessa, M., Gonçalves, M., Cabral, L., Godinho, F., Peres, E., Reis, M., Magalhães, L., Chalmers, A.: The recognition of web pages’ hyperlinks by people with intellectual disabilities: an evaluation study. J. Appl. Res. Intell. Disabil. 25(6), 542–552 (2012). doi:10.1111/j.1468-3148.2012.00700.x

    Article  Google Scholar 

  28. Rocha, T.: Metáfora de Interação para o Acesso à Informação Digital de uma Forma Autónoma por Pessoas com Deficiência Intelectual. Ph.D. Thesis, University of Trás-os-Montes e Alto Douro (2014)

  29. Roh, S.Z.: Designing accessible Web-based instruction for all learners: perspectives of students with disabilities and Web-based instructional personnel in higher education. Unpublished Doctoral dissertation, Indiana University (2004). http://mutex.gmu.edu:2068/pqdweb?did=828407271&sid=3&Fmt=2&clientId=31810&RQT=09&VName=PQD

  30. Small, J., Schallau, P., Brown, K., Ettinger, D., Blanchard, S., Krahn, G.: Web accessibility for people with cognitive disabilities. http://www.resna.org/ProfResources/Publications/Proceedings/2005/Research/CAC/Small.php (2005)

  31. W3C, World Wide Web Consortium—WAI, Web Accessibility Initiative: Web Content Accessibility Guidelines (WCAG) 2.0. http://www.w3.org/TR/WCAG20/ (2008)

  32. Williamson, K., Schauder, D., Stockfield, L., Wright, S., Bow, A.: The role of the internet for people with disabilities: issues of access and equity for public libraries. Aust. Libr. J. 50(2), 157–174 (2001). doi:10.1080/00049670.2001.1075595

    Article  Google Scholar 

  33. Wong, A.W.K., Chan, C.C.H., Li-Tsang, C.W.P., Lam, C.S.: Competence of people with intellectual disabilities on using human–computer interface. Res. Dev. Disabil. 30, 107–123. Elsevier (2009). http://www.sciencedirect.com

  34. Yankelovich, N., Lai, J.: Designing speech user interfaces. In: CHI’99 Extended Abstracts on Human Factors in Computing Systems—CHI’99, New York, New York, USA, p. 124 (1999)

Download references

Author information

Authors and Affiliations

  1. University of Trás-os-MOntes e Alto Douro, Vila Real, Portugal

    Tânia Rocha, Diana Carvalho & Maximino Bessa

  2. INESC TEC/UTAD, Vila Real, Portugal

    Tânia Rocha, Diana Carvalho & Maximino Bessa

  3. University of Aveiro, Aveiro, Portugal

    Sofia Reis

  4. University of Minho, Braga, Portugal

    Luís Magalhães

Authors
  1. Tânia Rocha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Diana Carvalho
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Maximino Bessa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sofia Reis
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Luís Magalhães
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tânia Rocha.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rocha, T., Carvalho, D., Bessa, M. et al. Usability evaluation of navigation tasks by people with intellectual disabilities: a Google and SAPO comparative study regarding different interaction modalities. Univ Access Inf Soc 16, 581–592 (2017). https://doi.org/10.1007/s10209-016-0489-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-016-0489-5

Keywords

Search

Navigation