Advertisement

Exploring the Effect of Tasks Difficulty on Usability Scores of Academic Websites Computed Using SUS

  • Kalpna SagarEmail author
  • Anju Saha
Conference paper
  • 23 Downloads
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1087)

Abstract

The prime objective of this study is to empirically determine the effect of tasks difficulty on usability scores computed using the System Usability Scale (SUS). Usability dataset is created by involving twelve end-users that evaluate the usability of 15 academic websites in a laboratory. Each end-user performs three subsets of six tasks whose difficulty is varying from easy to impossible under six different categories. Results are obtained after applying two statistical techniques, one is ANOVA and other is the correlation with regression. Results show that the SUS scores vary from higher to lower values when end-users conduct usability assessment with a list of easy, moderate, and impossible tasks on academic websites. The results also indicate the effect of tasks difficulty on the correlation between the SUS scores and task success rate. Though, the strength of the correlation is strong with each subset of tasks but it varies that depends on the nature of the tasks.

Keywords

Usability evaluation System usability scale Quantitative assessment Academic websites Usability metric Tasks difficulty 

References

  1. 1.
    J. Brooke, SUS-A quick and dirty usability scale. Usability Eval. Ind. 189(194), 4–7 (1996)Google Scholar
  2. 2.
    J. Kirakowski, M. Corbett, SUMI: The software usability measurement inventory. Br. J. Edu. Technol. 24(3), 210–212 (1993)CrossRefGoogle Scholar
  3. 3.
    J.R. Lewis, IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum.-Comput. Interact. 7(1), 57–78 (1995)CrossRefGoogle Scholar
  4. 4.
    J. Sauro, SUPR-Q: A comprehensive measure of the quality of the website user experience. J. Usability Stud. 10(2), 68–86 (2015)Google Scholar
  5. 5.
    P. Kortum, S.C. Peres, The relationship between system effectiveness and subjective usability scores using the System Usability Scale. Int. J. Hum.-Comput. Interact. 30(7), 575–584 (2014)CrossRefGoogle Scholar
  6. 6.
    J.R. Lewis, The system usability scale: past, present, and future. Int. J. Hum.–Comput. Interact. 1–14 (2018)Google Scholar
  7. 7.
    I. Standard, Ergonomic requirements for office work with visual display terminals (vdts)–part 11: Guidance on usability. ISO Standard 9241-11: 1998. Int. Organ. Stand (2018)Google Scholar
  8. 8.
  9. 9.
    K. Sagar, A. Saha, Qualitative usability feature selection with ranking: a novel approach for ranking the identified usability problematic attributes for academic websites using data-mining techniques. Hum.-centric Comput. Inf. Sci. 7(1), 29 (2017)CrossRefGoogle Scholar
  10. 10.
    K. Sagar, D. Gupta, A.K. Sangaiah, Manual versus automated qualitative usability assessment of interactive systems. Concurrency Comput. Pract. Experience e5091Google Scholar
  11. 11.
  12. 12.
    J. Sauro, J.R. Lewis, Correlations among prototypical usability metrics: evidence for the construct of usability. in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM, 2009, April), pp. 1609–1618Google Scholar
  13. 13.
    R. Jain, D. Gupta, A. Khanna, Usability feature optimization using MWOA. ed. by S. Bhattacharyya, A. Hassanien, D. Gupta, A. Khanna, I. Pan International Conference on Innovative Computing and Communications. Lecture Notes in Networks and Systems, vol 56 (Springer, Singapore, 2019)Google Scholar
  14. 14.
    S. Kapoor, K. Sagar, B.V.R. Reddy, Speedroid: a novel automation testing tool for mobile apps. ed. by S. Bhattacharyya, A. Hassanien, D. Gupta, A. Khanna, I Pan International Conference on Innovative Computing and Communications. Lecture Notes in Networks and Systems, vol 56 (Springer, Singapore, 2019)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  1. 1.University School of Information and Communication Technology, GGSIPUDelhiIndia

Personalised recommendations