The Factor Structure of the System Usability Scale
Since its introduction in 1986, the 10-item System Usability Scale (SUS) has been assumed to be unidimensional. Factor analysis of two independent SUS data sets reveals that the SUS actually has two factors – Usable (8 items) and Learnable (2 items – specifically, Items 4 and 10). These new scales have reasonable reliability (coefficient alpha of .91 and .70, respectively). They correlate highly with the overall SUS (r = .985 and .784, respectively) and correlate significantly with one another (r = .664), but at a low enough level to use as separate scales. A sensitivity analysis using data from 19 tests had a significant Test by Scale interaction, providing additional evidence of the differential utility of the new scales. Practitioners can continue to use the current SUS as is, but, at no extra cost, can also take advantage of these new scales to extract additional information from their SUS data. The data support the use of “awkward” rather than “cumbersome” in Item 8.
KeywordsSystem Usability Scale SUS factor analysis psychometric evaluation subjective usability measurement usability learnability usable learnable
Unable to display preview. Download preview PDF.
- 1.Brooke, J.: SUS: A “Quick and Dirty” Usability Scale. In: Jordan, P.W., Thomas, B., Weerdmeester, B.A., McClelland (eds.) Usability Evaluation in Industry, pp. 189–194. Taylor & Francis, London (1996)Google Scholar
- 3.Sauro, J., Lewis, J.R.: Correlations among Prototypical Usability Metrics: Evidence for the Construct of Usability. In: The Proceedings of CHI 2009 (to appear, 2009)Google Scholar
- 5.Nunnally, J.C.: Psychometric Theory. McGraw-Hill, New York (1978)Google Scholar
- 6.Lucey, N.M.: More than Meets the I: User-Satisfaction of Computer Systems. Unpublished thesis for Diploma in Applied Psychology, University College Cork, Cork, Ireland (1991)Google Scholar
- 7.Kirakowski, J.: The Use of Questionnaire Methods for Usability Assessment (1994), http://sumi.ucc.ie/sumipapp.html
- 9.Tullis, T.S., Stetson, J.N.: A Comparison of Questionnaires for Assessing Website Usability. Unpublished presentation given at the UPA Annual Conference (2004), http://home.comcast.net/~tomtullis/publications/UPA2004TullisStetson.pdf
- 12.Cliff, N.: Analyzing Multivariate Data. Harcourt Brace Jovanovich, San Diego (1987)Google Scholar
- 14.Finstad, K.: The System Usability Scale and Non-Native English Speakers. Journal of Usability Studies 1, 185–188 (2006)Google Scholar