Objective Learnability Estimation of Software Systems

  • Alexey ChistyakovEmail author
  • María T. Soto-Sanfiel
  • Enric Martí
  • Takeo Igarashi
  • Jordi Carrabina
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10069)


Learnability is a fundamental usability factor. It is included in several well known and widely used software usability evaluation models such as: IBM’s Computer Usability Satisfaction Questionnaire (CUSQ), System Usability Measurement Inventory (SUMI), System Usability Scale (SUS), and others. However, all of them assess learnability only subjectively. Taking into account the fact of presence of differences in perceived duration in interaction between human and computer, development of a new approach targeting usability, as well as learnability, in objective measures could be of great interest. This paper describes our endeavour in pursuing this task. We present our approach to the problem, introduce an instrument for calculating objective learnability out of times of completion, and reveal results of a user study among 101 participants conducted to test adequacy of the method.


Human-Computer Interaction Learnability Usability Usability Measurement Usability Engineering 


  1. 1.
  2. 2.
    Dix, A.: Human-Computer Interaction. Springer, New York (2009)Google Scholar
  3. 3.
    Frøkjær, E., Hertzum, M., Hornbæk, K.: Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? In: CHI 2000 Proceedings of the SIGCHI conference on Human, vol. 2, pp. 345–352 (2000)
  4. 4.
    Gediga, G., Hamborg, K.C., Düntsch, I.: The isometrics usability inventory: an operationalization of ISO 9241–10 supporting summative and formative evaluation of software systems. Behav. Inf. Technol. 18(3), 151–164 (1999)CrossRefGoogle Scholar
  5. 5.
    Hoffman, R., Marx, M.: Measurement for evaluating the learnability and resilience of methods of cognitive work. Theor. Issues Ergon. Sci. 11, 561–575 (2010). CrossRefGoogle Scholar
  6. 6.
    Hornbæk, K.: Current practice in measuring usability: challenges to usability studies and research. Int. J. Hum Comput. Stud. 64(2), 79–102 (2006). CrossRefGoogle Scholar
  7. 7.
    Kirakowski, J., Corbett, M.: SUMI: the software usability measurement inventory. Br. J. Educ. Technol. 24, 210–212 (1993). CrossRefGoogle Scholar
  8. 8.
    Kirakowski, J., Cierlik, B.: Measuring the usability of web sites. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 42, pp. 424–428. SAGE Publications (1998)Google Scholar
  9. 9.
    Kitchenham, B.A., Hughes, R.T., Linkman, S.G.: Modeling software measurement data. IEEE Trans. Softw. Eng. 27(9), 788–804 (2001)CrossRefGoogle Scholar
  10. 10.
    Lewis, J.R.: IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum. Comput. Interact. 7(1), 57–78 (1995)CrossRefGoogle Scholar
  11. 11.
    Lewis, J.R., Sauro, J.: The factor structure of the system usability scale. In: Kurosu, M. (ed.) HCD 2009. LNCS, vol. 5619, pp. 94–103. Springer, Heidelberg (2009). doi: 10.1007/978-3-642-02806-9_12. CrossRefGoogle Scholar
  12. 12.
    Löwgren, J.: Human-Computer Interaction: What Every System Developer Should Know. Studentlitteratur, Lund (1993)Google Scholar
  13. 13.
    Molich, R., Nielsen, J.: Improving a human-computer dialogue. Commun. ACM 33(3), 338–348 (1990)CrossRefGoogle Scholar
  14. 14.
    Nielsen, J.: Usability Engineering, vol. 11. Elsevier Science (1994).
  15. 15.
    Padayachee, I., Kotze, P., van Der Merwe, A.: ISO 9126 external systems quality characteristics, sub-characteristics and domain specific criteria for evaluating e-learning systems. In: The Southern African Computer Lecturers’ Association, University of Pretoria, South Africa (2010)Google Scholar
  16. 16.
    Rafique, I., Weng, J., Wang, Y., Abbasi, M.Q., Lew, P., Wang, X.: Evaluating software learnability: a learnability attributes model. In: 2012 International Conference on Systems and Informatics (ICSAI2012), pp. 2443–2447. IEEE, May 2012.
  17. 17.
    Shackel, B.: Usability-context, framework, definition, design and evaluation. In: Shackel, B., Richardson, S. (eds.) Human Factors for Informatics Usability, pp. 21–37. Cambridge University Press, Cambridge (1991)Google Scholar
  18. 18.
    Tractinsky, N., Meyer, J.: Task structure and the apparent duration of hierarchical search. Int. J. Hum. Comput. Stud. 55(5), 845–860 (2001)CrossRefzbMATHGoogle Scholar
  19. 19.
    Wharton, C., Rieman, J., Lewis, C., Polson, P.: The cognitive walkthrough method: a practitioner’s guide. In: Nielsen, J., Mack, R.L. (eds.) Usability Inspection Methods, pp. 105–140. John Wiley & Sons, Inc., New York (1994)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Alexey Chistyakov
    • 1
    Email author
  • María T. Soto-Sanfiel
    • 2
  • Enric Martí
    • 1
  • Takeo Igarashi
    • 3
  • Jordi Carrabina
    • 4
  1. 1.Computer Science DepartmentUniversitat Autónoma de Barcelona (UAB)BellaterraSpain
  2. 2.Audiovisual Communication and Advertising DepartmentUABBellaterraSpain
  3. 3.Department of Computer ScienceThe University of TokyoBunkyōJapan
  4. 4.UAB, CEPHIS, Escola d’EnginyeriaBellaterraSpain

Personalised recommendations