On User eXperience Evaluation: Combining User Tests and Psychometrics

  • Virginia Zaraza RusuEmail author
  • Cristian Rusu
  • Pablo Cáceres
  • Virginica Rusu
  • Daniela Quiñones
  • Patricia Muñoz
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 722)


The ISO 9241-210 standard defines User eXperience (UX) as a person’s perceptions and responses resulting from the use and/or anticipated use of a product, system or service. One of the main perspectives on UX is the psychological one, being fundamental in all user studies. Psychometrics as a psychological phenomena measurement tool could be helpful in UX studies. The paper explores how user testing, query techniques and psychometrics may complement each other when assessing UX. We analyze empirical evidences, using the World Digital Library ( as case study.


User eXperience User testing Psychometrics Digital Library 


  1. 1.
    ISO 9241-210: Ergonomics of human-system interaction — Part 210: human-centred de-sign for interactive systems. International Organization for Standardization, Geneva (2010)Google Scholar
  2. 2.
    Bevan, N., Carter, J., Harker, S.: ISO 9241-11 revised: what have we learnt about usability since 1998? In: Kurosu, M. (ed.) Human-Computer Interaction. LNCS, vol. 9169, pp. 143–151. Springer, Heidelberg (2015)Google Scholar
  3. 3.
    Rusu, C., Rusu, V., Roncagliolo, S., González, C.: Usability and user experience: what should we care about? Int. J. Inf. Technol. Syst. Approach 8(2), 1–12 (2015)CrossRefGoogle Scholar
  4. 4.
    Lewis, J.: Usability: lessons learned… and yet to be learned. Int. J. Hum. Comput. Interact. 30(9), 663–684 (2014)CrossRefGoogle Scholar
  5. 5.
    Roto, V., Law, E., Vermeeren, A., Hoonhout, J.: User experience white paper. Bringing clarity to the concept of user experience (2011). Accessed 18 Oct 2017
  6. 6.
  7. 7.
    World Digital Library.
  8. 8.
    Furr, R.M., Bacharach, V.R.: Psychometrics. An Introduction. Sage, Los Angeles (2014)Google Scholar
  9. 9.
    Strickland, B.R. (ed.): The Gale Encyclopedia of Psychology. Gale, Detroit (2001)Google Scholar
  10. 10.
    Deci, E.L., Ryan, R.M.: Facilitating optimal motivation and psychological well-being across life’s domains. Can. Psychol. 49(1), 14–23 (2008)CrossRefGoogle Scholar
  11. 11.
    Gagné, M., Forest, J., Vansteenkiste, M., Crevier-Braud, L., van den Broeck, A., Aspeli, A.K., Bellerose, J., Benabou, C., Chemolli, E., Güntert, S.T., Halvari, H., Indiyastuti, D.L., Johnson, P.A., Molstad, M.H., Naudin, M., Ndao, A., Olafsen, A.H., Roussel, P., Wang, Z., Westbye, C.: The multidimensional work motivation scale: validation evidence in seven languages and nine countries. Eur. J. Work Organ. Psychol. 24(2), 178–196 (2014)CrossRefGoogle Scholar
  12. 12.
    Deci, E.L., Ryan, R.M.: Self-determination theory. In: Wright, J.D. (ed.) International Encyclopedia of the Social & Behavioral Sciences, pp. 486–491. Elsevier, Amsterdam (2015)CrossRefGoogle Scholar
  13. 13.
    Deci, E.L., Ryan, R.M.: The “What” and “Why” of goal pursuits: human needs and the self-determination of behavior. Psychol. Inq. 11(4), 227–268 (2000)CrossRefGoogle Scholar
  14. 14.
    Arms, W.Y.: Digital Libraries. MIT, Cambridge (2000)Google Scholar
  15. 15.
    Lewis, J., Sauro, J.: Revisiting the factor structure of the system usability scale. J. Usability Stud. 12(4), 183–192 (2017)Google Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  • Virginia Zaraza Rusu
    • 1
    Email author
  • Cristian Rusu
    • 1
  • Pablo Cáceres
    • 1
  • Virginica Rusu
    • 2
  • Daniela Quiñones
    • 1
  • Patricia Muñoz
    • 1
  1. 1.Pontificia Universidad Católica de ValparaísoValparaísoChile
  2. 2.Universidad de Playa Ancha de Ciencias de la EducaciónValparaísoChile

Personalised recommendations