User Experience Evaluation by ERM: Experience Recollection Method

  • Masaaki KurosuEmail author
  • Ayako Hashizume
  • Yuuki Ueno
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10901)


Evaluation of user experience (UX) is the key for improving the quality of artifact that people use in their everyday life and thus improve their quality of life. Two types of evaluation methods can be classified, i.e. the real-time method (e.g. ESM by Larson & Csikszentmihalyi) and memory-based method (e.g. UX curve by Kujala et al.). The ERM proposed here belongs to the latter and asks users to remind their past experience from the time when they had the expectation for targeted artifact and to rate the degree of satisfaction by −10 to +10 rating scale. Two ways of analysis are proposed, one is classifying the result by the aspect of experience and another is classifying the result on the time phase. Web-based application was developed so that the data collection will become efficient.


User experience (UX) Evaluation Experience recollection method (ERM) Rating scale Satisfaction 


  1. 1.
  2. 2.
    Ando, M.: Dynamic Change of Long-term Usability – Change of Context of Use and Its Influence, pp. 31–45, Sokendai Bunka-kagaku Kenkyu (2007). (in Japanese)Google Scholar
  3. 3.
    Blackwell, R.D., Engel, J.F., Miniard, P.W.: Consumer Behaviour. South Western, Div of Thomson Learning International (2005)Google Scholar
  4. 4.
    Hashizume, A., Ueno, Y., Tomida, T., Suzuki, H., Kurosu, M.: Web tool for the UX graph. In: ISASE 2016 Proceedings (2016)Google Scholar
  5. 5.
    ISO9241-11:1998: Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs) – Part 11: Guidance on UsabilityGoogle Scholar
  6. 6.
    ISO 9241-210:2010: Ergonomics of Human-System Interaction - Human-Centred Design for Interactive SystemsGoogle Scholar
  7. 7.
    ISO/IEC25010:2011: Systems and Software Engineering – Systems and Software Quality Requirements and Evaluation (SQuaRE) – System and Software Quality ModelsGoogle Scholar
  8. 8.
    Kahneman, D., Fredrickson, B.L., Schreiber, C.A., Redelmeier, D.A.: When more pain is preferred to less: adding a better end. Psychol. Sci. 4(6), 401–405 (1993)CrossRefGoogle Scholar
  9. 9.
    Karapanos, E., Zimmerman, J., Forlizzi, J., Martens, J.-B.: User experience over time: an initial framework. In: ACM SIGCHI 2009 Proceedings, pp. 729–738 (2009)Google Scholar
  10. 10.
    Karapanos, E., Martens, J.B., Hassenzahl, M.: Reconstructing experiences with iScale. Int. J. Hum. Comput. Stud. 70, 849–865 (2012)CrossRefGoogle Scholar
  11. 11.
    Kawakita, J.: Idea Generation Method - for the Development of Creativity. Chuo-koron sha (1967). (in Japanese)Google Scholar
  12. 12.
    Kujala, S., Roto, V., Vaananen-Vainio-Mattila, K., Karapanos, E., Sinnela, A.: UX curve: a method for evaluating long-term user experience. Interact. Comput. 23(5), 473–483 (2011)CrossRefGoogle Scholar
  13. 13.
    Kurosu, M.: Usability, quality in use and the model of quality characteristics. In: Kurosu, M. (ed.) HCI 2015. LNCS, vol. 9169, pp. 227–237. Springer, Cham (2015). Scholar
  14. 14.
    Kurosu, M.: Theory of User Engineering. CRC Press, Boca Raton (2016)Google Scholar
  15. 15.
    Kurosu, M., Hashizume, A.: TFD (Time Frame Diary) – a new diary method for obtaining ethnographic information. In: APCHI 2008 Proceedings (2008)Google Scholar
  16. 16.
    Larson, R., Csikszentmihalyi, M.: The experience sampling method, In: Reis, H.T. (ed.) Naturalistic Approaches to Studying Social Interaction, New Directions for Methodology of Social and Behavioral Sciences, pp. 41–56. Jossey-Bass (1983)Google Scholar
  17. 17.
    Lewin, K., Dembo, T., Festinger, L., Sears, P.S.: Level of aspiration. In: Hunt, J.McV. (ed.) Personality and the Behavioral Disorder, vol. 1, pp. 333–378 (1944)Google Scholar
  18. 18.
    Loftus, E.F.: Memory: Surprising New Insights into How We Remember and Why We Forget. Addison-Wesley, Reading (1980)Google Scholar
  19. 19.
    Munsterberg, H.: On the Witness Stand: Essays on Psychology and Crime, Doubleday, Page & Co., Garden City (1908)Google Scholar
  20. 20.
    Norman, D.A.: The Invisible Computer – Why Good Products Can Fail, the Personal Computer is So Complex, and Information Appliances are the Solution, The MIT Press, Cambridge (1998)Google Scholar
  21. 21.
    Roto, V., Law, E.L.-C., Vermeeren, A., Hoonhout, J. (eds.): User Experience White Paper – Bringing Clarity to the Concept of User Experience (2011).
  22. 22.
    Ueno, Y., Kurosu, M., Hashizume, A.: On-line version of UX graph (2016). (in English).
  23. 23.
    Ueno, Y., Kurosu, M., Hashizume, A.: On-line version of ERM (2017). (in Japanese).

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.The Open University of JapanChibaJapan
  2. 2.Tokyo Metropolitan UniversityTokyoJapan
  3. 3.Otsuka Business ServiceTokyoJapan

Personalised recommendations