Quality, Quality in Use, Actual Usability and User Experience as Key Drivers for Web Application Evaluation

  • Philip Lew
  • Luis Olsina
  • Li Zhang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6189)


Due to the increasing interest in Web quality, usability and user experience, quality models and frameworks have become a prominent research area as a first step in evaluating them. The ISO 25010/25012 standards were recently issued which specify and evaluate software and data quality requirements. In this work we propose extending the ISO 25010 standard to incorporate new characteristics and concepts into a flexible modeling framework. Particularly, we focus on including information quality, and learnability in use characteristics, and actual usability and user experience concepts into the modeling framework. The resulting models and framework contribute towards a flexible, integrated approach to evaluate Web applications. The operability and particularly the learnability of a real Web application are evaluated using the framework.


Learnability quality usability in use learnability in use usability information quality user experience 


  1. 1.
    Abran, A., Surya, W., Khelifi, A., Rilling, J., Seffah, A., Robert, F.: Consolidating the ISO Usability Models. In: 11th annual Int’l Software Quality Management Conference (2003)Google Scholar
  2. 2.
    Bevan, N.: Extending quality in use to provide a framework for usability measurement. In: Proc. of HCI Int’l 2009, San Diego, California, USA (2009)Google Scholar
  3. 3.
    Bevan, N.: Classifying and selecting UX and usability measures. In: Proc. of the 5th COST294-MAUSE Workshop on Meaningful Measures: Valid Useful User Experience Measurement (2008)Google Scholar
  4. 4.
    Covella, G., Olsina, L.: Assessing Quality in Use in a Consistent Way. In: ACM proceedings, Int’l Congress on Web Engineering (ICWE ’06), SF, USA, pp. 1–8 (2006)Google Scholar
  5. 5.
    Ginige, A., Murugesan, S.: Web Engineering: An Introduction. IEEE Multimedia 8(1), 14–18 (2001)CrossRefGoogle Scholar
  6. 6.
    Grossman, T., Fitzmaurice, G., Attar, R.: A survey of software learnability: metrics, methodologies and guidelines. In: Proceedings of the 27th Int’l conference on Human factors in computing systems, pp. 649–658 (2009)Google Scholar
  7. 7.
    Hassenzahl, M.: User experience (UX): towards an experiential perspective on product quality, IHM. In: Proc. of the 20th Int’l Conference of the Assoc. Francophone d’Interaction Homme-Machine, vol. 339, pp. 11–15 (2008)Google Scholar
  8. 8.
    ISO/IEC CD 25010  Software engineering – Software product Quality Requirements and Evaluation (SQuaRE) – Quality model and guide (2009)Google Scholar
  9. 9.
    ISO/IEC 25012 Software engineering – Software product Quality Requirements and Evaluation (SQuaRE) – Data quality model (2008) Google Scholar
  10. 10.
    ISO 9241-110, Ergonomics of human-system interaction, Part 110: Dialogue principles (2006)Google Scholar
  11. 11.
    ISO/IEC 9126-1. Software Engineering— Software Product Quality—Part 1: Quality Model (2001) Google Scholar
  12. 12.
    Lew, P., Zhang, L., Wang, S.: Model and Measurement for Web Application Usability from an End User Perspective. In: Proc. of QAW 2009: 1st Quality Assessment in Web Workshop held at Int’l Congress on Web Engineering (ICWE ’09), CEUR Workshop Proceedings, San Sebastian, Spain, vol. 561 (2009) ISSN 1613-0073,
  13. 13.
    Nielsen, J., Levy, J.: Measuring usability: preference vs. performance. Comm. of the ACM 37(4), 66–75 (1994)CrossRefGoogle Scholar
  14. 14.
    Olsina, L., Sassano, R., Mich, L.: Towards the Quality of Web 2.0 Applications. In: Proc. of 8th Int’l Workshop on Web-oriented Software Technology (IWWOST 2009) held at Int’l Congress on Web Engineering (ICWE09), San Sebastian, Spain, vol. 493, pp. 3–15, CEUR ( (2009) ISSN 1613-0073Google Scholar
  15. 15.
    Olsina, L., Rossi, G., Garrido, A., Distante, D., Canfora, G.: Web Applications Refactoring and Evaluation: A Quality-Oriented Improvement Approach. Journal of Web Engineering 4(7), 258–280 (2008)Google Scholar
  16. 16.
    Olsina, L., Papa, F., Molina, H.: How to Measure and Evaluate Web Applications in a Consistent Way. In: Rossi, Pastor, Schwabe, Olsina (eds.) Springer book: Web Engineering: Modeling and Implementing Web Applications, ch. 13, pp. 385–420 (2007)Google Scholar
  17. 17.
    Santos, P.J., Badre, A.N.: Discount learnability evaluation. Graphics, Visualization & Usability Center, Georgia Institute of Technology (1995), (accessed by 20/12/2009)
  18. 18.
    Stewart, T.: Usability or user experience - what’s the difference? System concepts (2008), (accessed by 20/12/2009)
  19. 19.
    Vaníček, J.: Software and Data Quality. In: Proc. Conference of Agricultural Perspectives XIV, Czech University of Agriculture in Prague, vol. 52 (3), pp. 138–146 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Philip Lew
    • 1
  • Luis Olsina
    • 2
  • Li Zhang
    • 1
  1. 1.School of Computer Science and EngineeringBeihang UniversityChina
  2. 2.GIDISWeb Engineering School at Universidad Nacional de La PampaArgentina

Personalised recommendations