A Web Usability Evaluation Process for Model-Driven Web Development

  • Adrian Fernandez
  • Silvia Abrahão
  • Emilio Insfran
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6741)


Most of usability evaluation methods for the Web domain have several limitations such as: the concept of usability is only partially supported; usability evaluations are mainly performed when the Web application has been completed; there is a lack of guidelines on how to properly integrate usability into Web development. This paper addresses these issues through the presentation of a Web Usability Evaluation Process (WUEP) for integrating usability evaluations at different stages of model-driven Web development processes. A case study was performed in order to analyze the feasibility of the approach by applying WUEP to evaluate the usability of a real Web application that was developed by using a specific model-driven development process in the industrial domain. The results suggest that WUEP provides good insights into the performance of usability evaluations. The usability problems are corrected at the model and model-transformation levels, thereby improving the usability of the final Web application.


Web Usability Evaluation Process Web Metrics Model-Driven Web Development 


  1. 1.
    Abrahão, S., Iborra, E., Vanderdonckt, J.: Usability Evaluation of User Interfaces Generated with a Model-Driven Architecture Tool. In: Maturing Usability: Quality in Software, Interaction and Value, Springer, pp. 3-32 (2007)Google Scholar
  2. 2.
    Abrahão, S., Insfran, E.: Early Usability Evaluation in Model-Driven Architecture Environments. In: 6th IEEE International Conference on Quality Software (QSIC 2006), pp. 287–294. IEEE Computer Society, Beijing (2006)CrossRefGoogle Scholar
  3. 3.
    Atterer, R., Schmidt, A.: Adding Usability to Web Engineering Models and Tools. In: Lowe, D.G., Gaedke, M. (eds.) ICWE 2005. LNCS, vol. 3579, pp. 36–41. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  4. 4.
    Blackmon, M.H., Polson, P.G., Kitajima, M., Lewis, C.: Cognitive Walkthrough for the Web. In: Proc. of the ACM CHI 2002, USA, pp. 463–470 (2002)Google Scholar
  5. 5.
    Botafogo, R., Rivlin, E., Shneiderman, B.: Structural analysis of hypertexts: Identifying hierarchies and useful metrics. ACM Trans. Inf. Systems 10(2), 142–180 (1992)CrossRefGoogle Scholar
  6. 6.
    Calero, C., Ruiz, J., Piattini, M.: Classifying Web metrics using the Web quality model. Online Information Review Journal. Emerald Group. 29(3), 227–248 (2005)CrossRefGoogle Scholar
  7. 7.
    Casteleyn, S., Daniel, F., Dolog, P., Matera, M.: Engineering Web Applications. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  8. 8.
    Ceri, S., Fraternali, P., Bongio, A.: Web Modeling Language (WebML): A Modeling Language for Designing Web Sites. In: Proc. of the 9th WWW Conf., pp. 137–157 (2000)Google Scholar
  9. 9.
    Cockton, G., Lavery, D., Woolrychn, A.: Inspection-based evaluations. In: Jacko, J.A., Sears, A. (eds.) The Human-Computer Interaction Handbook, 2nd edn., pp. 1171–1190 (2003)Google Scholar
  10. 10.
    Conte, T., Massollar, J., Mendes, E., Travassos, G.H.: Usability Evaluation Based on Web Design Perspectives. In: 1st Int. Symposium on Empirical Software Engineering and Measurement (ESEM 2007), Spain, pp. 146–155 (2007)Google Scholar
  11. 11.
    Fernandez, A., Insfran, E., Abrahão, S.: Integrating a Usability Model into Model-Driven Web Development Processes. In: Vossen, G., Long, D.D.E., Yu, J.X. (eds.) WISE 2009. LNCS, vol. 5802, pp. 497–510. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  12. 12.
    Fernandez, A., Insfran, E., Abrahão, S.: Usability Evaluation Methods for the Web: A Systematic Mapping Study. In: Information and Software Technology (2011), doi:10.1016/j.infsof.2011.02.007Google Scholar
  13. 13.
    Gomez, J., Cachero, C., Pastor, O.: Conceptual Modeling of Device-Independent Web Applications. IEEE MultiMedia 8(2), 26–39 (2001)CrossRefGoogle Scholar
  14. 14.
    Ivory, M.Y.: An Empirical Foundation for Automated Web Interface Evaluation. PhD Thesis, University of California, Berkeley, Computer Science Division (2001)Google Scholar
  15. 15.
    ISO/IEC 9126-1 Standard, Software Engineering, Product Quality - Part 1: Quality Model (2001)Google Scholar
  16. 16.
    ISO/IEC 25000 series, Software Engineering, Software Product Quality Requirements and Evaluation, SQuaRE (2005)Google Scholar
  17. 17.
    Juristo, N., Moreno, A., Sanchez-Segura, M.I.: Guidelines for eliciting usability functionalities. IEEE Transactions on Software Engineering 33(11), 744–758 (2007)CrossRefGoogle Scholar
  18. 18.
    Leavit, M., Shneiderman, B.: Research-Based Web Design & Usability Guidelines. U.S. Government Printing Office (2006), (last access: March 2011)
  19. 19.
    Molina, F., Toval, J.A.: Integrating usability requirements that can be evaluated in design time into Model Driven Engineering of Web Information Systems. Advances in Engineering Software 40(12), 1306–1317 (2009)CrossRefzbMATHGoogle Scholar
  20. 20.
    Neuwirth, C. M., Regli, S. H.: IEEE Internet Computing Special Issue on Usability and the Web, vol. 6(2) (2002)Google Scholar
  21. 21.
    Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: Proc. ACM CHI 1990 Conf., Seattle, WA, pp. 249–256 (1990)Google Scholar
  22. 22.
    Olsina, L., Rossi, G.: Measuring Web Application Quality with WebQEM. IEEE Multimedia 9(4), 20–29 (2002)CrossRefGoogle Scholar
  23. 23.
    Offutt, J.: Quality Attributes of Web Software Applications. IEEE Software: Special Issue on Software Engineering of Internet Software, 25–32 (2002)Google Scholar
  24. 24.
    Panach, I., Condori, N., Valverde, F., Aquino, N., Pastor, O.: Understandability measurement in an early usability evaluation for model-driven development: an empirical study. In: Int. Empirical Software Engineering and Measurement (ESEM 2008), pp. 354–356 (2008)Google Scholar
  25. 25.
    Runeson, P., Höst, M.: Guidelines for Conducting and Reporting Case Study Research in Software Engineering. Empirical Software Engineering 14(2) (2009)Google Scholar
  26. 26.
    World Wide Web Consortium W3C: Web Content Accessibility Guidelines (WCAG) 2.0 (2008), (last access: March 2011)

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Adrian Fernandez
    • 1
  • Silvia Abrahão
    • 1
  • Emilio Insfran
    • 1
  1. 1.ISSI Research Group, Departamento de Sistemas Informáticos y ComputaciónUniversitat Politècnica de ValènciaValenciaSpain

Personalised recommendations