Abstract
The challenge of developing more usable Web applications has motivated the appearance of a number of techniques, methods and tools to address Web usability issues. Although there are many proposals for supporting the development of usable Web applications, many developers are not aware of them and many organizations do not properly apply them. This paper reports on a systematic review of the use of usability evaluation methods in Web development. The objective of the review is to investigate what usability evaluation methods have been employed by researchers to evaluate Web artifacts and how they were employed. A total of 51 research papers have been reviewed from an initial set of 410 papers. The results show that 45% of the papers reviewed reported the use of evaluation methods specifically crafted for the Web and that the most employed method is user testing. In addition, the results of the review have identified several research gaps. Specifically, 80% of the evaluations are still performed at the implementation phase of Web applications development and 47% of the papers did not present any validation of the usability evaluation method(s) employed.
This work is funded by the META project (TIN2006-15175-C05-05), the Quality-driven model transformations project (UPV), and the CALIPSO research network (TIN2005-24055-E).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Alva, O.M.E., Martínez Prieto, A.B., Cueva Lovelle, J.M., Sagástegui Ch., T.H., López, B.: Comparison of Methods and Existing Tools for the Measurement of Usability in the Web. In: Proc. Int. Conf. on Web Engineering, Spain, pp. 386–389. Springer, Heidelberg (2003)
Baresi, L., Fraternali, P., Houben, G.-J. (eds.): ICWE 2007. LNCS, vol. 4607. Springer, Heidelberg (2007)
Batra, S., Bishu, R.R.: Web Usability and Evaluation: Issues and Concerns. In: Aykin, N. (ed.) HCII 2007. LNCS, vol. 4559, pp. 243–249. Springer, Heidelberg (2007)
Becker, S.A., Berkemeyer, A.: Rapid Application Design and Testing of Web Usability. IEEE Multimedia 9(4), 38–46 (2002)
Blackmon, M.H., Polson, P.G., Kitajima, M., Lewis, C.: Cognitive walkthrough for the web. In: Proc. of the CHI 2002, Minneapolis, Minnesota, USA, pp. 463–470 (2002)
Bolchini, D., Garzotto, F.: Quality of Web Usability Evaluation Methods: An Empirical Study on MiLE+. In: Proc. of the IWWUA 2007, Nancy, France, pp. 481–492 (2007)
Feldman, S.I., Uretsky, M., Najork, M., Wills, C.E.: Proc. of the International Conference on World Wide Web 2004, pp. 17–20. ACM, New York (2004)
Fenton, N., Pfleeger, S.L.: Software Metrics: A Rigorous and Practical Approach, 2nd edn. International Thomson Computer Press (1996)
Freire, A.P., Goularte, R., Fortes, R.P.M.: Techniques for Developing more Accessible Applications: a Survey Towards a Process Classifications. In: Proc. of the 25th ACM Int. Conference on Design of communication, El Paso, Texas, USA, pp. 162–169 (2007)
Hornbæk, K., Frøkjær, E.: Comparing Usability Problems and Redesign Proposals as Input to Practical Systems Development. In: Proc. of the CHI 2005, Portland, USA, pp. 391–400 (2005)
Hornbæk, K., Frøkjær, E.: Two psychology-based usability inspection techniques studied in a diary experiment. In: Proc. of the 3rd Nordic conference on Human-computer interaction (NordCHI 2004), Tampere, Finland, pp. 3–12 (2004)
ISO – International Standard Organization, ISO 9241-11: Ergonomic requirements for office work with visual display terminals (VDTs) – Part 11: Guidance on usability (1998)
ISO – International Standard Organization, ISO/IEC 12207: Standard for Information Technology – Software Lifecycle Processes (1998)
Kitchenham, B.: Guidelines for Performing Systematic Literature Reviews in Software Engineering. Version 2.3, EBSE Technical Report, Keele University, UK
Koch, N., Fraternali, P., Wirsing, M. (eds.): ICWE 2004. LNCS, vol. 3140. Springer, Heidelberg (2004)
Cueva Lovelle, J.M., Rodríguez, B.M.G., Gayo, J.E.L., Ruiz, M.d.P.P., Aguilar, L.J. (eds.): ICWE 2003. LNCS, vol. 2722. Springer, Heidelberg (2003)
Lowe, D.G., Gaedke, M. (eds.): ICWE 2005. LNCS, vol. 3579. Springer, Heidelberg (2005)
Matera, M., Rizzo, F., Carughi, G.T.: Web Usability: Principles and Evaluation Methods. In: Mendes, E., Mosley, N. (eds.) Web Engineering, pp. 143–179.
Mendes, E.: A Systematic Review of Web Engineering Research. In: Proc. of the International Symposium on Empirical Software Engineering (ISESE 2005), pp. 498–507 (2005)
Mendes, E., Mosley, N. (eds.): Web Engineering. Springer, Heidelberg (2005)
Neuwirth, C.M., Regli, S.H.: IEEE Internet Computing Special Issue on Usability and the Web. IEEE Internet Computing Special Issue on Usability and the Web 6(2) (March/April 2002)
Sutcliffe, A.: Assessing the Reliability of Heuristic Evaluation for Website Attractiveness and Usability. In: Proc. of the HICSS 2002, vol. 5, pp. 137–141.
Yvory, M., Hearst, M.: The State of the Art in Automating Usability Evaluation of User Interfaces. ACM Computing Surveys 33(4), 470–516 (2001)
Weske, M., Hacid, M.S., Godart, C. (eds.): Web Information Systems Engineering - WISE 2007 Workshops Proceedings, Nancy, France, December 3, 2007. LNCS, vol. 4832. Springer, Heidelberg (2007)
Wolber, D., Calder, N., Brooks, C.H., Ginige, A. (eds.): Proc. of the 6th International Conference on Web Engineering 2006, alo Alto-CA, USA, July 11-14. ACM, New York (2006)
WWW 2003, Proc. of the Twelfth International World Wide Web Conference 2003, Budapest, Hungary, May 20-24, 2003. ACM, New York (2003), http://www2003.org
: WWW 2007, Proc. of the Twelfth International World Wide Web Conference, Banff, Alberta, Canada, May 8-12, 2007. ACM, New York (2007), http://www2007.org
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Insfran, E., Fernandez, A. (2008). A Systematic Review of Usability Evaluation in Web Development. In: Hartmann, S., Zhou, X., Kirchberg, M. (eds) Web Information Systems Engineering – WISE 2008 Workshops. WISE 2008. Lecture Notes in Computer Science, vol 5176. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85200-1_10
Download citation
DOI: https://doi.org/10.1007/978-3-540-85200-1_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85199-8
Online ISBN: 978-3-540-85200-1
eBook Packages: Computer ScienceComputer Science (R0)