Abstract
A cost-effective approach for web portal usability evaluation is presented in this chapter. Due to specifics of portals as web sites, mainly referring to their structure and media specificities along with diversity of users, tasks and workflows, distinct assessment approaches should be employed. Methodology brings together laboratory-based testing along with experts’ inspection and produces valuable results for users and developers at a low cost. Compared to our first study, user assessment applied a faster and less expensive procedure, providing stability of measures with reduced sample size, while inspection employed fewer specialists with higher expertize and a simpler evaluation form. Directions of future work are identified.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bevan, N. (1995) Measuring usability as quality of use. Software Quality Journal 4: 115–150.
Boye, J. (2006) Improving portal usability. CMS Watch (available at http://www.cmswatch.com/Feature/151-Portal-Usability).
Brantley, S., Armstrong, A., and Lewis, K. M. (2006) Usability testing of a customizable library web portal. College & Research Libraries 67: 2.
Brooke, J. (1996) SUS: a “quick and dirty” usability scale. In: Jordan, P. W., Thomas, B., Weerdmeester, B. A, and McClelland, A. L. (Eds.): Usability Evaluation in Industry. Taylor and Francis, London, pp. 189–194.
Can, F., Kocberber, S., Baglioglu, O., Kardas, S., Ocalan, H.C., and Uyar, E. (2008) Bilkent news portal: A personalizable system with new event detection and tracking capabilities. SIGIR’08, July 20–24, Singapore.
Carr, A. (2004) Tapor: A case study of web portal usability (available at http://tapor.ualberta.ca/News/TAPoR_UI.pdf).
Carstens, D. S., and Patterson, P. (2005) Usability study of travel websites. Journal of Usability Studies 1: 1.
GemiusAudience (2008) http://www.valicon.net/uploads/tablica_za_web_aktualni_podaci_za_kolovoz_o8.pdf.
GFK Croatia (2008) http://www.gfk.hr/press1/infopis.htm.
Granić, A., Mitrović, I., and Marangunić, N. (2009) Web portal design: an employment of a range of assessment methods. In: Papadopoulos, G. A., Wojtkowski, W., Wojtkowski, W. G., Wrycza, S., & Zupancic, J. (Eds.): Information Systems Development: Towards a Service Provision Society. Springer, New York, NY, pp. 131–139.
Granić, A., Mitrović, I., and Marangunić, N. (2008) Experience with usability testing of web portals. In: Cordeiro, J., Filipe, J., and Hammoudi, S. (Eds.) Proceedings of the 4th International Conference on Web Information Systems and Technologies – WEBIST 2008.. Portugal: INSTICC PRESS, pp. 161–167.
Hornbæk, K. (2006) Current practice in measuring usability: Challenges to usability studies and research. International Journal of Man-Machine Studies 64: 2.
Hornbæk, K., and Law, E. L.-C. (2007) Meta-analysis of correlations among usability measures. CHI 2007 Proceedings, April 28–May 3, San Jose, CA, USA.
Hvannberg, E., Law, E. L.-C., Larusdottir, M. (2007) Heuristic evaluation: Comparing ways of finding and reporting usability problems. Interacting with Computers 19: 225–240.
ISO/IEC 25062:2006 (2006) Software engineering – Software product Quality Req. and Evaluation (SQuaRE) – Common Industry Format (CIF) for usability test reports.
Kellar, M., and Watters, C. (2006) Using web browser interactions to predict task. WWW 2006, May 23–26, Edinburgh, Scotland.
Klausegger, C. (2006) Evaluating internet portals – An empirical study of acceptance measurement based on Austrian National Tourist Office’s service portal. Journal of Quality Assurance in Hospitality & Tourism 6: 3–4.
Lewis, J.R. (2005) Introduction to usability testing. Tutorial given at HCI International 2005. July 22–27. Las Vegas, Nevada, Vol.13, No.6, pp. 29–33.
Lewis, J. R. (2006) Sample sizes for usability tests: Mostly math, not magic. Interactions Nov/Dec.
MIT Usability Guidelines (2004) http://web.mit.edu/is/usability/selected.guidelines.pdf.
Nielsen, J. (1993) Usability Engineering. Academic, Boston, pp. 25–62
Nielsen, J. (1994) Heuristic evaluation. In: Nielsen, J., and Mack, R. (Eds.) Usability Inspection Methods. John Wiley and Sons, Inc., New York, NY.
Telang, R., and Mukhopadhyay, T. (2005) Drivers of Web portal use. Electronic Commerce Research and Applications 4: 49–65.
Theng, Y. L., and Soh, E. S. (2005) An asian study of healthcare web portals: Implications for healthcare digital libraries. In: Proceedings of the 8th International Conference on Asian Digital Libraries, ICADL, Bangkok.
Tomić-Koludrović, I., and Petrić, M. (2004) Identities on the net: Gender and national stereotypes on croatian broad-reach portals. Društvena Istraživanja 13: 4–5.
Tractinsky, N., Katz, A., and Ikar, D. (2000) What is beautiful is usable. Interacting with Computers 13: 2.
Tsui, W. C., and Paynter, J. (2004) Cultural usability in the globalisation of news portal. In: Masoodian, M., Jones, S., and Rogers, B. (Eds.) Computer Human Interaction, Proceedings of the 6th Asia Pacific Conference, APCHI. LNCS 3101. Springer–Verlag, Berlin–Heidelberg.
Tullis, T. S., and Stetson, J. N. (2004) A comparison of questionnaires for assessing website usability. Proceedings of UPA Conference, Minneapolis, MN. http://home.comcast.net/~tomtullis/publications/UPA2004TullisStetson.pdf.
Waloszek, G. (2001) Portal usability – Is there such a thing? SAP Design Guild, Edition 3. http://www.sapdesignguild.org/editions/edition3/overview_edition3.asp.
Wood, J. (2004) Usability heuristics explained. iQ Content. http://www.iqcontent.com/publications/features/article_32.
Wright, P., and Monk, A. (1991) A cost-effective evaluation method for use by designers. International Journal of Man-Machine Studies 35(6): 891–912.
Acknowledgements
This chapter describes the results of research being carried out within the project 177-0361994-1998 Usability and Adaptivity of Interfaces for Intelligent Authoring Shells funded by the Ministry of Science, Education and Sports of the Republic of Croatia. Experiment was conducted at Department of Visual Communication Design, Arts Academy, University of Split.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media, LLC
About this paper
Cite this paper
Granić, A., Mitrović, I., Marangunić, N. (2011). Towards a Cost-Effective Evaluation Approach for Web Portal Interfaces. In: Song, W., et al. Information Systems Development. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-7355-9_15
Download citation
DOI: https://doi.org/10.1007/978-1-4419-7355-9_15
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4419-7205-7
Online ISBN: 978-1-4419-7355-9
eBook Packages: Computer ScienceComputer Science (R0)