Skip to main content
SpringerLink
Log in

Towards a Cost-Effective Evaluation Approach for Web Portal Interfaces

  • Conference paper
  • First Online:
Book cover Information Systems Development

  • 1088 Accesses

Abstract

A cost-effective approach for web portal usability evaluation is presented in this chapter. Due to specifics of portals as web sites, mainly referring to their structure and media specificities along with diversity of users, tasks and workflows, distinct assessment approaches should be employed. Methodology brings together laboratory-based testing along with experts’ inspection and produces valuable results for users and developers at a low cost. Compared to our first study, user assessment applied a faster and less expensive procedure, providing stability of measures with reduced sample size, while inspection employed fewer specialists with higher expertize and a simpler evaluation form. Directions of future work are identified.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bevan, N. (1995) Measuring usability as quality of use. Software Quality Journal 4: 115–150.

    Article  Google Scholar 

  2. Boye, J. (2006) Improving portal usability. CMS Watch (available at http://www.cmswatch.com/Feature/151-Portal-Usability).

  3. Brantley, S., Armstrong, A., and Lewis, K. M. (2006) Usability testing of a customizable library web portal. College & Research Libraries 67: 2.

    Google Scholar 

  4. Brooke, J. (1996) SUS: a “quick and dirty” usability scale. In: Jordan, P. W., Thomas, B., Weerdmeester, B. A, and McClelland, A. L. (Eds.): Usability Evaluation in Industry. Taylor and Francis, London, pp. 189–194.

    Google Scholar 

  5. Can, F., Kocberber, S., Baglioglu, O., Kardas, S., Ocalan, H.C., and Uyar, E. (2008) Bilkent news portal: A personalizable system with new event detection and tracking capabilities. SIGIR’08, July 20–24, Singapore.

    Google Scholar 

  6. Carr, A. (2004) Tapor: A case study of web portal usability (available at http://tapor.ualberta.ca/News/TAPoR_UI.pdf).

  7. Carstens, D. S., and Patterson, P. (2005) Usability study of travel websites. Journal of Usability Studies 1: 1.

    Google Scholar 

  8. GemiusAudience (2008) http://www.valicon.net/uploads/tablica_za_web_aktualni_podaci_za_kolovoz_o8.pdf.

  9. GFK Croatia (2008) http://www.gfk.hr/press1/infopis.htm.

  10. Granić, A., Mitrović, I., and Marangunić, N. (2009) Web portal design: an employment of a range of assessment methods. In: Papadopoulos, G. A., Wojtkowski, W., Wojtkowski, W. G., Wrycza, S., & Zupancic, J. (Eds.): Information Systems Development: Towards a Service Provision Society. Springer, New York, NY, pp. 131–139.

    Google Scholar 

  11. Granić, A., Mitrović, I., and Marangunić, N. (2008) Experience with usability testing of web portals. In: Cordeiro, J., Filipe, J., and Hammoudi, S. (Eds.) Proceedings of the 4th International Conference on Web Information Systems and Technologies – WEBIST 2008.. Portugal: INSTICC PRESS, pp. 161–167.

    Google Scholar 

  12. Hornbæk, K. (2006) Current practice in measuring usability: Challenges to usability studies and research. International Journal of Man-Machine Studies 64: 2.

    Google Scholar 

  13. Hornbæk, K., and Law, E. L.-C. (2007) Meta-analysis of correlations among usability measures. CHI 2007 Proceedings, April 28–May 3, San Jose, CA, USA.

    Google Scholar 

  14. Hvannberg, E., Law, E. L.-C., Larusdottir, M. (2007) Heuristic evaluation: Comparing ways of finding and reporting usability problems. Interacting with Computers 19: 225–240.

    Article  Google Scholar 

  15. ISO/IEC 25062:2006 (2006) Software engineering – Software product Quality Req. and Evaluation (SQuaRE) – Common Industry Format (CIF) for usability test reports.

    Google Scholar 

  16. Kellar, M., and Watters, C. (2006) Using web browser interactions to predict task. WWW 2006, May 23–26, Edinburgh, Scotland.

    Google Scholar 

  17. Klausegger, C. (2006) Evaluating internet portals – An empirical study of acceptance measurement based on Austrian National Tourist Office’s service portal. Journal of Quality Assurance in Hospitality & Tourism 6: 3–4.

    Article  Google Scholar 

  18. Lewis, J.R. (2005) Introduction to usability testing. Tutorial given at HCI International 2005. July 22–27. Las Vegas, Nevada, Vol.13, No.6, pp. 29–33.

    Google Scholar 

  19. Lewis, J. R. (2006) Sample sizes for usability tests: Mostly math, not magic. Interactions Nov/Dec.

    Google Scholar 

  20. MIT Usability Guidelines (2004) http://web.mit.edu/is/usability/selected.guidelines.pdf.

  21. Nielsen, J. (1993) Usability Engineering. Academic, Boston, pp. 25–62

    Google Scholar 

  22. Nielsen, J. (1994) Heuristic evaluation. In: Nielsen, J., and Mack, R. (Eds.) Usability Inspection Methods. John Wiley and Sons, Inc., New York, NY.

    Google Scholar 

  23. Telang, R., and Mukhopadhyay, T. (2005) Drivers of Web portal use. Electronic Commerce Research and Applications 4: 49–65.

    Article  Google Scholar 

  24. Theng, Y. L., and Soh, E. S. (2005) An asian study of healthcare web portals: Implications for healthcare digital libraries. In: Proceedings of the 8th International Conference on Asian Digital Libraries, ICADL, Bangkok.

    Google Scholar 

  25. Tomić-Koludrović, I., and Petrić, M. (2004) Identities on the net: Gender and national stereotypes on croatian broad-reach portals. Društvena Istraživanja 13: 4–5.

    Google Scholar 

  26. Tractinsky, N., Katz, A., and Ikar, D. (2000) What is beautiful is usable. Interacting with Computers 13: 2.

    Article  Google Scholar 

  27. Tsui, W. C., and Paynter, J. (2004) Cultural usability in the globalisation of news portal. In: Masoodian, M., Jones, S., and Rogers, B. (Eds.) Computer Human Interaction, Proceedings of the 6th Asia Pacific Conference, APCHI. LNCS 3101. Springer–Verlag, Berlin–Heidelberg.

    Google Scholar 

  28. Tullis, T. S., and Stetson, J. N. (2004) A comparison of questionnaires for assessing website usability. Proceedings of UPA Conference, Minneapolis, MN. http://home.comcast.net/~tomtullis/publications/UPA2004TullisStetson.pdf.

  29. Waloszek, G. (2001) Portal usability – Is there such a thing? SAP Design Guild, Edition 3. http://www.sapdesignguild.org/editions/edition3/overview_edition3.asp.

  30. Wood, J. (2004) Usability heuristics explained. iQ Content. http://www.iqcontent.com/publications/features/article_32.

  31. Wright, P., and Monk, A. (1991) A cost-effective evaluation method for use by designers. International Journal of Man-Machine Studies 35(6): 891–912.

    Article  Google Scholar 

Download references

Acknowledgements

This chapter describes the results of research being carried out within the project 177-0361994-1998 Usability and Adaptivity of Interfaces for Intelligent Authoring Shells funded by the Ministry of Science, Education and Sports of the Republic of Croatia. Experiment was conducted at Department of Visual Communication Design, Arts Academy, University of Split.

Author information

Authors and Affiliations

  1. Faculty of Science, University of Split, Split, Croatia

    Andrina Granić & Ivica Mitrović

  2. Arts Academy, University of Split, Split, Croatia

    Nikola Marangunić

Authors
  1. Andrina Granić
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ivica Mitrović
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nikola Marangunić
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrina Granić .

Editor information

Editors and Affiliations

  1. Durham University, Durham, DH1 3LE, United Kingdom

    William Wei Song

  2. , School of Information Technology, Jiangxi University of Finance and Econom, Nanchang, 330013, Jiangxi, China, People's Republic

    Shenghua Xu

  3. Finance & Economics, School of Information Management, Jiangxi University of, Fenglin Rd., Nanchang, 330013, Jiangxi, China, People's Republic

    Changxuan Wan

  4. UFIDA Software Technology College, Jiangxi University of Finance & Economic, Fenglin Rd., Nanchang, 330013, Jiangxi, China, People's Republic

    Yuansheng Zhong

  5. College of Business & Economics, Dept. Information Technology &, Boise State University, Univesity Dr. 1910, Boise, 83725-1615, Idaho, USA

    Wita Wojtkowski

  6. College of Business & Economics, Dept. Information Technology &, Boise State University, Univesity Dr. 1910, Boise, 83725-1615, Idaho, USA

    Gregory Wojtkowski

  7. Fac. Information Technology, Monash University, Clayton, 3800, Victoria, Australia

    Henry Linger

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this paper

Cite this paper

Granić, A., Mitrović, I., Marangunić, N. (2011). Towards a Cost-Effective Evaluation Approach for Web Portal Interfaces. In: Song, W., et al. Information Systems Development. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-7355-9_15

Download citation

  • DOI: https://doi.org/10.1007/978-1-4419-7355-9_15

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4419-7205-7

  • Online ISBN: 978-1-4419-7355-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation