Towards a Multidimensional Model for Web-Based Applications Quality Assessment

  • Ghazwa Malak
  • Linda Badri
  • Mourad Badri
  • Houari Sahraoui
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3182)


Several approaches for quantitative evaluation of Web-based applications have proposed test-benches, checklists and tools. In this paper, we propose an evaluation approach that integrates and extends the various approaches proposed in this field. We have developed a list of over than 300 criteria and sub-criteria, which we classified using the ISO/IEC 9126 standard as a guide. These criteria represent a first basis for the development of a hierarchical quality model specific to Web-Based Applications. In order to refine our quality model, we followed a systematic approach using the GQM paradigm. A tool supporting our assessment approach has been developed. With this tool, we conducted an experience on several Web systems. The obtained results were rather encouraging. However, they have shown that more dimensions have to be considered to increase the reliability of our model. As a next step, we introduce a three-dimensional model where the initial model is one dimension. The two others represent respectively the life cycle processes and the Web applications domains.


Quality Characteristic Quality Model Application Domain Multidimensional Model Life Cycle Process 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Abrahao, S., Olsina, L., Pastor, O.: A Methodology for Evaluation Quality and Functional Size of Operative WebApps. In: Proceedings of 2nd International Workshop on Web Oriented Software Technology, ECOOP 2002 Workshops. Malaga, Spain (2002)Google Scholar
  2. 2.
    Basili, V.R.: Software Modeling and Measurement: The Goal Question Metric Paradigm. Computer Science Technical Report Series, CS-TR-2956 (UMIACSTR-92-96). University of Maryland, College Park, MD (1992)Google Scholar
  3. 3.
    Boldyreff, C., Gaskell, C., Marshall, A., Warren, P.: WEB-SEMProject: Establishing Effective Web Site Evaluation Metrics. In: Proceedings of 2nd International Workshop on Web Site Evolution WSE 2000, Zurich, Switzerland (2000)Google Scholar
  4. 4.
    Brajnik, G.: Automatic Web Usability Evaluation: Where is the Limit? In: Proceedings of the 6th Conference on Human Factors & the web, Austin TX (2000)Google Scholar
  5. 5.
    Calero, C., Ruiz, J., Piattini, M.: A Web Metrics Survey Using WQM. In: Koch, N., Fraternali, P., Wirsing, M. (eds.) ICWE 2004. LNCS, vol. 3140, pp. 147–160. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  6. 6.
    Cutter Consortium: Poor Project Management – Problem of E-Projects (2000),
  7. 7.
    Dalton, S.: A Workbench to Support Development and Maintenance of World-Wide Web Documents. MSc Thesis, Supervisor: Dr. C. Boldyreff, Department of Computer Science, University of Durham (1996)Google Scholar
  8. 8.
    Differding, C., Hoisl, B., Lott, C.M.: Technology Package for the Goal Question Metric Paradigm. Internal Report 281/96 (1996),
  9. 9.
    Fleming, J.: WEB Navigation: Designing the User Experience. O’Reilly, Sebastopol (1998)Google Scholar
  10. 10.
    ISO/IEC 9126.: Software Product Evaluation - Quality characteristics and Guidelines for their use (2001)Google Scholar
  11. 11.
    ISO/IEC 12207. Information Technology. Software Life Cycle Processes (1995)Google Scholar
  12. 12.
    Ivory, M., Hearst, M.: Towards Quality Checkers ForWeb Site Designs. IEEE Internet Computing (2002)Google Scholar
  13. 13.
    Keevil, B.: Scaling the Heights: The Future of Information Technology. In: SIGDOC 1998 Conference. Quebec City, QC (1998)Google Scholar
  14. 14.
    Lycett, M.: Understanding Variation in Component-based Development: Case Finding from Practice. Information and Software Technology Journal 43, 203–213 (2001)CrossRefGoogle Scholar
  15. 15.
    Malak, G.: Évaluation de la Qualité des Applications Web. Mémoire de maîtrise. Département d’informatique, Université Laval, Québec, Canada (2002)Google Scholar
  16. 16.
    Malak, G., Belkhiter, N., Badri, L., Badri, M.: Evaluation de la Qualité des Applications Web: État de l’Art. In: INFORSID 2002 Conference, Nantes, France (2002)Google Scholar
  17. 17.
    Malak, G., Badri, L., Badri, M., Belkhiter, N.: Web-Based Applications Quality: Evaluation and Perspectives. In: Proceedings of the International Conference on Internet Computing IC 2002, Las Vegas, USA, pp. 939–946 (2002)Google Scholar
  18. 18.
    Nielsen, J.: Designing Web Usability: The Practice of Simplicity. New Riders Publishing, Indianapolis (2000)Google Scholar
  19. 19.
    Nielsen, J.: The Alertbox (1996-2003), Available on-line at
  20. 20.
    Niessink, F.: Software Requirements: Functional & Non-functional Software Requirements (2002),
  21. 21.
    Offutt, J.: Web Software Applications Quality Attributes. In: Quality Engineering in Software Technology (CONQUEST 2002), Nuremberg, Germany, pp. 187–198 (2002)Google Scholar
  22. 22.
    Olsina, L., Rossi, G.: Measuring Web Application Quality with WebQEM. IEEE MultiMedia 9(4) (2002)Google Scholar
  23. 23.
    Ramler, R., Weippl, E., Winterer, M., Shwinger, W., Altmann, J.: A Quality-Driven Approach to Web Testing. In: Iberoamerican Conference on Web Engineering, ICWE 2002, Argentina, vol. 1, pp. 81–95 (2002)Google Scholar
  24. 24.
    Ruiz, J., Calero, C., Piattini, M.: A three Dimensional Web Quality Model. In: Cueva Lovelle, J.M., Rodríguez, B.M.G., Gayo, J.E.L., del Pueto Paule Ruiz, M., Aguilar, L.J. (eds.) ICWE 2003. LNCS, vol. 2722, pp. 384–385. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  25. 25.
    Wu, Y., Offutt, J.: Modeling and Testing Web-based Applications. GMU ISE Technical ISETR- 02-08 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Ghazwa Malak
    • 1
  • Linda Badri
    • 2
  • Mourad Badri
    • 2
  • Houari Sahraoui
    • 1
  1. 1.Department of Computer Science and Operational ResearchUniversity of MontrealMontrealCanada
  2. 2.Department of Mathematics and Computer ScienceUniversity of Quebec at Trois-RivièresTrois-RivièresCanada

Personalised recommendations