Abstract
This paper presents a methodology for estimating users’ opinion of the quality of a software product. Users’ opinion changes with time as they progressively become more acquainted with the software product. In this paper, we study the dynamics of users’ opinion and offer a method for assessing users’ final perception, based on measurements in the early stages of product release. The paper also presents methods for collecting users’ opinion and from the derived data, shows how their initial belief state for the quality of the product is formed. It adapts aspects of Belief Revision theory in order to present a way of estimating users’ opinion, subsequently formed after their opinion revisions. This estimation is achieved by using the initial measurements and without having to conduct surveys frequently. It reports the correlation that users tend to infer among quality characteristics and represents this correlation through a determination of a set of constraints between the scores of each quality characteristic. Finally, this paper presents a fast and automated way of forming users’ new belief state for the quality of a product after examining their opinion revisions.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alchourron, C., Gardenfors, P., and Makinson D. 1985. On the logic of theory change:Partial meet contraction and revision functions, Journal of Symbotic Logic 50(2): 510–530.
Bevan, N. 1997. Quality and Usability: A New Framework, eds. van Veenendaal E. and McMullan J. Achieving software product quality, Tutein Nolthenius, Netherlands.
Crosby, P. 1979. Quality is Free, McGraw-Hill, New-York.
Eiter, T. and Gottlob, G. 1992. On the complexity of propositional knowledge base revision, updates and counterfactuals, Artificial Intelligence 59: 227–270.
Gardenfors P. 1988. Knowledge in Flux, MIT Press, Cambridge.
Gardenfors P. and Makinson, D. 1988. Revision of knowledge systems using epistemic entrenchment, In Proceedings of the Second Conference on Theoretical Aspects of Reasoning about Knowledge, Morgan Kaufmann, pp. 83–95.
Grady, R. and Caswell, D. 1987. Software Metrics: Establishing a Company-Wide Program, Prentice Hall.
Grove, A. 1988. Two Modellings for Theory Change, Journal of Philosophical Logic.
ISO/IEC 9001:2000. Quality management systems—Requirements, International Organization for Standardization.
ISO9126. 1991. Software Product Evaluation—Quality Characteristics and Guidelines for their Use, ISO/IEC Standard ISO-9126.
Juran J. and Gryna F. 1980. Quality Planning and Analysis, 2nd ed., McGraw-Hill, New-York.
Kan, S. 1996. Metrics and Models in Software Quality Engineering, Addison-Wesley.
Kaplan, C., Clark, R., and Tang, V. 1995. Secrets of Software Quality, McGraw Hill, ISBN: 0-07-911795-3.
McCall, J. A., Richards, P. K., and Walters, G. F. 1977. Factors in Software Quality, Vols I, II, III. US Rome Air Development Center Reports NTIS AD/A-049 014, 015, 055.
Nebel, B. 1991. Belief revision and default reasoning: Syntax-based approaches, In Proceedings of the Second International Conference on Principles of Knowledge Representation and Reasoning, Morgan Kaufmann.
Nebel, B. 1994. Base revision operations and schemes: Semantics, representation and complexity, In Proceedings of the Eleventh European Conference on Artificial Intelligence, John Wiley & Sons.
Nielsen, J. 1993. Usability engineering, Academic Press, San Diego.
Paulk, M.C., Weber, C.V., Curtis, B., and Chrissis, M.B. 1995. The Capability Maturity Model: Guidelines for Improvement of the Software Process, Addison-Wesley.
Peppas, P. and Williams, M.-A. 1995. Constructive modellings for theory change, Notre Dame Journal of Formal Logic, 36(1):120–133.
Stavrinoudis, D., Xenos, M., Peppas, P., and Christodoulakis, D. 1998. Measuring user’s perception and opinion of software quality, In: Proceedings of the 6th European Conference on Software Quality, EOQ-SC, Vienna, pp. 229–237.
Xenos, M. and Christodoulakis, D. 1995. Software quality: The user’s point of view, In Software Quality and Productivity: Theory, practice, Education and Training, eds. by Mathew Lee, Ben-Zion Barta and Peter Juliff, pp. 266–272. Chapman and Hall Publications, ISBN 0-412-629607.
Xenos, M., Stavrinoudis, D., and Christodoulakis, D. 1998. The Correlation Between Developer-oriented and User-oriented Software Quality Measurements (A Case Study), 5th European Conference on Software Quality, EOQ-SC, Dublin, pp. 267–275.
Author information
Authors and Affiliations
Corresponding author
Additional information
Dimitris Stavrinoudis received his degree in Computer Engineering from Patras University and is a Ph.D. student of Computer Engineering and Informatics Department. He worked as a senior computer engineer and researcher at the R.A. Computer Technology Institute. He has participated in research and development projects in the areas of software engineering, databases and educational technologies. Currently, he works at the Hellenic Open University. His research interests include software quality, software metrics and measurements.
Michalis Xenos received his degree and Ph.D. in Computer Engineering from Patras University. He is a Lecturer in the Informatics Department of the School of Sciences and Technology of the Hellenic Open University. He also works as a researcher in the Computer Technology Institute of Patras and has participated in over 15 research and development projects in the areas of software engineering and IT development management. His research interests include, inter alia, Software Engineering and Educational Technologies. He is the author of 6 books in Greek and over 30 papers in international journals and conferences.
Pavlos Peppas received his B.Eng. in Computer Engineering from Patras University (1988), and his Ph.D. in Computer Science from Sydney University (1994). He joined Macquarie University, Sydney, as a lecturer in September 1993, and was promoted to a senior lecturer in October 1998. In January 2000, he took up an appointment at Intrasoft, Athens, where he worked as a senior specialist in the Data Warehousing department. He joint Athens Information Technology in February 2003 as a senior researcher, and since November 2003 he is an associate professor at the Dept of Business Administration at the University of Patras. He also holds an adjunct associate professorship at the School of Computer Science and Engineering at the University of New South Wales. His research interests lie primarily within the area of Artificial Intelligence, and more specifically in logic-based approaches to Knowledge Representation and Reasoning with application in robotics, software engineering, organizational knowledge management, and the semantic web.
Dimitris Christodoulakis received his degree in Mathematics from the University of Athens and his Ph.D. in Informatics from the University of Bonn. He was a researcher at the National Informatics Centre of Germany. He is a Professor and Vice President of Computer Engineering and Informatics Department of Patras University. Scientific Coordinator in many research and development projects in the followings sections: Knowledge and Data Base Systems, Very large volume information storage, Hypertext, Natural Language Technology for Modern Greek. Author and co-author in many articles published in international conferences. Editor in proceedings of conventions. Responsible for proofing tools development for Microsoft Corp. He is Vice Director in the Research Academic Computer Technology Institute (RACTI).
Rights and permissions
About this article
Cite this article
Stavrinoudis, D., Xenos, M., Peppas, P. et al. Early Estimation of Users’ Perception of Software Quality. Software Qual J 13, 155–175 (2005). https://doi.org/10.1007/s11219-005-6215-9
Issue Date:
DOI: https://doi.org/10.1007/s11219-005-6215-9