Abstract
For over twenty years, metrics have been being invented to measure software quality. And yet quantifying quality presupposes agreement on what constitutes quality. Quality has been portrayed as an absolute quantity, subject to objective measurements. We believe this effort has been misguided. We argue that quality, like beauty, is in the eye of the beholder — that is, that quality is not absolute, but depends on the perspective taken by the evaluator. As such, any direct measure of quality must necessarily be subjective, summarizing the impressions of some particular class of people who interact with the product. Indirect measures of quality are less objective than they may appear to be — beyond the arbitrariness of the choice of measure, and any difficulty in its interpretation, there is always the tenuous link of the metric to the perception of quality by any specific group. The need for this novel point of view is especially clearly illustrated by mathematical software.
Chapter PDF
Similar content being viewed by others
References
Buckley, M. and Chillarege,R. (1995) Discovering Relationships Between Coverage and Customer Satisfaction. 1995 Conference on Software Maintenance, October 17–20, Opio, France, 192–201.
Carrol, J. M. and Rosson, M. B. (1984) Beyond MIPS*: Performance Is Not Quality. BYTE, 9(2), February, 168–72.
Clark, K. B., and Fujimoto, T. (1991) Product Development Performance. Harvard Business School Press, Boston
Cochran, W. G. ( 1953, 1963) Sampling Techniques. John Wiley and Sons, New York
Consumers Reports (1966) Annual Auto Issue, 61(4), April.
Galsworthy, John. (1912) The Inn of Tranquillity and Other Essays and Studies, Charles Scribner’s Sons, New York
Gilb, T. (1977) Software Metrics, Winthrop, Cambridge, MA.
Gilbert, P. (1983) Software Design and Development. Science Research Associates, Inc., Chicago.
IEEE Std P1061–1988 Standard for a Software Quality Metrics Methodology.
IEEE Std 610.12–1990 Standard Glossary of Software Engineering Terminology (ANSI).
ISO/IEC 9126:1991(E) International Standard — Information Technology — Software product evaluation — Quality characteristics and guidelines for their use.
ISO/IEC 8402:1986 International Standard — Quality — vocabulary.
ISO 9000:1987 International Standard — Quality management and quality assurance standards — Guidelines for selection and use.
ISO 9000–3:1991 International Standard — Quality management and quality assurance standards — Part 3: Guidelines for the application of ISO 9001 to the development, supply and maintenance of software.
ISO 9001:1987 International Standard — Quality systems — Model for quality assurance in design/development, production, installation and servicing.
ISO 9003:1987 International Standard — Quality systems — Model for quality assurance in final inspection and test.
ISO 9004:1987 International Standard — Quality management and quality system elements — Guidelines.
Hailstone, R. (1991) Quality management and software engineering. in Software Quality and Reliability, Tools and methods, ed. Darrel Ince, Chapman & Hall, London.
Johnson, J. H. (1996) Private communication.
Kitchenham, B. A., and Walker, J. G. (1986) The meaning of quality. in Proc. Conf. Software Engineering 86, 393–406.
Oxford English Dictionary Second Edition (1993), Oxford University Press, Oxford, UK.
Schach, S. R. (1990) Software Engineering. Aksen Associates Inc., Homewood, IL.
Stephan, F. and McCarthy, P. J. (1958), Sampling Opinions - An Analysis of Survey Procedures. John Wiley and Sons, New York
Tinnirello, P. C. (1995) Handbook of Application Development, Second Edition. Auerbach Publications, Boston.
Toole, F. E. (1985) Subjective measurements of loudspeaker sound quality and listener performance. Journal of the Audio Engineering Society, 33(1–2), Jan.—Feb., 2–32.
Toole, F. E. (1986a) Loudspeaker measurements and their relationship to listener preferences. I. Journal of the Audio Engineering Society, 34(4), April, 227–35.
Toole, F. E. (1986b) Loudspeaker measurements and their relationship to listener preferences. II Journal of the Audio Engineering Society, 34(5), May, 323–48.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1997 IFIP International Federation for Information Processing
About this chapter
Cite this chapter
Gentleman, W.M. (1997). If software quality is a perception, how do we measure it?. In: Boisvert, R.F. (eds) Quality of Numerical Software. IFIP Advances in Information and Communication Technology. Springer, Boston, MA. https://doi.org/10.1007/978-1-5041-2940-4_3
Download citation
DOI: https://doi.org/10.1007/978-1-5041-2940-4_3
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-5041-2942-8
Online ISBN: 978-1-5041-2940-4
eBook Packages: Springer Book Archive