On Meaningful Menus for Measurement: Disentangling Evaluative Issues in System Design
This essay argues that system evaluation should be viewed in the broader context of measurement. Seven measurement issues are discussed including testing, verification, demonstration, evaluation, validation, acceptance, and viability. These issues are discussed from the perspectives of both system designers and users. It is proposed that a comprehensive approach to measurement should invoke planning and execution of four phases of measurement including naturalist, marketing, engineering, and sales and service phases. The prerequisites to the success of this approach are discussed.
KeywordsMeasurement Issue User Acceptance Product Concept Electric Power Research Institute Service Phase
Unable to display preview. Download preview PDF.
- Frey, P. R., Sides, W. H., Hunt, R. M., and Rouse, W. B., 1984, Computer-Generated Display System Guidelines: Volume 1, Display Design, Technical Report NP37091, Volume 1, March 1984, Electric Power Research Institute, Palo Alto, CA.Google Scholar
- Rouse, W. B., 1984, Computer-Generated Display System Guidelines: Volume 2, Developing an Evaluation Plan, Technical Report NP3701, Volume 2, March 1984, Electric Power Research Institute, Palo Alto, CA.Google Scholar
- Rouse, W. B., 1986, “Design and Evaluation of Computer-Based Decision Support-Systems”, Microcomputer Decision Support Systems: Design, Implementation, and Evaluation, Andriole, S. J., ed., QED Information Sciences, Wellesley, MA.Google Scholar
- Rouse, W. B., Kisner, R. A., Frey, P. R., and Rouse, S. H., 1984, A Method for Analytical Evaluation of Computer-Based Decision Aids, Technical Report NUREG/CR-3655; ORNL/TM-9068, July 1984, Oak Ridge National Laboratory, Oak Ridge, TN.Google Scholar
- Rouse, W. B., and Morris, N. M., 1986, “Understanding and Enhancing User Acceptance of Computer Technology, IEEE Transactions on Systems, Man, and Cybernetics, SMC-16.Google Scholar
- Rouse, W. B., and Rouse, S. H., 1984, “A Note on Evaluation of Complex Man-Machine Systems”, IEEE Transactions on System, Man, and Cybernetics, SMC-14.Google Scholar