Abstract
System evaluation and validation refer to assessing the extent to which a system is successful in achieving its desired goals most efficiently. In particular, evaluation extends beyond simple assessment of success and failure to issues of workload, safety, and cost effectiveness. The simple fact that a system works is not enough. In addition, it should be established whether it is mentally loading, whether it is sufficiently safe with respect to the operators but also in the wider ecological sense — and whether it is sufficiently competitive in comparison with rival systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Annet, J., & Duncan, K. D. (1967). Task analysis and training design. Occupational Psychology, 41, 211–221.
Bainbridge, L. (1979). Verbal reports as evidence of the operator’s knowledge. International Journal of Man-Machine Studies, 11, 411–436.
Bainbridge, L. (1991). Verbal protocol analysis. In J. R. Wilson & E. N. Corlett (Eds.), Evaluation of Human Work. London: Taylor & Francis.
Card, S. K., Moran, T. P., & Newell, A. (1983). The Psychology of Human-Computer Interaction. Hillsdale: Lawrence Erlbaum.
Chubb, G. P., Laughery, K. R., & Pritsker, A. A. B. (1987). Simulating manned systems. In G. S. Salvendy (Ed.), Handbook of Human Factors, New York: Wiley (pp. 1298–1327 ).
Damos, D. (Ed.). (1991). Multiple Task Performance. London: Taylor Francis.
Diaper, D. (1989a). Task analysis for knowledge descriptions (TAKD): The method and an example. In D. Diaper (Ed.), Task Analysis for Human-Computer Interaction, Chichester: Horwood (pp. 108–159 ).
Diaper, D. (1989b). Task observation for human-computer interaction. In D. Diaper (Ed.), Task Analysis for Human-Computer Interaction (pp. 210–237 ).
Drury, G. C. (1983). Task analysis methods in industry. Applied Ergonomics, 14, 19–28.
Farina, A. J. (1973). Development of a taxonomy of human performance. A review of descriptive schemes for human task behavior. JSAS Catalog of Selected Documents in Psychology. MS 318.
Farina, A. J., & Wheaton, G. R. (1973). Development of a taxonomy of human performance. JSAS Catalog of Selected Documents in Psychology. Ms 323.
Fleishman, E. A., & Hempel, W. E., Jr. (1955). The relation between abilities and improvement with practice in a visual reaction discrimination task. Journal of experimental Psychology, 40, 301–312.
Fleishman, E. A., & Quintance, M. K. (1984) Taxonomies of Human Performance. Orlando, FL: Academic Press.
Harris, R., Lavecchia, H. P., & Dick, A. O. (1989). The Human Operator Simulator (HOS-4) In G. R. McMillan et al. (Eds.), Applications of Human Performance Models to System Design. New York: Plenum
Heuer, H. (1984). Motor learning as a process of structural constriction and displacement. In W. Prinz & A. F. Sanders (Eds.), Cognition and motor processes. Berlin: Springer-Verlag.
Johnson, P. (1989). Supporting system design by analyzing current task knowledge. In D. Diaper (Ed.), Task Analysis for Human-Computer Interaction, Chichester: Horwood.
Johnson, H., & Johnson, P. (1987). The development of task analysis as a design tool: a method for carrying out task analysis. ICL Report.
Kroemer, K. H. E. (1987). Engineering anthropometry. In G. Salvendy (Ed.), Handbook of Human Factors. New York: Wiley.
Lane, N. A., Strieb, M. I., Glenn, F. A., & Cherry, R. A. (1981). The human operator simulator: An overview. In J. Moraal & K. F. Kraiss (Eds.), Manned System Design: Methods, Equipment and applications. New York: Plenum.
Laughery, K. R. (1989). MicroSAINT: A tool for modelling human performance in systems. In G. R. McMillan et al. (Eds.), Applications of Human Performance Models to System Design. New York: Plenum.
McCormick, E. J. (1976). Job and task analysis. In M. D. Dunnette (Ed.), Handbook of Industrial and Organisational Psychology.
McMillan, G. R. (1989). Application of Human Performance Models to System Design. New York: Plenum.
Mecham, R. C. (1977). Technical manual for the Position Analysis Questionnaire. Logan PAQ Services Inc.
Meister, D. (1985). Behavioral Analysis and Measurement Methods. Chichester: Wiley.
Michon, J. A. (1966). Tapping regularity as a measure of perceptual-motor load. Ergonomics, 10, 67–72.
Miller, R. B. (1962). Task description and analysis. In R. M. Gagne (Ed.), Psychological Principles In System Development. New York: Holt, Rinehart, & Winston.
Miller, R. B. (1973). Development of a taxonomy of human performance: Design of a system’s task vocabulary. JSAS Catalog of Selected Documents in Psychology. Ms 327.
Miller, R. B. (1974). A Method For Determining Task Strategies. Technical report AFHRL-TR-74–26.
Mundel, M. E. (1978). Motion and Time study. Englewood Cliffs: Prentice Hall. Payne, S. J. (1984). Task-Action Grammars Interact, 1, 1139–1145.
Reason, J. (1990). Human Error. Cambridge University Press.
Reid, G. B., & Nygren, T. E. (1988) The subjective workload assessment technique. A scaling procedure for measuring mental workload. In P. A. Hancock & N. Meshkati (Eds.), Human mental workload. Amsterdam: North-Holland.
Sanders, A. F. (1979). Some remarks on mental load. In N. Moray (Ed.), Mental Workload: Its Theory and Measurement. New York: Plenum.
Sanders, A. F. (1984). Structure and interconnections between human performance limits. Paper to the DRG meeting on Human Performance Limits, Toronto.
Sanders, A. F. (1991). Simulation as a tool in the measurement of human performance. Ergonomics, 34, 995–1025.
Senders, J. W. (1983). Visual Scanning Processes. Hillsdale: Lawrence Erlbaum.
Sheperd, A. (1985). Hierarchical task analysis and training decisions. Programmed Learning and Educational Technology, 22, 162–176.
Sheperd, A. (1989). Analysis and training in information technology tasks. In D. Diaper (Ed.), Task Analysis for Human Computer-Interaction, Chichester: Horwood.
Singleton, W. T. (1974). Man-Machine Systems. Harmondsworth: Penguin.
Stammers, R. B., Carey, M. S., & Astely, J. A. (1991). Task analysis. In. R. Wilson & E. N. Corlett (Eds.), Evaluation of Human Work. London: Taylor & Francis.
Stassen, H. G. (1989). On the modelling of manual control tasks. In G. R. McMillan et al. (Eds.), Applications of Human Performance Models to System Design (pp. 107–123 ). New York: Plenum.
Wickens, C. D. (1984). Engineering Psychology and Human Performance. Columbus: Merrill.
Wickens, C. D. (1992). Engineering Psychology and Human Performance. New York: Harper Collins.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1993 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sanders, A.F., Roelofsma, P.H.M.P. (1993). Performance Evaluation of Human-Machine Systems. In: Wise, J.A., Hopkin, V.D., Stager, P. (eds) Verification and Validation of Complex Systems: Human Factors Issues. NATO ASI Series, vol 110. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-02933-6_19
Download citation
DOI: https://doi.org/10.1007/978-3-662-02933-6_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-08155-2
Online ISBN: 978-3-662-02933-6
eBook Packages: Springer Book Archive