Software-evaluation based upon ISO 9241 Part 10

  • Jochen Prümper
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 733)


In this article the software evaluation instrument ISONORM 9241/10 is presented. This instrument was developed from ‘ISO 9241: Ergonomic requirements for office work with visual display terminals (VDTs), Part 10: Dialogue Principles’. The capabilities of this instrument are shown through two methods. First, two different kinds of computer-systems (with and without graphical user interface) are evaluated for their conformity to ISO 9241/10. Second, a procedure is shown in which ISONORM 9241/10 is used as a basis for moderation with user-groups, when in the beginning of a designprocess, through the forum of a participative system-development, first demands are formulated. It is shown that the user-friendliness of systems with GUI is judged to be significantly superior in all seven principles of ISO 9241/10, to those systems without GUI. In the user-group meeting, through ISONORM 9241/10, many concrete recommendations for a new software to be developed could be generated.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Altmann, A.: Direkte Manipulation: Empirische Befunde zum Einfluß der Benutzeroberfläche auf die Erlernbarkeit von Textsystemen. Zeitschrift für Arbeits-und Organisationspsychologie 31, 108–114 (1987)Google Scholar
  2. 2.
    Brodbeck, F.C., Zapf, D., Prümper, J., Frese, M.: Error handling in office work with computers: A field study. Journal of Occupational and Organizational Psychology (1993, in press)Google Scholar
  3. 3.
    DIN 66 234/8 Bildschirmarbeitsplätze: Grundsätze ergonomischer Dialoggestaltung. Berlin: Beuth 1988Google Scholar
  4. 4.
    Dzida, W., Itzfeldt, W.D.: User-perceived quality of interactive systems. IEEE Transactions on Software Engineering SE-4, 270–276 (1978)Google Scholar
  5. 5.
    Dzida, W., Wiethoff, M, Arnold, A.G.: ERGOguide — The quality assurance guide to ergonomic software. Delft University of Technology/German National Center of Computer Science 1993Google Scholar
  6. 6.
    Flanagan, J.G.: The critical incident technique. Psychological Bulletin 51, 327–358 (1954)PubMedGoogle Scholar
  7. 7.
    Frese, M., Sabini, J. (eds.): Goal-directed behavior: The concept of action in psychology. Hillsdale: Erlbaum 1985Google Scholar
  8. 8.
    Frese, M., Schulte-Göcking, H., Altmann, A.: Lernprozesse in Abhängigkeit von der Trainingsmethode, von Personenmerkmalen und von der Benutzeroberfläche (direkte Manipulation vs. konventionelle Interaktion). In: W. Schönpflug, M. Wittstock (eds.): Software-Ergonomie '87. Nützen Informationssysteme dem Benutzer? Stuttgart: Teubner 1987, pp. 377–386Google Scholar
  9. 9.
    Frese, M., Zapf, D.: Action as the core of work psychology: A German approach. In: M.D. Dunnette, L.M. Hough, H. Triandis (eds.): Handbook of industrial and organizational psychology (Vol. 4). Palo Alto, CA: Consulting Psychologists Press 1994, in pressGoogle Scholar
  10. 10.
    Hacker, W., Volpert, W., von Cranach, M.: Cognitive and motivational aspects of action. Berlin: Deutscher Verlag der Wissenschaften 1982Google Scholar
  11. 11.
    ISO 9241/10: ISO 9241 — Ergonomic requirements for office work with visual display terminals (VDTs), Part 10 — Dialogue principles — First Draft International Standard, February 2, 1993Google Scholar
  12. 12.
    Kirakowski, J., Corbett, M.: Effective methodology for the study of HCI. Amsterdam: North Holland 1990Google Scholar
  13. 13.
    Nielsen, J.: Finding usability problems through heuristic evaluation. In: P. Bauersfeld, J. Bennett, G. Lynch (eds.): CHI'92 Conference Proceedings. New York: ACM press 1992, pp. 373–380Google Scholar
  14. 14.
    Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: J.C. Chow, J. Whiteside (eds.): CHI'90 Conference Proceedings. New York: ACM press 1990, pp. 249–256Google Scholar
  15. 15.
    Prümper, J.: Benutzerorientierte, iterative Software-Entwicklung in der Praxis. In: W. Coy, P. Gorny, I. Kopp, C. Skarpelis (eds.): Menschengerechte Software als Wettbewerbsfaktor. Stuttgart: Teubner 1993a, pp. 630–647Google Scholar
  16. 16.
    Prümper, J.: GUIs sind noch weit entfernt von einer optimalen Beurteilung — ISO 9241 Teil 10 als Leitlinie für SW-Entwicklung und-Bewertung. Computerwoche 25, 46 (1993b)Google Scholar
  17. 17.
    Prümper, J.: Wie benutzerfreundlich ist Ihre Software? Börsenblatt 20, 24–26 (1993c)Google Scholar
  18. 18.
    Prümper, J., Anft, M.: Die Evaluation von Software auf Grundlage des Entwurfs zur internationalen Ergonomie-Norm ISO 9241 Teil 10 als Beitrag zur partizipativen Systemgestaltung — ein Fallbeispiel. In: K.H. Rödiger (ed.): Software-Ergonomie '93 — Von der Benutzungsoberfläche zur Arbeitsgestaltung. Stuttgart: Teubner 1993a, pp. 145–156Google Scholar
  19. 19.
    Prümper, J., Anft, M.: ISONORM 9241/10 — Beurteilung von Software auf Grundlage der Internationalen Ergonomie-Norm ISO 9241/10 (Questionnaire) 1993bGoogle Scholar
  20. 20.
    Prümper, J., Anft, M.: ISONORM 9241/10 — Software Evaluation based upon the Principles of Ergonomic Requirements ISO 9241/10 (Questionnaire) 1993cGoogle Scholar
  21. 21.
    Prümper, J., Zapf, D., Brodbeck, F.C., Frese, M.: Some surprising differences between novice and expert errors in computerized office work. Behaviour & Information Technology 11, 319–328 (1992)Google Scholar
  22. 22.
    Rauterberg, M.: Läßt sich die Gebrauchstauglichkeit interaktiver Software messen? Und wenn ja, wie? Ergonomie & Informatik 16, 3–18 (1992a)Google Scholar
  23. 23.
    Rauterberg, M.: An empirical comparison of menu-selection (CUI) and desktop (GUI) computer programs carried out by beginners and experts. Behaviour & Information Technology 11, 227–236 (1992b)Google Scholar
  24. 24.
    Rosson, M.B., Alpert, S.R.: The cognitive consequences of object-oriented design. Human-Computer Interaction 5, 345–379 (1990)Google Scholar
  25. 25.
    Shneiderman, B.: We can design better user interfaces: A review of humancomputer interaction styles. Ergonomics 31, 699–710 (1988)Google Scholar
  26. 26.
    Téeni, D.: Direct manipulation as a source of cognitive feedback: A humancomputer experiment with a judgement task. International Journal of ManMachine Studies 33, 453–466 (1990)Google Scholar
  27. 27.
    Ulich, E., Rauterberg, M., Moll, T., Greutmann, T., Strohm, O.: Task orientation and user-oriented dialog design. International Journal of Human-Computer Interaction 3, 117–144 (1991)Google Scholar
  28. 28.
    Zapf, D., Brodbeck, F.C., Frese, M., Peters, M., Prümper, J.: Errors in working with office computers. A first validation of a taxonomy for observed errors in a field setting. International Journal of Human-Computer Interaction 4, 311–339 (1992)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1993

Authors and Affiliations

  • Jochen Prümper
    • 1
  1. 1.DATA TRAIN GmbHBerlinGermany

Personalised recommendations