Annals of Operations Research

, Volume 72, Issue 0, pp 5–27 | Cite as

Aiding DSS users in the use of complex OR models

  • Danièle Thomassin Singh
  • Pavan Pratap Singh

Abstract

The under-utilization of decision support systems (DSS) based on complex OR models is a reality faced by many OR/IS system designers. The research finding that DSS users trade off decision making effort versus decision accuracy has been utilized as a ready-made explanation for this phenomenon. That is, it has been argued that complex DSSs may never get to be used at all due to the increased effort required in using them. We argue, in contrast, that DSSs have been found to elicit a zero-sum effort versus accuracy tradeoff precisely because they are architecturally designed to do so. A modification of DSS architecture designed to deal with this problem is proposed, and a research prototype based upon this architecture is described. Two preliminary laboratory experiments designed to examine the utility of this prototype have indicated that DSS design can significantly impact the level of the effort versus accuracy tradeoff. We conclude, therefore, that the "complexity ceiling" which has heretofore limited the amount of complexity an OR/IS designer can usefully incorporate into DSSs is not inviolate.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    R.H. Ashton and S.S. Kramer, Students as surrogates in behavioral research: Some evidence, Journal of Accounting Research 68(1980)209–222.Google Scholar
  2. [2]
    L.R. Beach and T.R. Mitchell, A contingency model for the selection of decision strategies, Academy of Management Review 3(1978)439–449.Google Scholar
  3. [3]
    I. Benbasat and A.S. Dexter, Individual differences in the use of decision support aids, Journal of Accounting Research 20(1982)735–749.Google Scholar
  4. [4]
    I. Benbasat and R.N. Taylor, Behavioral aspects of information processing for the design of management information systems, IEEE Transactions on Systems, Man, and Cybernetics 12(1982) 439–450.Google Scholar
  5. [5]
    J.R. Bettman and P. Kakkar, Effects of information presentation format on consumer information acquisition, in: Advances in Consumer Research, Vol. 3, B. Anderson, ed., Association for Consumer Research, 1977, pp. 316–320.Google Scholar
  6. [6]
    J.R. Bettman, E.J. Johnson and J.W. Payne, A componential analysis of cognitive effort in choice, Organizational Behavior and Human Decision Processes 45(1990)111–139.Google Scholar
  7. [7]
    R.S. Billings and L.L. Scherer, The effects of response mode and importance on decision-making strategies: Judgment versus choice, Organizational Behavior and Human Decision Processes 41 (1988)1–19.Google Scholar
  8. [8]
    A.L. Brown, J.D. Bransford, R.A. Ferrara and J.C. Campione, Learning, remembering and understanding, in: Handbook of Child Psychology, 4th ed., Vol. 3, J.H. Flavell and E.M. Markham, eds., 1983, pp. 77–106.Google Scholar
  9. [9]
    J.S. Bruner, J.J. Goodnow and G.A. Austin, A Study of Thinking, Wiley, New York, 1956.Google Scholar
  10. [10]
    M.T.H. Chi, R. Glaser and E. Rees, Expertise in problem solving, in: Advances in the Psychology of Human Intelligence, Vol. 1, R.J. Sternberg, ed., Lawrence Erlbaum Associates, Hillsdale, NJ, 1982, pp. 7–75.Google Scholar
  11. [11]
    M.T.H. Chi, R. Glaser and M.J. Farr, The Nature of Expertise, Lawrence Erlbaum Associates, Hillsdale, NJ, 1988.Google Scholar
  12. [12]
    J.J.J. Christensen-Szalanski, Problem solving strategies: A selection mechanism, some implications and some data, Organizational Behavior and Human Performance 25(1980)307–323.Google Scholar
  13. [13]
    J.F. Courtney and D.B. Paradice, A knowledge based DSS for managerial problem diagnosis, Decision Sciences 18(1987)373–399.Google Scholar
  14. [14]
    A. Cypher, The structure of users' activities, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 243–263.Google Scholar
  15. [15]
    D.R. Davies, D.M. Jones and A. Taylor, Selective-and sustained-attention tasks: Individual and group differences, in: Varieties of Attention, R. Parasuraman and D.R. Davies, eds., Academic Press, Orlando, FL, 1984, pp. 395–448.Google Scholar
  16. [16]
    B.L. Dos Santos and M.L. Bariff, A study of user interface aids for model-oriented Decision Support Systems, Management Science 34(1988)461–468.Google Scholar
  17. [17]
    S.W. Draper, Display managers as the basis for user-machine communication, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 339–352.Google Scholar
  18. [18]
    J.E. Dutton, Interpretations on automatic: A different view of strategic issue diagnosis, Journal of Management Studies 30(1993)339–357.Google Scholar
  19. [19]
    H. Einhorn and R. Hogarth, Confidence in judgment: Persistence of the illusion of validity, Psychological Review 85(1978)395–416.Google Scholar
  20. [20]
    M. Gopalakrishnan, S. Gopalakrishnan and D.M. Miller, A Decision Support System for scheduling personnel in a newspaper publishing environment, Interfaces 23(1993)104–115.Google Scholar
  21. [21]
    S.J. Hoch and D.A. Schkade, A psychological approach to Decision Support Systems, Management Science 42(1996)51–64.Google Scholar
  22. [22]
    R. Hockey, Varieties of attentional state: The effects of environment, in: Varieties of Attention, R. Parasuraman and D.R. Davies, eds., Academic Press, Orlando, FL, 1984, pp. 449–484.Google Scholar
  23. [23]
    E.L. Hutchins, J.D. Hollan and D.A. Norman, Direct manipulation interfaces, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 87–124.Google Scholar
  24. [24]
    E. Johnson, J. Payne and J. Bettman, Information displays and preference reversals, Organizational Behavior and Human Decision Processes 42(1988)1–21.Google Scholar
  25. [25]
    P.N. Johnson-Laird, Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness, Harvard University Press, Cambridge, MA, 1983.Google Scholar
  26. [26]
    D. Kahneman, Attention and Effort, Prentice-Hall, Englewood Cliffs, NJ, 1973.Google Scholar
  27. [27]
    I.P. Khera and J.D. Benson, Are students really poor substitutes of businessmen in behavioral research?, Journal of Marketing Research 7(1970)529–532.Google Scholar
  28. [28]
    L.B. Kurke and H.E. Aldrich, Mintzberg was right!: A replication and extension of the nature of managerial work, Management Science 29(1983)975–984.Google Scholar
  29. [29]
    J. Leplat, Task complexity in work situations, in: Tasks, Errors, and Mental Models, L.P. Goodstein, et al., eds., Taylor & Francis, London, 1988, pp. 105–115.Google Scholar
  30. [30]
    C. Lewis and D.A. Norman, Designing for error, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 411–432.Google Scholar
  31. [31]
    S.L. Loy, The interaction effects between general thinking skills and an interactive graphics-based DSS to support problem structuring, Decision Sciences 23(1991)648–672.Google Scholar
  32. [32]
    E.J. Lusk, A test of differential performance peaking for a disembedding task, Journal of Accounting Research, Supplement (1973) 191–202.Google Scholar
  33. [33]
    G. March and H.A. Simon, Organizations, Wiley, New York, 1958.Google Scholar
  34. [34]
    G.A. Miller, The magical number seven, plus or minus two: Some limits on our capacity for processing information, Psychological Review 63(1956)81–97.Google Scholar
  35. [35]
    H. Mintzberg, Managerial work: Analysis from observation, Management Science 18(1971)B97–B110.Google Scholar
  36. [36]
    Y. Miyata and D.A. Norman, Psychological issues in support of multiple activities, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 265–284.Google Scholar
  37. [37]
    K. Mykytyn, P.P. Mykytyn, Jr. and C.W. Slinkman, Expert systems: A question of liability?, MIS Quarterly (March 1990) 27–42.Google Scholar
  38. [38]
    D.A. Norman, Categorization of action slips, Psychological Review 88(1981)1–15.Google Scholar
  39. [39]
    D.A. Norman and T. Shallice, Attention to action: Willed and automatic control of behavior, in: Consciousness and Self-Regulation: Advances in Research, Vol. 4, R.J. Davidson, G.E. Schwartz and D. Shapiro, eds., Plenum Press, New York, 1985, pp. 1–18.Google Scholar
  40. [40]
    C.E. O'Malley, Helping users help themselves, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 377–398.Google Scholar
  41. [41]
    L. Paquette and T. Kida, The effect of decision strategy and task complexity on decision performance, Organizational Behavior and Human Decision Processes 41(1988)128–142.Google Scholar
  42. [42]
    J.W. Payne, Contingent decision behavior, Psychological Bulletin 92(1982)382–402.Google Scholar
  43. [43]
    J.W. Payne, J.R. Bettman and E.J. Johnson, Adaptive strategy selection in decision making, Journal of Experimental Psychology: Learning, Memory, and Cognition 14(1988)534–552.Google Scholar
  44. [44]
    W.E. Pracht and J.F. Courtney, The effects of an integrative graphics-based DSS to support problem structuring, Decision Sciences 19(1988)598–621.Google Scholar
  45. [45]
    K.V. Ramani and B.K. Mandal, Operational planning of passenger trains in Indian railways, Interfaces 22(1992)39–51.Google Scholar
  46. [46]
    J. Rasmussen, Cognitive control and human error mechanisms, in: New Technology and Human Error, J. Rasmussen, K. Duncan and J. Leplat, eds., Wiley, Chichester, UK, 1987, pp. 53–61.Google Scholar
  47. [47]
    J.T. Reason, Generic error-modeling system (GEMS): A cognitive framework for locating common human error form, in: New Technology and Human Error, J. Rasmussen, K. Duncan and J. Leplat, eds., Wiley, Chichester, UK, 1987, pp. 63–83.Google Scholar
  48. [48]
    R. Reichman, Communication paradigms for a window system, in: User Centered System Design, D.A. Norman and S.W. Draper, eds., Lawrence Erlbaum Associates, Hillsdale, NJ, 1986, pp. 285–314.Google Scholar
  49. [49]
    J.C. Rivera, An empirical study of the effect of system response time and task complexity on user decision quality, Unpublished Doctoral Dissertation, Mississippi State University, Mississippi, MS, 1992.Google Scholar
  50. [50]
    S. Rodriguez, Training users of a flexible Decision Support System: The effects of training content and user ability, Unpublished Doctoral Dissertation, Case Western Reserve University, Cleveland, OH, 1991.Google Scholar
  51. [51]
    J. Russo and B. Dosher, Strategies for multiattribute binary choice, Journal of Experimental Psychology: Learning, Memory and Cognition 9(1983)676–696.Google Scholar
  52. [52]
    A.P. Sage, Behavioral and organizational considerations in the design of information systems and processes for planning and decision support, IEEE Transactions on Systems, Man, and Cybernetics SMC-11(1981)640–678.Google Scholar
  53. [53]
    A.P. Sage, Decision Support Systems Engineering, Wiley, New York, 1991.Google Scholar
  54. [54]
    J.D. Schmitz, G.D. Armstrong and J.D.C. Little, CoverStory — automated news finding in marketing, Interfaces 20(1990)29–38.Google Scholar
  55. [55]
    K. Sengupta and D. Te'eni, Cognitive feedback in GDSS: Improving control and convergence, MIS Quarterly 17(1993)87–113.Google Scholar
  56. [56]
    P.W. Shannon and R.P. Minch, A Decision Support System for motor vehicle taxation evaluation, Interfaces 22(1992)52–64.Google Scholar
  57. [57]
    H.A. Simon, Theories of decision making in economics and behavioral science, American Economic Review 49(1959)253–283.Google Scholar
  58. [58]
    H.A. Simon, The New Science of Management Decisions, Harper and Row, New York, 1960.Google Scholar
  59. [59]
    H.A. Simon, Rational decision making in business organizations, American Economic Review 69(1979)493–513.Google Scholar
  60. [60]
    P. Slovic, S. Lichtenstein and B. Fischhoff, Decision making, in: Steven's Handbook of Experimental Psychology, 2nd ed., R.C. Atkinson et al., eds., Wiley, New York, 1988.Google Scholar
  61. [61]
    R.J. Sternberg, Beyond IQ: A Triarchic Theory of Intelligence, Cambridge University Press, New York, 1985.Google Scholar
  62. [62]
    R.J. Sternberg, The Triarchic Mind: A New Theory of Human Intelligence, Viking, New York, 1988.Google Scholar
  63. [63]
    R. Stewart, Managers and their Jobs: A Study of the Similarities and Differences in the Ways Managers Spend their Time, 2nd ed., MacMillan, London, 1988.Google Scholar
  64. [64]
    R.N. Taylor, Psychological determinants of bounded rationality: Implications for decision making strategies, Decision Sciences 20(1975)166–181.Google Scholar
  65. [65]
    D. Te'eni, Analysis and design of process feedback in information systems: Old and new wine in new bottles, Accounting, Management, and Information Technologies 2(1992)1–18.Google Scholar
  66. [66]
    D. Thomassin Singh, Incorporating solution process monitoring tools into current Decision Support System architecture, Unpublished Doctoral Dissertation, Department of Management Information and Decision Systems, Case Western Reserve University, Cleveland, OH, 1994.Google Scholar
  67. [67]
    P. Todd and I. Benbasat, An experimental investigation of the impact of computer based decision aids on decision making strategies, Information Systems Research 2(1991)87–115.Google Scholar
  68. [68]
    P. Todd and I. Benbasat, The use of information in decision making: An experimental investigation of the impact of computer-based decision aids, MIS Quarterly 16(1992)373–393.Google Scholar
  69. [69]
    G.R. Walsh, Methods of Optimization, Wiley, London, 1975.Google Scholar
  70. [70]
    H.S. Weigel S.P. Wilcox, The army's personnel Decision Support System, Decision Support Systems 9(1993)281–306.Google Scholar
  71. [71]
    D.J. Wilde and C.S. Beightler, Foundations of Optimization, Prentice-Hall, Englewood Cliffs, NJ, 1976.Google Scholar
  72. [72]
    T. Winograd, Bringing Design to Software, Addison-Wesley, New York, 1996.Google Scholar
  73. [73]
    H.A. Witkin, P. Oltman, E. Ruskin and S. Karp, The Embedded Figures Test Manual, Consulting Psychologist Press, Palo Alto, CA, 1971.Google Scholar
  74. [74]
    D. Yang and W. Mou, An integrated Decision Support System in a Chinese chemical plant, Interfaces 23(1993)93–100.Google Scholar

Copyright information

© Kluwer Academic Publishers 1997

Authors and Affiliations

  • Danièle Thomassin Singh
  • Pavan Pratap Singh

There are no affiliations available

Personalised recommendations