Abstract
Decision Support Systems (DSSs) in the domain of Industrial Engineering and Management can be very powerful tools, but more knowledge about the way users utilize these systems is required. In the current research, we evaluated the effect of previous experience with a task on users’ willingness to accept a suggested decision aid and their performance in a supply chain management system. Participants were randomly assigned to one of three between-participants groups: the No Aid Group, which did not receive any decision aid during the interaction; the Aid Group, which was offered an algorithm, at the beginning of the first session, to help members improve their decisions; and the Mid-term Aid Group, which received, at the beginning of the second session, the same algorithm that was offered to the Aid Group. Participants were tested separately. The results demonstrated that in the second session, the performance of the Aid Group was significantly better in comparison with the No Aid Group. The Mid-term Aid Group’s performance did not show any gain, although both the Aid and Mid-term Aid Groups made similar use of the aid in this session. We concluded that in a DSS, having previous experience with the task before introducing the decision aid compared to having previous experience with the task and with the decision aid is not recommended.
Similar content being viewed by others
References
Bailey NR, Scerbo MW (2007) Automation-induced complacency for monitoring highly reliable systems: the role of task complexity, system experience, and operator trust. Theor Issues Ergon Sci 8(4):321–348
Becker-Peth M, Katok E, Thonemann UW (2013) Designing buyback contracts for irrational but predictable newsvendors. Manag Sci 59:1800–1816
Bostian AA, Holt CA, Smith AM (2008) Newsvendor “pull-to-center” effect: adaptive learning in a laboratory experiment. Manuf Serv Oper Manag 10:590–608
Buehlmann U, Ragsdale CT, Gfeller B (2000) A spreadsheet-based decision support system for wood panel manufacturing. Decis Support Syst 29:207–227
Corritore CL, Kracher B, Wiedenbeck S (2003) On-line trust: concepts, evolving themes, a model. Int J Hum Comput Stud 58:737–758
Dzindolet MT, Pierce LG, Beck HP, Dawe LA (2002) The perceived utility of human and automated aids in a visual detection task. Hum Factors 44:79–94
Dzindolet MT, Peterson SA, Pomranky RA, Pierce LG, Beck HP (2003) The role of trust in automation reliance. Int J Hum Comput Stud 58:697–718
Hankowski RJ Kantowitz BH, Kantowitz SC (1994) Driver acceptance of unreliable route guidance information. In: Proceedings of the Human Factors and Ergonomics Society 38th annual meeting. Human Factors and Ergonomics Society, Santa Monica, pp 1062–1066
Ho TH, Lim N, Cui TH (2010) Reference dependence in multilocation newsvendor models: a structural analysis. Manag Sci 56:1891–1910
Jackson GC, Taylor JC (1998) Administering the MIT Beer game: lessons learned. Dev Bus Simul Exp Learn 25:208–214
Kantowitz BH, Hankowski RJ, Kantowitz SC (1997) Driver acceptance of unreliable traffic information in familiar and unfamiliar settings. Hum Factors 39:164–176
Kapanoglu M, Miller WA (2004) An evolutionary algorithm-based decision support system for managing flexible manufacturing. Robot Comput Aided Manuf 20:529–539
Lacson FC, Wiegmann DA, Madhavan P (2005) Effects of attribute and goal framing on automation reliance and compliance. In: Proceedings of the Human Factors and Ergonomics Society 49th annual meeting. Human Factors and Ergonomics Society, Santa Monica, pp 482–486
Layton C, Smith PJ, McCoy CE (1994) Design of cooperative problem-solving system for en-route flight planning: an empirical evaluation. Hum Factors 36:94–112
Lee JD, Moray N (1992) Trust, control strategies and allocation of function in human-machine systems. Ergonomics 35:1243–1270
Lee JD, Moray N (1994) Trust, self confidence and operators’ adaptation to automation. Int J Hum Comput Stud 40:153–184
Liu H, Howley E, Duggan J (2009) Optimisation of the Beer Distribution Game with complex customer demand patterns. In: IEEE Congress on evolutionary computation, 2009, CEC’09, pp 2638–2645. IEEE
Madhavan P, Wiegmann DA, Lacson FC (2006) Automation failures on tasks easily performed by operators undermine trust in automated aids. Hum Factors 48:241–256
Moray N, Inagaki T, Itoh M (2000) Adaptive automation, trust, and self-confidence in fault management of time-critical tasks. J Exp Psychol Appl 6:44–58
Muir BM, Moray N (1996) Trust in automation: part II. Experimental studies of trust and human intervention in a process control simulation. Ergonomics 39:429–461
Parasuraman R, Riley V (1997) Human and automation: use, misuse, disuse, abuse. Hum Factors 39:230–253
Parasuraman R, Molloy R, Singh IL (1993) Performance consequences of automation-induced complacency. Int J Aviat Psychol 3:1–23
Park C, Song J, Kim J-G, Kim I (1999) Delivery date decision support system for the large scale make-to-order manufacturing companies: a Korean electric motor company case. Prod Plan Control 10:585–597
Ravid G, Rafaeli S (2000) Multi player, Internet and Java-based simulation games: learning and research in implementing a computerized version of the “Beer-Distribution Supply Chain Game”. Simul Ser 32:15–22
Ren Y, Croson R (2013) Overconfidence in newsvendor orders: an experimental study. Manag Sci 59:2502–2517
Rice R, Keller D (2009) Automation reliance under time pressure. Cognit Technol 14:36–44
Riley V (1996) Operator reliance on automation: theory and data. In: Parasuraman R, Moulouas M (eds) Automation and human performance: Theory and applications. Lawrence Erlbaum, Mahwah, pp 19–35
Ruël G, van Donk DP, van der Vaart T (2006) The beer game revisited: relating risk-taking behaviour and bullwhip effect. In: Proceedings of EurOMA, pp 403–412
Schiffels S, Fügener A, Kolisch R, Jens Brunner O (2014) On the assessment of costs in a newsvendor environment: insights from an experimental study. Omega 43:1–8
Schweitzer ME, Cachon GP (2000) Decision bias in the newsvendor problem with a known demand distribution: experimental evidence. Manag Sci 46:404–420
Sterman J (1984) Instructions for running the beer distribution game. Systems Dynamics Group, Sloan School of Management, Cambridge
Tan G, Lewandowsky S (1996) A comparison of operator trust in humans versus machines. In: CybErg 96 virtual conference. Retrieved May (Vol 16, p 2000)
Waern Y, Ramberg R (1996) People’s perception of human and computer advice. Comput Hum Behav 12:17–27
Waern Y, Hägglund S, Löwgren J, Rankin I, Sololnicki T, Steinmann A (1992) Communication knowledge for knowledge communication. Int J Man Mach Stud 37:215–239
Wu DY, Katok E (2006) Learning, communication, and the bullwhip effect. J Oper Manag 24:839–850
Acknowledgments
This research was supported in part by ORT Braude Research Committee, Israel.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yuviler-Gavish, N., Naseraldin, H. The effect of previous experience when introducing a decision aid in a decision support system for supply chain management. Cogn Tech Work 18, 439–447 (2016). https://doi.org/10.1007/s10111-016-0369-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10111-016-0369-z