Abstract
The purpose of this paper is to delineate the research challenges of human—machine collaboration in risky decision-making. Technological advances in machine intelligence have enabled a growing number of applications in human—machine collaborative decision-making. Therefore, it is desirable to achieve superior performance by fully leveraging human and machine capabilities. In risky decision-making, a human decision-maker is vulnerable to cognitive biases when judging the possible outcomes of a risky event, whereas a machine decision-maker cannot handle new and dynamic contexts with incomplete information well. We first summarize features of risky decision-making and possible biases of human decision-makers therein. Then, we argue the necessity and urgency of advancing human—machine collaboration in risky decision-making. Afterward, we review the literature on human—machine collaboration in a general decision context, from the perspectives of human—machine organization, relationship, and collaboration. Lastly, we propose challenges of enhancing human—machine communication and teamwork in risky decision-making, followed by future research avenues.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Akash K, Hu W L, Reid T, Jain N (2017). Dynamic modeling of trust in human—machine interactions. In: American Control Conference (ACC). Seattle, WA: IEEE, 1542–1548
Amann J, Blasimme A, Vayena E, Frey D, Madai V I (2020). Explainability for artificial intelligence in healthcare: A multi-disciplinary perspective. BMC Medical Informatics and Decision Making, 20(1): 310
Apel H, Thieken A H, Merz B, Blöschl G (2004). Flood risk assessment and associated uncertainty. Natural Hazards and Earth System Sciences, 4(2): 295–308
Bedford T, Cooke R (2001). Probabilistic Risk Analysis: Foundations and Methods. Cambridge: Cambridge University Press
Bell D E (1982). Regret in decision making under uncertainty. Operations Research, 30(5): 961–981
Bhardwaj A, Ghasemi A H, Zheng Y, Febbo H, Jayakumar P, Ersal T, Stein J L, Gillespie R B (2020). Who’s the boss? Arbitrating control authority between a human driver and automation system. Transportation Research Part F: Traffic Psychology and Behaviour, 68: 144–160
Bier V (2004). Implications of the research on expert overconfidence and dependence. Reliability Engineering & System Safety, 85(1–3): 321–329
Bier V M, Haimes Y Y, Lambert J H, Matalas N C, Zimmerman R (1999). A survey of approaches for assessing and managing the risk of extremes. Risk Analysis, 19(1): 83–94
Blumenthal-Barby J S, Krieger H (2015). Cognitive biases and heuristics in medical decision making: A critical review using a systematic search strategy. Medical Decision Making, 35(4): 539–557
Bradley J V (1954). Desirable control-display relationships for moving-scale instruments. Technical Report 54–423. Dayton, OH: US Air Force, Wright Air Development Center (WADC)
Broomell S B, Budescu D V (2009). Why are experts correlated? Decomposing correlations between judges. Psychometrika, 74(3): 531–553
Cadario R, Longoni C, Morewedge C K (2021). Understanding, explaining, and utilizing medical artificial intelligence. Nature Human Behaviour, in press, doi:https://doi.org/10.1038/s41562-021-01146-0
Calhoun G L, Ruff H A, Behymer K J, Frost E M (2018). Human-autonomy teaming interface design considerations for multi-unmanned vehicle control. Theoretical Issues in Ergonomics Science, 19(3): 321–352
Cannon-Bowers J A, Salas E, Converse S (1993). Shared mental models in expert team decision making. In: Castellan Jr N J, ed. Individual and Group Decision Making. New York: Taylor & Francis Psychology Press, 221–246
Charness G, Karni E, Levin D (2007). Individual and group decision making under risk: An experimental study of Bayesian updating and violations of first-order stochastic dominance. Journal of Risk and Uncertainty, 35(2): 129–148
Chen G, Kim K A, Nofsinger J R, Rui O M (2007). Trading performance, disposition effect, overconfidence, representativeness bias, and experience of emerging market investors. Journal of Behavioral Decision Making, 20(4): 425–451
Chen J Y C, Barnes M J (2014). Human-agent teaming for multirobot control: A review of human factors issues. IEEE Transactions on Human—Machine Systems, 44(1): 13–29
Chen J Y C, Lakhmani S G, Stowers K, Selkowitz A R, Wright J L, Barnes M (2018). Situation awareness-based agent transparency and human—autonomy teaming effectiveness. Theoretical Issues in Ergonomics Science, 19(3): 259–282
Chignell M H, Hancock P A (1986). Knowledge-based load leveling and task allocation in human—machine systems. In: 21st Annual Conference on Manual Control. Moffett Field, CA: NASA Ames Research Center, 9
Cokely E T, Kelley C M (2009). Cognitive abilities and superior decision making under risk: A protocol analysis and process model evaluation. Judgment and Decision Making, 4(1): 20–33
Cramer H, Evers V, Ramlal S, van Someren M, Rutledge L, Stash N, Aroyo L, Wielinga B (2008). The effects of transparency on trust in and acceptance of a content-based art recommender. User Modeling and User-Adapted Interaction, 18(5): 455–496
Croskerry P (2013). From mindless to mindful practice — Cognitive bias and clinical decision making. New England Journal of Medicine, 368(26): 2445–2448
Dafoe A, Bachrach Y, Hadfield G, Horvitz E, Larson K, Graepel T (2021). Cooperative AI: Machines must learn to find common ground. Nature, 593(7857): 33–36
Damacharla P, Javaid A Y, Gallimore J J, Devabhaktuni V K (2018). Common metrics to benchmark Human-Machine Teams (HMT): A review. IEEE Access, 6: 38637–38655
DARPA (2018). AI Next Campaign. Available at: darpa.mil/work-with-us/ai-next-campaign
Daugherty P R, Wilson H J (2018). Human + Machine: Reimagining Work in the Age of AI. Boston: Harvard Business Review Press
Davis F D, Bagozzi R P, Warshaw P R (1989). User acceptance of computer technology: A comparison of two theoretical models. Management Science, 35(8): 982–1003
Dawes R M, Faust D, Meehl P E (1989). Clinical versus actuarial judgment. Science, 243(4899): 1668–1674
de Visser E J, Pak R, Shaw T H (2018). From “automation” to “autonomy”: The importance of trust repair in human—machine interaction. Ergonomics, 61(10): 1409–1427
Deck C, Jahedi S (2015). The effect of cognitive load on economic decision making: A survey and new experiments. European Economic Review, 78: 97–119
Degani A, Goldman C V, Deutsch O, Tsimhoni O (2017). On human-machine relations. Cognition Technology and Work, 19(2–3): 211–231
Dietvorst B J, Simmons J P, Massey C (2015). Algorithm aversion: People erroneously avoid algorithms after seeing them err. Journal of Experimental Psychology, 144(1): 114–126
Doherty E, Cockton G, Bloor C, Benigno D (2001). Improving the performance of the cyberlink mental interface with the “Yes/No Program”. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York: ACM, 69–76
Doherty E, Stephenson G, Engel W (2000). Using a cyberlink mental interface for relaxation and controlling a robot. In: Proceedings of the SIGCAPH Computers and the Physically Handicapped. New York: ACM, 4–9
Dörner D, Wearing A J (1995). Complex problem solving: Toward a (computer simulated) theory. In: Frensch P A, Funke J, eds. Complex Problem Solving: The European Perspective. New York: Taylor & Francis Psychology Press, 65–99
Du N, Haspiel J, Zhang Q, Tilbury D, Pradhan A K, Yang X J, Robert Jr L P (2019). Look who’s talking now: Implications of AV’s explanations on driver’s trust, AV preference, anxiety and mental workload. Transportation Research Part C: Emerging Technologies, 104: 428–442
Duan Y, Edwards J S, Dwivedi Y K (2019). Artificial intelligence for decision making in the era of Big Data: Evolution, challenges and research agenda. International Journal of Information Management, 48: 63–71
Dubois C, Le Ny J (2020). Adaptive task allocation in human—machine teams with trust and workload cognitive models. In: IEEE International Conference on Systems, Man, and Cybernetics (SMC). Toronto, ON, 3241–3246
Edmonds M, Gao F, Liu H, Xie X, Qi S, Rothrock B, Zhu Y X, Wu Y N, Lu H J, Zhu S C (2019). A tale of two explanations: Enhancing human trust by explaining robot behavior. Science Robotics, 4(37): eaay4663
Edwards W (1962). Subjective probabilities inferred from decisions. Psychological Review, 69(2): 109–135
El-Gamal M A, Grether D M (1995). Are people Bayesian? Uncovering behavioral strategies. Journal of the American Statistical Association, 90(432): 1137–1145
Endsley M R (1988). Situation awareness global assessment technique (SAGAT). In: Proceedings of the IEEE National Aerospace and Electronics Conference. Dayton, OH, 789–795
Endsley M R (1995). Toward a theory of situation awareness in dynamic systems. Human Factors, 37(1): 32–64
Ferrari V (2019). Man—machine teaming: Towards a new paradigm of man—machine collaboration? In: Barbaroux P, ed. Disruptive Technology and Defence Innovation Ecosystems, vol. 5. Hoboken, NJ: John Wiley & Sons, 121–137
Fishbein M, Ajzen I (1975). Belief, Attitude, Intention and Behavior: An Introduction to Theory and Research. Boston, MA: Addison-Wesley Publishing Company
Fitts P M (1951). Human Engineering for An Effective Air-Navigation and Traffic Control System. Washington, DC: National Research Council
Fitts P M, Seeger C M (1953). S-R compatibility: Spatial characteristics of stimulus and response codes. Journal of Experimental Psychology, 46(3): 199–210
Flemisch F, Heesen M, Hesse T, Kelsch J, Schieben A, Beller J (2012). Towards a dynamic balance between humans and automation: Authority, ability, responsibility and control in shared and cooperative control situations. Cognition Technology and Work, 14(1): 3–18
Gentner D (2001). Mental models, psychology of. In: Smelser N J, Baltes P B, eds. International Encyclopedia of the Social & Behavioral Sciences. Amsterdam: Elsevier, 9683–9687
Goodrich M A, Yi D (2013). Toward task-based mental models of human-robot teaming: A Bayesian approach. In: International Conference on Virtual, Augmented and Mixed Reality. Designing and Developing Augmented and Virtual Environments. Berlin, Heidelberg: Springer, 267–276
Gregory R, Slovic P, Flynn J (1996). Risk perceptions, stigma, and health policy. Health & Place, 2(4): 213–220
Grether D M (1992). Testing Bayes rule and the representativeness heuristic: Some experimental evidence. Journal of Economic Behavior & Organization, 17(1): 31–57
Griffiths T L, Tenenbaum J B (2006). Optimal predictions in everyday cognition. Psychological Science, 17(9): 767–773
Gunning D (2016). Explainable Artificial Intelligence (XAI) — What are we trying to do? Available at: cc.gatech.edu/∼alanwags/DLAI2016/(Gunning)IJCAI-16DLAIWS.pdf
Gursoy D, Chi O H, Lu L, Nunkoo R (2019). Consumers acceptance of artificially intelligent (AI) device use in service delivery. International Journal of Information Management, 49: 157–169
Gutzwiller R S, Reeder J (2021). Dancing with algorithms: Interaction creates greater preference and trust in machine-learned behavior. Human Factors, 63(5): 854–867
Haesevoets T, de Cremer D, Dierckx K, van Hiel A (2021). Human-machine collaboration in managerial decision making. Computers in Human Behavior, 119: 106730
Hancock P A, Kajaks T, Caird J K, Chignell M H, Mizobuchi S, Burns P C, Feng J, Fernie G R, Lavallière M, Noy I Y, Redelmeier D A, Vrkljan B H (2020). Challenges to human drivers in increasingly automated vehicles. Human Factors, 62(2): 310–328
Hancock P A, Billings D R, Schaefer K E, Chen J Y C, de Visser E J, Parasuraman R (2011). A meta-analysis of factors affecting trust in human-robot interaction. Human Factors, 53(5): 517–527
Hancock P A, Chignell M H (1989). Intelligent Interfaces: Theory, Research and Design. North Holland: Elsevier Science Inc.
Hoc J M (2000). From human—machine interaction to human—machine cooperation. Ergonomics, 43(7): 833–843
Hoff K A, Bashir M (2015). Trust in automation: Integrating empirical evidence on factors that influence trust. Human Factors, 57(3): 407–434
Holzinger A (2016). Interactive machine learning for health informatics: When do we need the human-in-the-loop?. Brain Informatics, 3(2): 119–131
Hunt R G, Krzystofiak F J, Meindl J R, Yousry A M (1989). Cognitive style and decision making. Organizational Behavior and Human Decision Processes, 44(3): 436–453
Jarrahi M H (2018). Artificial intelligence and the future of work: Human—AI symbiosis in organizational decision making. Business Horizons, 61(4): 577–586
Johnson-Laird P (1996). Mental models, deductive reasoning, and the brain. In: Gazzaniga M S, ed. The Cognitive Neurosciences. Cambridge, MA: The MIT Press, 999–1008
Kahneman D, Frederick S (2002). Representativeness revisited: Attribute substitution in intuitive judgment. In: Gilovich T, Griffin D, Kahneman D, eds. Heuristics and Biases: The Psychology of Intuitive Judgment. Cambridge: Cambridge University Press, 49–81
Kahneman D, Tversky A (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47(2): 263–291
Karstens C D, Correia Jr J, LaDue D S, Wolfe J, Meyer T C, Harrison D R, Cintineo J L, Calhoun K M, Smith T M, Gerard A E, Rothfusz L P (2018). Development of a human—machine mix for forecasting severe convective events. Weather and Forecasting, 33(3): 715–737
Kemp C, Tenenbaum J B (2008). The discovery of structural form. Proceedings of the National Academy of Sciences of the United States of America, 105(31): 10687–10692
Kraus J, Scholz D, Stiegemeier D, Baumann M (2020). The more you know: Trust dynamics and calibration in highly automated driving and the effects of take-overs, system malfunction, and system transparency. Human Factors, 62(5): 718–736
Kreye M E, Goh Y M, Newnes L B, Goodwin P (2012). Approaches to displaying information to assist decisions under uncertainty. Omega, 40(6): 682–692
Kulesza T, Wong W K, Stumpf S, Perona S, White R, Burnett M M, Oberst I, Ko A J (2009). Fixing the program my computer learned: Barriers for end users, challenges for the machine. In: Proceedings of the 14th International Conference on Intelligent User Interfaces. Sanibel Island, FL: ACM, 187–196
Kunnathuvalappil Hariharan N (2018). Artificial Intelligence and human collaboration in financial planning. Journal of Emerging Technologies and Innovative Research, 5(7): 1348–1355
Kuo I H, Rabindran J M, Broadbent E, Lee Y I, Kerse N, Stafford R M Q, MacDonald B A (2009). Age and gender factors in user acceptance of healthcare robots. In: The 18th IEEE International Symposium on Robot and Human Interactive Communication. Toyama, 214–219
Laid J, Ranganath C, Gershman S (2020). Future directions in human machine teaming workshop. Arlington, VA: US Department of Defense
Lee J (2020). Is artificial intelligence better than human clinicians in predicting patient outcomes? Journal of Medical Internet Research, 22(8): e19918
Lee J, Moray N (1992). Trust, control strategies and allocation of function in human—machine systems. Ergonomics, 35(10): 1243–1270
Lee J D, See K A (2004). Trust in automation: Designing for appropriate reliance. Human Factors, 46(1): 50–80
Li F F, Etchemendy J (2018). Introducing Stanford’s human-centered AI initiative. Available at: hai.stanford.edu/news/introducing-stanfords-human-centered-ai-initiative
Luce R D, Fishburn P C (1991). Rank- and sign-dependent linear utility models for finite first-order gambles. Journal of Risk and Uncertainty, 4(1): 29–59
Lyn Paul C, Blaha L M, Fallon C K, Gonzalez C, Gutzwiller R S (2019). Opportunities and challenges for human—machine teaming in cybersecurity operations. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 63(1): 442–446
Lyons J B, Havig P R (2014). Transparency in a human—machine context: Approaches for fostering shared awareness/intent. In: International Conference on Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments. Cham: Springer, 181–190
Lyons J B, Mahoney S, Wynne K T, Roebke M A (2018). Viewing machines as teammates: A qualitative study. In: AAAI Spring Symposium Series. Palo Alto, CA, 166–170
Madhavan P, Wiegmann D A (2007). Similarities and differences between human—human and human—automation trust: An integrative review. Theoretical Issues in Ergonomics Science, 8(4): 277–301
March J G, Shapira Z (1987). Managerial perspectives on risk and risk taking. Management Science, 33(11): 1404–1418
McGuirl J M, Sarter N B (2006). Supporting trust calibration and the effective use of decision aids by presenting dynamic system confidence information. Human Factors, 48(4): 656–665
Mearman A (2011). Who do heterodox economists think they are? American Journal of Economics and Sociology, 70(2): 480–510
Miller A P (2018). Want less-biased decisions? Use algorithms. Harvard Business Review, 2018-7-26
Ordóñez L D, Benson III L, Pittarello A (2015). Time-pressure perception and decision making. In: Keren G, Wu G, eds. The Wiley Blackwell Handbook of Judgment and Decision Making, II. Hoboken, NJ: John Wiley & Sons, 517–542
Ortiz C A, Park M R (2011). Visual Controls: Applying Visual Management to the Factory. Boca Raton: Taylor & Francis Productivity Press
Ososky S, Schuster D, Jentsch F, Fiore S, Shumaker R, Lebiere C, Kurup U, Oh J, Stentz A (2012). The importance of shared mental models and shared situation awareness for transforming robots from tools to teammates. In: Proceedings of SPIE 8387, Unmanned Systems Technology XIV. Baltimore, MD, 838710
Ososky S, Schuster D, Phillips E, Jentsch F (2013). Building appropriate trust in human-robot teams. In: AAAI Spring Symposium: Trust and Autonomous Systems. Stanford, CA: Association for the Advancement of Artificial Intelligence, 60–65
Parasuraman R, Sheridan T B, Wickens C D (2000). A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans, 30(3): 286–297
Parker S, Grote G (2019). Automation, algorithms, and beyond: Why work design matters more than ever in a digital world. Applied Psychology, in press, doi:https://doi.org/10.1111/apps.12241
Patel B N, Rosenberg L, Willcox G, Baltaxe D, Lyons M, Irvin J, Rajpurkar P, Amrhein T, Gupta R, Halabi S, Langlotz C, Lo E, Mammarappallil J, Mariano A J, Riley G, Seekins J, Shen L, Zucker E, Lungren M P (2019). Human-machine partnership with artificial intelligence for chest radiograph diagnosis. NPJ Digital Medicine, 2: 111
Payne J W, Bettman J R, Johnson E J (1993). The Adaptive Decision Maker. Cambridge: Cambridge University Press
Phillips E, Ososky S, Grove J, Jentsch F (2011). From tools to teammates: Toward the development of appropriate mental models for intelligent robots. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 55(1): 1491–1495
Rahwan I, Cebrian M, Obradovich N, Bongard J, Bonnefon J F, Breazeal C, Crandall J W, Christakis N A, Couzin I D, Jackson M O, Jennings N R, Kamar E, Kloumann I M, Larochelle H, Lazer D, McElreath R, Mislove A, Parkes D C, Pentland A S, Roberts M E, Shariff A, Tenenbaum J B, Wellman M (2019). Machine behaviour. Nature, 568(7753): 477–486
Renooij S (2001). Probability elicitation for belief networks: Issues to consider. Knowledge Engineering Review, 16(3): 255–269
Roth E M, Sushereba C, Militello L G, Diiulio J, Ernst K (2019). Function allocation considerations in the era of human autonomy teaming. Journal of Cognitive Engineering and Decision Making, 13(4): 199–220
Saenz M J, Revilla E, Simón C (2020). Designing AI systems with human—machine teams. MIT Sloan Management Review, 61(3): 1–5
Salem M, Lakatos G, Amirabdollahian F, Dautenhahn K (2015). Would you trust a (faulty) robot: Effects of error, task type and personality on human-robot cooperation and trust. In: 10th ACM/IEEE International Conference on Human-Robot Interaction. Portland, OR, 141–148
Salmon P M, Stanton N A, Walker G H, Baber C, Jenkins D P, McMaster R, Young M S (2008). What really is going on? Review of situation awareness models for individuals and teams. Theoretical Issues in Ergonomics Science, 9(4): 297–323
Schaefer K E, Chen J Y C, Szalma J L, Hancock P A (2016). A metaanalysis of factors influencing the development of trust in automation. Human Factors, 58(3): 377–400
Schaefer K E, Straub E R, Chen J Y C, Putney J, Evans III A W (2017). Communicating intent to develop shared situation awareness and engender trust in human-agent teams. Cognitive Systems Research, 46: 26–39
Seeber I, Bittner E, Briggs R O, de Vreede T, de Vreede G J, Elkins A, Maier R, Merz A B, Oeste-Reiß S, Randrup N, Schwabe G, Söllner M (2020). Machines as teammates: A research agenda on AI in team collaboration. Information & Management, 57(2): 103174
Seeber I, Waizenegger L, Seidel S, Morana S, Benbasat I, Lowry P B (2019). Reinventing collaboration with autonomous technology-based agents. In: Proceedings of the 27th European Conference on Information Systems (ECIS). Stockholm: Association for Information Systems, 4
Selkowitz A R, Lakhmani S G, Larios C N, Chen J Y C (2016). Agent transparency and the autonomous squad member. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 60(1): 1319–1323
Seong Y, Bisantz A M (2008). The impact of cognitive feedback on judgment performance and trust with decision aids. International Journal of Industrial Ergonomics, 38(7–8): 608–625
Sheridan T B, Hennessy R T (1984). Research and modeling of supervisory control behavior: Report of a workshop. Washington, DC: The National Academies Press, US National Research Council
Shin D (2020). The effects of explainability and causability on perception, trust, and acceptance: Implications for explainable AI. International Journal of Human—Computer Studies, 146: 102551
Shin D, Park Y J (2019). Role of fairness, accountability, and transparency in algorithmic affordance. Computers in Human Behavior, 98: 277–284
Silver D, Huang A, Maddison C J, Guez A, Sifre L, van den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M, Dieleman S, Grewe D, Nham J, Kalchbrenner N, Sutskever I, Lillicrap T, Leach M, Kavukcuoglu K, Graepel T, Hassabis D (2016). Mastering the game of Go with deep neural networks and tree search. Nature, 529(7587): 484–489
Silver D, Schrittwieser J, Simonyan K, Antonoglou I, Huang A, Guez A, Hubert T, Baker L, Lai M, Bolton A, Chen Y, Lillicrap T, Hui F, Sifre L, van den Driessche G, Graepel T, Hassabis D (2017). Mastering the game of Go without human knowledge. Nature, 550(7676): 354–359
Simon D, Krawczyk D C, Holyoak K J (2004). Construction of preferences by constraint satisfaction. Psychological Science, 15(5): 331–336
Skraaning G, Jamieson G A (2019). Human performance benefits of the automation transparency design principle: Validation and variation. Human Factors, 63(3): 379–401
Speier C (2006). The influence of information presentation formats on complex task decision-making performance. International Journal of Human-Computer Studies, 64(11): 1115–1131
Speier C, Morris M G (2003). The influence of query interface design on decision-making performance. Management Information Systems Quarterly, 27(3): 397–423
Stowers K, Kasdaglis N, Newton O, Lakhmani S, Wohleber R, Chen J (2016). Intelligent agent transparency: The design and evaluation of an interface to facilitate human and intelligent agent collaboration. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 60(1): 1706–1710
Tenenbaum J B, Kemp C, Griffiths T L, Goodman N D (2011). How to grow a mind: Statistics, structure, and abstraction. Science, 331(6022): 1279–1285
Tetlock P E (2003). Thinking the unthinkable: Sacred values and taboo cognitions. Trends in Cognitive Sciences, 7(7): 320–324
Tong J, Feiler D (2017). A behavioral model of forecasting: Naive statistics on mental samples. Management Science, 63(11): 3609–3627
Topol E J (2019). High-performance medicine: The convergence of human and artificial intelligence. Nature Medicine, 25(1): 44–56
Tschandl P, Rinner C, Apalla Z, Argenziano G, Codella N, Halpern A, Janda M, Lallas A, Longo C, Malvehy J, Paoli J, Puig S, Rosendahl C, Soyer H P, Zalaudek I, Kittler H (2020). Human-computer collaboration for skin cancer recognition. Nature Medicine, 26(8): 1229–1234
Tversky A, Kahneman D (1974). Judgment under uncertainty: Heuristics and biases. Science, 185(4157): 1124–1131
Urlings P, Jain L C (2002). Teaming human and machine: A conceptual framework. In: Abraham A, Köppen M, eds. Hybrid Information Systems. Heidelberg: Springer, 711–721
van Maanen P P, van Dongen K (2005). Towards task allocation decision support by means of cognitive modeling of trust. In: Proceedings of 17th Belgian-Netherlands Artificial Intelligence Conference. Brussels, 399–400
Venkatesh V, Thong J Y L, Xu X (2012). Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology. Management Information Systems Quarterly, 36(1): 157–178
von Neumann J, Morgenstern O (1944). Theory of Games and Economic Behavior. Princeton: Princeton University Press
Vosgerau G (2006). The perceptual nature of mental models. Advances in Psychology, 138: 255–275
Wakker P (1989). Continuous subjective expected utility with non-additive probabilities. Journal of Mathematical Economics, 18(1): 1–27
Wang N, Pynadath D V, Hill S G (2016). Trust calibration within a human—robot team: Comparing automatically generated explanations. In: The 11th ACM/IEEE International Conference on Human—Robot Interaction. Christchurch, 109–116
Warden T, Carayon P, Roth E M, Chen J, Clancey W J, Hoffman R, Steinberg M L (2019). The national academies board on human system integration (BOHSI) panel: Explainable AI, system transparency, and human machine teaming. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 63(1): 631–635
Whelehan D F, Conlon K C, Ridgway P F (2020). Medicine and heuristics: Cognitive biases and medical decision-making. Irish Journal of Medical Science, 189(4): 1477–1484
Wickens C D, Hollands J G, Banbury S, Parasuraman R (2013). Engineering Psychology and Human Performance, 4th ed. New York: Taylor & Francis Psychology Press
Wickham P A (2003). The representativeness heuristic in judgements involving entrepreneurial success and failure. Management Decision, 41(2): 156–167
Wynne K T, Lyons J B (2018). An integrative model of autonomous agent teammate-likeness. Theoretical Issues in Ergonomics Science, 19(3): 353–374
Xu W (2019). Towards human-centered AI: A perspective from human—computer interaction. Interaction, 26(4): 42–46
Yalçin Ö N, DiPaola S (2020). Modeling empathy: Building a link between affective and cognitive processes. Artificial Intelligence Review, 53(4): 2983–3006
Zinn J O (2008). Heading into the unknown: Everyday strategies for managing risk and uncertainty. Health Risk & Society, 10(5): 439–450
Author information
Authors and Affiliations
Corresponding authors
Additional information
This study was supported by the National Natural Science Foundation of China (Grant Nos. 71871128, 72171127 and 72192824) and Beijing Social Science Fund (Grant No. 19GLB029).
Rights and permissions
This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Xiong, W., Fan, H., Ma, L. et al. Challenges of human—machine collaboration in risky decision-making. Front. Eng. Manag. 9, 89–103 (2022). https://doi.org/10.1007/s42524-021-0182-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s42524-021-0182-0