Abstract
The continued research, development and acceptance of intelligent systems for diagnosis and decision support has uncovered many practical considerations for the interaction of intelligent, autonomous agents. One such consideration is the possibility of an agent intentionally transmitting misinformation to other agents or to a human decision maker to achieve its own goals. Most intelligent, knowledge-based systems to date have assumed all experts involved in system development operate toward a shared goal and operate in good faith. We wish to challenge these assumptions and consider cases where agents in the system are not assumed to operate in good faith and therefore misinformation is a possibility. Most literature devoted to deception in agent systems focuses on building trust relationships through a history of interaction. We apply models of deception and deception detection from psychology and cognitive science to intelligent multi-agent systems. We focus on a model for deception detection in which the detection and analysis of deception are decoupled. Finally, we introduce a novel method for the detection of deception in multi-agent systems based on correlations between the agents in the system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Beinlich, I., Suermondt, G., Chavez, R., Cooper, G.: The alarm monitoring system. In: Second European Conference on AI and Medicine (1989)
Bowyer Bell, J., Whaley, B.: Cheating and Deception. Transaction Publishers (1991)
Barton Bowyer, J.: Cheating. St. Martin’s Press, New York (1982)
Breese, J.S., Heckerman, D., Kadie, C.: Empirical analysis of predictive algorithms for collaborative filtering. Technical Report MSR-TR-98-12, Microsoft Research, Microsoft Corporation, One Microsoft Way, Redmond, WA, 98052 (October 1998)
Burgoon, J.K., Buller, D.B.: Interpersonal Deception: III. Effects of Deceit on Perceived Communication and Nonverbal Behavior Dynamics. Journal of Nonverbal Behavior 18(2), 155–184 (1994)
Denett, D.C.: The Intentional Stance. The MIT Press, Cambridge (1987)
Joey, F.: George and John R. Carlson. Group support systems and deceptive communication. In: Proceedings of the 32nd Hawaii International Conference on System Sciences, January 1999, IEEE, Los Alamitos (1999)
Johnson, P., Grazioli, S.: Fraud Detection: Intentionality and Deception in Cognition. Accounting, Organizations and Society 25, 355–392 (1993)
Santos Jr., E., Johnson Jr., G.: Toward detecting deception in intelligent systems. To appear in Proceedings of the SPIE Defense and Security Symposium (April 2004)
Mawby, R., Mitchell, R.W.: Feints and Ruses: An Analysis of Deception in Sports. In: Mitchell, R.W., Thompson, N.S. (eds.) Deception: Perspectives on Human and Nonhuman Deceit, State University of New York Press (1986)
Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., Riedl, J.: Grouplens: an open architecture for collaborative filtering of netnews. In: Proceedings of the conference on Computer supported cooperative work, October 22-26, pp. 175–186. IEEE, Los Alamitos (1994)
Whaley, B.: Toward a General Theory of Deception. In: Gooch, J., Perlmutter, A. (eds.) Military Deception and Strategic Surprise. Frank Cass (1982)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Johnson, G., Santos, E. (2004). Detecting Deception in Intelligent Systems I: Activation of Deception Detection Tactics. In: Tawfik, A.Y., Goodwin, S.D. (eds) Advances in Artificial Intelligence. Canadian AI 2004. Lecture Notes in Computer Science(), vol 3060. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24840-8_24
Download citation
DOI: https://doi.org/10.1007/978-3-540-24840-8_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22004-6
Online ISBN: 978-3-540-24840-8
eBook Packages: Springer Book Archive