Skip to main content

An Emerging Catastrophe: The Weaponization of Emotional Sentience in AI

  • Chapter
  • First Online:
Cognitive Dynamics on Clausewitz Landscapes
  • 230 Accesses

Abstract

Here, we reassemble bits and pieces from across the previous essays to conduct a policy analysis of, and make a recommendation regarding, the Next Big Thing in artificial intelligence, the forthcoming creation of “emotionally sentient” systems that can understand—and manipulate—human emotional responses at and across various timescales. Although civilian uses of the technology will clearly be aimed at marketing something—goods, services, compliance with the desires and intents of a purported authority, and so on—there is considerable potential for “dual use” of such machineries on Clausewitz landscapes of conflict and contention.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. McDuff, D., and M. Czerwinski. 2018. Designing emotionally sentient agents. Communications of the ACM 61 (12): 74–83.

    Article  Google Scholar 

  2. Ortony, A., G. Clore, and A. Collins. 1988. The cognitive structure of emotions. New York: Cambridge University Press.

    Book  Google Scholar 

  3. Bartneck, C., M. Lyons, and M. Saerbeck. 2017. The relationship between emotion models and artificial intelligence, https://arxiv.org/pdf/1706.09554

  4. Minsky, M. 1986. The society of mind. New York: Simon and Schuster.

    Google Scholar 

  5. Osinga, F. 2007. Science, strategy and war: The strategic theory of John Boyd. London: Routledge.

    Book  Google Scholar 

  6. Darwin, C. 1872. The expression of the emotions in man and animals. London.

    Google Scholar 

  7. Henrich, J., S. Heine, and A. Norenzayan. 2010. The weirdest people in the world? Behavioral and Brain Sciences 33: 61–135.

    Article  Google Scholar 

  8. Cowen, A., and D. Keltner. 2017. Self-report captures 27 distinct categories of emotion bridged by continuous gradients, PNAS. www.pnas.org/cgi/doi/10.1073/pnas.1702247114.

  9. Kleinman, A. 1991. Rethinking Psychiatry: From cultural category to personal experience. New York: Free Press.

    Google Scholar 

  10. Wallace, R. 2017. Computational Psychiatry: A systems biology approach to the epigenetics of mental disorders. New York: Springer.

    Book  Google Scholar 

  11. Zilberstein, S. 1996. Using anytime algorithms in intelligent systems. AI Magazine 17: 73–83.

    Google Scholar 

  12. Wallace, R. 2019. Cognition, conflict, and doctrine: how groupthink fails on a Clausewitz landscape. In press, Journal of Defense Modeling and Simulation.

    Google Scholar 

  13. Dang, T., K. Ling, and D. Quevedo. 2018. Stability analysis of event-triggered anytime control with multiple control laws. arXiv:1804.07876v1 [math.OC] April 2018.

  14. Quevedo, D., and V. Gupta. 2012. Sequence-based anytime control. IEEE Transactions on Automatic Control 58: 377–390.

    Article  Google Scholar 

  15. Greco, L., D. Fontanelli, and A. Bicchi. 2007. Almost sure stability of anytime controllers via stochastic scheduling. In 46th IEEE conference on decision and control, pp. 5640–5645.

    Google Scholar 

  16. Cover, T., and J. Thomas. 2006. Elements of information theory, 2nd ed. New York: Wiley.

    Google Scholar 

  17. Jin, H., Z. Hu, and X. Zhou. 2008. A convex stochastic optimization problem arising from portfolio selection. Mathematical Finance 18: 171–183.

    Article  Google Scholar 

  18. Protter, P. 2005. Stochastic integration and differential equations, 2nd ed. New York: Springer.

    Book  Google Scholar 

  19. Appleby, J., X. Mao, and A. Rodkina. 2008. Stabilization and destabilization of nonlinear differential equations by noise. IEEE Transactions on Automatic Control 53: 126–132.

    Article  Google Scholar 

  20. Wallace, R., L.F. Chaves, L. Bergmann, C. Ayres, L. Hogerwerf, R. Kock, and R.G. Wallace. 2018. Clear-Cutting Disease Control: Capital-led deforestation, public health austerity, and vector-borne infection. New York: Springer.

    Book  Google Scholar 

  21. Atlan, H., and I. Cohen. 1998. Immune information, self-organization, and meaning. International Immunology 10: 711–717.

    Article  Google Scholar 

  22. Khinchin, A. 1957. Mathematical foundations of information theory. New York: Dover Publications.

    Google Scholar 

  23. Wallace, R. 2018. Carl von Clausewitz, the Fog-of-War, and the AI Revolution: The real world is not a game of Go. New York: Springer.

    Book  Google Scholar 

  24. Wallace, R. 2018. New statistical models of nonergodic cognitive systems and their pathologies. Journal of Theoretical Biology 436: 72–78.

    Article  Google Scholar 

  25. Feynman, R. 2000. Lectures on computation. New York: Westview Press.

    Google Scholar 

  26. Champagnat, N., R. Ferriere, and S. Meleard. 2006. Unifying evolutionary dynamics: From individual stochastic process to macroscopic models. Theoretical Population Biology 69: 297–321.

    Article  Google Scholar 

  27. Dembo, A., and O. Zeitouni. 1998. Large deviations and applications, 2nd ed. New York: Springer.

    Book  Google Scholar 

  28. Pettini, M. 2007. Geometry and topology in hamiltonian dynamics and statistical mechanics. New York: Springer.

    Book  Google Scholar 

  29. Weinstein, A. 1996. Groupoids: Unifying internal and external symmetry. Notices of the American Mathematical Association 43: 744–752.

    Google Scholar 

  30. Lyne, J., and H. Howe. 2017. Punctuated equilibrium: Rhetorical dynamics of a scientific controversy, Chapter 6 in Harris, R. (ed.), Landmark essays on Rhetoric of science: Case studies, Second Edition, CRC Press, Boca Raton.

    Google Scholar 

  31. Wallace, R. 2005. Consciousness: A mathematical treatment of the global neuronal workspace model. New York: Springer.

    Google Scholar 

  32. Jullien, F. 2004. A Treatise on Efficacy: Between Western and Chinese thinking. Honolulu: University of Hawaii Press.

    Google Scholar 

  33. Pielou, E.C. 1977. Mathematical ecology. New York: Wiley.

    Google Scholar 

  34. de Groot, S., and P. Mazur. 1984. Nonequilibrium thermodynamics. New York: Dover.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rodrick Wallace .

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Wallace, R. (2020). An Emerging Catastrophe: The Weaponization of Emotional Sentience in AI. In: Cognitive Dynamics on Clausewitz Landscapes. Springer, Cham. https://doi.org/10.1007/978-3-030-26424-6_12

Download citation

Publish with us

Policies and ethics