Deciding How to Decide: Six Key Questions for Reducing AI’s Democratic Deficit
Through its power to “rationalise”, artificial intelligence (AI) is rapidly changing the relationship between people and the state. But to echo Max Weber’s warnings from one hundred years ago about the increasingly rational bureaucratic state, the “reducing” power of AI systems seems to pose a threat to democracy—unless such systems are developed with public preferences, perspectives and priorities in mind. In other words, we must move beyond minimal legal compliance and faith in free markets to consider public opinion as constitutive of legitimising the use of AI in society. In this chapter I pose six questions regarding how public opinion about AI ought to be sought: what we should ask the public about AI; how we should ask; where and when we should ask; why we should ask; and who is the “we” doing the asking. I conclude by contending that while the messiness of politics may preclude clear answers about the use of AI, this is preferable to the “coolly rational” yet democratically deficient AI systems of today.
KeywordsArtificial intelligence Max Weber Legitimacy Bureaucracy Public opinion Digital ethics
Josh Cowls is the recipient of a doctoral scholarship from The Alan Turing Institute.
- Ada Lovelace Institute. 2018. About Us. Retrieved 8 April 2019. https://www.adalovelaceinstitute.org/about-us/.
- ———. n.d. Ada Lovelace Institute. Retrieved 8 April 2019. https://www.adalovelaceinstitute.org/.
- Angwin, Julia, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias. ProPublica. Retrieved 8 April 2019. https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing.
- Asilomar AI Principles. 2017. Principles Developed in Conjunction with the 2017 Asilomar Conference [Benevolent AI 2017].Google Scholar
- Balaram, Brhmie. 2017. The Role of Citizens in Developing Ethical AI – RSA. Retrieved 8 April 2019. https://www.thersa.org/discover/publications-and-articles/rsa-blogs/2017/10/the-role-of-citizens-in-developing-ethical-ai.
- Binns, Reuben, Max Van Kleek, Michael Veale, Ulrik Lyngs, Jun Zhao, and Nigel Shadbolt. 2018. “It’s Reducing a Human Being to a Percentage”; Perceptions of Justice in Algorithmic Decisions.Google Scholar
- Bourdieu, Pierre. 1979. Public Opinion Does Not Exist. Communication and Class Struggle 1: 124–130.Google Scholar
- Brandom, Russell. 2018. Is Google’s $5 Billion Antitrust Fine a Microsoft Moment? The Verge. Retrieved 8 April 2019. https://www.theverge.com/2018/7/18/17587620/google-european-commission-billion-fine-microsoft-antitrust.
- Burr, Christopher, and Nello Cristianini. 2019. Can Machines Read Our Minds? Minds and Machines.Google Scholar
- Cowls, Josh. 2017. AI’s “Trolley Problem” Problem. The Alan Turing Institute. Retrieved 8 April 2019. https://www.turing.ac.uk/blog/ais-trolley-problem-problem.
- Cowls, Josh, Thomas King, Mariarosaria Taddeo, and Luciano Floridi. 2019. Designing AI for Social Good: Seven Essential Factors. SSRN Scholarly Paper. ID 3388669. Rochester: Social Science Research Network.Google Scholar
- Crawford, Kate, and Vladan Joler. 2018. Anatomy of an AI System.Google Scholar
- Dargan, Richard. 2019. Artificial Intelligence Boosts Efficiency and Quality in Radiology Practice. Radiological Society of North America. Retrieved 10 June 2019. https://www.rsna.org/en/news/2019/March/Artificial-Intelligence-Boosts-Efficiency.
- Delacroix, Sylvie. 2017. Taking Turing by Surprise? Designing Autonomous Systems for Morally-Loaded Contexts. . SSRN Scholarly Paper. ID 3025626. Rochester: Social Science Research Network.Google Scholar
- Delcker, Janosch. 2019. Europe’s Silver Bullet in Global AI Battle: Ethics. POLITICO. Retrieved 8 April 2019. https://www.politico.eu/article/europe-silver-bullet-global-ai-battle-ethics/.
- Department for Digital, Culture, Media and Sport. 2019. Centre for Data Ethics (CDEI) 2 Year Strategy. GOV.UK. Retrieved 8 April 2019. https://www.gov.uk/government/publications/the-centre-for-data-ethics-and-innovation-cdei-2-year-strategy/centre-for-data-ethics-cdei-2-year-strategy.
- Dodd, Vikram. 2017. Met Police to Use Facial Recognition Software at Notting Hill Carnival. The Guardian, August 5.Google Scholar
- European Commission. 2019. Ethics Guidelines for Trustworthy AI. Digital Single Market – European Commission. Retrieved 8 April 2019. https://ec.europa.eu/digital-single-market/en/news/ethics-guidelines-trustworthy-ai.
- Floridi, Luciano, and Cowls, Josh. 2019. A Unified Framework of Five Principles for AI in Society. Harvard Data Science Review.Google Scholar
- Fraser, Nancy. 1990. Rethinking the Public Sphere: A Contribution to the Critique of Actually Existing Democracy. Social Text (25/26): 56–80.Google Scholar
- Gellner, Ernest. 2008. Nations and Nationalism. Santa Barbara: Cornell University Press.Google Scholar
- Golbeck, Jennifer. 2013. Facebook Wants to Know Why You’re Self-Censoring Your Posts. Slate Magazine. Retrieved 8 April 2019. https://slate.com/technology/2013/12/facebook-self-censorship-what-happens-to-the-posts-you-dont-publish.html.
- Habermas, J. 1989. The Structural Transformation of the Public Shere. Boston: MIT Press.Google Scholar
- Hall, Wendy, and Jérôme Pesenti. 2017. Growing the Artificial Intelligence Industry in the UK. Department for Digital, Culture, Media & Sport and Department for Business, Energy & Industrial Strategy. Part of the Industrial Strategy UK and the Commonwealth.Google Scholar
- Harwell, Drew. 2018. Amazon Met with ICE Officials over Facial-Recognition System That Could Identify Immigrants. Washington Post. Retrieved 8 April 2019. https://www.washingtonpost.com/technology/2018/10/23/amazon-met-with-ice-officials-over-facial-recognition-system-that-could-identify-immigrants/.
- Hitrova, Christina. 2019. Turing’s Data Ethics Group Supports the Development of the NHS Code of Conduct for Data-Driven Health and Care Technology. The Alan Turing Institute. Retrieved 8 April 2019. https://www.turing.ac.uk/blog/turings-data-ethics-group-supports-development-nhs-code-conduct-data-driven-health-and-care.
- Hubbard, Alex. 2019. When It Comes to Explaining AI Decisions, Context Matters. Information Commissioner’s Office. Retrieved 10 June 2019. https://ai-auditingframework.blogspot.com/2019/06/when-it-comes-to-explaining-ai.html.
- Hvistendahl, Mara. 2017. In China, a Three-Digit Score Could Dictate Your Place in Society. Wired, December 14.Google Scholar
- International Conference of Data Protection and Privacy Commissioners. 2018. Ethics and Data Protection in Artificial Intelligence. Retrieved 8 April 2019. https://icdppc.org/public-consultation-ethics-and-data-protection-in-artificial-intelligence-continuing-the-debate/.
- Kobie, Nicole. 2019. The Complicated Truth about China’s Social Credit System. Wired UK, January 21.Google Scholar
- Lassman, Peter, and Ronald Speirs. 1994. Weber: Political Writings. Cambridge: Cambridge University Press.Google Scholar
- Leslie, David. 2019. Understanding Artificial Intelligence Ethics and Safety.Google Scholar
- Levinson, Sanford. 2006. How the United States Constitution Contributes to the Democratic Deficit in America. Drake L Review 55: 859.Google Scholar
- Loder, John, and Lydia Nicholas. 2018. Confronting Dr Robot. Nesta. Retrieved 8 April 2019. https://www.nesta.org.uk/report/confronting-dr-robot/.
- McCarthy, J., M. L. Minsky, N. Rochester, and C. E. Shannon. 1955. A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence.Google Scholar
- Miles, Tom. 2018. U.N. Investigators Cite Facebook Role in Myanmar Crisis. Reuters, March 12.Google Scholar
- Montreal Declaration for a Responsible Development of Artificial Intelligence. 2017. Montreal Declaration for a Responsible Development of Artificial Intelligence. Announced at the Conclusion of the Forum on the Socially Responsible Development of AI.Google Scholar
- Moor, James. 2006. The Dartmouth College Artificial Intelligence Conference: The next Fifty Years. AI Magazine 27 (4): 87–87.Google Scholar
- Mouffe, Chantal. 2005. The Return of the Political. Vol. 8. London: Verso.Google Scholar
- O’Connor, Dan. 2018. Can AI Improve Health for Everyone? We Want to Fund Research to Find out | Wellcome. Retrieved 8 April 2019. https://wellcome.ac.uk/news/can-ai-improve-health-everyone-we-want-fund-research-find-out.
- Patel, Reema. 2019. Public Deliberation Could Help Address AI’s Legitimacy Problem in 2019. Retrieved 8 April 2019. https://www.adalovelaceinstitute.org/public-deliberation-could-help-address-ais-legitimacy-problem-in-2019/.
- Penn, Jonnie. 2018. AI Thinks like a Corporation—and That’s Worrying – Open Voices. The Economist. Retrieved 8 April 2019. https://www.economist.com/open-future/2018/11/26/ai-thinks-like-a-corporation-and-thats-worrying.
- Pew Research Center. 2016. Top Voting Issues in 2016 Election. Retrieved 8 April 2019. https://www.people-press.org/2016/07/07/4-top-voting-issues-in-2016-election/.
- Scott, James C. 1998. Seeing like a State: How Certain Schemes to Improve the Human Condition Have Failed. New Haven: Yale University Press.Google Scholar
- Snow, Jackie. 2019. How Africa Is Seizing an AI Opportunity. Fast Company. Retrieved 8 April 2019. https://www.fastcompany.com/90308114/how-africa-is-seizing-an-ai-opportunity.
- Solon, Olivia. 2017. “It’s Digital Colonialism”: How Facebook’s Free Internet Service Has Failed Its Users. The Guardian, July 27.Google Scholar
- Stephens-Davidowitz, Seth. 2013. Dr. Google Will See You Now. The New York Times. Retrieved 8 April 2019. https://www.nytimes.com/2013/08/11/opinion/sunday/dr-google-will-see-you-now.html?rref=collection%2Fbyline%2Fseth-stephens-davidowitz&action=click&contentCollection=undefined®ion=stream&module=stream_unit&version=latest&contentPlacement=16&pgtype=collection.
- The IEEE Initiative on Ethics of Autonomous and Intelligent Systems. 2017. Ethically Aligned Design, V2.Google Scholar
- Tufekci, Zeynep. 2018. YouTube, the Great Radicalizer. The New York Times, June 8.Google Scholar
- Webb, Amy. 2019. Build Democracy into AI. POLITICO. Retrieved 8 April 2019. https://www.politico.eu/article/build-democracy-into-ai-combat-china/.
- Whittaker, Meredith, Kate Crawford, Roel Dobbe, Genevieve Fried, Elizabeth Kaziunas, Varoon Mathur, Sarah Mysers West, Rashida Richardson, Jason Schultz, and Oscar Schwartz. 2018. AI Now Report 2018. AI Now Institute at New York University.Google Scholar
- Wilson, Clare. 2018. Trolley Problem Tested in Real Life for First Time with Mice. New Scientist. Retrieved 8 April 2019. https://www.newscientist.com/article/2168648-trolley-problem-tested-in-real-life-for-first-time-with-mice/.
- Zuboff, Shoshana. 2019. The Age of Surveillance Capitalism: The Fight for the Future at the New Frontier of Power. New York: Profile Books.Google Scholar