Abstract
The solution for content moderation is unlikely to be a choice between human moderation or moderation by artificial intelligence, but rather a combination of the two in the future. In 2020, during the COVID-19 pandemic—while big tech companies were also making their employees work from home and giving artificial intelligence more tasks—“Facebook and Google roughly doubled the amount of potentially harmful material they removed in the second quarter of this year compared with the three months through March”, and there were many more complaints about the decisions as a result, making it clear that human content scrutiny will not be unnecessary for some time. The chapter examines the human moderation and the use of artificial intelligence. “After all, a butt is a butt and a nipple is a nipple. But deciding when a nipple is art, porn or protest gets murky even when humans are doing the deciding. Teaching AI software about human sexual desire is a whole other ballgame.”
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Frieze (2018).
- 2.
Ibid.; It should be added, however, that the events saw a fortunate increase in traffic at Flemish museums during the period, and the agency produced a video mocking Facebook’s policy: Visitflanders (2018).
- 3.
Stapley-Brown (2018).
- 4.
For the interesting case that ended in a settlement between the parties, see Gosztonyi (2022).
- 5.
Dawson (2018).
- 6.
Facebook Community Standards, III.14. Adult nudity and sexual activity.
- 7.
BBC News (2016).
- 8.
NCAC (2019).
- 9.
And Angelo Stagnaro probably misunderstands the process when writing: “Facebook has had a long history of censoring Christian organizations and individuals, flagging our beliefs as being ‘hateful’ or otherwise inappropriate, but it is their actions and inaction that is most accurately branded as hateful.” Stagnaro (2018).
- 10.
Daily Mail Online (2020).
- 11.
Roy (2020).
- 12.
Jenik (2021).
- 13.
- 14.
- 15.
Gillespie (2018), p. 116.
- 16.
Huszár (2022).
- 17.
Interpretative insertion by the author.
- 18.
Koebler and Cox (2018).
- 19.
Ibid., 2018.
- 20.
Joaquin Quiñonero Candela, the company’s Head of Artificial Intelligence, was interviewed about the shortcomings of Facebook and its use of artificial intelligence. Hao (2021).
- 21.
Dias Oliva (2020), p. 612.
- 22.
Jillson (2021).
- 23.
Sorbán (2021), pp. 72–73.
- 24.
Balkin (2018), p. 2024.
- 25.
Llansó et al. (2020), pp. 2–3.
- 26.
Huszár (2021), p. 34.
- 27.
Nlc.hu (2018).
- 28.
- 29.
Newton (2019b).
- 30.
Hvg.hu (2019).
- 31.
Ruckenstein and Turunen (2020), pp. 1026–1042.
- 32.
Gillespie (2020), p. 2.
- 33.
Scott and Kayali (2020).
- 34.
Barker and Murphy (2020).
- 35.
UNHRC (2018), p. 64.
- 36.
Turner Lee et al. (2019).
- 37.
Cambridge Consultants (2019), p. 5.
- 38.
Ibid., pp. 6–8.
References
Balkin JM (2018) Free speech is a triangle. Columbia Law Rev 118(7)
Barker A, Murphy H (2020) YouTube reverts to human moderators in fight against misinformation. Financial Times, 20 September. https://www.ft.com/content/e54737c5-8488-4e66-b087-d1ad426ac9fa/
BBC News (2016) Denmark: Facebook blocks Little Mermaid over ‘bare skin’. BBC News, 4 January. https://www.bbc.com/news/blogs-news-from-elsewhere-35221329/
Buni C, Chemaly S (2016) The secret rules of the internet. The murky history of moderation, and how it’s shaping the future of free speech. The Verge, 13 April. https://www.theverge.com/2016/4/13/11387934/internet-moderator-history-youtube-facebook-reddit-censorship-free-speech/
Cambridge Consultants (2019) Use of AI in online content moderation. Ofcom, 18 July. https://www.ofcom.org.uk/__data/assets/pdf_file/0028/157249/cambridge-consultants-ai-content-moderation.pdf
Daily Mail Online (2020) Do naked bodies belong on Facebook? Tech giant struggles with changing ‘vague and unevenly enforced’ rules over nudity and body art without suppressing freedom of speech. Daily Mail Online, 15 January. https://www.dailymail.co.uk/sciencetech/article-7890913/Does-naked-body-belong-Facebook-It-s-complicated.html/
Dawson A (2018) Facebook censors 30,000 year-old Venus of Willendorf as ‘pornographic’. The Art Newspaper, 27 February. https://www.theartnewspaper.com/news/facebook-censors-famous-30-000-year-old-nude-statue-as-pornographic/
Dias Oliva T (2020) Content moderation technologies: applying human rights standards to protect freedom of expression. Hum Rights Law Rev 20(4)
Facebook Community Standards, https://transparency.fb.com/policies/community-standards/
Frieze (2018) Facebook censors Rubens Paintings for nudity. Frieze, 24 July. https://www.frieze.com/article/facebook-censors-rubens-paintings-nudity/
Gillespie T (2018) Custodians of the internet: platforms, content moderation, and the hidden decisions that shape social media. Yale University Press, New Haven
Gillespie T (2020) Content moderation, AI, and the question of scale. Big Data Soc 7(2)
Gosztonyi G (2022) Nyolc évnyi pereskedés egy női nemiszervért, avagy Facebook, cenzúra, meztelenség, művészet (Eight years of litigation over a female genital organ – Facebook, censorship, nudity, art). JOG.történet. 2 May. https://mtajogtortenet.elte.hu/blog/gosztonyi-gergely-facebook-meztelenseg
Hao K (2021) How Facebook got addicted to spreading misinformation. MIT Technology Review, 11 March. https://www.technologyreview.com/2021/03/11/1020600/facebook-responsible-ai-misinformation/
Huszár D (2021) A véleménynyilvánítás és kifejezés szabadsága a közösségi média platformjain (Freedom of opinion and expression on social media platforms). Média Kábel Műhold 25(4)
Huszár D (2022) Az algoritmusalapú tartalommoderálás kezdete, jelene és jövője (The beginnings, present and future of algorithm-based content management). Joghistória 27(2)
Hvg.hu (2019) Mégis megszólalt a Facebook: így dolgoznak a bejegyzéseinket átnéző moderátorok (Facebook has spoken: this is how moderators reviewing our posts work). hvg.hu, 29 July. https://hvg.hu/tudomany/20180728_facebook_moderator_bejegyzesek_ellenorzese/
Jenik C (2021) A minute on the internet in 2021. statista.com, 30 July. https://www.statista.com/chart/25443/estimated-amount-of-data-created-on-the-internet-in-one-minute/
Jillson E (2021) Aiming for truth, fairness, and equity in your company’s use of AI. ftc.gov, 19 Apr. https://www.ftc.gov/news-events/blogs/business-blog/2021/04/aiming-truth-fairness-equity-your-companys-use-ai/
Koebler J, Cox J (2018) The impossible job: inside Facebook’s struggle to moderate two billion people. Vice, 23 August. https://www.vice.com/en/article/xwk9zd/how-facebook-content-moderation-works/
Llansó E, van Hoboken J, Leerssen P, Harambam J (2020) Artificial intelligence, content moderation, and freedom of expression. Working paper of the Transatlantic Working Group on content moderation online and freedom of expression, 26 February. https://www.ivir.nl/publicaties/download/AI-Llanso-Van-Hoboken-Feb-2020.pdf
MacKinnon R (2013) Consent of the networked. The worldwide struggle for internet freedom. Basic Books, New York
NCAC (2019) Facebook agrees to reconsider artistic nudity policies. NCAC, 5 June. https://ncac.org/news/facebook-agrees-to-reconsider-artistic-nudity-policies/
Newton C (2019a) The trauma floor. The secret lives of Facebook moderators in America. The Verge, 25 February. https://www.theverge.com/2019/2/25/18229714/cognizant-facebook-content-moderator-interviews-trauma-working-conditions-arizona/
Newton C (2019b) Read the full transcript of Mark Zuckerberg’s leaked internal Facebook meetings. The Verge, 1 October. https://www.theverge.com/2019/10/1/20892354/mark-zuckerberg-full-transcript-leaked-facebook-meetings/
Nlc.hu (2018) Nyilvánosak a Facebook moderálási alapelvei (Facebook’s moderation policy is public). nlc.hu, 24 April. https://nlc.hu/szabadido/20180424/facebook-moderalasi-alapelvek-nyilvanos-fellebbezes/
Pintér M (2018) Ha a Facebook egy ország, itt az új alkotmánya (If Facebook is a country, here is its new constitution). 24.hu, 24 April. https://24.hu/tech/2018/04/24/facebook-uj-szabalyzat-community-standard/
Roy AS (2020) How does Facebook handle the 4+ petabyte of data generated per day? Cambridge Analytica – Facebook data scandal. Medium, 16 September. https://medium.com/@srank2000/how-facebook-handles-the-4-petabyte-of-data-generated-per-day-ab86877956f4/
Ruckenstein M, Turunen LLM (2020) Re-humanizing the platform: content moderators and the logic of care. N Media Soc 22(6)
Scott M, Kayali L (2020) What happened when humans stopped managing social media content. Politico, 21 October. https://www.politico.eu/article/facebook-content-moderation-automation/
Sorbán K (2021) Ethical and legal implications of using AI-powered recommendation systems in streaming services. Információs Társadalom 21(2)
Stagnaro A (2018) Facebook censors image of Santa Kneeling before our Lord. National Catholic Register, 26 December. https://www.ncregister.com/blog/facebook-censors-image-of-santa-kneeling-before-our-lord/
Stapley-Brown V (2018) Paris court hears arguments in Facebook censorship case centering on Courbet’s origin of the world. The Art Newspaper, 2 February. https://www.theartnewspaper.com/news/paris-court-hears-arguments-in-facebook-censorship-case-centering-on-courbet-s-origin-of-the-world/
Turner Lee N, Resnick P, Barton G (2019) Algorithmic bias detection and mitigation: best practices and policies to reduce consumer harms. Brookings Institution, 22 May. https://www.brookings.edu/research/algorithmic-bias-detection-and-mitigation-best-practices-and-policies-to-reduce-consumer-harms/
UNHRC (2018) Report of the Special Rapporteur on the promotion and protection of the right to freedom of opinion and expression. UN Doc A/HRC/38/35
Visitflanders (2018) Social media doesn’t want you to see Rubens’ paintings. 21 July. https://www.youtube.com/watch?v=UZq3cVgU5AI/
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Gosztonyi, G. (2023). Human and Technical Aspect of Content Management. In: Censorship from Plato to Social Media. Law, Governance and Technology Series, vol 61. Springer, Cham. https://doi.org/10.1007/978-3-031-46529-1_8
Download citation
DOI: https://doi.org/10.1007/978-3-031-46529-1_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-46528-4
Online ISBN: 978-3-031-46529-1
eBook Packages: Law and CriminologyLaw and Criminology (R0)