Abstract
As the information environment is evolving, so are its manipulative uses. Hence, this chapter will focus on so-called synthetic media, produced by employing techniques such as Deep Learning. This class of media includes, e.g., deepfakes, Extended Reality applications, and (some) virtual influencers. To assess emergent threats, this chapter will first discuss the nature of Information Warfare and its connections with changes in the information ecosystem, before moving to the main relevant types of synthetic media, discussing their potential Information Warfare uses and weighing their pros and cons, subsequently evaluating the likelihood of nefarious use by Russia and other aggressive states.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Adamsky, D. (2018). From Moscow with coercion: Russian deterrence theory and strategic culture. Journal of Strategic Studies,41(1–2), 33–60.
Aro, J. (2016). The cyberspace war: Propaganda and trolling as warfare tools. European View,15, 121–132.
Bailenson, J. (2018). Experience on demand: What virtual reality is, how it works, and what it can do. New York and London: W. W. Norton and Company.
Benkler, Y., Faris, R., & Roberts, H. (2018). Network propaganda: Manipulation, disinformation, and radicalization in American politics. Oxford and New York: Oxford University Press.
Bergendorff, C. L. (2019, July 6). Why I’d invest in a robot teenager: An investor’s perspective on CGI influencers. Medium. Retrieved November 12, 2020, from https://medium.com/swlh/why-id-invest-in-a-robot-teenager-an-investor-s-perspective-on-cgi-influencers-6269455b695.
Bokša, M. (2019). Russian information warfare in Central and Eastern Europe: Strategies, impact, countermeasures. The German Marshall Fund of the United States Policy Paper. Retrieved November 13, 2020, from https://www.gmfus.org/file/27616/download.
Bradley, S. (2020, March 20). Even better than the real thing? Meet the virtual influencers taking over your feeds. The Drum. Retrieved November 12, 2020, from https://www.thedrum.com/news/2020/03/20/even-better-the-real-thing-meet-the-virtual-influencers-taking-over-your-feeds.
Braun, A. (2019, February 14). Security, privacy, virtual reality: How hacking might affect VR and AR. IOT Tech Trends. Retrieved November 11, 2020, from https://www.iottechtrends.com/how-hacking-affect-vr-ar/.
Charlet, K., & Citron, D. (2019, September 5). Campaigns must prepare for deepfakes: This is what their plan should look like. Carnegie Endowment for International Peace. Retrieved November 11, 2020, from https://carnegieendowment.org/2019/09/05/campaigns-must-prepare-for-deepfakes-this-is-what-their-plan-should-look-like-pub-79792.
Chesney, R., & Citron, D. (2019). Deepfakes and the new disinformation war: The coming of age of post-truth geopolitics. Foreign Affairs,98(1), 147–155.
Collange, J., & Guegan, J. (2020). Using virtual reality to induce gratitude through virtual social interaction. Computers in Human Behavior, 113. 10.1016/j.chb.2020.106473.
Constine, J. (2020). ByteDance and TikTok have secretly built a deepfakes maker. TechCrunch, 3 January. Retrieved February 10 2020, from https://techcrunch.com/2020/01/03/tiktok-deepfakes-face-swap/.
Cook, J. (2020, January 29). Brands are building their own virtual influencers. Are their posts legal? Huffpost. Retrieved November 12, 2020, from https://www.huffpost.com/entry/virtual-instagram-influencers-sponcon_n_5e31cbefc5b6328af2ef97fd.
Cruz, L. (2019, October 09). Pixel power: Brand ambassadors go virtual and viral. Cisco. Retrieved November 12, 2020, from https://newsroom.cisco.com/feature-content?type=webcontentandarticleId=2021742.
Delibasic, S. (2018, August 17). Meet the ‘Disturbing’ rise of virtual influencers faking their way into our Instagram feeds. The New Daily. Retrieved November 12, 2020, from https://thenewdaily.com.au/life/tech/2018/08/17/cgi-virtual-influencers/.
Di Pietro, R., et al. (2021). New Dimensions Of Information Warfare. Cham: Springer Nature.
Forsey, C. (2019, September 18). These influencers are computer-generated: The Future of marketing, or untrustworthy advertising? Hubspot. Retrieved November 12, 2020, from https://blog.hubspot.com/marketing/virtual-influencers.
Galston, W. A. (2020, January 8). Is seeing still believing? The deepfake challenge to truth in politics. Brookings. Retrieved February 7, 2020, from https://www.brookings.edu/research/is-seeing-still-believing-the-deepfake-challenge-to-truth-in-politics/.
Ghosh, D., & Scott, B. (2018). #Digitaldeceit: The technologies behind precision propaganda on the internet. Washington, D.C.: New America.
Giles, K., Hartmann, K., & Mustaffa, M. (2019). The role of deepfakes in malign influence campaigns. Riga: NATO StratCom COE.
Gräve, J.-F. (2019). What KPIs are key? Evaluating performance metrics for social media influencers. Social Media + Society. 10.1177/2056305119865475.
Greengard, S. (2019). Virtual reality. Cambridge (MA) and London: The MIT Press.
Greengard, S. (2020). Will deepfakes do deep damage? Society 63(1), 17–19.
Griffin, T., & Muldoon, M. (2020). Exploring virtual reality experiences of slum tourism. Tourism Geographies. https://doi.org/10.1080/14616688.2020.1713881.
Haile, J. (2020, September 18). What are the ethical implications of CGI influencers promoting brands? Talking Influence. Retrieved November 12, from https://talkinginfluence.com/2020/09/18/ethical-implications-cgi-influencers/.
Hall, K. H. (2018). Deepfake videos: When seeing isn’t believing. Catholic University Journal of Law and Technology,27(1), 51–76.
Hall, S., & Takahashi, R. (2017, October). Augmented and virtual reality: The promise and peril of immersive technologies. McKinsey and Company. Retrieved November 11, 2020, from https://www.mckinsey.com/industries/technology-media-and-telecommunications/our-insights/augmented-and-virtual-reality-the-promise-and-peril-of-immersive-technologies.
Hudson, S., et al. (2019). With or without you? Interaction and immersion in a virtual reality experience. Journal of Business Research,100, 459–468.
Joseph, R. (2019). Fakebusters strike back. Index on Censorship,48(1), 76–79.
Kalpokas, I. (2021). Problematising reality: The promises and peris of synthetic media. SN Social Sciences,1(1), 1–11.
Leighton, H. (2019, November 26). What it means for virtual Instagram influencers’ popularity rising. Forbes. Retrieved November 12, 2020, from https://www.forbes.com/sites/heatherleighton/2019/11/26/what-it-means-for-virtual-instagram-influencers-popularity-rising/#1d9d67a86e09.
Leung, X. Y., Lyu, J., & Bai, B. (2020). A fad or the future? Examining the effectiveness of virtual reality advertising in the hotel industry. International Journal of Hospitality Management, 88. 10.1016/j.ijhm.2019.102391.
Luthera, N. (2020, January 16). The dark side of deepfake artificial intelligence and virtual influencers. Forbes. Retrieved November 12, 2020, from https://www.forbes.com/sites/forbesbusinesscouncil/2020/01/16/the-dark-side-of-deepfake-artificial-intelligence-and-virtual-influencers/#23bafcf21cd9.
Marr, B. (2019, July 17). The important risks and dangers of virtual and augmented reality. Forbes. Retrieved November 11, 2020, from https://www.forbes.com/sites/bernardmarr/2019/07/17/the-important-risks-and-dangers-of-virtual-and-augmented-reality/#3509078c3d50.
Martineu, P. (2019, December 20). Facebook removes accounts with AI-generated profile photos. Wired. Retrieved November 11, 2020, from https://www.wired.com/story/facebook-removes-accounts-ai-generated-photos/.
McLean, G., & Wilson, A. (2019). Shopping in the digital world: Examining customer engagement through augmented reality mobile applications. Computers in Human Behavior,10, 210–224.
Mukherjee, S. (2018). Playing subaltern: Video games and postcolonialism. Games and Culture,13(5), 504–520.
Pan, X., & Hamilton, A. F. C. (2018). Why and how to use virtual reality to study human social interaction: The challenges of exploring a new research landscape. British Journal of Psychology,109, 395–417.
Park, C. S. (2019). Does too much news on social media discourage news seeking? Mediating role of news efficacy between perceived news overload and news avoidance on social media. Social Media + Society. https://doi.org/10.1177/2056305119872956.
Paul, C., & Posard, M. N. (2020). Artificial intelligence and the manufacturing of reality. The RAND Blog. Retrieved November 11, 2020, from https://www.rand.org/blog/2020/01/artificial-intelligence-and-the-manufacturing-of-reality.html.
Polyakova, A. (2018, November 15). Weapons of the Weak: Russia and AI-driven asymmetric warfare. The Brookings Institution. Retrieved November 14, 2020, from https://www.brookings.edu/research/weapons-of-the-weak-russia-and-ai-driven-asymmetric-warfare/.
Powers, K. (2019, June 20). Virtual influencers are becoming more real: Here’s why brands should be cautious. American Marketing Association. Retrieved November 12, 2020, from https://www.ama.org/marketing-news/virtual-influencers-are-becoming-more-real-heres-why-brands-should-be-cautious/.
Pynnöniemi, K. (2019). Information-psychological warfare in russian security strategy. In R. E. Kanet (Ed.), Routledge handbook of Russian security (pp. 214–226). London and New York: Routledge.
Rauschnabel, P. A., Felix, R., & Hinsch, C. (2019). Augmented reality marketing: How Mobile AR-apps can improve brands through inspiration. Journal of Retailing and Consumer Services,49, 43–53.
Riparbelli, V. (2019). Our vision for the future of synthetic media. Medium. Retrieved November 11, 2020, from https://medium.com/@vriparbelli/our-vision-for-the-future-of-synthetic-media-8791059e8f3a#:~:text=Synthetic%20media%20will%20significantly%20accelerate,digital%20realm%20begins%20and%20ends.
Riva, G., Wiederhold, B. K., & Mantovani, F. (2019). Neuroscience of virtual reality: From virtual exposure to embodied medicine. Cyberpsychology, Behavior, and Social Networking,22(1), 82–98.
Robinson, B. (2020). Towards an ontology and ethics of virtual influencers. Australasian Journal of Information Systems,24, 1–8.
Robinson, L., et al. (2019) The growing need to focus on modern political warfare. RAND Research Brief. Retrieved November 13, 2020, from https://www.rand.org/pubs/research_briefs/RB10071.html.
Russell, S. (2020). Human compatible: AI and the problem of control. London: Penguin Books.
Schick, N. (2020). Deepfakes and the infocalypse: What you urgently need to know. London: Monoray.
Scholz, J., & Duffy, K. (2018). We are at home: How augmented reality reshapes mobile marketing and consumer-brand relationships. Journal of Retailing and Consumer Services,44, 11–23.
Simonite, T. (2019, September 4). Forget politics: For now, deepfakes are for bullies. Wired. Retrieved November 11, 2020, from https://www.wired.com/story/forget-politics-deepfakes-bullies/.
Sokolov, M. (2019, December 5). Virtual influencer trends: An overview of the industry. The Drum. Retrieved November 12, 2020, from https://www.thedrum.com/opinion/2019/12/05/virtual-influencer-trends-overview-the-industry.
Spangler, T. (2020, May 6). Miquela, the uncanny CGI influencer, signs with CAA. Variety. Retrieved November 12, 2020, from https://variety.com/2020/digital/news/miquela-virtual-influencer-signs-caa-1234599368/.
Steffen, J. H., et al. (2019). Framework of affordances for virtual reality and augmented reality. Journal of Management Information Systems,36(3), 683–729.
Tashev, B., Purcell, M., & McLaughlin, B. (2019). Russia’s information warfare: Exploring the cognitive dimension. MCU Journal,10(2), 129–147.
Thomas, Z. (2020, April 19). Coronavirus: Will Covid-19 speed up the use of robots to replace human workers? BBC. Retrieved November 11, 2020, from https://www.bbc.com/news/technology-52340651.
Thornton, R., & Miron, M. (2020). Towards the ‘Third Revolution in Military Affairs’: The Russian military’s use of AI-enabled cyber warfare. The RUSI Journal,165(3), 12–21.
Torossian, R. (2020, March 25). The risks—And benefits—Of working with virtual influencers. Agility PR Solutions. Retrieved November 12, 2020, from https://www.agilitypr.com/pr-news/public-relations/the-risks-and-benefits-of-working-with-virtual-influencers/.
Tussyadiah, I. P., et al. (2018). able. Tourism Management,66, 140–154.
Vaccari, C., & Chadwick, A. (2020). Deepfakes and disinformation: Exploring the impact of synthetic political video on deception, uncertainty, and trust in news. Social Media + Society. https://doi.org/10.1177/2056305120903408.
Van de Weghe, T. (2019, May 30). Six lessons from my deepfakes research at stanford. Medium. Retrieved November 11, 2020, from https://medium.com/jsk-class-of-2019/six-lessons-from-my-deepfake-research-at-stanford-1666594a8e50.
Vogue Business (2020, June 16). Brands eye China’s virtual idols. Retrieved November 12, 2020, from https://www.voguebusiness.com/technology/china-virtual-influencers.
Webster, A. (2020, August 31). IKEA turned a virtual influencer into a physical installation. The Verge. Retrieved November 12, 2020, from https://www.theverge.com/2020/8/31/21408626/ikea-tokyo-imma-virtual-influencer.
Williams, R. (2020, April 6). WHO enlists virtual influencer for COVID-19 prevention campaign. Mobile Marketer. Retrieved November 11, 2020, from https://www.mobilemarketer.com/news/who-enlists-virtual-influencer-for-covid-19-prevention-campaign/575493/.
Woolley, S. (2020). The reality game: How the next wave of technology will break the truth and what we can do about it. London: Endeavour.
Yates, K. (2020, May 29). The lucrative rise of the virtual influencer. Vice. Retrieved November 12, 2020, from https://www.vice.com/en_uk/article/xg8xdd/liam-nikuro-imma-lil-miquela-virtual-influencers.
Young, N. (2019). Deepfake technology: Complete guide to deepfakes, politics and social media. Independently published by Amazon.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Kalpokas, I., Kalpokiene, J. (2021). Synthetic Media and Information Warfare: Assessing Potential Threats. In: Mölder, H., Sazonov, V., Chochia, A., Kerikmäe, T. (eds) The Russian Federation in Global Knowledge Warfare. Contributions to International Relations. Springer, Cham. https://doi.org/10.1007/978-3-030-73955-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-73955-3_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-73954-6
Online ISBN: 978-3-030-73955-3
eBook Packages: Political Science and International StudiesPolitical Science and International Studies (R0)