Abstract
This chapter examines the current state of the art in the implementation of virtual reality technologies in the public sector, specifically focusing on the metaverse space developed for the Ionian Film Office. It will highlight the perspectives of various stakeholders, such as users, designers, employees, visitors, and technicians, who engage with these systems, addressing both the opportunities and limitations that arise. In addition, the chapter explores the potential of sensory enhancement as a means to elevate user experiences within the metaverse. By discussing advancements in haptic, auditory, scent, and visual technologies, we aim to provide an overview of how such sensory enrichment can create more immersive and interactive experiences for users. Furthermore, we will delve into the challenges and ethical considerations of implementing these technologies in the public sector, taking into account issues like accessibility, privacy, and safety. Through the lens of the Ionian Film Office metaverse, we will showcase both the current state and future possibilities of virtual and augmented reality technologies. By offering insights into the evolution of sensory enhancement, this chapter aims to serve as a valuable resource for researchers, designers, and policymakers interested in harnessing the power of the metaverse to transform the public sector.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Spielberg et al. Ready player one. Warner Bros., United States.
- 2.
- 3.
The Internet of Senses (IoS) is a term coined by Ericsson's ConsumerLab to represent sensory experiences similar to those of the physical world with the contribution of 6G. The IoS is a projected future network where humans can transmit and share their sensory experiences, including smells, tastes, and tactile sensations, over the internet. It aims to merge the physical and digital worlds by creating more immersive, multi-sensory online experiences that align with human perception and cognition (Panagiotakopoulos et al. 2022).
- 4.
The traditionally recognized list of five senses includes sight, hearing, touch, taste, and smell. Aristotle's categorization 2000 years ago is now recognized as an inadequate classification because it omits other types of experience (Garcia-Ruiz et al. 2021).
- 5.
Anticipated advancements in 6G entail terabit speeds and elevated frequencies within the terahertz (THz) band (0.1–10 THz), delivering data rates exceeding one hundred gigabits per second (Gbps). THz bands and millimeter waves (mmWave) are perceived as pivotal catalysts for the development of 6G technology systems, with terabits per second (Tbps) becoming imperative to meet the demanding specifications of diverse potential 6G applications. For instance, the creation of digital twins through the transmission of 3D images aims to achieve speeds reaching 1Tbps (Panagiotakopoulos et al. 2022).
- 6.
The three waves of smell in HCI. The First Wave (1900–1960s) occurred primarily in the cinematic arts. The Second Wave (1990–2000s) emerged alongside the advent of the World Wide Web. Technologists and researchers spearheaded attempts to remotely transmit sensory experiences, including scent to enrich desktop experiences. The Third Wave can include advancements in multisensory interfaces and efforts to digitize smell sensations (i.e., via the trigeminal nerve). The COVID-19 pandemic has brought increased attention to the importance of the sense of smell, inviting the question of whether these developments herald a lasting trend in HCI or a temporary wave that will soon recede (Brooks et al. 2023).
- 7.
- 8.
Smell-O-Vision under the patented name “MOTON PICTURES WITH SYNCHRONIZED ODOR EMISSION” was an invention (First Patent No. 2,813,452 issued November 19, 1957, and second Patent No. 2,905,049 issued September 22, 1959) related particularly to apparatus for distributing odors in timed sequence concerning a motion picture film.
- 9.
Sensorama Simulator was an invention of Morton Leonard Heilig that was patented in 1962 (Patent No. 3,050,870) and relates to a simulator to stimulate the senses of a user giving him an actual and realistic experience.
References
Alcañiz M, Bigné E, Guixeres J (2019) Virtual reality in marketing: a framework, review, and research agenda. Front Psychol. https://doi.org/10.3389/fpsyg.2019.01530
Anderson J, Rainie L (2022) The metaverse in 2040. In: Pew research center: internet, science & tech. https://www.pewresearch.org/internet/2022/06/30/the-metaverse-in-2040/. Accessed on 24 Sep 2023
Awadallah AM, Damiani E, Zemerly J, Yeun CY (2023) Identity threats in the metaverse and future research opportunities. In: 2023 international conference on business analytics for technology and security (ICBATS). https://doi.org/10.1109/icbats57792.2023.10111122
Ball M (2021) Framework for the metaverse. In: MatthewBall.co. https://www.matthewball.vc/all/forwardtothemetaverseprimer. Accessed on 30 Oct 2023
Ball M (2022) A brief history of the future. In: THE METAVERSE: and how it will revolutionize everything. WW Norton
Bhattacharya P, Saraswat D, Savaliya D et al (2023) Towards future internet: the metaverse perspective for diverse industrial applications. Mathematics 11:1–41. https://doi.org/10.3390/math11040941
Bloomberg (2022) Metaverse may be $800 billion market, next tech platform. In: Bloomberg.com. https://www.bloomberg.com/professional/blog/metaverse-may-be-800-billion-market-next-tech-platform/. Accessed on 30 Oct 2023
Bordegoni M, Carulli M, Ferrise F (2019) Improving multisensory user experience through olfactory stimuli. Emot Eng 7:201–231. https://doi.org/10.1007/978-3-030-02209-9_13
Brooks J, Nagels S, Teng S-Y et al. (2021) Demonstrating trigeminal-based interfaces. In: Extended abstracts of the 2021 CHI conference on human factors in computing systems. https://doi.org/10.1145/3411763.3451551
Brooks J, Lopes P, Obrist M et al. (2023) Third wave or winter? the past and future of smell in HCI. In: Extended abstracts of the 2023 CHI conference on human factors in computing systems. https://doi.org/10.1145/3544549.3583749
Carr M, Haar A, Amores J et al (2020) Dream engineering: simulating worlds through sensory stimulation. Conscious Cogn 83:1–19. https://doi.org/10.1016/j.concog.2020.102955
Cheng R, Wu N, Chen S, Han B (2022) Will metaverse be NextG internet? vision, hype, and reality. IEEE Netw 36:197–204. https://doi.org/10.1109/mnet.117.2200055
Cheok A, Karunanayaka K (2018a) Discussion and conclusion. human–computer interaction series 119-124.https://doi.org/10.1007/978-3-319-73864-2_7
Cheok A, Karunanayaka K (2018b) Electric taste. human–computer interaction series 49–68.https://doi.org/10.1007/978-3-319-73864-2_4
Cheok AD, Karunanayaka K (2018c) Digital smell interface. Hum Comput Interact Series 93–117. https://doi.org/10.1007/978-3-319-73864-2_6
Cheong BC (2022) Avatars in the metaverse: potential legal issues and remedies. Int Cybersecur Law Rev 3:467–494. https://doi.org/10.1365/s43439-022-00056-9
Chinie C, Oancea M, Todea S (2022) The adoption of the metaverse concepts in Romania. Manage Market Chall Knowl Soc 17:328–340. https://doi.org/10.2478/mmcks-2022-0018
Christensen L, Robinson A (2022) The potential global economic impact of the metaverse. In: Analysis group. https://www.analysisgroup.com/Insights/publishing/the-potential-global-economic-impact-of-the-metaverse/. Accessed on 28 Oct 2023
Cook AV, Bechtel M, Anderson S et al (2020) The spatial web and web 3 . In: Deloitte. https://www2.deloitte.com/content/dam/insights/us/articles/6645_Spatial-web-strategy/DI_Spatial-web-strategy.pdf. Accessed on 13 Oct 2023
Council of the European Union (2022a) Metaverse—virtual world, real world challenges. In: Council of the European Union. https://www.consilium.europa.eu/media/54987/metaverse-paper-9-march-2022.pdf. Accessed on 11 Oct 2023
Council of the European Union (2022b) The Metaverse in the context of the fight against terrorism. In: Council of the European Union. https://data.consilium.europa.eu/doc/document/ST-9292-2022-INIT/en/pdf
Covaci A, Saleme EB, Mesfin G et al (2023) Multisensory 360° videos under varying resolution levels enhance presence. IEEE Trans Visual Comput Graph 29:2093–2101. https://doi.org/10.1109/tvcg.2022.3140875
da Silveira AC, Rodrigues EC, Saleme EB et al (2023) Thermal and wind devices for multisensory human-computer interaction: an overview. Multimedia Tools Appl 82:34485–34512. https://doi.org/10.1007/s11042-023-14672-y
Duan H, Li J, Fan S et al. (2021) Metaverse for social good: a university campus prototype. In: Proceedings of the 29th ACM international conference on multimedia, pp 153–161. https://doi.org/10.1145/3474085.3479238
Dwivedi YK, Hughes L, Baabdullah AM et al (2022) Metaverse beyond the hype: multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy. Int J Inf Manage 66:1–55. https://doi.org/10.1016/j.ijinfomgt.2022.102542
Dwivedi YK, Kshetri N, Hughes L et al (2023) Exploring the Darkverse: a multi-perspective analysis of the negative societal impacts of the metaverse. Inf Syst Front 25:2071–2114. https://doi.org/10.1007/s10796-023-10400-x
Falk TH, Le LB, Morandotti R (2022) The internet of senses: a position paper on the challenges and opportunities of multisensory immersive experiences for the metaverse. In: 2022 IEEE international conference on metrology for extended reality, artificial intelligence and neural engineering (MetroXRAINE). https://doi.org/10.1109/metroxraine54828.2022.9967586
Floridi L (2022) Metaverse: a matter of experience. Philosoph Technol 35:1–7. https://doi.org/10.1007/s13347-022-00568-6
Garcia-Ruiz MA, Kapralos B, Rebolledo-Mendez G (2021) An overview of olfactory displays in education and training. Multimodal Technol Interact 5:64. https://doi.org/10.3390/mti5100064
Giang Barrera K, Shah D (2023) Marketing in the metaverse: conceptual understanding, framework, and research agenda. J Bus Res 155:1–19. https://doi.org/10.1016/j.jbusres.2022.113420
Gutiérrez M, Vexo F, Thalmann D (2008) Smell and taste. Stepp Virt Real 157–161.https://doi.org/10.1007/978-1-84800-117-6_10
Hackl C (2022) Defining the metaverse today. In: Forbes. https://www.forbes.com/sites/cathyhackl/2021/05/02/defining-the-metaverse-today/?sh=74ef019c6448. Accessed on 10 Oct 2023
IMT-2030 (6G) Promotion Group (2021) White paper on 6G vision and candidate technologies. IMT-2030 (6G) Promotion Group. In: CAICT. http://www.caict.ac.cn/english/news/202106/P020210608349616163475.pdf. Accessed on 10 Oct 2023
Jaynes C, Seales WB, Calvert K et al (2003) The Metaverse: a networked collection of inexpensive, self-configuring, immersive environments. Proceed Workshop Virtual Environ 2003:115–124. https://doi.org/10.1145/769953.769967
Jones LA (2018) Haptics. The MIT Press, Cambridge, MA
Karunanayaka K, Cheok AD, Vedadi S (2023) Digital smell: toward electrically reproducing artificial smell sensations. IEEE Access 11:50659–50670. https://doi.org/10.1109/access.2023.3278093
Kaye JN (2001) Symbolic olfactory display. Thesis, Massachusetts Institute of Technology
Kim J (2021) Advertising in the metaverse: research agenda. J Interact Advert 21:141–144. https://doi.org/10.1080/15252019.2021.2001273
Kim DY, Lee HK, Chung K (2023) Avatar-mediated experience in the metaverse: the impact of avatar realism on user-avatar relationship. J Retail Consum Serv 73:1–11. https://doi.org/10.1016/j.jretconser.2023.103382
Kshetri N (2022a) Web 3.0 and the metaverse shaping organizations’ brand and product strategies. IT Professional 24:11–15. https://doi.org/10.1109/mitp.2022.3157206
Kshetri N (2022b) Policy, ethical, social, and environmental considerations of Web3 and the metaverse. IT Professional 24:4–8. https://doi.org/10.1109/mitp.2022.3178509
Kusiak A (2023) Manufacturing metaverse. J Intell Manuf 34:2511–2512. https://doi.org/10.1007/s10845-023-02145-w
Laaroussi Z, Ustundag Soykan E, Liljenstam M et al (2022) On the security of 6G use cases: Threat analysis of “all-senses meeting. In: 2022 IEEE 19th annual consumer communications & networking conference (CCNC). https://doi.org/10.1109/ccnc49033.2022.9700673
Lee L-H, Braud T, Zhou P et al (2021) All one needs to know about metaverse: a complete survey on technological singularity, virtual ecosystem, and research agenda. J Latex Class Files 14:1–66. https://doi.org/10.48550/arXiv.2110.05352
Luan H, Wang Y, Huang L et al. (2023) Multi-sensory consistency experience: a 6-dof simulation system based on video automatically generated motion effects 1–14. https://easychair.org/publications/preprint_open/gR2D. Accessed on 01 Nov 2023
Maggioni E, Cobden R, Dmitrenko D et al (2020) Smell space. ACM Transact Comput Hum Interact 27:1–26. https://doi.org/10.1145/3402449
Maksymyuk T, Gazda J, Volosin M et al (2022) Interfacing the metaverse: are we ready for the distributed wearable smartphone? 1–8. https://doi.org/10.36227/techrxiv.21547002.v1
Marlatt R (2019) Capitalizing on the craze of fortnite: toward a conceptual framework for understanding how gamers construct communities of practice. J Educ 200:3–11. https://doi.org/10.1177/0022057419864531
Marr B (2022) The important difference between Web3 and the metaverse. In: Forbes. https://www.forbes.com/sites/bernardmarr/2022/02/22/the-important-difference-between-web3-and-the-metaverse/?sh=413bad4d5af3. Accessed on 2 Oct 2023
Mourtzis D (2023) The metaverse in industry 5.0: a human-centric approach towards personalized value creation. Encyclopedia 3:1105–1120. https://doi.org/10.3390/encyclopedia3030080
Murer M, Aslan I, Tscheligi M (2013) LOLLio: exploring taste as playful modality. In: Proceedings of the 7th international conference on tangible, embedded and embodied interaction 299–302. https://doi.org/10.1145/2460625.2460675
Mystakidis S (2022) Metaverse. Encyclopedia 2:486–497. https://doi.org/10.3390/encyclopedia2010031
Nakamoto T (2015) Olfactory interfaces. In: The Cambridge handbook of applied perception research, pp 408–424. https://doi.org/10.1017/cbo9780511973017.026
Narumi T, Kajinami T, Tanikawa T, Hirose M (2010) Meta cookie. ACM SIGGRAPH 2010 Emerging Technologies 1. https://doi.org/10.1145/1836821.1836839
Obrist M, Gatti E, Maggioni E et al (2017) Multisensory experiences in HCI. IEEE Multimedia 24:9–13. https://doi.org/10.1109/mmul.2017.33
Omniverse Avatar Cloud Engine Ace (2023) In: NVIDIA developer. https://developer.nvidia.com/omniverse/ace. Accessed 30 Oct 2023
Orús C, Ibáñez-Sánchez S, Flavián C (2021) Enhancing the customer experience with virtual and augmented reality: the impact of content and device type. Int J Hosp Manag 98:1–13. https://doi.org/10.1016/j.ijhm.2021.103019
Panagiotakopoulos D, Marentakis G, Metzitakos R et al (2022) Digital Scent technology: toward the internet of senses and the metaverse. IT Profess 24:52–59. https://doi.org/10.1109/mitp.2022.3177292
Park S-M, Kim Y-G (2022) A metaverse: taxonomy, components, applications, and open challenges. IEEE Access 10:4209–4251. https://doi.org/10.1109/access.2021.3140175
Petit O, Velasco C, Wang QJ, Spence C (2022) Consumer consciousness in multisensory extended reality. Front Psychol 13:1–7. https://doi.org/10.3389/fpsyg.2022.851753
Peyron M-A, Woda A (2016) An update about artificial mastication. Curr Opin Food Sci 9:21–28. https://doi.org/10.1016/j.cofs.2016.03.006
Ranasinghe N, Do EY-L (2016) Digital Lollipop. ACM Trans Multimed Comput Commun Appl 13:1–22. https://doi.org/10.1145/2996462
Ranasinghe N, Jain P, Karwita S, Do EY-L (2017) Virtual lemonade. In: Proceedings of the eleventh international conference on tangible, embedded, and embodied interaction, pp 183–190. https://doi.org/10.1145/3024969.3024977
Rostami S, Maier M (2022) The metaverse and beyond: implementing advanced multiverse realms with smart wearables. IEEE Access 10:110796–110806. https://doi.org/10.1109/access.2022.3215736
Salminen K, Rantala J, Isokoski P et al (2018) Olfactory display prototype for presenting and sensing authentic and synthetic odors. In: Proceedings of the 20th ACM international conference on multimodal interaction, pp 73–77. https://doi.org/10.1145/3242969.3242999
Samshir NA, Johari N, Karunanayaka K, David Cheok A (2016) Thermal sweet taste machine for multisensory internet. In: Proceedings of the fourth international conference on human agent interaction, pp 325–328. https://doi.org/10.1145/2974804.2980503
Samsung Research (2022) White Paper on 6G: The next hyper connected experience for all. In: Samsung research. https://cdn.codeground.org/nsr/downloads/researchareas/6G%20Vision.pdf. Accessed on 09 Oct 2023.
Smart J, Cascio J, Paffendorf J et al. (2007) Pathways to the 3D Web: a cross-industry public foresight project. Metaverse Roadmap, pp 1–28. https://www.w3.org/2008/WebVideo/Annotations/wiki/images/1/19/MetaverseRoadmapOverview.pdf
Spence C, Obrist M, Velasco C, Ranasinghe N (2017) Digitizing the chemical senses: possibilities & pitfalls. Int J Hum Comput Stud 107:62–74. https://doi.org/10.1016/j.ijhcs.2017.06.003
Takahashi D (2015) Second life pioneer philip rosedale shows off virtual toy room in high fidelity. In: GamesBeat. https://venturebeat.com/games/virtual-world-pioneer-philip-rosedale-shows-off-virtual-toy-room-in-high-fidelity/. Accessed on 14 Aug 2023
Tariq S, Abuadbba A, Moore K (2023) Deepfake in the metaverse: Security implications for virtual gaming, meetings, and offices. In: The 2nd Workshop on the security implications of Deepfakes and Cheapfakes. https://doi.org/10.1145/3595353.3595880
Uddin M, Manickam S, Ullah H et al (2023) Unveiling the metaverse: exploring emerging trends, multifaceted perspectives, and future challenges. IEEE Access 11:87087–87103. https://doi.org/10.1109/access.2023.3281303
Velasco C, Obrist M (2020a) The exciting world of multisensory experiences. In: Multisensory experiences: where the senses meet technology. Oxford University Press, pp 1–12. https://doi.org/10.1093/oso/9780198849629.003.0001
Velasco C, Obrist M (2020b) Fundamentals of multisensory experiences. In: Multisensory experiences: where the senses meet technology, pp 13–28. https://doi.org/10.1093/oso/9780198849629.003.0002
Velasco C, Obrist M (2020c) Laws of multisensory experiences. In: Multisensory experiences: where the senses meet technology, pp 71–82. https://doi.org/10.1093/oso/9780198849629.003.0005
Velasco C, Tu Y, Obrist M (2018) Towards multisensory storytelling with taste and flavor. In: Proceedings of the 3rd international workshop on multisensory approaches to human-food interaction. https://doi.org/10.1145/3279954.3279956
Velasco C, Obrist M (2021) Multisensory experiences: a primer. Front Comput Sci 3:1–6. https://doi.org/10.3389/fcomp.2021.614524
Vi CT, Ablart D, Arthur D, Obrist M (2017) Gustatory interface: The challenges of ‘how’ to stimulate the sense of taste. In: Proceedings of the 2nd acm sigchi international workshop on multisensory approaches to human-food interaction, pp 29–33. https://doi.org/10.1145/3141788.3141794
Wang J, Erkoyuncu J, Roy R (2018) A conceptual design for smell based augmented reality: case study in maintenance diagnosis. Procedia CIRP 78:109–114. https://doi.org/10.1016/j.procir.2018.09.067
Wang Y, Su Z, Zhang N et al (2023) A survey on Metaverse: fundamentals, security, and privacy. IEEE Commun Surv Tut 25:319–352. https://doi.org/10.1109/comst.2022.3202047
Xu M, Ng WC, Lim WY et al (2022) A full dive into realizing the edge-enabled metaverse: visions, enabling technologies, and challenges. IEEE Commun Surv Tut 25:656–700. https://doi.org/10.1109/comst.2022.3221119
Yanagida Y, Tomono A (2013) Basics for olfactory display. Hum Olfactory Displ Interf 60–85. https://doi.org/10.4018/978-1-4666-2521-1.ch003
Zalan T, Barbesino P (2023) Making the metaverse real. Digit Bus 3:1–7. https://doi.org/10.1016/j.digbus.2023.100059
Acknowledgements
The co-author, Dimitrios Panagiotakopoulos, acknowledges the support of the development activities of the University of West Attica by strengthening the services of the Financial and Administrative Support Unit of the Special Research Funds Account (ΕΛΚΕ ΠαΔΑ), the promotion and support of research results and the strengthening of the University’s educational activities, in application of paragraph B of the paragraph of article 132 of Law 4763/2020. Project code: 80993. The creation of the Ionian Film Office was made possible through the financial support of the project HAL (Hub of Art Laboratories) *MIS:5047267* (code 80504, ESPA 2014-2020, EPANEK), co-financed by Greece and the European Union and is implemented by the Ionian University in Corfu.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Deliyannis, I., Panagopoulos, I., Panagiotakopoulos, D., Marentakis, G., Metzitakos, R. (2024). The Sensory Enrichment and Interactivity of Immersive User Experiences in the Public Sector: The Ionian Film Office Metaverse. In: Geroimenko, V. (eds) Augmented and Virtual Reality in the Metaverse. Springer Series on Cultural Computing. Springer, Cham. https://doi.org/10.1007/978-3-031-57746-8_9
Download citation
DOI: https://doi.org/10.1007/978-3-031-57746-8_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-57745-1
Online ISBN: 978-3-031-57746-8
eBook Packages: Computer ScienceComputer Science (R0)