Improving Multisensory User Experience Through Olfactory Stimuli

  • Monica BordegoniEmail author
  • Marina Carulli
  • Francesco Ferrise


More and more modern digital applications allow users to make experiences that elicit their senses. More traditional applications allow users to make visual and sound experiences. Recently, the sense of touch has been introduced to enrich the users’ experiences with digital worlds. The sense of smell is equally important for enriching and making the experiences engaging, but has been mostly neglected so far, mostly because of the limited knowledge about olfaction and of olfactory technologies. This chapter presents a methodology for the development of applications including multisensory user experiences based also on the sense of olfaction. The methodology has been used and tested for the development of applications in various sectors, which are reported in the chapter.



The authors gratefully acknowledge the contribution of A. Gallace, M. Gustafsson and T. Pfuhl for contributing to the case study “Wine tasting: a visual–audio–tactile–olfactory experience”; A. Tosin and F. Previtali for contributing to the case study “Walk in the mountains: a visual–audio–tactile–olfactory experience”, L. Cappelli and G. Petrosin for contributing to the case study “Multisensory walk-through in a museum: a visual–sound–olfactory experience” and Y. Shi and D. Ruscio for contributing to the case study “Reading experience: a visual–olfactory experience”.


  1. 1.
    Alam KM, Rahman AS, El Saddik A (2013) Mobile haptic e-book system to support 3D immersive reading in ubiquitous environments. ACM Trans Multimedia Comput Com Appl 9(4)CrossRefGoogle Scholar
  2. 2.
    Bensafi M, Rouby C, Farget V et al (2002) Influence of affective and cognitive judgments on autonomic parameters during inhalation of pleasant and unpleasant odors in humans. Neurosci Lett 319:162–166CrossRefGoogle Scholar
  3. 3.
    Bordegoni M, Carulli M, Shi Y (2016) Investigating the use of smell in vehicle-driver interaction. Proceedings of the ASME design engineering technical conference, smart innovation, systems and technologies 65:513–523.
  4. 4.
    Bordegoni M, Carulli M, Shi Y, Ruscio D (2017) Investigating the effects of odour integration in reading and learning experiences, Interact Des Architect 32:104–125Google Scholar
  5. 5.
    Bordegoni M, Carulli M (2016) Evaluating industrial products in an innovative visual-olfactory environment. J Comput Inf Sci Eng 16(3). Scholar
  6. 6.
    Bosmans A (2006) Scents and sensibility: when do (in)congruent ambient scents influence product evaluations? J Mark 70(3):32–43. Scholar
  7. 7.
    Carulli M, Bordegoni M, Ferrise F, Gallace A, Gustafsson M, Pfuhl T (2018) Simulating multisensory wine tasting experience. In: DS92: Proceedings of the DESIGN 2018 15th international design conference, pp 2177–2186Google Scholar
  8. 8.
    Carulli M, Tosin A, Previtali F, Ferrise F, Bordegoni M (2018) Simulating A virtual journey on Italian Alps through a multisensory system. Comput Aided Des Appl (in press)Google Scholar
  9. 9.
    Chu S, Downes JJ (2000) Odour-evoked autobiographical memories: psychological investigations of proustian phenomena. Chem Sens 25:111–116CrossRefGoogle Scholar
  10. 10.
    Chu S, Downes JJ (2002) Proust nose best: odors are better cues of autobiographical memory. Mem Cognit 30(4):511–518CrossRefGoogle Scholar
  11. 11.
    Classen C, Howes D, Synnott A (1994) Aroma: the cultural history of smell. Routledge, LondonGoogle Scholar
  12. 12.
    Corbin A (1996) The foul and the fragrant: odour and the French social imagination. LondonGoogle Scholar
  13. 13.
    Dalim C (2013) Astronomy for kids. E-learning system using markerless augmented realityGoogle Scholar
  14. 13.
    Davide F, Holmberg M, Lundström I (2001) Virtual olfactory interfaces: electronic noses and olfactory displays. In: Communications through virtual technology: identity community and technology in the internet age. IOS Press, AmsterdamGoogle Scholar
  15. 15.
    Disztinger P, Schlögl S, Groth A (2017) Technology acceptance of virtual reality for travel planning. In: Information and communication technologies in tourism. SpringerGoogle Scholar
  16. 16.
    Ehrlichman H, Bastone L (1992) The use of odor in the study of emotion. In: Van Toller S, Dodd GH (eds) Fragrance: the psychology and biology of perfume. Elsevier, New YorkGoogle Scholar
  17. 17.
    Epple G, Herz RS (1999) Ambient odors associated to failure influence cognitive performance in children. Dev Psychobiol 35:103–107CrossRefGoogle Scholar
  18. 18.
    Ferrise F, Graziosi S, Bordegoni M (2017) Prototyping strategies for multisensory product experience engineering. J Intell Manuf 28(7):1695–1707CrossRefGoogle Scholar
  19. 19.
    Field TM (1995) Touch in early development. Lawrence Erlbaum Associates, Inc.Google Scholar
  20. 20.
    Gallace A, Spence C (2013) In touch with the future. Oxford University PressGoogle Scholar
  21. 21.
    Guttentag DA (2010) Virtual reality: applications and implications for tourism. Tour Manag 31(5):637–651. Scholar
  22. 22.
    Hassenzahl M (2013) User experience and experience design. In: Soegaard M, Dam RF (eds) The encyclopedia of human-computer interaction, Aarhus. Denmark, The Interaction Design FoundationGoogle Scholar
  23. 23.
    Hassenzahl M, Tractinsky N (2006) User experience a research agenda. Behav Inform Technol 25(2):91–97CrossRefGoogle Scholar
  24. 24.
    Herz RS (2004) A naturalistic analysis of autobiographical memories triggered by olfactory visual and auditory stimuli. Chem Sens 29(3):217–224CrossRefGoogle Scholar
  25. 25.
    Herz RS (1998) Are odors the best cues to memory?: a cross-modal comparison of associative memory stimuli. Ann N Y Acad Sci 855:670–674CrossRefGoogle Scholar
  26. 26.
    Hirota K, Ito Y, Amemiya T, Ikei Y (2013) Presentation of odor in multi-sensory theater, VAMR/HCII 2013Google Scholar
  27. 27.
    Howell MJ, Herrera NS, Moore AG, McMahan RP (2016) A reproducible olfactory display for exploring olfaction in immersive media experiences. Multimedia Tools ApplGoogle Scholar
  28. 28.
    Kahneman D, Tversky A (2000) Choices, values, and frames. Cambridge University PressGoogle Scholar
  29. 29.
    Kilteni K, Groten R, Slater M (2012) The sense of embodiment in virtual reality. Presence: teleoperators and virtual environments 21(4):373–387. Scholar
  30. 30.
    Kim DW, Nishimoto K, Kunifuji S et al (2009) Development of aroma-card based soundless Olfactory display. In: Electronics, circuits, and systems, ICECSGoogle Scholar
  31. 31.
    Krishna A (2012) An integrative review of sensory marketing: engaging the senses to affect perception, judgment and behavior. J Consum Psychol 22:332–351CrossRefGoogle Scholar
  32. 32.
    Lorig T (1992) Cognitive and non-cognitive effects of odour exposure: electrophysiological and behavioral evidence. In: Van Toller S, Dodd GH (eds) Fragrance: the psychology and biology of perfume. Elsevier, New YorkGoogle Scholar
  33. 33.
    Lu W, Petiot JF (2012) A sound–based protocol to study product emotions. Int J Prod Dev 16(3):207–224CrossRefGoogle Scholar
  34. 34.
    MacPhee M (1992) Deodorized culture: anthropology of smell in America. Arizona Anthropol 8Google Scholar
  35. 35.
    Marr D (1982) Vision: a computational investigation into the human representation and processing of visual information. Henry Holt and Co Inc, New York, NYGoogle Scholar
  36. 36.
    Matsukura H, Yoneda T, Ishida H (2012) Smelling screen: technique to present a virtual odor source at an arbitrary position on a screen. In: IEEE Virtual Reality 2012Google Scholar
  37. 37.
    Meamarbashi A (2014) Instant effects of peppermint essential oil on the physiological parameters and exercise performance. Avicenna J Phytomed 4(1)Google Scholar
  38. 38.
    Mitchell DJ, Kahn BE, Knasko SC (1995) There’s something in the air: effects of congruent or incongruent ambient odor on consumer decision making. J Consum Res 22(2):229–238CrossRefGoogle Scholar
  39. 39.
    Morrot G, Brochet F, Dubourdieu D (2001) The color of odors. Brain Lang 309–320CrossRefGoogle Scholar
  40. 40.
    Nakamoto T (2013) Human olfactory displays and interfaces: odor sensing and presentation. Information Science referenceGoogle Scholar
  41. 41.
    Narumi T, Nishizaka S, Kajinami T, Tanikawa T, Hirose M (2011) Meta Cookie+: an illusion-based gustatory display. In: Virtual and Mixed Reality, pp 260–269Google Scholar
  42. 42.
    Park A, Lee KJ, Casalegno F (2010) The three dimensions of book evolution in ubiquitous computing age: digitalization, augmentation, and hypermediation. In: Proceedings of the IEEE international conference on sensor networks, ubiquitous, and trustworthy computing, pp 374–378Google Scholar
  43. 43.
    Reinarz J (2014) Past scents: historical perspectives on smell. University of Illinois PressGoogle Scholar
  44. 44.
    Spence C, Driver J (2004) Crossmodal space and crossmodal attention. Oxford University PressGoogle Scholar
  45. 45.
    Schifferstein HNJ (2015) Employing consumer research for creating new and engaging food experiences in a changing world. Curr Opin Food Sci 3:27–32. Scholar
  46. 46.
    Schifferstein HNJ (2010) From salad to bowl: the role of sensory analysis in product experience research. Food Qual Prefer 21:1059–1067. Scholar
  47. 47.
    Schifferstein HNJ (2009) The drinking experience: cup or content? Food Qual Prefer 20:268–276. Scholar
  48. 48.
    Spence C, Gallace A (2011) Multisensory design: reaching out to touch the consumer. Psychol Mark 28:267–308. Scholar
  49. 49.
    Terracciano A, Dima M, Carulli M, Bordegoni M (2017) Mapping memory routes: a multisensory interface for sensorial urbanism and critical heritage studies. Proceedings of conference on human factors in computing systems, part F127655, pp 353–356Google Scholar
  50. 50.
    Vernet-Maury E, Alaoui-Ismaili O, Dittmar A et al (1999) Basic emotions induced by odorants: a new approach based on autonomic pattern results. J Autonomic Nervous System 75:176–183CrossRefGoogle Scholar
  51. 51.
    Viswadhara Meenakshi V, Sowmya K (2003) ESTER: experiencing smell through electronic reality. In: Consumer electronics, ICCEGoogle Scholar
  52. 52.
    Warm JS, William ND, Parasuraman R (1991) Effects of olfactory stimulation on performance and stress in a visual sustained attention task. J Soc Cosmet Chem 42:199–210Google Scholar
  53. 53.
    Watanabe J, Ando H, Maeda T (2005) Shoe-shaped interface for inducing a walking cycle. In: Proceedings of the 2005 international conference on augmented tele-existence, pp 30–34Google Scholar
  54. 54.
    Welch G, State A, Ilie A et al (2005) Immersive electronic books for surgical training. IEEE Multimedia 12(3):22–35CrossRefGoogle Scholar
  55. 55.
    Yamada T, Yokoyama S, Tanikawa T et al (2006) wearable olfactory display: using odor in outdoor environment. In: IEEE Virtual Reality 2006Google Scholar
  56. 56.
    Yoshimura T, Sakashita Y (2006) Development of a perfume emission system via internet. J Comput Chem Jpn 5(4):227–230CrossRefGoogle Scholar
  57. 57.
    Zucconi G (2014) La sua voce è profumo. Passeggiata letteraria tra aromi, odori, fragranze, MondadoriGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Monica Bordegoni
    • 1
    Email author
  • Marina Carulli
    • 1
  • Francesco Ferrise
    • 1
  1. 1.Politecnico di MilanoMilanItaly

Personalised recommendations