The Future of Learning Multisensory Experiences: Visual, Audio, Smell and Taste Senses
This paper describes an investigative study about the sense of smell, taste, hearing and vision to assist process of learning. This will serve to start the design and construction of a multisensory human-computer interface for different educational applications. The most important part is understanding the ways in which learners’ senses process learning and memorize information and in which relation these activities are.
Though sensory systems and interfaces have developed significantly over the last few decades, there are still unfulfilled challenges in understanding multisensory experiences in Human Computer Interaction. The researchers generally rely on vision and listening, some of them focus on touch, but the taste and smell senses remain uninvestigated. Understanding the ways in which human’s senses influence the process, learning effects and memorizing information may be important to e-learning system and its higher functionalities. In order to analyze these questions, we carried out several usability studies with students to see if visual or audio experiences, different smells or tastes can assist and support memorizing information. Obtained results have shown improvement of learning abilities when using different smells, tastes and virtual reality facilities.
KeywordsLearning Human-computer Interface Virtual reality Sense of smell Sense of taste
- 1.Mansor, N., Jamaluddin, H., Shukor, Z.: Concept and application of virtual reality haptic technology: a review. J. Theor. Appl. Inf. Technol. 95(14), (2017)Google Scholar
- 4.Thalmann, D.: Sensors and actuators for HCI and VR: a few case studies. In: Frontiers in Electronic Technologies, pp. 65–83. Springer (2017)Google Scholar
- 5.Shen, C.W., Ho, J.T., Kuo, T.C., Luong, T.H.: Behavioral intention of using virtual reality in learning. In: International Conference on World Wide Web Companion, pp. 129–137 (2017)Google Scholar
- 9.Garcia-Ruiz, M., El-Seoud, S.A., Edwards, A., Aquino-Santos, R.: Integrating the sense of smell in an educational human computer interface. In: Interactive Computer Aided Learning Conference (2008)Google Scholar
- 10.Kaye, N.: Olfactory Display. MSc thesis, Massachusetts Institute of Technology (2001) Google Scholar