Sensorial Computing

  • Puja VarsaniEmail author
  • Ralph Moseley
  • Simon Jones
  • Carl James-Reynolds
  • Eris Chinellato
  • Juan Carlos Augusto
Part of the Human–Computer Interaction Series book series (HCIS)


Humanity is at a special time in its relationship with technology where there is an increasing likelihood of artificially replicating characteristics which we thought were in the realm of the distinctly human. Artificial Intelligence and Robotics are making the news increasingly often and replication of body parts is also making progress. This chapter looks at senses which although not exclusively human have a powerful potential to support other higher functions and aspects of human life. Technology has been developing nature-inspired artifacts which resemble somehow their human counterparts with specific practical applications. So far these explorations have been mostly isolated. It is only a matter of time, however, until these become physically and logically connected into a cooperative fashion – in fact Robots typically use them although not always in their full capacity. Such developments will provide machines with interface capacities of a higher order, bringing new powerful tools to solve new problems, whilst raising unexpected scenarios and challenges for our societies. Regardless of whether we want it or not, it seems impossible to stop technological progress in this direction. We assume this development is here to stay. Thus we look at the artificial and human synergies, how interaction with machines is influenced by sense-like interface capabilities – namely “sensorial computing”.


  1. Adler E, Hoon M, Mueller K et al (2000) A novel family of mammalian taste receptors. Cell 100(6):693–702CrossRefGoogle Scholar
  2. Aghajan H, Lopez-Cozar Delgado R, Augusto J (eds) (2009) Human-centric interfaces for ambient intelligence. Amsterdam, Academic Press/ElsevierGoogle Scholar
  3. Augusto J, Callaghan V, Kameas A et al (2013) Intelligent environments: a manifesto. Hum Cent Comput Inf Sci 3:12. Springer. doi: CrossRefGoogle Scholar
  4. Balkwill L, Thompson W (1999) A cross-cultural investigation of the perception of emotion in music: psychophysical and cultural cues. Music Percept Interdiscip J 17:43–64. CrossRefGoogle Scholar
  5. Braun M, Cheok A (2014) Towards an olfactory computer-dream interface. ACM Press, pp 1–3.
  6. Bregman A (1990) Auditory scene analysis: the perceptual organization of sound. MIT Press, Cambridge, MA/LondonGoogle Scholar
  7. Brixen E (2007) Techniques for the authentication of digital audio recordings. In: Audio engineering society convention 122. Audio Engineering SocietyGoogle Scholar
  8. Chen LY, Tee BC, Chortos AL, Schwartz G et al (2014) Continuous wireless pressure monitoring and mapping with ultra-small passive sensors for health monitoring and critical care. Nat Commun 5:5028. CrossRefGoogle Scholar
  9. Chinellato E, del Pobil AP (2009) The neuroscience of vision-based grasping: a functional review for computational modeling and bio-inspired robotics. J Integr Neurosci 8(2):223–254CrossRefGoogle Scholar
  10. Cremer L (1948) Die wissenschaftlichen Grundlagen der Raumakustik, Bd. 1. Hirzel-Verlag, StuttgartGoogle Scholar
  11. Doty R, Shaman P, Applebaum S, Giberson R et al (1984) Smell identification ability: changes with age. Science 226(4681):1441–1443CrossRefGoogle Scholar
  12. Downey L (2015) Well-being technologies: meditation using virtual worlds. PhD thesis, College of Engineering and Computing Nova Southeastern UniversityGoogle Scholar
  13. Fletcher H, Munson WA (1933) Loudness, its definition, measurement and calculation. Bell Labs Tech J 12:377–430CrossRefGoogle Scholar
  14. Fourier J (1822) Théorie analytique de la chaleur. Firmin Didot Père et Fils, PariszbMATHGoogle Scholar
  15. Groen F, Pavlin G, Winterboer A, Evers V (2017) A hybrid approach to decision making and information fusion: combining humans and artificial agents. Robot Auton Syst 90:71–85. CrossRefGoogle Scholar
  16. Harrison S, Tatar D, Sengers P (2007) The three paradigms of HCI. In: Alt. Chi. Session at the SIGCHI Conference on human factors in computing systems San Jose, California, USA, pp 1–18Google Scholar
  17. He W, Boesveldt S, de Graaf C, de Wijk R (2014) Dynamics of autonomic nervous system responses and facial expressions to odors. Front Psychol 5.
  18. Herz R, McCall C, Cahill L (1999) Hemispheric lateralization in the processing of odor pleasantness versus odor names. Chem Senses 24:691CrossRefGoogle Scholar
  19. Herz R, Eliassen J, Beland S, Souza T (2004) Neuroimaging evidence for the emotional potency of odor-evoked memory. Neuropsychologia 42:371–378. CrossRefGoogle Scholar
  20. Hou C, Wang H, Zhang Q, Li Y, Zhu M (2014 Aug 6) Highly conductive, flexible, and compressible all-graphene passive electronic skin for sensing human touch. Adv Mater 26(29):5018–5024. CrossRefGoogle Scholar
  21. ISO/IEC JTC1/SC29/WG11 (1999) Information Technology- Coding of audiovisual objects—ISO/IEC.D 4496 (Part 3, Audio)Google Scholar
  22. ISO226:2003E, Acoustics – normal equal-loudness-level contoursGoogle Scholar
  23. Jones S (2016) Doing the right thing: computer ethics pedagogy revisited. J Inf Commun Ethics Soc 14(1):33–48. CrossRefGoogle Scholar
  24. Jones S, Hara S, Augusto J (2015) eFRIEND: an ethical framework for intelligent environments development. Ethics Inf Technol 17(1):11–25. CrossRefGoogle Scholar
  25. Juhani P (2014) The eyes of the skin: architecture and the senses. Wiley, ChichesterGoogle Scholar
  26. Kajstura M, Trawinska A, Hebenstreit J (2005) Application of the electrical network frequency (ENF) criterion. Forensic Sci Int 155(2):165–171CrossRefGoogle Scholar
  27. Kim DH, Lu N, Ma R, Kim YS, Kim RH et al (2011) Epidermal electronics. Science 333:838–843CrossRefGoogle Scholar
  28. Kobayashi Y, Habara M, Ikezazki H, Chen R et al (2010) Advanced taste sensors based on artificial lipids with global selectivity to basic taste qualities and high correlation to sensory scores. Sensors (Basel) 10(4):3411–3443. CrossRefGoogle Scholar
  29. Kumar R, Bhondekar AP, Kaur R, Vig S, Sharma A, Kapur P (2012) A simple electronic tongue. Sens Actuators B 171–172:1046–1053CrossRefGoogle Scholar
  30. Lantham R (2017) The Coming Technological Singularity: How to survive in a post-human era. In: Science fiction criticism: an anthology of essential writings. Bloomsbury Academic, London. ISBN: 9781474248624Google Scholar
  31. Li X, Staszewski L, Xu H, Durick K, Zoller M, Adler E (2002) Human receptors for sweet and umami taste. Proc Natl Acad Sci USA 99(7):4692–4696. CrossRefGoogle Scholar
  32. Linden DJ (2015) Touch: the science of hand, heart and mind. Viking Press, TorontoGoogle Scholar
  33. McGann JP(2017) Poor human olfaction is a 19th-century myth. Science 356(7263). doi: CrossRefGoogle Scholar
  34. Moseley R (2016) Deep immersion with Kasina: an exploration of meditation and concentration within virtual reality environments. In: Proceedings: the computing conference (2017)Google Scholar
  35. Moskvitch K (2017) The Internet of things 2.0: when things start to listen. Eng Technol 12(1):63–65CrossRefGoogle Scholar
  36. Nyquist H (1928) Certain topics in telegraph transmission theory. Trans Am Inst Electr Eng 47:617–644CrossRefGoogle Scholar
  37. O’Connell M (2017) To be a machine. Granta Books, p 153. ISBN: 9781783781966.Google Scholar
  38. Prescott TJ, Diamond ME, Wing AM (2011 Nov 12) Active touch sensing. Philos Trans R Soc Lond Ser B Biol Sci 366(1581):2989–2995. CrossRefGoogle Scholar
  39. Ryan EB, Cacioppo T (1981) Dimensions of sociolinguistics In: Scherer KR, Giles H (eds) Social markers in speech. Cambridge University Press, 1979, p 395. Lang Soc 10:443. doi: CrossRefGoogle Scholar
  40. Scherer K (2003) Vocal communication of emotion: a review of research paradigms.Speech Commun 40(1–2):227–256. ISSN: 0167-6393. CrossRefGoogle Scholar
  41. Sheutz M, Arnold T (2016) Are we ready for sex robots. In: Proceedings HRI ‘16 The eleventh ACM/IEEE International conference on human robot interaction, Christchurch, New Zealand IEEE Press Piscataway, NJ, USA, pp 351–358. ISBN: 9781467383707Google Scholar
  42. Suzuki R, Homma S, Matsuura E, Okada K (2014) System for presenting and creating smell effects to video. ACM Press, pp 208–215. doi:
  43. Toko K (2000) Taste sensor. Sensors Actuators B 64(1–3):205–215CrossRefGoogle Scholar
  44. Tootell R, Tsao D, Vanduffel W (2003) Neuroimaging weighs in: humans meet macaques in “primate” visual cortex. J Neurosci 10:3981–3989CrossRefGoogle Scholar
  45. Turkle S (2011) Alone together. Basic Books. ISBN: 9780465031467Google Scholar
  46. Villarreal B, Gordillo JL (2016) Bioinspired smell sensor: nostril model and design. IEEE/ASME Trans Mechatron 21:912–921. CrossRefGoogle Scholar
  47. Wang X, Dong L, Zhang H, Yu R et al (2015) Recent progress in electronic skin. Adv Sci 2(10):1500169. CrossRefGoogle Scholar
  48. Weiser M (1999) The computer for the 21st century. In: ACM SIGMOBILE Mobile computing and communications review – Special issue dedicated to Mark Weiser, vol 3, Issue 3, ACM New York, NY, USA, pp 3–11. doi: CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Puja Varsani
    • 1
    Email author
  • Ralph Moseley
    • 1
  • Simon Jones
    • 1
  • Carl James-Reynolds
    • 1
  • Eris Chinellato
    • 1
  • Juan Carlos Augusto
    • 1
  1. 1.Middlesex University LondonLondonUK

Personalised recommendations