Vibrotactile and vibroacoustic communications: pairs in interaction and play—an interactive structure and bodies in an urban environment

  • Ann Morrison
  • Cristina Manresa-Yee
  • Hendrik Knoche
  • Walther Jensen
Long Paper
First Online:
  • 444 Downloads

Abstract

We designed a vibrotactile vest and The Humming Wall, a vibroacoustic interactive furniture set in an urban environment to interact with each other. We developed the vibrotactile patterns in the vest as a form of vibrotactile language to convey information to the wearer. In addition, we designed a set of interactive movements on The Humming Wall that would trigger patterns on the vest and elicit sensations and encourage body movements onto the wearer’s body. We invited people to interact in pairs at The Humming Wall, with one at the wall and one wearing the vest (they later swapped roles). Actions by the one at the wall, such as swiping or knocking on the wall were repeated on the vest wearer’s body. In addition, participants could ‘feel’ (vibroacoustically) and hear their own heartbeats and breath rates at the wall. We conducted a field trial with 39 participants over a 5-week period. Participants wearing the vest (and their pair) completed a set of tasks. We logged use and responses, recorded all activities on video and conducted post-experiment interviews and questionnaires. The results depicted the participants’ experience, communication and connection while wearing the vibrotactile vest and interacting with the wall. The findings show convincing, strong and positive responses to novel interactions between the responsive vibroacoustic environment and the vibrotactile vest. This work constitutes the first field trial with people ‘working’ in pairs with a vibrotactile wearable responding to and driving vibroacoustic displays with an interactive vibroacoustic environment.

Keywords

Pairs interacting Play Communication Connection Wearable computing Vibrotactile The Humming Wall Haptic patterns Vibroacoustic 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgements

We thank the volunteers for the field trials and Aalborg Kommune for support. This work is supported by the EU-funded project CultAR (FP7-ICT-2011-9 601139), TIN2016-81143-R (AEI/FEDER, UE), the FUEIB agreement 3194 and mobility grant CAS12/00199, Programa José Castillejo granted by the Spanish MECD.

References

  1. 1.
    Ahonen, H., Deek, P., Kroeker, J.: Low frequency sound treatment promoting physical and emotional relaxation qualitative study. Int. J. Psychosoc. Rehabil. 17(1), 45–58 (2012)Google Scholar
  2. 2.
    Bao, J., Shou, X., Wang, H., Yang, H.: Study on heartbeat information acquired from pressure cushion based on body sensor network. In: 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, pp. 1103–1108 (2013).  https://doi.org/10.1109/GreenCom-iThings-CPSCom.2013.190
  3. 3.
    da Silva Benini, M.J., Bruinink, M.W., Pekel, A.D., Talbott, W.A., Visser, A., Markopoulos, P.: Restoring balance: replacing the vestibular sense with wearable vibrotactile feedback. In: Röcker, C., Ziefle, M. (eds.) Smart Healthcare Applications and Services: Developments and Practices, pp. 283–301 (2011)CrossRefGoogle Scholar
  4. 4.
    Braun, V., Clarke, V.: Using thematic analysis in psychology. Qual. Res. Psychol. 3(2), 77–101 (2006).  https://doi.org/10.1191/1478088706qp063oa CrossRefGoogle Scholar
  5. 5.
    Choi, S., Kuchenbecker, K.J.: Vibrotactile display: perception, technology, and applications. Proc. IEEE 101(9), 2093–2104 (2013).  https://doi.org/10.1109/JPROC.2012.2221071 CrossRefGoogle Scholar
  6. 6.
    Dahiya, R.S., Valle, M.: Tactile Sensing Technologies. In: Robotic Tactile Sensing. Springer, Dordrecht (2013)CrossRefGoogle Scholar
  7. 7.
    De Niet, G., Tiemens, B., Lendemeijer, B., Hutschemaekers, G.: Music-assisted relaxation to improve sleep quality: meta-analysis. J. Adv. Nurs. 65(7), 1356–1364 (2009).  https://doi.org/10.1111/j.1365-2648.2009.04982.x CrossRefGoogle Scholar
  8. 8.
    Deci, E.L., Ryan, R.M.: The “what” and “why” of goal pursuits: human needs and the self-determination of behavior. Psychol. Inq. 11(4), 227–268 (2000).  https://doi.org/10.1207/S15327965PLI1104_01 CrossRefGoogle Scholar
  9. 9.
    Diamond, A., Amso, D.: Contributions of neuroscience to our understanding of cognitive development. Curr. Dir. Psychol. Sci. 17(2), 136–141 (2008).  https://doi.org/10.1111/j.1467-8721.2008.00563.x CrossRefGoogle Scholar
  10. 10.
    Dijk, E.O., Weffers, A.: Breathe with the Ocean: a system for relaxation using audio, haptic and visual stimuli. In: Special Symposium at EuroHaptics 2010: Haptic and Audio-Visual Stimuli: Enhancing Experiences and Interaction, pp. 47–60 (2011)Google Scholar
  11. 11.
    Dijk, E.O., Nijholt, A., van Erp, J.B.F., van Wolferen, G., Kuyper, E.: Audio–tactile stimulation: a tool to improve health and well-being? Int. J. Auton. Adapt. Commun. Syst. 6(4), 305–323 (2013)CrossRefGoogle Scholar
  12. 12.
    Dublon, G., Portocarrero, E.: Listentree: audio-haptic display in the natural environment. In: Proceedings of 20th International Conference on Auditory Display (ICAD–2014) (2014)Google Scholar
  13. 13.
    Field, T.: Touch for socioemotional and physical well-being: a review. Dev. Rev. 30(4), 367–383 (2010).  https://doi.org/10.1016/j.dr.2011.01.001 CrossRefGoogle Scholar
  14. 14.
    Field, T.: Touch, 2nd edn. MIT press, Cambridge (2014)Google Scholar
  15. 15.
    Fuermaier, A.B.M., Tucha, L., Koerts, J., van Heuvelen, M.J.G., van der Zee, E.A., Lange, K.W., Tucha, O.: Good vibrations—effects of whole body vibration on attention in healthy individuals and individuals with ADHD. PLoS One (2014).  https://doi.org/10.1371/journal.pone.0090747 Google Scholar
  16. 16.
    Gallace, A., Spence, C.: The science of interpersonal touch: an overview. Neurosci. Biobehav. Rev. 34(2), 246–259 (2010).  https://doi.org/10.1016/j.neubiorev.2008.10.004 CrossRefGoogle Scholar
  17. 17.
    Geldard, F.A., Sherrick, C.E.: The cutaneous “rabbit”: a perceptual illusion. Science 178(4057), 178–179 (1972)CrossRefGoogle Scholar
  18. 18.
    Haans, A., IJsselsteijn, W.A.: The virtual midas touch: helping behavior after a mediated social touch. IEEE Trans. Haptics 2(3), 136–140 (2009)CrossRefGoogle Scholar
  19. 19.
    Huisman, G., Frederiks, A.D., Dijk, B.V., Hevlen, D., Krose, B.: The TaSSt: tactile sleeve for social touch. In: World Haptics Conference (WHC), 2013, pp. 211–216 (2013)Google Scholar
  20. 20.
    Jackson, S.A., Marsh, H.W.: Development and validation of a scale to measure optimal experience: the flow state scale. J. Sport Exerc. Psychol. 18(1), 17–35 (1996)CrossRefGoogle Scholar
  21. 21.
    Jones, L.A., Sarter, N.B.: Tactile displays: guidance for their design and application. Human Factors J. Human Factors Ergon. Soc. 50(1), 90–111 (2008).  https://doi.org/10.1518/001872008X250638 CrossRefGoogle Scholar
  22. 22.
    King, L.K., Almeida, Q.J., Ahonen, H.: Short-term effects of vibration therapy on motor impairments in Parkinson’s disease. Neurorehabilitation 25(4), 297–306 (2009)Google Scholar
  23. 23.
    Koike, Y., Hoshitani, M., Tabata, Y., Seki, K., Nishimura, R., Kano, Y.: Effects of vibroacoustic therapy on elderly nursing home residents with depression. J. Phys. Ther. Sci. 24(3), 291–294 (2012).  https://doi.org/10.1589/jpts.24.291 CrossRefGoogle Scholar
  24. 24.
    Loewy, J., Stewart, K., Dassler, A.-M., Telsey, A., Homel, P.: The effects of music therapy on vital signs, feeding, and sleep in premature infants. Pediatrics 131(5), 902–918 (2013)CrossRefGoogle Scholar
  25. 25.
    Manresa-Yee, C., Morrison, A., Muntaner, J.J.: First insights with a vibrotactile interface for children with multiple disabilities. In: CHI’15 Extended Abstracts on Human Factors in Computing Systems (CHI EA’15), pp. 905–910 (2015).  https://doi.org/10.1145/2702613.2732910
  26. 26.
    McDaniel, T., Villanueva, D., Krishna, S., Panchanathan, S.: MOVeMENT: a framework for systematically mapping vibrotactile stimulations to fundamental body movements. In: Proceedings of HAVE 2010, pp. 1–6Google Scholar
  27. 27.
    Montagu, A.: Touching: the human significance of the skin. Harper and Row Publishers, New York (1972)Google Scholar
  28. 28.
    Morrison, A., Knoche, H., Manresa-Yee, C.: Designing a vibrotactile language for a wearable vest. In: HCII2015, Design, User Experience, and Usability: Users and Interactions (LNCS 9187), pp. 655–666 (2015)Google Scholar
  29. 29.
    Morrison, I., Löken, L.S., Olausson, H.: The skin as a social organ. Exp. Brain Res. 204, 305–314 (2010).  https://doi.org/10.1007/s00221-009-2007-y CrossRefGoogle Scholar
  30. 30.
    Morrison, A., Manresa-Yee, C., Knoche, H.: Vibrotactile and vibroacoustic interventions into health and well-being. Univ. Access Inf. Soc. (2017).  https://doi.org/10.1007/s10209-016-0516-6 Google Scholar
  31. 31.
    Mueller, F.F., Vetere, F., Gibbs, M.R., Kjeldskov, J., Pedell, S., Howard, S.: Hug over a distance. In: CHI’05 Extended Abstracts on Human Factors in Computing Systems (CHI EA’05), pp. 1673–1676 (2005).  https://doi.org/10.1145/1056808.1056994
  32. 32.
    Neumann, D.A.: Kinesiology of the Musculoskeletal System: Foundations for Rehabilitation. 2nd edn. Mosby, St. Louis (2010)Google Scholar
  33. 33.
    Orso, V., Gamberini, L., Mazza, R., Hsieh, Y.-T.T., Jensen, B.W.S., Jacucci, G., Morrison, A.J., Jensen, W.: Follow the vibes: a comparison between two tactile displays in a navigation task in the field. PsychNol. J. 14(1), 61–79 (2016)Google Scholar
  34. 34.
    Orso, V., Mazza, R., Gamberini, L., Morrison, A., Jensen, W.: Investigating Tactile Stimulation in Symbiotic Systems, pp. 137–142. Springer, Cham (2017).  https://doi.org/10.1007/978-3-319-57753-1_12 Google Scholar
  35. 35.
    Paredes, P., Chan, M.: CalmMeNow: exploratory research and design of stress mitigating mobile interventions. In: Proceedings of CHI EA’11, pp. 1699–1704 (2011)Google Scholar
  36. 36.
    Pares, N., Carreras, A., Durany, J., Ferrer, J., Freixa, P., Gómez, D., Kruglanski, O., Parés, R., Ribas, J.I., Soler, M., Sanjurjo, A., et al.: MEDIATE: an interactive multisensory environment for children with severe autism and no verbal communication. In: Proceedings of the Third International Workshop on Virtual Rehabilitation (2004)Google Scholar
  37. 37.
    Park, Y.W., Bae, S.H., Nam, T.J.: How do couples use cheektouch over phone calls?. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12), pp. 763–766 (2012).  https://doi.org/10.1145/2207676.2207786
  38. 38.
    Pless, M., Carlsson, M.: Effects of motor skill intervention on developmental coordination disorder: a meta-analysis. Adapt. Phys. Act. Q. 17(4), 381–401 (2000).  https://doi.org/10.1123/apaq.17.4.381 CrossRefGoogle Scholar
  39. 39.
    Punkanen, M., Ala-Ruona, E.: Contemporary vibroacoustic therapy: perspectives on clinical practice, research, and training. Music Med. 4(3), 128–135 (2012)CrossRefGoogle Scholar
  40. 40.
    Rosenthal, J., Edwards, N., Villanueva, D., Krishna, S., McDaniel, T., Panchanathan, S.: Design, implementation, and case study of a pragmatic vibrotactile belt. IEEE Trans. Instrum. Meas. 60(1), 114–125 (2011).  https://doi.org/10.1109/TIM.2010.2065830 CrossRefGoogle Scholar
  41. 41.
    Rüütel, E.: The Psychophysiological effects of music and vibroacoustic stimulation. Nordic J. Music Ther. 11(1), 16–26 (2002).  https://doi.org/10.1080/08098130209478039 CrossRefGoogle Scholar
  42. 42.
    Rüütel, E., Ratnik, M., Tamm, E., Zilensk, H.: The experience of vibroacoustic therapy in the therapeutic intervention of adolescent girls. Nordic J. Music Ther. 13(1), 33–46 (2004)CrossRefGoogle Scholar
  43. 43.
    Schelle, K.J., Gomez Naranjo, C., ten Bhömer, M., Tomico, O., Wensveen, S.: Tactile dialogues: personalization of vibrotactile behavior to trigger interpersonal communication. In: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction—TEI’14, pp. 637–642 (2015).  https://doi.org/10.1145/2677199.2687894
  44. 44.
    Spelmezan, D., Jacobs, M., Hilgers, A., Borchers, J.: Tactile motion instructions for physical activities. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09), pp. 2243–2252 (2009).  https://doi.org/10.1145/1518701.1519044
  45. 45.
    Tang, F., McMahan, R.P., Allen, T.T.: Development of a low-cost tactile sleeve for autism intervention. In: 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE), pp. 35–40 (2014).  https://doi.org/10.1109/HAVE.2014.6954328
  46. 46.
    Teh, J.K.S., Cheok, A.D., Peiris, R.L., Choi, Y., Thuong, V., Lai, S.: Huggy Pajama: a mobile parent and child hugging communication system. In: Proceedings of the 7th International Conference on Interaction Design and Children (IDC’08), pp. 250–257 (2008).  https://doi.org/10.1145/1463689.1463763
  47. 47.
    Uchiyama, H., Covington, M.A., Potter, W.A.: Vibrotactile glove guidance for semi-autonomous wheelchair operations. In: Proceedings of the 46th Annual Southeast Regional Conference on XX (ACM-SE 46), pp. 336–339 (2008).  https://doi.org/10.1145/1593105.1593195
  48. 48.
    van Boerdonk, K., Tieben, R., Klooster, S., van den Hoven, E.: Contact through canvas: an entertaining encounter. Pers. Ubiquit. Comput. 13(8), 551–567 (2009).  https://doi.org/10.1007/s00779-009-0240-9 CrossRefGoogle Scholar
  49. 49.
    Van Der Linden, J., Johnson, R., Bird, J., Rogers, Y., Schoonderwaldt, E.: Buzzing to play: lessons learned from an in the wild study of real-time vibrotactile feedback. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems—CHI’11, pp. 533–542 (2011)Google Scholar
  50. 50.
    Van Erp, J.B.F., Toet, A.: Social touch in human computer interaction. Front. Digit. Humanit. 2, 2 (2015).  https://doi.org/10.3389/fdigh.2015.00002 Google Scholar
  51. 51.
    Vaucelle, C., Bonanni, L., Ishii, H.: Design of haptic interfaces for therapy. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09), pp. 467–470 (2009).  https://doi.org/10.1145/1518701.1518776
  52. 52.
    Vorderer, P., Wirth, W., Gouveia, F.R., Biocca, F., Saari, T., Jäncke, F., Böcking, S., Chramm, H., Gysbers, A., Hartmann, T., Klimmt, C., Laarni, J., Ravaja, N., Sacau, A., Baumgartner, T., Jäncke, P.: MEC spatial presence questionnaire (MEC-SPQ): short documentation and instructions for application. Report to the European Community, Project Presence: MEC (IST-2001-37661) (2004). http://www.ijk.hmt-hannover.de/presence
  53. 53.
    Yang, C.C., Zhuang, W.Y., Wu, H.-T.: Assessment of the impact of acupuncture on peripheral blood flow with multi-channel photoplethysmography. In: 2014 IEEE International Conference on Electron Devices and Solid-State Circuits, pp. 1–2 (2014).  https://doi.org/10.1109/EDSSC.2014.7061096
  54. 54.
    Zephyr Bioharness 3. Retrieved 1 Aug 2015 from http://www.zephyranywhere.com
  55. 55.
    Zhu, Y., Li, B., Cui, M., Fu, Y., Zhu, L.: Acu3D: a cross-platform three-dimensional visualization system for the meridians and acupoints of human body. In: 2015 7th International Conference on Information Technology in Medicine and Education (ITME), pp. 27–31 (2015).  https://doi.org/10.1109/ITME.2015.102

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2017

Authors and Affiliations

  • Ann Morrison
    • 1
  • Cristina Manresa-Yee
    • 2
  • Hendrik Knoche
    • 1
  • Walther Jensen
    • 1
  1. 1.Department of Architecture, Design and Media TechnologyAalborg UniversityAalborgDenmark
  2. 2.Department of Mathematics and Computer ScienceUniversitat de les Illes BalearsPalmaSpain

Personalised recommendations