The Affective Experience of Handling Digital Fabrics: Tactile and Visual Cross-Modal Effects

  • Di Wu
  • Ting-I Wu
  • Harsimrat Singh
  • Stefano Padilla
  • Douglas Atkinson
  • Nadia Bianchi-Berthouze
  • Mike Chantler
  • Sharon Baurley
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6974)


In the textile sector, emotions are often associated with both physical touch and manipulation of the product. Thus there is the need to recreate the affective experiences of touching and interacting with fabrics using commonly available internet technology. New digital interactive representations of fabrics simulating handling have been proposed with the idea of bringing the digital experience of fabrics closer to the reality. This study evaluates the contribution of handling real fabrics to viewing digital interactive animations of said fabrics and vice versa. A combination of self-report and physiological measures was used. Results showed that having previous physical handling experience of the fabrics significantly increased pleasure and engagement in the visual experience of the digital handling of the same fabrics. Two factors mediated these experiences: gender and interoceptive awareness. Significant results were not found for the opposite condition.


Physiological Signals Affective Interaction Fabric Handling Digital Fabric Handling Touch Cross-Modal transfer 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Moody, W., Morgan, R., Dillon, P., Baber, C., Wing, A.: Factors underlying fabric perception. In: Proceedings of the Eurohaptics (2001) Google Scholar
  2. 2.
    Lin, T., Akimobo, M., Shigeo, M.: Using Subjective and Physiological Measures to Evaluate Audience-participating Movie Experience. In: AVI 2008, Napoli, Italy, pp. 28–30 (2008)Google Scholar
  3. 3.
    Clore, G., Palmer, J., Gratch, J.: Affective guidance of intelligent agents: How emotion controls cognition. Proceedings: Cognitive Systems Research 10, 21–30 (2009)Google Scholar
  4. 4.
    Laparra-Hernández, J., Belda-Lois, J.M., Medina, E., Campos, N., Poveda, R.: EMG and GSR signals for evaluating user’s perception of different types of ceramic flooring. International Journal of Industrial Ergonomics 39(2), 326–332 (2009)CrossRefGoogle Scholar
  5. 5.
    McDonagh, D., Bruseberg, A., Laslam, C.: Visual product evaluation: exploring users emotional relationships with product. Applied Ergonomics 33, 231–240 (2002)CrossRefGoogle Scholar
  6. 6.
    Jansson-Boyd, C., Marlow, N.: Not only in the eye of the beholder: tactile information can affect aesthetic evaluation. Psychology of Aesthetics, Creativity, and the Arts 1(3), 170–173 (2007)CrossRefGoogle Scholar
  7. 7.
    Citrin, A.V., Stem, D.E., Spangenberg, E.R., Clark, M.J.: Consumer need for tactile input: an internet retailing challenge. Journal of Business Research 56, 915–922 (2003)CrossRefGoogle Scholar
  8. 8.
    Padilla, S., Drbohlav, O., Green, P.R., Spence, A., Chantler, M.J.: Perceived roughness of 1/fβ noise surfaces. Vision Research 48(17), 1791–1797 (2008)CrossRefGoogle Scholar
  9. 9.
    Shah, P., Padilla, S., Green, P.R., Chantler, M.J.: Perceived Directionality of 1/fβ Noise Surfaces. In: Proceedings of 5th Symposium on Applied Perception in Graphics and Visualization (APGV), p. 203. ACM Press, New York (2008)CrossRefGoogle Scholar
  10. 10.
    Chen, X., Shao, F., Barnes, C., Childs, T., Henson, B.: Exploring relationships between touch perception and surface physical properties. International Journal of Design 3(2), 67–77 (2009)Google Scholar
  11. 11.
    Essick, G.K., James, A., McGlone, F.P.: Psychophysical assessment of the affective components of non-painful touch. NeuroReport 10, 2083–2087 (1999)CrossRefGoogle Scholar
  12. 12.
    Essick, G.K., McGlone, F., Dancer, C., Fabricant, D., Ragin, Y., Phillips, N., Jones, T., Guest, S.: Quantitative assessment of pleasant touch. Neuroscience & Biobehavioral Reviews 34(2), 192–203 (2010), Touch, Temperature, Pain/Itch and PleasureCrossRefGoogle Scholar
  13. 13.
    Barnes, C.J., Childs, T.H.C., Henson, B., Southee, C.H.: Surface finish and touch—a case study in a new human factors tribology. Wear 257(7-8), 740–750 (2004)CrossRefGoogle Scholar
  14. 14.
    Easton, R.D., Green, A.J., Srinivas, K.: Transfer between vision and haptics: Memory for 2-D pattern and 3-D objects. Psychonomic Bulletin and Review 4, 403–410 (1997)CrossRefGoogle Scholar
  15. 15.
    Reales, J.M., Ballesteros, S.: Implicit and explicit memory for visual and haptic objects: Cross-modal priming depends on structural descriptions. Journal of Experimental Psychology: Learning, Memory, and Cognition 15, 379–388 (1999)Google Scholar
  16. 16.
    Gallace, A., Spence, C.: The science of interpersonal touch: an overview. Neuroscience and Biobehavioral Reviews 34, 246–259 (2010)CrossRefGoogle Scholar
  17. 17.
    Suzuku, T., Gyoba, J.: Visual and tactile cross-modal mere exposure effects. Cognition and Emotion 22(1), 147–154 (2008)CrossRefGoogle Scholar
  18. 18.
    McCarthy, J., Wright, P., Wallace, J.: The experience of enchantment in human-computer interaction. Personal and Ubiquitous Computing 10, 278–369 (2006)CrossRefGoogle Scholar
  19. 19.
    Lang, P.J.: The Emotion Probe: Studies of Motivation and Attention. American Psychologist 50(5), 285–372 (1995)CrossRefGoogle Scholar
  20. 20.
    Agarwal, A., Meyer, A.: Beyond usability: evaluating emotional response as an integral part of user experience. In: Proceedings: CHI 2009 (2009)Google Scholar
  21. 21.
    Schandry, R.: Heart beat perception and emotional experience. Psychophysiology 18(4), 483–488 (1981)CrossRefGoogle Scholar
  22. 22.
    Pollatos, O., Kirsch, W., Schandry, R.: On the relationship between interoceptive awareness, emotional experience, and brain processes. Cognitive Brain Research 25, 948–962 (2005)CrossRefGoogle Scholar
  23. 23.
    Chanel, G., Kierkels, J.J.M., Soleymani, M., Pun, T.: Short-term emotion assessment in a recall paradigm. International Journal of Human-Computer Studies 67, 607–627 (2009)CrossRefGoogle Scholar
  24. 24.
    Picard, R.W., Vyzas, E., Healey, J.: Toward machine emotional intelligence: Analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1175–1191 (2001)Google Scholar
  25. 25.
    Kim, E.Y., Kim, S.-j., Koo, H.-j., Jeong, K.J., Kim, J.-I.: Emotion-Based Textile Indexing Using Colors and Texture. In: Wang, L., Jin, Y. (eds.) FSKD 2005. LNCS (LNAI), vol. 3613, pp. 1077–1080. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  26. 26.
    Kim, N.Y., Shin, Y., Kim, E.Y.: Emotion-Based Textile Indexing Using Neural Networks. In: Jacko, J.A. (ed.) HCI 2007, Part III. LNCS, vol. 4552, pp. 349–357. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  27. 27.
    Rolls, E.T., O’Doherty, J., et al.: Representations of Pleasant and Painful Touch in the Human Orbitofrontal and Cingulate Cortices. Cereb. Cortex 13(3), 308–317 (2003)CrossRefGoogle Scholar
  28. 28.
    McGlone, F., Spence, C.: The cutaneous senses: Touch, temperature, pain/itch, and pleasure. Neuroscience and Biobehavioral Reviews 34, 145–147 (2010)CrossRefGoogle Scholar
  29. 29.
    Nogueira, C., Cabeco-Silva, M.E., Schacher, L., Adolphe, D.: Textile Materials: Tactile Describers. Journal of Food Technology 7(3), 66–70 (2009)Google Scholar
  30. 30.
    Schutz-Bosbach, S., Tausche, P., Weiss, C.: Roughness perception during the rubber hand illusion. Brain and Cognition 70(1), 136–144 (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Di Wu
    • 1
  • Ting-I Wu
    • 1
  • Harsimrat Singh
    • 1
  • Stefano Padilla
    • 2
  • Douglas Atkinson
    • 3
  • Nadia Bianchi-Berthouze
    • 1
  • Mike Chantler
    • 2
  • Sharon Baurley
    • 3
  1. 1.UCLICUniversity College LondonLondonUK
  2. 2.School of Mathematical and Computer SciencesHeriot-Watt UniversityEdinburghUK
  3. 3.Brunel DesignBrunel UniverstyLondonUK

Personalised recommendations