Effect of Pseudo-Haptic Feedback on Touchscreens on Visual Memory During Image Browsing

  • Takeru HashimotoEmail author
  • Takuji Narumi
  • Ryohei Nagao
  • Tomohiro Tanikawa
  • Michitaka Hirose
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10894)


This study investigated the effect of pseudo-haptic feedback that is rendered based on visuo–haptic interaction with a touchscreen, on a visual memory task during image browsing. Pseudo-haptic feedback on a touchscreen is rendered by changing the control/display ratio (C/D ratio), which is the ratio of the movement of the user’s finger (control) to the movement of the background image on the display (display). By using this method, we compared the performances of the visual memory task under two visual modification conditions (i.e., with and without dynamic C/D ratio modification) and two interactivity conditions (i.e., with an interactive system and with an autonomous system). The experimental results showed that the figures associated with the pseudo-haptic feedback significantly remained in memory, and the participants showed the best performance of the visual memory task when using interactive scrolling with dynamic C/D ratio modification. These results show that pseudo-haptic feedback on touchscreens affects a user’s memory during image browsing.


Pseudo-haptics Memory Attention Touch screens 



This study is partially supported by Grant-in-Aid for Scientific Research on Innovative Areas (16H01668) and Grant-in-Aid for Scientific Research (A) (17H00753).


  1. 1.
    Brewster, S., Chohan, F., Brown, L.: Tactile feedback for mobile interactions. In: Proceeding of the SIGCHI Conference on Human Factors in Computing Systems, pp. 159–162 (2007)Google Scholar
  2. 2.
    Levesque, V., Oram, L., MacLean, K., Cockburn, A., Marchuk, N.D., Johnson, D., Colgate, J.E., Peshkin. M.A.: Enhancing physicality in touch interaction with programmable friction. In: Proceeding of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2481–2490 (2011)Google Scholar
  3. 3.
    Bau, O., Poupyrev, I., Israr, A., Harrison, C.: TeslaTouch. In: Proceeding of the 23rd Annual ACM Symposium on User Interface Software and Technology, p. 283 (2010)Google Scholar
  4. 4.
    Narumi, T., Ujitoko, Y., Ban, Y., Tanikawa, T., Hirota, K., Hirose, M.: Resistive swipe: visuo-haptic interaction during swipe gestures to scroll background images on touch interfaces. In: Proceeding of the 2017 IEEE World Haptics Conference, pp. 334–339 (2017)Google Scholar
  5. 5.
    Lecuyer, A., Coquillart, S., Kheddar, A., Richard, P., Coiffet, P.: Pseudo-haptic feedback: can isometric input devices simulate force feedback? In: Proceeding of the IEEE Virtual Reality, pp. 83–90 (2000)Google Scholar
  6. 6.
    Tyler, S.W., Hertel, P.T., McCallum, M.C., Ellis, H.C.: Cognitive effort and memory. J. Exp. Psychol.: Hum. Learn. Mem. 5(6), 607–617 (1979)Google Scholar
  7. 7.
    Norman, D.A.: Memory and attention (1976)Google Scholar
  8. 8.
    Blanch, R., Guiard, Y., Beaudouin-Lafon, M.: Semantic pointing. In: Proceeding of the SIGCHI Conference on Human Factors in Computing Systems, vol. 6, no. 1, pp. 519–526 (2004)Google Scholar
  9. 9.
    Taima, Y., Ban, Y., Narumi, T., Tanikawa, T., Hirose, M.: Controlling fatigue while lifting objects using pseudo-haptics in a mixed reality space. In: Proceeding of the IEEE Haptics Symposium, pp. 175–180 (2014)Google Scholar
  10. 10.
    Ban, Y., Kajinami, T., Narumi, T., Tanikawa, T., Hirose, M.: Modifying an identified curved surface shape using pseudo-haptic effect. In: Proceeding of the IEEE Haptics Symposium, pp. 211–216 (2012)Google Scholar
  11. 11.
    Ban, Y., Narumi, T., Tanikawa, T., Hirose, M.: Modifying perceived size of a handled object through hand image deformation. Presence: Teleoperators Virtual Environ. 22(3), 255–270 (2013)CrossRefGoogle Scholar
  12. 12.
    Lecuyer, A., Burkhardt, J.M., Etienne, L.: Feeling bumps and holes without a haptic interface: the perception of pseudo-haptic textures. In: Proceeding of the SIGCHI Conference on Human Factors in Computing Systems, vol. 6, pp. 239–246 (2004)Google Scholar
  13. 13.
    Pusch, A., Lecuyer, A.: Pseudo-haptics: from the theoretical foundations to practical system design guidelines. In: Proceeding of ICMI 2011, pp. 57–64 (2011)Google Scholar
  14. 14.
    Kokubun, A., Ban, Y., Narumi, T., Tanikawa, T., Hirose, M.: Representing normal and shearing forces on the mobile device with visuo-haptic interaction and a rear touch interface. In: Proceeding of Haptics Symposium, pp. 415–420 (2014)Google Scholar
  15. 15.
    Hagiwara, A., Sugimoto, A., Kawamoto, K.: Saliency-based image editing for guiding visual attention. In: Proceeding of the 1st International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction, pp. 43–48 (2011)Google Scholar
  16. 16.
    Parkhurst, D.J., Niebur, E.: Texture contrast attracts overt visual attention in natural scenes. Eur. J. Neurosci. 19(3), 783–789 (2004)CrossRefGoogle Scholar
  17. 17.
    Kadaba, N.R., Yang, X.D., Irani, P.P.: Facilitating multiple target tracking using semantic depth of field (SDOF). In: Proceeding of CHI 2009 Extended Abstracts on Human Factors in Computing Systems, pp. 4375–4380 (2009)Google Scholar
  18. 18.
    Tanaka, R., Narumi, T., Tanikawa, T., Hirose, M.: Attracting user’s attention in spherical image by angular shift of virtual camera direction. In: Proceeding of the 3rd ACM Symposium on Spatial User Interaction, pp. 61–64 (2015)Google Scholar
  19. 19.
    Tanaka, R., Narumi, T., Tanikawa, T., Hirose, M.: Guidance field: potential field to guide users to target locations in virtual environments. In: Proceeding of the IEEE Symposium on 3D User Interfaces, pp. 39–48 (2016)Google Scholar
  20. 20.
    Imura, J., Kasada, K., Narumi, T., Tanikawa, T., Hirose, M.: Reliving past scene experience system by inducing a video-camera operator’s motion with overlaying a video-sequence onto real environment. ITE Trans. Media Technol. Appl. 2(3), 225–235 (2014)CrossRefGoogle Scholar
  21. 21.
    Bier, R., Stone, M.: Snap dragging. In: Proceeding of SIGGRAPH 1986, pp. 233–240 (1986)CrossRefGoogle Scholar
  22. 22.
    Beaudouin-Lafon, M., Mackay, W.: Reification, polymorphism and reuse: three principles for designing visual interfaces. In: Proceeding of AVI 2000, pp. 102–109 (2000)Google Scholar
  23. 23.
    Gordon, P.C., Holyoak, K.J.: Implicit learning and generalization of the mere exposure” effect. J. Pers. Soc. Psychol. 45(3), 492 (1983)CrossRefGoogle Scholar
  24. 24.
    Simion, C., Shimojo, S.: Interrupting the cascade-orienting contributes to decision making even in the absence of visual stimulation. Percept. Psychophys. 69(4), 591–595 (2007)CrossRefGoogle Scholar
  25. 25.
    Triona, L.M., Klahr, D., Williams, C.: Point and click or build by hand: comparing the effects of physical vs. virtual materials on middle school students’ ability to optimize an engineering design. In: Proceeding of CogSci (2005)Google Scholar
  26. 26.
    Barsalou, L.W., Wiemer-Hastings, K.: Situating abstract concepts. In: Pecher, D., Zwaan, R., (eds.) Grounding Cognition: the Role of Perception and Action in Memory, Language, and Thought. Cambridge University Press (2005)Google Scholar
  27. 27.
    Jostmann, N.B., Lakens, D., Schubert, T.W.: Weight as an embodiment of importance. Psychol. Sci. 20(9), 1169–1174 (2009)CrossRefGoogle Scholar
  28. 28.
    Ackerman, J.M., Nocera, C.C., Bargh, J.A.: Incidental haptic sensations influence social judgments and decisions. Science 328(5986), 1712–1715 (2010)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Takeru Hashimoto
    • 1
    Email author
  • Takuji Narumi
    • 1
    • 2
  • Ryohei Nagao
    • 1
  • Tomohiro Tanikawa
    • 1
  • Michitaka Hirose
    • 1
  1. 1.Graduate School of Information Science and TechnologyThe University of TokyoTokyoJapan
  2. 2.JST PRESTOTokyoJapan

Personalised recommendations