Skip to main content

Effect of Pseudo-Haptic Feedback on Touchscreens on Visual Memory During Image Browsing

  • Conference paper
  • First Online:
Haptics: Science, Technology, and Applications (EuroHaptics 2018)

Abstract

This study investigated the effect of pseudo-haptic feedback that is rendered based on visuo–haptic interaction with a touchscreen, on a visual memory task during image browsing. Pseudo-haptic feedback on a touchscreen is rendered by changing the control/display ratio (C/D ratio), which is the ratio of the movement of the user’s finger (control) to the movement of the background image on the display (display). By using this method, we compared the performances of the visual memory task under two visual modification conditions (i.e., with and without dynamic C/D ratio modification) and two interactivity conditions (i.e., with an interactive system and with an autonomous system). The experimental results showed that the figures associated with the pseudo-haptic feedback significantly remained in memory, and the participants showed the best performance of the visual memory task when using interactive scrolling with dynamic C/D ratio modification. These results show that pseudo-haptic feedback on touchscreens affects a user’s memory during image browsing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Brewster, S., Chohan, F., Brown, L.: Tactile feedback for mobile interactions. In: Proceeding of the SIGCHI Conference on Human Factors in Computing Systems, pp. 159–162 (2007)

    Google Scholar 

  2. Levesque, V., Oram, L., MacLean, K., Cockburn, A., Marchuk, N.D., Johnson, D., Colgate, J.E., Peshkin. M.A.: Enhancing physicality in touch interaction with programmable friction. In: Proceeding of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2481–2490 (2011)

    Google Scholar 

  3. Bau, O., Poupyrev, I., Israr, A., Harrison, C.: TeslaTouch. In: Proceeding of the 23rd Annual ACM Symposium on User Interface Software and Technology, p. 283 (2010)

    Google Scholar 

  4. Narumi, T., Ujitoko, Y., Ban, Y., Tanikawa, T., Hirota, K., Hirose, M.: Resistive swipe: visuo-haptic interaction during swipe gestures to scroll background images on touch interfaces. In: Proceeding of the 2017 IEEE World Haptics Conference, pp. 334–339 (2017)

    Google Scholar 

  5. Lecuyer, A., Coquillart, S., Kheddar, A., Richard, P., Coiffet, P.: Pseudo-haptic feedback: can isometric input devices simulate force feedback? In: Proceeding of the IEEE Virtual Reality, pp. 83–90 (2000)

    Google Scholar 

  6. Tyler, S.W., Hertel, P.T., McCallum, M.C., Ellis, H.C.: Cognitive effort and memory. J. Exp. Psychol.: Hum. Learn. Mem. 5(6), 607–617 (1979)

    Google Scholar 

  7. Norman, D.A.: Memory and attention (1976)

    Google Scholar 

  8. Blanch, R., Guiard, Y., Beaudouin-Lafon, M.: Semantic pointing. In: Proceeding of the SIGCHI Conference on Human Factors in Computing Systems, vol. 6, no. 1, pp. 519–526 (2004)

    Google Scholar 

  9. Taima, Y., Ban, Y., Narumi, T., Tanikawa, T., Hirose, M.: Controlling fatigue while lifting objects using pseudo-haptics in a mixed reality space. In: Proceeding of the IEEE Haptics Symposium, pp. 175–180 (2014)

    Google Scholar 

  10. Ban, Y., Kajinami, T., Narumi, T., Tanikawa, T., Hirose, M.: Modifying an identified curved surface shape using pseudo-haptic effect. In: Proceeding of the IEEE Haptics Symposium, pp. 211–216 (2012)

    Google Scholar 

  11. Ban, Y., Narumi, T., Tanikawa, T., Hirose, M.: Modifying perceived size of a handled object through hand image deformation. Presence: Teleoperators Virtual Environ. 22(3), 255–270 (2013)

    Article  Google Scholar 

  12. Lecuyer, A., Burkhardt, J.M., Etienne, L.: Feeling bumps and holes without a haptic interface: the perception of pseudo-haptic textures. In: Proceeding of the SIGCHI Conference on Human Factors in Computing Systems, vol. 6, pp. 239–246 (2004)

    Google Scholar 

  13. Pusch, A., Lecuyer, A.: Pseudo-haptics: from the theoretical foundations to practical system design guidelines. In: Proceeding of ICMI 2011, pp. 57–64 (2011)

    Google Scholar 

  14. Kokubun, A., Ban, Y., Narumi, T., Tanikawa, T., Hirose, M.: Representing normal and shearing forces on the mobile device with visuo-haptic interaction and a rear touch interface. In: Proceeding of Haptics Symposium, pp. 415–420 (2014)

    Google Scholar 

  15. Hagiwara, A., Sugimoto, A., Kawamoto, K.: Saliency-based image editing for guiding visual attention. In: Proceeding of the 1st International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction, pp. 43–48 (2011)

    Google Scholar 

  16. Parkhurst, D.J., Niebur, E.: Texture contrast attracts overt visual attention in natural scenes. Eur. J. Neurosci. 19(3), 783–789 (2004)

    Article  Google Scholar 

  17. Kadaba, N.R., Yang, X.D., Irani, P.P.: Facilitating multiple target tracking using semantic depth of field (SDOF). In: Proceeding of CHI 2009 Extended Abstracts on Human Factors in Computing Systems, pp. 4375–4380 (2009)

    Google Scholar 

  18. Tanaka, R., Narumi, T., Tanikawa, T., Hirose, M.: Attracting user’s attention in spherical image by angular shift of virtual camera direction. In: Proceeding of the 3rd ACM Symposium on Spatial User Interaction, pp. 61–64 (2015)

    Google Scholar 

  19. Tanaka, R., Narumi, T., Tanikawa, T., Hirose, M.: Guidance field: potential field to guide users to target locations in virtual environments. In: Proceeding of the IEEE Symposium on 3D User Interfaces, pp. 39–48 (2016)

    Google Scholar 

  20. Imura, J., Kasada, K., Narumi, T., Tanikawa, T., Hirose, M.: Reliving past scene experience system by inducing a video-camera operator’s motion with overlaying a video-sequence onto real environment. ITE Trans. Media Technol. Appl. 2(3), 225–235 (2014)

    Article  Google Scholar 

  21. Bier, R., Stone, M.: Snap dragging. In: Proceeding of SIGGRAPH 1986, pp. 233–240 (1986)

    Article  Google Scholar 

  22. Beaudouin-Lafon, M., Mackay, W.: Reification, polymorphism and reuse: three principles for designing visual interfaces. In: Proceeding of AVI 2000, pp. 102–109 (2000)

    Google Scholar 

  23. Gordon, P.C., Holyoak, K.J.: Implicit learning and generalization of the mere exposure” effect. J. Pers. Soc. Psychol. 45(3), 492 (1983)

    Article  Google Scholar 

  24. Simion, C., Shimojo, S.: Interrupting the cascade-orienting contributes to decision making even in the absence of visual stimulation. Percept. Psychophys. 69(4), 591–595 (2007)

    Article  Google Scholar 

  25. Triona, L.M., Klahr, D., Williams, C.: Point and click or build by hand: comparing the effects of physical vs. virtual materials on middle school students’ ability to optimize an engineering design. In: Proceeding of CogSci (2005)

    Google Scholar 

  26. Barsalou, L.W., Wiemer-Hastings, K.: Situating abstract concepts. In: Pecher, D., Zwaan, R., (eds.) Grounding Cognition: the Role of Perception and Action in Memory, Language, and Thought. Cambridge University Press (2005)

    Google Scholar 

  27. Jostmann, N.B., Lakens, D., Schubert, T.W.: Weight as an embodiment of importance. Psychol. Sci. 20(9), 1169–1174 (2009)

    Article  Google Scholar 

  28. Ackerman, J.M., Nocera, C.C., Bargh, J.A.: Incidental haptic sensations influence social judgments and decisions. Science 328(5986), 1712–1715 (2010)

    Article  Google Scholar 

Download references

Acknowledgement

This study is partially supported by Grant-in-Aid for Scientific Research on Innovative Areas (16H01668) and Grant-in-Aid for Scientific Research (A) (17H00753).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Takeru Hashimoto .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hashimoto, T., Narumi, T., Nagao, R., Tanikawa, T., Hirose, M. (2018). Effect of Pseudo-Haptic Feedback on Touchscreens on Visual Memory During Image Browsing. In: Prattichizzo, D., Shinoda, H., Tan, H., Ruffaldi, E., Frisoli, A. (eds) Haptics: Science, Technology, and Applications. EuroHaptics 2018. Lecture Notes in Computer Science(), vol 10894. Springer, Cham. https://doi.org/10.1007/978-3-319-93399-3_47

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-93399-3_47

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-93398-6

  • Online ISBN: 978-3-319-93399-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics