Ease of hand rotation during active exploration of views of a 3-D object modulates view generalization

Experimental Brain Research volume 237, pages939–951(2019)Cite this article

Abstract

Active exploration of views of 3-D objects by manually controlling a device, such as a trackball, facilitates subsequent object recognition, suggesting that motor simulation contributes to object recognition. Further, biomechanical constraints, such as range of hand rotation, can affect mental rotation. Thus, the ease with which an object can be rotated by hand may modulate the facilitative effect active exploration through manual control has on object recognition. In our experiment, participants performed two sessions of a view-matching task, with a learning task administered between the two. In the learning task, one group of participants (active group) viewed and explored a novel 3-D object using their hand to rotate a handle attached to a cathode-ray tube monitor. The other group (passive group) observed on the monitor a replay of the movements of the 3-D object as manipulated by an active-group participant. Active-group participants were interviewed to determine the direction they found easiest to rotate their hand. The view-generalization performances were compared between the pre and post sessions. Although we observed a facilitative effect on the view-matching process in both groups, the active group exhibited view-dependent facilitation. The view-generalization range of the active group in the post-session was asymmetric in terms of the rotation direction. Most intriguingly, for most participants, this asymmetric change corresponded to the direction that afforded the easiest hand rotation (ulnar deviation). These findings suggest that the object-recognition process can be affected by ease of hand rotation, which is based on the biomechanical constraints of the wrist joint.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

US$ 39.95

Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

References

  1. American Academy of Orthopaedic Surgeons (1965) Joint motion: method of measuring and recording. E. & S. Livingstone Ltd., Edinburgh

    Google Scholar 

  2. Bülthoff HH, Edelman S (1992) Psychophysical support for a two-dimensional view interpolation theory of object recognition. Proc Natl Acad Sci USA 89:60–64

    Article  PubMed  Google Scholar 

  3. Christou CG, Bülthoff HH (1999) View dependence in scene recognition after active learning. Mem Cognit 27:996–1007. https://doi.org/10.3758/BF03201230

    Article  CAS  PubMed  Google Scholar 

  4. Cohen MS, Kosslyn SM, Breiter HC, Digirolamo GJ, Thompson WL, Anderson AK, Bookheimer SY, Rosen BR, Belliveau JW (1996) Changes in cortical activity during mental rotation: a mapping study using functional magnetic resonance imaging. Brain 119:89–100. https://doi.org/10.1093/brain/119.1.89

    Article  PubMed  Google Scholar 

  5. Crisco JJ, Heard WM, Rich RR, Paller DJ, Wolfe SW (2011) The mechanical axes of the wrist are oriented obliquely to the anatomical axes. J Bone Joint Surg Am 93:169–177. https://doi.org/10.2106/JBJS.I.01222

    Article  PubMed  PubMed Central  Google Scholar 

  6. de Lange FP, Hagoort P, Toni I (2005) Neural topography and content of movement representations. J Cogn Neurosci 17:97–112. https://doi.org/10.1162/0898929052880039

    Article  PubMed  Google Scholar 

  7. Formica D, Charles SK, Zollo L, Guglielmelli E, Hogan N, Krebs HI (2012) The passive stiffness of the wrist and forearm. J Neurophysiol 108:1158–1166. https://doi.org/10.1152/jn.01014.2011

    Article  PubMed  PubMed Central  Google Scholar 

  8. Glanville A, Kreezer G (1937) The maximum amplitude and velocity of joint movements in normal human male adults. Hum Biol 9:197–211

    Google Scholar 

  9. Goodale MA, Milner AD (1992) Separate visual pathways for perception and action. Trends Neurosci 15:20–25. https://doi.org/10.1016/0166-2236(92)90344-8

    Article  CAS  PubMed  Google Scholar 

  10. Grush R (2004) The emulation theory of representation: motor control, imagery, and perception. Behav Brain Sci 27:377–396. https://doi.org/10.1017/S0140525X04000093

    Article  PubMed  Google Scholar 

  11. Harman KL, Humphrey GK, Goodale MA (1999) Active manual control of object views facilitates visual recognition. Curr Biol 9:1315–1318. https://doi.org/10.1016/S0960-9822(00)80053-6

    Article  CAS  PubMed  Google Scholar 

  12. Harvey LO (2007) Parameter estimation of signal detection models: RscorePlus user’s manual, version 5.5.8. http://psych.colorado.edu/~lharvey/ Accessed 2 Oct 2018

  13. James KH, Humphrey GK, Goodale MA (2001) Manipulating and recognizing virtual objects: where the action is. Can J Exp Psychol 55:111–120. https://doi.org/10.1037/h0087358

    Article  CAS  PubMed  Google Scholar 

  14. Kosslyn SM, Alpert NM, Thompson WL, Chabris CF, Rauch SL, Anderson AK (1994) Identifying objects seen from different viewpoints. A PET investigation. Brain 117:1055–1071. https://doi.org/10.1093/brain/117.5.1055

    Article  PubMed  Google Scholar 

  15. Kosslyn SM, Thompson WL, Wraga M, Alpert NM (2001) Imagining rotation by endogenous versus exogenous forces: distinct neural mechanisms. NeuroReport 12:2519–2525. https://doi.org/10.1097/00001756-200108080-00046

    Article  CAS  PubMed  Google Scholar 

  16. Lamm C, Windischberger C, Moser E, Bauer H (2007) The functional role of dorso-lateral premotor cortex during mental rotation: an event-related fMRI study separating cognitive processing steps using a novel task paradigm. NeuroImage 36:1374–1386. https://doi.org/10.1016/j.neuroimage.2007.04.012

    Article  PubMed  Google Scholar 

  17. Liberman A, Cooper F, Shankweiler D, Studdert-Kennedy M (1967) Perception of the speech code. Psychol Rev 74:431–461. https://doi.org/10.1037/h0020279

    Article  CAS  PubMed  Google Scholar 

  18. Liu CH, Ward J, Markall H (2007) The role of active exploration of 3D face stimuli on recognition memory of facial information. J Exp Psychol Hum Percept Perform 33:895–904. https://doi.org/10.1037/0096-1523.33.4.895

    Article  PubMed  Google Scholar 

  19. Logothetis NK, Pauls J, Bülthoff HH, Poggio T (1994) View-dependent object recognition by monkeys. Curr Biol 4:401–414. https://doi.org/10.1016/S0960-9822(00)00089-0

    Article  CAS  PubMed  Google Scholar 

  20. Mansfield PJ, Neumann DA (2014) Essentials of kinesiology for the physical therapist assistant, 2nd edn. e-book. Elsevier Health Sciences, London

  21. Meijer F, Van der Lubbe RHJ (2011) Active exploration improves perceptual sensitivity for virtual 3D objects in visual recognition tasks. Vision Res 51:2431–2439. https://doi.org/10.1016/j.visres.2011.09.013

    Article  PubMed  Google Scholar 

  22. Moore ML (1965) Clinical assessment of joint motion. In: Licht S (ed) Therapeutic exercise, 2nd edn. Elizabeth Licht, New Haven, pp 128–162

    Google Scholar 

  23. Parsons LM (1987) Imagined spatial transformations and feet of one’s hands. Cogn Psychol 241:178–241. https://doi.org/10.1016/0010-0285(87)90011-9

    Article  Google Scholar 

  24. Parsons LM (1994) Temporal and kinematic properties of motor behavior reflected in mentally simulated action. J Exp Psychol Hum Percept Perform 20(4):709–730. https://doi.org/10.1037/0096-1523.20.4.709

    Article  CAS  PubMed  Google Scholar 

  25. Richter W, Ugurbil K, Georgopoulos AP, Kim SG (1997) Time-resolved fMRI of mental rotation. NeuroReport 8:3697–3702. https://doi.org/10.1097/00001756-199712010-00008

    Article  CAS  PubMed  Google Scholar 

  26. Richter W, Somorjai R, Summers R, Jarmasz M, Menon RS, Gati JS, Georgopoulos AP, Tegeler C, Ugurbil K, Kim SG (2000) Motor area activity during mental rotation studied by time-resolved single-trial fMRI. J Cogn Neurosci 12:310–320. https://doi.org/10.1162/089892900562129

    Article  CAS  PubMed  Google Scholar 

  27. Sasaoka T, Asakura N, Kawahara T (2010) Effect of active exploration of 3-D object views on the view-matching process in object recognition. Perception 39:289–308. https://doi.org/10.1068/p5721

    Article  PubMed  Google Scholar 

  28. Sasaoka T, Mizuhara H, Inui T (2014) Dynamic parieto-premotor network for mental image transformation revealed by simultaneous EEG and fMRI measurement. J Cogn Neurosci 26:232–246. https://doi.org/10.1162/jocn_a_00493

    Article  PubMed  Google Scholar 

  29. Schendan HE, Stern CE (2007) Mental rotation and object categorization share a common network of prefrontal and dorsal and ventral regions of posterior cortex. NeuroImage 35:1264–1277. https://doi.org/10.1016/j.neuroimage.2007.01.012

    Article  PubMed  Google Scholar 

  30. Schendan HE, Stern CE (2008) Where vision meets memory: prefrontal–posterior networks for visual object constancy during categorization and recognition. Cereb Cortex 18:1695–1711. https://doi.org/10.1093/cercor/bhm197

    Article  PubMed  Google Scholar 

  31. Schubotz RI (2007) Prediction of external events with our motor system: towards a new framework. Trends Cogn Sci 11:211–218. https://doi.org/10.1016/j.tics.2007.02.006

    Article  PubMed  Google Scholar 

  32. Sekiyama K (1982) Kinesthetic aspects of mental representations in the identification of left and right hands. Percept Psychophys 32:89–95. https://doi.org/10.3758/BF03204268

    Article  CAS  PubMed  Google Scholar 

  33. Spilman HW, Pinkston D (1969) Relation of test positions to radial and ulnar deviation. Phys Ther 49:837–844. https://doi.org/10.1093/ptj/49.8.837

    Article  CAS  PubMed  Google Scholar 

  34. Sugio T, Inui T, Matsuo K, Matsuzawa M, Glover GH, Nakai T (1999) The role of the posterior parietal cortex in human object recognition: a functional magnetic resonance imaging study. Neurosci Lett 276:45–48. https://doi.org/10.1016/S0304-3940(99)00788-0

    Article  CAS  PubMed  Google Scholar 

  35. Tarr MJ, Pinker S (1989) Mental rotation and orientation-dependence in shape recognition. Cogn Psychol 21:233–282. https://doi.org/10.1016/0010-0285(89)90009-1

    Article  CAS  PubMed  Google Scholar 

  36. Ungerleider LG, Mishkin M (1982) Two cortical visual systems. In: Ingle DJ, Goodale MA, Mansfield RJW (eds) Analysis of visual behavior. MIT Press, Cambridge, pp 549–586

    Google Scholar 

  37. Vannuscorps G, Caramazza A (2015) Typical biomechanical bias in the perception of congenitally absent hands. Cortex 67:147–150. https://doi.org/10.1016/j.cortex.2015.02.015

    Article  PubMed  Google Scholar 

  38. Vannuscorps G, Caramazza A (2016) Typical action perception and interpretation without motor simulation. Proc Natl Acad Sci USA 113:86–91. https://doi.org/10.1073/pnas.1516978112

    Article  CAS  PubMed  Google Scholar 

  39. Warrington EK, James M (1988) Visual apperceptive agnosia: a clinico-anatomical study of three cases. Cortex 24:13–32. https://doi.org/10.1016/S0010-9452(88)80014-5

    Article  CAS  PubMed  Google Scholar 

  40. Warrington EK, Taylor AM (1973) The contribution of the right parietal lobe to object recognition. Cortex 9:152–164. https://doi.org/10.1016/S0010-9452(73)80024-3

    Article  CAS  PubMed  Google Scholar 

  41. Wexler M, Kosslyn SM, Berthoz A (1998) Motor processes in mental rotation. Cognition 68:77–94. https://doi.org/10.1016/S0010-0277(98)00032-8

    Article  CAS  PubMed  Google Scholar 

  42. Wohlschläger A, Wohlschläger A (1998) Mental and manual rotation. J Exp Psychol Hum Percept Perform 24:397–412. https://doi.org/10.1037/0096-1523.24.2.397

    Article  PubMed  Google Scholar 

  43. Wraga M, Thompson WL, Alpert NM, Kosslyn SM (2003) Implicit transfer of motor strategies in mental rotation. Brain Cogn 52:135–143. https://doi.org/10.1016/S0278-2626(03)00033-2

    Article  PubMed  Google Scholar 

  44. Zacks JM (2008) Neuroimaging studies of mental rotation: a meta-analysis and review. J Cogn Neurosci 20:1–19. https://doi.org/10.1162/jocn.2008.20013

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

This work was supported by a Grant-in-Aid for Scientific Research (S) (20220003) (C) (26330174, 18K12014) from the Japan Society for the Promotion of Science (JSPS), and was partially supported by the Center of Innovation Program from Japan Science and Technology Agency (JST).

Author information

Affiliations

  1. Brain, Mind, and KANSEI Sciences Research Center, Hiroshima University, 1-2-3, Kasumi, Minami-ku, Hiroshima, 734-8551, Japan

    Takafumi Sasaoka

  2. Center for Mathematical Modeling and Data Science, Osaka University, Osaka, Japan

    Nobuhiko Asakura

  3. Department of Psychology, Otemon Gakuin University, Osaka, Japan

    Toshio Inui

  4. Graduate School of Informatics, Kyoto University, Kyoto, Japan

    Toshio Inui

Authors
  1. Takafumi Sasaoka
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nobuhiko Asakura
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Toshio Inui
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Takafumi Sasaoka.

Ethics declarations

Conflict of interest

The authors declare that they have no conflicts of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Sasaoka, T., Asakura, N. & Inui, T. Ease of hand rotation during active exploration of views of a 3-D object modulates view generalization. Exp Brain Res 237, 939–951 (2019). https://doi.org/10.1007/s00221-019-05474-6

Download citation

Keywords

  • Active exploration
  • Embodied recognition
  • Mental rotation
  • Object recognition