Abstract
Previous research has revealed changes in the perception of objects due to changes of object-oriented actions. In present study, we varied the arm and finger postures in the context of a virtual reaching and grasping task and tested whether this manipulation can simultaneously affect the perceived size and distance of external objects. Participants manually controlled visual cursors, aiming at reaching and enclosing a distant target object, and judged the size and distance of this object. We observed that a visual–proprioceptive discrepancy introduced during the reaching part of the action simultaneously affected the judgments of target distance and of target size (Experiment 1). A related variation applied to the grasping part of the action affected the judgments of size, but not of distance of the target (Experiment 2). These results indicate that perceptual effects observed in the context of actions can directly arise through sensory integration of multimodal redundant signals and indirectly through perceptual constancy mechanisms.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Changes in visual perception have been reported under diverse conditions in which certain characteristics of the body or of its action varied (for reviews, see Harris et al., 2015; Hommel et al., 2001; Proffitt, 2006; Proffitt & Linkenauger, 2013; Witt, 2011a; Zwickel & Prinz, 2012). These “action specific effects” have been often observed when body and manipulated objects were not in direct contact, such as in tool use, although their origin is not well understood (Firestone & Scholl, 2016; Philbeck & Witt, 2015). We recently noted that these effects resemble well-known interactions between senses, such as between vision and touch, and might thus obey the same known principles of sensory integration of multimodal signals even though the signals are spatially separated (Kirsch et al., 2017; Kirsch & Kunde, 2019a, 2019b; see also Debats et al., 2017a, 2017b; Debats & Heuer, 2018a, 2018b).
Consider that haptic signals can provide information about the same object as visual signals, such as in natural grasping. Importantly, when a discrepancy between both signals is introduced, the haptic signal (e.g., current hand opening) attracts the visually perceived size of the grasped object (Ernst & Banks, 2002). This and similar effects indicate that the object’s percept combines both haptic and visual signals (e.g., Helbig & Ernst, 2007). Note that such a crossmodal discrepancy or conflict is omnipresent in the studies on action-specific perception, which typically vary a body-related variable and hold the visual input constant. Consider also that, in theory, body-related signals can inform observers about object features in many interactions with the environment because body features often covary with environmental features. In throwing an object, for example, features of object motion, such as trajectory or final distance, are strongly correlated with body features associated with setting the object in motion, such as with magnitude and direction of applied forces. Thus, perceptual changes reported in several settings in the context of actions can be considered as outcomes of sensory integration of redundant multimodal signals.
In a series of previous studies, we used a virtual grasping task in which participants repeatedly enclosed visual objects by manually controlled visual cursors and measured the perceived objects’ size and hand opening (Kirsch et al., 2017; Kirsch & Kunde, 2019a, 2019b). We introduced a discrepancy between the visual object size and hand opening (i.e., visual–proprioceptive conflict) and observed mutual attraction biases between proprioceptive and visual signals that varied with relative reliability of visual information. These results confirmed main predictions of the sensory integration approach. An important aspect of these findings is that, unlike the natural grasping, indicators of sensory integration were observed in the absence of direct contact between the body and a distant object (i.e., under conditions conceptually similar to situations in which action specific effects have been frequently reported).
In the present study, we further explored this approach. In particular, we tested whether visual–proprioceptive discrepancies implemented in a virtual reaching and grasping task influence size constancy mechanisms, which ensure the same perception of object size, irrespective of object’s distance. A formal description of size constancy is known as the size–distance invariance hypothesis (SDIH). According to the SDIH, the perceived size of an object (oriented uprightly to the line of sight) is computed by the multiplication of a function of the retinal size with perceived distance: Perceived size = tan (retinal image size) × perceived distance (e.g., Epstein et al., 1961; Kaufman et al., 2006). If proprioception informs vision about distant objects in the context of goal-directed actions, as we suggested, then an impact of visual–proprioceptive discrepancies on the perception of distance should also be expressed in perceived size and vice versa; an impact on perceived size could propagate to the perception of distance (see also, e.g., Sperandio & Chouinard, 2015).
Resolving this issue could help us to better understand the origin of previous observations and to predict new phenomena. For example, a number of studies indicated changes in size perception associated with changes in action ability (e.g., Cañal-Bruland & van der Kamp, 2009; Cooper et al., 2012; Gray et al., 2014; Kirsch et al., 2014; Lee et al., 2012; Wesp et al., 2004; Witt et al., 2008; Witt & Dorsch, 2009; Witt & Proffitt, 2005). Increased ability to hit a golf hole, for example, was associated with larger judgments of object size (e.g., Witt et al., 2008). Moreover, action ability proved to affect the perceived distance in another group of studies (Kirsch & Kunde, 2013a, 2013b; Linkenauger et al., 2015; Witt, 2011b; Witt et al., 2005; Witt & Proffitt, 2008). For example, the length of a virtual arm affected the perceived distance to a target object after reaching experience: A longer arm (i.e., a larger reaching ability) decreased the distance estimates as compared with a shorter arm (Linkenauger et al., 2015). Both observations could originate from changes in distance perception or, on the other hand, from changes in size perception. Moreover, changes in size perception observed in the first group of studies should be accompanied by changes in distance perception and, vice versa, changes in distance perception observed in the second group of studies should be accompanied by changes in size perception. Some indirect evidence for such an effect transfer already exists (Suh & Abrams, 2018; see also Stefanucci & Proffitt, 2009; Stefanucci & Storbeck, 2009; for related observations in the context of emotions).
Below, we report two experiments, in which participants virtually reached and grasped a distant object and judged the distance and size of that object. The rationale was as follows. The cue integration approach suggests that visual and proprioceptive signals are integrated to the extent they provide information about the same object feature (Deroy et al., 2016; Ernst, 2006; Shams & Beierholm, 2010). For example, reaching for an object informs one about the distance of the object, but usually not about its size. Grasping an object, in contrast, informs one about the object size, but not about its distance. Accordingly, the reaching component of a goal-directed movement (“movement distance” hereafter) should serve as a cue for distance perception and thus directly affect the perceived distance of the object, but not its size. The grasping component (“finger aperture” hereafter), in contrast, should serve as a cue for size perception and thus directly affect the perceived size of the object, but not its perceived distance. We varied visual–proprioceptive discrepancy created for either movement distance (Experiment 1) or finger aperture (Experiment 2) and explored whether these predicted effects on perceived object distance and size propagate to the other perceptual dimension according to the size constancy. To anticipate the results, this was the case for Experiment 1, but not for Experiment 2.
Experiment 1
Participants manually controlled a pair of visual cursors aiming at reaching and enclosing a distant rectangular target object (see Fig. 1). We varied the gain of the reaching component of the hand movement (i.e., the transformation of the hand movement distance into the cursor movement distance) and measured the perception of the target distance and size. Previous research suggested that an increase in hand movement distance should increase the perceived distance to the target under the present conditions. For example, increasing the arm’s reach by enlarging the arm avatar in a virtual environment proved to decrease the distance to a target object being reached (Linkenauger et al., 2015; also, see the Introduction and Kirsch & Kunde, 2015, for similar observations). According to the sensory integration approach, this and related effects arise because in reaching a given target object, the combined multimodal estimate of the final hand position, and thus of the position of the target, is closer to the participant’s body when the arm is virtually extended and movement distance decreases. In addition, an increase in hand movement distance was also expected to increase the perceived size of the target according to the SDIH (cf. also Sperandio & Chouinard, 2015).
Methods
Participants
The sample size was estimated based on the data of the first five participants that served as a pilot data set. This initial analysis revealed effect sizes of dz = 0.5 and dz = 1.1 for the effects of hand movement distance on target size and distance, respectively. These values required 26 and seven participants (based on power of 1 − β = 0.80). Based on this estimate, we recruited 34 right-handed participants. Three of them took part in only one of two sessions. The data of another participant was unusable due to technical reasons. These participants were excluded prior to analyses. The final sample included 20 females and 10 males (Mage = 26 years, SD = 4 years). All participants had normal or corrected-to-normal vision. They gave their written informed consent for the procedures and received monetary compensation or course credit for their participation.
As estimation of effect sizes from small sample sizes could be inaccurate, we also computed confidence intervals (80%) for the expected effects based on the pilot data set (see also, e.g., Cocks & Torgerson, 2013; Lakens, 2021). These values amounted to 0.56 ± .76 mm for the size effect and 6.46 ± 4.14 mm for the distance effect. The effects observed in the whole sample of participants corresponded, on average, rather well to the means of the pilot data set and were thus well within their confidence intervals (see Fig. 2). Moreover, the predicted and observed effect sizes were quite similar (size: dz = 0.5 vs. dz = 0.6; distance: dz = 1.1 vs. dz = 0.9). Thus, the pilot sample rather accurately predicted the size and the magnitude of the effects of interest under the present conditions.
The study was conducted in accordance with the ethical guidelines (2016) of the German Psychological Society (DGPs) and has been approved by the local ethics committee (Ethikkommission des Institutes für Psychologie der Humanwissenschaftlichen Fakultät der Julius-Maximilians-Universität Würzburg, GZ 2019-04).
Apparatus
The experiment was performed in a dark experimental room. Stimuli were presented on a 19-in. monitor (Fujitsu Siemens P19-1; 1,280 × 1,024 pixels; 1 pixel = 0.294 mm; 60 Hz) that was placed horizontally in front of the participants, whose heads were supported by a chin rest (see the upper part of Fig. 1). The height of the chin rest was fix (about 20 cm above the level of the monitor) so that the distance between the eyes and the center of the monitor was about 90 cm. Participants used their right hand to manipulate a movement device that allowed recording of hand and finger movements. The movement device was mainly composed of a graphics tablet (Intuos 4 A4, Wacom), a digitizing stylus and a pincer-like construction (LEGO building blocks) that held the stylus up on the tablet and was moveable along a track (see the middle part of Fig. 1). Participants placed their fingers on two U-shaped plastic plates, which were fixed to the pincer construction and were thus mirror-symmetrically interlocked. The index and the middle fingers were bound together and placed on one plate, the thumb on the other. Moving the fingers together/apart moved the stylus to the left/right. Moving the hand forward/backward moved the stylus forward/backward. By recording the position of the stylus on the tablet, we thus were able to extract information about hand and finger movements. The vision of the hand during the movements (as well as of the movement device) was prevented by using a black cover positioned above the tablet. Perceptual judgments were made by pressing buttons of a computer mouse with the left hand. Auditory stimuli were presented through headphones.
Stimuli and trial procedure
The lower part of Fig. 1 illustrates the main trial events. At the beginning of each trial participants moved their fingers together and placed their hand at a start position (the location of a mechanical stop close to participants’ body). During this movement, the background of the display was always gray. After the start position was reached a short beep tone was presented, and a pair of green cursors (dots of 3 mm in size) and a first rectangular target object appeared at the lower and upper part of the display respectively. The target object was composed of a number of black unfilled circles (1.2 mm in diameter; density ~ 12 dots per cm2) randomly distributed along the rectangle. The width of the rectangle was always 3.1 cm. Its height and its location varied (see Design). Participants had to enclose the target object by the cursors (i.e., to virtually reach and grasp the object), and thus had to move their hand forward and the fingers apart until the cursors reach the edges of the object. A durable clicking noise was presented and the cursors disappeared when the correct hand and finger postures were adopted. Participants were asked to maintain this body state for 1 s and to perform corrective movements when the cursors left the edges of the target (i.e., when the hand location or the finger aperture changed). Then, the target object disappeared and participants had to move the hand back to the start position. After the start position was reached, a beep tone, the cursors and a second target object were presented. The second target object has to be virtually reached and grasped in the same way as the first target object. This movement was now followed by a blue question mark (5 mm), in response to which a perceptual judgment about the size or the distance of the target objects was made. When a judgment was made before the question mark appeared or when the finger or movement distance changed before the judgment was made an error display was presented and the trial was repeated.
Design
To measure size and distance perception we used a method of constant stimuli. One of the target objects served as a standard stimulus, another target object served as a test stimulus. The critical experimental variation was related to the standard stimulus. In particular, we varied the transformation of the hand movement distance to the cursor movement distance (i.e., gain) so that the same target object (4.3 × 3.1 cm, middle of the display) was reached either by a rather small hand movement (7 cm; “small movement distance”) or by a rather large hand movement (15 cm; “large movement distance”; see also Fig. 2a). Movements to the target object that served as a test stimulus were not transformed—that is, the distances of the hand movements corresponded to the distances covered by the cursors displayed on the monitor (and were 11 cm for the targets presented in the middle of the display).
There were two types of blocks of trials, “distance judgment blocks” and “size judgment blocks”, which differed in the characteristics of the test stimulus and in the required judgment. In the distance judgment blocks, the target object was always of the same size (4.3 × 3.1 cm). Its distance, however, varied around the distance of the target object used in the standard stimulus condition (middle of the display) from −4.5 cm (i.e., 4.5 cm closer to the observer) to +4.5 cm (i.e., 4.5 cm farther apart) in ten equidistant steps. Participants had to estimate whether the first (left mouse button) or the second (right mouse button) target object was farther away.
In the size judgment blocks, the distance of the target object was always the same (middle of the display). Its height, however, varied around the height of the target object used in the standard stimulus condition (4.3 × 3.1 cm) from −1.8 cm (i.e., 1.8 cm smaller than the standard stimulus) to +1.8 cm (larger than the standard stimulus) in ten equidistant steps. Participants had to estimate whether the first (left mouse button) or the second (right mouse button) target object was larger.
The experiment was divided into two separate sessions taking place on two different days and lasting about 1.2 h on average. Each session included four distance judgment blocks and four size judgement blocks. The order of blocks was DSDSDSDS (D = distance judgment block, S = size judgment block) for 15 participants and SDSDSDSD for fourteen participants in each of the sessions. One participant was exposed to each of these orders due to inattention of the experimenter.
Each block included 40 trials. In one half of the trials, the first target object was a standard stimulus and the second target object a test stimulus. For the other trials, the reverse was true. The order of these and all other conditions (2 movement distance conditions × 10 test stimuli) was random. Overall, participants performed 16 repetitions of each movement distance and test stimulus condition for each type of block. At the beginning of each session, participants performed eight practice trials for each block type, which were not included in the analysis.
Data analysis
The proportion of trials in which the test stimulus was judged as larger in the size judgment blocks and farther away in the distance judgment blocks was computed as a function of the test size and movement distance. Two participants were excluded from further analyses due to very low discrimination performance in the distance blocks (see participants 18 and 23 in Fig. S1 in the Supplementary Materials). A local model-free fitting procedure was applied to fit psychometric functions (Zychaluk & Foster, 2009). The point of subjective equality (PSE) was determined for each movement distance and type of judgment by estimating the test value at which the test stimulus was judged as larger/farther away with a frequency of 50%. The raw data have been made publicly available (https://osf.io/3unkb/).
We also quantified the predictions of the SDIH. That is, based on the impact of hand movement distance on the target distance judgments we predicted its effect on target size judgments. For this purpose, the perceived horizontal distance to the target’s center (a’) was transformed to the perceived eye-target distance (c’) according to Pythagoras's theorem for each participant and each movement distance condition (see also the right upper part of Fig. 1):
where a' = a + PSE; \( a=\sqrt{c^2-{b}^2} \); b = 325 mm; and c = 900 mm.
The to be perceived size of the target was then computed for each movement distance condition using the following formula (see, e.g., Kilpatrick & Ittelson, 1953):
where s = 43 mm.
Hypotheses
The PSE was expected to be larger for the large movement distance than for the small movement distance. This should be true for each type of judgment.
Results and discussion
The PSE was larger for the large than for the small movement distance condition in the judgments of target distance, t(27) = 4.68, p < .001, as well as in the judgments of target size, t(27) = 3.32, p = .003, as predicted (see Fig. 2b–c for mean PSEs and the corresponding judgment data, and Fig. S1 in the Supplementary Materials for individual judgment data). These results suggest that the participants combined the proprioceptive with the visual cues in the estimation of target distance and that this multimodal percept of target distance affected the perceived size of the target object.
We also explored whether there is a correlation between both effects across the participants. After excluding two obvious outliers for this analysis (whose distance effect was more than 2.5 standard deviation larger than the mean) there was a trend towards a positive correlation, r = .339, p = .090, indicating that participants who showed a large effect in the distance blocks where those who also showed a large effect in the size blocks (see Fig. 2d).Footnote 1 This is another indicator that the impact of proprioception on the distance perception propagated to the size perception. Participants with larger effects were likely those who weighted the proprioceptive information more strongly.
The SDIH predicted, however, a slightly smaller magnitude of the effect on size judgments (M = 0.3 mm, SD = 0.3) than we observed (M = 0.8 mm, SD = 1.2), t(27) = 2.0, p = .056. There may be at least two reasons for this trend. It is possible that our approximation to the SDIH and/or measurements did not capture the size constancy exactly. Also, since the impact of different cues can depend on task conditions (e.g., Cutting & Vishton, 1995) proprioception could have received slightly more weight in the size judgment blocks than in the distance judgment blocks (also see the General Discussion).
Experiment 2
In Experiment 2, we used the same virtual reaching and grasping task as in Experiment 1, but now varied the gain of the grasping component of the hand movement (i.e., finger aperture). An increase in finger aperture was expected to increase the perceived size of the target (see also Kirsch et al., 2017; Kirsch & Kunde, 2019a, 2019b; for related observations). This should be so because the combined multimodal estimate of the target size should be smaller for the small than for the large finger aperture. Moreover, an increase in finger aperture could also increase the perceived distance of the target according to the SDIH. However, matters are complicated as the SDIH is often violated when size and distance judgments are concurrently collected in the same experiment and the apparent object’s size varies (Epstein et al., 1961). For example, the moon appears as larger at the horizon than at the zenith (the moon illusion), while it is concurrently judged as being closer at the horizon than at the zenith. This inconsistency, according to the SDIH, is called the size distance paradox (SDP; Epstein et al., 1961; Gruber, 1954; Kaufman et al., 2006; Ono et al., 1974). We were thus prepared to encounter both effect directions.
Methods
Participants
The sample size was determined to be 32 participants prior to data collection. The sample included twenty-four females and eight males (Mage = 26 years, SD = 6 years). All participants were right-handed and had normal or corrected-to-normal vision. They gave their written informed consent for the procedures and received monetary compensation or course credit for their participation.
Apparatus
The apparatus was the same as in Experiment 1.
Stimuli and trial procedure
Stimuli and trial procedure were the same as in Experiment 1.
Design
The design was the same as in Experiment 1, except for the following change. The critical experimental variation was now related to the transformation of the distance between the fingers into the distance between the cursors. In the “small finger aperture” condition, the distance between the fingers was 1.1 cm smaller than the size of the target object (4.3 cm). In the “large finger aperture” condition, the distance between the finger was 1.1 cm larger than the size of the target object. This finger aperture variation was applied only for movements to the target object that served as a standard stimulus. Enclosing of the target object that served as a test stimulus was not transformed (i.e., the distances between the fingers corresponded to the size of the target object displayed on the monitor). Also, the reaching component of the movements was always the same (i.e., hand movement distance always amounted about 11 cm for the targets presented in the middle of the display; also see Experiment 1).
Data analysis
Data analysis was performed in the same way as in Experiment 1. The only difference was that the factor finger aperture was used in Experiment 2 instead of the factor movement distance used in Experiment 1. One participant had to be excluded due to very low discrimination performance in the size blocks (see Participant 24 in Fig. S2 in the Supplementary Materials).
We again quantified the predictions of the SDIH. Here, the impact of finger aperture on target distance judgments was predicted based on its effect on target size judgments. The perceived eye-target distance (c’) was initially computed for each finger aperture condition using the following formula (see e.g., Kilpatrick & Ittelson, 1953):
where s' = s + PSE; s = 43 mm; and c = 900 mm.
Then, the to be perceived horizontal target distance (a’) was derived for each finger aperture according to:
where b = 325 mm.
Hypotheses
The PSE of size judgments was expected to be larger for the large finger aperture than for the small finger aperture. For target distance judgments, the PSE should increase for the large finger aperture as compared with the small finger aperture according to the SDIH, but to decrease according to the SDP.
Results and discussion
The PSE was larger for the large than for the small finger aperture in the judgments of target size, t(30) = 5.73, p < .001, but there was no difference between the finger apertures in the judgments of target distance, t(30) = .15, p = .882 (see Fig. 3b–c for mean PSEs and the corresponding judgment data, and Fig. S2 in the Supplementary Materials for individual judgment data). These results suggest that the participants combined their finger aperture with the visual cues in the estimation of target size and that this multimodal percept of target size did not affect the perceived distance of the target object.
We again explored whether there is a correlation of the difference between finger apertures measured in the distance judgment blocks and that measured in the size blocks across the participants. There was no indication for such a relation, r = .048, p = .798 (see Fig. 3d). This is another indicator that the impact of proprioception on the size perception did not propagate to the distance perception.
The SDIH predicted a mean PSE difference of 36.9 mm (SD = 35.9) for the target distance judgments between both finger aperture conditions. This value was far above the observed difference (M = 0.1 mm, SD = 2.9), t(30) = 5.67, p < .001. Although we did not quantify the SDP explicitly, we also did not observed evidence for the SDP as there were no signs of an inverse relation between perceived size and distance. Thus, neither the SDIH nor the SDP were supported by the results.
General discussion
The present study explored the origin of action specific effects in visual perception. Based on a sensory integration approach we hypothesized that the perception of distant objects in the context of actions is directly affected via exploitation and integration of redundant multimodal signals and tested whether these direct influences can lead to indirect perceptual effects via size constancy mechanisms. In a virtual reaching and grasping task, we introduced a crossmodal conflict between visual object features and proprioceptive object information provided by the reaching (Experiment 1) or grasping (Experiment 2) part of the action and measured the effects of these manipulations on the perception of a target object.
An increase in proprioceptive object distance increased the perceived object distance in Experiment 1, whereas an increase in proprioceptive object size increased the perceived object size in Experiment 2. These results are in accordance with direct effects of sensory integration on the perception of distant objects. In addition, an increase in proprioceptive object distance also increased the perceived object size. This outcome suggests an indirect influence of sensory integration on perception via size constancy mechanisms. An increase in proprioceptive object size, however, did not affect the perceived object distance.
There may be several reasons for why changes in size perception did not propagate to the changes in distance perception. One idea stems from the research on the SDP that is often explained by a two-stage mechanism (e.g., Coren & Aks, 1990; Higashiyama, 1979). Initially, distance cues are used to scale the retinal image size and thus determine perceived object’s size in accord with the SDIH. At this stage, if distance cues signal a larger distance an object (of constant retinal size) is perceived as larger. Then, perceived size is used as a cue for judgments of object’s distance while distance cues are ignored. At this second stage, apparently larger objects, which were associated with a larger distance initially, are now judged as closer. This presumably occurs because the physical distance usually increases when the retinal objects’ size decreases. Accordingly, it has been argued that such distance judgments that violate the SDIH reflect participants’ cognitive responses (i.e., a response bias), rather than being perceptual in nature (Kaufman et al., 2006; Kaufman et al., 2007; Mon-Williams & Tresilian, 1999; see also Gogel & Sturm, 1971; Ono et al., 1974, for similar suggestions). This approach indicates that distance cues used for size and distance judgments do not need to be the same and that distance perception does not necessarily rely on perceived size. In the present study, we combined a two-alternative forced-choice procedure with the method of constant stimuli. This approach is rather immune to response biases (see also Kaufman et al., 2007). Thus, assuming that size constancy mechanisms hold for the perceived size but not for the perceived distance and that we measured genuine perception would explain why an impact of perceived size (affected by proprioception) on perceived distance was not observed.
Alternatively, it is also possible that the size constancy holds for both perceived distance and size. However, the introduced conflict between hand opening and visual/ocular signals could have been treated differently for the perception of size and distance. This conflict could be tolerated in size perception, but perhaps not in distance perception. In particular, while proprioceptive information received some weight in the integrated percept of size, it could have been received no weight at all in the perception of distance (see, e.g., Brenner & van Damme, 1999). This could be because relatively small errors in apparent size could cause relatively large errors in distance perception (see also the SDIH predictions for Experiment 1 and Experiment 2). This would be in accordance with a common assumption that sensory cues are used and weighted according to given task conditions (e.g., Cutting & Vishton, 1995; Landy et al., 1995).
Previous studies manipulating action related variables revealed effects on both, size and distance perception (see also the Introduction). The present results suggest that these observations might be of a similar origin, at least to a certain degree. In particular, using tools extending observers’ reachability proved to decrease the perceived distance to a distant target object (e.g., Linkenauger et al., 2015; Witt, 2011b; see also Introduction). This effect should be accompanied by an increase in perceived object size given the present results. Such an effect has in fact been reported (Suh & Abrams, 2018). Moreover, in many sports-like tasks, such as archery, in which action ability affected size perception, one might wonder how an action such as shooting an arrow, whose obvious purpose is to bridge a certain distance, can affect the perceived size of an object (Lee et al., 2012; see also the Introduction). One possibility indicated by the present results is that in such situations action related variables primarily affect distance perception and that the effects on perceived size are a by-product of the size constancy. These considerations are of course tentative and should be considered with caution. In theory, two originally unrelated arbitrary signals can be integrated after a systematic statistical relation between them is established (Ernst, 2007; Kaliuzhna et al., 2015). Accordingly, in principle, any sensory features of an action can be assumed to be directly linked to any visual characteristics of an object based on their statistical co-occurrence.
Perceptual effects observed in the context of actions have been often discussed within two theoretical frameworks. First, action-related variables, such as ability, have been suggested to scale early sensory processing (e.g., Proffitt & Linkenauger, 2013; Witt, 2011a). Changing these variables—that is, the reference scale—is assumed to change the percept. Second, it has been proposed that actions and perceptions are commonly coded in cognition (e.g., Hommel et al., 2001). Here, perceptual changes can emerge when features of motor and perceptual codes overlap. The present results do not contradict these theories. However, specific links to size constancy in general and to the present and related task situations in particular cannot be inferred from these ideas, at least not without additional assumptions. The sensory integration approach, in contrast, puts action related effects into context of a broad traditional research on perception and thus allows predictions that are more specific.
To conclude, the present results indicate that perceptual effects observed in the context of actions can be a direct consequence of sensory integration of bodily and visual signals relating to the same feature of an object. However, such effects can propagate to a different object feature through perceptual constancy mechanisms. In that case, a certain body-related characteristic of an object can indirectly affect a different object characteristic.
Notes
Excluding these participants from the main analyses did not change the results substantially. The PSE was still significantly larger for the small movement distance in the distance judgment blocks, t(25) = 8.71, p < .001, as well as in the size blocks, t(25) = 4.10, p < .001.
References
Brenner, E., & van Damme, W. J. M. (1999). Perceived distance, shape and size. Vision Research, 39, 975–986. https://doi.org/10.1016/S0042-6989(98)00162-X
Cañal-Bruland, R., & van der Kamp, J. (2009). Action goals influence action-specific perception. Psychonomic Bulletin & Review, 16(6), 1100–1105. https://doi.org/10.3758/PBR.16.6.1100
Cocks, K., & Torgerson, D.J. (2013). Sample size calculations for pilot randomized trials: A confidence interval approach. Journal of Clinical Epidemiology, 66, 197–201. https://doi.org/10.1016/j.jclinepi.2012.09.002
Cooper, A. D., Sterling, C. P., Bacon, M. P., & Bridgeman, B. (2012). Does action affect perception or memory? Vision Research, 62, 235–240. https://doi.org/10.1016/j.visres.2012.04.009
Coren, S., & Aks, D. J. (1990). Moon illusion in pictures: A multimechanism approach. Journal of Experimental Psychology: Human Perception & Performance, 16(2), 365–380. https://doi.org/10.1037/0096-1523.16.2.365
Cutting, J. E., & Vishton, P. M. (1995). Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth. In W. Epstein & S. Rogers (Eds), Handbook of perception and cognition. Vol 5; Perception of space and motion (pp. 69–117). Academic Press, DOI: https://doi.org/10.1097/00001665-199511000-00004.
Debats, N. B., Ernst, M. O., & Heuer, H. (2017a). Perceptual attraction in tool-use: Evidence for a reliability-based weighting mechanism. Journal of Neurophysiology, 117, 1569–1580. https://doi.org/10.1152/jn.00724.2016
Debats, N. B., Ernst, M. O., & Heuer, H. (2017b). Kinematic cross-correlation induces sensory integration across separate objects. European Journal of Neuroscience, 46, 2826–2834. https://doi.org/10.1111/ejn.13758
Debats, N. B., & Heuer, H. (2018a). Sensory integration of actions and their visual effects is based on both online and prior causality evidence. Scientific Reports, 8, 9796. https://doi.org/10.1038/s41598-018-28251-x
Debats, N. B., & Heuer, H. (2018b). Sensory integration of movements and their visual effects is not enhanced by spatial proximity. Journal of Vision, 18(11), 1–16. https://doi.org/10.1167/18.11.15
Deroy, O., Spence, C., & Noppeney, U. (2016). Metacognition in multisensory perception. Trends in Cognitive Sciences, 20(10), 736–747. https://doi.org/10.1016/j.tics.2016.08.006
Epstein, W., Park, J., & Casey, A. (1961). The current status of the size–distance hypotheses. Psychological Bulletin, 58(6), 491–514. https://doi.org/10.1037/h0042260
Ernst, M. O. (2006). A Bayesian view on multimodal cue integration. In G. Knoblich, I. M. Thornton, M. Grosjean, & M. Shiffrar (Eds.), Human body perception from the inside out (pp. 105–131). Oxford University Press.
Ernst, M. O. (2007). Learning to integrate arbitrary signals from vision and touch. Journal of Vision, 7, 1–14. https://doi.org/10.1167/7.5.7
Ernst, M. O., & Banks, M. S. (2002). Human integrate visual and haptic information in a statistically optimal fashion. Nature, 415(24), 429–433.https://doi.org/10.1167/7.5.7
Firestone, C., & Scholl, B. J. (2016). Cognition does not affect perception: Evaluating the evidence for ‘top-down’ effects. Behavioral and Brain Sciences, 1–72. Advance online publication. https://doi.org/10.1017/S0140525X15000965
Gogel, W. C., & Sturm, R. D. (1971). Directional separation of the size cue to distance. Psychologische Forschung, 35, 57–80. https://doi.org/10.1007/BF00424475
Gray, R., Navia, J. A., & Allsop, J. (2014). Action-specific effects in aviation: What determines judged runway size? Perception, 43(2/3), 145–154. https://doi.org/10.1068/p7601
Gruber, H. E. (1954). The relation of perceived size to perceived distance. The American Journal of Psychology, 67(3), 411–426, DOI: https://doi.org/10.2307/1417933.
Harris, L. R., Carnevale, M. J., D’Amour, S., Fraser, L. E., Harrar, V., Hoover, A. E. N., Mander, C., & Pritchett, L. M. (2015). How our body influences our perception of the world. Frontiers in Psychology, 6, 819. https://doi.org/10.3389/fpsyg.2015.00819
Helbig, H. B., & Ernst, M. O. (2007). Knowledge about a common source can promote visual-haptic integration. Perception, 36, 1523–1533. https://doi.org/10.1068/p5851
Higashiyama, A. (1979). The perception of size and distance under monocular observation. Perception & Psychophysics, 26(3), 230–234. https://link.springer.com/content/pdf/10.3758/BF03199873.pdf, DOI: https://doi.org/10.3758/BF03199873
Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The theory of event coding (TEC): A framework for perception and action planning. Behavioral and Brain Sciences, 24(5), 849–878. https://doi.org/10.1017/S0140525X01000103
Kaliuzhna, M., Prsa, M., Gale, S., Lee, S. J., & Blanke, O. (2015). Learning to integrate contradictory multisensory self-motion cue pairings. Journal of Vision, 15(1), 1–15. https://doi.org/10.1167/15.1.10
Kaufman, L., Kaufman, J. H., Noble, R., Edlund, S., Bai, S., & King, T. (2006). Perceptual distance and the constancy of size and stereoscopic depth. Spatial Vision, 19(5), 439–457. https://doi.org/10.1163/156856806778457377
Kaufman, L., Vassiliades, V., Noble, R., Alexander, R., Kaufman, J., & Edlund, S. (2007). Perceptual distance and the moon illusion. Spatial Vision, 20(1/2), 155–175. https://doi.org/10.1163/156856807779369698
Kilpatrick, F. P., & Ittelson, W. H. (1953). The size-distance invariance hypothesis. Psychological Review, 60(4), 223–231.
Kirsch, W., Herbort, O., Ullrich, B., & Kunde, W. (2017). On the origin of body-related influences on visual perception. Journal of Experimental Psychology: Human Perception and Performance, 43(6), 1222–1237. https://doi.org/10.1037/xhp0000358
Kirsch, W., Königstein, E., & Kunde, W. (2014). Hitting ability and perception of object’s size: Evidence for a negative relation. Attention, Perception, & Psychophysics, 76, 1752–1764. https://doi.org/10.3758/s13414-014-0685-4
Kirsch, W., & Kunde, W. (2013a). Moving further moves things further away in visual perception: Position-based movement planning affects distance judgment. Experimental Brain Research, 226(3), 431–440. https://doi.org/10.1007/s00221-013-3455-y
Kirsch, W., & Kunde, W. (2013b). Visual near space is scaled to parameters of current action plans. Journal of Experimental Psychology: Human Perception and Performance, 39(5), 1313–1325.
Kirsch, W., & Kunde, W. (2015). Arm movement as a cue for the estimation of visual location. Perceptual & Motor Skills, 121(1), 149–162. https://doi.org/10.2466/25.24.PMS.121c14x3
Kirsch, W., & Kunde, W. (2019a). Multisensory integration in virtual interactions with distant objects. Scientific Reports, 9, Article 17362. https://doi.org/10.1038/s41598-019-53921-9.
Kirsch, W., & Kunde, W. (2019b). On perceptual biases in virtual object manipulation: Signal reliability and action relevance matter. Attention, Perception & Psychophysics, 81(8), 2881–2889. https://doi.org/10.3758/s13414-019-01783-8
Lakens, D. (2021). Sample size justification. Unsubmitted preprint. https://doi.org/10.31234/osf.io/9d3yf
Landy, M.S., Maloney, L.T., Johnston, E.B., & Young, M. (1995). Measurement and modeling of depth cue combination: in defense of weak fusion. Vision Research, 35, 389–412. https://doi.org/10.1016/0042-6989(94)00176-M
Lee, Y., Lee, S., Carello, C., & Turvey, M.T. (2012). An archer’s perceived form scales the “hitableness” of archery targets. Journal of Experimental Psychology: Human Perception & Performance, 38(5), 1125–1131. https://doi.org/10.1037/a0029036
Linkenauger, S. A., Bülthoff, H. H., & Mohler, B. J. (2015). Virtual arm’s reach influences perceived distances but only after experience reaching. Neuropsychologia, 70, 393–401. https://doi.org/10.1016/j.neuropsychologia.2014.10.034
Mon-Williams, M., & Tresilian, J. R. (1999). The size–distance paradox is a cognitive phenomenon. Experimental Brain Research, 126, 578–582. https://doi.org/10.1007/s002210050766
Ono, H., Muter, P., & Mitson, L. (1974). Size–distance paradox with accommodative micropsia. Perception & Psychophysics, 15(2), 301–307. https://doi.org/10.3758/BF03213948
Philbeck, J. W., & Witt, J. K. (2015). Action-specific influences on perception and postperceptual processes: Present controversies and future directions. Psychological Bulletin, 141, 1120–1144. https://doi.org/10.1037/a0039738
Proffitt, D. R. (2006). Embodied perception and the economy of action. Perspectives on Psychological Science, 1, 110–122. https://doi.org/10.1111/j.1745-6916.2006.00008.x
Proffitt, D. R., & Linkenauger, S. A. (2013). Perception viewed as a phenotypic expression. W. Prinz (Ed.), Tutorials in action science (pp. 171–198). MIT Press.
Shams, L., & Beierholm, U. R. (2010). Causal inference in perception. Trends in Cognitive Sciences, 14(9), 425–432. https://doi.org/10.1016/j.tics.2010.07.001
Sperandio, I., & Chouinard, P. A. (2015). The mechanisms of size constancy. Multisensory Research 28, 253–283, DOI: https://doi.org/10.1163/22134808-00002483.
Stefanucci, J. K., & Proffitt, D. R. (2009). The roles of altitude and fear in the perception of heights. Journal of Experimental Psychology: Human Perception & Performance, 35, 424–438. https://doi.org/10.1037/a0013894
Stefanucci, J. K., & Storbeck, J. (2009). Don’t look down: Emotional arousal elevates height perception. Journal of Experimental Psychology: General, 138, 131–145. https://doi.org/10.1037/a0014797
Suh, J., & Abrams, R.A. (2018). Tool use produces a size illusion revealing action-specific perceptual mechanisms. Acta Psychologica, 183, 10–18. https://doi.org/10.1016/j.actpsy.2017.12.003
Wesp, R., Cichello, P., Gracia, E. B., & Davis, K. (2004). Observing and engaging in purposeful actions with objects influences estimates of their size. Perception & Psychophysics, 66(8), 1261–1267. https://doi.org/10.3758/BF03194996
Witt, J. K. (2011a). Action’s effect on perception. Current Directions in Psychological Science, 20(3), 201–206. https://doi.org/10.1177/0963721411408770
Witt, J. K. (2011b). Tool use influences perceived shape and perceived parallelism, which serve as indirect measures of perceived distance. Journal of Experimental Psychology: Human Perception and Performance, 37, 1148–1156. https://doi.org/10.1037/a0021933
Witt, J. K., & Dorsch, T. E. (2009). Kicking to bigger uprights: Field goal kicking performance influences perceived size. Perception, 38(9), 1328–1340, DOI: https://doi.org/10.1068/p6325.
Witt, J. K., Linkenauger, S. A., Bakdash, J. Z., & Proffitt, D. R. (2008). Putting to a bigger hole: Golf performance relates to perceived size. Psychonomic Bulletin & Review, 15(3), 581–585. https://doi.org/10.3758/PBR.15.3.581
Witt, J. K., & Proffitt, D. R. (2005). See the ball, hit the ball: Apparent ball size is correlated with batting average. Psychological Science, 16(12), 937–938. https://doi.org/10.1111/j.1467-9280.2005.01640.x
Witt, J. K., & Proffitt, D. R. (2008). Action-specific influences on distance perception: A role for motor simulation. Journal of Experimental Psychology: Human Perception and Performance, 34, 1479–1492. https://doi.org/10.1037/a0010781
Witt, J. K., Proffitt, D. R., & Epstein, W. (2005). Tool use affects perceived distance, but only when you intend to use it. Journal of Experimental Psychology: Human Perception and Performance, 31,880–888. https://doi.org/10.1037/0096-1523.31.5.880
Zwickel, J., & Prinz, W. (2012). Assimilation and contrast: the two sides of specific interference between action and perception. Psychological Research, 72(2), 171–182. https://doi.org/10.1007/s00426-011-0338-3
Zychaluk, K., & Foster, D. H. (2009). Model-free estimation of the psychometric function. Attention, Perception, & Psychophysics, 71, 1414–1425. https://doi.org/10.3758/APP.71.6.1414
Author note
This research was supported by Grant KI 1620/3-1 awarded to W. Kirsch by the German Research Council (DFG). The data are publicly available via the Open Science Framework (https://osf.io/3unkb/).
Funding
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Corresponding author
Additional information
Open Practices Statement
The data for all experiments are available (https://osf.io/3unkb/) and none of the experiments was preregistered.
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
ESM 1
(DOCX 848 kb)
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Kirsch, W., Kunde, W. & Herbort, O. Impact of proprioception on the perceived size and distance of external objects in a virtual action task. Psychon Bull Rev 28, 1191–1201 (2021). https://doi.org/10.3758/s13423-021-01915-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3758/s13423-021-01915-y