In autism spectrum disorder (ASD), atypical integration of visual depth cues may be due to flattened perceptual priors or selective fusion. The current study attempts to disentangle these explanations by psychophysically assessing within-modality integration of ordinal (occlusion) and metric (disparity) depth cues while accounting for sensitivity to stereoscopic information. Participants included 22 individuals with ASD and 23 typically developing matched controls. Although adults with ASD were found to have significantly poorer stereoacuity, they were still able to automatically integrate conflicting depth cues, lending support to the idea that priors are intact in ASD. However, dissimilarities in response speed variability between the ASD and TD groups suggests that there may be differences in the perceptual decision-making aspect of the task.
Although Autism Spectrum Disorders (ASD) are generally associated with social difficulties, recent changes to diagnostic criteria (i.e. DSM-V) have led to a renewed interest in the sensory symptoms within this population. One sensory domain which has commonly been reported to show distinct differences is visual perception. Specifically, it has been suggested that atypical integration of visual information may explain why individuals with ASD perform better (Bertone et al. 2005; O’Riordan et al. 2001) or worse (Bertone et al. 2003; Van Boxtel and Lu 2013) than typically developing individuals on some perceptual tasks.
Theories of Perception in Autism
Currently, there is not a consensus on how to explain the atypical perceptual processing observed in autism. One account proposed by Pellicano and Burr (2012) to explain sensory integration difficulties in ASD, including perception, takes a Bayesian approach. In typical individuals, Bayesian models of perception propose that the perceptual system generates the most probable interpretation of the world around us by combining sensory information with prior expectations, underlying biases which shape overall perception. Pellicano and Burr (2012) argue that individuals with ASD are less influenced by prior expectations due to having weaker or flattened “perceptual priors” meaning that previous experience has less influence on perception. This theory struggles to explain why sometimes individuals with autism show “selective fusion”: the integration of sensory information in some conditions but not others.
An alternative framework called Enhanced Perceptual Functioning theory [EPF, Mottron and Burack (2001); Mottron et al. (2006)] is perhaps better able to account for the flexible integration of visual information observed in the literature by those with ASD. EPF theory specifies that lower level (sensory) processing in ASD is enhanced, which results in a reduced influence of higher level (or top–down) processes allowing for greater flexibility when integrating visual information. If higher-level visual information is not advantageous in completing a task, then it will not be integrated by those with ASD (unlike typically developing individuals), whereas if it is necessary then it will be integrated. One area of visual processing that could prove valuable in testing these theories is the combination of different cues (or sources of information) to depth.
Binocular Disparity and Other Cues to Depth
While an overall perception of depth is elicited via combination of a number of different cues, one cue in particular, binocular disparity, has been shown to produce a strong sensation of depth even when other, highly reliable cues to depth are present (Hillis et al. 2004; Johnston et al. 1993; Knill and Saunders 2003; Lovell et al. 2012; Vuong et al. 2006). Binocular disparity occurs due to the eyes’ horizontal separation, causing each to register a slightly different view of the world. The brain exploits these differences, or disparities, in order to retrieve a three-dimensional layout of our surroundings.
The sensation of depth elicited by binocular disparity is termed stereopsis, and stereoscopic acuity (‘stereoacuity’) exhibits a large amount of individual variation in the ASD population, with a higher proportion of those with ASD being less sensitive to binocular disparity (Scharre and Creedon 1992; Adams et al. 2010; Anketell et al. 2013; Coulter et al. 2013; Black et al. 2013), In addition, there are also higher rates of strabismus in the ASD population (Kaplan et al. 1999; Scharre and Creedon 1992; Milne et al. 2009) which can impair binocular vision. While stereopsis is not the only cue to depth, its contribution to the overall percept of depth is notable (Saladin 1998); and it is arguable that impairment in the ability to utilise this cue results in a qualitatively different depth experience which can affect judgement of space (Barry 2009).
Accurate judgement of depth relies on the processing and integration of multiple cues including binocular disparity (mentioned above) but also information from texture and occlusion (Howard and Rogers 2012). The perception of texture patterns varies systematically with depth and thus can be used to estimate distance. Occlusion (discussed below), where one object is in front of another, puts strict limits on depth ordering.
Cue Combination for Depth Perception in Autism
A recent study conducted by Bedford (2016) investigated how young people with autism or who were typically-developing integrated binocular disparity and texture gradient information. They did this by asking them to judge whether two surfaces that were tilted away from the observer had the same or different degree of slant. The cues to depth-defined slant were presented either alone or together; when both cues were available they could be either congruent (in agreement, specifying the same amount of slant) or conflicting (specifying different amounts of slant).
Bedford et al. (2016) found that typically-developing adolescents’ ability to judge slant was improved when both cues were available and they were congruent, compared to judgement of depth-defined slant using either cue alone. This benefit of combining sensory estimates is thought to be due to a reduction in uncertainty due to averaging (Hillis et al. 2002, 2004). When the cues were again presented together but were conflicting and signalled different slants, this reduced the typically-developing adolescents’ precision. This is because they could not help but average the cues, even when this made them worse at the task (determining depth-defined slant)—this deleterious effect is known as ‘mandatory fusion’ (Hillis et al. 2002).
Those with an ASD were able to integrate disparity and texture cues when congruent (showing increased judgement precision), but unlike their typical peers, they did not show the effects of mandatory fusion. That is, when cues were conflicting, the thresholds of those with ASD were identical to those obtained for their single best cue. Bedford et al. (2016) termed this ‘selective fusion’. The authors concluded that perception in individuals with ASD was more flexible and less governed by top-down feedback (see also Smith et al. 2015).
Individual Differences in Stereoacuity
Both Bedford et al. (2016) and studies of typical depth cue integration (Hillis et al. 2002, 2004; Johnston et al. 1993; Knill and Saunders 2003; Landy et al. 1995) either explicitly state that their observers passed a clinical stereotest or state more generally that participants had no known stereo-vision problems/performed sufficiently on experimental tasks involving the use of stereo-vision for depth judgements. However, individual differences are abundant in depth perception research (Hillis et al. 2002; Knill and Saunders 2003; McKee 1983), and it has been suggested that the combination and relative weighting of cues may be largely observer-dependent (Nefs et al. 2010; Zalevski et al. 2007).
Though there is an emerging interest in the role of such individual differences in how depth cues are utilised and combined (Wilmer 2008), and it has been hypothesised that those with poor stereopsis may over-weight monocular depth cues (Hahn et al. 2010), the ramifications of differences in stereoacuity have not yet been explored. This is especially important in the case of developmental disorders such as ASD who are more likely to have poor binocular fusion and worse stereoacuity due to an increased prevalence in vision disorders (Denis et al. 1997; Kaplan et al. 1999; Milne et al. 2009; Scharre and Creedon 1992). It may be that the ‘selective fusion’ observed in ASD (Bedford et al. 2016) is an effect of limited stereopsis rather than a consequence of autism specific symptoms such as reduced top-down processing (Happé and Frith 2006; Mottron et al. 2006).
Occlusion: A Qualitatively Different Depth Cue
Ordinal cues to depth, such as occlusion, are well-suited but under-used to assess how multiple cues are integrated into a final overall percept. Occlusion occurs when one object fully or partially hides another from view. The presence of occlusion has been demonstrated to hasten the processing of disparity and improve accuracy of depth judgements (Gillam and Borsting 1988). Moreover, when occlusion conflicts with other depth cues there is reduced reliance on disparity (Braunstein et al. 1986), and it can interfere with perception of depth overall (Schriever 1924; Stevenson and Körding 2009). The importance of the structural inference that occlusion affords have been noted previously (Harris and Wilcox 2009; Nakayama and Shimojo 1990; Tsai and Victor 2000); it is thought to aid in the perception of depth by providing hard constraints, where certain depth configurations are ruled out (Nakayama and Shimojo 1992).
The constraints provided by occlusion can be thought of as a type of perceptual prior, biasing overall perception away from an unlikely 3D layout. The current study aims to further explore visual cue integration in autism using psychophysical methods, as well as better characterise possible underlying causes of ‘selective fusion’ as observed by Bedford et al. (2016). If there is indeed a weaker influence of priors upon overall percept (Pellicano and Burr 2012), those with ASD would be expected to experience an attenuated effect of occlusion (see Hodgson and McGonigle-Chalmers 2011).
On the other hand, it has previously been shown that reliance on occlusion is especially strong in those with poor stereopsis (Braunstein et al. 1986). Therefore, if differences in cue integration in autism are caused by a reduction in the ability to utilise a single cue (such as binocular disparity) rather than a true difference in how the cues are integrated, it is predicted that ability to judge depth will be reduced to a greater degree for all individuals (i.e. ASD and non-ASD) with poor stereopsis compared to those with intact stereopsis when the occlusion cue conflicts with disparity information.
The Current Study
In the present study, we experimentally assessed the effect of occlusion information, which is conflicting or congruent with disparity information, on the precision of relative disparity thresholds in adolescents and adults who are TD or have an ASD. In order to disambiguate whether any observed effects are due to occlusion, or simply use of the occluded figure as an additional source of disparity, control trials using a non-occluded reference figure were also included. Participants across both groups presented with a range of stereoscopic ability. Both crossed and uncrossed disparity threshold were estimated for all conditions.
There are three possible patterns of performance that could be shown
Occlusion is used as a prior, disparity thresholds and reaction times are reduced when occlusion is congruent and increase when it is conflicting. If the ASD group have flattened priors, or are influenced less by priors, then these effects will be reduced;
If the ASD group are able to flexibly combine cues, the occluded object may be used both as a prior and as a reference plane (dependent on whether the depth order of the occluded object is congruent with or conflicts with the disparity cue; Petrov and Glennerster 2006), so thresholds and reaction times may be reduced whenever it is present, compared to TD participants, who would theoretically only show lower thresholds in conditions involving no cue conflict;
Inclusion of an occluded or reference figure has the same effect on reaction times and thresholds for both groups.
It is also predicted that, regardless of diagnostic group, presence of congruent occlusion will decrease threshold and reaction time for those with poorer stereoacuity.
Twenty-seven adults and adolescents with ASD and 27 TD participants were recruited from colleges (participants with ASD were recruited from both mainstream programs and specialist autism provisions), universities and community contacts (such as local autism support groups) in the greater Nottinghamshire area. Participant numbers are typical for this type of study (Hall et al. 2010). Inclusion criteria for the typical group included no self-report of diagnosed developmental conditions.
All participants completed the Adult Autism Spectrum Quotient (AQ; Baron-Cohen et al. 2001) and those in the ASD group were administered the Autism Diagnostic Observation Schedule—Module 4 (ADOS; Lord et al. 2000). All participants with ASD except for two met the cut-off score on the ADOS, with 12 participants obtaining the ‘autism spectrum’ classification and a further 13 obtaining the more severe ‘autism’ classification. Of the ASD group, thirteen individuals did not reach the 32-point criterion on the AQ (as recommended by Baron-Cohen et al. 2001), but this number was reduced to 7 when using the 26-point threshold suggested by Woodbury-Smith et al. (2005).
Participants were excluded for the following reasons:
TD participants—Adult Autism Spectrum Quotient score greater than 32 (AQ; Baron-Cohen et al. 2001): four participants;
ASD participants—not scoring above threshold on either the AQ or the Adult Autism Spectrum Quotient (AQ; Baron-Cohen et al. 2001): one participant;
Any participant who failed to perform better than chance on the baseline task (when disparity was set at 2.5 × threshold); 5 ASD [one of whom also met exclusion criteria (2)].
These exclusions left data for 22 ASD and 23 TD participants; their demographics are reported in Table 1.
All participants had normal or corrected-to-normal vision, but presence of stereopsis was not required. An initial measure of crossed stereoacuity was obtained using the TNO stereoacuity test (18th edition; Nederlandse Organisatie voor Toegepast Natuurwetenschappelijk Onderzoek; TNO, http://www.ootech.nl/).
The stimuli were generated and presented using MATLAB, with the Psychophysics Toolbox (Brainard 1997; Kleiner et al. 2007; Pelli 1997) and Palamedes (Prins and Kingdom 2009) software packages and displayed on a Sony Viewsonic P225f CRT monitor calibrated using a PR655 spectro-photometer (Photo Research, Chatsworth, CA, USA). 3DPixx liquid–crystal shutter glasses controlled by a DataPixx (VPixx Technologies Inc˙, Saint-Bruno, QC, Canada) allowed for stereoscopic viewing. The monitor had a frame rate of 120 Hz (60 Hz with shutter glasses). The refresh rate of both the monitor and shutter glasses was confirmed using a photodiode and a Tektronix 2115 60 MHz oscilloscope. Viewing distance was 928 cm. One pixel subtended ∼ 0.00231° of visual angle (8.32 arc seconds).
Stimuli and Design
The task was to indicate via a button-press which of two circles appeared closer in depth to the participant. The trial-wise dependent measures of interest included whether the participant perceived the comparison circle to be closer than the reference (see below), and the reaction time of their decision. For all trials, the targets (i.e. parts of the scene to be discriminated in depth) were bright circles (12.05 cd/m2) on a mid-luminance background (3.15 cd/m2). Only the red gun of the CRT monitor was used to display the stimuli.
The targets could be presented in four different occlusion configurations; baseline, congruent occlusion, conflicting occlusion, and figure-present-but-non occluding or ‘adjacent’ (Fig. 1). The baseline condition consisted of only the circle stimuli. Two circles were presented, one above the other—a reference circle of fixed disparity [0.16°] and a comparison circle, where the disparity was changed each trial. In the other three conditions a rectangle was also presented. This was low luminance (1.07 cd/ m2) and presented with zero disparity for crossed conditions, and 0.3° of disparity for uncrossed conditions (unless otherwise stated). In the congruent occlusion condition, the comparison and reference circles each occluded the rectangle. In the conflict condition, again the comparison and reference circles each occluded the rectangle, however, the disparity information provided by the rectangle indicated that it was in front of the circles (i.e. for crossed conditions, the rectangle was presented at a disparity of 0.3°, and at zero disparity for uncrossed conditions). Finally, in the ‘figure present but non-occluding’ or ‘adjacent’ condition, both the comparison and reference circles were presented beside the rectangle.
All occlusion configurations were presented in blocks of trials containing crossed or uncrossed disparities. For crossed disparities the stimulus viewed by the right eye was located further to the left, and vice versa for the left eye. Thus, the stimulus appeared to be floating in front of the surface of the CRT screen. For uncrossed disparities the stimulus viewed by the right eye was further to the right and vice versa for the left eye and the stimulus appeared to be inside the CRT screen.
The procedure was approved by the University of Nottingham’s School of Psychology Ethics Committee. Participants were seen within the School of Psychology in two or three sessions of 60–90 min. The experimental conditions were presented in separate blocks, with each block consisting of one condition. The order of presentation of conditions was counterbalanced between participants. The Weschler Abbreviated Scales of Intelligence (WASI) and Autism Diagnostic Observation Schedule (ADOS) were administered in separate sessions.
The laboratory-based experiment described here used standard psychophysical methods involving a 2-alternative-forced-choice paradigm (Pelli and Farell 1995, p. 29.9). In the experimental task, participants completed a relative-depth discrimination task where they had to choose which of two circles appeared closer to them. A trial consisted of a pair of stimuli (reference and comparison circles) presented one above the other for an unlimited amount of time until a response. Trials were separated by a random temporal jitter ranging between 0.5 and 1 s. A fixation cross with zero disparity remained in the centre of the screen at all times and participants were instructed to fixate on this cross throughout stimulus presentation. The task was composed of three stages: a combined demonstration and practice phase, a threshold estimation phase and a psychometric function estimation phase for each participant. This combined use of adaptive and constant methods allowed for efficient estimation of both threshold and slope parameter with relatively few trials and relatively novice participants.
Demonstration and Practice Phase
The experimenter explained the task to the participants and showed four demonstration trials (one for each possible occlusion configuration). In all of these trials, the disparity of the comparison stimulus was set to 0.3°. Next, participants were presented with 20 practice trials, where the disparity of the stimulus was set adaptively, using a 2-down 1-up staircase (see next section). For the practice phase the starting value of the comparison stimulus was set at ±0.148° relative to the disparity of the reference stimulus. Participants indicated which stimulus appeared closer to them by pressing a key.
Threshold Estimation Phase
A 2-down 1-up staircase with a 40-trial termination criterion was used to estimate the disparity at which the participant correctly identified the stimulus that was closer to them. This converges on a threshold of 80.35% correct. The comparison circle had a starting disparity value of ±0.074° relative to the disparity of the reference stimulus. Threshold was estimated as the mean of the last 4 reversals. The ratio of down and up stepsize (∆−/∆+) was set at 0.5488 (García-Pérez 1998). No feedback was given. A separate estimate of threshold was generated for each of the 8 conditions. The relative position of the reference and comparison stimuli (above or below the fixation cross) was randomised on each trial. A random amount of horizontal jitter was added to each stimulus to ensure that the task could not be completed monocularly.
Psychometric Function Estimation Phase
A series of fixed disparity levels were then generated around the threshold obtained in the prior phase. The threshold was used as an anchor for generating five levels of disparity—one at the same level as the reference stimulus, 2 at the threshold level (one of which appeared in front of and one behind the reference stimulus) and 2 that were 2.5 times larger than the threshold (again, one that would appear in front of and one behind the reference stimulus). Each test disparity was presented 30 times. As in the previous phase, the relative vertical and horizontal position of the reference and comparison stimuli was randomised on each trial. Additionally, the presentation order of the comparison stimulus disparities was randomly shuffled before each block began.
All data were processed and analysed using quantitative parametric methods in R 3.2.2. The ratio of ‘target in front’ responses was calculated for each disparity level. These data were then fit with a psychometric function (as described in Wichmann and Hill 2001) for each participant condition-wise. This was done by fitting a Gaussian cumulative density function using ‘maximum likelihood estimation’ via R’s glm function (Knoblauch and Maloney 2012). An estimate of the threshold at which a participant specified the target as being in front of the reference 83.25% of trials and the slope of the psychometric function at this point were calculated using the threshold_slope function within the modelfree package. The thresholds were log-transformed to minimise the effects of skewness and kurtosis (Wesemann et al. 1987). The thresholds for the baseline or no-occlusion condition were used as covariates in the main analysis to assess the impact of stereoacuity. Thus occlusion configuration factor in the final analyses had three levels: congruent occlusion, conflicting occlusion and adjacent.
The disparity threshold and slope were modelled using mixed-effects linear regression (R package afex; Singmann and Bolker 2014). The models contained factors for occlusion configuration (occluding, conflict, adjacent) and disparity sign (crossed, uncrossed) of the stimuli, as well as diagnostic group (ASD, TD) and continuous predictors in the form of crossed and uncrossed stereoacuity (threshold obtained for the baseline occlusion configuration condition). The baseline threshold measures entered into the model as continuous predictors were also mean-centred to aid in interpretation of coefficient values. Sum contrast coding was used for categorical variables. Random intercepts and fully-crossed random slopes were included in the models (Barr et al. 2013). We report omnibus Type-III tests with denominator degrees of freedom, F-scaling factors, and p values obtained via Kenward-Roger approximation (Halekoh and Højsgaard 2014). All p values in the omnibus tests were Bonferroni-corrected (Dunn 1959, 1961). In cases where a significant main effect or interaction was found, pairwise comparisons were made with p values adjusted using the Tukey method (Tukey 1977), using the R package lsmeans (Lenth 2014).
Two RT outcome measures were calculated—median response speed (the reciprocal of RT), and the standard deviation of response speed (hereafter referred to as response speed variability). All RT measures were calculated separately for each combination of participant, condition, and disparity level. For both the median response speed and its standard deviation, the raw RT data were first trimmed so values fell between 250 ms and +2 standard deviations from the mean. The raw RT data were then transformed to speed by taking the reciprocal. Use of cut-offs and transformation when dealing with RT data is known to ameliorate the effect of slow outliers and thereby preserves power (Ratcliff 1993; Whelan 2008). Finally, both the psychometric parameters and RT outcome measures were screened for potential outliers with reference to the group. The threshold for rejection was set at 2.5 of the median absolute deviation (Leys et al. 2013).
Two linear mixed-effects models (using mixed function of the R package afex) were constructed. Like before, these models contained factors for occlusion configuration and disparity sign of the stimuli, as well as diagnostic group and continuous predictors in the form of crossed and uncrossed stereoscopic ability.
Three measures of stereoacuity were obtained; the TNO test, and disparity threshold for the crossed and uncrossed baseline experimental conditions. Stereoacuity (across all three measures) ranged from 0.001° to 2.778°, with a median value of 0.017°. Bonferroni-corrected one-tailed t-tests showed that log-transformed stereoacuity scores differed significantly between groups for the uncrossed experimental baseline measure only [t(31.169) = − 1.754, p = 0.045]. Participants with ASD exhibited a worse average stereoacuity of −1.668 log10° [standard deviation (SD) = 0.516], whereas TD individuals had a better average stereoacuity of −1.885 log10° (SD = 0.267).
There were no main effects of or interaction including disparity sign (all p > 0.05), so all summary statistics for this measure are collapsed across disparity sign. There was no main effect of diagnostic group (p = 1.000), and there were no significant interactions.
Occlusion configuration had a significant effect on threshold [F(2, 38.413) = 35.246, p < 0.001], see left panel of Fig. 2. Multiple pairwise comparisons revealed that the thresholds obtained from all three occlusion conditions significantly differed from one another. When the occlusion cue was conflicting, thresholds were higher compared to when the occlusion cue did not conflict [t(39.789) = −6.786, p < 0.001], or when the figure was adjacent to the target [t(39.823) = −8.523, p < 0.001]. Thresholds were also significantly lower for the adjacent condition compared to the congruent occlusion condition [t(38.226) = −3.443, p = 0.004]. A significant main effect of uncrossed baseline stereoacuity [β = 0.74; F(1, 39.329) = 24.43, p < 0.001] showed that individuals with higher (i.e. worse) baseline uncrossed disparity thresholds were also likely to have increased thresholds for all other occlusion configurations.
There was no significant main effect of, or interactions involving, diagnostic group (all p > 0.2), and there were no significant interactions. Similar main effects of occlusion configuration [F(2, 37.869) = 67.37, p < 0.001] and uncrossed baseline [F(1, 41.406) = 18.038, p < 0.001] measures also applied to the slope of the psychometric function (Fig. 3). The slope had a significantly shallower gradient in the case of conflicting occlusion [least squares mean (LSM) = 4.267 standard error of the mean (SE) = 0.878], compared to when the occlusion cue was congruent [LSM = 17.055 (SE = 1.299); t(37.558) = 8.905, p < 0.001], or when the figure was adjacent to the target [LSM = 20.261 (SE = 1.311); t(38.193) = 10.783, p < 0.001]. The slope was steeper for the adjacent condition than for the congruent occlusion condition [t(38.215) = 2.785, p = 0.022]. With regards to the baseline measures, there was an effect involving both crossed and uncrossed baseline stereoacuity, though the effect was stronger for uncrossed (β = −0.573) compared to crossed (β = −0.248).
For slope there was a significant interaction between disparity sign and occlusion configuration [F(2, 73.846) = 6.862, p = 0.007]. There was a difference in slope between crossed and uncrossed disparities only for the adjacent occlusion [t(93.584) = 3.782, p < 0.001], and not the congruent (p = 0.959) or conflicted types (p = 0.748).
Reaction Time Measures
As observed for other measures, there was a main effect of occlusion configuration [F(2, 38.467) = 5.24, p = 0.039]. Response speed significantly differed between the conflict (LSM = 1.209 [SE = 0.04]) and congruent (LSM = 1.291 [SE = 0.042]) occlusion conditions [t(39.778) = 3.062, p = 0.011], and conflict and adjacent (LSM = 1.29 [SE = 0.044]) conditions[t(39.615) = 2.651, p = 0.03], but not for the congruent and adjacent conditions (p = 1). There was also a main effect of uncrossed baseline [F(1, 39.152) = 17.644, p < 0.001], where individuals with a higher uncrossed baseline threshold tended to respond faster (β = 0.973).
Overall, participants with ASD exhibited slower response speeds (LSM = 1.147 [SE = 0.053]) than their TD counterparts [LSM = 1.379 (SE = 0.056)]; [F(1, 39.049) = 9.003, p = 0.019]. Though there was no main effect of disparity sign, there was an interaction between diagnostic group and disparity sign [F(1, 39.258) = 8.297, p = 0.026; which can be seen in Fig. 4]. Further analysis revealed that the ASD group had significantly slower response speeds to uncrossed disparities only [t(39.173) = 3.936, p < 0.001]; response speeds for crossed disparities did not differ between the two diagnostic groups (p = 0.112).
Response Speed Variability
Occlusion configuration also had an effect on response speed variability [F(2, 38.367) = 13.932, p < 0.001], with—as for median response speed—variability being significantly higher for the conflict condition (LSM = 0.415 [SE = 0.013]), compared to the congruent occlusion (LSM = 0.39 [SE = 0.011]; t(39.702) = −5.283, p < 0.001) or adjacent (LSM = 0.39 [SE = 0.011]; t(39.875) = −3.491, p = 0.003) conditions. Response speed variability did not significantly differ between the congruent occlusion and adjacent conditions (p = 0.134). However, an interaction between diagnostic group and occlusion configuration showed that this condition-dependent effect upon response speed variability was only present in the TD group; response speed variability did not significantly differ between occlusion conditions for the ASD group. Table 2 shows descriptives and pair-wise comparisons at all levels of diagnostic group and occlusion configuration.
This study examined the impact of occlusion cues upon perceived depth in adults with and without ASD. Both groups performed as if they automatically integrated occlusion and disparity information to judge depth. In addition to this main finding there were interesting differences between the groups’ behaviour. Those with ASD were less sensitive to uncrossed disparities, measured psychophysically when no occlusion or reference planes were present (the ‘baseline’ occlusion configuration). Times taken to judge uncrossed relative disparities were increased for this group across all occlusion configurations. Variability of response speed did not depend on whether the occlusion cue was congruent for the ASD group, whereas response speed became more variable for the TD group when occlusion conflicted with disparity information. Additionally, across the TD and ASD groups, while an increase in relative disparity threshold for the baseline condition made it more likely that an individual would have similarly decreased performance across the occlusion and adjacent reference figure conditions, it was also related to faster response speeds.
The main aim of the study was to determine whether individuals with autism exhibited true differences in depth cue utilisation, or if these were due to reduced stereopsis. There was a group difference in stereoacuity, with the ASD group exhibiting increased uncrossed thresholds compared to the TD group. Reduced stereoacuity in ASD has been identified previously (Adams et al. 2010; Anketell et al. 2013; Coulter et al. 2013; Scharre and Creedon 1992) but this is the first study to have tested for and observed a difference between crossed and uncrossed disparity threshold in ASD. An overall reduction in response speed (especially for uncrossed disparities) was also found. Slower reaction times are not characteristic of ASD (Ferraro 2016) so this may reflect a specific difficulty in processing disparity information.
A deficit localised to uncrossed disparities cannot be accounted for by the reported increase in prevalence of convergence insufficiency seen in autism (Milne et al. 2009; this would predict reduced sensitivity to crossed disparities). The perception of uncrossed disparities requires divergence, an ability that remains intact in ASD (Milne et al. 2009).
Uncrossed disparity refers to relative depth information further away than fixation. The effects of this on behaviour are unclear, since other cues to depth are also available. It is interesting to note that the ability to utilise uncrossed binocular disparities has been shown to reduce visual crowding (Astle et al. 2014), which improves the ability to recognise and respond appropriately to a stimulus when it is one of many possibly salient objects (Whitney and Levi 2011). It is possible that a reduced ability to make sense of crowded visual scenes could contribute to the reported sensations of being overwhelmed by sensory environments. This conclusion, however, is speculative at this stage.
It should be noted that those with autism exhibit a substantial increase in prevalence of strabismus compared to TD populations. Sensitivity to uncrossed disparity is specifically reduced in the case of exo-phoria or -tropia (Lam et al. 2002). While those with autism are not significantly more likely to have exo- compared to eso-deviations (Black et al. 2013; Denis et al. 1997; Ikeda et al. 2012; Kabatas et al. 2015; Kaplan et al. 1999; Milne et al. 2009; Scharre and Creedon 1992), the increase in prevalence of strabismus compared to the general population could contribute to this deficit.
Here we find evidence that populations with ASD do not differ from their TD peers in the utilisation of occlusion. Individuals with autism showed an identical pattern to their TD peers regarding the effect of occlusion configuration upon disparity threshold. The finding that those with ASD showed increased thresholds for conflicting compared to congruent occlusion indicates that the integration of metric and ordinal uni-modal cues is automatic in this population. This is inconsistent with the results of Bedford et al. (2016), who found that when two metric cues were incongruent, information from the cues was not necessarily combined in this group. While here we used a highly-reliable ordinal cue, Bedford et al. (2016) used texture. This use of qualitatively different cues may account for the discrepancy between our findings and those of Bedford et al. (2016).
It should be noted that in our study, where occlusion and disparity cues were conflicting those with ASD did not show increased response speed variability, unlike the TD group. This suggests that although the introduction of conflicting cues caused reduction in the ability to judge depth, it did not increase judgement uncertainty in the ASD group. This is not consistent with the flattened perceptual prior suggested by Pellicano and Burr (2012). A flattened occlusion prior could account for the fixed variability in response speed for those with ASD, but it does not readily explain the deleterious effect of conflicting occlusion on disparity threshold. A more parsimonious consideration could be that while the occlusion prior is similar for ASD and TD populations, there may be group differences in the perceptual decision-making aspect of the task used to assess the level of cue integration. In other words, though the performance of individuals with ASD may match the TD group, they do not experience the increase in difficulty experienced by the TD group.
The effects observed here were strong, the combination of a relatively small sample size and the heterogeneity present in individuals with an ASD means that unbeknown to the authors, there may be subgroups who were performing differently. Additionally, it is not known whether the automatic cue combination seen here in those with ASD is specific to the disparity and occlusion cues, or if this effect is more generalizable. Further studies using different cues are needed, especially in the case of cross-modal cue integration, where the presence of differences in ASD appears specific to a subset of the senses (Haigh et al. 2016; Hames et al. 2016).
The present study examined the impact of occlusion cues upon perceived depth-from- disparity. Cue integration did not depend upon level of stereoacuity or autism diagnosis. Unlike previous work, people with ASD were found to automatically integrate conflicting depth cues, lending support to the idea that the occlusion prior remains intact in ASD and that the outcome of cue integration is similar to those who are TD. However, the decision-making undertaken to reach this final percept may differ between the ASD and TD groups. Future work should explore whether cue-specific likelihood distributions differ in autism, and if so, whether these are specific to those with ASD or are simply a function of a reduction in stereoacuity.
Adams, R. J., Dove, C. N., Drover, J. R., Norman, B. R., Patterson, R., & Wang, Y. Z. (2010). Assessing eye and visual functioning in children and young adults with autism spectrum disorder. Presented at the Association for Research in Vision and Ophthalmology.
Anketell, P. M., Saunders, K. J., Gallagher, S. M., Bailey, C., & Little, J. -A. (2013). Visual findings in children with Autistic Spectrum Disorder. Presented at the Association for Research in Vision and Ophthalmology.
Astle, A. T., McGovern, D. P., & McGraw, P. V. (2014). Characterizing the role of disparity information in alleviating visual crowding. Journal of Vision, 14(6), 8–8.
Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., & Clubley, E. (2001). The autism-spectrum quotient (AQ): Evidence from asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. Journal of Autism and Developmental Disorders, 31(1), 5–17.
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68(3), 255–278. doi:10.1016/j.jml.2012.11.001.
Barry, S. R. (2009). Fixing my gaze. New York: Basic Books.
Bedford, R., Pellicano, E., Mareschal, D., & Nardini, M. (2016). Flexible integration of visual cues in adolescents with autism spectrum disorder. Autism Research, 9(2), 272–281. doi:10.1002/aur.1509.
Bertone, A., Mottron, L., Jelenic, P., & Faubert, J. (2003). Motion perception in autism: A ‘‘complex’’ issue. Journal of Cognitive Neuroscience, Neurosurgery, and Psychiatry, 15, 218–225.
Bertone, A., Mottron, L., Jelenic, P., & Faubert, J. (2005). Enhanced and diminished visuo-spatial information processing in autism depends on stimulus complexity. Brain: A Journal of Neurology, 128(10), 2430–2441.
Black, K., McCarus, C., Collins, M. L. Z., & Jensen, A. (2013). Ocular manifestations of autism in ophthalmology. Strabismus, 21(2), 98–102. doi:10.3109/09273972.2013.786733.
Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10(4), 433–436.
Braunstein, M. L., Andersen, G. J., Rouse, M. W., & Tittle, J. S. (1986). Recovering viewer-centered depth from disparity, occlusion, and velocity gradients. Perception and Psychophysics, 40(4), 216–224.
Coulter, R. A., Tea, Y., Bade, A., Fecho, G., Amster, D., Jenewein, E., et al. (2013). Vision testing of children and adolescents with ASD: What are we missing? Presented at the International Meeting for Autism Research.
Denis, D., Burillon, C., Livet, M. O., & Burguiere, O. (1997). Ophthalmologic findings in the autistic child. Journal Francais d’Ophtalmologie, 20(2), 103–110.
Dunn, O. J. (1959). Estimation of the medians for dependent variables. The Annals of Mathematical Statistics, 30(1), 192–197. doi:10.2307/2237135.
Dunn, O. J. (1961). Multiple comparisons among means. Journal of the American Statistical Association, 56(293), 52–64. doi:10.1080/01621459.1961.10482090.
Ferraro, F. R. (2016). No evidence of reaction time slowing in autism spectrum disorder. Autism: The International Journal of Research and Practice, 20(1), 116–122. doi:10.1177/1362361314559986.
García-Pérez, M. A. (1998). Forced-choice staircases with fixed step sizes: Asymptotic and small-sample properties. Vision Research, 38(12), 1861–1881.
Gillam, B. J., & Borsting, E. (1988). The role of monocular regions in stereoscopic displays. Perception, 17(5), 603–608.
Hahn, E., Comstock, D., Connick, S., MacCarron, J., & Mulla, S. (2010). Monocular clues in seven stereoacuity tests. Dalhousie Medical Journal, 37(1), 4–13.
Haigh, S. M., Heeger, D. J., Heller, L. M., Gupta, A., Dinstein, I., Minshew, N. J., & Behrmann, M. (2016). No difference in cross-modal attention or sensory discrimination thresholds in autism and matched controls. Vision Research, 121, 85–94.
Halekoh, U., & Højsgaard, S. (2014). A Kenward-Roger approximation and parametric bootstrap methods for tests in linear mixed models–the R package pbkrtest. Journal of Statistical Software, 59(9), 1–32.
Hall, D., Chung, J., & Navidi, G. (2010). Comparative analysis of IMFAR sample sizes in support of the national database for autism research, International Meeting for Autism Research (IMFAR), http://www.autism-insar.org.
Hames E. C., Murphy, B., Rajmohan, R., Anderson, R. C., Baker, M., Zupancic, S., … & Richman, D. (2016). Visual, auditory, and cross modal sensory processing in adults with autism: An eeg power and BOLD fMRI investigation. Frontiers in Human Neuroscience, 10.
Happé, F. G. E., & Frith, U. (2006). The weak coherence account: Detail-focused cognitive style in autism spectrum disorders. Journal of Autism and Developmental Disorders, 36(1), 5–25. doi:10.1007/s10803-005-0039-0.
Harris, J. M., & Wilcox, L. M. (2009). The role of monocularly visible regions in depth and surface perception. Vision Research, 49(22), 2666–2685. doi:10.1016/j.visres.2009.06.021.
Hillis, J. M., Ernst, M. O., Banks, M. S., & Landy, M. S. (2002). Combining sensory information: Mandatory fusion within, but not between, senses. Science, 298(5598), 1627–1630.
Hillis, J. M., Watt, S. J., Landy, M. S., & Banks, M. S. (2004). Slant from texture and disparity cues: Optimal cue combination. Journal of Vision, 4(12), 967–992. doi:10.1167/4.12.1.
Hodgson, E. S., & McGonigle-Chalmers, M. (2011). Partial occlusion depiction and its relationship with field independence in children with ASD. Autism: The international Journal of Research and Practice, 15(4), 473–495. doi:10.1177/1362361310363279.
Howard, I. P., & Rogers, B. J. (2012). Perceiving in depth. Oxford: Oxford University Press.
Ikeda, J., Davitt, B. V., Ultmann, M., Maxim, R., & Cruz, O. A. (2012). Brief report: Incidence of ophthalmologic disorders in children with autism. Journal of Autism and Developmental Disorders, 43(6), 1447–1451. doi:10.1007/s10803-012-1475-2.
Johnston, E. B., Cumming, B. G., & Parker, A. J. (1993). Integration of depth modules: Stereopsis and texture. Vision Research, 33(5–6), 813–826.
Kabatas, E. U., Ozer, P. A., Ertugrul, G. T., Kurtul, B. E., Bodur, S., & Alan, B. E. (2015). Initial ophthalmic findings in turkish children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 45, 2578–2581. doi:10.1007/s10803-015-2428-3.
Kaplan, M., Rimland, B., Edelson, S. M., & Edelson, S. M. (1999). Strabismus in autism spectrum disorder. Focus on Autism and Other Developmental Disabilities, 14(2), 101–105.
Kleiner, M., Brainard, D. H., & Pelli, D. G. (2007). What’s new in Psychtoolbox-3? Presented at the European Conference on Visual Perception.
Knill, D. C., & Saunders, J. A. (2003). Do humans optimally integrate stereo and texture information for judgments of surface slant? Vision Research, 43(24), 2539–2558. doi:10.1016/S0042-6989(03)00458-9.
Knoblauch, K., & Maloney, L. T. (2012). Modeling psychophysical data in R. Berlin: Springer.
Lam, A. K. C., Tse, P., Choy, E., & Chung, M. (2002). Crossed and uncrossed stereoacuity at distance and the effect from heterophoria. Ophthalmic and Physiological Optics : The Journal of the British College of Ophthalmic Opticians (Optometrists), 22(3), 189–193. Retrieved from http://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pubmed&id=12090632&retmode=ref&cmd=prlinks.
Landy, M. S., Maloney, L. T., Johnston, E. B., & Young, M. (1995). Measurement and modeling of depth cue combination: In defense of weak fusion. Vision Research, 35(3), 389–412.
Lenth, R. V. (2014). Least-squares means: The R Package lsmeans. California: Sage
Leys, C., Ley, C., Klein, O., Bernard, P., & Licata, L. (2013). Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median. Journal of Experimental Social Psychology, 49(4), 764–766. doi:10.1016/j.jesp.2013.03.013.
Lord, C., Risi, S., Lambrecht, L., Cook, E. H. Jr., Leventhal, B. L., DiLavore, P. C., et al. (2000). The autism diagnostic observation schedule—generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30(3), 205–223. doi:10.1023/A:1005592401947.
Lovell, P. G., Bloj, M., & Harris, J. M. (2012). Optimal integration of shading and binocular disparity for depth perception. Journal of Vision, 12, 1.
McKee, S. P. (1983). The spatial requirements for fine stereoacuity. Vision Research, 23(2), 191–198.
Milne, E., Griffiths, H., Buckley, D., & Scope, A. (2009). Vision in children and adolescents with autistic spectrum disorder: Evidence for reduced convergence. Journal of Autism and Developmental Disorders, 39(7), 965–975. doi:10.1007/s10803-009-0705-8.
Mottron, L., & Burack, J. (2001). Enhanced perceptual functioning in the development of autism. In Burack; Charman, Yir-miya, & & Zelazo (Eds.), The development of autism: Perspectives from theory and research (pp. 131–148). Mahwah, NJ: Erlbaum.
Mottron, L., Dawson, M., Soulières, I., Hubert, B., & Burack, J. (2006). Enhanced perceptual functioning in autism: An update, and eight principles of autistic perception. Journal of Autism and Developmental Disorders, 36(1), 27–43. doi:10.1007/s10803-005-0040-7.
Nakayama, K., & Shimojo, S. (1990). da Vinci stereopsis: Depth and subjective occluding contours from unpaired image points. Vision Research, 30(11), 1811–1825.
Nakayama, K., & Shimojo, S. (1992). Experiencing and perceiving visual surfaces. Science, 257(5075), 1357–1363.
Nefs, H. T., O’Hare, L., & Harris, J. M. (2010). Two independent mechanisms for motion-in-depth perception: Evidence from individual differences. Frontiers in Psychology, 1, 1–8. doi:10.3389/fpsyg.2010.00155.
O’Riordan, M. A., Plaisted, K. C., Driver, J., & Baron-Cohen, S. (2001). Superior visual search in autism. Journal of Experimental Psychology: Human Perception and Performance, 27, 719–730.
Pelli, D. G. (1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10(4), 437–442.
Pelli, D. G., & Farell, B. (1995). Psychophysical methods. In M. Bass, E. W. Van Stryland, D. R. Williams & W. L. Wolfe (Eds.), Handbook of optics, (2nd ed., I pp. 29.21–29.13). New York: McGraw-Hill.
Pellicano, E., & Burr, D. (2012). When the world becomes “too real”: A Bayesian explanation of autistic perception. Trends in Cognitive Sciences, 16(10), 504–510. doi:10.1016/j.tics.2012.08.009.
Petrov, Y., & Glennerster, A. (2006). Disparity with respect to a local reference plane as a dominant cue for stereoscopic depth relief. Vision Research, 46(26), 4321–4332. doi:10.1016/j.visres.2006.07.011.
Piepho, H. P. (2004). An algorithm for a letter-based representation of all-pairwise comparisons. Journal of Computational and Graphical Statistics. doi:10.1198/1061860043515.
Prins, N., & Kingdom, F. (2009). Palamedes: Matlab routines for analyzing psychophysical data.
Ratcliff, R. (1993). Methods for dealing with reaction time outliers. Psychological Bulletin, 114(3), 510–532.
Saladin, J. J. (1998). Phorometry and stereopsis. In W. J. Benjamin & I. M. Borish (Eds.), Borishs clinical refraction (pp. 724–773). Philadelphia: Elsevier.
Scharre, J. E., & Creedon, M. P. (1992). Assessment of visual function in autistic children. Optometry and Vision Science, 69(6), 433–439.
Schriever, W. (1924). Experimentelle studien über stereoskopisches sehen. Zeitschrift Fur Psychologie, 96, 113–170.
Singmann, H., & Bolker, M. (2014). afex: Analysis of Factorial Experiments. R package version 0.12–135.
Smith, D., Ropar, D., & Allen, H. A. (2015). Visual integration in autism. Frontiers in Human Neuroscience, 9, 1–7. doi:10.3389/fnhum.2015.00387.
Stevenson, I. H., & Körding, K. P. (2009). Structural inference affects depth perception in the context of potential occlusion. In Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, & A. Culotta (Eds.), (Vol. 22, pp. 1777–1784). Presented at the Advances in Neural Informational Processing Systems.
Tsai, J. J., & Victor, J. D. (2000). Neither occlusion constraint nor binocular disparity accounts for the perceived depth in the “sieve effect.” Vision Research, 40(17), 2265–2276.
Tukey, J. W. (1977). Exploratory data analysis. Reading, MA: Addison-Wesley.
Van Boxtel, JJA, & Lu, H. (2013). Impaired global, and compensatory local, biological motion processing in people with high levels of autistic traits. Frontiers in Psychology, 4, 1–10. doi:10.3389/fpsyg.2013.00209.
Vuong, Q. C., Domini, F., & Caudek, C. (2006). Disparity and shading cues cooperate for surface interpolation. Perception, 35(2), 145–155.
Wesemann, W., Klingenberger, H., & Rassow, B. (1987). Electrophysiological assessment of the human depth-perception threshold. Graefe’s Archive for Clinical and Experimental Ophthalmology, 225(6), 429–436.
Whelan, R. (2008). Effective analysis of reaction time data. The Psychological Record, 58, 475–482.
Whitney, D., & Levi, D. M. (2011). Visual crowding: A fundamental limit on conscious perception and object recognition. Trends in Cognitive Sciences, 15(4), 160–168.
Wichmann, F. A., & Hill, N. J. (2001). The psychometric function: I. Fitting, sampling, and goodness of fit. Attention, Perception, & Psychophysics, 63(8), 1293–1313.
Wilmer, J. B. (2008). How to use individual differences to isolate functional organization, biology, and utility of visual functions; with illustrative proposals for stereopsis. Spatial Vision, 21(6), 561–579. doi:10.1163/156856808786451408.
Woodbury-Smith, M. R., Robinson, J., Wheelwright, S., & Baron-Cohen, S. (2005). Screening adults for asperger syndrome using the aq: A preliminary study of its diagnostic validity in clinical practice. Journal of Autism and Developmental Disorders, 35(3), 331–335. doi:10.1007/s10803-005-3300-7.
Zalevski, A. M., Henning, G. B., & Hill, N. J. (2007). Cue combination and the effect of horizontal disparity and perspective on stereoacuity. Spatial Vision, 20(1–2), 107–138.
This research was supported by an ESRC 1+3 studentship awarded to DS. The authors would like to thank all the schools, organisations and individuals who helped with the recruitment of participants, with special thanks to Autism East Midlands (formerly NORSACA), A Place To Call Our Own, Asperger’s COI, Central College Nottingham, Lincoln College, Bluecoat Academy, and The Nottingham Academy. Many thanks to all the individuals in this study for their participation.
This work was supported by the Economic and Social Research Council [grant number ES/J500100/1], by a PhD studentship to DS. The funders had no role in the study design, data collection, analysis, decision to publish or preparation of the manuscript.
All authors developed the study concept and design. DS created the experiment code, recruited and ran participants, analysed the data and wrote the first draft of the article, under supervision of HA and DR. All authors contributed to the final paper and approved the final version for submission.
Conflict of interest
The authors declare that they have no conflict of interest.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
About this article
Cite this article
Smith, D., Ropar, D. & Allen, H.A. The Integration of Occlusion and Disparity Information for Judging Depth in Autism Spectrum Disorder. J Autism Dev Disord 47, 3112–3124 (2017). https://doi.org/10.1007/s10803-017-3234-x
- Autism spectrum disorder
- Cue integration