Vivid visual mental imagery in the absence of the primary visual cortex
- 2.5k Downloads
The role of the primary visual cortex in visual mental imagery has provided significant debate in the imagery literature. Functional neuroimaging studies show considerable variation depending on task and technique. Patient studies can be difficult to interpret due to the diverse nature of cortical damage. The type of cortical damage in patient SBR is exceedingly rare as it is restricted to the gray matter of the calcarine sulcus. In this study, we show that in spite of his near-complete cortical blindness, SBR exhibits vivid visual mental imagery both behaviorally and when measured with functional magnetic resonance imaging. The pattern of cortical activation to visual mental imagery in SBR is indistinguishable from individual sighted subjects, in contrast to the visual perceptual responses, which are greatly attenuated.
KeywordsMental imagery Cortical damage Primary visual cortex Cortical blindness
Visual mental imagery is the ability to produce a visual image independently of the visual input to the retina. There is some phenomenological correspondence of mental imagery with the images perceived when visual stimuli are presented to the eyes, although mental images are generally (and not surprisingly) weaker. Since the introduction of functional magnetic resonance imaging (fMRI) to the battery of tools used to investigate the human brain, there have been many investigations into the neural basis of mental imagery. Several studies have found that visual imagery evokes activation in visual association cortex, such as occipitotemporal and occipitoparietal regions [1, 2, 3, 4, 5, 6]. Additionally, regions outside of the occipital cortex in the frontal lobe appear to show non-specific activation during visual imagery , perhaps providing top-down feedback to the specific sensory representation that is appropriate for the mental image.
Patient studies suggest that there is a dissociation between visual imagery and visual perception. Berhmann et al.  and Servos and Goodale  described individual patients suffering from visual agnosia, in whom visual imagery appeared to be intact as measured with a battery of tests. Conversely, Moro et al.  described two patients with intact primary visual cortex (V1) and visual perception, in whom visual imagery was severely impaired. Similarly, Zeman et al.  describe a patient who suddenly lost the ability to spontaneously generate visual mental images in the absence of any visual loss.
One issue that remains controversial is the role of V1 in visual mental imagery. To what extent is V1 required for visual mental imagery? Activation of V1 is only found in a subset of mental imagery experiments, with some reporting no activation of V1 (see Kosslyn and Thompson  for a comprehensive review of the early literature). It has been shown that rTMS over V1 can interfere with imagery of oriented gratings , but targeting of V1 with TMS is difficult . A potential reconciliation of the data is that the role of V1 depends on the type of imagery; precise, detailed imagery is more likely to need V1. Clearly the result of Moro et al. described above indicates that V1 is not sufficient for imagery. Only one study has reported a patient (HS) who was transiently cortically blind, but yet reported ‘seeing’ images which were presumably mental images . However, since the lesion of the calcarine sulcus was not complete, and no functional imaging data are available, it may be that there was some spared cortex contributing to perception. Another patient—SBR—has a very specific lesion to V1 bilaterally, with only the very anterior tip intact, and no evidence of direct damage to the adjacent white matter . This patient therefore provides a unique opportunity to determine the effect of V1 damage on visual mental imagery. In our previous fMRI study we have shown abnormal gray matter intensity in his T1-weighted scan, abnormal perfusion to V1 relative to area MT+ and a lack of BOLD activity in V1.
The contentious nature of investigating mental imagery is at least in part due to the lack of objective criteria. With no external stimulus, imagery is a classic subjective phenomenon. Attempts to address this inherent subjectivity have used measures of reaction time, and tasks that require using a mental image for performance, although this arguably just changes the problem. fMRI can provide a unique insight into imagery, without employing an additional task, such as rotation. However, the correlation between subjective reports of imagery strength and BOLD activity level is not straightforward. One study that found a correlation between the vividness of visual imagery questionnaire  and mental imagery used BOLD activity throughout the entire occipital lobe and relied on negative activity to drive the correlation . Nonetheless, the presence of occipital cortical activation to visual mental imagery, combined with subjective reports of the images is strong evidence for successful imagery. While fMRI is a useful measure of activation, it does not provide any causal evidence. It is entirely possible that the activation of V1 in some imaging studies could reflect epiphenomenal activity. Therefore, this lesion fMRI study combines an objective measure of activation with causal inferences based on the absence of V1.
The nature of visual mental imagery in SBR was investigated using both fMRI and behavioral testing, and compared to eight young male control subjects.
Scanning was performed at the Oxford Centre for Functional Magnetic Resonance Imaging of the Brain (FMRIB) using a Siemens 3T Verio scanner with a 12-channel head coil. A 1 × 1 × 1 mm3 T1 structural scan was performed using standard parameters [magnetization prepared rapid gradient echo (MPRAGE), repetition time (TR) = 11.2 ms, echo time (TE) = 4.68 ms].
Each subject participated in four functional MRI scans (TR = 3 s; 3.1 mm × 3.1 mm × 3 mm; 44 slices, TE = 30 ms). Scan one was the visual perception scan and consisted of 21 s blocks of either faces (6.6° visual angle), houses (6.6°), flashing checkerboard (7.4°; 8-Hz flicker) or a black fixation cross (3°) on a gray background. A new house or face stimulus was presented every second of the block. Each block was preceded and followed by a 1.5-s period of fixation designed to match the period in which the auditory cue was given in the imagery scans. Blocks were presented four times each in pseudo-random order, determined by a Latin square design. Total scan length was therefore 6 min 24 s. Scans 2–4 were imagery scans in which subjects were prompted with an auditory cue, to imagine either ‘houses’, ‘faces’ or ‘chessboard’ (1.5 s). The term ‘chessboard’ was employed as this is how most of the subjects described the checkerboard stimulus. After 21 s, the subject heard the word ‘stop’ (1.5 s), before the next instruction was given. Again, blocks of different imagery instructions were presented in a pseudo-random order counterbalanced using a Latin square design. During the imagery scans, subjects were instructed to keep their eyes closed, and all lights were off in the scanner room.
Functional data were analyzed using FMRIB’s easy analysis tool (FEAT), part of the FSL toolbox (www.fmrib.ox.ac.uk/fsl). For both imagery and visual perception scans, at a single scan level the images were pre-processed using a number of steps: head movement correction using MCFLIRT, spatial smoothing with a Gaussian kernel full-width, half-height (FWHM) = 5 mm, mean-based intensity normalization, non-linear high-pass temporal frequency filtering (Gaussian-weighted straight line fitting, with sigma = 30 s). EPI data were registered to both the high-resolution MPRAGE structural scan and to the MNI-152 standard brain using FLIRT, another tool from the FSL toolbox.
Single-scan (first level) analyses were combined across the three imagery scans for each subject using fixed-effects analysis. Group analyses (fixed effects) were then performed for each type of imagery (checkerboard, faces, houses). In the case of the visual perception scans, the first level analyses for each subject were fed into a group analysis (fixed effects) to produce the statistical maps. No thresholding was performed prior to the group analyses. The use of fixed effects implies that the results from the control group cannot be extrapolated to a general population. Mixed-effects analyses take into account intersubject variability, so tend to reduce the statistical significance of group activation. For the purpose of this study, however, it was more important to get an indication of the pattern of activation in the control subjects to compare with SBR, where there is no intersubject variability to take into account.
Segmentation, surface reconstruction, and inflation were performed on the structural scan of a control subject with the FreeSurfer software for visualization of the statistical activation data [17, 18]. Output from both the group analyses and the individual data from SBR was registered to the space of this brain in FreeSurfer using FLIRT. Other than the mapping to the cortical surface, no further analyses were performed in FreeSurfer.
The optimal method to define regions of interest to compare the levels of activation in SBR and sighted controls would be a localizer scan, but this is not possible for SBR. The primary visual cortex was defined using a probabilistic map defined using retinotopic mapping in 16 subjects . This ROI for V1 was entirely within the damaged region of SBR, as the size of the retinotopic stimuli used for the mapping was well within his blind region. The fusiform face area was defined as a spherical ROI, radius of 6 mm, centered upon the co-ordinates from the localizer in experiment one of Andrews et al.  (left −38 −61 18; right 41 −55 −25). Similarly, the parahippocampal place area was also defined as a spherical ROI, radius 6 mm centered upon the co-ordinates used by Park and Chun  (left −27, −46, −15; right 24, −33, −23). Additionally, a fourth (spherical; radius 8 mm) medial visual area was defined at the intersection of the occipital, parietal, and temporal cortices, referred to here as the anterior calcarine, also known as retrosplenial cortex . Percentage BOLD change was extracted from each of the imagery and visual scans in these four visual areas, resulting in a total of eight values for the control visual scans and 24 for the control imagery scans.
Analysis of variance was performed for each visual area to determine significant differences between stimulus type (faces, houses, checkerboards) and scan type (visual or imagery).
Visual imagery testing
The vividness of visual imagery questionnaire (VVIQ)  was performed on each control subject and SBR to gain some idea of the individual abilities of the subjects to generate visual imagery. Additionally, SBR completed a short battery of imagery questionnaires (which could be administered aurally given that SBR was blind) administered by a clinical psychologist (EH).
Visual activation corresponds to expected regions of interest
The activation patterns to the visual stimuli consisting of faces, houses, and flickering checkerboard were as predicted for the control subjects. The largest responses to all stimuli were in V1, and then the fusiform face area (FFA). The parahippocampal place area showed the greatest activation to the house stimuli, but very little to the others. The most anterior portion of the calcarine showed more deactivation than activation in controls.
Although SBR claimed not to be able to perceive the visual stimuli, the faces and houses evoked patterns of activation similar to those in controls in the FFA, albeit at a lower level. There was also activation in SBR’s PPA, although this was considerably more variable. SBR’s activation to faces and houses are shown in Fig. 2b. The apparent lateralization to the right hemisphere indicates that SBR’s eyes were probably not looking at the center of the screen.
Patterns of activation to mental imagery of houses, faces, and checkerboards
The equivalent patterns of activation in SBR differ according to the condition. In particular, the pattern of activation to imagery of houses is remarkably similar to the control group. The group data appear to be more reliable due to the type of analysis used. If a mixed-effects analysis is applied to the control data, the activation appears significantly lower than that in SBR (supplementary figure 1). Comparison of imagery of faces is also similar with the exception of the anterior calcarine, which is significantly activated in controls, but not at all in SBR. The reasons for this discrepancy are unclear, but presumably relate to the method used to generate the images.
Interestingly, imagery of houses evoked a response just significantly greater than baseline in the primary visual cortex of control subjects (t = 2.0, df = 23, p < 0.05). However, the similarity of activation to imagery of houses between controls and SBR outside of V1 is striking, suggesting that a lack of V1 activation does not affect activation in extrastriate areas.
In sighted subjects, occipital responses to perception are greater than to mental imagery
Comparison of responses to visual stimulation and visual mental imagery in each of the visual regions of interest showed significant differences. A two-way ANOVA showed a highly significant effect of stimulus type in V1 (F = 62.2; p << 0.001; df = 1) and FFA (F = 10.2; p < 0.005; df = 1) with greater responses to visual stimuli. In contrast, the significant effect of stimulus type in the anterior calcarine region reflected greater activation to mental imagery (F = 23.6; p << 0.001; df = 1). The PPA was the only region that showed no effect of stimulus type.
These results contrast sharply with the data from SBR in which the activation to imagery is greater than visual stimuli in both the FFA and the PPA. There are no responses significantly different from zero in V1 for either stimulus type. In the anterior calcarine, imagery of houses evokes a considerably larger response than visual presentation, although visual presentation of both faces and checkerboards result in larger activation than imagery.
Behavioral measures of visual mental imagery
SBR’s performance on a battery of mental imagery questionnaires
Spontaneous use of imagery scale: (Reisberg et al. 2003)
3.1 (control mean 3.1)
Controllability of visual imagery: Richardson )
Straight/curves letter task: Coltheart et al. 
Top/bottom larger letter task: Coltheart et al. 
Mental hue comparison task: De Vreese 
This study has shown that visual mental imagery can be evoked strongly and successfully even when V1 is compromised. V1 is therefore not necessary for this type of mental imagery. Rather, the generation of images of faces and houses appears to be mediated by activation of a network of extrastriate visual areas both in the dorsal and ventral stream.
Large-scale studies of brain-damaged patients appear to indicate that the greatest deficits in visual mental imagery occur following left posterior occipital damage . A split-brain subject investigated by Farah et al.  was unable to perform visual mental imagery when the cue for the imagery was presented in the left visual field. This suggests that the right hemisphere was unable to support visual mental imagery. Furthermore, Stokes et al.  also found a left hemisphere bias in the lateral occipital cortex for mental imagery classification. These findings are consistent with the greater activation to imagery in the left hemisphere in both SBR and the control group.
V1 has already been shown not to be sufficient for visual mental imagery. Moro et al.  have described two patients without damage to V1, both of whom show deficits in visual mental imagery, with one also showing deficits of tactile imagery. There was damage to left ventral occipital regions in both cases, with one also showing bilateral damage to parietal cortex. Again, this is consistent with the patterns of activation seen in controls and SBR in the current study.
The patterns of activation to imagery in SBR are very similar to those expected from visual perception. This strongly suggests that in spite of the almost complete absence of V1, extrastriate cortical areas are intact and can be significantly activated. It will be interesting to monitor the function of these extrastriate visual areas over time to determine whether they remain visual in a similar way to that reported in late blindness .
One point of potential interest is that SBR did not show much significant activation to the checkerboard. However, this was also the case for many of the control subjects. The group data showing % signal change in Fig. 4 indicate the lower response in this imagery condition. Indeed, the inter-subject variability can be seen in the BOLD responses of Fig. 4, but also in the finding that a mixed-effects analysis (which takes account of inter-subject variance) produced no significant activation within the occipital and parietal regions. The control subjects were also shown checkerboard stimuli in the visual stimulation experiment prior to the imagery scans, so they presumably had an advantage over SBR who had no recent accurate image of this stimulus.
It may be that it is particularly difficult to produce a mental image of such a basic stimulus. The extensive research by Kosslyn and his colleagues leads them to suggest that mental imagery requiring fine-grained spatial detail is likely to activate V1 . In the meta-analysis of studies involving visual mental imagery by Kosslyn and Thompson  there is a list of studies that produced activation of V1 in control subjects. A limitation of using a patient such as SBR is that it is not possible to first present a visual stimulus and then request that the same, or a similar, mental image is produced. In spite of this limitation, two of the tasks reported to produce activation in V1, navigation around one’s hometown  and imagery of animals  were successfully performed by SBR during interview. Additionally, SBR can generate ‘basic’ images such as black and white stripes of varying thickness and upper and lower case letters at different sizes.
The robust imagery experienced by SBR raises the question of whether V1 activation during visual mental imagery is an epiphenomenon not necessary for the experience of the image. One of the predictions in Kosslyn and Thompson is that damage that is specific to, and limited to V1 should produce retinotopic deficits in visual mental imagery. The presence of spared cortex at the very anterior section of SBR’s calcarine cortex can address this prediction. The region corresponds visually to a spared temporal crescent around 40–50° eccentric (as seen in Fig. 1), thus according to this requirement for intact V1 imagery should only be preserved in that region. In this case, however, the imagery spans the entire visual field, and many of the questionnaires performed on SBR require detailed analysis unlikely to be available so eccentrically in the visual field.
In conclusion, the data presented here show that when damage leading to cortical blindness is restricted to V1, visual mental imagery is intact and evokes widespread activation of extrastriate, parietal and frontal regions comparable to sighted subjects.
We are grateful to head radiographer Stuart Wilson for his assistance in the smooth running of the project. We would like to thank SBR for his enthusiastic participation and generous offering of his time. This research was funded by the Royal Society (University Research Fellowship to HB), a Wellcome Trust Clinical Fellowship (WT088217 to EH) and the NIHR Biomedical Research Centre, Oxford (CK).
Conflict of interest
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
- 1.Roland PE, Gulyas B (1994) Visual imagery and visual representation. Trends Neurosci 17(7):281–287 (discussion 294–287). pii:0166-2236(94)90057-4 Google Scholar
- 24.Richardson A (1994) Individual differences in imaging: their measurement. origins and consequences. Baywood Publishing Company, AmityvilleGoogle Scholar
- 32.Moro V, Berlucchi G, Lerch J, Tomaiuolo F, Aglioti SM (2008) Selective deficit of mental visual imagery with intact primary visual cortex and visual perception. Cortex; a journal devoted to the study of the nervous system and behavior 44(2):109–118. doi: 10.1016/j.cortex.2006.06.004 PubMedCrossRefGoogle Scholar
Open AccessThis is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.