Neural network model of the primary visual cortex: From functional architecture to lateral connectivity and back
- 1.1k Downloads
The role of intrinsic cortical dynamics is a debatable issue. A recent optical imaging study (Kenet et al., 2003) found that activity patterns similar to orientation maps (OMs), emerge in the primary visual cortex (V1) even in the absence of sensory input, suggesting an intrinsic mechanism of OM activation. To better understand these results and shed light on the intrinsic V1 processing, we suggest a neural network model in which OMs are encoded by the intrinsic lateral connections. The proposed connectivity pattern depends on the preferred orientation and, unlike previous models, on the degree of orientation selectivity of the interconnected neurons. We prove that the network has a ring attractor composed of an approximated version of the OMs. Consequently, OMs emerge spontaneously when the network is presented with an unstructured noisy input. Simulations show that the model can be applied to experimental data and generate realistic OMs. We study a variation of the model with spatially restricted connections, and show that it gives rise to states composed of several OMs. We hypothesize that these states can represent local properties of the visual scene.
KeywordsVisual cortex Spontaneous activity Orientation selectivity Neural network model Optical imaging
Processing of visual information in the mammalian primary visual cortex (V1) is thought to arise from an interplay between the pattern of external projections and intrinsic cortical dynamics. Even though the intrinsic processing has been a subject of an extensive research, its role and the mechanisms underlying it remain poorly understood. A powerful tool for understanding the intrinsic processing is the study of spontaneous cortical activity, that is, activity not evoked by visual stimulation. Even in the absence of visual stimulation, V1 exhibits a rich and complex spontaneous activity (Lampl et al., 1999; Tsodyks et al., 1999; Kenet et al., 2003; Fiser et al., 2004). This activity is thought to originate from mechanisms intrinsic to V1. Thus, spontaneous activity can reveal the underlying V1 architecture and shed light on its function.
In this study, we focus on the link between spontaneous activity and the activity evoked by visual stimulation. Since the work of Hubel and Wiesel (1959) it is believed that one of the main functions of V1 is to encode and process oriented stimuli. A major progress in studying the functional architecture of V1 was achieved by optical imaging (Blasdel and Salama, 1986; Grinvald et al., 1986). In a widely used experimental protocol (Grinvald et al., 1999), an animal is shown full field moving gratings of different orientations. Each orientation yields a single condition orientation map (OM), a two-dimensional representation of the neuronal activity across the cortical sheet evoked by the stimulus. In cats, as well in many other mammals (including primates, ferrets, tree shrews and sheep, but not rodents; see Van Hooser et al., 2005) neurons with similar orientation preference tend to be clustered. Thus, OMs are characterized by patches of high neuronal activity separated by regions of low neuronal activity. The location and shape of the patches change with the gratings’ orientation.
A recent work (Kenet et al., 2003) used optical imaging with voltage sensitive dye to study spontaneous activity in V1 of an anaesthetized cat, measured when the animal’s eyes were closed. Even though no visual stimulus was presented, some of the spontaneous cortical states were similar to the OMs of the same region. When such spontaneous OMs emerged, they spanned several hypercolumns, and were often followed by states similar to OMs of a proximal orientation. It was speculated that the spontaneous activity reflects the internal state of the brain, which might be influenced by context, attention, or perceptual memory. For example, the spontaneous state can reflect an expectation of the orientation of a forthcoming input, based on prior activity. In any case, the striking similarity between spontaneous and evoked states suggests that there exists a mechanism intrinsic to V1 capable of generating the OMs. If such mechanism exists, the evoked OMs originate from an interplay between the intrinsic mechanism and the pattern of afferent LGN input, known to have some degree of orientation tuning.
What is the intrinsic V1 mechanism underlying the spontaneous emergence of OMs? Many experimental studies suggest an important role for the pattern of lateral connectivity in V1. A large body of anatomical and electrophysiological research has shown that the V1 intracortical connectivity is correlated with orientation preference. The general trend is that long range lateral projections connect neurons with similar orientation preference (Gilbert and Wiesel, 1989; Malach et al., 1993; Weliky et al., 1995; Bosking et al., 1997; Kisvárday et al., 1997; Buzás et al., 1998). As the data is highly variable, this trend is true only on average, and the exact relation between intracortical connectivity, orientation preference, and other functional maps remains a subject of active research (Kisvárday et al., 2002; Ben-Shahar and Zucker, 2004). Direct evidence for the involvement of the lateral connections in orientation tuning comes from studies in which inactivation of GABAergic neurons altered the orientation tuning curves of remotely located neurons (Crook et al., 1998; Kisvárday et al., 2000). Developmental studies in newborn animals have shown that the overall geometry of the OMs is stable from a very early stage, and that it is resistant to manipulations of the visual input (Crair et al., 1998; Löwel et al., 1998). On the other hand, cortical development involves sharpening of the OMs with a time course that closely matches the time course for expression and refinement of long range lateral connections (Gödecke et al., 1997). Developmental experiments in which the visual input was rerouted into the auditory cortex (Sharma et al., 2000), yielded an auditory cortex that was similar, in many aspects, to V1. In particular, it exhibited both OMs and long range lateral projections that preferentially connected cells with similar orientation preference. Taken together, these developmental studies provide further support for the strong link between OMs and lateral connections.
From a theoretical point of view, V1 can be viewed as a complex, nonlinear, dynamical system. Several theoretical studies suggested that OMs are attractor states of the cortical dynamics (Somers et al., 1995; Sompolinsky and Shapley, 1997; Ernst et al., 2001). This line of thought is consistent with the spontaneous emergence of orientation maps because OMs can still be attractors of the intracortical dynamics even without the stimulus-encoding afferent input. In this family of models the pattern of lateral connectivity plays an important role in the formation of the attractor landscape, consistent with the experimental findings listed above. A well studied example of such a model is the ring model (Ben-Yishai et al., 1995; Hansel and Sompolinsky, 1998). This model considers a population of neurons in one hypercolumn in V1. Each neuron is characterized by a preferred orientation, and the overall distribution of preferred orientations is uniform over the entire range of possible orientations. The neurons receive both afferent LGN inputs and lateral recurrent inputs. When a stimulus is presented to the network via the afferent connections, the network develops an activity profile that peaks at the neuron whose preferred orientation matches the stimulus’ orientation. However, the precise shape of the stationary profile is determined, to a large extent, by recurrent connections. The ring model therefore suggests a mechanism that links the cortical response evoked by an oriented stimulus and the pattern of lateral connections.
Moreover, if the recurrent connections are strong enough, states similar to those evoked by a stimulus emerge even if a uniform input (representing lack of an external visual stimulus) is applied. This occurs because the uniform solution becomes unstable, and a continuum of states that are similar to the states evoked by the different stimulus orientations emerges as an attractor of the network’s dynamics. Collectively, these states are known as the ring attractor. Thus, the ring model suggests a mechanism that explains how states similar to OMs can emerge spontaneously. This mechanism was suggested to underlie the patterns of spontaneous activity observed in Kenet et al. (2003).
The ring model, however, cannot directly explain the generation of experimental OMs. It is inherently a one-dimensional model, proposed as a model for one hypercolumn, and cannot account for the generation of the 2-dimensional OMs. One can of course consider a straightforward 2-dimensional implementation of the ring model, by simply placing the neurons on a 2-dimensional sheet (Goldberg et al., 2004); however, the attractor states of such implementation do not necessarily match the experimental OMs. We will further discuss the limitations of the ring model in Section 2.
This leaves the following question open: what type of lateral connectivity can lead to the spontaneous emergence of the OMs? In this contribution we answer this question by suggesting a neural network model with a simple connectivity rule that supports a ring attractor; this ring attractor is composed of states similar to the experimental OMs. To construct this network we first consider an approximation to the OMs (Section 2). Then, we introduce the model and solve it analytically (Section 3). Later, we take an experimental data set, and apply to it the theory we developed in the previous section (Section 4).We continue by studying the effect of the limited spatial extent of the lateral connections (Section 5), and conclude with a discussion of our results and predictions of the models (Section 6).
2. The polar map
From the above analysis we conclude that experimental OMs can be well-approximated using the PM. For the purpose of this contribution, that is, constructing a neural network with OMs as being its attractor states, this approximation offers two advantages. First, by associating each location with only two real numbers (r x , θ x ), rather than the entire tuning curve, the dimensionality of the problem is greatly reduced. Second, the approximation suggests a natural way to interpolate OMs for orientations other than the ones presented during the experiment. We can thus consider a ring of approximated OMs, formally defined by assigning arbitrary values to φ in Eq. (2) Our modeling goal can be now reformulated as constructing a model whose attractor states will coincide with this ring of approximated OMs. This goal is achieved by the model we introduce in the next section.
The information about the PM is given by the term r x r y cos(θ x −θ y ). The parameter J 2 > 0, is a global scaling factor of this term. Since scaling the values of r is equivalent to scaling J 2, we assume that the values of r are normalized so that the mean of r x 2 over the area is 1. The parameter J 0 represents global excitation (if J 0 > 0) or global inhibition (if J 0 < 0). It should be noted that the connectivity given by Eq. (6) is similar to the connectivity of the ring model (Ben-Yishai et al., 1995). However, unlike in the ring model, the connectivity we suggest depends not only on the preferred orientations of the pre- and post- synaptic locations, but also on their selectivities.
We next consider the system given by Eqs. (4)–(6) for two types of afferent input: one corresponding to spontaneous activity (Section 3.1), and the other representing the afferent input evoked by the gratings stimulus (Section 3.2).
3.1. Spontaneous activity
To model spontaneous activity, we take the afferent input to be constant for all locations, i.e., I x aff . We also assume C > T, otherwise all locations are below threshold, and the network does not develop any activity.
3.1.1. Reduced dynamics
3.1.2. Uniform solutions
3.1.3. Non-uniform solutions
F 0(X) ≥ 0
F 0(X) ≥ X
F′0(X) ≥ 0
F′0(X) ≤ 1
F 2(X) ≥ 0
F 2(X) ≤ ½
F′2(X) ≥ 0
F 0(X) − XF′o(X) = F′2(X)
F 2(X) − XF′2(X) ≤ ½
F′0(X)F 2(X) − F 0(X)F′2(X) ≥ 0
3.1.4. Phase diagram
Outside the regions of linear phase and marginal phase no stable fixed point exists and the network develops amplitude instability. Unlike the boundaries of the linear phase, the line X 0 = X 2 that separates the marginal phase from the amplitude instability region depends on P(r). However, some of its properties do not depend on P(r). In particular it can be checked that it always passes through the points (J 0 = 1, J 2 = 2), and (J 0 = 0, J 2 = 4).
3.2. Evoked activity
The case of a non-uniform input is more complex than the uniform input case, because the steady state solutions are sensitive to the fine structure of the input. However, some general observations about the fixed point can still be made. Since the synaptic input I rec is still given by Eq. (10), it equals a scaled/shifted version of one of the approximated OMs, and the total synaptic input is the sum of that map, and the afferent input, I aff. The orientation of the approximated OM, and its scaling and translation parameters are still determined by ψ, ρ, and μ. Thus, the role of I aff reduces to selecting the values of μ, ρ, and ψ, which will put the system in a steady state.
3.2.1. Reduced dynamics
In the region corresponding to the marginal phase of the activity, i.e., J 0 < 1, J 2 > 2, X 0 < X 2, where X 0 is a function of J 0 and X 2 is a function of J 2, (Section 3.1.3) inequalities (26) and (43) imply X 0 < X < X 2. On the interval X 0 < X < X 2, the left hand side of Eq. (41) is monotonically decreasing of X, approaching ∞ at X = X 0, and taking the value of 0 at X = X 2 (Fig. 5(B)). Therefore, in this region, Eq. (41) has a unique solution for any (positive) ϒ, and a unique fixed point exists. Finally, in the region J 0 < 1, J 2 > 2, X 0 > X 2, inequalities (26) and (43) cannot be satisfied simultaneously, therefore, no fixed point exists.
3.2.3. Phase diagram
In sum, the above analysis shows that the region where a fixed point exists for the evoked activity, coincides precisely with the regions where a fixed point exists for the spontaneous activity, i.e., the regions of the linear and marginal phases of the spontaneous activity. The stability analysis in the appendix shows that this fixed point is stable, and that any other fixed point in this region is unstable. Similar arguments to those presented for the marginal phase of the spontaneous activity imply that the total synaptic current is a scaled/shifted version of an OM. However, unlike the case of the spontaneous activity where the orientation of the OM was arbitrary, for the evoked activity, the orientation of the OM is bound to match the orientation of the afferent input.
3.3. Energy function
To illustrate the theoretical results obtained in the previous section and validate their applicability to experimental data, we applied the model to the Kenet et al. (2003) data set. An important assumption we made in the previous section is that of isotropy of orientation preference (Section 3.1.1). The isotropy assumption requires the distribution of the values of z x to be rotationally symmetric about the origin. The experimental distribution of z x , which is shown in Fig. 1(B), does not seem to deviate strongly form the rotational symmetry assumption. This is consistent with some previous optical imaging studies in cats that either did not find any systematic over-representations of specific orientations (Bonhoeffer and Grinvald, 1993; Kenet et al., 2003), or found small, albeit significant in some cases, over representation of cardinal orientations (Müller et al., 2000; Yu and Shou, 2000; Dragoi et al., 2001b; Wang et al., 2003). However, there are many factors that might distort the precise distribution and mask the true extent of the anisotropy. In particular, the fact that only a small fraction of V1 is imaged can increase the anisotropy in the imaged map compared to the true one, whereas measurement noise of the optical imaging data, can artificially induce an opposite effect.
The PM after isotropy adjustment is shown in Fig. 7(A) and it is very similar to the experimental PM shown in Fig. 1(A). Since our main motivation of using the PM is its ability to provide an approximation to the OMs (Eq. (2)), we quantified the distortion caused by the isotropy adjustment by calculating for every orientation the correlation between the OM approximated with the experimental PM and the OM approximated with the adjusted PM. The average correlation over all possible orientations was 0.971 (min: 0.968, max: 0.973). These high correlations indicate that the original map was not very far from meeting the isotropy assumption in the first place. The average correlation between the 8 experimental OMs and the OMs approximated with the adjusted PM was high as well (0.791; min: 0.725, max: 0.855). We therefore used the adjusted PM to construct the connectivity matrix (Eq. (6)) and tested the model in the spontaneous activity and the evoked activity regimes.
An example of a single simulation is presented in Fig. 8(A)–8(C). Figure 8(A) shows the initial state. Figure. 8(B) shows the total synaptic input, I rec + C, at the fixed point. It is a linear transformation of the approximated OM of 90°. The highly similar experimental OM of 90° is presented in Fig. 8(C) for comparison (correlation = 0.85). The steady states of all simulations where similar to one of the experimental OMs (correlation >0.7). The high similarity between the simulated and experimental maps demonstrates that the model produced a good approximation for the experimental OM. It also implies that any violations of the approximation assumptions, (ability to approximate OMs with the PM and isotropy) did not cause any significant distortion of the OM. In Fig. 8(D) we show the distribution of the orientations of the steady state OMs for all 10000 simulations. The orientation was calculated by taking the angle of the projection of the synaptic input at the fixed point on the PM. Consistently with our theoretical analysis, this figure shows that the OM at the fixed point was arbitrary, with equal probability for all orientations.
5. Model with spatially restricted connections
For the spatially restricted model we constructed the lateral connectivity with Eq. (48), using the same PM we used for the simulations in Section 4. We took σ = 0.6 mm, which is approximately the diameter of a hypercolumn. It has been estimated that in cats most projections are approximately within this distance (Kisvárday et al., 1997; Schummers et al., 2002). The global parameters of the lateral connections were J 0 = −3 and J 2 = 3.5, which correspond to the marginal phase of the spatially unrestricted model. Any single realization of the input, such as the ones in Fig. 10(A) and (D), yielded one particular steady state solution. However, for different realizations of the input, the network had an unlimited number of attractors states. Some of these states were similar to OMs, like in the case of the spatially unrestricted model. Still, other steady states were not highly correlated with OMs. An example of two such states is given in Fig. 10(B) and (E). A close examination of these states revealed that they were mosaics of OMs, i.e., they were composed of different OMs in different regions of the modeled area. The structure of these states is demonstrated in Fig. 10(C), 10(F). For example, in Fig. 10(C), the OM of 22.5° is presented in the upper part, and the OM of 67.5° is presented in the lower part. This combination of OMs presented in Fig. 10(C) produces a state that is very similar to the steady state shown in Fig. 10(B). We conclude that with noisy afferent input the model with spatially restricted connections is qualitatively similar to the model of spontaneous activity we considered in Section 3.1, except that steady states can be mosaics of OMs, rather than a single OM.
We also tested this model in the evoked activity case, by adding a small modulation in the shape of an approximated OM to the noisy input described above (similarly to our approach in Section 4). An example of such input is presented in Fig. 10(F) where the orientation of the OM was 45°. The steady state for this simulation is presented in Fig. 10(G), and the experimental OM for 45° is presented in 10H. The steady state is similar to the OM encoded in the input, and the noise is filtered out. This was the case for all simulations. Thus, for evoked activity, the behavior of the model with spatially restricted connections is very similar to the behavior of the model with unrestricted connections.
The emergence of OMs during spontaneous activity in anaesthetized cats has led to the suggestion that OMs are attractors of the intracortical network (Kenet et al., 2003). Adopting this view, we posed the following question: what type of intracortical dynamics and connectivity can lead to the formation of attractors at the OMs? In this work, we suggested a rate model endowed with a simple connectivity rule (Eq. (6)), and showed that it yields attractor states that are highly similar to OMs. Specifically, we showed analytically that in the proper parameter regime (marginal phase), and given a uniform input, the model has a ring attractor formed by approximated OMs of arbitrary orientations. This property explains the formation of OMs during spontaneous activity where the afferent input is assumed to be unstructured. We also considered the case where the activity is evoked by a visual stimulus and showed how a structured afferent input can select the OM that matches the stimulus’ orientation. The model therefore suggests that OMs are encoded in the lateral connections, and that these connections can generate OMs both when the activity is spontaneous and when it is evoked by a visual stimulus.
The core of our model is its connectivity pattern (Eqs. (6), (48)). This connectivity pattern depends on three properties of the interconnected sites: the selectivity, the preferred orientation, and the distance between the pre- and post- synaptic locations. The main theoretical innovation in our model is the explicit incorporation of the selectivity variable into the connectivity pattern. We treat the selectivity as a structural attribute of every cortical location, similarly to how the preferred orientation is dealt with by many models (including ours). We have shown that this approach is sufficient for explaining the correspondence between OMs and intrinsically preferred states of the cortical network. The model therefore predicts a different connectivity pattern for neurons near pinwheels and neurons in linear zones. There are some experimental evidence in favor of this view. Yousef et al. (2001) reported that connections of neurons near pinwheels have shorter lateral extent that neurons in linear zones, and that these connections are not as orientation-specific as those of neurons in linear zones. The latter result is consistent with our connectivity matrix, in which the orientation-dependent term in the equation of synaptic strength (Eq. (6)) is multiplied by the selectivity.
In the context of studying orientation selectivity, it is important to distinguish between two types tuning curves: of membrane potential tuning curves, on which we focused in this contribution, and commonly considered firing rate tuning curves. These two types of tuning curves give rise to two different measures of selectivity, and the closely related measures of tuning width. In our model, the shape of the membrane potential tuning curve is the same for all locations (a cosine shape). The different selectivity of different locations comes from different scaling of the tuning curve. As for firing rate tuning curves, the picture is more complicated. Equation (44) implies that the selectivity and width of firing rate tuning curves vary with membrane potential selectivity. The precise characteristics of the firing rate tuning curve depends on the model parameters (J 0, J 2), and both broad and narrow tuning curves are possible. In the linear regime, all locations have broad tuning curves. In the non-linear regime, both broad and narrow tuning curves are possible.
Several experimental studies used recordings of single neurons to study the dependence of selectivity and other tuning curve properties on the cortical location. Before we compare our model with these studies, it is important to note that the low selectivity near pinwheels seen with optical imaging, which is at the heart of our modeling approach, is difficult to interpret in terms of single neuron properties. This is because it can arise from either lack of orientation selectivity of single neurons near the pinwheel, or from averaging highly selective neurons with a highly variable orientation preference. The second option received support form extra-cellular recordings (Maldonado et al., 1997; Dragoi et al., 2001a) that found that as far as firing rates are concerned, neurons near pinwheels are as sharply tuned as neurons in linear zones. However, intracellular recordings (Schummers et al., 2002) have shown that when tuning curves of sub-threshold membrane potential are considered, the selectivity of neurons is indeed reduced with the selectivity given by the PM. Our model, in which selectivity varies both for synaptic-input and firing-rate tuning curves, is therefore consistent with membrane potential tuning curves, but not with firing rate tuning curves. As suggested by Schummers et al. (2002), this difference between the tuning of membrane potential and the tuning of firing rate might be accounted for by different parameters of the gain function (e.g., firing thresh-old) for neurons near pinwheels. This suggestion can be easily incorporated into our model. Other mechanisms were suggested, some of them, like sensitivity to the temporal structure of the membrane potential fluctuations (Volgushev et al., 2002), are beyond the framework of the rate models we discussed here.
The notion of tuning curves, is clearly associated with evoked activity. However, the principles laid down in this work can lead to the definition of “spontaneous tuning curves”. In an experimental setup, if optical imaging of spontaneous activity is performed simultaneously with single unit recordings, a spontaneous tuning curve can be defined as the average firing rate (measured electrophysiologically) as a function of the orientation encoded by the cortical state (measured by the optical imaging). It would be interesting to characterize spontaneous tuning curves and compare them with the classical, evoked, tuning curves. In one particular scenario our model predicts a qualitative difference between spontaneous and evoked tuning curves. A comparison between the phase diagrams for spontaneous and evoked activity (Figs. 4(E), 5(C)) implies that if V1 operates near the phase transition between the linear and marginal phases of spontaneous activity, (J 2 close to 2), spontaneous tuning curves are expected to be significantly broader than the evoked ones. This prediction can be tested experimentally.
6.2. Orientation preference
Similarly to other models, our connectivity pattern suggests a more excitatory (or less inhibitory) coupling between neurons with similar orientation preference. This is in agreement with many experimental works that have shown that neurons tend to make connections with other neurons with a similar orientation preference. It has been argued that this is only a weak trend that is true only on average (Kisvárday et al., 1997). This does not necessarily contradict our model because the model considers populations of neurons and not single neurons. In addition, both in the linear and in the marginal phases, the ratio between the preferred-orientation dependent and independent components can be made arbitrarily small, by taking large negative value for J 0.
Another challenge for our model is the fact that the dependence of the connectivity on orientation preference is primarily true for long range connections, i.e. connections between different hypercolumns. Moreover, it has been suggested that short-range connections are spatially isotropic (Ts’o et al., 1986; Das and Gilbert, 1999) (note that isotropy here refers to invariance with respect to direction on the cortical sheet, unlike the isotropy in the feature space we considered before). In contrast, our model does not distinguish between long-range and short-range connections, and in particular it does not include explicitly isotropic short range connections. We focused on the long-range type connections because isotropic connections alone, are hard to reconcile with the spontaneous emergence of OMs. This type of connectivity is invariant with respect to spatial rotation/ translation. Consequently, the spontaneous patterns it induces are also invariant with respect to rotation/translation. However, experimentally observed patterns of spontaneous activity are correlated with the OMs and do not exhibit this invariance (Kenet et al., 2003). It is also important to note that because of the dependence of the connectivity on the selectivity, our model does not exhibit a strong spatial anisotropy of the short-range connections. In the linear zones, neurons are surrounded by neurons with similar orientation preference, and therefore they exhibit roughly isotropic connections. Near pinwheels this is not true anymore; However there the connectivity depends only weakly on the orientation preference, and the global component (J 0) dominates the connectivity, producing again a roughly isotropic connectivity. Nonetheless, an explicit incorporation of isotropic short range connections might be considered in a future work.
6.3. Spatial structure of the OMs
Two assumptions about the structure of the OMs were required for the formation of the ring attractor. The first assumption is that OMs can be well-approximated using the PM (Eq. (2)), that is, by considering at each location only the preferred orientation and selectivity. This assumption can be expressed by the condition that on average, a large fraction of the variance of the pixels’ tuning curves can be explained by its first Fourier component (Eq. (3)). We found that this condition is met in experimental data sets, and that individual OMs are highly correlated with their approximated versions. We note however, that the approximation of orientation tuning curves with cosine functions, as in Eq. (2), was criticized recently on the ground that it cannot describe the height and width of the tuning curves independently (Swindale et al., 2003). While deviations from cosine tuning curves can be functionally important, our analysis indicates that the PM provides a good first-order approximation for the OMs. The examples in Figs. 8–10 of individual experimental OMs compared with the output of the model, further support this claim.
The second assumption we made about the OMs is that the representation of orientation preference in the PM is isotropic, that is, that the distribution of preferred orientations is uniform and independent of the distribution of selectivities. For the experimental data set, we showed that orientation preference did not deviate strongly from the isotropy assumption. As discussed in Section 4, this result is consistent with some experimental studies in cats. Other studies, however, found a small bias of the distribution of preferred orientations towards the cardinal orientations. Interestingly, Kenet et al. (2003) reported a similar cardinal-orientations bias in the distribution of spontaneous OMs. It is thus conceivable that a small anisotropy in the distribution of preferred orientations indeed exists in cats’ V1, and that this anisotropy induces a significant anisotropy in spontaneous activity patterns. While our current model does not account for anisotropy, it provides a framework in which the effects of anisotropy in V1 could be addressed in future works.
6.4. Relation to the ring model
The model we presented here is strongly related to the ring model for feature selectivity (Ben-Yishai et al., 1995; Hansel and Sompolinsky, 1998). In fact, the ring model can be viewed as a special case of our model, in which all locations have the same selectivity. Therefore, these two models share some features that do not depend on the distribution of selectivities P(r), e.g., the general structure of the phase diagrams (Figs. 8(E) and 9(C)). Since in our model multiple selectivities are allowed, the attractor states can exhibit a much richer spatial structure and approximate the experimental OMs.
6.5. Lateral extent of the connections
For most of the work, the connectivity pattern that we considered (Eq. (6)), did not depend on the distance between the pre- and post- synaptic locations. In contrast, neuronal connections in the cortex have a limited lateral extent. Therefore, in Section 5, we suggested a modification of the connectivity rule in which the connections were spatially restricted. Using simulations, we showed that this version of the model has properties similar to the spatially unrestricted one, except for one important difference: the states generated during spontaneous activity are not necessarily OMs, but can be a mosaic of several OMs. Consequently, we predict that such states exist in spontaneous activity data. Preliminary analysis we of the data obtained in Kenet et al. (2003), indicates that mosaic states indeed emerge spontaneously.
It is important to note that the distinction between OM states and mosaic states is somewhat blurred. An OM state might in fact be a small part of a larger mosaic state, that would have been observed had a larger cortical area been considered. It is also possible, that what looks as an OM state is a composition of several OMs of similar orientations, that cannot be distinguished with current techniques. We can thus expect that if a large cortical region will be imaged during spontaneous activity, spontaneous states will correspond more closely to mosaic states, rather than to OM states. From a theoretical point of view, the prevalence and characteristics of mosaic states in spontaneous activity is an interesting question because mosaic states provide a signature of the effective strength and extent of the lateral connections in V1. Spontaneous states that correspond to OM states rather than to mosaic states indicate a strong lateral connectivity with large spatial extent. A further analysis, which is beyond the scope of this contribution, is required to fully characterize the behavior of the spatially restricted model, and its implications on spontaneous activity.
Our approach was based on identifying the attractor states of the intracortical network with the OMs. Because we used a static input and simple rate dynamics, attractor states always existed; the network always converged to a stationary activity profile. In contrast, spontaneous activity in anaesthetized cats is highly dynamic, continuously switching between states. This gap between the dynamics of spontaneous activity in cats and the dynamics of our model can be bridged by considering various mechanisms that can prevent the asymptotic convergence of the model to a fixed point. The dynamical switching between states can be induced by a dynamical external input. Specifically, Goldberg et al. (2004) suggested that spatio-temporally correlated noise coming from the LGN may drive the cortical dynamics. In the marginal phase, where the shape of the activity is dominated by recurrent connections, this type of afferent noise would cause the network to perform a random walk in the space of OMs. An analysis of experimental data reveals that signatures of its dynamics are different from those of a simple random walk along the ring attractor. Another possibility, which might be more compatible with experimental data, is that the system is in the linear phase. The observed cortical states in this case are the sum of the afferent input and a component in the shape of the OMs, induced by the recurrent connections (Goldberg et al., 2004).
The dynamical switching between states can be also induced by mechanisms intrinsic to V1. For example, firing rate adaptation or synaptic depression/facilitation can destabilize the attractor states on a slow time-scale. Including a term for firing rate adaptation in the dynamical equation (Eq. (4)), as in Hansel and Sompolinsky (1998), causes the network, in the marginal phase, to perform a limit-cycle in the space of OMs. This possibility seems too simplistic to account for the spontaneous cortical dynamics. However, a more complicated dynamical behavior can emerge if synaptic depression/facilitation is included. Such complicated behavior indeed emerges in the ring model with synaptic dynamics (Tsodyks, unpublished results), and we expect similar results for our model. It is also likely that spontaneous activity in V1 is driven by a combination of several of the mechanisms we mentioned above. Our model provides the framework in which the contribution of each of these mechanisms could be studied.
6.7. The stimulus
Throughout the paper, we assumed that the evoked OMs encode the orientation of the stimulus. This might not be the case. Basole et al. (2003) found that states highly similar to OMs, can also be evoked by texture stimuli containing short line segments. The OM to which the resulting state corresponded depended on both the orientation of the line segments and the direction in which they moved. The authors concluded that OM-like states encode the spatio-temporal properties of the stimulus, rather than its (spatial) orientation. The issue of which stimulus property is encoded by the OMs is largely avoided in our model because we did not consider in details how a particular visual stimulus is transformed into a pattern of LGN input to V1. For the types of input we considered, the LGN-V1 mapping is assumed to extract some information about features of the visual scene (e.g. orientation) and the intrinsic V1 processing acts to amplify and denoise the afferent signal. Input patterns of higher complexity may lead to a more intricate transformation by the recurrent V1 network.
In a broader context, our model can be considered as a general model for population encoding of a sensory or motor variable in the presence of a weak or noisy input. This variable can be some spatio-temporal characteristic of a sensory stimulus, but also direction of a planned movement, or direction of gaze. The variable encoded must however be periodic, otherwise the concept of a ring attractor is not relevant. In fact, the generality of the model is inherited from the ring model, which our model generalizes. Extensions of the ring model and other similar models supporting ring attractors have been considered in several systems such as spatial working-memory (Camperi and Wang, 1998; Compte et al., 2000), head direction system (Skaggs et al., 1995; Redish et al., 1996; Zhang, 1996; Xie et al., 2002; Boucheny et al., 2005), hippocampal place cells (Tsodyks and Sejnowski, 1995), general statistical inference (Pouget et al., 1998; Deneve et al., 1999) and TMS-induced perceptual suppression (Miyawaki and Okada, 2004). Some of these models build directly on the formulation of Ben-Yishai et al. (1995); others use different formulations but are similar in many aspects (Ermentrout, 1998). Our model adds to this class of models the possibility of variability in response amplitude, i.e. selectivity, of different neurons. As a result, the ring attractor is not associated with a simple spatial form of the activity pattern, like a single localized bump in the ring model, but rather includes the complex spatial structure of the OMs.
Regardless of the precise nature of the features represented by the OMs, the spatially restricted version of the model suggests how local features of the stimulus can be encoded when the stimulus properties, e.g. orientation, vary across the visual field. Since the coarse grain mapping of the visual field to the cortex is retinotopic, we can expect the activity patterns at a small cortical regions to represent the properties of the stimulus in the corresponding regions of the visual field. The states generated by the model, e.g. the mosaic states in Fig. 10, when evoked, achieve precisely this. We thus predict that states similar to the mosaic states will play important role in encoding complex stimuli whose features vary across the visual field.
For the theoretical analysis we let orientations take values over the interval [0, 2π) rather than the natural encoding over the interval [0, π). This encoding induces a 2π periodicity that simplifies the equations we present. Thus, φ j represents a stimulus whose actual orientation was φ j /2.
We thank A. Grinvald, T. Kenet, and A. Arieli for kindly providing us with the experimental data. Special thanks to D. Hansel for critical reading of the manuscript and inspiring suggestions. We thank H. Sompolinsky for fruitful discussions, and S. Preminger, A. Loebel, O. Shriki, M. Katkov, O. Barak, and M. Szwed for their comments on the manuscript. Supported by grants from the Israeli Science Foundation and Irving B. Harris Foundation.
- Crook JM, Kisvárday ZF, Eysel UT (1998) Evidence for a contribution of lateral inhibition to orientation tuning and direction selectivity in cat visual cortex: Reversible inactivation of functionally characterized sites combined with neuroanatomical tracing techniques. Eur. J. Neurosci. 10: 2056–2075.CrossRefPubMedGoogle Scholar
- Grinvald A, Shoham D, Shmuel A, Glaser D, Vanzetta I, Shtoyermann E, Slovin H, Sterkin A, Wijnberg C, Hildesheim R, Arieli A (1999) In-Vivo Optical Imaging of Cortical Architecture and Dynamics. In: U. Windhorst, H. Johansson, eds. Modern Techniques in Neuroscience research. Springer-Verlag, pp. 893–969.Google Scholar
- Hansel D, Sompolinsky H (1998) Modeling Feature Selectivity in Local Cortical Circuits. In: C. Koch, I. Segev, eds. Methods in Neuronal Modeling: From Synapse to Networks. 2 edition MIT Press pp. 499–567.Google Scholar
- Hertz J, Krogh A, Palmer R (1991) Introduction to the Theory of Neural Computation. Perseus Books.Google Scholar
- Sterkin A, Lampl I, Ferster D, Glaser D, Grinvald A, Arieli A (1999) Exploring cortical synchronization by simultaneous intracellular recording and dye imaging in cat visual cortex. Soc. Neurosci. Abstr. 25.Google Scholar
- Tsodyks M, Sejnowski T (1995) Associative memory and hippocampal place cells. Int. J. Neural. Syst. 6: 81–86.Google Scholar