Encyclopedia of Color Science and Technology

2016 Edition
| Editors: Ming Ronnier Luo

Color Synesthesia

Reference work entry
DOI: https://doi.org/10.1007/978-1-4419-8071-7_112

Synonyms

Definition

Color synesthesia is a condition in which sensory or cognitive inducers elicit atypical binding of these inducers to concurrent color experiences.

Marks of Color Synesthesia

Synesthesia is a condition in which stimulation in one sensory or cognitive stream involuntarily, or automatically, leads to associated internal or external (illusory or hallucinatory) experiences in a second unstimulated sensory or cognitive system [1, 2, 3, 4, 5, 6, 7, 8, 9]. Although most cases of synesthesia are developmental and run in families, acquired cases have also been reported following traumatic brain injury, demyelination, ischemia, tumors, post-traumatic total ocular blindness, and neuropathology involving the optic nerve and/or chiasm [10, 11, 12].

Color synesthesia is a special kind of synesthesia that comprises cases of synesthesia in which a noncolored sensory or cognitive stimulus involuntarily leads to internal or external color experiences. The prevalence of color synesthesia is unknown. Estimates range from 1 in 200 to 1 in 250,000 [13, 14]. Some speculate that color synesthesia may be present in more than 4 % of the population [5].

One of the best-known forms of color synesthesia is grapheme-color synesthesia, in which numbers or letters are seen as colored. But lots of other forms of color synesthesia have been identified, including week-color synesthesia, sound-color synesthesia, taste-color synesthesia, fear-color synesthesia, etc. [5] For lack of space, this entry shall focus primarily on grapheme-color synesthesia.

One mark of color synesthesia is that the synesthetic colors are seen either as projected out onto the world (“projector synesthesia”) or in the mind’s eye (“associator synesthesia”) [15]. Another mark is that it exhibits test-retest reliability [1, 16]: colors identified by the subject as representative of her synesthetic experiences relative to a given stimulus in the initial testing phase are nearly identical to colors identified by the subject as representative of her synesthetic experiences relative to the same stimulus in a retesting phase at a later time (see Fig. 1).
Color Synesthesia, Fig. 1

Example of test-retest reliability of synesthetic experience in one of the St. Louis Synesthesia Lab’s associator grapheme-color synesthetes from ages 3 to 8 (Go = gold, B = blue, Y = yellow, G = green, P = purple, R = red, Bl = black, DBr = dark brown, Br = brown, W = white)

Because of the automatic nature of synesthesia and its test-retest reliability, color synesthesia is not to be confused with memory associations or stereotypical colors of objects. For example, there is no evidence that color synesthetes simply remember the colors of entities or images they were exposed to earlier in their lives or associate stimuli with their stereotypical colors [16].

Synesthetic color experience is unique for each synesthete. For example, the letter A may trigger the color red in one grapheme-color synesthete but trigger the color blue in another. In fact, each grapheme has been found to trigger each of the 11 Berlin and Kay colors in different synesthetes (red, pink, orange, yellow, green, blue, purple, blown, black, white, gray). Despite the uniqueness of synesthetic color experience, synesthetic colors sometimes fall into certain clusters. For example, grapheme-color synesthetes tend to associate A with red, E with yellow or white, I with black or white, and O with white [17, 18].

Low-Level Versus High-Level Perception

An open question about color synesthesia is whether it is a form of low-level or high-level perception. According to Ramachandran and Hubbard [19], synesthesia is a form of low-level perception, a “sensory” phenomenon. As they put it:

Work in our laboratory has shown that synesthesia is a genuine sensory phenomenon. The subject is not just “imagining the color” nor is the effect simply a memory association (e.g., from having played with colored refrigerator magnets in childhood) [19, p. 51].

Some of the evidence listed in favor of treating color synesthesia as a kind of low-level perception is that some grapheme-color synesthetes appear to experience a pop-out effect in visual search paradigms in which some characters elicit synesthetic experience. For example, if a cluster of 2s is embedded in an array of randomly placed 5s, normal subjects take several seconds to find the shape formed by the 2s, whereas grapheme-color synesthetes who experience a pop-out effect instantly see the shape (see Fig. 2) [7, 20, 21].
Color Synesthesia, Fig. 2

When normal subjects are presented with the figure on the left, it takes them several seconds to identify the hidden shape. Some grapheme-color synesthetes instantly see the triangular shape because they experience the 2 s and the 5 s as having different colors

Visual search paradigms are supposed to be indicators of whether synesthetic experience requires focal attention. If synesthetic experience does not require focal attention, then digits with unique synesthetic colors should capture attention, which would lead to highly efficient identification of inducing digits. If, on the other hand, synesthetic experience requires focal attention, then synesthetic colors do not capture attention, and the identification process should be inefficient [22]. Perceptual features must be processed early enough in the visual system for them to attract attention and lead to pop-out and segregation [23, 24]. So the appearance that synesthetic experience can lead to pop-out and segregation indicates that synesthesia is a low-level perceptual phenomenon [7, 19, 20].

While a significant number of grapheme-color synesthetes are more efficient in visual search paradigms than controls, this does not clearly show that attention is not required for synesthetic experience, however. In one subject PM, it was shown that quick identification of graphemes occurred only when the graphemes that elicit synesthetic experience were close to the initial focus of attention [25]. Smilek et al. [26] used a variation on the standard visual search paradigm to test subject J’s search efficiency. J was shown an array of black graphemes on a colored background, some of which induced synesthetic experience. The colored background was either congruent or incongruent with the synesthetic color of the target. The researchers found that J was more efficient in her search when the background was incongruent than when it was congruent. This indicates that the synesthetic colors attracted attention only when they were clearly distinct from the background.

Edquist et al. [22] carried out a group study involving 14 grapheme-color synesthetes and 14 controls. Each subject performed a visual search task in which a target digit differed from the distractor digits in terms of its synesthetic color or its display color. Both synesthetes and controls identified the target digit efficiently when the target had a unique display color, but the two groups were equally inefficient when the target had a unique synesthetic color. The researchers concluded that for most grapheme-color synesthetes, graphemes elicit synesthetic color only once the subject attends to them. This indicates that synesthetic colors cannot themselves attract attention because they are not processed early enough in the visual system.

Another reason to think that not all cases of color experience in grapheme-color synesthesia are forms of low-level perception is that their appearance seems to depend on interpretation of visual experience. In Fig. 3, for instance, synesthetes assign different colors to the middle letter depending on whether they interpret the string of letters as spelling the word “cat” or the word “the.” For example, one of our child subjects, a 7-year-old female, experiences the middle letter as red when she reads the word “cat” and the middle letter as brown when she reads the word “the.” This suggests that it is not the shape of the letter that gives rise to the color experience but the category or concept associated with the letter [27].
Color Synesthesia, Fig. 3

Synesthetes interpret the middle letter as an A when it occurs in “cat” and as an H when it occurs in “the.” The color of their synesthetic experience will depend on which word the grapheme is considered part of

The fact that the very same grapheme can elicit different color experiences in synesthetes depending on the context in which it occurs suggests that synesthetes need to interpret what they visually experience before they experience synesthetic colors. Though Ramachandran and Hubbard [19] argue that grapheme-color synesthesia is a form of low-level perception (a “sensory phenomenon”), they grant that linguistic context can affect synesthetic experience. They presented the sentence “Finished files are the result of years of scientific study combined with the experienced number of years’ to a subject and asked her to count the number of “f’s” in it. Most normal subjects count only three “f’s” because they disregard the high-frequency word “of.” Though the synesthete eventually spotted six “f’s” she initially responded the way normal subjects do.

Ramachandran and Hubbard [19] suggest that these contextual effects can be explained by top-down factors. Whether this is right, however, will depend on whether color experience processed in early visual areas is indeed affected by top-down factors. If it is not, then top-down influences cannot explain the contextual effects. A better explanation of contextual influence then may be that interpretation of low-level perceptual information is required for synesthetic experience.

Another explanation of the disagreement about whether color synesthesia gives rise to pop-out effects may bear on the fact that few studies of pop-out effects have properly distinguished between projector synesthesia and associator synesthesia as well as what Ramachandran calls “higher synesthesia” and “lower synesthesia.” Lower grapheme-color synesthesia is synesthesia (either projector or associator) that arises in response to sensory stimuli, whereas higher grapheme-color synesthesia is synesthesia (either projector or associator) that arises in response to thoughts of graphemes. It is possible that the majority of synesthetes are higher synesthetes and that only lower synesthetes experience pop-out effects.

Neural Mechanism

The precise neural mechanism underlying color synesthesia is unknown. One hypothesis, the so-called local cross-activation hypothesis, proposed by Hubbard and Ramachandran, holds that grapheme-color synesthesia arises due to cross-activation between color areas in the visual cortex and the adjacent visual word form area [7, 20, 28]. This suggestion is inspired by the observation that local crossover phenomena can explain other illusory and hallucinatory experiences, such as phantom limb sensations.

A second hypothesis is that color synesthesia may be due to disinhibited feedback from an area of the brain that binds information from different senses [3, 29, 30]. The main piece of evidence cited in favor of this hypothesis comes from an analogous case in which a patient PH reported seeing visual movement in response to tactile stimuli following acquired blindness [29]. As PH was blind, he could not have received the information via standard visual pathways. It is plausible that the misperception was a result of disinhibited feedback from brain regions that receives information from other senses.

The fact that synesthetic experiences can arise when subjects are under the influence of psychedelics provides some further evidence for the disinhibited feedback hypothesis [31]. The synesthetic effect of psychedelic substances may be due to an inhibition of feedback from areas of information binding. It is unknown, however, whether drug-induced synesthesia and congenital synesthesia have the same underlying mechanism.

A third hypothesis is that color synesthesia arises as a result of aberrant reentrant processing [21, 32]. The hypothesis is similar to the disinhibited feedback hypothesis but suggests specifically that high-level information reenters color areas in visual cortex and that it is this form of reentrant information processing that leads to the experience of synesthetic colors. This model would explain why visual context and meaning typically influence which synesthetic colors a grapheme gives rise to [32, 33].

It is plausible that different forms of color synesthesia proceed via different mechanisms. Cases of color synesthesia have been reported in which the visual cortex is not involved in generating synesthetic colors [12, 34]. None of the three aforementioned hypotheses, despite their plausibility in run-of-the mill cases, can explain more unusual cases of color synesthesia.

Cognitive Advantages of Color Synesthesia

If pop-out effects require attention to the synesthetic graphemes, grapheme-color synesthesia is unlikely to give subjects much of a cognitive advantage in visual search tests. However, there may nonetheless be cognitive advantages associated with color synesthesia. For example, some case studies suggest that grapheme-color synesthetes may have greater recall ability for digits and written names when compared to non-synesthetes [35, 36].

In rare cases color synesthesia has been associated with extreme mathematical skills. Subject DT, for example, sees numbers as three-dimensional colored, textured forms [34]. His synesthesia gives him the ability to multiply high digits very rapidly. He reports that the product of multiplying two numbers is the number that corresponds to the shape that fits between the shapes corresponding to the multiplied numbers. Subject DT’s color synesthesia also gives rise to extreme mnemonic skills. DT currently holds the European record in reciting the decimal points of the number pi. An fMRI study comparing DT to controls while attempting to locate patterns in number sequences indicated that DT’s synesthetic color experiences occur as a result of information processing in nonvisual brain regions, including temporal, parietal, and frontal areas [34].

Brogaard et al. [12] describe a case of a subject, JP, who has exceptional abilities to draw complex geometrical images by hand and a form of acquired synesthesia for mathematical formulas and moving objects, which he perceives as colored, complex geometrical figures (see Fig. 4).
Color Synesthesia, Fig. 4

Image hand-drawn by subject JP

JP’s synesthesia began in the wake of a brutal assault that led to unspecified brain injury. A fMRI study contrasting activity resulting from exposure to image-inducing formulas and non-inducing formulas indicated that JP’s colored synesthetic images arise as a result of activation in areas in the temporal, parietal, and frontal cortices in the left hemisphere. The image-inducing formulas as contrasted with the non-inducing formulas induced no activation in the visual cortex or the right hemisphere [12] (see Fig. 5).
Color Synesthesia, Fig. 5

Sagittal slices. Activation induced by the image-inducing formula contrasted to non-inducing formulas. The SPM(T) maps were thresholded at family-wise-error-corrected p-value 0.01 and overlaid on JP’s structural T1-weighted MRI which was standardized into MNI-space using SPM8 [12]

These two unusual case studies suggest that at least some forms of color synesthesia can give rise to cognitive advantages in the area of mathematics. As the visual cortex does not appear to be directly involved in generating the synesthetic images in either subject, the two cases also suggest that at least some forms of color synesthesia are best characterized as forms of high-level perception that proceeds via a nonstandard mechanism.

Cross-References

References

  1. 1.
    Baron-Cohen, S., Wyke, M., Binnie, C.: Hearing words and seeing colors: an experimental investigation of synesthesia. Perception 16, 761–767 (1987)CrossRefGoogle Scholar
  2. 2.
    Cytowic, R.E.: Synesthesia: A Union of the Senses. Springer, New York (1989)CrossRefGoogle Scholar
  3. 3.
    Grossenbacher, P.G., Lovelace, C.T.: Mechanisms of synesthesia: cognitive and physiological constraints. Trends Cogn. Sci. 5, 36–41 (2001)CrossRefGoogle Scholar
  4. 4.
    Hubbard, E.M.: Neurophysiology of synesthesia. Curr. Psychiatry Rep. 9, 193–199 (2007)CrossRefGoogle Scholar
  5. 5.
    Hubbard, E.M., Ramachandran, V.S.: Neurocognitive mechanisms of synesthesia. Neuron 48, 509–520 (2005)CrossRefGoogle Scholar
  6. 6.
    Hubbard, E.M., Arman, A.C., Ramachandran, V.S., Boynton, G.M.: Individual differences among grapheme-color synesthetes: brain-behavior correlations. Neuron 45(6), 975–985 (2005)CrossRefGoogle Scholar
  7. 7.
    Ramachandran, V.S., Hubbard, E.M.: Psychophysical investigations into the neural basis of synaesthesia. Proc. R. Soc. Lond. B Biol. Sci. 268, 979–983 (2001)CrossRefGoogle Scholar
  8. 8.
    Sperling, J.M., Prvulovic, D., Linden, D.E.J., Singer, W., Stirn, A.: Neuronal correlates of graphemic colour synaesthesia: a fMRI study. Cortex 42, 295–303 (2005)CrossRefGoogle Scholar
  9. 9.
    Ward, J., Huckstep, B., Tsakanikos, E.: Sound-colour synaesthesia: to what extent does it use cross-modal mechanisms common to us all? Cortex 42, 264–280 (2006)CrossRefGoogle Scholar
  10. 10.
    Afra, P., Funke, M., Matsu, F.: Acquired auditory-visual synesthesia: a window to early cross-modal sensory interactions. Psychol. Res. Behav. Manage. 2, 31–37 (2009)CrossRefGoogle Scholar
  11. 11.
    Beauchamp, M.S., Ro, T.: Neural substrates of sound-touch synesthesia after a thalamic lesion. J. Neurosci. 28, 13696–13702 (2008)CrossRefGoogle Scholar
  12. 12.
    Brogaard, B, Vanni, S, Silvanto, J.: Seeing mathematics: perceptual experience and brain activity in acquired synesthesia. Neurocase. (2012, in press)Google Scholar
  13. 13.
    Cytowic, R.E.: Synesthesia: phenomenology and neuropsychology. In: Baron-Cohen, S. (ed.) Synesthesia: Classic and Contemporary Readings, pp. 17–39. Blackwell, Oxford (1997)Google Scholar
  14. 14.
    Sagiv, N., Ward, J.: Cross-modal interactions: lessons from synesthesia. Prog. Brain Res. 155, 259–271 (2006)CrossRefGoogle Scholar
  15. 15.
    Dixon, M.J., Smilek, D., Merikle, P.M.: Not all synaesthetes are created equal: projector versus associator synaesthetes. Cogn. Affect. Behav. Neurosci. 4, 335–343 (2004)CrossRefGoogle Scholar
  16. 16.
    Eagleman, D.M., Kagan, A.D., Nelson, S.S., Sagaram, D., Sarma, A.K.: A standardized test battery for the study of synesthesia. J. Neurosci. Methods 159, 139–145 (2007)CrossRefGoogle Scholar
  17. 17.
    Baron-Cohen, S., Harroson, J., Goldstein, L.H., Wyke, M.: Coloured speech perception: is synaesthesia what happens when modularity breaks down? Perception 22, 419–426 (1993)CrossRefGoogle Scholar
  18. 18.
    Simner, J., Ward, J., Lanz, M., Jansari, A., Noonan, K., Glover, L., et al.: Non-random associations of graphemes to colours in synaesthetic and non-synaesthetic populations. Cogn. Neuropsychol. 22(8), 1069 (2005)CrossRefGoogle Scholar
  19. 19.
    Ramachandran, V.S., Hubbard, E.M.: The phenomenology of synaesthesia. J. Conscious. Stud. 10, 49–57 (2003)Google Scholar
  20. 20.
    Ramachandran, V.S., Hubbard, E.M.: Synaesthesia: a window into perception, thought and language. J. Conscious. Stud. 8, 3–34 (2001)Google Scholar
  21. 21.
    Smilek, D., Dixon, M.J., Cudahy, C., Merikle, P.M.: Synaesthetic photisms influence visual perception. J. Cogn. Neurosci. 13, 930–936 (2001)CrossRefGoogle Scholar
  22. 22.
    Edquist, J., Rich, A.N., Brinkman, C., Mattingly, J.B.: Do synaesthetic colours act as unique features in a visual search? Cortex 42, 222–231 (2006)CrossRefGoogle Scholar
  23. 23.
    Beck, J.: Effect of orientation and of shape similarity on perceptual grouping. Percept. Psychophys. 1, 300–302 (1966)CrossRefGoogle Scholar
  24. 24.
    Treisman, A.: Perceptual grouping and attention in visual search for features and for objects. J. Exp. Psychol. Hum. Percept. Perform. 8(2), 194–214 (1982)CrossRefGoogle Scholar
  25. 25.
    Laeng, B., Svartdal, F., Oelmann, H.: Does color synesthesia pose a paradox for early-selection theories of attention? Psychol. Sci. 15, 277–281 (2004)CrossRefGoogle Scholar
  26. 26.
    Smilek, D., Dixon, M.J., Merikle, P.M.: Synaesthetic photisms guide attention. Brain Cogn. 53, 364–367 (2003)CrossRefGoogle Scholar
  27. 27.
    Cytowic, R.E., Eagleman, D.M.: Wednesday is Indigo Blue. MIT Press, Cambridge, MA (2009)Google Scholar
  28. 28.
    Hubbard, E.M., Manohar, S., Ramachandran, V.S.: Con- trast affects the strength of synesthetic colors. Cortex. (2005b, in press)Google Scholar
  29. 29.
    Armel, K.C., Ramachandran, V.S.: Acquired synesthesia in retinitis pigmentosa. Neurocase 5, 293–296 (1999)CrossRefGoogle Scholar
  30. 30.
    Grossenbacher, P.G.: Perception and sensory information in synaesthetic experience. In: Baron-Cohen, S., Harrison, J.E. (eds.) Synaesthesia: Classic and Contemporary Readings, pp. 148–172. Blackwell, Malden (1997)Google Scholar
  31. 31.
    Shanon, B.: Ayahuasca visualizations: a structural typology. J. Conscious. Stud. 9, 3–30 (2002)Google Scholar
  32. 32.
    Myles, K.M., Dixon, M.J., Smilek, D., Merikle, P.M.: Seeing double: the role of meaning in alphanumeric-colour synaesthesia. Brain Cogn. 53, 342–345 (2003)CrossRefGoogle Scholar
  33. 33.
    Dixon, M.J., Smilek, D.: The importance of individual dif- ferences in grapheme-color synesthesia. Neuron 45, 821–823 (2005)CrossRefGoogle Scholar
  34. 34.
    Bor, D., Billington, J., Baron-Cohen, S.: Savant memory for digits in a case of synaesthesia and Asperger syndrome is related to hyperactivity in the lateral prefrontal cortex. Neurocase 13, 311–319 (2007)CrossRefGoogle Scholar
  35. 35.
    Mills, C.B., Innis, J., Westendorf, T., Owsianiecki, L., McDonald, A.: Effect of a synesthete’s photisms on name recall. Cortex 42, 155–163 (2006)CrossRefGoogle Scholar
  36. 36.
    Smilek, D., Dixon, M.J., Cudahy, C., Merikle, P.M.: Synesthetic color experiences influence memory. Psychol. Sci. 13(6), 548–552 (2002)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  1. 1.Department of Philosophy and the Brogaard Lab for Multisensory ResearchUniversity of Miami and University of OsloMiamiUSA