Abstract
A significative percentage of the human population suffer from impairments in their capacity to distinguish or even see colours. For them, everyday tasks like navigating through a train or metro network map becomes demanding. We present a novel technique for extracting colour information from everyday natural stimuli and presenting it to visually impaired users as pleasant, non-invasive sound. This technique was implemented inside a Personal Digital Assistant (PDA) portable device. In this implementation, colour information is extracted from the input image and categorised according to how human observers segment the colour space. This information is subsequently converted into sound and sent to the user via speakers or headphones. In the original implementation, it is possible for the user to send its feedback to reconfigure the system, however several features such as these were not implemented because the current technology is limited.We are confident that the full implementation will be possible in the near future as PDA technology improves.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Foster, D.H.: Color constancy. Vision Research 51, 674–700 (2011)
Brown, R.O., MacLeod, D.I.A.: Color appearance depends on the variance of surround colors. Current Biology 7, 844–849 (1997)
Otazu, X., Parraga, C.A., Vanrell, M.: Towards a unified model for chromatic induction. Journal of Vision 10(12), article 5 (2010)
Berlin, B., Kay, P.: Basic color terms: their universality and evolution, Berkeley, Oxford (1969)
Genetics Home Reference: Color vision deficiency, National Library of Medicine, http://ghr.nlm.nih.gov/condition/color-vision-deficiency
Vision Problems in the U.S.: Prevalence of Adult Vision Impairment and Age-Related Eye Disease in America. Prevent Blindness America and the National Eye Institute (2008), http://www.preventblindness.org/vpus/2008_update/
Derefeldt, G., Swartling, T.: Color Concept Retrieval by Free Color Naming - Identification of up to 30 Colors without Training. Displays 16, 69–77 (1995)
Yendrikhovskij, S.N.: A Computational Model of Colour Categorization. Color Research and Application 26, S235–S238 (2001)
Seaborn, M., Hepplewhite, L., Stonham, J.: Fuzzy colour category map for the measurement of colour similarity and dissimilarity. Pattern Recognition 38, 165–177 (2005)
Mojsilovic, A.: A computational model for color naming and describing color composition of images. IEEE - Transactions on Image Processing 14, 690–699 (2005)
Benavente, R., Vanrell, M., Baldrich, R.: Parametric fuzzy sets for automatic color naming. Journal of the Optical Society of America A 25, 2582–2593 (2008)
Menegaz, G., Troter, A.L., Sequeira, J., Boi, J.M.: A discrete model for color naming. EURASIP J. Appl. Signal Process. 2007(1), 113 (2007)
Wang, Z., Luo, M.R., Kang, B., Choh, H., Kim, C.: An Algorithm for Categorising Colours into Universal Colour Names. In: 3rd European Conference on Colour in Graphics, Imaging, and Vision (2006)
Hansen, T., Walter, S., Gegenfurtner, K.R.: Effects of spatial and temporal context on color categories and color constancy. Journal of Vision 7 (2007)
Moroney, N.: Unconstrained web-based color naming experiment. In: SPIE Color Imaging VIII: Processing, Hardcopy, and Applications (2003)
Boynton, R.M., Olson, C.X.: Salience of Chromatic Basic Color Terms Confirmed by 3 Measures. Vision Research 30, 1311–1317 (1990)
Hardin, C.L., Maffi, L.: Color categories in thought and language. Cambridge University Press, Cambridge (1997)
Webster, M.A., Kay, P.: Individual and population differences in focal colors. In: MacLaury, R.E., Paramei, G.V., Dedrick, D. (eds.) Anthropology of Color: Interdisciplinary Multilevel Modeling, pp. 29–54. J. Benjamins Pub. Co., Amsterdam (2007)
Maurer, D., Pathman, T., Mondloch, C.J.: The shape of boubas: sound-shape correspondences in toddlers and adults. Developmental Science 9, 316–322 (2006)
Lewis, J.W., Beauchamp, M.S., DeYoe, E.A.: A comparison of visual and auditory motion processing in human cerebral cortex. Cerebral Cortex 10, 873–888 (2000)
Visual Music by Maura McDonnell (2002), http://homepage.tinet.ie/~musima/visualmusic/visualmusic.htm
Harbisson, N.: Sonochromatic cyborg, http://www.harbisson.com (cited July 01, 2012)
Google Play, http://play.google.com/store (cited July 01, 2012)
Evans, B.: Foundations of a visual music. Computer Music Journal 29, 11–24 (2005)
Cronly-Dillon, J., Persaud, K., Gregory, R.P.F.: The perception of visual images encoded in musical form: a study in cross-modality infomration transfer. Proc. Roy. Soc. B 266, 2427–2433 (1999)
Bologna, G., Deville, B., Pun, T., Vickenbosch, M.: Transforming 3D coloured pixels into musical instrument notes for vision substitution applications. EURASIP J. Im. Video Process. 2007, 76204 (2007)
Rossi, J., Perales, F.J., Varona, J., Roca, M.: COL.diesis: transforming colour into melody and implementing the result in a colour sensor device. In: International Conference on Information Visualisation (2009)
Hurlbert, A.: Colour constancy. Current Biology 21(17), 906–907 (2007)
Hurlbert, A., Wolf, K.: Color contrast: a contributory mechanism to color constancy. Progress on Brain Research 144 (2004)
Worthey, J.A., Brill, M.H.: Heuristic analysis of von kries color constancy. Journal of the Optical Society of America A 3, 1708–1712 (1986)
Buchsbaum, G.: A spatial processor model for object colour perception. Journal Franklin Institute 310, 1–26 (1980)
Land, E.H.: The retinex. American Scientist 52, 247–264 (1964)
Finlayson, G.D., Trezzi, E.: Shades of gray and colour constancy. In: Color Imaging Conference (2004)
van de Weijer, J., Gevers, T., Gijsenij, A.: Edge-based color constancy. IEEE Transactions on Image Processing 16, 2207–2214 (2007)
Lee, H.: Method for computing the scene-illuminant chromaticity from specular highlights. Journal of the Optical Society of America A 3, 1694–1699 (1986)
Klinker, G., Shafer, S., Kanade, T.: A physical approach to color image understanding. International Journal of Computer Vision 4, 7–38 (1990)
Funt, B.V., Drew, M.S., Ho, J.: Color constancy from mutual reflection. International Journal of Computer Vision 6, 5–24 (1991)
Finlayson, G.D., Hordley, S.D., Hubel, P.M.: Color by correlation: A simple, unifying framework for color constancy. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 1209–1221 (2001)
Sapiro, G.: Color and illuminant voting. IEEE Transactions on Image Processing 21, 1210–1215 (1999)
Vazquez-Corral, J., Vanrell, M., Baldrich, R., Tous, F.: Color Constancy by Category Correlation. IEEE Transactions on Image Processing 21, 1997–2007 (2012)
Changeux, J.P.: Du vrai, du beau, du bien: Une nouvelle approche neuronale, Odile Jacob (2010)
Ward, J., Huckstep, B., Tsakanikos, E.: Sound-colour synaesthesia: to what extent does it use cross-modal mechanisms common to us all? Cortex 42, 264–280 (2006)
Peeters, G., Giordano, B.L., Susini, P., Misdariis, N., McAdams, S.: The Timbre Toolbox: extracting audio descriptors from musical signals. Journal of the Acoustic Society of America 130, 2902–2916 (2011)
Herrera-Boyer, P., Klapuri, A., Davy, M.: Automatic Classification of Pitched Musical Instrument Sounds. Signal Processing Methods for Music Transcription, Part II, 163–200 (2006)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Gonzalez, A., Benavente, R., Penacchio, O., Vazquez-Corral, J., Vanrell, M., Parraga, C.A. (2013). Coloresia: An Interactive Colour Perception Device for the Visually Impaired. In: Multimodal Interaction in Image and Video Applications. Intelligent Systems Reference Library, vol 48. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35932-3_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-35932-3_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35931-6
Online ISBN: 978-3-642-35932-3
eBook Packages: EngineeringEngineering (R0)