Abstract
This paper presents an attempt at ‘non-verbal mapping’ between music and images. We use physical parameters of key, height and timbre as sound, and hue, brightness and chroma as color, to clarify their direct correspondence. First we derive a mapping rule between sound and color from those with such special abilities as ‘colored hearing’. Next we apply the mapping to everyday people using a paired comparison test and key identification training, and we find similar phenomena to colored hearing among everyday people. The experimental result shows a possibility that they also have potential of ability of sound and color mapping.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Iwamiya, S.: Interaction between auditory and visual processing in car audio. Applied Human Science 16, 115–119 (1997)
Kawamura, M., Ohgushi, K.: Tonality of music and sense of color. Annual report for musical psychology, 160
Umemoto, T., et al.: Studies in the Psychology of Music, ch. 7. Nakanishiya Syuppann Co., Ltd. (1996)
Saisho, H.: Absolute Pitch, Shogakukan, Inc. (1998)
Levitin, D.J.: Absolute pitch: Self-reference and human memory. In: Proc. CASYS 1998 (1998)
Fujisaki, W., Kashino, M.: The characteristics of pitch perception in absolute pitch possessors. J. ASJ 57(12), 759–767 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 IFIP International Federation for Information Processing
About this paper
Cite this paper
Nagata, N., Iwai, D., Wake, S.H., Inokuchi, S. (2005). Non-verbal Mapping Between Sound and Color-Mapping Derived from Colored Hearing Synesthetes and Its Applications. In: Kishino, F., Kitamura, Y., Kato, H., Nagata, N. (eds) Entertainment Computing - ICEC 2005. ICEC 2005. Lecture Notes in Computer Science, vol 3711. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11558651_39
Download citation
DOI: https://doi.org/10.1007/11558651_39
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29034-6
Online ISBN: 978-3-540-32054-8
eBook Packages: Computer ScienceComputer Science (R0)