Skip to main content

The Developmental Significance of Cross-Modal Matching

  • Chapter
Intersensory Perception and Sensory Integration

Part of the book series: Perception and Perceptual Development ((PPD))

Abstract

Philosophers and psychologists have sometimes argued that traditional distinctions between the spatial senses and, for that matter, between afferent sensory perception and efferent motor control are arbitrary and unhelpful (e.g., Bornstein, 1936; Freedman, 1968; von Hornbostel, 1927). Conceptual and experimental isolation of visual, auditory, and somesthetic processes (ultimately based upon Muller’s so-called “law of specific nervous energies”) led, undoubtedly, to a tremendous increase in knowledge of peripheral sensory physiology and to more or less detailed descriptions of sensory pathways to the central nervous system. Yet such work seemed to imply that human beings and other creatures see, hear, feel, and so on as isolated independent acts, as though individuals could only be known to each other as distinct independent visual, auditory, and sentient persons. Moreover ordinary language does not make the distinctions between modality dimensions which any treatment of, say, sight, hearing, and touch as isolated and distinct ways of knowing the world would seem to require. (Ordinary language is in fact shot through with synesthetic comparisons. See, e.g., Marks, 1975, for a recent discussion of synesthesia.) Of course, knowledge is perceptually based, but it is not obvious that it is visually based or (pace Berkeley) tactually based.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Abbott, C. The intelligence of batrachians. Science, 1882, 3, 66–67.

    Article  Google Scholar 

  • Abravanel, E., Active detection of solid-shape information by touch and vision. Perception and Psychophysics, 1971, 70, 358–360.

    Article  Google Scholar 

  • Abravanel, E., How children combine vision and touch when perceiving the shape of objects. Perception and Psychophysics, 1972, 12, 171–175. (a)

    Google Scholar 

  • Abravanel, E., Short-term memory for shape information processed intra- and inter-modally at three ages. Perceptual and Motor Skills, 1972, 35, 419–425. (b)

    Google Scholar 

  • Alexander, R., Pattern rate and interpattern interval in development of matching simple auditory-visual patterns. Developmental Psychology, 1977, 13, 332–335.

    Article  Google Scholar 

  • Allen, T.W., Walker, K., Symonds, L., amp; Marcell, M., Intrasensory perception of temporal sequences during infancy. Developmental Psychology, 1977, 13, 225–229.

    Article  Google Scholar 

  • Armstrong, D.M. Bodily sensations. Routledge amp; Kegan Paul: New York, 1962.

    Google Scholar 

  • Aronson, E., amp; Rosenbloom, S. Space perception in early infancy: Perception within a common auditory-visual space. Science, 1971, 172, 1161–1163.

    Article  Google Scholar 

  • Berkeley, G. A new theory of visions. Dent: London, 1925.

    Google Scholar 

  • Birch, H.G., amp; Belmont, L. Auditory-visual integration in normal and retarded readers. American Journal of Orthopsychiatry, 1964, 34, 852 - 861.

    Article  Google Scholar 

  • Birch, H.G., amp; Lefford, A. Intersensory development in children. Monographs of the Society for Research in Child Development, 1963, 28 (5), Whole No. 89.

    Google Scholar 

  • Birch, H.G., amp; Lefford, A., Two strategies for studying perception in “brain-damaged” children. In H.G. Birch (Ed.), Brain damage in children. Williams amp; Wilkins: Baltimore, 1964.

    Google Scholar 

  • Birch, H.G., amp; Lefford, A., Visual differentiation, intersensory integration and voluntary motor control. Monographs of the Society for Research in Child Development, 1967, 32 (2), Whole No. 110.

    Google Scholar 

  • Bjorkman, M., Relations between intra-modal and cross-modal matching. Scandinavian Journal of Psychology, 1967, 8, 67–76.

    Article  Google Scholar 

  • Blank, M., Cognitive functions of language in the pre-school year. Developmental Psychology, 1974, 10, 229–245.

    Article  Google Scholar 

  • Bornstein, W., On the functional relations of the sense organs to one another and to the organism as a whole. Journal of Genetic Psychology, 1936, 15, 117–131.

    Article  Google Scholar 

  • Brower, T.G.R., The visual world of infants. Scientific American, June 1966, 80–92.

    Google Scholar 

  • Bower, T.G.R., Broughton, J.M., amp; Moore, M.K., The coordination of visual and tactual input in infants. Perception and Psychophysics, 1970, 8, 51–53.

    Article  Google Scholar 

  • Bridger, W.H., Cognitive factors in perceptual dysfunction. In D.A. Hamburg, K.H. Pribram, amp; A.J. Stunkard (Eds.), Perception and its disorders. Williams amp; Wilkins: Baltimore, 1970.

    Google Scholar 

  • Brown, I.D., Visual and tactual judgments of surface roughness. Ergonomics, 1960, 3, 51–61.

    Article  Google Scholar 

  • Brown, D.R., amp; Owen, D.H., The metrics of visual form: Methodological dyspepsia. Psychological Bulletin, 1967, 68, 243–259.

    Article  Google Scholar 

  • Brown, D.R., Condon, C.F., amp; Hitchcock, L., Jr., Stimulus equivalence of auditory and visual patterns in an intermodal discrimination task. Perceptual and Motor Skills, 1966, 22, 823–832.

    Article  Google Scholar 

  • Bryant, P.E. Comments on the design of developmental studies of cross-modal matching and cross-modal transfer. Cortex, 1968, 4, 127–137.

    Google Scholar 

  • Bryant, P.E., amp; Raz, I., Visual and tactual perception of shape by young children. Developmental Psychology, 1975, 77, 525–526.

    Article  Google Scholar 

  • Bryant, P.E., Jones, P., Claxton, V., amp; Perkins, G.M., Recognition of shapes across modalities by infants. Nature, 1972, 240, 303–304.

    Article  Google Scholar 

  • Bryden, M.P., Auditory-visual and sequential spatial matching in relation to reading ability. Child Development, 1972, 43, 824–832.

    Article  Google Scholar 

  • Buser, J., Borenstein, P., amp; Bruner, J., Etude des systemes “associatifs” visuels et auditifs chez le chat anesthesie au chloralose. Electroencephalography and Clinical Neuro-physiology, 1959, 11, 305–324.

    Article  Google Scholar 

  • Cashdan, S., Visual and haptic form discrimination under conditions of successive stimulation. Journal of Experimental Psychology, 1968, 76, 215–218.

    Article  Google Scholar 

  • Cole, M., Chorover, S.L., amp; Ettlinger, G., Cross-modal transfer in man. Nature, 1961, 191, 1225–1226.

    Article  Google Scholar 

  • Connolly, K., amp; Jones, B., A developmental study of afferent-reafferent integration. British Journal of Psychology, 1970, 61, 259–266.

    Article  Google Scholar 

  • Cronin, V., Cross-modal and intramodal visual and tactual matching in young children. Developmental Psychology, 1973, 8, 336–340.

    Article  Google Scholar 

  • De Leon, J.L., Raskin, L.M., amp; Gruen, G.E., Sensory-modality effects on shape perception in pre-school children. Developmental Psychology, 1970, 3, 358–362.

    Article  Google Scholar 

  • Denner, B., amp; Cashdan, S., Sensory processing and the recognition of forms in nursery-school children. British Journal of Psychology, 1967, 58, 101–104.

    Article  Google Scholar 

  • Diewert, G.L., amp; Stelmach, G. E. Intra-modal and inter-modal transfer of movement information. Acta Psychologica, 1977, 47, 119–128.

    Google Scholar 

  • Drager, U.C., amp; Hubel, D.H., Responses to visual stimulation and relationship between visual, auditory and somatosensory inputs in moise superior colliculus. Journal of Neurophysiology, 1975, 55, 640–713.

    Google Scholar 

  • Ettlinger, G., Analysis of cross-modal effects and their relationship to language. In F.L. Darley amp; C.H. Millikan (Eds.), Brain mechanisms underlying speech and language. New York: Grune amp; Stratton, 1967.

    Google Scholar 

  • Fantz, R.L., Pattern perception in young infants. Psychological Record, 1958, 8, 43–47.

    Google Scholar 

  • Fishman, M.C., amp; Michael, C.R., Integration of auditory information in the cat’s visual cortex. Vision Research, 1973, 13, 1415–1419.

    Article  Google Scholar 

  • Freedman, S.J. (Ed.), The neuropsychology of spatially oriented behavior. Homewood, Illinois: Dorsey Press, 1968.

    Google Scholar 

  • Freides, D., Information complexity and cross-modal functions. British Journal of Psychology, 1975, 66, 283–287.

    Article  Google Scholar 

  • Garvill, J., amp; Molander, B., Verbal mediation in cross-modal transfer. British Journal of Psychology, 1971, 62, 449–457.

    Article  Google Scholar 

  • Garvill, J., amp; Molander, B., Effects of standard modality, comparison modality and retention interval on matching of form. Scandinavian Journal of Psychology, 1973, 14, 203–206.

    Article  Google Scholar 

  • Garvill, J., amp; Molander, B. Effects of interference on intra-modal and cross-modal matchings of form. Umea Psychological Reports, 1977, No. 124.

    Google Scholar 

  • Goodnow, J.J., Effects of active handling, illustrated by uses for objects. Child Development, 1969, 40, 201–212.

    Article  Google Scholar 

  • Goodnow, J.J., Eye and hand: Differential memory and its effect on matching. Neuropsychologia, 1971, 9, 89–95. (a)

    Google Scholar 

  • Goodnow, J.J., Matching auditory and visual series: Modality problem or translation problem? Child Development, 1971, 42, 1187–1201. (b)

    Google Scholar 

  • Gottfried, A.W., Rose, S.A., amp; Bridger, W.H. Cross-modal transfer in human infants. Child Development, 1911, 48, 118–123.

    Article  Google Scholar 

  • Gottfried, A.W., Rose, S.A., amp; Bridger, W.H., Effects of visual, haptic and manipulatory experience on infant’s visual recognition memory of objects. Developmental Psychology, 1978, 14, 305–312.

    Article  Google Scholar 

  • Green, D.M., amp; Swets, J., Signal detection theory and psychophysics. New York: Wiley, 1966.

    Google Scholar 

  • Harvey, N., Does intermodal equivalence exist between hetero-modal stimulus dimensions or between stimulus value on these dimensions. Quarterly Journal of Experimental Psychology, 1913, 25, 476–491.

    Article  Google Scholar 

  • Hermelin, B., amp; O’Connor, N., Recognition of shapes by normal and subnormal children. British Journal of Psychology, 1961, 52, 281–284.

    Article  Google Scholar 

  • Hershenson, M., Development of the perception of form. Psychological Bulletin, 1967, 67, 326–336.

    Article  Google Scholar 

  • Jackson, J.P., Development of visual and tactual processing of sequentially presented shapes. Developmental Psychology, 1973, 8, 46 - 50.

    Article  Google Scholar 

  • Jones, B., Outflow and inflow in movement duplication. Perception and Psychophysics, 1972, 9, 118–120.

    Google Scholar 

  • Jones, B., When are vision and kinaesthesia comparable? British Journal of Psychology, 1973, 64, 587–591.

    Article  Google Scholar 

  • Jones, B., Cross-modal matching by retarded and normal readers. Bulletin of the Psychonomic Society, 1974, 3, 163–165.

    Google Scholar 

  • Jones, B., amp; Alexander, R., Developmental trends in auditory-visual cross-modal matching of spatiotemporal patterns. Developmental Psychology, 1974, 10, 354–356.

    Article  Google Scholar 

  • Jones, B., amp; Connolly, K. Memory effects in cross-modal matching. British Journal of Psychology, 1970, 67, 267–270.

    Article  Google Scholar 

  • Jones, B., amp; Robinson, T., Sensory integration in normal and retarded children. Developmental Psychology, 1973, 9, 178–182.

    Article  Google Scholar 

  • Jung, R., Neuronal integration in the visual cortex and its significance for visual information. In W. Rosenblith (Ed.), Sensory communication. Cambridge: MIT Press, 1961.

    Google Scholar 

  • Kinney, J.S., Discrimination in auditory and visual patterns. Perceptual and Motor Skills, 1961, 14, 529–541.

    Google Scholar 

  • Klapper, Z.S., amp; Birch, H.G., Developmental course of temporal patterning in vision and audition. Perceptual Motor Skills, 1971, 32, 547–555.

    Article  Google Scholar 

  • Koen, F., Verbal mediators in cross-modal form discrimination. Canadian Journal of Psychology, 1971, 25, 103–110.

    Article  Google Scholar 

  • Lashley, K.S., The problem of serial order in behavior. In L.A. Jeffress (Ed.), Cerebral mechanisms in behavior: The Hixon symposium. New York: Wiley, 1951.

    Google Scholar 

  • Legge, D., Analysis of visual and proprioceptive components of motor skill by means of a drug. British Journal of Psychology, 1965, 65, 243–254.

    Article  Google Scholar 

  • Lobb, H., Vision versus touch in form discrimination. Canadian Journal of Psychology, 1965, 19, 175–187.

    Article  Google Scholar 

  • Lyons-Ruth, K., Bimodal perception in infancy: Response to auditory-visual incongruity. Child Development, 1977, 48, 820–827.

    Article  Google Scholar 

  • Marcell, M., amp; Allen, T.W., Memory effects and sensory integration: A test of Connolly and Jones model of intersensory functioning. Paper presented at the Biennial Meeting of the Society for Research in Child Development, 1975.

    Google Scholar 

  • Marks, L.E., On colored-hearing synthesis: Cross-modal translations of sensor dimensions. Psychological Bulletin, 1975, 82, 303–331.

    Article  Google Scholar 

  • Millar, S. Visual and haptic cue utilization by preschool children: The recognition of visual and haptic stimuli presented separately and together. Journal of Experimental Child Psychology, 1971, 12, 88–94.

    Article  Google Scholar 

  • Millar, S. Effects of interpolated tasks on latency and accuracy of intramodal and cross-modal shape recognition by children. Journal of Experimental Psychology, 1972, 96, 170–175. (a)

    Google Scholar 

  • Millar, S. The development of visual and kinaesthetic judgments of distance. British Journal of Psychology, 1972, 63, 271–282. (b)

    Google Scholar 

  • Milner, A.D., amp; Bryant, P. E. Cross-modal matching by young children. Journal of Comparative and Physiological Psychology, 1968, 71, 453–458.

    Google Scholar 

  • Newell, K.M., Shapiro, D.C., amp; Carlton, M.J., Coordinating visual and kinaesthetic memory codes. British Journal of Psychology, 1979, 70, 87–96.

    Article  Google Scholar 

  • Owen, D.H., amp; Brown, D.R., Visual and tactual form discrimination: Psychophysical comparison within and between modalities. Perception and Psychophysics, 1970, 7, 302–306.

    Article  Google Scholar 

  • Pick, A.D., Pick, H.L., Jr., amp; Thomas, M.L., Cross-modal transfer and improvement of form discrimination. Journal of Experimental Child Psychology, 1966, 3, 279–288.

    Article  Google Scholar 

  • Posner, M.I., Characteristics of visual and kinesthetic memory. Journal of Experimental Psychology, 1967, 75, 103–107.

    Article  Google Scholar 

  • Rose, S.A., Blank, M.S., amp; Bridger, W.H., Intermodal and intramodal retention of visual and tactual information in young children. Developmental Psychology, 1972, 6, 482–486.

    Article  Google Scholar 

  • Rubinstein, L., amp; Gruenberg, E.M., Intramodal and cross-modal sensory transfer of visual and auditory temporal patterns. Perception and Psychophysics, 1971, 9, 385–390.

    Article  Google Scholar 

  • Rudel, R.G., amp; Teuber, H.L., Cross-modal transfer of shape discrimination by children. Neuropsychologia, 1964, 2, 1–8.

    Article  Google Scholar 

  • Rudel, R.G., amp; Teuber, H.L., Pattern recognition within and across sensory modalities in normal and brain-injured children. Neuropsychologia, 1971, 9, 389–399.

    Article  Google Scholar 

  • Rudnick, M., Martin, V., amp; Sterritt, G.M. On the relative difficulty of auditory and visual, temporal and spatial, integrative and non-integrative sequential pattern comparisons. Psychonomic Science, 1972, 27, 207–210.

    Google Scholar 

  • Sherrington, C.S., Man on his nature. New York: Macmillan, 1941.

    Google Scholar 

  • Taylor, M.M., Lederman, S.J., amp; Gibson, R.H., Tactual perception of texture. In E. Corterette amp; M. Friedman (Eds.), Handbook of perception. Vol. 3. New York: Academic Press, 1973.

    Google Scholar 

  • Teghtsoonian, M., amp; Teghtsoonian, R., Seen and felt length. Psychonomic Science, 1965, 3, 465–469.

    Google Scholar 

  • Teghtsoonian, R., amp; Teghtsoonian, M., Two varieties of perceived length. Perception and Psychophysics, 1970, 8, 389–392.

    Article  Google Scholar 

  • von Hornbostel, E.M., The unity of the senses. Psyche, 1927, 4, 83–89.

    Google Scholar 

  • von Senden, M., Space and sight. London: Methuen, 1960.

    Google Scholar 

  • Vurpillot, E., The development of scanning strategies and their relation to visual differentiation. Journal of Experimental Child Psychology, 1968, 6, 632–650.

    Article  Google Scholar 

  • Warren, D.H., Intermodality interactions in spatial localization. Cognitive Psychology, 1970, 7, 114–133.

    Article  Google Scholar 

  • Wickelgren, B.G., Superior colliculus: Some receptive field properties of bimodally responsive cells. Science, 1971, 173, 69–72.

    Article  Google Scholar 

  • Wilson, W.A., Jr., Intersensory transfer in normal and brain-operated monkeys. Neuropsychologia, 1965, 3, 363–370.

    Article  Google Scholar 

  • Williams, T.M., amp; Aiken, L.S., Development of pattern classification: Auditory visual equivalence in the use of prototypes. Developmental Psychology, 1977, 13, 198–204.

    Article  Google Scholar 

  • Zung, B.J., Cross-modal matching among normal and retarded children. Child Development, 1971, 42, 1614–1618.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1981 Plenum Press, New York

About this chapter

Cite this chapter

Jones, B. (1981). The Developmental Significance of Cross-Modal Matching. In: Walk, R.D., Pick, H.L. (eds) Intersensory Perception and Sensory Integration. Perception and Perceptual Development. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-9197-9_4

Download citation

  • DOI: https://doi.org/10.1007/978-1-4615-9197-9_4

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4615-9199-3

  • Online ISBN: 978-1-4615-9197-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics