Advertisement

Experimental Brain Research

, Volume 220, Issue 1, pp 51–61 | Cite as

See what I hear? Beat perception in auditory and visual rhythms

  • Jessica A. Grahn
Research Article

Abstract

Our perception of time is affected by the modality in which it is conveyed. Moreover, certain temporal phenomena appear to exist in only one modality. The perception of temporal regularity or structure (e.g., the ‘beat’) in rhythmic patterns is one such phenomenon: visual beat perception is rare. The modality-specificity for beat perception is puzzling, as the durations that comprise rhythmic patterns are much longer than the limits of visual temporal resolution. Moreover, the optimization that beat perception provides for memory of auditory sequences should be equally relevant to visual sequences. Why does beat perception appear to be modality specific? One possibility is that the nature of the visual stimulus plays a role. Previous studies have usually used brief stimuli (e.g., light flashes) to present visual rhythms. In the current study, a rotating line that appeared sequentially in different spatial orientations was used to present a visual rhythm. Discrimination accuracy for visual rhythms and auditory rhythms was compared for different types of rhythms. The rhythms either had a regular temporal structure that previously has been shown to induce beat perception in the auditory modality, or they had an irregular temporal structure without beat-inducing qualities. Overall, the visual rhythms were discriminated more poorly than the auditory rhythms. The beat-based structure, however, increased accuracy for visual as well as auditory rhythms. These results indicate that beat perception can occur in the visual modality and improve performance on a temporal discrimination task, when certain types of stimuli are used.

Keywords

Music Rhythm Timing Auditory perception Visual perception Cross-modal comparisons 

References

  1. Averbach E, Coriell E (1961) Short-term memory in vision. Bell Syst Tech J 40:309–328Google Scholar
  2. Chen Y, Repp BH, Patel AD (2002) Spectral decomposition of variability in synchronization and continuation tapping: comparisons between auditory and visual pacing and feedback conditions. Hum Movement Sci 21:515–532CrossRefGoogle Scholar
  3. Collier GL, Logan G (2000) Modality differences in short-term memory for rhythms. Mem Cognition 28:529–538CrossRefGoogle Scholar
  4. Collier GL, Wright CE (1995) Temporal rescaling of simple and complex ratios in rhythmic tapping. J Exp Psychol Human 21:602–627CrossRefGoogle Scholar
  5. Cowan N (1984) On short and long auditory stores. Psychol Bull 96:341–370PubMedCrossRefGoogle Scholar
  6. Crowder RG (1982) Decay of auditory memory in vowel discrimination. J Exp Psychol Learn Mem Cogn 8:153–162PubMedCrossRefGoogle Scholar
  7. Darwin CJ, Turvey MT, Crowder RG (1972) An auditory analogue of the Sperling partial report procedure: evidence for brief auditory storage. Cognit Psychol 3:255–267CrossRefGoogle Scholar
  8. Drake C, Penel A, Bigand E (2000) Tapping in time with mechanically and expressively performed music. Music Percept 18:1–24Google Scholar
  9. Eriksen CW, Collins JF (1967) Some temporal characteristics of visual pattern perception. J Exp Psychol 74:476–484PubMedCrossRefGoogle Scholar
  10. Essens PJ (1995) Structuring temporal sequences: comparison of models and factors of complexity. Percept Psychophys 57:519–532PubMedCrossRefGoogle Scholar
  11. Essens PJ, Povel DJ (1985) Metrical and nonmetrical representations of temporal patterns. Percept Psychophys 37:1–7PubMedCrossRefGoogle Scholar
  12. Ferrandez AM, Hugueville L, Lehéricy S et al (2003) Basal ganglia and supplementary motor area subtend duration perception: an fMRI study. NeuroImage 19:1532–1544PubMedCrossRefGoogle Scholar
  13. Gault RH, Goodfellow LD (1938) An empirical comparison of audition, vision, and touch in the discrimination of temporal patterns and ability to reproduce them. J Gen Psychol 18:41–47CrossRefGoogle Scholar
  14. Glenberg AM, Jona M (1991) Temporal coding in rhythm tasks revealed by modality effects. Mem Cogn 19:514–522CrossRefGoogle Scholar
  15. Glenberg AM, Mann S, Altman L, Forman T (1989) Modality effects in the coding and reproduction of rhythms. Mem Cogn 17:373–383CrossRefGoogle Scholar
  16. Goldstone S, Lhamon WT (1972) Auditory-visual differences in human temporal judgment. Percept Motor Skills 34:623–633PubMedCrossRefGoogle Scholar
  17. Grahn JA (2009) The role of the basal ganglia in beat perception: neuroimaging and neuropsychological investigations. Ann NY Acad Sci 1169:35–45PubMedCrossRefGoogle Scholar
  18. Grahn JA, Brett M (2007) Rhythm perception in motor areas of the brain. J Cogn Neurosci 19:893–906PubMedCrossRefGoogle Scholar
  19. Grahn JA, Brett M (2009) Impairment of beat-based rhythm discrimination in Parkinson’s disease. Cortex 45:54–61PubMedCrossRefGoogle Scholar
  20. Grahn JA, Henry MJ, McAuley JD (2011) FMRI investigation of cross-modal interactions in beat perception: audition primes vision, but not vice versa. NeuroImage 54:1231–1243PubMedCrossRefGoogle Scholar
  21. Grondin S (1993) Duration discrimination of empty and filled intervals marked by auditory and visual signals. Percept Psychophys 54:383–394PubMedCrossRefGoogle Scholar
  22. Grondin S, Meilleur-Wells G, Ouellette C, Macar F (1999) Sensory effects on judgements of short time-intervals. Psychol Res 61:261–268CrossRefGoogle Scholar
  23. Guttman SE, Gilroy LA, Blake R (2005) Hearing what the eyes see: auditory encoding of visual temporal sequences. Psychol Sci 16:228–265PubMedCrossRefGoogle Scholar
  24. Handel S, Buffardi L (1969) Using several modalities to perceive one temporal pattern. Q J Exp Psychol 21:37–41Google Scholar
  25. Holcombe AO (2009) Seeing slow and seeing fast: two limits on perception. Trends Cogn Sci 13:216–221PubMedCrossRefGoogle Scholar
  26. Hove MJ, Spivey MJ, Krumhansl CL (2010) Compatibility of motion facilitates visuomotor synchronization. J Exp Psychol Human 36:1525–1534CrossRefGoogle Scholar
  27. Jäncke L, Loose R, Lutz K, Specht K, Shah NJ (2000) Cortical activations during paced finger-tapping applying visual and auditory pacing stimuli. Cog Brain Res 10:51–66CrossRefGoogle Scholar
  28. Jantzen KJ, Steinberg FL, Kelso JAS (2005) Functional MRI reveals the existence of modality and coordination-dependent timing networks. NeuroImage 25:1031–1042PubMedCrossRefGoogle Scholar
  29. Large EW, Palmer C (2002) Perceiving temporal regularity in music. Cogn Sci 26:1–37CrossRefGoogle Scholar
  30. McAuley JD, Henry MJ (2010) Modality effects in rhythm processing: auditory encoding of visual rhythms is neither obligatory nor automatic. Atten Percept Psycho 72:1377–1389CrossRefGoogle Scholar
  31. Nettl B (2000) An ethnomusicologist contemplates universals in musical sound and musical culture. In: Wallin NL, Merker BH, Brown S (eds) The origins of music. MIT Press, Cambridge, MA, pp 463–472Google Scholar
  32. Parncutt R (1994) A perceptual model of pulse salience and metrical accent in musical rhythms. Music Percept 11:409–464Google Scholar
  33. Patel AD, Iversen JR, Chen Y, Repp BH (2005) The influence of metricality and modality on synchronization with a beat. Exp Brain Res 163:226–238PubMedCrossRefGoogle Scholar
  34. Povel DJ, Essens PJ (1985) Perception of temporal patterns. Music Percept 2:411–440Google Scholar
  35. Povel DJ, Okkerman H (1981) Accents in equitone sequences. Percept Psychophys 30:565–572PubMedCrossRefGoogle Scholar
  36. Repp BH, Penel A (2002) Auditory dominance in temporal processing: new evidence from synchronization with simultaneous visual and auditory sequences. J Exp Psychol Human 28:1085CrossRefGoogle Scholar
  37. Sakitt B (1976) Iconic memory. Psychol Rev 83:257–276PubMedCrossRefGoogle Scholar
  38. Schubotz RI, Friederici AD, von Cramon DY (2000) Time perception and motor timing: a common cortical and subcortical basis revealed by fMRI. NeuroImage 11:1–12PubMedCrossRefGoogle Scholar
  39. Schutz M, Kubovy MJ (2009) Causality and cross-modal integration. J Exp Psychol Hum Percept Perform 35:1791–1810PubMedCrossRefGoogle Scholar
  40. Semjen A, Ivry RB (2001) The coupled oscillator model of between-hand coordination in alternate-hand tapping: a reappraisal. J Exp Psychol Human 27:251–265CrossRefGoogle Scholar
  41. Shih LYL, Kuo W-J, Yeh T-C et al (2009) Common neural mechanisms for explicit timing in the sub-second range. NeuroReport 20:897–901PubMedCrossRefGoogle Scholar
  42. Sperling G (1960) The information available in brief visual presentation. Psychol Monogr 74:1–29CrossRefGoogle Scholar
  43. Stauffer CC, Haldemann J, Troche SJ, Rammsayer TH (2012) Auditory and visual temporal sensitivity: evidence for a hierarchical structure of modality-specific and modality-independent levels of temporal information processing. Psychol Res 76:20–31PubMedCrossRefGoogle Scholar
  44. van Noorden L, Moelants D (1999) Resonance in the perception of musical pulse. J New Music Res 28:43–66CrossRefGoogle Scholar
  45. Wiener M, Turkeltaub P, Coslett HB (2010) The image of time: a voxel-wise meta-analysis. NeuroImage 49:1728–1740PubMedCrossRefGoogle Scholar

Copyright information

© Springer-Verlag 2012

Authors and Affiliations

  1. 1.Department of PsychologyBrain and Mind Institute, University of Western OntarioLondonCanada

Personalised recommendations