Abstract
We investigated the influence of conceptual processing on visual attention from the standpoint of Theory of Event Coding (TEC). The theory makes two predictions: first, an important factor in determining the influence of event 1 on processing event 2 is whether features of event 1 are bound into a unified representation (i.e., selection or retrieval of event 1). Second, whether processing the two events facilitates or interferes with each other should depend on the extent to which their constituent features overlap. In two experiments, participants performed a visual-attention cueing task, in which the visual target (event 2) was preceded by a relevant or irrelevant explicit (e.g., “UP”) or implicit (e.g., “HAPPY”) spatial-conceptual cue (event 1). Consistent with TEC, we found relevant explicit cues (which featurally overlap to a greater extent with the target) and implicit cues (which featurally overlap to a lesser extent), respectively, facilitated and interfered with target processing at compatible locations. Irrelevant explicit and implicit cues, on the other hand, both facilitated target processing, presumably because they were less likely selected or retrieved as an integrated and unified event file. We argue that such effects, often described as “attentional cueing”, are better accounted for within the event coding framework.
Similar content being viewed by others
Notes
Making this assumption a priori might seem problematic. The alternative assumption, namely that both words could be selected at once and to the same degree, seems defensible if we entertain the possibility that the vertically arranged words are grouped into a single perceptual object. However, this assumption gives rise to the prediction that cue Relevance should have no impact on performance (Duncan, 1984), which is disconfirmed in both Experiments 1 and 2. Hence, our assumption that the relevant word is selected with a higher likelihood at the expense of the irrelevant word was confirmed by the findings.
References
Ansorge, U., Khalid, S., & König, P. (2013). Space-valence priming with subliminal and supraliminal words. Frontiers in Psychology, 4, 81. doi:10.3389/fpsyg.2013.00081.
Ansorge, U., Kiefer, M., Khalid, S., Grassl, S., & König, P. (2010). Testing the theory of embodied cognition with subliminal words. Cognition, 116(3), 303–320. doi:10.1016/j.cognition.2010.05.010.
Barsalou, L. (1999). Perceptions of perceptual symbols. Behavioral and Brain Sciences, 22, 637–660. doi:10.1017/S0140525X99532147.
Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617–645. doi:10.1146/annurev.psych.59.103006.093639.
Brainard, D. H. (1997). The Psychophysics Toolbox. Spatial Vision, 10, 433–436.
Casasanto, D. (2010). Space for thinking. In V. Evans & P. Chilton (Eds.), Language, cognition, and space: State of the art and new directions (pp. 453–478). London: Equinox Publishing.
Chasteen, A. L., Burdzy, D. C., & Pratt, J. (2010). Thinking of god moves attention. Neuropsychologia, 48, 627–630. doi:10.1016/j.neuropsychologia.2009.09.029.
Cho, Y. S., Lien, M. C., & Proctor, R. W. (2006). Stroop dilution depends on the nature of the color carrier but not on its location. Journal of Experimental Psychology: Human Perception and Performance, 32, 826–839. doi:10.1037/0096-1523.32.4.826.
Connell, L., & Lynott, D. (2014). Principles of representation: Why you can’t represent the same concept twice. Topics in Cognitive Science, 6, 390–406. doi:10.1111/tops.12097.
Cousineau, D. (2005). Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson’s method. Tutorials in Quantitative Methods for Psychology, 1, 42–45.
Cousineau, D., & Chartier, S. (2010). Outliers detection and treatment: A review. International Journal of Psychological Research, 3, 58–67. doi:10.21500/20112084.844.
Dudschig, C., de la Vega, I., De Filippis, M., & Kaup, B. (2014). Language and vertical space: On the automaticity of language action interconnections. Cortex, 58, 151–160. doi:10.1016/j.cortex.2014.06.003.
Duncan, J. (1984). Selective attention and the organization of visual information. Journal of Experimental Psychology: General, 113, 501–517. doi:10.1037/0096-3445.113.4.501.
Dutilh, G., Vandekerckhove, J., Forstmann, B. U., Keuleers, E., Brysbaert, M., & Wagenmakers, E. J. (2012). Testing theories of post-error slowing. Attention, Perception, & Psychophysics, 74, 454–465. doi:10.3758/s13414-011-0243-2.
Eckstein, M. P., Drescher, B. A., & Shimozaki, S. S. (2006). Attentional cues in real scenes, saccadic targeting, and Bayesian priors. Psychological Science, 17, 973–980. doi:10.1111/j.1467-9280.2006.01815.x.
Eder, A. B., & Klauer, K. C. (2007). Common valence coding in action and evaluation: Affective blindness towards response-compatible stimuli. Cognition and Emotion, 21, 1297–1322. doi:10.1080/02699930701438277.
Eder, A. B., & Klauer, K. C. (2009). A common-coding account of the bidirectional evaluation–behavior link. Journal of Experimental Psychology: General, 138, 218–235. doi:10.1037/a0015220.
Eder, A. B., Müsseler, J., & Hommel, B. (2012). The structure of affective action representations: Temporal binding of affective response codes. Psychological Research, 76, 111–118. doi:10.1007/s00426-011-0327-6.
Estes, Z., Verges, M., & Adelman, J. S. (2015). Words, objects, and locations: Perceptual matching explains spatial interference and facilitation. Journal of Memory and Language, 84, 167–189. doi:10.1016/j.jml.2015.06.002.
Estes, Z., Verges, M., & Barsalou, L. W. (2008). Head up, foot down—object words orient attention to the objects’ typical location. Psychological Science, 19, 93–97. doi:10.1111/j.1467-9280.2008.02051.x.
Fischer, M. H., & Zwaan, R. A. (2008). Embodied language: A review of the role of the motor system in language comprehension. Quarterly Journal of Experimental Psychology, 61, 825–850. doi:10.1080/17470210701623605.
Fournier, L. R., Wiediger, M. D., & Taddese, E. F. (2015). Action plans can interact to hinder or facilitate reach performance. Attention, Perception, & Psychophysics, 77, 2755–2767. doi:10.3758/s13414-015-0959-5.
Frings, C., Moeller, B., & Rothermund, K. (2013). Retrieval of event files can be conceptually mediated. Attention, Perception, & Psychophysics, 75, 700–709. doi:10.3758/s13414-013-0431-3.
Frings, C., & Rothermund, K. (2011). To be or not to be… included in an event file: Integration and retrieval of distractors in stimulus-response episodes is influenced by perceptual grouping. Journal of Experimental Psychology-Learning Memory and Cognition, 37, 1209–1227. doi:10.1037/a0023915.
Frings, C., Rothermund, K., & Wentura, D. (2007). Distractor repetitions retrieve previous responses to targets. The Quarterly Journal of Experimental Psychology, 60, 1367–1377. doi:10.1080/17470210600955645.
Gallese, V., & Lakoff, G. (2005). The brain’s concepts: The role of the sensory-motor system in conceptual knowledge. Cognitive Neuropsychology, 22, 455–479. doi:10.1080/02643290442000310.
Gibson, B. S., & Kingstone, A. (2006). Visual attention and the semantics of space: Beyond central and peripheral cues. Psychological Science, 17, 622–627. doi:10.1111/j.1467-9280.2006.01754.x.
Gibson, B. S., Scheutz, M., & Davis, G. J. (2009). Symbolic control of visual attention: Semantic constraints on the spatial distribution of attention. Attention Perception & Psychophysics, 71, 363–374. doi:10.3758/APP.71.2.363.
Giesen, C., Frings, C., & Rothermund, K. (2012). Differences in the strength of distractor inhibition do not affect distractor–response bindings. Memory & Cognition, 40, 373–387. doi:10.3758/s13421-011-0157-1.
Giesen, C., & Rothermund, K. (2014). Distractor repetitions retrieve previous responses and previous targets: Experimental dissociations of distractor–response and distractor–target bindings. Journal of Experimental Psychology. Learning, Memory, and Cognition, 40, 645–659. doi:10.1037/a0035278.
Goodhew, S. C., Visser, T. A., Lipp, O. V., & Dux, P. E. (2011). Implicit semantic perception in object substitution masking. Cognition, 118, 130–134. doi:10.1016/j.cognition.2010.10.013.
Gozli, D. G., Chasteen, A. L., & Pratt, J. (2013a). The cost and benefit of implicit spatial cues for visual attention. Journal of Experimental Psychology: General, 142, 1028–1046. doi:10.1037/a0030362.
Gozli, D. G., Chow, A., Chasteen, A. L., & Pratt, J. (2013b). Valence and vertical space: Saccade trajectory deviations reveal metaphorical spatial activation. Visual Cognition, 21, 628–646. doi:10.1080/13506285.2013.815680.
Gozli, D. G., Goodhew, S. C., Moskowitz, J. B., & Pratt, J. (2013c). Ideomotor perception modulates visuospatial cueing. Psychological Research, 77, 528–539. doi:10.1007/s00426-012-0461-9.
Gozli, D. G., & Pratt, J. (2011). Seeing while acting: Hand movements can modulate attentional capture by motion onset. Attention, Perception, & Psychophysics, 73, 2448–2456. doi:10.3758/s13414-011-0203-x.
Gozli, D. G., Pratt, J., Martin, K. Z., & Chasteen, A. L. (2016). Implied spatial meaning and visuospatial bias: Conceptual processing influences processing of visual targets and distractors. PLoS One, 11, e0150928. doi:10.1371/journal.pone.0150928.
Ho, C., & Spence, C. (2006). Verbal interface design: Do verbal directional cues automatically orient visual spatial attention? Computers in Human Behavior, 22, 733–748. doi:10.1016/j.chb.2005.12.008.
Hommel, B. (1998). Automatic stimulus-response translation in dual-task performance. Journal of Experimental Psychology-Human Perception and Performance, 24, 1368–1384. doi:10.1037/0096-1523.24.5.1368.
Hommel, B. (2004). Event files: Feature binding in and across perception and action. Trends in Cognitive Sciences, 8, 494–500. doi:10.1016/j.tics.2004.08.007.
Hommel, B. (2005). How much attention does an event file need? Journal of Experimental Psychology: Human Perception and Performance, 31, 1067–1082. doi:10.1037/0096-1523.31.5.1067.
Hommel, B. (2009). Action control according to TEC (theory of event coding). Psychological Research, 73, 512–526. doi:10.1007/s00426-009-0234-2.
Hommel, B., Memelink, J., Zmigrod, S., & Colzato, L. S. (2014). Attentional control of the creation and retrieval of stimulus–response bindings. Psychological Research, 78, 520–538. doi:10.1007/s00426-013-0503-y.
Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001a). The theory of event coding (TEC): A framework for perception and action planning. Behavioral and Brain Sciences, 24, 849–878. doi:10.1017/S0140525X01000103.
Hommel, B., Pratt, J., Colzato, L., & Godijn, R. (2001b). Symbolic control of visual attention. Psychological Science, 12, 360–365. doi:10.1111/1467-9280.00367.
Kahneman, D., Treisman, A., & Gibbs, B. (1992). The reviewing of object files—Object-specific integration of information. Cognitive Psychology, 24, 175–219. doi:10.1016/0010-0285(92)90007-O.
Kiss, M., Grubert, A., & Eimer, M. (2013). Top-down task sets for combined features: Behavioral and electrophysiological evidence for two stages in attentional object selection. Attention, Perception, & Psychophysics, 75, 216–228. doi:10.3758/s13414-012-0391-z.
Kunde, W., & Wühr, P. (2004). Actions blind to conceptually overlapping stimuli. Psychological Research, 68, 199–207. doi:10.1007/s00426-003-0156-3.
Lachmair, M., Ruiz Fernández, S., & Gerjets, P. (2016). Priming effects between spatial meaning of verbs and numbers are modulated by time intervals: Early interference and late facilitation. Canadian Journal of Experimental Psychology. doi:10.1037/cep0000085.
Lakens, D. (2011). High skies and oceans deep: polarity benefits or mental simulation? Frontiers in Psychology, 2, 21. doi:10.3389/fpsyg.2011.00021.
Lakens, D. (2012). Polarity correspondence in metaphor congruency effects: Structural overlap predicts categorization times for bipolar concepts presented in vertical space. Journal of Experimental Psychology. Learning, Memory, and Cognition, 38, 726–736. doi:10.1037/a0024955.
Logan, G. D. (1995). Linguistic and conceptual control of visual spatial attention. Cognitive Psychology, 28, 103–174. doi:10.1006/cogp.1995.1004.
Luo, C. & Proctor, R.W. (2016). How different location modes influence responses in a Simon-like task. Psychological Research. doi:10.1007/s00426-016-0809-7.
Lynott, D., & Coventry, K. R. (2014). On the ups and downs of emotion: Testing between conceptual-metaphor and polarity accounts of emotional valence-spatial location interactions. Psychonomic Bulletin & Review, 21, 218–226. doi:10.3758/s13423-013-0481-5.
Marmolejo-Ramos, F., Montoro, P. R., Elosúa, M. R., Contreras, M. J., & Jiménez-Jiménez, W. A. (2014). The activation of representative emotional verbal contexts interacts with vertical spatial axis. Cognitive Processing, 15, 253–267. doi:10.1007/s10339-014-0620-6.
Meier, B., & Robinson, M. (2004). Why the sunny side is up—Associations between affect and vertical position. Psychological Science, 15, 243–247. doi:10.1111/j.0956-7976.2004.00659.x.
Memelink, J., & Hommel, B. (2013). Intentional weighting: A basic principle in cognitive control. Psychological Research, 77, 249–259. doi:10.1007/s00426-012-0435-y.
Moeller, B., & Frings, C. (2014). Attention meets binding: Only attended distractors are used for the retrieval of event files. Attention, Perception, & Psychophysics, 76, 959–978. doi:10.3758/s13414-014-0648-9.
Moeller, B., Hommel, B., & Frings, C. (2015). From hands to feet: Abstract response representations in distractor–response bindings. Acta Psychologica, 159, 69–75. doi:10.1016/j.actpsy.2015.05.012.
Morey, R. D. (2008). Confidence intervals from normalized data: A correction to Cousineau (2005). Tutorials in Quantitative Methods for Psychology, 4, 61–64.
Müsseler, J. (1999). How independent from action control is perception? An event-coding account for more equally-ranked crosstalks. In G. Aschersleben, T. Bachmann, J. Müsseler (Eds.), Cognitive Contributions to the Perception of Spatial and Temporal Events (Advances in Psychology, Vol. 129, pp. 121–147). Amsterdam: Elsevier.
Müsseler, J., & Hommel, B. (1997). Blindness to response-compatible stimuli. Journal of Experimental Psychology: Human Perception and Performance, 23(3), 861–872. doi:10.1037/0096-1523.23.3.861.
Ostarek, M., & Vigliocco, G. (2017). Reading sky and seeing a cloud: On the relevance of events for perceptual simulation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 43, 579–590. doi:10.1037/xlm0000318.
Ouellet, M., Santiago, J., Funes, M. J., & Lupiánez, J. (2010). Thinking about the future moves attention to the right. Journal of Experimental Psychology: Human Perception and Performance, 36, 17–24. doi:10.1037/a0017176.
Palmer, J., Ames, C. T., & Lindsey, D. T. (1993). Measuring the effect of attention on simple visual search. Journal of Experimental Psychology: Human Perception and Performance, 19(1), 108–130. doi:10.1037//0096-1523.19.1.108.
Palmer, J., Verghese, P., & Pavel, M. (2000). The psychophysics of visual search. Vision Research, 40(10), 1227–1268. doi:10.1016/S0042-6989(99)00244-8.
Pecher, D., Dantzig, S., Boot, I., Zanolie, K., & Huber, D. E. (2010). Congruency between word position and meaning is caused by task-induced spatial attention. Frontiers in Psychology, 1, 30. doi:10.3389/fpsyg.2010.00030.
Pelli, D. G. (1997). The Video Toolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10, 437–442. doi:10.1163/156856897X00366.
Proctor, R. W., & Xiong, A. (2015). Polarity correspondence as a general compatibility principle. Current Directions in Psychological Science, 24, 446–451. doi:10.1177/0963721415607305.
Pulvermüller, F. (1999). Words in the brain's language. Behavioral and Brain Sciences, 22, 253–279. doi:10.1017/S0140525X9900182X.
Rajsic, J., Wilson, D. E., & Pratt, J. (2015). Confirmation bias in visual search. Journal of Experimental Psychology. Human Perception & Performance, 41, 1353–1364. doi:10.1037/xhp0000090.
Rothermund, K., Wentura, D., & De Houwer, J. (2005). Retrieval of incidental stimulus-response associations as a source of negative priming. Journal of Experimental Psychology. Learning, Memory, and Cognition, 31, 482–495. doi:10.1037/0278-7393.31.3.482.
Rowe, G., Hirsh, J. B., & Anderson, A. K. (2007). Positive affect increases the breadth of attentional selection. Proceedings of the National Academy of Sciences, 104, 383–388. doi:10.1073/pnas.0605198104.
Santiago, J., & Lakens, D. (2015). Can conceptual congruency effects between number, time, and space be accounted for by polarity correspondence? Acta Psychologica, 156, 179–191. doi:10.1016/j.actpsy.2014.09.016.
Sasaki, K., Yamada, Y., & Miura, K. (2016). Emotion biases voluntary vertical action only with visible cues. Acta Psychologica, 163, 97–106.
Stoet, G., & Hommel, B. (1999). Action planning and the temporal binding of response codes. Journal of Experimental Psychology-Human Perception and Performance, 25(6), 1625–1640. doi:10.1037/0096-1523.25.6.1625.
Taylor, J. E. T., Lam, T. K., Chasteen, A. L., & Pratt, J. (2015). Bow your head in shame, or, hold your head up with pride: Semantic processing of self-esteem concepts orients attention vertically. PLoS ONE, 10, e0137704. doi:10.1016/j.actpsy.2015.11.003.
Thomaschke, R., Hopkins, B., & Miall, R. C. (2012). The planning and control model (PCM) of motorvisual priming: Reconciling motorvisual impairment and facilitation effects. Psychological Review, 119, 388–407. doi:10.1037/a0027453.
Treisman, A. (1998). Feature binding, attention and object perception. Philosophical Transactions of the Royal Society of London Series B-Biological Sciences, 353, 1295–1306. doi:10.1098/rstb.1998.0284.
Treisman, A. M., & Gelade, G. (1980). A feature-integration theory of attention. Cognitive Psychology, 12, 97–136. doi:10.1016/0010-0285(80)90005-5.
Treisman, A., & Schmidt, H. (1982). Illusory conjunctions in the perception of objects. Cognitive Psychology, 14, 107–141. doi:10.1016/0010-0285(82)90006-8.
Wühr, P., & Müsseler, J. (2001). Time course of the blindness to response-compatible stimuli. Journal of Experimental Psychology: Human Perception and Performance, 27, 1260–1270. doi:10.1037/0096-1523.27.5.1260.
Xie, J., Huang, Y., Wang, R., & Liu, W. (2015). Affective valence facilitates spatial detection on vertical axis: Shorter time strengthens effect. Frontiers in Psychology, 6, 277. doi:10.3389/fpsyg.2015.00277.
Xie, J., Wang, R., & Chang, S. (2014). The mechanism of valence-space metaphors: ERP evidence for affective word processing. PLoS One, 9, e99479. doi:10.1371/journal.pone.0099479.
Zanolie, K., van Dantzig, S., Boot, I., Wijnen, J., Schubert, T. W., Giessner, S. R., & Pecher, D. (2012). Mighty metaphors: Behavioral and ERP evidence that power shifts attention on a vertical dimension. Brain and Cognition, 78, 50–58. doi:10.1016/j.bandc.2011.10.006.
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Funding
This study was supported by the Natural Sciences and Engineering Research Council of Canada (Alexander Graham Bell Doctoral Scholarships to Tarek Amer and Davood Gozli, a Postdoctoral Fellowship to Davood Gozli, and a Discovery Grant to Jay Pratt).
Conflict of interest
Tarek Amer declares that he has no conflict of interest. Davood Gozli declares that he has no conflict of interest. Jay Pratt declares that he has no conflict of interest.
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Appendix
Appendix
In this section, we report analyses of RT data from both experiments, without the exclusion of RT outliers. Here, we excluded the incorrect trials and trials immediately following an incorrect response. Response times, therefore, could take any value up to 2000 ms, which was the cut-off built-in of the procedure.
Experiment 1
Mean RTs from Experiment 1 were submitted to a 2 × 3 × 2 × 2 repeated measures ANOVA, with factors being cue Relevance, cue-target SOA, cue-target compatibility, and cue-target distance. This analysis revealed a main effect of SOA (F[2,38] = 71.84, p < 0.001, η 2p = 0.791). As SOA increased, RTs decreased (484, 377, and 340 ms, respectively, for SOAs = 300, 550, and 800 ms). We also found a main effect of Compatibility (F[1,19] = 6.10, p = 0.023, η 2p = 0.243), driven by faster responses with cue-target compatible than incompatible trials (respectively, 391 ± 27 and 409 ± 31 ms). Both of these results matched the findings reported in the main text after outlier-exclusion. The only other significant finding was a two-way interaction between Relevance and SOA (F[2,38] = 4.04, p = 0.026, η 2p = 0.176). The effect of SOA was more pronounced with irrelevant cues (514, 400, and 345 ms, respectively, for SOAs = 300, 550, and 800 ms), compared to relevant cues (453, 355, and 335 ms). No other main effect or interaction reached statistical significance. Most importantly, we found no interaction between Relevance x Compatibility (F[1,19] < 0.48). In short, the main results of Experiment 1 (i.e., the main effect of cue-target Compatibility) persist in the absence of the RT outliers-detection/exclusion procedure.
Experiment 2
Mean RTs from Experiment 2 were submitted to the same repeated measures ANOVA. This analysis also revealed a main effect of SOA (F[2,38] = 122.29, p < 0.001, η 2p = 0.866). As SOA increased, RTs decreased (491, 381, and 352 ms, respectively, for SOAs = 300, 550, and 800 ms). We also found a two-way interaction between relevance and distance (F[1,19] = 7.56, p = 0.013, η 2p = 0.285), driven by faster responses when the target appeared near the relevant (i.e., selected) word compared to when the target appeared near the irrelevant (i.e., not selected) word (401 vs. 419 ms). Finally, we found a three-way interaction between relevance, compatibility, and distance (F[1,19] = 4.65, p = 0.044, η 2p = 0.197). Matching the results reported in the main text, we found the same pattern of Relevance x Compatibility interaction—i.e., facilitation with cue-target compatibility when the cue is irrelevant, but an inverse compatibility when the cue is relevant—only with cue-target near trials (39 ± 22 ms, Cohen’s d = 0.39), but no such interaction when the target and cue appear far from each other (−5 ± 12 ms, Cohen’s d = 0.09). No other main effect or interaction reached significance. Thus, the central result of Experiment 2 (i.e., the three-way interaction between relevance, compatibility, and distance) remains the same without the application of the RT outliers-detection/exclusion procedure.
Rights and permissions
About this article
Cite this article
Amer, T., Gozli, D.G. & Pratt, J. Biasing spatial attention with semantic information: an event coding approach. Psychological Research 82, 840–858 (2018). https://doi.org/10.1007/s00426-017-0867-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00426-017-0867-5