Skip to main content
Log in

Attention in hindsight: Using stimulated recall to capture dynamic fluctuations in attentional engagement

  • Original Manuscript
  • Published:
Behavior Research Methods Aims and scope Submit manuscript

Abstract

Attentional engagement is known to vary on a moment-to-moment basis. However, few self-report methods can effectively capture dynamic fluctuations in attentional engagement over time. In the current paper, we evaluated the utility of stimulated recall, a method wherein individuals are asked to remember their subjective states while using a mnemonic cue, for the measurement of temporal changes in attentional engagement. Participants were asked to watch a video lecture, during which we assessed their in-the-moment levels of attentional engagement using intermittent thought probes. Then, we used stimulated recall by cueing participants with short video clips from the lecture to retrospectively assess the levels of attentional engagement they had experienced when they first watched those clips within the lecture. Experiment 1 assessed the statistical overlap between in-the-moment and video-stimulated ratings. Experiment 2 assessed the generalizability of video-stimulated recall across different types of lectures. Experiment 3 assessed the impact of presenting video-stimulated probe clips in non-chronological order. Experiment 4 assessed the effect of video-stimulated recall on its own. Across all experiments, we found statistically robust correspondence between in-the-moment and video-stimulated ratings of attentional engagement, illustrating a strong convergence between these two methods of assessment. Taken together, our findings indicate that stimulated recall provides a new and practical methodological approach that can accurately capture dynamic fluctuations in subjective attentional states over time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data availability

Anonymized data for all studies in this paper are publicly available on the Open Science Framework at https://osf.io/r8ub7/. The experiments were not preregistered.

Code availability

Analysis scripts for this paper are publicly available on the Open Science Framework at https://osf.io/r8ub7/.

Notes

  1. Although the data were collected in order of Experiment 2 (Jan to Aug 2021), Experiment 3 (Apr to Aug 2021), Experiment 1 (May to Oct 2021), and Experiment 4 (Jan to Apr 2023), they are presented here in the current order to aid with theoretical and methodological comparisons.

  2. Given that a minimum of three probe responses are needed to construct the time series, subsampling the data at a proportion lower than 20% was not possible.

  3. To avoid overparameterization within the model, only positive time lags were used in the analysis; however, analyzing the data using only negative time lags replicated the pattern of effects found. See Supplementary Materials for complete analyses.

  4. To offer comparison to the video lecture used in Experiment 1, another group of independent raters (32 participants: 17 women, 15 men; Mage = 20.4 years, SDage = 1.3 years) were asked to assess the evolutionary psychology video on various engagement metrics on a scale of 0 to 10 (see Supplementary Materials). Compared to the video lectures used in Experiment 2, the evolutionary psychology video had significantly higher engagement metrics compared to the art history video [most ps < .036, most ds > .55, except for ratings of flow, appeal, and video quality where ps > .11, ds < .41], but was statistically similar to the computer science video [most ps > .05, most ds < .51, except for ratings of appeal and video quality where ps < .025, ds > .59].

  5. When analyzing the data using only negative time lags, we replicated the pattern of effects found within positive time lags (see Supplementary Materials).

  6. Negative time lags replicated the pattern of effects found within positive time lags (see Supplementary Materials).

  7. Negative time lags replicated the pattern of effects found within positive time lags (see Supplementary Materials).

References

Download references

Funding

This research was funded by the Natural Sciences and Engineering Research Council of Canada (NSERC) Banting and Postdoctoral Fellowships awarded to EJP, NSERC Masters- and Doctoral-level Canada Graduate Scholarships awarded to SAG, and NSERC Discovery Grants awarded to JDW and DS.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Effie J. Pereira.

Ethics declarations

Conflicts of interest

All authors declare no conflicts of interest.

Ethics approval

All studies were conducted in accordance with the Declaration of Helsinki, and all protocol and procedures were approved by the University of Waterloo’s research ethics board (#42793).

Consent to participate

Informed written consent was obtained from all individuals who participated in the studies in this paper.

Consent for publication

Informed written consent was obtained from all individuals regarding the publishing of their anonymized data.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open practices statement

Anonymized data as well as the analysis scripts for the studies contained within this paper are publicly available on the Open Science Framework at https://osf.io/r8ub7/. The experiments were not preregistered.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 1436 KB)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pereira, E.J., Ayers-Glassey, S., Wammes, J.D. et al. Attention in hindsight: Using stimulated recall to capture dynamic fluctuations in attentional engagement. Behav Res (2023). https://doi.org/10.3758/s13428-023-02273-4

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.3758/s13428-023-02273-4

Keywords

Navigation