How Well Can We Measure Visual Attention? Psychometric Properties of Manual Response Times and First Fixation Latencies in a Visual Search Paradigm
- 438 Downloads
Attentional biases are considered to be important for the development and maintenance of anxiety disorders, but despite widespread research in this area, the psychometric properties of measures targeting attentional allocation processes have rarely been evaluated. The current study assessed the reliability and validity of manual response times and first fixation latencies within a visual search paradigm, including data from one hundred twenty-two participants (n = sixty-two participants with social anxiety disorder). We found raw manual response times to be highly reliable, while raw first fixation latencies, in most cases, were not. Bias scores were neither reliable for manual responses nor for first fixation latencies. However, we found indicators of convergent validity, as raw values and also bias scores of both measures were significantly correlated. These results raise doubts about our ability to accurately measure visual attention, especially via eye-tracking procedures.
KeywordsAttentional biases Psychometric properties Visual search Eye movements Social anxiety disorder
Financial support for this study was provided by a grant from the German Research Foundation provided to the last author.
Compliance with Ethical Standards
Conflict of interest
Richard Wermes, Tania M. Lincoln and Sylvia Helbig-Lang declare that they have no conflicts of interest.
Research involving Human and Animal Rights
No animal studies were carried out for this article.
All study procedures were in accordance with ethical standards of the responsible ethics committee. All participants provided a written informed consent before they were enrolled in the study.
- Amir, N., Beard, C., Taylor, C. T., Klumpp, H., Elias, J., Burns, M., & Chen, X. (2009). Attention training in individuals with generalized social phobia: a randomized controlled trial. Journal of Consulting and Clinical Psychology, 77(5), 961–973. doi: 10.1037/a0016685.CrossRefPubMedPubMedCentralGoogle Scholar
- Boettcher, J., Leek, L., Matson, L., Holmes, E. A., Browning, M., MacLeod, C., Andersson, G., & Carlbring, P. (2013). Internet-based attention bias modification for social anxiety: a randomised controlled comparison of training towards negative and training towards positive cues. PLoS ONE, 8(9), 1–14. doi: 10.1371/journal.pone.0071760.CrossRefGoogle Scholar
- Brown, H. M., Eley, T. C., Broeren, S., MacLeod, C., Rinck, M., Hadwin, J. A., & Lester, K. J. (2014). Psychometric properties of reaction time based experimental paradigms measuring anxiety-related information-processing biases in children. Journal of Anxiety Disorders, 28(1), 97–107. doi: 10.1016/j.janxdis.2013.11.004.CrossRefPubMedGoogle Scholar
- Chen, N. T. M., Clarke, P. J. F., Watson, T. L., MacLeod, C., & Guastella, A. J. (2014). Biased saccadic responses to emotional stimuli in anxiety: an antisaccade study. PLoS ONE, 9(2), 1–7. doi: 10.1371/journal.pone.0086474.
- Cooper, R. M., Bailey, J. E., Diaper, A., Stirland, R., Renton, L. E., Benton, C. P., … & Munafo, M. R. (2011). Effects of 7.5% CO2 inhalation on allocation of spatial attention to facial cues of emotional expression. Cognition and Emotion, 25(4), 626–638. doi: 10.1177/0269881108096981.CrossRefPubMedGoogle Scholar
- Dalgleish, T., Taghavi, R., Neshat-Doost, H., Moradi, A., Canterbury, R., & Yule, W. (2003). Patterns of processing bias for emotional information across clinical disorders: a comparison of attention, memory, and prospective cognition in children and adolescents with depression, generalized anxiety, and posttraumatic stress disorder. Journal of Clinical Child and Adolescent Psychology 32(1), 10–21. doi: 10.1207/S15374424JCCP3201_02.CrossRefPubMedGoogle Scholar
- Fresco, D. M., Coles, M. E., Heimberg, R. G., Liebowitz, M. R., Hami, S., Stein, M. B., & Goetz, D. (2001). The Liebowitz social anxiety scale: a comparison of the psychometric properties of self-report and clinician-administered formats. Psychological Medicine, 31(6), 1025–1035. doi: 10.1017/S0033291701004056.CrossRefPubMedGoogle Scholar
- Hoffman, J. E. (1998). Visual attention and eye movements. Attention, 384, 119–153.Google Scholar
- Laux, L., Glanzmann, P., Schaffner, P., & Spielberger, C. D. (1981). State-Trait-Anxiety-Inventory (STAI). Theoretical Foundations and Instructions. Weinheim: Beltz.Google Scholar
- Mogg, K., Bradley, B. P., Dixon, C., Fisher, S., Twelftree, H., & McWilliams, A. (2000). Trait anxiety, defensiveness and selective processing of threat: an investigation using two measures of attentional bias. Personality and Individual Differences, 28(1), 1063–1077. doi: 10.1016/S0191-8869(99)00157-9.CrossRefGoogle Scholar
- Murphy, K. R., & Davidshofer, C. O. (2005). Psychological testing: principles and applications. New Jersey: Upper Saddle River.Google Scholar
- Neubauer, K., von Auer, M., Murray, E., Petermann, F., Helbig-Lang, S., & Gerlach, A. L. (2013). Internet-delivered attention modification training as a treatment for social phobia: A randomized controlled trial. Behaviour Research and Therapy, 51(2), 87–97. doi: 10.1016/j.brat.2012.10.006.CrossRefPubMedGoogle Scholar
- Stangier, U., & Heidenreich, T. (2005). Liebowitz Soziale Angst-Skala (LSAS) [Liebowitz Social Anxiety Scale]. In Collegium Internationale Psychiatriae Scalarum (Ed.), Internationale Skalen für Psychiatrie (pp. 299–305). Göttingen: Hogrefe.Google Scholar
- Staugaard, S. R. (2009). Reliability of two versions of the dot-probe task using photographic faces. Psychology Science Quarterly, 51(3), 339–350. http://www.psychologie-aktuell.com/fileadmin/download/PschologyScience/3-2009/07_staugaard.pdf.
- Zanarini, M. C., Skodol, A. E., Bender, D., Dolan, R., Sanislow, C., Schaefer, E., … Gundersono, J. G. (2000). The collaborative longitudinal personality disorders study: Reliability of axis I and II diagnoses. Journal of Personality Disorders, 14(4), 291–299. doi: 10.1521/pedi.2000.14.4.291.CrossRefPubMedGoogle Scholar