Skip to main content
Log in

Attention Bias Modification Training Via Smartphone to Reduce Social Anxiety: A Randomized, Controlled Multi-Session Experiment

  • Original Article
  • Published:
Cognitive Therapy and Research Aims and scope Submit manuscript

Abstract

Testing feasibility and efficacy of psychological treatment via mobile devices is important, given its potential benefits for high-dosage treatment delivery, widespread and inexpensive dissemination, and efficient research methods. We conducted the first randomized controlled trial of attention bias modification training delivered via smartphones, comparing this training to control training in a double-blind design, also including a waitlist condition. All participants performed a variant of dot-probe training involving faces with neutral and disgust (representative of social threat) expressions in brief sessions three times daily over 4 weeks on their own smartphones, at home or anywhere they chose. Attention bias modification, also known as cognitive bias modification of attention, training included a contingency to induce attentional deployment away from disgust faces, whereas the control training included no contingency. Participants completed weekly Internet-based self-report symptom assessments as well as smartphone-delivered dot-probe attention bias assessments, whose reliability findings supported the viability of using smartphones for reaction-time based assessments. The between-groups training effect on attention bias scores was small, showing statistical significance in some analyses and not in others. On measures of social anxiety, intention-to-treat analyses (n = 326) revealed significant pre–post treatment declines with medium to large effect sizes in both training groups, whereas small declines in a waitlist group were nonsignificant. Both training groups showed greater reductions in social anxiety than did waitlist; however, the benefits under these two training conditions were statistically indistinguishable. Improvements in the two training conditions beyond those of waitlist could be attributable to any factors common to them, but not to the contingency training specific to active attention bias modification training.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. Data from study signup was missing for one participant, and the answer on handheld device type was missing for 1.4 % of participants.

  2. Due to a programming error, in two of the eight pairs, the face of one model (ID YY2) was paired with the face of another model (ID ES2) who shared similar features. Because many participants had already completed training when we discovered this problem, we maintained the same stimuli throughout the study without mentioning it to participants. Two participants reported noticing the mismatch. However, the error did not violate the requirement for attention bias modification that each pair consist of a neutral and a threat stimulus.

  3. All p values are two-tailed. T tests employ Welch’s method (equal variances are not assumed). Those appearing in the second paragraph under each symptom heading (e.g., under LSAS above) apply to comparisons of change scores, whereas those in the third paragraph apply to scores at one time, either postassessment or two-month follow-up. For pre–post Cohen’s d effect sizes within each group, we used the formula (M post − M pre)/SDpre. For between-groups Cohen’s d effect sizes, we employed the standard Cohen’s d formula using pooled standard deviation, (M Group1 − M Group2)/SDpooled.

References

  • Amir, N., Beard, C., Burns, M., & Bomyea, J. (2009a). Attention modification program in individuals with generalized anxiety disorder. Journal of Abnormal Psychology, 118(1), 28–33. doi:10.1037/a0012589.

    Article  PubMed Central  PubMed  Google Scholar 

  • Amir, N., Beard, C., Taylor, C. T., Klumpp, H., Elias, J., Burns, M., et al. (2009b). Attention training in individuals with generalized social phobia: A randomized controlled trial. Journal of Consulting and Clinical Psychology, 77(5), 961–973. doi:10.1037/a0016685.

    Article  PubMed Central  PubMed  Google Scholar 

  • Amir, N., Elias, J., Klumpp, H., & Przeworski, A. (2003). Attentional bias to threat in social phobia: Facilitated processing of threat or difficulty disengaging attention from threat? Behaviour Research and Therapy, 41(11), 1325–1335. doi:10.1016/S0005-7967(03)00039-1.

    Article  CAS  PubMed  Google Scholar 

  • Amir, N., Weber, G., Beard, C., Bomyea, J., & Taylor, C. T. (2008). The effect of a single-session attention modification program on response to a public-speaking challenge in socially anxious individuals. Journal of Abnormal Psychology, 117(4), 860–868. doi:10.1037/a0013445.

    Article  PubMed Central  PubMed  Google Scholar 

  • Antony, M. M., Bieling, P. J., Cox, B. J., Enns, M. W., & Swinson, R. P. (1998). Psychometric properties of the 42-item and 21-item versions of the Depression Anxiety Stress Scales in clinical groups and a community sample. Psychological Assessment, 10(2), 176–181. doi:10.1037/1040-3590.10.2.176.

    Article  Google Scholar 

  • Ataya, A. F., Adams, S., Mullings, E., Cooper, R. M., Attwood, A. S., & Munafò, M. R. (2012). Internal reliability of measures of substance-related cognitive bias. Drug and Alcohol Dependence, 121(1–2), 148–151. doi:10.1016/j.drugalcdep.2011.08.023.

    Article  PubMed  Google Scholar 

  • Baker, S. L., Heinrichs, N., Kim, H.-J., & Hofmann, S. G. (2002). The Liebowitz social anxiety scale as a self-report instrument: A preliminary psychometric analysis. Behaviour Research and Therapy, 40(6), 701–715. doi:10.1016/S0005-7967(01)00060-2.

    Article  PubMed  Google Scholar 

  • Bar-Haim, Y., Lamy, D., Pergamin, L., Bakermans-Kranenburg, M. J., & van IJzendoorn, M. H. (2007). Threat-related attentional bias in anxious and nonanxious individuals: A meta-analytic study. Psychological Bulletin, 133(1), 1–24. doi:10.1037/0033-2909.133.1.1.

    Article  PubMed  Google Scholar 

  • Barlow, D. H., Nock, M. K., & Hersen, M. (2009). Single case experimental designs: Strategies for studying behavior change (3rd ed.). Boston, MA: Allyn and Bacon.

    Google Scholar 

  • Beard, C., Sawyer, A. T., & Hofmann, S. G. (2012). Efficacy of attention bias modification using threat and appetitive stimuli: A meta-analytic review. Behavior Therapy, 43(4), 724–740. doi:10.1016/j.beth.2012.01.002.

    Article  PubMed Central  PubMed  Google Scholar 

  • Boettcher, J., Berger, T., & Renneberg, B. (2012). Internet-based attention training for social anxiety: A randomized controlled trial. Cognitive Therapy and Research, 36(5), 522–536. doi:10.1007/s10608-011-9374-y.

    Article  Google Scholar 

  • Boettcher, J., Leek, L., Matson, L., Holmes, E., Browning, M., MacLeod, C., et al. (2013). Internet-based attention bias modification for social anxiety: A randomised controlled comparison of training towards negative and training towards positive cues. PLoS ONE, 8(9), e71760. doi:10.1371/journal.pone.0071760.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Browning, M., Grol, M., Ly, V., Goodwin, G. M., Holmes, E. A., & Harmer, C. J. (2011). Using an experimental medicine model to explore combination effects of pharmacological and cognitive interventions for depression and anxiety. Neuropsychopharmacology, 36(13), 2689–2697. doi:10.1038/npp.2011.159.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Bunnell, B. E., Beidel, D. C., & Mesa, F. (2013). A randomized trial of attention training for generalized social phobia: Does attention training change social behavior? Behavior Therapy. doi:10.1016/j.beth.2013.04.010.

  • Carlbring, P., Apelstrand, M., Sehlin, H., Amir, N., Rousseau, A., Hofmann, S., et al. (2012). Internet-delivered attention bias modification training in individuals with social anxiety disorder—a double blind randomized controlled trial. BMC Psychiatry, 12(1), 66. doi:10.1186/1471-244X-12-66.

    Article  PubMed Central  PubMed  Google Scholar 

  • Cox, B. J., Ross, L., Swinson, R. P., & Direnfeld, D. M. (1998). A comparison of social phobia outcome measures in cognitive-behavioral group therapy. Behavior Modification, 22(3), 285–297. doi:10.1177/01454455980223004.

    Article  CAS  PubMed  Google Scholar 

  • Damian, M. F. (2010). Does variability in human performance outweigh imprecision in response devices such as computer keyboards? Behavior Research Methods, 42(1), 205–211. doi:10.3758/BRM.42.1.205.

    Article  PubMed  Google Scholar 

  • Eldar, S., Apter, A., Lotan, D., Edgar, K. P., Fox, N. A., Pine, D. S., et al. (2012). Attention bias modification treatment for pediatric anxiety disorders: A randomized controlled trial. The American Journal of Psychiatry, 15, 213–220. Retrieved from http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3491316/.

  • Enock, P. M., & McNally, R. J. (2010). Feasibility and efficacy of attention bias modification via iPhone and other handheld devices to reduce social anxiety and worry. Unpublished manuscript. Department of Psychology, Harvard University, Cambridge, MA.

  • Enock, P. M., & McNally, R. J. (2013). How mobile apps and other web-based interventions can transform psychological treatment and the treatment development cycle. The Behavior Therapist, 36(3), 56, 58, 60, 62–66. Retrieved from http://www.abct.org/docs/PastIssue/36n3.pdf.

  • Enock, P. M., Robinaugh, D. J., Reese, H. E., & McNally, R. J. (2012). Improved reliability estimation and psychometrics of the dot-probe paradigm on smartphones and PC. Poster session presented at the meeting of The Association of Behavioral and Cognitive Therapies, National Harbor, MD.

  • Fox, E., Russo, R., Bowles, R., & Dutton, K. (2001). Do threatening stimuli draw or hold visual attention in subclinical anxiety? Journal of Experimental Psychology: General, 130(4), 681. doi:10.1037//0096-3445.130.4.681.

    Article  CAS  Google Scholar 

  • Fresco, D. M., Coles, M. E., Heimberg, R. G., Leibowitz, M. R., Hami, S., Stein, M. B., et al. (2001). The Liebowitz Social Anxiety Scale: A comparison of the psychometric properties of self-report and clinician-administered formats. Psychological Medicine, 31(6), 1025–1035. doi:10.1017/S0033291701004056.

    Article  CAS  PubMed  Google Scholar 

  • Fresco, D. M., Mennin, D. S., Heimberg, R. G., & Turk, C. L. (2003). Using the Penn State Worry Questionnaire to identify individuals with generalized anxiety disorder: A receiver operating characteristic analysis. Journal of Behavior Therapy and Experimental Psychiatry, 34(3–4), 283–291. doi:10.1016/j.jbtep.2003.09.001.

    Article  PubMed  Google Scholar 

  • Gee, A. (2011). Therapist-free therapy: Cognitive-bias modification may put the psychiatrist’s couch out of business. The Economist. Retrieved from http://www.economist.com/node/18276234.

  • Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models (p. 648). New York: Cambridge University Press. Retrieved from http://www.amazon.com/Analysis-Regression-Multilevel-Hierarchical-Models/dp/052168689X.

  • Hakamata, Y., Lissek, S., Bar-Haim, Y., Britton, J. C., Fox, N. A., Leibenluft, E., et al. (2010). Attention bias modification treatment: A meta-analysis toward the establishment of novel treatment for anxiety. Biological Psychiatry. doi:10.1016/j.biopsych.2010.07.021.

  • Hakamata, Y., Lissek, S., Bar-Haim, Y., Britton, J. C., Fox, N. A., Leibenluft, E., et al. (2012). Erratum: Attention bias modification treatment: A meta-analysis toward the establishment of novel treatment for anxiety. Biological Psychiatry, 72(5), 429. doi:10.1016/j.biopsych.2012.07.015.

    Article  Google Scholar 

  • Hallion, L. S., & Ruscio, A. M. (2011). A meta-analysis of the effect of cognitive bias modification on anxiety and depression. Psychological Bulletin, 137(6), 940–958. doi:10.1037/a0024355.

    Article  PubMed  Google Scholar 

  • Hedman, E., Ljótsson, B., Rück, C., Furmark, T., Carlbring, P., Lindefors, N., et al. (2010). Internet administration of self-report measures commonly used in research on social anxiety disorder: A psychometric evaluation. Computers in Human Behavior, 26(4), 736–740. doi:10.1016/j.chb.2010.01.010.

    Article  Google Scholar 

  • Heeren, A., Reese, H. E., McNally, R. J., & Philippot, P. (2012). Attention training toward and away from threat in social phobia: Effects on subjective, behavioral, and physiological measures of anxiety. Behaviour Research and Therapy, 50(1), 30–39. doi:10.1016/j.brat.2011.10.005.

    Article  PubMed  Google Scholar 

  • Heimberg, R. G., Mueller, G. P., Holt, C. S., Hope, D. A., & Liebowitz, M. R. (1992). Assessment of anxiety in social interaction and being observed by others: The social interaction anxiety scale and the Social Phobia Scale. Behavior Therapy, 23(1), 53–73. doi:10.1016/S0005-7894(05)80308-9.

    Article  Google Scholar 

  • Li, S., Tan, J., Qian, M., & Liu, X. (2008). Continual training of attentional bias in social anxiety. Behaviour Research and Therapy, 46(8), 905–912. doi:10.1016/j.brat.2008.04.005.

    Article  PubMed  Google Scholar 

  • Liebowitz, M. R. (1987). Social phobia. Modern Problems of Pharmacopsychiatry, 22, 141–173.

    CAS  PubMed  Google Scholar 

  • Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the Depression Anxiety Stress Scales (2nd ed.). Sydney: Psychology Foundation.

    Google Scholar 

  • MacLeod, C. (1995). Training selective attention: A cognitive-experimental technique for reducing anxiety vulnerability? In World congress of behavioural and cognitive therapies (p. 118).

  • MacLeod, C., Mathews, A., & Tata, P. (1986). Attentional bias in emotional disorders. Journal of Abnormal Psychology, 95(1), 15–20. doi:10.1037/0021-843X.95.1.15.

    Article  CAS  PubMed  Google Scholar 

  • MacLeod, C., Rutherford, E., Campbell, L. W., Ebsworthy, G., & Holker, L. (2002). Selective attention and emotional vulnerability: Assessing the causal basis of their association through the experimental manipulation of attentional bias. Journal of Abnormal Psychology, 111(1), 107–123. doi:10.1037/0021-843X.111.1.107.

    Article  PubMed  Google Scholar 

  • MacLeod, C., Soong, L. Y., Rutherford, E. M., & Campbell, L. W. (2007). Internet-delivered assessment and manipulation of anxiety-linked attentional bias: Validation of a free-access attentional probe software package. Behavior Research Methods, 39(3), 533–538. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/17958165.

    Google Scholar 

  • Matsumoto, D., & Ekman, P. (1988). Japanese and Caucasian Facial Expressions of Emotion (JACFEE) and Neutral Faces (JACNeuF). San Francisco, CA: Intercultural and Emotion Research Laboratory, Department of Psychology, San Francisco State University.

  • Mattick, R., & Clarke, J. C. (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36(4), 455–470. doi:10.1016/S0005-7967(97)10031-6.

    Article  CAS  PubMed  Google Scholar 

  • McNally, R. J., Enock, P. M., Tsai, C., & Tousian, M. (2013). Attention bias modification for reducing speech anxiety. Behaviour Research and Therapy, 51(12), 882–888. doi:10.1016/j.brat.2013.10.001.

    Article  PubMed  Google Scholar 

  • Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990). Development and validation of the Penn State Worry Questionnaire. Behaviour Research and Therapy, 28(6), 487–495. doi:10.1016/0005-7967(90)90135-6.

    Article  CAS  PubMed  Google Scholar 

  • Neubauer, K., von Auer, M., Murray, E., Petermann, F., Helbig-Lang, S., & Gerlach, A. L. (2013). Internet-delivered attention modification training as a treatment for social phobia: A randomized controlled trial. Behaviour Research and Therapy, 51(2), 87–97. doi:10.1016/j.brat.2012.10.006.

    Article  PubMed  Google Scholar 

  • Pinheiro, J., Bates, D., DebRoy, S., & Sarkar, D. (2010). nlme: Linear and nonlinear mixed effects models. Vienna: R Foundation for Statistical Computing. Retrieved from http://cran.r-project.org/web/packages/nlme.

  • R Development Core Team. (2012). R: A language and environment for statistical computing. Vienna. Retrieved from http://www.r-project.org/.

  • Rodebaugh, T. L., Woods, C. M., & Heimberg, R. G. (2007). The reverse of social anxiety is not always the opposite: The reverse-scored items of the social interaction anxiety scale do not belong. Behavior Therapy, 38(2), 192–206. doi:10.1016/j.beth.2006.08.001.

    Article  PubMed  Google Scholar 

  • Rytwinski, N. K., Fresco, D. M., Heimberg, R. G., Coles, M. E., Liebowitz, M. R., & Cissell, S. (2009). Screening for social anxiety disorder with the self-report version of the Liebowitz Social Anxiety Scale. Depression and Anxiety, 26(1), 34–38. doi:10.1002/da.20503.

    Article  PubMed  Google Scholar 

  • Sawyer, A. T., Whitfield-Gabrieli, S., Gabrieli, J. D. E., Amir, N., Fang, A., Richey, A., et al. (2012). Attention retraining in SAD: Treatment outcome and neurobiological correlates. In A. Asnaani & A. T. Sawyer (Chairs), Modifying cognitive biases: Emerging data on applications and effects on clinical disorders. Symposium conducted at the meeting of The Association of Behavioral and Cognitive Therapies, National Harbor, MD.

  • Schmidt, N. B., Richey, J. A., Buckner, J. D., & Timpano, K. R. (2009). Attention training for generalized social anxiety disorder. Journal of Abnormal Psychology, 118(1), 5–14. doi:10.1037/a0013643.

    Article  PubMed  Google Scholar 

  • Schmukle, S. C. (2005). Unreliability of the dot probe task. European Journal of Personality, 19(7), 595–605. doi:10.1002/per.554.

    Article  Google Scholar 

  • SPSS Inc. (2009). PASW Statistics for Windows, Version 18.0. Chicago: SPSS Inc. http://www-01.ibm.com/support/docview.wss?uid=swg21476197

  • Staugaard, S. R. (2009). Reliability of two versions of the dot-probe task using photographic faces. Psychology Science Quarterly, 51(3), 339–350.

    Google Scholar 

  • Ulrich, R., & Giray, M. (1989). Time resolution of clocks: Effects on reaction time measurement-Good news for bad clocks. British Journal of Mathematical and Statistical Psychology, 42(1), 1–12. doi:10.1111/j.2044-8317.1989.tb01111.x.

    Article  Google Scholar 

  • Waechter, S., Nelson, A. L., Wright, C., Hyatt, A., & Oakman, J. (2013). Measuring attentional bias to threat: Reliability of dot probe and eye movement indices. Cognitive Therapy and Research. doi:10.1007/s10608-013-9588-2.

  • Wald, I., Lubin, G., Holoshitz, Y., Muller, D., Fruchter, E., Pine, D. S., et al. (2011). Battlefield-like stress following simulated combat and suppression of attention bias to threat. Psychological Medicine, 41(4), 699–707. doi:10.1017/S0033291710002308.

    Article  CAS  PubMed  Google Scholar 

  • Watson, D., & Friend, R. (1969). Measurement of social-evaluative anxiety. Journal of Consulting and Clinical Psychology, 33(4), 448–457. doi:10.1037/h0027806.

    Article  CAS  PubMed  Google Scholar 

  • Wells, T., & Beevers, C. G. (2010). Biased attention and dysphoria: Manipulating selective attention reduces subsequent depressive symptoms. Cognition and Emotion, 24(4), 719–728. doi:10.1080/02699930802652388.

    Article  Google Scholar 

  • Zlomke, K. R. (2009). Psychometric properties of internet administered versions of Penn State Worry Questionnaire (PSWQ) and Depression, Anxiety, and Stress Scale (DASS). Computers in Human Behavior, 25(4), 841–843. doi:10.1016/j.chb.2008.06.003.

    Article  Google Scholar 

Download references

Acknowledgments

The authors thank Imke Vonk, Linh Vu, and Jennifer Yu for their assistance, primarily in data collection.

Conflict of Interest

Philip M. Enock, Stefan G. Hofmann and Richard J. McNally declare that they have no conflict of interest.

Informed Consent

All participants signed up through the website, which described the study in an easy-to-read format (Online Supplement 1). They electronically provided consent after going through these pages and a detailed consent form. All procedures were approved by Harvard’s Committee on the Use of Human Subjects in Research.

Animal Rights

No animal studies were carried out by the authors for this article.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Philip M. Enock.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (PDF 837 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Enock, P.M., Hofmann, S.G. & McNally, R.J. Attention Bias Modification Training Via Smartphone to Reduce Social Anxiety: A Randomized, Controlled Multi-Session Experiment. Cogn Ther Res 38, 200–216 (2014). https://doi.org/10.1007/s10608-014-9606-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10608-014-9606-z

Keywords

Navigation