Journal of Child and Family Studies

, Volume 27, Issue 6, pp 1830–1843 | Cite as

A Multi-Informant Approach to Assessing Safety Behaviors among Adolescents: Psychometric Properties of the Subtle Avoidance Frequency Examination

  • Noor Qasmieh
  • Bridget A. Makol
  • Tara M. Augenstein
  • Melanie F. Lipton
  • Danielle E. Deros
  • Jeremy N. Karp
  • Lauren M. Keeley
  • Michelle L. Truong
  • Sarah J. Racz
  • Andres De Los ReyesEmail author
Original Paper


Safety behaviors are subtle avoidance strategies for minimizing distress within social situations (e.g., avoidance of eye contact). These behaviors factor prominently in the development and maintenance of social anxiety concerns, and when patients use these behaviors within psychosocial treatments for social anxiety, this may impede treatment response. Prior work supports the need to include measures of safety behaviors within evidence-based assessments of social anxiety. Along these lines, researchers developed the Subtle Avoidance Frequency Examination (SAFE) to assess safety behaviors among adults. However, we know relatively little about the SAFE’s psychometric properties when administered to adolescents. We tested the SAFE’s psychometric properties using adolescent self-reports and parallel parent reports in a mixed-clinical/community sample of 96 14 to 15 year-old adolescents and their parents (33 clinic-referred; 63 community control; 59.4% African American). Adolescent and parent SAFE reports displayed moderate correspondence with each other. Both adolescent and parent SAFE reports related positively to well-established measures of adolescent social anxiety and depressive symptoms. Both reports distinguished adolescents on referral status as well as cut scores on well-established measures of adolescent social anxiety. Further, both adolescent and parent SAFE reports displayed incremental validity in relation to survey reports of adolescent social anxiety, over-and-above survey reports of adolescent depressive symptoms, which commonly co-occur with social anxiety. However, adolescent (but not parent) SAFE reports predicted adolescents’ social anxiety and state arousal as displayed within social interactions with unfamiliar peer confederates. These findings have important implications for leveraging multi-informant approaches to assessing safety behaviors among adolescents.


Adolescents Multiple informants Safety behaviors Social anxiety Subtle Avoidance Frequency Examination 



This work was supported, in part, by an internal grant from the University of Maryland at College Park (College of Behavioral and Social Sciences Dean’s Research Initiative) awarded to the last author.

Author Contributions

N.Q.: assisted in executing the study, assisted with data analyses, and wrote the paper. B.A.M.: assisted with data analyses and collaborated in editing the paper. T.M.A. and M.F.L.: collaborated with the design of the study, executed the study, and collaborated in editing the paper. D.E.D., J.N.K., and L.M.K.: assisted in executing the study and collaborated in editing the paper. M.L.T. and S.J.R.: collaborated in editing the paper. A.D.L.R.: designed the study, assisted with data analyses, and wrote the paper.

Compliance with Ethical Standards

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the University of Maryland at College Park’s Institutional Review Board and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.


  1. Alden, L. E. & Bieling, P. (1998). Interpersonal consequences of the pursuit of safety. Behaviour Research and Therapy, 36(1), 53–64. Scholar
  2. Alfano, C. A., & Beidel, D. C. (2011). Social anxiety in adolescents and young adults: translating developmental science into practice. Washington, DC: American Psychological Association.CrossRefGoogle Scholar
  3. American Psychiatric Association (2013). Social anxiety disorder (social phobia). In Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.Google Scholar
  4. Anderson, E. R., & Hope, D. A. (2009). The relationship among social phobia, objective and perceived physiological reactivity, and anxiety sensitivity in an adolescent population. Journal of Anxiety Disorders, 23(1), 18–26. Scholar
  5. Beck, A. T., Steer, R. A., Ball, R., & Ranieri, W. F. (1996). Comparison of Beck Depression Inventories-IA and-II in psychiatric outpatients. Journal of Personality Assessment, 67(3), 588–597. Scholar
  6. Beidel, D. C., Rao, P. A., Scharfstein, L., Wong, N., & Alfano, C. A. (2010). Social skills and social phobia: an investigation of DSM-IV subtypes. Behaviour Research and Therapy, 48(10), 992–1001. Scholar
  7. Beidel, D. C., Turner, S. M., Hamlin, K. & Morris, T. L. (2000a). The Social Phobia and Anxiety Inventory for Children (SPAI-C): external and discriminative validity. Behavior Therapy, 31(1), 75–87. Scholar
  8. Beidel, D. C., Turner, S. M. & Morris, T. L. (1995). A new inventory to assess childhood social anxiety and phobia: the Social Phobia and Anxiety Inventory for Children. Psychological Assessment, 7(1), 73–79. Scholar
  9. Beidel, D. C., Turner, S. M. & Morris, T. L. (2000b). Behavioral treatment of childhood social phobia. Journal of Consulting and Clinical Psychology, 68(6), 1072–1080. Scholar
  10. Bögels, S. M., Alden, L., Beidel, D. C., Clark, L. A., Pine, D. S., Stein, M. B., & Voncken, M. (2010). Social anxiety disorder: questions and answers for the DSM‐V. Depression and Anxiety, 27(2), 168–189. Scholar
  11. Clark, D. M. (2005). A cognitive perspective on social phobia. In W. R. Crozier, & L. E. Alden (Eds.), The essential handbook of social anxiety for clinicians (pp. 193–218). England: John Wiley & Sons.Google Scholar
  12. Clark, D. M. & McManus, F. (2002). Information processing in social phobia. Biological Psychiatry, 51(1), 92–100. Scholar
  13. Clark, D. M. & Wells, A. (1995). A cognitive model of social phobia. In R. G. Heimberg, M. R. Liebowitz, D. A. Hope, & F. R. Schneier (Eds.), Social phobia (pp. 69–93). New York: The Guilford Press.Google Scholar
  14. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. 2nd ed. Mahwah, NJ: Erlbaum.Google Scholar
  15. Cuming, S., Rapee, R. M., Kemp, N., Abbott, M. J., Peters, L., & Gaston, J. E. (2009). A self-report measure of subtle avoidance and safety behaviors relevant to social anxiety: development and psychometric properties. Journal of Anxiety Disorders, 23(7), 879–883. Scholar
  16. Curran, J. P. (1982). A procedure for the assessment of social skills: the Simulated Social Interaction Test. In J. P. Curran, P. M. Monti (Eds.), Social skills training: a practical handbook for assessment and treatment (pp. 348–373). New York, NY: Guilford.Google Scholar
  17. De Los Reyes, A., Alfano, C. A., & Beidel, D. C. (2010). The relations among measurements of informant discrepancies within a multisite trial of treatments for childhood social phobia. Journal of Abnormal Child Psychology, 38(3), 395–404. Scholar
  18. De Los Reyes, A., Alfano, C. A., & Beidel, D. C. (2011). Are clinicians’ assessments of improvements in children’s functioning “global”? Journal of Clinical Child & Adolescent Psychology, 40(2), 281–294. Scholar
  19. De Los Reyes, A., Aldao, A., Thomas, S. A., Daruwala, S., Swan, A. J., & Van Wie, M., et al. (2012). Adolescent self-reports of social anxiety: can they disagree with objective psychophysiological measures and still be valid? Journal of Psychopathology and Behavioral Assessment, 34(3), 308–322. Scholar
  20. De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A., Burgers, D. E., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141(4), 858–900. Scholar
  21. De Los Reyes, A., Bunnell, B. E., & Beidel, D. C. (2013a). Informant discrepancies in adult social anxiety disorder assessments: links with contextual variations in observed behavior. Journal of Abnormal Psychology, 122(2), 376–386. Scholar
  22. De Los Reyes, A., Henry, D. B., Tolan, P. H., & Wakschlag, L. S. (2009). Linking informant discrepancies to observed variations in young children’s disruptive behavior. Journal of Abnormal Child Psychology, 37(5), 637–652. Scholar
  23. De Los Reyes, A., Thomas, S. A., Goodman, K. L., & Kundey, S. M. (2013b). Principles underlying the use of multiple informants’ reports. Annual Review of Clinical Psychology, 9, 123–149. Scholar
  24. Deros, D. E., Racz, S. J., Lipton, M. F., Augenstein, T. M., Karp, J. N. & Keeley, L. M. et al (2018). Multi-informant assessments of adolescent social anxiety: adding clarity by leveraging reports from unfamiliar peer confederates. Behavior Therapy, 49(1), 84–89. Scholar
  25. Grant, B. F., Hasin, D. S., Blanco, C., Stinson, F. S., Chou, S. P., & Goldstein, R. B., et al. (2005). The epidemiology of social anxiety disorder in the United States: results from the National Epidemiologic Survey on alcohol and related conditions. Journal of Clinical Psychiatry, 66(11), 1351–1361. Scholar
  26. Hedtke, K. A., Kendall, P. C., & Tiwari, S. (2009). Safety seeking and coping behavior during exposure tasks with anxious youth. Journal of Clinical Child and Adolescent Psychology, 38(1), 1–15. Scholar
  27. Heimberg, R. G. (2002). Cognitive-behavioral therapy for social anxiety disorder: current status and future directions. Biological Psychiatry, 51(1), 101–108. Scholar
  28. Heimberg, R. M. & Juster, H. R. (1995). Cognitive behavioral treatments: literature review. In R. G. Heimberg, M. R. Liebowitz, D. A. Hope, F. R. Schneier (Eds.), Social phobia: diagnosis, assessment, and treatment (pp. 41–66). New York: The Guilford Press.Google Scholar
  29. Hodson, K. J., McManus, F. V., Clark, D. M., & Doll, H. (2008). Can Clark and Wells’ (1995) cognitive model of social phobia be applied to young people?. Behavioural and Cognitive Psychotherapy, 36(4), 449–461. Scholar
  30. Hofmann, S. (2007). Cognitive factors that maintain social anxiety disorder: a comprehensive model and its treatment implications. Cognitive Behaviour Therapy, 36(4), 193–209. Scholar
  31. Karp, J. N., Makol, B. A., Keeley, L. M., Qasmieh, N., Deros, D. E., & Weeks, J. W. et al. (2018). Convergent, incremental, and criterion-related validity of multi-informant assessments of adolescents’ fears of negative and positive evaluation. Clinical Psychology and Psychotherapy.
  32. Keeley, L. M., Makol, B. A., Qasmieh, N., Deros, D. E., Karp, J. N., Lipton, M. F. et al. (2018). Validity of adolescent and parent reports on the six-item ADHD Self-Report Scale (ASRS-6) in clinical assessments of adolescent social anxiety. Journal of Child and Family Studies, 27.
  33. Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Waters, E. E. (2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry, 62(6), 593–602. Scholar
  34. Kim, E.-J. (2005). The effect of the decreased safety behaviors on anxiety and negative thoughts in social phobics. Journal of Anxiety Disorders, 19(1), 69–86. Scholar
  35. Kley, H., Tuschen-Caffier, B. & Heinrichs, N. (2012). Safety behaviors, self-focused attention and negative thinking in children with social anxiety disorder, socially anxious and non-anxious children. Journal of Behavior Therapy and Experimental Psychiatry, 43(1), 548–555. Scholar
  36. Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boyce, W. T. & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: mixing and matching contexts and perspectives. American Journal of Psychiatry, 160(9), 1566–1577. Scholar
  37. Lang, P. J. (1980). Behavioral treatment and bio-behavioral assessment: computer applications. In J. B. Sidowski, J. H. Johnson, T. A. Williams (Eds.), Technology in mental health care delivery systems (pp. 119–137). Norwood, NJ: Ablex.Google Scholar
  38. Lerner, M. D., De Los Reyes, A., Drabick, D. A. G., Gerber, A. H., & Gadow, K. D. (2017). Informant discrepancy defines discrete, clinically useful autism spectrum disorder subgroups. Journal of Child Psychology and Psychiatry, 58(7), 829–839. Scholar
  39. Lipton, M. F., Augenstein, T. M., Weeks, J. W., & De Los Reyes, A. (2014). A multi-informant approach to assessing fear of positive evaluation in socially anxious adolescents. Journal of Child and Family Studies, 23(7), 1247–1257. Scholar
  40. Mattick, R. P. & Clarke, J. C. (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36(4), 455–470. Scholar
  41. McManus, F., Sacadura, C., & Clark, D. M. (2008). Why social anxiety persists: an experimental investigation of the role of safety behaviors as a maintaining factor. Journal of Behavior Therapy and Experimental Psychiatry, 39(2), 147–161. Scholar
  42. Meleshko, K. G., & Alden, L. E. (1993). Anxiety and self-disclosure: toward a motivational model. Journal of Personality and Social Psychology, 64(6), 1000–1009. Scholar
  43. Morgan, H., & Raffles, C. (1999). Does reducing safety behaviours improve treatment response in patients with social phobia? Australian and New Zealand Journal of Psychiatry, 33(4), 503–510. Scholar
  44. Morrison, A. S. & Heimberg, R. G. (2013). Social anxiety and social anxiety disorder. Annual Review of Clinical Psychology, 9, 249–274. Scholar
  45. Piacentini, J. C., Cohen, P., & Cohen, J. (1992). Combining discrepant diagnostic information from multiple sources: are complex algorithms better than simple ones? Journal of Abnormal Child Psychology, 20(1), 51–63. Scholar
  46. Piccirillo, M. L., Dryman, M. T., & Heimberg, R. G. (2016). Safety behaviors in adults with social anxiety: review and future directions. Behavior Therapy, 47(5), 675–687. Scholar
  47. Porges, S. W. (1997). Emotion: an evolutionary by‐product of the neural regulation of the autonomic nervous system. Annals of the New York Academy of Sciences, 807(1), 62–77. Scholar
  48. Rapee, R. M. (1995). Descriptive psychopathology of social phobia. In R. G. Heimberg, M. R. Liebowitz, D. A. Hope, F. R. Schneier (Eds.), Social phobia: diagnosis, assessment, and treatment (pp. 41–66). New York: The Guilford Press.Google Scholar
  49. Rapee, R. M., Gaston, J. E., & Abbott, M. J. (2009). Testing the efficacy of theoretically derived improvements in the treatment of social phobia. Journal of Consulting and Clinical Psychology, 77(2), 317–327. Scholar
  50. Rapee, R. M. & Heimberg, R. G. (1997). A cognitive-behavioral model of anxiety in social phobia. Behavior Research and Therapy, 35(8), 741–756. Scholar
  51. Rausch, E., Racz, S. J., Augenstein, T. M., Keeley, L., Lipton, M. F., & Szollos, S., et al. (2017). A multi-informant approach to measuring depressive symptoms in clinical assessments of adolescent social anxiety using the Beck Depression Inventory-II: convergent, incremental, and criterion-related validity. Child and Youth Care Forum, 46(5), 661–683. Scholar
  52. Rowa, K., Paulitzki, J. R., Ierullo, M. D., Chiang, B., Antony, M. M., McCabe, R. E., & Moscovitch, D. A. (2015). A false sense of security: safety behaviors erode objective speech performance in individuals with social anxiety disorder. Behaviour Therapy, 46(3), 304–314. Scholar
  53. Salkovskis, P. M. (1991). The importance of behaviour in the maintenance of anxiety and panic: a cognitive account. Behavioural and Cognitive Psychotherapy, 19(1), 6–19. Scholar
  54. Salkovskis, P. M., Clark, D. M. & Gelder, M. G. (1996). Cognition-behaviour links in the persistence of panic. Behaviour Research and Therapy, 34(5), 453–458. Scholar
  55. Silverman, W. K., Pina, A. A., & Viswesvaran, C. (2008). Evidence-based psychosocial treatments for phobic and anxiety disorders in children and adolescents. Journal of Clinical Child & Adolescent Psychology, 37(1), 105–130. Scholar
  56. Sloan, T. & Telch, M. J. (2002). The effects of safety-seeking behavior and guided threat reappraisal on fear reduction during exposure: an experimental investigation. Behaviour Research and Therapy, 40(3), 235–251. Scholar
  57. Stangier, U., Heidenreich, T., & Schermelleh-Engel, K. (2006). Safety behaviors and social performance in patients with generalized social phobia. Journal of Cognitive Psychotherapy, 20(1), 17–31. Scholar
  58. Stein, M. B. & Stein, D. J. (2008). Social anxiety disorder. The Lancet, 371(9618), 1115–1125. Scholar
  59. Steer, R. A., Kumar, G., Ranieri, W. F., & Beck, A. T. (1998). Use of the Beck Depression Inventory-II with adolescent psychiatric outpatients. Journal of Psychopathology and Behavioral Assessment, 20(2), 127–137. Scholar
  60. Storch, E. A., Masia-Warner, C., Dent, H. C., Roberti, J. W., & Fisher, P. H. (2004). Psychometric evaluation of the Social Anxiety Scale for Adolescents and the Social Phobia and Anxiety Inventory for Children: construct validity and normative data. Journal of Anxiety Disorders, 18(5), 665–679. Scholar
  61. Taylor, C. T., & Alden, L. E. (2010). Safety behaviors and judgmental biases in social anxiety disorder. Behaviour Research and Therapy, 48(3), 226–237. Scholar
  62. Thomas, S. A., Aldao, A., & De Los Reyes, A. (2012b). Implementing clinically feasible psychophysiological measures in evidence-based assessments of adolescent social anxiety. Professional Psychology: Research and Practice, 43(5), 510–519. Scholar
  63. Thomas, S. A., Daruwala, S. E., Goepel, K. A., & De Los Reyes, A. (2012). Using the Subtle Avoidance Frequency Examination examination in adolescent social anxiety assessments. Child and Youth Care Forum, 41(6), 547–559. Scholar
  64. Thomas, S. A., Weeks, J. W., Dougherty, L. R., Lipton, M. F., Daruwala, S. E., Kline, K. & De Los Reyes, A. (2015). Allelic variation of risk for anxiety symptoms moderates the relation between adolescent safety behaviors and social anxiety symptoms. Journal of Psychopathology and Behavioral Assessment, 37(4), 597–610. Scholar
  65. Thwaites, R. & Freeston, M. (2005). Safety-seeking behaviours: fact or function? How can we clinically differentiate between safety behaviours and adaptive coping strategies across anxiety disorders?. Behavioural and Cognitive Psychotherapy, 33(2), 177–188. Scholar
  66. Turner, S. M., Beidel, D. C., Cooley, M. R., Woody, S. R., & Messer, S. C. (1994). A multicomponent behavioral treatment for social phobia: Social Effectiveness Therapy. Behaviour Research and Therapy, 32(4), 381–390. Scholar
  67. Wells, A., Clark, D. M., Salkovskis, P., Ludgate, J., Hackmann, A., & Gelder, M. (1995). Social phobia: the role of in-situation safety behaviors in maintaining anxiety and negative beliefs. Behavior Therapy, 26(1), 153–161. Scholar
  68. Youngstrom, E. A., Findling, R. L., & Calabrese, J. R. (2003). Who are the comorbid adolescents? Agreement between psychiatric diagnosis, youth, parent, and teacher report. Journal of Abnormal Child Psychology, 31(3), 231–245. Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Noor Qasmieh
    • 1
  • Bridget A. Makol
    • 1
  • Tara M. Augenstein
    • 1
  • Melanie F. Lipton
    • 1
  • Danielle E. Deros
    • 1
  • Jeremy N. Karp
    • 1
  • Lauren M. Keeley
    • 1
  • Michelle L. Truong
    • 1
  • Sarah J. Racz
    • 1
  • Andres De Los Reyes
    • 1
    Email author
  1. 1.Comprehensive Assessment and Intervention Program, Department of PsychologyUniversity of MarylandCollege ParkUSA

Personalised recommendations