Skip to main content

Advertisement

SpringerLink
Log in

Psychometric Properties of the Response to Anxiety Questionnaire

  • Published:
Journal of Psychopathology and Behavioral Assessment Aims and scope Submit manuscript

Abstract

Recent research highlights the importance of transdiagnostic factors of psychopathology, particularly in understanding comorbidity. Repetitive negative thinking (RNT) is one such factor, which may elucidate anxiety-depression comorbidity. The Response to Anxiety Questionnaire (RAQ) aims to evaluate repetitive negative thinking (RNT) related to anxiety-depression comorbidity, specifically hopelessness and rumination about anxiety symptoms. Anxious hopelessness is negative thoughts about the future due to anxiety symptoms, and anxious rumination includes negative evaluations of the meaning of anxiety symptoms, therefore the current study assessed the RAQ in three studies. We used exploratory and confirmatory factor analysis methodologies to examine the factor structure of the RAQ. In addition, we tested indirect effects of the two factors of RAQ (Rumination and Hopelessness) between anxiety and depression, and tested measure convergent validity. Results of the current study provide additional support for the psychometric properties of the RAQ, suggesting a two factor makeup (hopelessness, rumination), as well as its use in predicting anxiety and depressive symptoms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Abramson, L. Y., Metalsky, G. I., & Alloy, L. B. (1989). Hopelessness depression: a theory-based subtype of depression. Psychological Review, 96(2), 358–372.

  • Abramson, L. Y., Alloy, L. B., Hogan, M. E., Whitehouse, W. G., Gibb, B. E., Hankin, B. L., & Cornette, M. M. (2000). The hopelessness theory of suicidality. In T. E. Joiner & M. D. Rudd (Eds.), Suicide Science (pp. 17–32). Boston: Kluwer Academic Publishing.

    Google Scholar 

  • Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B. N. Petrov & F. Csaki (Eds.), Proceedings of the second international symposium on information theory (pp. 267–281). Budapest: Akademiai Kiado.

    Google Scholar 

  • Alloy, L. B., Kelly, K. A., Mineka, S., & Clements, C. M. (1990). Comorbidity of anxiety and depressive disorders: A helplessness/hopelessness perspective. In J. D. Maser & C. R. Cloninger (Eds.), Comorbidity of anxiety and mood disorders. Washington, D.C.: American Psychiatric Press.

    Google Scholar 

  • Asparouhov, T., & Muthén, B. (2010). Simple second order Chi square correction. Technical report. www.statmodel.com.

  • Behar, E., Alcaine, O., Zuellig, A. R., & Borkovec, T. D. (2003). Screening for generalized anxiety disorder using the Penn State Worry Questionnaire: A receiver operating characteristic analysis. Journal of Behavior Therapy and Experimental Psychiatry, 34(1), 25–43.

    Article  PubMed  Google Scholar 

  • Bentler, P. M. (1992). On the fit of models to covariances and methodology to the bulletin. Psychological Bulletin, 112, 400–404. https://doi.org/10.1037//0033-2909.112.3.400

    Article  PubMed  Google Scholar 

  • Brown, T. A. (2014). Confirmatory factor analysis for applied research. New York, NY: Guilford Publications.

  • Brown, T. A., Campbell, L. A., Lehman, C. L., Grisham, J. R., & Mancill, R. B. (2001). Current and lifetime comorbidity of the DSM-IV anxiety and mood disorders in a large clinical sample. Journal of Abnormal Psychology, 110(4), 585–599.

    Article  PubMed  Google Scholar 

  • Cohen, J. R., Young, J. F., Gibb, B. E., Hankin, B. L., & Abela, J. R. (2014). Why are anxiety and depressive symptoms comorbid in youth? A multi-wave, longitudinal examination of competing etiological models. Journal of Affective Disorders, 161, 21–29.

    Article  PubMed  PubMed Central  Google Scholar 

  • Comrey, A. L. & Lee, H. B. (1992). A first course in factor analysis. A.L. Comrey & H.B. Lee. (Eds.) New York, NY: Lawrence Erlbaum Associates.

  • Derryberry, D., & Reed, M. A. (2002). Anxiety-related attentional biases and their regulation by attentional control. Journal of Abnormal Psychology, 111(2), 225–236. https://doi.org/10.1037/0021-843X.111.2.225

    Article  PubMed  Google Scholar 

  • Ehring, T., & Watkins, E. R. (2008). Repetitive negative thinking as a transdiagnostic process. International Journal of Cognitive Therapy, 1(3), 192–205. https://doi.org/10.1521/ijct.2008.1.3.192

    Article  Google Scholar 

  • Eysenck, M. W., Derakshan, N., Santos, R., & Calvo, M. G. (2007). Anxiety and cognitive performance: attentional control theory. Emotion, 7(2), 336.

    Article  PubMed  Google Scholar 

  • Fresco, D. M., Mennin, D. S., Heimberg, R. G., & Turk, C. L. (2003). Using the Penn State Worry Questionnaire to identify individuals with generalized anxiety disorder: A receiver operating characteristic analysis. Journal of Behavior Therapy and Experimental Psychiatry, 34(3–4), 283–291.

  • Fritz, M. S., & MacKinnon, D. P. (2007). Required sample size to detect the mediated effect. Psychological Science, 18(3), 233–239.

    Article  PubMed  PubMed Central  Google Scholar 

  • Garrido, L. E., Abad, F. J., & Ponsoda, V. (2016). Are fit indices really fit to estimate the number of factors with categorical variables? Some cautionary findings via Monte Carlo simulation. Psychological Methods, 21(1), 93. https://doi.org/10.1037/met0000064

    Article  PubMed  Google Scholar 

  • Grant, D. M., Beck, G. J., Farrow, S. M., & Davila, J. (2007). Do interpersonal features of social anxiety influence the development of depressive symptoms? Cognition and Emotion, 21(3), 646–663.

    Article  Google Scholar 

  • Grant, D. M., Judah, M. R., Mills, A. C., Lechner, W. V., Davidson, C. L., & Wingate, L. R. (2014). Rumination and excessive reassurance seeking: Mediators of the relationship between social anxiety and depression? Journal of Psychopathology and Behavioral Assessment, 36(3), 465–474. https://doi.org/10.1007/s10862-013-9399-5

    Article  Google Scholar 

  • Hayes, A. F. (2013). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. New York: Guilford Press.

    Google Scholar 

  • Hayes, A. F., & Rockwood, N. J. (2016). Regression-based statistical mediation and moderation analysis in clinical research: observations, recommendations, and implementation. Behavior Research and Therapy. https://doi.org/10.1016/j.brat.2016.11.001

  • Horn, J. L. (1965). A rationale and test for the number of factors in a factor analysis. Psychometrika, 30, 179–185. https://doi.org/10.1007/BF02289447

    Article  PubMed  Google Scholar 

  • Houck, P. R., Spiegel, D. A., Shear, M. K., & Paola Rucci, D. S. (2002). Reliability of the self-report version of the panic disorder severity scale. Depression and Anxiety, 15, 183–185. https://doi.org/10.1002/da.10049

    Article  PubMed  Google Scholar 

  • Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/10705519909540118

    Article  Google Scholar 

  • Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., & Wang, P. (2010). Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. American Journal of Psychiatry, 167(7), 748–751

  • Jacobson, N. C., & Newman, M. G. (2014). Avoidance mediates the relationship between anxiety and depression over a decade later. Journal of Anxiety Disorders, 28(5), 437–445. https://doi.org/10.1016/j.janxdis.2014.03.007

    Article  PubMed  PubMed Central  Google Scholar 

  • Johansson, R., Carlbring, P., Heedman, Å., Paxling, B., & Andersson, G. (2013). Depression, anxiety and their comorbidity in the Swedish general population: point prevalence and the effect on health-related quality of life. PeerJ, 1, e98. https://doi.org/10.7717/peerj.98

    Article  PubMed  PubMed Central  Google Scholar 

  • Joiner, T. E., Wingate, L. R., & Otamendi, A. (2005). An interpersonal addendum to the hopelessness theory of depression: hopelessness as a stress and depression generator. Journal of Social and Clinical Psychology, 24(5), 649–664. https://doi.org/10.1521/jscp.2005.24.5.649

    Article  Google Scholar 

  • Jöreskog, K. G. (1999). How large can a standardized coefficient be. Unpublished Technical Report. Retrieved from: http://www.ssicentral.com/lisrel/techdocs/HowLargeCanaStandardizedCoefficientbe.pdf.

  • Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed.). New York: The Guilford Press.

    Google Scholar 

  • Koster, E. H., De Lissnyder, E., Derakshan, N., & De Raedt, R. (2011). Understanding depressive rumination from a cognitive science perspective: the impaired disengagement hypothesis. Clinical Psychology Review, 31(1), 138–145. https://doi.org/10.1016/j.cpr.2010.08.005

    Article  PubMed  Google Scholar 

  • Krueger, R. F., & Eaton, N. R. (2015). Transdiagnostic factors of mental disorders. World Psychiatry, 14(1), 27–29. https://doi.org/10.1002/wps.20175

    Article  PubMed  PubMed Central  Google Scholar 

  • Lee, I. A. & Preacher, K. J. (2013). Calculation for the test of the difference between two dependent correlations with one variable in common [Computer software]. Available from http://quantpsy.org

  • Lenze, E. J., Mulsant, B. H., Mohlman, J., Shear, M. K., Dew, M. A., Schulz, R., & Reynolds, C. F. (2005). Generalized anxiety disorder in late life: lifetime course and comorbidity with major depressive disorder. The American Journal of Geriatric Psychiatry, 13(1), 77–80.

    Article  PubMed  Google Scholar 

  • MacCallum, R. C., Widaman, K. F., Preacher, K. J., & Hong, S. (2001). Sample size in factor analysis: the role of model error. Multivariate Behavioral Research, 36(4), 611–637.

    Article  PubMed  Google Scholar 

  • Mansell, W., Harvey, A., Watkins, E. R., & Shafran, R. (2008). Cognitive behavioral processes across psychological disorders: a review of the utility and validity of the transdiagnostic approach. International Journal of Cognitive Therapy, 1(3), 181–191. https://doi.org/10.1521/ijct.2008.1.3.181

    Article  Google Scholar 

  • Mattick, R. P., & Clarke, J. C. (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36, 455–470. https://doi.org/10.1016/S0005-7967(97)10031-6

    Article  PubMed  Google Scholar 

  • McEvoy, P. M., Watson, H., Watkins, E. R., & Nathan, P. (2013). The relationship between worry, rumination, and comorbidity: Evidence for repetitive negative thinking as a transdiagnostic construct. Journal of Affective Disorders, 151(1), 313–320. https://doi.org/10.1016/j.jad.2013.06.014

    Article  PubMed  Google Scholar 

  • McLean, C. P., Asnaani, A., Litz, B. T., & Hofmann, S. G. (2011). Gender differences in anxiety disorders: Prevalence, course of illness, comorbidity and burden of illness. Journal of Psychiatric Research, 45(8), 1027–1035. https://doi.org/10.1016/j.jpsychires.2011.03.006

    Article  PubMed  PubMed Central  Google Scholar 

  • Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in test of measurement invariance. Journal of Applied Psychology, 93(3), 568–592. https://doi.org/10.1037/0021-9010.93.3.568

    Article  PubMed  Google Scholar 

  • Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990). Development and validation of the Penn State worry questionnaire. Behaviour Research and Therapy, 28(6), 487–495. https://doi.org/10.1016/0005-7967(90)90135-6

    Article  PubMed  Google Scholar 

  • Mills, A. C., Grant, D. M., Lechner, W. V., & Judah, M. R. (2014). Relationship between trait repetitive negative thinking styles and symptoms of psychopathology. Personality and Individual Differences, 71, 19–24.

    Article  Google Scholar 

  • Muthen, B., & Kaplan, D. (1992). A comparison of some methodologies for the factor analysis of non-normal Likert variables: a note on the size of the model. British Journal of Mathematical and Statistical Psychology, 45(1), 19–30. https://doi.org/10.1111/j.2044-8317.1992.tb00975.x

    Article  Google Scholar 

  • Muthén, L. K., & Muthén, B. O. (2007). Mplus. Statistical analysis with latent variables. Version, 3. New York, NY: Wiley.

  • Muthén, L. K., & Muthén, B. O. (2011). Mplus user's guide. Sixth edition. Los Angeles: Muthén & Muthén.

    Google Scholar 

  • Muthén, B., du Toit, S., & Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equation in latent variable modeling with categorical and continuous outcomes. Los Angeles: University of California.

  • Newman, M. G., & Llera, S. J. (2011). A novel theory of experiential avoidance in generalized anxiety disorder: a review and synthesis of research supporting a contrast avoidance model of worry. Clinical Psychology Review, 31(3), 371–382.

  • Norton, P. J., & Barrera, T. L. (2012). Transdiagnostic versus diagnosis-specific CBT for anxiety disorders: a preliminary randomized controlled noninferiority trial. Depression and Anxiety, 29(10), 874–882. https://doi.org/10.1002/da.21974

    Article  PubMed  PubMed Central  Google Scholar 

  • Norton, P. J., & Philipp, L. M. (2008). Transdiagnostic approaches to the treatment of anxiety disorders: A quantitative review. Psychotherapy, 45(2), 214–226. https://doi.org/10.1037/0033-3204.45.2.214

    Article  PubMed  Google Scholar 

  • Norton, P. J., Barrera, T. L., Mathew, A. R., Chamberlain, L. D., Szafranski, D. D., Reddy, R., & Smith, A. H. (2013). Effect of transdiagnostic CBT for anxiety disorders on comorbid diagnoses. Depression and Anxiety, 30(2), 168–173. https://doi.org/10.1002/da.22018

    Article  PubMed  Google Scholar 

  • O'Connor, B. P. (2000). SPSS, SAS, and MATLAB programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instruments, and Computers, 32, 396–402. https://doi.org/10.3758/BF03200807

    Article  PubMed  Google Scholar 

  • Penninx, B. W., Nolen, W. A., Lamers, F., Zitman, F. G., Smit, J. H., Spinhoven, P., et al. (2011). Two-year course of depressive and anxiety disorders: results from the Netherlands Study of Depression and Anxiety (NESDA). Journal of Affective Disorders, 133(1), 76–85. https://doi.org/10.1016/j.jad.2011.03.027

    Article  PubMed  Google Scholar 

  • Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1(3), 385–401. https://doi.org/10.1177/014662167700100306

    Article  Google Scholar 

  • Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696.

    Article  PubMed  PubMed Central  Google Scholar 

  • Reiss, S., Peterson, R., Gursky, D., & McNally, R. (1985). Anxiety sensitivity, anxiety frequency and the predictions of fearfulness. Behavior Research and Therapy, 24(1), 1–8. https://doi.org/10.1016/0005-7967(86)90143-9

    Article  Google Scholar 

  • Ruscio, A. M., & Borkovec, T. D. (2004). Experience and appraisal of worry among high worriers with and without generalized anxiety disorder. Behaviour Research and Therapy, 42(12), 1469–1482.

    Article  PubMed  Google Scholar 

  • Sarin, S., Abela, J., & Auerbach, R. (2005). The response styles theory of depression: a test of specificity and causal mediation. Cognition & Emotion, 19(5), 751–761. https://doi.org/10.1080/02699930441000463

    Article  Google Scholar 

  • Shear, M. K., Brown, T. A., Barlow, D. H., Money, R., Sholomskas, D. E., Woods, S. W., et al. (1997). Multicenter collaborative panic disorder severity scale. American Journal of Psychiatry, 154(11), 1571–1575. https://doi.org/10.1176/ajp.154.11.1571

    Article  PubMed  Google Scholar 

  • Smith, J. M., Alloy, L. B., & Abramson, L. Y. (2006). Cognitive vulnerability to depression, rumination, hopelessness, and suicidal ideation: multiple pathways to self-injurious thinking. Suicide and Life-threatening Behavior, 36(4), 443–454.

    Article  PubMed  Google Scholar 

  • Spielberger, C. D., Gorsuch, R. L., Lushene, R. E., Vagg, P. R., & Jacobs, G. A. (1983). Manual for the state-trait anxiety inventory. Palo Alto: Consulting Psychologists Press.

    Google Scholar 

  • Starr, L. R., & Davila, J. (2012a). Cognitive and interpersonal moderators of daily co-occurence of anxious and depressed moods in generalized anxiety disorder. Cognitive Therapy and Research, 36, 655–669.

    Article  PubMed  PubMed Central  Google Scholar 

  • Starr, L. R., & Davila, J. (2012b). Responding to anxiety with rumination and hopelessness: mechanism of anxiety-depression symptom co-occurrence? Cognitive Therapy and Research, 36(4), 321–337. https://doi.org/10.1007/s10608-011-9363-1

    Article  PubMed  PubMed Central  Google Scholar 

  • Starr, L. R., & Davila, J. (2012c). Temporal patterns of anxious and depressed mood in generalized anxiety disorder: a daily diary study. Behavior Research and Therapy, 50(2), 131–141.

    Article  Google Scholar 

  • Starr, L. R., Stroud, C. B., & Li, Y. I. (2016). Predicting the transition from anxiety to depressive symptoms in early adolescence: Negative anxiety response style as a moderator of sequential comorbidity. Journal of Affective Disorders, 190, 757–763.

    Article  PubMed  Google Scholar 

  • Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Boston: Allyn & Bacon/Pearson Education.

    Google Scholar 

  • Taylor, S., Arabian, B., & Fedoroff, I. C. (1999). Anxiety sensitivity: progress, prospects, and challenges. Anxiety Sensitivity: Theory, Research, and Treatment of the Fear of Anxiety, 339–353.

  • Weng, L. J., & Cheng, C. P. (2005). Parallel analysis with unidimensional binary data. Educational and Psychological Measurement, 65(5), 697–716. https://doi.org/10.1177/0013164404273941

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, Oklahoma State University, 116 North Murray Hall, Stillwater, OK, 74078, USA

    Danielle L. Taylor, DeMond M. Grant, Kristen E. Frosio, Jacob D. Kraft & Evan J. White

Authors
  1. Danielle L. Taylor
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. DeMond M. Grant
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kristen E. Frosio
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jacob D. Kraft
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Evan J. White
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Danielle L. Taylor.

Ethics declarations

Experiment Participants

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research board and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Conflict of Interest

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Taylor, D.L., Grant, D.M., Frosio, K.E. et al. Psychometric Properties of the Response to Anxiety Questionnaire. J Psychopathol Behav Assess 40, 550–562 (2018). https://doi.org/10.1007/s10862-018-9648-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10862-018-9648-8

Keywords

Search

Navigation