Psychometric Properties of the Response to Anxiety Questionnaire

  • Danielle L. TaylorEmail author
  • DeMond M. Grant
  • Kristen E. Frosio
  • Jacob D. Kraft
  • Evan J. White


Recent research highlights the importance of transdiagnostic factors of psychopathology, particularly in understanding comorbidity. Repetitive negative thinking (RNT) is one such factor, which may elucidate anxiety-depression comorbidity. The Response to Anxiety Questionnaire (RAQ) aims to evaluate repetitive negative thinking (RNT) related to anxiety-depression comorbidity, specifically hopelessness and rumination about anxiety symptoms. Anxious hopelessness is negative thoughts about the future due to anxiety symptoms, and anxious rumination includes negative evaluations of the meaning of anxiety symptoms, therefore the current study assessed the RAQ in three studies. We used exploratory and confirmatory factor analysis methodologies to examine the factor structure of the RAQ. In addition, we tested indirect effects of the two factors of RAQ (Rumination and Hopelessness) between anxiety and depression, and tested measure convergent validity. Results of the current study provide additional support for the psychometric properties of the RAQ, suggesting a two factor makeup (hopelessness, rumination), as well as its use in predicting anxiety and depressive symptoms.


Anxiety Depression Repetitive negative thinking (RNT) Response to anxiety questionnaire 


Compliance with Ethical Standards

Experiment Participants

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research board and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Conflict of Interest

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.


  1. Abramson, L. Y., Metalsky, G. I., & Alloy, L. B. (1989). Hopelessness depression: a theory-based subtype of depression. Psychological Review, 96(2), 358–372.Google Scholar
  2. Abramson, L. Y., Alloy, L. B., Hogan, M. E., Whitehouse, W. G., Gibb, B. E., Hankin, B. L., & Cornette, M. M. (2000). The hopelessness theory of suicidality. In T. E. Joiner & M. D. Rudd (Eds.), Suicide Science (pp. 17–32). Boston: Kluwer Academic Publishing.Google Scholar
  3. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B. N. Petrov & F. Csaki (Eds.), Proceedings of the second international symposium on information theory (pp. 267–281). Budapest: Akademiai Kiado.Google Scholar
  4. Alloy, L. B., Kelly, K. A., Mineka, S., & Clements, C. M. (1990). Comorbidity of anxiety and depressive disorders: A helplessness/hopelessness perspective. In J. D. Maser & C. R. Cloninger (Eds.), Comorbidity of anxiety and mood disorders. Washington, D.C.: American Psychiatric Press.Google Scholar
  5. Asparouhov, T., & Muthén, B. (2010). Simple second order Chi square correction. Technical report.
  6. Behar, E., Alcaine, O., Zuellig, A. R., & Borkovec, T. D. (2003). Screening for generalized anxiety disorder using the Penn State Worry Questionnaire: A receiver operating characteristic analysis. Journal of Behavior Therapy and Experimental Psychiatry, 34(1), 25–43.CrossRefPubMedGoogle Scholar
  7. Bentler, P. M. (1992). On the fit of models to covariances and methodology to the bulletin. Psychological Bulletin, 112, 400–404. CrossRefPubMedGoogle Scholar
  8. Brown, T. A. (2014). Confirmatory factor analysis for applied research. New York, NY: Guilford Publications.Google Scholar
  9. Brown, T. A., Campbell, L. A., Lehman, C. L., Grisham, J. R., & Mancill, R. B. (2001). Current and lifetime comorbidity of the DSM-IV anxiety and mood disorders in a large clinical sample. Journal of Abnormal Psychology, 110(4), 585–599.CrossRefPubMedGoogle Scholar
  10. Cohen, J. R., Young, J. F., Gibb, B. E., Hankin, B. L., & Abela, J. R. (2014). Why are anxiety and depressive symptoms comorbid in youth? A multi-wave, longitudinal examination of competing etiological models. Journal of Affective Disorders, 161, 21–29.CrossRefPubMedPubMedCentralGoogle Scholar
  11. Comrey, A. L. & Lee, H. B. (1992). A first course in factor analysis. A.L. Comrey & H.B. Lee. (Eds.) New York, NY: Lawrence Erlbaum Associates.Google Scholar
  12. Derryberry, D., & Reed, M. A. (2002). Anxiety-related attentional biases and their regulation by attentional control. Journal of Abnormal Psychology, 111(2), 225–236. CrossRefPubMedGoogle Scholar
  13. Ehring, T., & Watkins, E. R. (2008). Repetitive negative thinking as a transdiagnostic process. International Journal of Cognitive Therapy, 1(3), 192–205. CrossRefGoogle Scholar
  14. Eysenck, M. W., Derakshan, N., Santos, R., & Calvo, M. G. (2007). Anxiety and cognitive performance: attentional control theory. Emotion, 7(2), 336.CrossRefPubMedGoogle Scholar
  15. Fresco, D. M., Mennin, D. S., Heimberg, R. G., & Turk, C. L. (2003). Using the Penn State Worry Questionnaire to identify individuals with generalized anxiety disorder: A receiver operating characteristic analysis. Journal of Behavior Therapy and Experimental Psychiatry, 34(3–4), 283–291.Google Scholar
  16. Fritz, M. S., & MacKinnon, D. P. (2007). Required sample size to detect the mediated effect. Psychological Science, 18(3), 233–239.CrossRefPubMedPubMedCentralGoogle Scholar
  17. Garrido, L. E., Abad, F. J., & Ponsoda, V. (2016). Are fit indices really fit to estimate the number of factors with categorical variables? Some cautionary findings via Monte Carlo simulation. Psychological Methods, 21(1), 93. CrossRefPubMedGoogle Scholar
  18. Grant, D. M., Beck, G. J., Farrow, S. M., & Davila, J. (2007). Do interpersonal features of social anxiety influence the development of depressive symptoms? Cognition and Emotion, 21(3), 646–663.CrossRefGoogle Scholar
  19. Grant, D. M., Judah, M. R., Mills, A. C., Lechner, W. V., Davidson, C. L., & Wingate, L. R. (2014). Rumination and excessive reassurance seeking: Mediators of the relationship between social anxiety and depression? Journal of Psychopathology and Behavioral Assessment, 36(3), 465–474. CrossRefGoogle Scholar
  20. Hayes, A. F. (2013). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. New York: Guilford Press.Google Scholar
  21. Hayes, A. F., & Rockwood, N. J. (2016). Regression-based statistical mediation and moderation analysis in clinical research: observations, recommendations, and implementation. Behavior Research and Therapy.
  22. Horn, J. L. (1965). A rationale and test for the number of factors in a factor analysis. Psychometrika, 30, 179–185. CrossRefPubMedGoogle Scholar
  23. Houck, P. R., Spiegel, D. A., Shear, M. K., & Paola Rucci, D. S. (2002). Reliability of the self-report version of the panic disorder severity scale. Depression and Anxiety, 15, 183–185. CrossRefPubMedGoogle Scholar
  24. Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. CrossRefGoogle Scholar
  25. Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., & Wang, P. (2010). Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. American Journal of Psychiatry, 167(7), 748–751Google Scholar
  26. Jacobson, N. C., & Newman, M. G. (2014). Avoidance mediates the relationship between anxiety and depression over a decade later. Journal of Anxiety Disorders, 28(5), 437–445. CrossRefPubMedPubMedCentralGoogle Scholar
  27. Johansson, R., Carlbring, P., Heedman, Å., Paxling, B., & Andersson, G. (2013). Depression, anxiety and their comorbidity in the Swedish general population: point prevalence and the effect on health-related quality of life. PeerJ, 1, e98. CrossRefPubMedPubMedCentralGoogle Scholar
  28. Joiner, T. E., Wingate, L. R., & Otamendi, A. (2005). An interpersonal addendum to the hopelessness theory of depression: hopelessness as a stress and depression generator. Journal of Social and Clinical Psychology, 24(5), 649–664. CrossRefGoogle Scholar
  29. Jöreskog, K. G. (1999). How large can a standardized coefficient be. Unpublished Technical Report. Retrieved from:
  30. Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed.). New York: The Guilford Press.Google Scholar
  31. Koster, E. H., De Lissnyder, E., Derakshan, N., & De Raedt, R. (2011). Understanding depressive rumination from a cognitive science perspective: the impaired disengagement hypothesis. Clinical Psychology Review, 31(1), 138–145. CrossRefPubMedGoogle Scholar
  32. Krueger, R. F., & Eaton, N. R. (2015). Transdiagnostic factors of mental disorders. World Psychiatry, 14(1), 27–29. CrossRefPubMedPubMedCentralGoogle Scholar
  33. Lee, I. A. & Preacher, K. J. (2013). Calculation for the test of the difference between two dependent correlations with one variable in common [Computer software]. Available from
  34. Lenze, E. J., Mulsant, B. H., Mohlman, J., Shear, M. K., Dew, M. A., Schulz, R., & Reynolds, C. F. (2005). Generalized anxiety disorder in late life: lifetime course and comorbidity with major depressive disorder. The American Journal of Geriatric Psychiatry, 13(1), 77–80.CrossRefPubMedGoogle Scholar
  35. MacCallum, R. C., Widaman, K. F., Preacher, K. J., & Hong, S. (2001). Sample size in factor analysis: the role of model error. Multivariate Behavioral Research, 36(4), 611–637.CrossRefPubMedGoogle Scholar
  36. Mansell, W., Harvey, A., Watkins, E. R., & Shafran, R. (2008). Cognitive behavioral processes across psychological disorders: a review of the utility and validity of the transdiagnostic approach. International Journal of Cognitive Therapy, 1(3), 181–191. CrossRefGoogle Scholar
  37. Mattick, R. P., & Clarke, J. C. (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36, 455–470. CrossRefPubMedGoogle Scholar
  38. McEvoy, P. M., Watson, H., Watkins, E. R., & Nathan, P. (2013). The relationship between worry, rumination, and comorbidity: Evidence for repetitive negative thinking as a transdiagnostic construct. Journal of Affective Disorders, 151(1), 313–320. CrossRefPubMedGoogle Scholar
  39. McLean, C. P., Asnaani, A., Litz, B. T., & Hofmann, S. G. (2011). Gender differences in anxiety disorders: Prevalence, course of illness, comorbidity and burden of illness. Journal of Psychiatric Research, 45(8), 1027–1035. CrossRefPubMedPubMedCentralGoogle Scholar
  40. Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in test of measurement invariance. Journal of Applied Psychology, 93(3), 568–592. CrossRefPubMedGoogle Scholar
  41. Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990). Development and validation of the Penn State worry questionnaire. Behaviour Research and Therapy, 28(6), 487–495. CrossRefPubMedGoogle Scholar
  42. Mills, A. C., Grant, D. M., Lechner, W. V., & Judah, M. R. (2014). Relationship between trait repetitive negative thinking styles and symptoms of psychopathology. Personality and Individual Differences, 71, 19–24.CrossRefGoogle Scholar
  43. Muthen, B., & Kaplan, D. (1992). A comparison of some methodologies for the factor analysis of non-normal Likert variables: a note on the size of the model. British Journal of Mathematical and Statistical Psychology, 45(1), 19–30. CrossRefGoogle Scholar
  44. Muthén, L. K., & Muthén, B. O. (2007). Mplus. Statistical analysis with latent variables. Version, 3. New York, NY: Wiley.Google Scholar
  45. Muthén, L. K., & Muthén, B. O. (2011). Mplus user's guide. Sixth edition. Los Angeles: Muthén & Muthén.Google Scholar
  46. Muthén, B., du Toit, S., & Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equation in latent variable modeling with categorical and continuous outcomes. Los Angeles: University of California.Google Scholar
  47. Newman, M. G., & Llera, S. J. (2011). A novel theory of experiential avoidance in generalized anxiety disorder: a review and synthesis of research supporting a contrast avoidance model of worry. Clinical Psychology Review, 31(3), 371–382.Google Scholar
  48. Norton, P. J., & Barrera, T. L. (2012). Transdiagnostic versus diagnosis-specific CBT for anxiety disorders: a preliminary randomized controlled noninferiority trial. Depression and Anxiety, 29(10), 874–882. CrossRefPubMedPubMedCentralGoogle Scholar
  49. Norton, P. J., & Philipp, L. M. (2008). Transdiagnostic approaches to the treatment of anxiety disorders: A quantitative review. Psychotherapy, 45(2), 214–226. CrossRefPubMedGoogle Scholar
  50. Norton, P. J., Barrera, T. L., Mathew, A. R., Chamberlain, L. D., Szafranski, D. D., Reddy, R., & Smith, A. H. (2013). Effect of transdiagnostic CBT for anxiety disorders on comorbid diagnoses. Depression and Anxiety, 30(2), 168–173. CrossRefPubMedGoogle Scholar
  51. O'Connor, B. P. (2000). SPSS, SAS, and MATLAB programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instruments, and Computers, 32, 396–402. CrossRefPubMedGoogle Scholar
  52. Penninx, B. W., Nolen, W. A., Lamers, F., Zitman, F. G., Smit, J. H., Spinhoven, P., et al. (2011). Two-year course of depressive and anxiety disorders: results from the Netherlands Study of Depression and Anxiety (NESDA). Journal of Affective Disorders, 133(1), 76–85. CrossRefPubMedGoogle Scholar
  53. Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1(3), 385–401. CrossRefGoogle Scholar
  54. Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696.CrossRefPubMedPubMedCentralGoogle Scholar
  55. Reiss, S., Peterson, R., Gursky, D., & McNally, R. (1985). Anxiety sensitivity, anxiety frequency and the predictions of fearfulness. Behavior Research and Therapy, 24(1), 1–8. CrossRefGoogle Scholar
  56. Ruscio, A. M., & Borkovec, T. D. (2004). Experience and appraisal of worry among high worriers with and without generalized anxiety disorder. Behaviour Research and Therapy, 42(12), 1469–1482.CrossRefPubMedGoogle Scholar
  57. Sarin, S., Abela, J., & Auerbach, R. (2005). The response styles theory of depression: a test of specificity and causal mediation. Cognition & Emotion, 19(5), 751–761. CrossRefGoogle Scholar
  58. Shear, M. K., Brown, T. A., Barlow, D. H., Money, R., Sholomskas, D. E., Woods, S. W., et al. (1997). Multicenter collaborative panic disorder severity scale. American Journal of Psychiatry, 154(11), 1571–1575. CrossRefPubMedGoogle Scholar
  59. Smith, J. M., Alloy, L. B., & Abramson, L. Y. (2006). Cognitive vulnerability to depression, rumination, hopelessness, and suicidal ideation: multiple pathways to self-injurious thinking. Suicide and Life-threatening Behavior, 36(4), 443–454.CrossRefPubMedGoogle Scholar
  60. Spielberger, C. D., Gorsuch, R. L., Lushene, R. E., Vagg, P. R., & Jacobs, G. A. (1983). Manual for the state-trait anxiety inventory. Palo Alto: Consulting Psychologists Press.Google Scholar
  61. Starr, L. R., & Davila, J. (2012a). Cognitive and interpersonal moderators of daily co-occurence of anxious and depressed moods in generalized anxiety disorder. Cognitive Therapy and Research, 36, 655–669.CrossRefPubMedPubMedCentralGoogle Scholar
  62. Starr, L. R., & Davila, J. (2012b). Responding to anxiety with rumination and hopelessness: mechanism of anxiety-depression symptom co-occurrence? Cognitive Therapy and Research, 36(4), 321–337. CrossRefPubMedPubMedCentralGoogle Scholar
  63. Starr, L. R., & Davila, J. (2012c). Temporal patterns of anxious and depressed mood in generalized anxiety disorder: a daily diary study. Behavior Research and Therapy, 50(2), 131–141.CrossRefGoogle Scholar
  64. Starr, L. R., Stroud, C. B., & Li, Y. I. (2016). Predicting the transition from anxiety to depressive symptoms in early adolescence: Negative anxiety response style as a moderator of sequential comorbidity. Journal of Affective Disorders, 190, 757–763.CrossRefPubMedGoogle Scholar
  65. Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Boston: Allyn & Bacon/Pearson Education.Google Scholar
  66. Taylor, S., Arabian, B., & Fedoroff, I. C. (1999). Anxiety sensitivity: progress, prospects, and challenges. Anxiety Sensitivity: Theory, Research, and Treatment of the Fear of Anxiety, 339–353.Google Scholar
  67. Weng, L. J., & Cheng, C. P. (2005). Parallel analysis with unidimensional binary data. Educational and Psychological Measurement, 65(5), 697–716. CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Danielle L. Taylor
    • 1
    Email author
  • DeMond M. Grant
    • 1
  • Kristen E. Frosio
    • 1
  • Jacob D. Kraft
    • 1
  • Evan J. White
    • 1
  1. 1.Department of PsychologyOklahoma State UniversityStillwaterUSA

Personalised recommendations