Abstract
Psychological flexibility is the act of being open to internal experiences while pursuing valued life directions and has been implicated in positive mental health. A lack of psychological flexibility has been implicated in a wide range of mental health problems. In most research, assessment of psychological (in) flexibility has been done with the Acceptance and Action Questionnaire – II (AAQ-II), yet researchers have noted that items on the AAQ-II may not adequately discriminate between responses to experiences and the experiences themselves. Furthermore, little research has examined whether items on the AAQ-II function as intended in terms of assessing psychological (in) flexibility and whether items function differently across populations. The present study used an item response theory framework to examine item functioning in the AAQ-II across items (within the measure) and across non-distressed student, distressed student, outpatient, and residential samples. The analyses identified differences in functioning between items, with some items being more sensitive to differences in psychological inflexibility. No items performed well in assessing psychological flexibility (as opposed to inflexibility) or positive functioning. Items functioned similarly across samples, yet patterns of responding differed in the non-distressed student versus residential and outpatient samples. Implications for use of the AAQ-II in clinical and research contexts are discussed.
This is a preview of subscription content, access via your institution.
References
A-Tjak, J. G. L., Davis, M. L., Morina, N., Powers, M. B., Smits, J. A., & Emmelkamp, P. M. (2015). A meta-analysis of the efficacy of acceptance and commitment therapy for clinically relevant mental and physical health problems. Psychotherapy and Psychosomatics, 84(1), 30–36. https://doi.org/10.1159/000365764.
Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011). Preliminary psychometric properties of the acceptance and action questionnaire-II: A revised measure of psychological inflexibility and experiential avoidance. Behavior Therapy, 42(4), 676–688. https://doi.org/10.1016/j.beth.2011.03.007.
Fan, J., Upadhye, S., & Worster, A. (2015). Understanding receiver operating characteristic (ROC) curves. Cjem, 8(01), 19–20. https://doi.org/10.1017/s1481803500013336.
Fiorillo, D., McLean, C., Pistorello, J., Hayes, S. C., & Follette, V. M. (2017). Evaluation of a web-based acceptance and commitment therapy program for women with trauma-related problems: A pilot study. Journal of Contextual Behavioral Science, 6(1), 104–113. https://doi.org/10.1016/j.jcbs.2016.11.003.
Fledderus, M., Oude Voshaar, M. A., Ten Klooster, P. M., & Bohlmeijer, E. T. (2012). Further evaluation of the psychometric properties of the acceptance and action questionnaire-II. Psychological Assessment, 24(4), 925–936. https://doi.org/10.1037/a0028200.
Francis, A. W., Dawson, D. L., & Golijani-Moghaddam, N. (2016). The development and validation of the comprehensive assessment of acceptance and commitment therapy processes (CompACT). Journal of Contextual Behavioral Science, 5(3), 134–145. https://doi.org/10.1016/j.jcbs.2016.05.003.
Gámez, W., Chmielewski, M., Kotov, R., Ruggero, C., & Watson, D. (2011). Development of a measure of experiential avoidance: The multidimensional experiential avoidance questionnaire. Psychological Assessment, 23(3), 692–713. https://doi.org/10.1037/a0023242.
Gámez, W., Chmielewski, M., Kotov, R., Ruggero, C., Suzuki, N., & Watson, D. (2014). The brief experiential avoidance questionnaire: Development and initial validation. Psychological Assessment, 26(1), 35–45. https://doi.org/10.1037/a0034473.
Greiner, M., Pfeiffer, D., & Smith, R. D. (2000). Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests. Preventive Veterinary Medicine, 45, 23–41. https://doi.org/10.1016/S0167-5877(00)00115-X.
Harvey, R. J., & Hammer, A. L. (1999). Item response theory. The Counseling Psychologist, 27(3), 353–383. https://doi.org/10.1177/0011000099273004.
Hayes, S. C. (2004). Acceptance and commitment therapy, relational frame theory, and the third wave of behavioral and cognitive therapies. Behavior Therapy, 35(4), 639–665. https://doi.org/10.1016/S0005-7894(04)80013-3.
Hayes, S. C., Strosahl, K., Wilson, K. G., Bissett, R. T., Pistorello, J., Toarmino, D., Polusny, M. A., Dykstra, T. A., Batten, S. V., Bergan, J., Stewart, S. H., Zvolensky, M. J., Eifert, G. H., Bond, F. W., Forsyth, J. P., Karekla, M., & McCurry, S. M. (2004). Measuring experiential avoidance: A preliminary test of a working model. The Psychological Record, 54, 553–578. https://doi.org/10.1007/BF03395492.
Hayes, S. C., Luoma, J. B., Bond, F. W., Masuda, A., & Lillis, J. (2006). Acceptance and commitment therapy: Model, processes and outcomes. Behaviour Research and Therapy, 44(1), 1–25. https://doi.org/10.1016/j.brat.2005.06.006.
Hayes, S. C., Levin, M. E., Plumb-Vilardaga, J., Villatte, J. L., & Pistorello, J. (2013). Acceptance and commitment therapy and contextual behavioral science: Examining the progress of a distinctive model of behavioral and cognitive therapy. Behavior Therapy, 44(2), 180–198. https://doi.org/10.1016/j.beth.2009.08.002.
Houghton, D. C., Compton, S. N., Twohig, M. P., Saunders, S. M., Franklin, M. E., Neal-Barnett, A. M., Ely, L., Capriotti, M. R., & Woods, D. W. (2014). Measuring the role of psychological inflexibility in trichotillomania. Psychiatry Research, 220(1–2), 356–361. https://doi.org/10.1016/j.psychres.2014.08.003.
Juarascio, A. S., Schumacher, L. M., Shaw, J., Forman, E. M., & Herbert, J. D. (2015). Acceptance-based treatment and quality of life among patients with an eating disorder. Journal of Contextual Behavioral Science, 4(1), 42–47. https://doi.org/10.1016/j.jcbs.2014.11.002.
Kang, T., Cohen, A. S., & Sung, H. J. (2009). Model selection indices for polytomous items. Applied Psychological Measurement, 33, 499–518. https://doi.org/10.1177/0146621608327800.
Kashdan, T. B., & Rottenberg, J. (2010). Psychological flexibility as a fundamental aspect of health. Clinical Psychology Review, 30(7), 865–878. https://doi.org/10.1016/j.cpr.2010.03.001.
Lappalainen, P., Granlund, A., Siltanen, S., Ahonen, S., Vitikainen, M., Tolvanen, A., & Lappaleinen, R. (2014). ACT internet-based vs face-to-face? A randomized controlled trial of two ways to deliver acceptance and commitment therapy for depressive symptoms: An 18-month follow-up. Behaviour Research and Therapy, 61, 43–54. https://doi.org/10.1016/j.brat.2014.07.006.
Lee, E. B., Smith, B. M., Twohig, M. P., Lensegrav-Benson, T., & Quakenbush-Roberts, B. (2017). Assessment of the body image-acceptance and action questionnaire in a female residential eating disorder treatment facility. Journal of Contextual Behavioral Science, 6(1), 21–28. https://doi.org/10.1016/j.jcbs.2016.11.004.
Levin, M. E., Luoma, J. B., Lillis, J., Hayes, S. C., & Vilardaga, R. (2014a). The acceptance and action questionnaire - stigma (AAQ-S): Developing a measure of psychological flexibility with stigmatizing thoughts. Journal of Contextual Behavioral Science, 3(1), 21–26. https://doi.org/10.1016/j.jcbs.2013.11.003.
Levin, M. E., MacLane, C., Daflos, S., Seeley, J. R., Hayes, S. C., Biglan, A., & Pistorello, J. (2014b). Examining psychological inflexibility as a transdiagnostic process across psychological disorders. Journal of Contextual Behavioral Science, 3, 155–163. https://doi.org/10.1016/j.jcbs.2014.06.003.
Locke, B. D., McAleavey, A. A., Zhao, Y., Lei, P. W., Hayes, J. A., Castonguay, L. G., Li, H., Tate, R., & Lin, Y. C. (2012). Development and initial validation of the counseling center assessment of psychological symptoms–34. Measurement and Evaluation in Counseling and Development, 45, 151–169. https://doi.org/10.1177/0748175611432642.
McCracken, L. M., Vowles, K. E., & Eccleston, C. (2004). Acceptance of chronic pain: Component analysis and a revised assessment method. Pain, 107(1), 159–166. https://doi.org/10.1016/j.pain.2003.10.012.
Ritzert, T. R., Forsyth, J. P., Berghoff, C. R., Barnes-Holmes, D., & Nicholson, E. (2015). The impact of a cognitive defusion intervention on behavioral and psychological flexibility: An experimental evaluation in a spider fearful non-clinical sample. Journal of Contextual Behavioral Science, 4(2), 112–120. https://doi.org/10.1016/j.jcbs.2015.04.001.
Samejima, F. (1997). Graded response model. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 85–100). New York, NY: Springer.
Sandoz, E. K., Wilson, K. G., Merwin, R. M., & Kellum, K. K. (2013). Assessment of body image flexibility: The body image-acceptance and action questionnaire. Journal of Contextual Behavioral Science, 2(1–2), 39–48. https://doi.org/10.1016/j.jcbs.2013.03.002.
Spatola, C. A., Cappella, E. A., Goodwin, C. L., Baruffi, M., Malfatto, G., Facchini, M., et al. (2014). Development and initial validation of the cardiovascular disease acceptance and action questionnaire (CVD-AAQ) in an Italian sample of cardiac patients. Frontiers in Psychology, 5, 1284. https://doi.org/10.3389/fpsyg.2014.01284.
Wolgast, M. (2014). What does the acceptance and action questionnaire (AAQ-II) really measure? Behavior Therapy, 45, 831–839. https://doi.org/10.1016/j.beth.2014.07.002.
Funding
This research was supported by the NIMH of the National Institutes of Health under Award number R01MH080966 (Woods; PI).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
Clarissa W. Ong, Benjamin G. Pierce, Douglas W. Woods, Michael P. Twohig and Michael E. Levin declare that they have no conflict of interest.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Clarissa W. Ong and Benjamin G. Pierce are the Co-first authors
Rights and permissions
About this article
Cite this article
Ong, C.W., Pierce, B.G., Woods, D.W. et al. The Acceptance and Action Questionnaire – II: an Item Response Theory Analysis. J Psychopathol Behav Assess 41, 123–134 (2019). https://doi.org/10.1007/s10862-018-9694-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10862-018-9694-2