Abstract
Acceptance and commitment therapy (ACT) emphasizes values and behavioral commitments to help individuals achieve goals and manage emotions. This study evaluated the preliminary psychometric properties of the ACTive Values Wheel, a smartphone application-based psychometric instrument. ACTive provides a weighted and idiographic index of individuals’ self-reported values-directed behavior. One hundred sixty adults participated on an individual basis to complete the ACTive Values Wheel and questionnaire measures of well-being, psychological distress, psychological flexibility, and valued living to assess the convergent, incremental, discriminant, and criterion-related validity of the ACTive Values Wheel. The ACTive Values Wheel showed evidence of convergent and criterion-related validity through significant positive correlations with existing measures of valued living, emotional well-being, and openness to experience, respectively. Likewise, discriminant validity was evidenced by a nonsignificant correlation with age. However, evidence of incremental validity over and above existing measures of valued living was not found. These findings provide preliminary support for the psychometric properties of the ACTive Values Wheel. Accounting for the methodological limitations of the study, the ACTive Values Wheel shows potential as an accessible and interactive measure of self-reported values-directed behavior that could be extended to other languages and cultural contexts.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Åkerblom, S., Perrin, S., Fischer, M. R., & McCracken, L. M. (2017). The impact of PTSD on functioning in patients seeking treatment for chronic pain and validation of the posttraumatic diagnostic scale. International Journal of Behavioral Medicine, 24(2), 249–259. https://doi.org/10.1007/s12529-017-9641-8.
Antony, M. M., Bieling, P. J., Cox, B. J., Enns, M. W., & Swinson, R. P. (1998). Psychometric properties of the 42-item and 21-item versions of the Depression Anxiety Stress Scales in clinical groups and a community sample. Psychological Assessment, 10(2), 176–181. https://doi.org/10.1037/1040-3590.10.2.176.
Barrett, K., O'Connor, M., & McHugh, L. (2019). A systematic review of values-based psychometric tools within acceptance and commitment therapy (ACT). The Psychological Record., 69(4), 457–485. https://doi.org/10.1007/s40732-019-00352-7.
Barrett, K., O'Connor, M., & McHugh, L. (2020). Investigating the psychometric properties of the Values Wheel with a clinical cohort: A preliminary validation study. Journal of Contextual Behavioral Science, 15, 210–218. https://doi.org/10.1016/j.jcbs.2019.12.009.
Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186–3191. https://doi.org/10.1097/00007632-200012150-00014.
Browne, J. P., O’Boyle, C. A., McGee, H. M., McDonald, N. J., & Joyce, C. R. (1997). Development of a direct weighting procedure for quality of life domains. Quality of Life Research, 6(4), 301–309. https://doi.org/10.1023/A:101842312.
Ciarrochi, J., & Blackledge, J. T. (2006). Validation of the Personal Values Questionnaire. Unpublished manuscript, University of Wollongong, Australia.
Ciarrochi, J., Brockman, R., Duguid, J., Parker, P., Sahdra, B., & Kashdan, T. (2016). Measures that make a difference: Optimizing psychological measurement to promote well-being and reduce suffering. In R. Zettle, S. Hayes, T. Biglan, & D. Barnes-Holmes (Eds.) Handbook of contextual behavioral science (pp. 320–347). Wiley.
Dahl, J. (2015). Valuing in ACT. Current Opinion in Psychology, 2, 43–46. https://doi.org/10.1016/j.copsyc.2015.03.001.
Drake, C. E., Masuda, A., Dalsky, D., Stevens, K. T., Kramer, S., Primeaux, S. J., et al. (2019). Examining US and Japanese college students’ differences in psychological distress: The mediating roles of valued action and experiential avoidance. International Journal for the Advancement of Counselling, 41(1), 25–40. https://doi.org/10.1007/s10447-018-9342-2.
Faul, F., Erdfelder, E., Lang, A. G., & Buchner, A. (2007). G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. https://doi.org/10.3758/BF03193146.
Francis, A., Dawson, D., & Golijani-Moghaddam, N. (2016). The development and validation of the Comprehensive Assessment of Acceptance and Commitment Therapy processes (CompACT). Journal of Contextual Behavioral Science, 5(3), 134–145. https://doi.org/10.1016/j.jcbs.2016.05.003.
Hayes, S. C., & Hofmann, S. G. (Eds.). (2017). Process-based CBT: The science and core clinical competencies of cognitive behavioral therapy. Oakland, CA: New Harbinger.
Hayes, S. C., Levin, M. E., Plumb-Vilardaga, J., Villatte, J. L., & Pistorello, J. (2013). Acceptance and commitment therapy and contextual behavioral science: Examining the progress of a distinctive model of behavioral and cognitive therapy. Behavior Therapy, 44(2), 180–198. https://doi.org/10.1016/j.beth.2009.08.002.
Hayes, S. C., Luoma, J. B., Bond, F. W., Masuda, A., & Lillis, J. (2006). Acceptance and commitment therapy: Model, processes and outcomes. Behavior Research & Therapy, 44(1), 1–25. https://doi.org/10.1016/j.brat.2005.06.006.
Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (2012). Acceptance and commitment therapy: The process and practice of mindful change (2nd ed.). New York, NY: Guilford Press.
Hickey, A. M., Bury, G., O’Boyle, C. A., Bradley, F., O’Kelly, F. D., & Shannon, W. (1996). A new short form individual quality of life measure (SEIQoL-DW): application in a cohort of individuals with HIV/AIDS. BMJ (Clinical research ed.), 313(7048), 29–33. https://doi.org/10.1136/bmj.313.7048.29.
Jensen, M. P., Vowles, K. E., Johnson, L. E., & Gertz, K. J. (2015). Living well with pain: Development and preliminary evaluation of the Valued Living Scale. Pain Medicine, 16(11), 2109–2120. https://doi.org/10.1111/pme.12802.
Kirschenbaum, H. (2013). Values clarification in counseling and psychotherapy: Practical strategies for individual and group settings. Oxford, UK: Oxford University Press.
Lamers, S. M., Westerhof, G. J., Bohlmeijer, E. T., ten Klooster, P. M., & Keyes, C. L. (2011). Evaluating the psychometric properties of the mental health continuum-short form (MHC-SF). Journal of Clinical Psychology, 67(1), 99–110. https://doi.org/10.1002/jclp.20741.
Levin, M. E., Pierce, B., & Schoendorff, B. (2017). The acceptance and commitment therapy matrix mobile app: A pilot randomized trial on health behaviors. Journal of Contextual Behavioral Science, 6(3), 268–275. https://doi.org/10.1016/j.jcbs.2017.05.003.
Lloyd, C. E., Duncan, C., & Cooper, M. (2019). Goal measures for psychotherapy: A systematic review of self-report, idiographic instruments. Clinical Psychology: Science & Practice, 26(3), 12281. https://doi.org/10.1111/cpsp.12281.
Lovibond, P. F., & Lovibond, S. H. (1995). The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behavior Research & Therapy, 33(3), 335–343. https://doi.org/10.1016/0005-7967(94)00075-U.
Lundgren, T., Luoma, J. B., Dahl, J., Strosahl, K., & Melin, L. (2012). The bull's-eye values survey: A psychometric evaluation. Cognitive & Behavioral Practice, 19(4), 518–526. https://doi.org/10.1016/j.cbpra.2012.01.004.
McCracken, L. M., & Morley, S. (2014). The psychological flexibility model: A basis for integration and progress in psychological approaches to chronic pain management. The Journal of Pain, 15(3), 221–234. https://doi.org/10.1016/j.jpain.2013.10.014.
McCracken, L. M., & Yang, S. Y. (2006). The role of values in a contextual cognitive-behavioral approach to chronic pain. Pain, 123(2), 137–145. https://doi.org/10.1016/j.pain.2006.02.021.
McNamara, M., & Veeken, J. (2014). The values cards. Victoria, Australia: Qcards.
Miller, M. B., Meier, E., Lombardi, N., Leavens, E. L., Grant, D. M., & Leffingwell, T. R. (2016). The Valued Living Questionnaire for Alcohol Use: Measuring value-behavior discrepancy in college student drinking. Psychological Assessment, 28(9), 1051–1060. https://doi.org/10.1037/pas0000235.
Mokkink, L. B., De Vet, H. C., Prinsen, C. A., Patrick, D. L., Alonso, J., Bouter, L. M., & Terwee, C. B. (2018). COSMIN risk of Bias checklist for systematic reviews of patient-reported outcome measures. Quality of Life Research, 27(5), 1171–1179. https://doi.org/10.1007/s11136-017-1765-4.
O’Connor, M., Tennyson, A., Timmons, M., & McHugh, L. (2019). The development and preliminary psychometric properties of the Values Wheel. Journal of Contextual Behavioral Science, 12, 39–46. https://doi.org/10.1016/j.jcbs.2019.01.005.
Piccirillo, M. L., & Rodebaugh, T. L. (2019). Foundations of idiographic methods in psychology and applications for psychotherapy. Clinical Psychology Review, 71, 90–100. https://doi.org/10.1016/j.cpr.2019.01.002.
Pielech, M., Bailey, R. W., McEntee, M. L., Ashworth, J., Levell, J., Sowden, G., & Vowles, K. E. (2016). Preliminary evaluation of the values tracker: A two-item measure of engagement in valued activities in those with chronic pain. Behavior Modification, 40(1–2), 239–256. https://doi.org/10.1177/0145445515616911.
Prinsen, C. A. C., Mokkink, L. B., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., & Terwee, C. B. (2018). COSMIN guideline for systematic reviews of patient-reported outcome measures. Quality of Life Research, 27(5), 1147–1157. https://doi.org/10.1007/s11136-018-1798-3.
Reilly, E., Ritzert, T., Scoglio, A., Mote, J., Fukuda, S., Ahern, M., & Kelly, M. (2019). A systematic review of values measures in acceptance and commitment therapy research. Journal of Contextual Behavioral Science, 12, 290–304. https://doi.org/10.1016/j.jcbs.2018.10.004.
Romero-Moreno, R., Gallego-Alberto, L., Márquez-González, M., & Losada, A. (2017). Psychometric properties of the Valued Living Questionnaire adapted to dementia caregiving. Aging & Mental Health, 21(9), 983–990. https://doi.org/10.1080/13607863.2016.1191055.
Roy, A. (2003). Factor analysis and initial validation of the Personal Values Inventory. (Unpublished doctoral dissertation). Tennessee State University, Nashville, TN.
Serowik, K. L., Khan, A. J., LoCurto, J., & Orsillo, S. M. (2018). The conceptualization and measurement of values: A review of the psychometric properties of measures developed to inform values work with adults. Journal of Psychopathology & Behavioral Assessment, 40(4), 615–635. https://doi.org/10.1007/s10862-018-9679-1.
Smout, M., Davies, M., Burns, N., & Christie, A. (2014). Development of the valuing questionnaire (VQ). Journal of Contextual Behavioral Science, 3(3), 164–172. https://doi.org/10.1016/j.jcbs.2014.06.001.
Spitzer, R. L., Kroenke, K., & Williams, J. B. (1999). Validation and utility of a self-report version of PRIME-md: The PHQ primary care study. JAMA, 282(18), 1737–1744. https://doi.org/10.1001/jama.282.18.1737.
Spitzer, R. L., Kroenke, K., Williams, J. B., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder. Archives of Internal Medicine, 166(10), 1092–1097. https://doi.org/10.1001/archinte.166.10.1092.
Terwee, C. B., Prinsen, C. A. C., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., et al. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Quality of Life Research, 27(5), 1159–1170. https://doi.org/10.1007/s11136-018-1829-0.
Trindade, I. A., Ferreira, C., Pinto-Gouveia, J., & Nooren, L. (2016). Clarity of personal values and committed action: Development of a shorter engaged living scale. Journal of Psychopathology & Behavioral Assessment, 38(2), 258–265. https://doi.org/10.1007/s10862-015-9509-7.
Trompetter, H. R., Ten Klooster, P. M., Schreurs, K. M., Fledderus, M., Westerhof, G. J., & Bohlmeijer, E. T. (2013). Measuring values and committed action with the Engaged Living Scale (ELS): Psychometric evaluation in a nonclinical sample and a chronic pain sample. Psychological Assessment, 25(4), 1235–1246. https://doi.org/10.1037/a0033813.
Tullis, T., & Albert, W. (2008). Measuring the user experience. San Francisco, CA: Morgan Kaufmann.
VanBuskirk, K., West, L., Malcarne, V., Afari, N., Liu, L., Petkus, A., & Wetherell, J. L. (2012). Confirmatory factor analysis of the valued living questionnaire in a Black American sample: Implications for cognitive research and practice. Cognitive Therapy & Research, 36(6), 796–805. https://doi.org/10.1007/s10608-011-9405-8.
Wilson, K. G., & DuFrene, T. (2009). Mindfulness for two: An acceptance and commitment therapy approach to mindfulness in psychotherapy. Oakland, CA: New Harbinger.
Wilson, K. G., Sandoz, E. K., Kitchens, J., & Roberts, M. (2010). The Valued Living Questionnaire: Defining and measuring valued action within a behavioral framework. The Psychological Record, 60(2), 249–272. https://doi.org/10.1007/BF03395706.
World Medical Association. (2013). Declaration of Helsinki: Ethical principles for medical research involving human subjects. JAMA, 310(20), 2191–2194. https://doi.org/10.1001/jama.2013.281053.
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Declarations of Interest
None.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
O’Connor, M., Stapleton, A., Barrett, K. et al. Testing the Psychometric Properties of the Newly Developed ACTive Values Wheel. Psychol Rec 71, 461–471 (2021). https://doi.org/10.1007/s40732-020-00447-6
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40732-020-00447-6