Abstract
As positive organizational behavior research expands internationally, it is necessary to evaluate often-utilized measures for consistency across countries. The aim of this study was to identify three such scales—The PsyCap Questionnaire (PCQ), the Short Grit Scale (SGS), and the Gratitude Questionnaire (GQ)—and evaluate their psychometric properties in Chilean and US workers. The Chilean sample (n = 264) was comprised of employees currently enrolled in an MBA program and completed surveys in-person. The USA sample (n = 289) was comprised of employees recruited from MTurk and completed surveys online. Analyses revealed that the 12-item version of the PCQ was superior to the 24-item version. A bifactor model was superior to a one- or two-factor model when using the SGS. Strong measurement invariance was supported for the PCQ-12 and the SGS, but not the GQ. Chileans reported higher PsyCap and general grit compared to US workers. The PCQ-12 and SGS can be reliably used and compared across Chile and the USA, but the GQ requires more study.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
The data are available on the Open Science Framework: https://doi.org/10.17605/OSF.IO/W9CX4
Notes
Scales administered to the Chilean sample were translated and back translated by the third author of this paper in line with Brislin’s (1970) recommendations.
References
Adler, M. G., & Fagley, N. S. (2005). Appreciation: Individual differences in finding value and meaning as a unique predictor of subjective well-being. Journal of Personality, 73, 79–114. https://doi.org/10.1111/j.1467-6494.2004.00305.x.
Asparouhov, T., & Muthén, B. (2009). Exploratory structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 16, 397–438. https://doi.org/10.1080/10705510903008204.
Avey, J. B., Luthans, F., Smith, R. M., & Palmer, N. F. (2010). Impact of positive psychological capital on employee well-being over time. Journal of Occupational Health Psychology, 15, 17–28. https://doi.org/10.1037/a0016998.
Avey, J. B., Avolio, B. J., & Luthans, F. (2011). Experimentally analyzing the impact of leadership positivity on follower positivity and performance. The Leadership Quarterly, 21, 350–364. https://doi.org/10.1016/j.leaqua.2011.02.004.
Bandura, A. (2000). Cultivate self-efficacy for personal and organizational effectiveness. In E. A. Locke (Ed.), The Blackwell handbook of principles of organizational behavior (pp. 120–136). Oxford, UK: Blackwell. https://doi.org/10.1002/9781119206422.ch10.
Barends, A. J., & de Vries, R. E. (2019). Noncompliant responding: Comparing exclusion criteria in MTurk personality research to improve data quality. Personality and Individual Differences, 143, 84–89. https://doi.org/10.1016/j.paid.2019.02.015.
Barnette, J. J. (2000). Effects of stem and Likert response option reversals on survey internal consistency: If you feel the need, there is a better alternative to using those negatively worded stems. Educational and Psychological Measurement, 60, 361–370. https://doi.org/10.1177/00131640021970592.
Boehm, J. K., Lyubomirsky, S., & Sheldon, K. M. (2011). A longitudinal experimental study comparing the effectiveness of happiness-enhancing strategies in Anglo Americans and Asian Americans. Cognition & Emotion, 25, 1263–1272. https://doi.org/10.1080/02699931.2010.541227.
Brislin, R. W. (1970). Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1, 185–216. https://doi.org/10.1177/135910457000100301.
Britt, T. W., Shen, W., Sinclair, R. R., Grossman, M. R., & Klieger, D. M. (2016). How much do we really know about resilience? Industrial and Organizational Psychology, 9, 378–404. https://doi.org/10.1017/iop.2015.107.
Brown, T. A. (2015). Confirmatory factor analysis for applied research. New York: Guilford Press.
Bruner, G. C. (2003). Combating scale proliferation. Journal of Targeting, Measurement and Analysis for Marketing, 11, 1479–1862. https://doi.org/10.1057/palgrave.jt.5740091.
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon’s mechanical Turk: A new source of cheap, yet high-quality, data? Perspectives on Psychological Science, 6, 3–5. https://doi.org/10.1177/1745691610393980.
Carmon-Hally, M. A., Marín-Gutierrez, M., & Belmar-Saavedra, F. (2015). Psychometric analysis of Gratitude Questionnaire 6 (GQ-6) in Chilean population. Universitas Psychologica, 14, 881–888. https://doi.org/10.11144/Javeriana.upsy14-3.apgq.
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14, 464–504. https://doi.org/10.1080/10705510701301834.
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9, 233–255. https://doi.org/10.1207/s15328007sem0902_5.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
Credé, M., Tynan, M. C., & Harms, P. D. (2017). Much ado about grit: A meta-analytic synthesis of the grit literature. Journal of Personality and Social Psychology, 113, 492–511. https://doi.org/10.1037/pspp0000102.
Danner, D., Lechner, C. M., & Rammstedt, B. (2019). A cross-national perspective on the associations of grit with career success. Compare: A Journal of Comparative and International Education, 50, 185–201. https://doi.org/10.1080/03057925.2019.1617110.
Datu, J. A. D. (2017). Sense of relatedness is linked to higher grit in a collectivist setting. Personality and Individual Differences, 105, 135–138. https://doi.org/10.1016/j.paid.2016.09.039.
Datu, J. A. D., Valdez, J. P. M., & King, R. B. (2016). Perseverance counts but consistency does not! Validating the short grit scale in a collectivist setting. Current Psychology, 35, 121–130. https://doi.org/10.1007/s12144-015-9374-2.
Datu, J. A. D., Yuen, M., & Chen, G. (2017). Grit and determination: A review of literature with implications for theory and research. Journal of Psychologists and Counsellors in Schools, 27, 168–176. https://doi.org/10.1017/jgc.2016.2.
Dawkins, S., Martin, A., Scott, J., & Sanderson, K. (2013). Building on the positives: A psychometric review and critical analysis of the construct of psychological capital. Journal of Occupational and Organizational Psychology, 86, 348–370. https://doi.org/10.1111/joop.12007.
Di Fabio, A., Palazzeschi, L., & Bucci, O. (2017). Gratitude in organizations: A contribution for healthy organizational contexts. Frontiers in Psychology, 8, 2025. https://doi.org/10.3389/fpsyg.2017.02025.
Disabato, D. J., Goodman, F. R., Kashdan, T. B., Short, J. L., & Jarden, A. (2016). Different types of well-being? A cross-cultural examination of hedonic and eudaimonic well-being. Psychological Assessment, 28, 471–482. https://doi.org/10.1037/pas0000209.
Disabato, D. J., Goodman, F. R., & Kashdan, T. B. (2018). Is grit relevant to well-being and strengths? Evidence across the globe for separating perseverance of effort and consistency of interests. Journal of Personality, 87, 194–211. https://doi.org/10.1111/jopy.12382.
Donaldson, S. I., & Ko, I. (2010). Positive organizational psychology, behavior, and scholarship: A review of the emerging literature and evidence base. The Journal of Positive Psychology, 5, 177–191. https://doi.org/10.1080/17439761003790930.
Duckworth, A. L., & Quinn, P. D. (2009). Development and validation of the short grit scale (Grit-S). Journal of Personality Assessment, 91, 166–174. https://doi.org/10.1080/00223890802634290.
Duckworth, A. L., Peterson, C., Matthews, M. D., & Kelly, D. R. (2007). Grit: Perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92, 1087–1101. https://doi.org/10.1037/0022-3514.92.6.1087.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates.
Emmons, R. A. (2003). Acts of gratitude in organizations. In K. S. Cameron, J. E. Dutton, & R. E. Quinn (Eds.), Positive organizational scholarship (pp. 81–93). San Francisco, CA: Berrett-Koehler Publishers.
Eskreis-Winkler, L., Shulman, E. P., Beal, S. A., & Duckworth, A. L. (2014). The grit effect: Predicting retention in the military, the workplace, school and marriage. Frontiers in Psychology, 5, 36. https://doi.org/10.3389/fpsyg.2014.00036.
Fan, X., & Sivo, S. A. (2009). Using ΔGoodness-of-fit indexes in assessing mean structures. Structural Equation Modeling: A Multidisciplinary Journal, 16, 54–69. https://doi.org/10.1080/10705510802561311.
Fineman, S. (2006). On being positive: Concerns and counterpoints. The Academy of Management Review, 31, 270–291. https://doi.org/10.5465/amr.2006.20208680.
Froh, J. J., Fan, J., Emmons, R. A., Bono, G., Huebner, E. S., & Watkins, P. (2011). Measuring gratitude in youth: Assessing the psychometric properties of adult gratitude scales in children and adolescents. Psychological Assessment, 23, 311–324. https://doi.org/10.1037/a0021590.
Gorsuch, R. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
Grant, A. M., & Wrzesniewski, A. (2010). I won’t let you down … or will I? Core self-evaluations, other-orientation, anticipated guilt, and gratitude, and job performance. Journal of Applied Psychology, 95, 108–121. https://doi.org/10.1037/a0017974.
Hayes, A. F., & Coutts, J. J. (2020). Use omega rather than Cronbach’s alpha for estimating reliability. But…. Communication Methods and Measures, 14, 1–24. https://doi.org/10.1080/19312458.2020.1718629.
Heggestad, E. D., Scheaf, D. J., Banks, G. C., Hausfeld, M. M., Tonidandel, S., & Williams, E. B. (2019). Scale adaptation in organizational science research: A review and best-practice recommendations. Journal of Management, 45, 2596–2627. https://doi.org/10.1177/0149206319850280.
Hermida, R. (2015). The problem of allowing correlated errors in structural equation modeling: Concerns and considerations. Computational Methods in Social Sciences, 3, 5–17.
Hobfoll, S. E. (1989). Conservation of resources: A new attempt at conceptualizing stress. American Psychologist, 44, 513–524. https://doi.org/10.1037/0003-066x.44.3.513.
Hobfoll, S. E., Halbesleben, J., Neveu, J., & Westman, M. (2018). Conservation of resources in the organizational context: The reality of resources and their consequences. Annual Review of Organizational Psychology and Organizational Behavior, 5, 103–128. https://doi.org/10.1146/annurev-orgpsych-032117-104640.
Hofstede, G. (2001). Cultures consequences: Comparing values, behaviors, institutions, and organizations across nations. Sage Publications. https://doi.org/10.5465/amr.2002.7389951.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1–55. https://doi.org/10.1080/10705519909540118.
Hulin, C. L. (1987). A psychometric theory of evaluations of item and scale translations fidelity across languages. Journal of Cross-Cultural Psychology, 18, 115–142. https://doi.org/10.1177/0022002187018002001.
IBM Corp. (2016). IBM SPSS statistics for windows, version 24.0. Armonk, NY: IBM Corp.
Jordan, S. L., Ferris, G. R., Hochwarter, W. A., & Wright, T. A. (2019). Toward a work motivation conceptualization of grit in organizations. Group & Organization Management, 44, 320–360. https://doi.org/10.1177/1059601119834093.
Kang, Y., McNeish, D. M., & Hancock, G. R. (2016). The role of measurement quality on practical guidelines for assessing measurement and structural invariance. Educational and Psychological Measurement, 76, 533–561. https://doi.org/10.1177/0013164415603764.
Kee, Y. H., Tsai, Y., & Chen, L. H. (2008). Relationships between traditional and sense of gratitude among Taiwanese high school athletes. Psychological Reports, 102, 920–926. https://doi.org/10.2466/pr0.102.3.920-926.
Langer, A., Ulloa, V. G., Aguilar-Parra, J. M., Araya-Véliz, C., & Brito, G. (2016). Validation of a Spanish translation of the Gratitude Questionnaire (GQ-6) with a Chilean sample of adults and high schoolers. Health and Quality of Life Outcomes, 14, 53. https://doi.org/10.1186/s12955-016-0450-6.
Layous, K., Lee, H., Choi, I., & Lyubomirsky, S. (2013). Culture matters when designing a successful happiness-increasing activity: A comparison of the United States and South Korea. Journal of Cross-Cultural Psychology, 44, 1294–1303. https://doi.org/10.1177/0022022113487591.
Lorenz, T., Beer, C., Pütz, J., & Heinitz, K. (2016). Measuring psychological capital: Construction and validation of the Compound PsyCap Scale (CPC-12). PLoS One, 11, e0152892. https://doi.org/10.1371/journal.pone.0152892.
Lubke, G., & Muthén, B. (2004). Applying multigroup confirmatory factor models for continuous outcomes to Likert scale data complicates meaningful group comparisons. Structural Equation Modeling: A Multidisciplinary Journal, 11, 514–534. https://doi.org/10.1207/s15328007sem1104_2.
Luthans, F., & Youssef, C. M. (2004). Human, social, and now positive psychological capital management: Investing in people for a competitive advantage. Organizational Dynamics, 33, 143–160. https://doi.org/10.1016/j.orgdyn.2004.01.003.
Luthans, F., & Youssef-Morgan, C. M. (2017). Psychological capital: An evidence-based positive approach. Annual Review of Organizational Psychology and Organizational Behavior, 4, 339–366. https://doi.org/10.1146/annurev-orgpsych-032516-113324.
Luthans, F., Avolio, B. J., Avey, J. B., & Norman, S. M. (2007). Positive psychological capital: Measurement and relationship with performance and satisfaction. Personnel Psychology, 60, 541–572. https://doi.org/10.1111/j.1744-6570.2007.00083.x.
Luthans, F., Youssef-Morgan, C. M., & Avolio, B. J. (2015). Psychological capital and beyond. New York: Oxford University Press.
Masten, A. S. (2001). Ordinary magic: Resilience processes in development. American Psychologist, 56, 227–239. https://doi.org/10.1037/0003-066x.56.3.227.
McCullough, M. E., Emmons, R. A., & Tsang, J. (2002). The grateful disposition: A conceptual and empirical topography. Journal of Personality and Social Psychology, 82, 112–127. https://doi.org/10.1037/0022-3514.82.1.112.
Meade, A. W., Michels, L. C., & Lautenschlager, G. J. (2007). Are internet and paper-and-pencil personality tests truly comparable? An experimental design measurement invariance study. Organizational Research Methods, 10, 322–345. https://doi.org/10.1177/1094428106289393.
Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93, 568–592. https://doi.org/10.1037/0021-9010.93.3.568.
Milfont, T. L., & Fischer, R. (2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3, 111–121. https://doi.org/10.21500/20112084.857.
Mortenson, K., & Hughes, T. L. (2018). Comparing Amazon’s Mechanical Turk to conventional data collection methods in the health and medical research literature. Journal of General Internal Medicine, 33, 533–538. https://doi.org/10.1007/s11606-017-4246-0.
Muthén, L. K., & Muthén, B. O. (1998–2010). Mplus user’s guide (6th ed.). Muthén & Muthén Los Angeles, CA.
Newman, A., Ucbasaran, D., Zhu, F., & Hirst, G. (2014). Psychological capital: A review and synthesis. Journal of Organizational Behavior, 35, S120–S138. https://doi.org/10.1002/job.1916.
Padilla, M. A., & Divers, J. (2013). Coefficient omega bootstrap confidence intervals: Nonnormal distributions. Educational and Psychological Measurement, 73, 956–972. https://doi.org/10.1177/0013164413492765.
Paolacci, G., & Chandler, J. (2014). Inside the Turk: Understanding Mechanical Turk as a participant pool. Current Directions in Psychological Science, 23, 184–188. https://doi.org/10.1177/0963721414531598.
Peer, E., Vosgerau, J., & Acquisti, A. (2014). Reputation as a sufficient condition for data quality on Amazon Mechanical Turk. Behavior Research Methods, 46, 1023–1031. https://doi.org/10.3758/s13428-013-0434-y.
Probst, T. M., Gailey, N. J., Jiang, L., & Bohle, S. L. (2017). Psychological capital: Buffering the longitudinal curvilinear effects of job insecurity on performance. Safety Science, 100, 74–82. https://doi.org/10.1016/j.ssci.2017.02.002.
Raju, N. S., Laffitte, L. J., & Byrne, B. M. (2002). Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87, 517–529. https://doi.org/10.1037//0021-9010.87.3.517.
Rhemtulla, M., Brosseau-Liard, P. E., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17, 354–373. https://doi.org/10.1037/a0029315.
Rice, S. P. M. (2020). Measuring well-being: A longitudinal psychometric investigation into the theoretical structures of well-being and implications for assessment (publication no. 27739173) [doctoral dissertation, Washington State University]. ProQuest Dissertations Publishing.
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21, 137–150. https://doi.org/10.1037/met0000045.
Scheier, M. F., & Carver, C. S. (1985). Optimism, coping, and health: Assessment and implications of generalized outcome expectancies. Health Psychology, 4, 219–247. https://doi.org/10.1037/0278-6133.4.3.219.
Seligman, M. E. P., & Csikszentmihalyi, M. (2000). Positive psychology: An introduction. American Psychologist, 55, 5–14. https://doi.org/10.1037/0003-066X.55.1.5.
Sin, N. L., & Lyubomirsky, S. (2009). Enhancing well-being and alleviating depressive symptoms with positive psychology interventions: A practice-friendly meta-analysis. Journal of Clinical Psychology, 65, 467–487. https://doi.org/10.1002/jclp.20593.
Snyder, C. R. (2000). Handbook of hope. Academic Press.
Spence, J. R., Brown, D. J., Keeping, L. M., & Lian, H. (2014). Helpful today, but not tomorrow? Feeling grateful as a predictor of organizational citizenship behaviors. Personnel Psychology, 67, 705–738. https://doi.org/10.1111/peps.12051.
Stahl, G. K., & Tung, R. (2015). Towards a more balanced treatment of culture in international business studies: The need for positive cross-cultural scholarship. Journal of International Business Studies, 46, 391–414. https://doi.org/10.1057/jibs.2014.68.
Steenkamp, J. E. M., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78–90. https://doi.org/10.1086/209528.
Triandis, H. C., Bontempo, R., Villareal, M. J., Asai, M., & Lucca, N. (1988). Individualism and collectivism: Cross-cultural perspectives on self-ingroup relationships. Journal of Personality and Social Psychology, 54, 323–338. https://doi.org/10.1037/0022-3514.54.2.323.
Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–69. https://doi.org/10.1177/109442810031002.
Waters, L. (2012). Predicting job satisfaction: Contributions of individual gratitude and institutionalized gratitude. Psychology, 3, 1174–1176. https://doi.org/10.4236/psych.2012.312a173.
Watkins, P. C., Woodward, K., Stone, T., & Kolts, R. L. (2003). Gratitude and happiness: Development of a measure of gratitude, and relationship with subjective well-being. Social Behavior & Personality: An International Journal, 31, 431–452. https://doi.org/10.2224/sbp.2003.31.5.431.
Wernsing, T. (2014). Psychological capital: A test of measurement invariance across 12 national cultures. Journal of Leadership & Organizational Studies, 21, 179–190. https://doi.org/10.1177/1548051813515924.
Wood, A. M., Maltby, J., Stewart, N., & Joseph, S. (2008a). Conceptualizing gratitude and appreciation as a unitary personality trait. Personality and Individual Differences, 44, 621–632. https://doi.org/10.1016/j.paid.2007.09.028.
Wood, A. M., Maltby, J., Stewart, N., Linley, P. A., & Joseph, S. (2008b). A social-cognitive model of trait and state levels of gratitude. Emotion, 8, 281–290. https://doi.org/10.1037/1528-3542.8.2.281.
Yoon, M., & Lai, M. H. C. (2018). Testing factorial invariance with unbalanced samples. Structural Equation Modeling: A Multidisciplinary Journal, 25, 201–213. https://doi.org/10.1080/10705511.2017.1387859.
Acknowledgments
This research was partially supported by an Edward R. Meyer Distinguished Professorship award granted to the second author by Washington State University. This research was also supported by a Proyecto Dicyt USACH (Grant No. 031861LB), Vicerrectoría de Investigación, Desarrollo e Innovación de Universidad de Santiago de Chile granted to the third author. The authors would like to posthumously acknowledge the valuable assistance provided by Nicholas J. Gailey with data collection.
Code Availability
Mplus syntax for measurement invariance tests available on request.
Funding
This research was partially supported by an Edward R. Meyer Distinguished Professorship award granted to the second author by Washington State University.
This research was partially supported by a Proyecto Dicyt USACH (grant number 031861LB), Vicerrectoría de Investigación, Desarrollo e Innovación de Universidad de Santiago de Chile granted to the third author.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation and data collection were performed by Tahira Probst and Sergio López Bohle, and analyses were performed by Sean Rice. The first draft of the manuscript was written by Sean Rice, and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
This protocol was classified as exempt by the Washington State University Institutional Review Board (No. 14353), and approved by the Universidad de Santiago de Chile IRB (Resolution No. 54), prior to implementation. Participants provided informed consent prior to enrolling in the study.
Conflict of Interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
ESM 1
(DOCX 26 kb)
Rights and permissions
About this article
Cite this article
Rice, S.P.M., Probst, T.M. & Bohle, S.L. Psychometric Properties and Measurement Invariance of Psychological Capital, Grit, and Gratitude in Selected Samples from Chile and the USA. J well-being assess 4, 369–390 (2020). https://doi.org/10.1007/s41543-021-00039-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41543-021-00039-3