Skip to main content
Log in

Testing Measurement Invariance of the Positive and Negative Affect Schedule (PANAS) in American and Arab University Students

  • Original Article
  • Published:
International Journal of Mental Health and Addiction Aims and scope Submit manuscript

Abstract

Affect describes any feelings, emotions, or moods that a person experiences and is generally divided into two broad dimensions—positive affect and negative affect. The most widely used measure of affect, the Positive and Negative Affect Schedule (PANAS), has recently been translated to Arabic (see Appendix), yet the psychometric equivalence of this adapted measure is not fully understood. Using a series of multigroup confirmatory factor analyses, the current study examined measurement invariance of the English and adapted Arabic versions of the PANAS among 979 American and 1470 Arab university students. Although the two-factor structure of the 20-item PANAS was observed in both groups (configural variance), results did not support full invariance of factor loadings (metric invariance). A partial metric invariance model, however, revealed invariant loadings for all positive affect items and all but four negative affect items; dissimilar factor loadings emerged between groups for irritable, nervous, scared, and jittery. Evidence did not support scalar invariance of the 16 metric-invariant items, with only ten items demonstrating equivalent intercepts across groups. Finally, tests for strict invariance indicated nine of the ten scalar-invariant items had equivalent residual variances across groups.

All told, results suggest that the PANAS is partially invariant in American and Arab groups.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  • Bodenhausen, G. V., Sheppard, L. A., & Kramer, G. P. (1994). Negative affect and social judgment: The differential impact of anger and sadness. European Journal of Social Psychology, 24(1), 45–62. https://doi.org/10.1002/ejsp.2420240104.

    Article  Google Scholar 

  • Bryan, T., Sullivan-Burstein, K., & Mathur, S. (1998). The influence of affect on social information processing. Journal of Learning Difficulties, 31, 418–426. https://doi.org/10.1177/002221949803100501.

    Article  CAS  Google Scholar 

  • Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5.

    Article  Google Scholar 

  • Crawford, J. R., & Henry, J. D. (2004). The Positive and Negative Affect Schedule (PANAS): Construct validity, measurement properties and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 43(3), 245–265. https://doi.org/10.1348/0144665031752934.

    Article  Google Scholar 

  • Díaz-García, A., González-Robles, A., Mor, S., Mira, A., Quero, S., García-Palacios, A., Baños, R. M., & Botella, C. (2020). Positive and Negative Affect Schedule (PANAS): Psychometric properties of the online Spanish version in a clinical sample with emotional disorders. BMC Psychiatry, 20(1), 56. https://doi.org/10.1186/s12888-020-2472-1.

    Article  PubMed  PubMed Central  Google Scholar 

  • Dockray, S., & Steptoe, A. (2010). Positive affect and psychobiological processes. Neuroscience and Biobehavioral Reviews, 35(1), 69–75. https://doi.org/10.1016/j.neubiorev.2010.01.006.

    Article  PubMed  PubMed Central  Google Scholar 

  • Estévez-López, F., Pulido-Martos, M., Armitage, C. J., Wearden, A., Álvarez-Gallardo, I. C., Arrayás-Grajera, M. J., Girela-Rejón, M. J., Carbonell-Baeza, A., Aparicio, V. A., Geenen, R., Delgado-Fernández, M., & Segura-Jiménez, V. (2016). Factor structure of the Positive and Negative Affect Schedule (PANAS) in adult women with fibromyalgia from Southern Spain: The al-Ándalus project. PeerJ, 4, e1822. https://doi.org/10.7717/peerj.1822.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Joiner Jr., T. E., Sandín, B., Chorot, P., Lostao, L., & Marquina, G. (1997). Development and factor analytic validation of the SPANAS among women in Spain: (More) Cross-cultural convergence in the structure of mood. Journal of Personality Assessment, 68(3), 600–615. https://doi.org/10.1207/s15327752jpa6803_8.

    Article  PubMed  Google Scholar 

  • Lee, S. T. H., Hartanto, A., Yong, J. C., Koh, B., & Leung, A. K. (2019). Examining the cross-cultural validity of the positive affect and negative affect schedule between an Asian (Singaporean) sample and a Western (American) sample. Asian Journal of Social Psychology, 23, 109–116. https://doi.org/10.1111/ajsp.12390.

    Article  Google Scholar 

  • Lin, M., Lucas Jr., H. C., & Shmueli, G. (2013). Too big to fail: Large samples and the p-value problem. Information Systems Research, 24(4), 906–917. https://doi.org/10.1287/isre.2013.0480.

    Article  Google Scholar 

  • Little, T. D., Card, N. A., Slegers, D. W., & Ledford, E. C. (2007). Representing contextual effects in multiple-group MACS models. In T. D. Little, J. A. Bovaird, & N. A. Card (Eds.), Modeling contextual effects in longitudinal studies (p. 121–147). Lawrence Erlbaum Associates Publishers.

  • McNeish, D. M., & Stapleton, L. M. (2016). The effect of small sample size on two-level model estimates: A review and illustration. Educational Psychology Review, 28(2), 295–314. https://doi.org/10.1007/s10648-014-9287-x.

    Article  Google Scholar 

  • Megreya, A. M., Latzman, R. D., Al-Attiyah, A. A., & Alrashidi, M. (2016). The robustness of the nine-factor structure of the Cognitive Emotion Regulation Questionnaire across four Arabic-speaking Middle Eastern countries. Journal of Cross-Cultural Psychology, 47(6), 875–890. https://doi.org/10.1177/0022022116644785.

    Article  Google Scholar 

  • Megreya, A. M., Latzman, R. D., Al-Emadi, A. A., & Al-Attiyah, A. A. (2018). An integrative model of emotion regulation and associations with positive and negative affectivity across four Arabic speaking countries and the USA. Motivation and Emotion, 42(4), 566–575. https://doi.org/10.1007/s11031-018-9682-6.

    Article  Google Scholar 

  • Merz, E. L., Malcarne, V. L., Roesch, S. C., Ko, C. M., Emerson, M., Roma, V. G., & Sadler, G. R. (2013). Psychometric properties of Positive and Negative Affect Schedule (PANAS) original and short forms in an African American community sample. Journal of Affective Disorders, 151(3), 942–949. https://doi.org/10.1016/j.jad.2013.08.011.

    Article  PubMed  PubMed Central  Google Scholar 

  • Milfont, T. L., & Fischer, R. (2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3(1), 111–130. https://doi.org/10.21500/20112084.857.

    Article  Google Scholar 

  • Muthén, L. K., & Muthén, B. O. (1998-2017). Mplus user’s guide. Eighth Edition. Los Angeles: Muthén & Muthén.

    Google Scholar 

  • Pandey, R., & Shrivastava, N. (2008). Psychometric evaluation of a Hindi version of Positive and Negative Affect Schedule. Industrial Psychiatry Journal, 17(1), 49–54.

    Google Scholar 

  • Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004.

    Article  Google Scholar 

  • Raykov, T. (2012). Scale construction and development using structural equation modeling. In R. H. Hoyle (Ed.), Handbook of structural equation modeling (pp. 472–492). New York, NY: The Guilford Press.

    Google Scholar 

  • Rigdon, E. E. (1998). Structural equation modeling. In G. A. Marcoulides (Ed.), Methodology for business and management. Modern methods for business research (p. 251–294). Lawrence Erlbaum Associates Publishers.

  • Serafini, K., Malin-Mayor, B., Nich, C., Hunkele, K., & Carroll, K. M. (2016). Psychometric properties of the Positive and Negative Affect Schedule (PANAS) in a heterogeneous sample of substance users. The American Journal of Drug and Alcohol Abuse, 42(2), 203–212. https://doi.org/10.3109/00952990.2015.1133632.

    Article  PubMed  PubMed Central  Google Scholar 

  • Terraciano, A., McCrae, R. R., & Costa Jr., P. T. (2003). Factorial and construct validity of the Italian Positive and Negative Affect Schedule (PANAS). European Journal of Psychological Assessment, 19(2), 131–141. https://doi.org/10.1027//1015-5759.19.2.131.

    Article  Google Scholar 

  • Thompson, E. R. (2007). Development and validation of an internationally reliable short-form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227–242. https://doi.org/10.1177/0022022106297301.

    Article  Google Scholar 

  • Tuccitto, D. E., Giacobbi, P. R., & Leite, W. L. (2010). The internal structure of positive and negative affect: A confirmatory factor analysis of the PANAS. Educational and Psychological Measurement, 70(1), 125–141. https://doi.org/10.1177/0013164409344522.

    Article  Google Scholar 

  • van de Vijver, F. J. R., & Leung, K. (1997). Methods and data analysis of comparative research. In J. W. Berry, Y. H. Poortinga, & J. Pandey (Eds.), Handbook of cross-cultural psychology (2nd ed., pp. 257–300). Boston: Allyn & Bacon.

    Google Scholar 

  • Watson, D., Clark, L. A., & Carey, G. (1988a). Positive and negative affectivity and their relation to anxiety and depressive disorders. Journal of Abnormal Psychology, 97(3), 346–353. https://doi.org/10.1037/0021-843X.97.3.346.

    Article  CAS  PubMed  Google Scholar 

  • Watson, D., Clark, L. A., & Tellegen, A. (1988b). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063–1070. https://doi.org/10.1037/0022-3514.54.6.1063.

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Robert D. Latzman.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2000.

Informed Consent

Informed consent was obtained from all patients for being included in the study.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix 1

Appendix 1

figure a

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Davis, R.C., Arce, M.A., Tobin, K.E. et al. Testing Measurement Invariance of the Positive and Negative Affect Schedule (PANAS) in American and Arab University Students. Int J Ment Health Addiction 20, 874–887 (2022). https://doi.org/10.1007/s11469-020-00411-z

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11469-020-00411-z

Keywords

Navigation