Abstract
Purpose
The Profile of Mood States-Short Form (POMS-SF) is a well-validated tool commonly used in medical/clinical research. Less attention has been paid to the measurement invariance of the POMS—the degree to which the structure and items behave similarly for different groups (e.g., women and men). This study investigated the measurement invariance of the POMS Depression subscale across gender groups in a sample of cancer survivors.
Methods
The POMS Depression subscale has 8 items (Unhappy, Sad, Blue, Hopeless, Discouraged, Miserable, Helpless, and Worthless). Invariance was measured using multigroup confirmatory factor analysis. This study used data from American Cancer Society Studies of Cancer Survivors-II, a population-based survey of adult cancer survivors (n = 9170).
Results
We found factor structures and factor loadings were invariant for gender groups, but moderate differential item functioning (DIF) in the question containing the word blue.
Conclusion
With regard to cancer survivors’ gender, we found the Depression subscale of the POMS-SF had configural invariance, and partial metric and scalar invariance. This suggests that results should be interpreted with caution, especially when gender is considered important. More broadly, our finding suggests that questions with the word blue may introduce DIF into other measures of depressive mood. More research is needed to replicate these findings in other samples and with other instruments.
References
American Psychiatric Association. (2000). Cautionary statement. In Diagnostic and statistical manual of mental disorders (4th ed., text rev.). doi:10.1176/appi.books.9780890423349.11547.
Anderson, B. L., DeRubeis, R. J., Berman, B. S., Gruman, J., Champion, V. L., Massie, M. J., et al. (2014). Screening, assessment, and care of anxiety and depressive symptoms in adults with cancer: An American Society of Clinical Oncology guideline adaption. Journal of Clinical Oncology, 32(15), 1605–1619.
Brunet, J., Sabiston, C. M., Chaiton, M., Low, N. C., Contrera, G., Barnett, T. A., et al. (2014). Measurement invariance of the depressive symptoms scale during adolescence. BMC Psychiatry, 14, 95–105.
Cella, D., & Stone, A. A. (2015). Health-related quality of life measurement in oncology. American Psychologist, 70(2), 175–185.
Curran, S. L., Andrykowski, M. A., & Studts, J. L. (1995). Short form of the Profile of Mood States (POMS-SF): Psychometric information. Psychological Assessment, 7(1), 80–83.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299.
Finney, S. J., & DiStefano, C. (2006). Dealing with nonnormality and categorical data in structural equation modeling. In G. R. Hancock & R. O. Mueller (Eds.), Chapter in a second course in structural equation modeling. Greenwich: Information Age Publishing, Inc.
Goe, L., Bell, C., & Little, O. (2008). Approaches to evaluating teacher effectiveness: A research synthesis. Washington: National Comprehensive Center for Teacher Quality.
Grant, B. F., & Weissman, M. M. (2007). Gender and the prevalence of psychiatric disorders. In W. E. Narrow, M. B. First, P. J. Sirovatka, & D. A. Regier (Eds.), Age and gender considerations in psychiatric diagnosis: A research agenda for DSM-V (pp. 31–46). Washington: American Psychiatric Association.
Hennessy, C. H., Moriarty, D. G., Zack, M. M., Scherr, P. A., & Brackbill, R. (1994). Measuring health-related quality of life for public health surveillance. Public Health Reports, 109, 665–672.
Holland, P. W., & Wainer, H. (1993). Differential item functioning. New York: Routledge.
Isometsã, E. T., Heikkinen, M., Marttunen, M., Henriksson, M., Aro, H., Kuoppasalmi, K., et al. (1997). Mental disorders in young and middle aged men who commit suicide. The British Medical Journal, 310(6991), 1366–1367.
Jodoin, M., & Girl, M. (2001). Evaluating type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14, 329–349.
Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525–543.
Millsap, R. E., & Kwok, O. M. (2004). Evaluating the impact of partial measurement invariance on selection in two populations. Psychological Methods, 9, 93–115.
NcNair, D. M., Lorr, M., & Droppleman, L. F. (1992). Revised manual for the 16 Profile of Mood States. San Diego: Educational and Industrial Testing Services.
Plecki, M. L., Elfers, A. M., & Nakamura, Y. (2012). Using evidence for teacher education program improvement and accountability: An illustrative case of the role of value-added measures. Journal of Teacher Education, 63, 318–334.
Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552–566.
Raju, N. S., Oshima, T. C., van Der Linden, W. J., & Fleer, P. F. (1995). An IRT-based internal measure of test bias with applications for differential item functioning. Applied Psychological Measurement, 19, 353–368.
Shacham, S. (1983). A shortened version of the Profile of Mood States. Journal of Personality Assessment, 47, 305–306.
Shear, K., Halmi, K. A., Widiger, T. A., & Boyce, C. (2007). Sociocultural factors and gender. In W. E. Narrow, M. B. First, P. J. Sirovatka, & D. A. Regier (Eds.), Age and gender considerations in psychiatric diagnosis: A research agenda for DSM-V (pp. 65–79). Washington: American Psychiatric Association.
Smith, T., Stein, K. D., Mehta, C. C., Kaw, C., Kepner, J. L., Buskirk, T., et al. (2007). The rationale, design, and implementation of the American Cancer Society’s studies of cancer survivors. Cancer, 1(1), 1–12.
Substance Abuse and Mental Health Services Administration. Results from the 2013 National Survey on Drug Use and Health: Mental health findings, NSDUH Series H-49, HHS Publication No. (SMA) 14-4887. Rockville: Substance Abuse and Mental Health Services Administration, 2014.
Van de Vijver, F. J. R., & Poortinga, Y. H. (1997). Towards an integrated analysis of bias in cross-cultural assessment. European Journal of Psychological Assessment, 13, 29–37. doi:10.1027/1015-5759.13.1.29.
Acknowledgements
The American Cancer Society (ACS) Studies of Cancer Survivors (SCS) was funded as an intramural program of research conducted by the ACS Behavioral Research Center. We wish to acknowledge the cooperation and efforts of the cancer registries and public health departments from the states of Arizona, California (Regions 2–6), Colorado, Delaware, Illinois, Iowa, Maine, Massachusetts, Michigan, Nebraska, New Jersey, Pennsylvania, Washington, and Wyoming. We also thank the staff of the hundreds of hospitals that reported cases to the participating cancer registries. Lastly, we are grateful to the thousands of cancer survivors, their physicians, and their loved ones who contributed to the collection of these data. The authors assume full responsibility for analyses and interpretation of these data.
Funding
This study was funded by an intramural program of research conducted by the American Cancer Society’s Behavioral Research Center.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical standards
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Kim, J., Smith, T. Exploring measurement invariance by gender in the profile of mood states depression subscale among cancer survivors. Qual Life Res 26, 171–175 (2017). https://doi.org/10.1007/s11136-016-1452-x
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11136-016-1452-x