Abstract
The purpose of this study was to examine validation practice with a single, well-known, and widely used measure, the Satisfaction with Life Scale (SWLS; Diener et al. J Personal Assess 49:71–75, 1985). A comprehensive list of 35 articles from 1985 to 2012 was identified using PsycINFO. Using the Standards for Educational and Psychological Testing (AERA et al. Standards for educational and psychological testing. American Educational Research Association, Washington, DC, 1999), each of 46 studies was coded for sources of reliability evidence and five sources of validation evidence. The majority of validation studies involved translated versions of the SWLS. SWLS validation studies tended to focus on internal consistency reliability, internal structure, and convergent validity evidence. No test content or consequences of testing validation sources of evidence were presented. Overall, reliability and internal structure procedures tended to be well-reported. Critically, a greater understanding is needed of relations to other variables evidence and how to both interpret and report it.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Henceforth referred to as The Standards.
- 2.
The total number of articles do not sum to 25 as one article included a new translation in one language and presumably a pre-existing version in another language.
- 3.
Three studies were contained within a single article wherein the author conducted reliability analyses on three different samples.
- 4.
The focus of this methodological article was on describing steps to identify essential unidimensionality that could be used with either EFA or CFA. SWLS data were used as an example. Because it was unclear as to whether the researchers actually used CFA or EFA analyses with this data, this study was not included in the base rate counts in subsequent internal structure sections.
- 5.
* indicates articles included in the validation synthesis
References
* indicates articles included in the validation synthesis
*Abdallah, T. (1998). The Satisfaction with Life Scale (SWLS): Psychometric properties in an Arabic-speaking sample. International Journal of Adolescence and Youth, 7, 113–119.
American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement in Education (NCME). (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
American Psychological Association. (2013). PsycINFO Quick Facts. Retrieved May 14, 2013 from http://www.apa.org/pubs/databases/psycinfo/index.aspx
*Anaby, D., Jarus, T., & Zumbo, B. D. (2010). Psychometric evaluation of the Hebrew language version of the Satisfaction with Life Scale. Social Indicators Researcher, 96, 267–274. doi:10.1007/s11205-009-9476-z.
*Arrindell, W. A., Meeuwesen, L., & Huyse, F. J. (1991). The Satisfaction with Life Scale (SWLS): Psychometric properties in a non-psychiatric medical outpatients sample. Personality and Individual Differences, 12, 117–123.
*Arrindell, W. A., Heesink, J., & Feij, J. A. (1999). The Satisfaction with Life Scale (SWLS): Appraisal with 1700 healthy young adults in The Netherlands. Personality and Individual Differences, 26, 815–826.
*Athay, M. M. (2012). Satisfaction with Life Scale (SWLS) in caregivers of clinically-referred youth: Psychometric properties and mediation analysis. Administration and Policy in Mental Health and Mental Health Services Research, 39, 41–50. doi:10.1007/s10488-011-0390-8.
*Atienza, F. L., Balaguer, I., & García-Merita, M. L. (2003). Satisfaction with Life Scale: Analysis of factorial invariance across sexes. Personality and Individual Differences, 35, 1255–1260.
*Bai, X., Wu, C., Zheng, R., & Ren, X. (2011). The psychometric evaluation of the Satisfaction with Life Scale using a nationally representative sample of China. Journal of Happiness Studies, 12, 183–197. doi:10.1007/s10902-010-9186-x.
Barry, A. E., Chaney, B., Piazza-Gardner, A. K., & Chavarria, E. A. (2013). Validity and reliability reporting practices in the field of health education and behavior: A review of seven journals. Health Education & Behavior [online]. doi:10.1177/1090198113483139
Cizek, G. J., Rosenberg, S. L., & Koons, H. H. (2008). Sources of validity evidence for educational and psychological tests. Educational and Psychological Measurement, 68, 397–412. doi:10.1177/0013164407310130.
Cizek, G. J., Bowen, D., & Church, K. (2010). Sources of validity evidence for educational and psychological tests: A follow-up study. Educational and Psychological Measurement, 70, 732–743. doi:10.1177/0013164410379323.
Clark, A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7, 309–319.
*Clench-Aas, J., Nes, R. B., Dalgard, O. S., & Aarø, L. E. (2011). Dimensionality and measurement invariance in the Satisfaction with Life Scale in Norway. Quality of Life Research, 20, 1307–1317.
Cooper, H. (2010). Research synthesis and meta-analysis: A step by step approach (3rd ed.). Thousand Oaks: Sage.
Cooper, H., Hedges, L. V., & Valentine, J. C. (Eds.). (2009). The handbook of research synthesis and meta-analysis (2nd ed.). New York: Russell Sage.
Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78, 98–104.
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.
*Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction with Life Scale. Journal of Personality Assessment, 49, 71–75.
*Durak, M., Senol-Durak, E., & Gencoz, T. (2010). Psychometric properties of the Satisfaction with Life Scale among Turkish university students, correctional officers, and elderly adults. Social Indicators Research, 99, 413–429. doi:10.1007/s11205-010-9589-4.
Gadermann, A. M., Guhn, M., & Zumbo, B. D. (2011). Investigating the substantive aspect of construct validity for the Satisfaction of Life Scale adapted for children: A focus on cognitive processes. Social Indicators Research, 100, 37–60. doi:10.1007/s11205-010-9603-x.
*Glaesmer, H., Grande, G., Braehler, E., & Roth, M. (2011). The German version of the Satisfaction with Life Scale (SWLS): Psychometric properties, validity, and population-based norms. European Journal of Psychological Assessment, 27, 127–132.
*Gouveia, V. V., Milfont, T. L., Nunes da Fonseca, P., de Miranda, P., & Coelho, J. A. (2009). Life satisfaction in Brazil: Testing the psychometric properties of the Satisfaction with Life Scale (SWLS) in five Brazilian samples. Social Indicators Research, 90, 267–277.
Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7, 191–205.
Hogan, T. P., & Agnello, J. (2004). An empirical study of reporting practices concerning measurement validity. Educational and Psychological Measurement, 64, 802–812. doi:10.1177/0013164404264120.
Horn, J. L. (1991). Discussion of the issues of factorial invariance. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 114–125). Washington, DC: American Psychological Association.
Horn, J. L., & McArdle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Journal of Experimental Aging Research, 18, 117–144.
*Howell, R. T., Rodzon, K. S., Kurai, M., & Sanchez, A. H. (2010). A validation of well-being and happiness surveys for administration via the Internet. Behavior Research Methods, 42, 775–784. doi:10.3758/BRM.42.3.775.
Hubley, A. M., & Zumbo, B. D. (2011). Validity and the consequences of test interpretation and use. Social Indicators Research, 103, 219–230. doi:10.1007/s11205-011-9843.4.
Hubley, A. M., & Zumbo, B. D. (2013). Psychometric characteristics of assessment procedures: An overview. In K. F. Geisinger (Ed.), APA handbook of testing and assessment in psychology (Vol. 1, pp. 3–19). Washington, DC: American Psychological Association Press.
*Hultell, D., & Gustavsson, J. P. (2008). A psychometric evaluation of the Satisfaction with Life Scale in a Swedish nationwide sample of university students. Personality and Individual Differences, 44, 1070–1079.
Jonson, J. L., & Plake, B. S. (1998). A historical comparison of validity standards and validity practices. Educational and Psychological Measurement, 58, 736–753. doi:10.1177/0013164498058005002.
*Květon, P., Jelínek, M., Klimusová, H., & Vobořil, D. (2007). Data collection on the internet: Evaluation of web-based questionnaires. Studia Psychologica, 49, 81–88.
*Laranjeira, C. A. (2009). Preliminary validation study of the Portuguese version of the Satisfaction with Life Scale. Psychology, Health & Medicine, 14, 220–226.
Ledesma, R. D., & Valero-Mora, P. (2007). Determining the number of factors to retain in EFA: An easy-to-use computer program for carrying out parallel analysis. Practical Assessment, Research and Evaluation, 12, 1–11.
*Lewis, C. A., Shevlin, M. E., Bunting, B. P., & Joseph, S. (1995). Confirmatory factor analysis of the Satisfaction with Life Scale: Replication and methodological refinement. Perceptual and Motor Skills, 80, 304–306.
*Lewis, C. A., Shevlin, M. E., Smékal, V., & Dorahy, M. J. (1999). Factor structure and reliability of a Czech translation of the Satisfaction with Life Scale among Czech university students. Studia Psychologica, 41, 239–244.
Manten, A. A. (1973). Scientific literature reviews. Scholarly Publishing, 5, 75–89.
Meier, S. T., & Davis, S. R. (1990). Trends in reporting psychometric properties of scales used in counseling psychology research. Journal of Counseling Psychology, 37, 113–115. doi:10.1037/0022-0167.37.1.113.
Mulrow, C. D. (1994). Systematic reviews: Rationale for systematic reviews. British Medical Journal, 309, 597–599. doi:10.1136/bmj.309.6954.597.
*Navrátil, M., & Lewis, C. A. (2006). Temporal stability of the Czech translation of the Satisfaction with Life Scale: Test-retest data over one week. Psychological Reports, 98, 918–920.
Netemeyer, R., Bearden, W., & Sharma, S. (2003). Scaling procedures: Issues and applications. London: Sage.
*Neto, F. (1993). The Satisfaction with Life Scale: Psychometrics properties in an adolescent sample. Journal of Youth and Adolescence, 22, 125–134.
Olkin, I. (1996). Meta-analysis: Current issues in research synthesis. Statistics in Medicine, 15, 1253–1257.
*Pavot, W., Diener, E., Colvin, C. R., & Sandvik, E. (1991). Further validation of the Satisfaction with Life Scale: Evidence for the cross-method convergence of well-being measures. Journal of Personality Assessment, 57, 149–161.
*Pons, D., Atienza, F. L., Balaguer, I., & García-Merita, M. (2000). Satisfaction with Life Scale: Analysis of factorial invariance for adolescents and elderly persons. Perceptual and Motor Skills, 91, 62–68.
Qualls, A. L., & Moss, A. D. (1996). The degree of congruence between test standards and test documentation within journal publications. Educational and Psychological Measurement, 56, 209–214. doi:10.1177/0013164496056002002.
* Sancho, P., Galiana, L., Gutierrez, M., Francisco, E.-H., & Tomás, J. M. (2012). Validating the Portuguese version of the Satisfaction with Life Scale in an elderly sample. Social Indicators Research [online first]. doi:10.1007/s11205-012-9994-y
*Shevlin, M. E., & Bunting, B. P. (1994). Confirmatory factor analysis of the Satisfaction with Life Scale. Perceptual and Motor Skills, 79, 1316–1318.
*Shevlin, M., Brunsden, V., & Miles, J. N. V. (1998). Satisfaction with Life Scale: Analysis of factorial invariance, mean structures and reliability. Personality and Individual Differences, 25, 911–916.
*Siedlecki, K. L., Tucker-Drob, E. M., Oishi, S., & Salthouse, T. A. (2008). Life satisfaction across adulthood: Different determinants at different ages? The Journal of Positive Psychology, 3, 153–164.
Slaney, K. L., Tkatchouk, M., Gabriel, S. M., & Maraun, M. D. (2009). Psychometric assessment and reporting practices: Incongruence between theory and practice. Journal of Psychoeducational Assessment, 27, 465–476. doi:10.1177/0734282909335781.
Slaney, K. L., Tkatchouk, M., Gabriel, S. M., Ferguson, L. P., Knudsen, J. R. S., & Legere, J. C. (2010). A review of psychometric assessment and reporting practices: An examination of measurement-oriented versus non-measurement-oriented domains. Canadian Journal of School Psychology, 25, 246–259. doi:10.1177/0829573510375549.
*Slocum-Gori, S. L., Zumbo, B. D., Michalos, A. C., & Diener, E. (2009). A note on the dimensionality of quality of life scales: An illustration with the Satisfaction with Life Scale (SWLS). Social Indicators Research, 92, 489–496.
*Swami, V., & Chamorro-Premuzic, T. (2009). Psychometric evaluation of the Malay Satisfaction with Life Scale. Social Indicators Research, 92, 25–33.
Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Boston: Allyn & Bacon.
The Cochrane Collaboration. (2002). An introduction to meta-analysis. Retrieved July 17, 2012, from http://www.cochrane-net.org/openlearning/html/mod3.htm
*Tucker, K. L., Ozer, D. J., Lyubomirsky, S., & Boehm, J. K. (2006). Testing for measurement invariance in the Satisfaction with Life Scale: A comparison of Russians and North Americans. Social Indicators Research, 78, 341–360.
*Vautier, S., Mullet, E., & Jmel, S. (2004). Assessing the structural robustness of self-rated satisfaction with life: A SEM analysis. Social Indicators Research, 68, 235–249.
*Vittersø, J., Biswas-Diener, R., & Diener, E. (2005). The divergent meanings of life satisfaction: Item response modeling of the Satisfaction with Life Scale in Greenland and Norway. Social Indicators Research, 74, 327–348.
*Westaway, M. S., Maritz, C., & Golele, N. J. (2003). Empirical testing of the Satisfaction with Life Scale: A South African pilot study. Psychological Reports, 92, 551–554.
Whittington, D. (1998). How well do researchers report their measures? An evaluation of measurement in published educational research. Educational and Psychological Measurement, 58, 21–37. doi:10.1177/0013164498058001003.
*Wu, C.-H., & Wu, C.-Y. (2008). Life satisfaction in persons with schizophrenia living in the community. Social Indicators Research, 85, 447–460. doi:10.1007/s11205-007-9136-0.
*Wu, C.-H., & Yao, G. (2006). Analysis of factorial invariance across gender in the Taiwan version of the Satisfaction with Life Scale. Personality and Individual Differences, 40, 1259–1268.
*Wu, C.-H., Chen, L. H., & Tsai, Y.-M. (2009). Longitudinal invariance analysis of the Satisfaction with Life Scale. Personality and Individual Differences, 46, 396–401. doi:10.1016/j.paid.2008.11.002.
Zumbo, B. D. (1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores. Ottawa: Directorate of Human Resources Research and Evaluation, Department of National Defense.
Zumbo, B. D. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions and applications (pp. 65–82). Charlotte: Information Age Publishing.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Chinni, M.L., Hubley, A.M. (2014). A Research Synthesis of Validation Practices Used to Evaluate the Satisfaction with Life Scale (SWLS). In: Zumbo, B., Chan, E. (eds) Validity and Validation in Social, Behavioral, and Health Sciences. Social Indicators Research Series, vol 54. Springer, Cham. https://doi.org/10.1007/978-3-319-07794-9_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-07794-9_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07793-2
Online ISBN: 978-3-319-07794-9
eBook Packages: Humanities, Social Sciences and LawSocial Sciences (R0)